CN107347153B - The quality evaluating method of longitude and latitude figure panoramic video - Google Patents

The quality evaluating method of longitude and latitude figure panoramic video Download PDF

Info

Publication number
CN107347153B
CN107347153B CN201610916893.3A CN201610916893A CN107347153B CN 107347153 B CN107347153 B CN 107347153B CN 201610916893 A CN201610916893 A CN 201610916893A CN 107347153 B CN107347153 B CN 107347153B
Authority
CN
China
Prior art keywords
latitude
frame
longitude
quality
panoramic video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610916893.3A
Other languages
Chinese (zh)
Other versions
CN107347153A (en
Inventor
刘�东
吴仕林
陈志波
李厚强
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Science and Technology of China USTC
Original Assignee
University of Science and Technology of China USTC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Science and Technology of China USTC filed Critical University of Science and Technology of China USTC
Priority to CN201610916893.3A priority Critical patent/CN107347153B/en
Publication of CN107347153A publication Critical patent/CN107347153A/en
Application granted granted Critical
Publication of CN107347153B publication Critical patent/CN107347153B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/154Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/36Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a kind of quality evaluating methods of longitude and latitude figure panoramic video, comprising: for the panoramic video to be evaluated with two longitude and latitude bitmap-formats as reference, carries out each frame respectively and divides latitude down-sampling, obtain corresponding two irregular shape videos;Mean square error, the quality and overall quality frame by frame between two irregular shape videos are calculated frame by frame, to realize the quality evaluation of longitude and latitude figure panoramic video.The advantages of above method is: 1. consider the geometry deformation converted between spherical surface and longitude and latitude figure;2. considering all information on longitude and latitude figure as far as possible.Therefore, the present invention is better than traditional PSNR and S-PSNR.

Description

The quality evaluating method of longitude and latitude figure panoramic video
Technical field
The present invention relates to video quality evaluation technical field more particularly to a kind of quality evaluation sides of longitude and latitude figure panoramic video Method.
Background technique
With the progress of video acquisition and processing technique, panoramic video starts to step into people's lives.Panoramic video It is the video obtained from the scenery at each visual angle is carried out while being recorded centered on video camera.People are in viewing panoramic video When, it can arbitrarily switch visual angle, it is seemingly on the spot in person.Compared with traditional two-dimensional surface video, panoramic video can give user Preferably experience and feeling of immersion are brought, is the indispensable a part of the following virtual reality technology.
But the original data volume of panoramic video is more much bigger than conventional two-dimensional planar video, there is an urgent need to efficient videos Compression method.The difference between video in order to measure the performance of video compress, before needing more compressed video and compression (distortion) carries out quality evaluation by the compressed video of reference pair of the video before compressing.
Substantially, what panoramic video recorded is the video information on spherical surface.Since spherical surface is not easy to indicate, panoramic video is general It is expressed using longitude and latitude bitmap-format.Longitude and latitude figure by the point of spherical surface according to its longitude, dimension map to two-dimensional surface, for example, through Degree is mapped as column coordinate, latitude is mapped as row coordinate, to be rectangle plane by development of a sphere.The video of longitude and latitude bitmap-format can be with The encoder for directlying adopt traditional two-dimensional surface video carries out compressed encoding.
For conventional two-dimensional planar video, there is reference mass evaluation commonly using Y-PSNR (PSNR).But PSNR pairs The video of longitude and latitude bitmap-format is less reasonable, because very big geometry deformation has occurred compared to spherical surface in longitude and latitude figure, closer to the two poles of the earth Region is stretched bigger, and PSNR gives same weight for different location in plane, cannot accurately embody spherical surface The distortion of itself.
A kind of improved spherical surface Y-PSNR (S-PSNR) is researched and proposed, this method equably takes one on spherical surface These positions are mapped on longitude and latitude figure by a little positions, and only calculate the original video on these positions and compressed video it Between distortion.It solves the problems, such as geometry deformation although doing so, limited click-through on spherical surface has only been taken due to S-PSNR Row calculates, and has in fact only used a part of region on longitude and latitude figure, and ignores the distortion in other regions.
Summary of the invention
The object of the present invention is to provide a kind of quality evaluating method of longitude and latitude figure panoramic video, thus pair warp and weft bitmap-format Panoramic video carries out objective metric with the difference (distortion) before compression upon compression, and then helps to optimize panoramic video compression.
The purpose of the present invention is what is be achieved through the following technical solutions:
A kind of quality evaluating method of longitude and latitude figure panoramic video, comprising:
For the panoramic video to be evaluated with two longitude and latitude bitmap-formats as reference, each frame is carried out respectively and divides latitude Down-sampling obtains corresponding two irregular shape videos;
Mean square error, the quality and overall quality frame by frame between two irregular shape videos are calculated frame by frame, thus real The quality evaluation of existing longitude and latitude figure panoramic video.
Carrying out each frame divides the latitude down-sampling to include:
According to spherical surface to the mapping relations of longitude and latitude figure, the over-sampling rate of every latitude is calculated, further according to over-sampling rate Inverse carries out down-sampling to every latitude.
The step of over-sampling rate for calculating every latitude includes:
With row coordinate representation latitude, branch's down-sampling is carried out;Assuming that the height of longitude and latitude figure be N, latitude be from -90 degree to+ 90 degree, then the corresponding latitude θ of the i-th rowiAre as follows:
θi=(180 × i-90 × N-90)/(N-1), i=1,2 ..., N
Assuming that the sample rate of position is 1 under the line, then in latitude θiPosition, over-sampling rate be 1/cos (θi)。
It is described to include: to every latitude progress down-sampling according to the reciprocal of over-sampling rate
Assuming that the width of longitude and latitude figure is M, then need for M pixel to be down sampled to round (M*cos (θi)) a pixel, Middle round indicates to be rounded;
Down-sampling is realized by linear interpolation or cubic interpolation;Wherein, linear interpolation process is as follows:
It enables, K=round (M*cos (θi)), the value of original M pixel is respectively (1) x ..., x (M), the value after interpolation point Not Wei y (1) ..., y (K) then has:
Y (j)=x (j × M/K), j=1,2 ..., K;
If j × M/K is integer, known to corresponding value;
Otherwise, it enables a=floor (j × M/K), b=ceil (j × M/K), floor and ceil are to remove whole and take respectively It is whole, then have:
Y (j)=(j × M/K-a) × x (b)+(b-j × M/K) × x (a).
Mean square error, quality frame by frame and the overall quality between two irregular shape videos of calculating include: frame by frame
Assuming that in the current frame, the difference that the i-th row jth of two irregular shape videos arranges corresponding pixel value is dij
Then mean square error RMSE are as follows:
RMSE=sqrt ((ΣI=1..NΣJ=1..round (M*cos (θi))dij 2)/(ΣI=1..Nround(M*cos(θi))))
Wherein, sqrt indicates extraction of square root, θiFor the corresponding latitude value of the i-th row;
The then corresponding quality Q of present frame are as follows:
Q=10*log10(c2/RMSE);
Wherein, c is constant;
Then the overall quality of video is averaging to obtain by quality frame by frame;Alternatively, being averaging mean square error by mean square error frame by frame Difference, then bring above-mentioned quality into and seek formula to calculate overall quality.
As seen from the above technical solution provided by the invention, the invention has the advantages that 1. consider spherical surface and longitude and latitude The geometry deformation converted between figure;2. considering all information on longitude and latitude figure as far as possible.Therefore, the present invention is better than traditional PSNR and S-PSNR.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, required use in being described below to embodiment Attached drawing be briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for this For the those of ordinary skill in field, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Fig. 1 is a kind of flow chart of the quality evaluating method of longitude and latitude figure panoramic video provided in an embodiment of the present invention;
Fig. 2 is panoramic video schematic diagram provided in an embodiment of the present invention;
Fig. 3 is the schematic diagram of a certain frame of panoramic video of longitude and latitude bitmap-format provided in an embodiment of the present invention;
Fig. 4 is that the panoramic video of pair warp and weft bitmap-format provided in an embodiment of the present invention obtain after branch's down-sampling The schematic diagram of a certain frame of irregular shape video.
Specific embodiment
With reference to the attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete Ground description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Based on this The embodiment of invention, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, belongs to protection scope of the present invention.
The embodiment of the present invention provides a kind of quality evaluating method of longitude and latitude figure panoramic video, as shown in Figure 1, it is mainly wrapped It includes:
Step 11, for it is to be evaluated with as reference two longitude and latitude bitmap-formats panoramic video, carry out respectively each Frame divides latitude down-sampling, obtains corresponding two irregular shape videos.
In the embodiment of the present invention, according to spherical surface to the mapping relations of longitude and latitude figure, the over-sampling rate of every latitude is calculated, then Reciprocal according to over-sampling rate carries out down-sampling to every latitude.Detailed process is as follows:
1) the step of calculating the over-sampling rate of every latitude include:
With row coordinate representation latitude, branch's down-sampling is carried out;Assuming that the height of longitude and latitude figure be N, latitude be from -90 degree to+ 90 degree, then the corresponding latitude θ of the i-th rowiAre as follows:
θi=(180 × i-90 × N-90)/(N-1), i=1,2 ..., N
According to spherical surface calculation formula, θiThe spherical surface circumference of position is proportional to Rcos (θi), wherein R is the radius of ball;
Assuming that the sample rate of position is 1 under the line, then in latitude θiPosition, over-sampling rate be 1/cos (θi)。
2) include: to every latitude progress down-sampling according to the reciprocal of over-sampling rate
Assuming that the width of longitude and latitude figure is M, then need for M pixel to be down sampled to round (M*cos (θi)) a pixel, Middle round indicates to be rounded;
Down-sampling can be realized by linear interpolation or cubic interpolation;Wherein, linear interpolation process is as follows:
It enables, K=round (M*cos (θi)), the value of original M pixel is respectively (1) x ..., x (M), the value after interpolation point Not Wei y (1) ..., y (K) then has:
Y (j)=x (j × M/K), j=1,2 ..., K;
If j × M/K is integer, known to corresponding value;
Otherwise, it enables a=floor (j × M/K), b=ceil (j × M/K), floor and ceil are to remove whole and take respectively It is whole, then have:
Y (j)=(j × M/K-a) × x (b)+(b-j × M/K) × x (a).
It will be understood to those skilled in the art that in addition to linear interpolation used in the examples or cubic interpolation mode, It can also be using other conventional Downsapling methods.
As shown in Fig. 2, being panoramic video schematic diagram;Fig. 3 is the schematic diagram of a certain frame of panoramic video of longitude and latitude bitmap-format;Figure The signal of a certain frame of the 4 irregular shape videos obtained later for panoramic video progress branch's down-sampling of pair warp and weft bitmap-format Figure.
It will be understood by those skilled in the art that the panoramic video to be evaluated with two longitude and latitude bitmap-formats as reference It is handled using aforesaid way.
It will be understood by those skilled in the art that being used as the longitude and latitude figure panoramic video of reference, longitude and latitude figure usually to be evaluated The original version of panoramic video.For example, the video before compression is used as reference, after compression in the compression of longitude and latitude figure panoramic video The video of reconstruction carries out quality evaluation.
Step 12, the frame by frame mean square error between two irregular shape videos of calculating, quality and overall quality frame by frame, To realize the quality evaluation of longitude and latitude figure panoramic video.
Assuming that in the current frame, the difference that the i-th row jth of two irregular shape videos arranges corresponding pixel value is dij
Then mean square error RMSE are as follows:
RMSE=sqrt ((ΣI=1..NΣJ=1..round (M*cos (θi))dij 2)/(ΣI=1..Nround(M*cos(θi))))
Wherein, sqrt indicates extraction of square root, θiFor the corresponding latitude value of the i-th row;
The then corresponding quality Q of present frame are as follows:
Q=10*log10(c2/RMSE);
Wherein, c is constant;
Then the overall quality of video is averaging to obtain by quality frame by frame;Alternatively, being averaging mean square error by mean square error frame by frame Difference, then bring above-mentioned quality into and seek formula to calculate overall quality, i.e., with the RMSE of Averaged Square Error of Multivariate substitution above formula, final meter To Q be expressed as the overall quality of video.
It will be understood to those skilled in the art that the above process can be to two videos after down-sampling, point different face The pixel value of color (such as red, green, blue) calculates separately mean square error and quality, or brightness, coloration is divided to calculate separately mean square error Difference and quality, etc..
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment can The mode of necessary general hardware platform can also be added to realize by software by software realization.Based on this understanding, The technical solution of above-described embodiment can be embodied in the form of software products, which can store non-easy at one In the property lost storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.), including some instructions are with so that a computer is set Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the present invention.
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto, Within the technical scope of the present disclosure, any changes or substitutions that can be easily thought of by anyone skilled in the art, It should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with the protection model of claims Subject to enclosing.

Claims (5)

1. a kind of quality evaluating method of longitude and latitude figure panoramic video characterized by comprising
For the panoramic video to be evaluated with two longitude and latitude bitmap-formats as reference, carry out each frame respectively and divide under latitude to adopt Sample obtains corresponding two irregular shape videos;
Mean square error, the quality and overall quality frame by frame between two irregular shape videos are calculated frame by frame, to realize warp The quality evaluation of latitude figure panoramic video.
2. the quality evaluating method of longitude and latitude figure panoramic video according to claim 1, which is characterized in that carry out each frame point Latitude down-sampling includes:
According to spherical surface to the mapping relations of longitude and latitude figure, the over-sampling rate of every latitude is calculated, further according to the inverse of over-sampling rate Down-sampling is carried out to every latitude.
3. the quality evaluating method of longitude and latitude figure panoramic video according to claim 2, which is characterized in that described to calculate often The step of over-sampling rate of latitude includes:
With row coordinate representation latitude, branch's down-sampling is carried out;Assuming that the height of longitude and latitude figure is N, latitude is spent from -90 degree to+90, The then corresponding latitude θ of the i-th rowiAre as follows:
θi=(180 × i-90 × N-90)/(N-1), i=1,2 ..., N
Assuming that the sample rate of position is 1 under the line, then in latitude θiPosition, over-sampling rate be 1/cos (θi)。
4. the quality evaluating method of longitude and latitude figure panoramic video according to claim 3, which is characterized in that described to be adopted according to mistake The inverse of sample rate carries out down-sampling to every latitude
Assuming that the width of longitude and latitude figure is M, then need for M pixel to be down sampled to round (M*cos (θi)) a pixel, wherein Round indicates to be rounded;
Down-sampling is realized by linear interpolation or cubic interpolation;Wherein, linear interpolation process is as follows:
It enables, K=round (M*cos (θi)), the value of original M pixel is respectively (1) x ..., x (M), and the value after interpolation is respectively y (1) ..., y (K), then have:
Y (j)=x (j × M/K), j=1,2 ..., K;
If j × M/K is integer, known to corresponding value;
Otherwise, enable a=floor (j × M/K), b=ceil (j × M/K), floor and ceil be respectively remove it is whole and take it is whole, Then have:
Y (j)=(j × M/K-a) × x (b)+(b-j × M/K) × x (a).
5. the quality evaluating method of longitude and latitude figure panoramic video according to claim 1, which is characterized in that calculate two frame by frame Mean square error between irregular shape video, quality frame by frame and overall quality include:
Assuming that in the current frame, the difference that the i-th row jth of two irregular shape videos arranges corresponding pixel value is dij
Then mean square error RMSE are as follows:
RMSE=sqrt ((ΣI=1..NΣJ=1..round (M*cos (θi))dij 2)/(ΣI=1..Nround(M*cos(θi))))
Wherein, sqrt indicates extraction of square root, θiFor the corresponding latitude value of the i-th row, M is the width of longitude and latitude figure, and N is the height of longitude and latitude figure Degree, round indicate to be rounded;
The then corresponding quality Q of present frame are as follows:
Q=10*log10(c2/RMSE);
Wherein, c is constant;
Then the overall quality of video is averaging to obtain by quality frame by frame;Alternatively, mean square error is averaging by mean square error frame by frame, then It brings above-mentioned quality into and seeks formula to calculate overall quality.
CN201610916893.3A 2016-10-20 2016-10-20 The quality evaluating method of longitude and latitude figure panoramic video Active CN107347153B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610916893.3A CN107347153B (en) 2016-10-20 2016-10-20 The quality evaluating method of longitude and latitude figure panoramic video

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610916893.3A CN107347153B (en) 2016-10-20 2016-10-20 The quality evaluating method of longitude and latitude figure panoramic video

Publications (2)

Publication Number Publication Date
CN107347153A CN107347153A (en) 2017-11-14
CN107347153B true CN107347153B (en) 2019-02-26

Family

ID=60253768

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610916893.3A Active CN107347153B (en) 2016-10-20 2016-10-20 The quality evaluating method of longitude and latitude figure panoramic video

Country Status (1)

Country Link
CN (1) CN107347153B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108271020B (en) * 2018-04-24 2019-08-09 福州大学 A kind of panoramic video quality evaluating method of view-based access control model attention model
CN108833976B (en) 2018-06-27 2020-01-24 深圳看到科技有限公司 Method and device for evaluating picture quality after dynamic cut-stream of panoramic video

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101227604A (en) * 2007-01-18 2008-07-23 上海未来宽带技术及应用工程研究中心有限公司 Method for detecting network video quality by network injury tolerance
CN101448173A (en) * 2008-10-24 2009-06-03 华为技术有限公司 Method for evaluating Internet video quality, device and system thereof
TW201424343A (en) * 2012-12-03 2014-06-16 Arcadyan Technology Corp Method and apparatus for testing video signals
CN105915892A (en) * 2016-05-06 2016-08-31 乐视控股(北京)有限公司 Panoramic video quality determination method and system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070088516A1 (en) * 2005-10-14 2007-04-19 Stephen Wolf Low bandwidth reduced reference video quality measurement method and apparatus

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101227604A (en) * 2007-01-18 2008-07-23 上海未来宽带技术及应用工程研究中心有限公司 Method for detecting network video quality by network injury tolerance
CN101448173A (en) * 2008-10-24 2009-06-03 华为技术有限公司 Method for evaluating Internet video quality, device and system thereof
TW201424343A (en) * 2012-12-03 2014-06-16 Arcadyan Technology Corp Method and apparatus for testing video signals
CN105915892A (en) * 2016-05-06 2016-08-31 乐视控股(北京)有限公司 Panoramic video quality determination method and system

Also Published As

Publication number Publication date
CN107347153A (en) 2017-11-14

Similar Documents

Publication Publication Date Title
US10474227B2 (en) Generation of virtual reality with 6 degrees of freedom from limited viewer data
US10552989B2 (en) Point cloud attribute compression method based on KD tree and optimized graph transformation
US10991072B2 (en) Method and device for fusing panoramic video images
Lee et al. GROOT: a real-time streaming system of high-fidelity volumetric videos
US20180033209A1 (en) Stereo image generation and interactive playback
CN108898630A (en) A kind of three-dimensional rebuilding method, device, equipment and storage medium
US20220028119A1 (en) Method, device, and computer-readable recording medium for compressing 3d mesh content
CN112686877B (en) Binocular camera-based three-dimensional house damage model construction and measurement method and system
CN103345771A (en) Efficient image rendering method based on modeling
US10444931B2 (en) Vantage generation and interactive playback
CN108668108B (en) Video monitoring method and device and electronic equipment
CN111111167A (en) Sound effect playing method and device in game scene and electronic device
WO2019165863A1 (en) Optimization method for encoding-block-level lagrangian multiplier of equirectangular image
CN111294584B (en) Three-dimensional scene model display method and device, storage medium and electronic equipment
CN111435551B (en) Point cloud filtering method and device and storage medium
CN107347153B (en) The quality evaluating method of longitude and latitude figure panoramic video
KR20210020028A (en) Method and apparatus for encoding 3D image, and method and apparatus for decoding 3D image
CN111273877A (en) Linkage display platform and linkage method for live-action three-dimensional data and two-dimensional grid picture
CN114066999A (en) Target positioning system and method based on three-dimensional modeling
CN109697748A (en) Model compression processing method, model pinup picture processing method device, storage medium
KR20220035229A (en) Method and apparatus for delivering volumetric video content
CN107093197B (en) Animation compression method based on local cylindrical coordinates
CN113613011A (en) Light field image compression method and device, electronic equipment and storage medium
EP4040397A1 (en) Method and computer program product for producing a 3d representation of an object
KR102612539B1 (en) Multiview video encoding and decoding method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant