CN106488233A - A kind of panoramic video rhombus method of sampling and device - Google Patents
A kind of panoramic video rhombus method of sampling and device Download PDFInfo
- Publication number
- CN106488233A CN106488233A CN201610933426.1A CN201610933426A CN106488233A CN 106488233 A CN106488233 A CN 106488233A CN 201610933426 A CN201610933426 A CN 201610933426A CN 106488233 A CN106488233 A CN 106488233A
- Authority
- CN
- China
- Prior art keywords
- sampling
- data
- row
- sphere
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
Abstract
The invention discloses a kind of panoramic video rhombus method of sampling and device, the method includes：Required according to spatial resolution, sphere is divided into N=2K annular surface with equally spaced parallel, annular surface is designated as O successivelyi；With equally spaced warp by annular surface OiIt is divided evenly into Ti2 4M region of=2N；The mean value of the light in each region on calculated sphere, used as the sampled value of the corresponding sampled point in the region；Sampled value is aligned in the matrix of a N × N.The present invention sampled point can be made to meet on sphere equator sampling number is many, the few characteristic of the two poles of the earth sampling number, the property of the distribution character of the sampling number with rhombus distribution on longitude and latitude figure, so referred to as rhombus sampling.The method of sampling avoids sampling structure redundancy so that under conditions of identical spatial resolution is reached, and sampling number reduces, and the data volume after sampling reduces.
Description
Technical field
The present invention relates to video coding technique, more particularly to a kind of panoramic video rhombus method of sampling and device.
Background technology
Panoramic video refers in space all of scene of point of observation surrounding, the institute that can be received by this point of observation
Light is had to constitute.Panoramic video can be abstracted into a sphere centered on point of observation.
When active computer processes panoramic video, inevitably discretized space is carried out to panoramic video and adopt
Sample.When panoramic video is carried out discretized space sampling, need to ensure certain space sampling densities, with needed for reaching
Definition.Meanwhile, consider that the memory of computer is not suitable for storing the data of spherical structure again, need in some way
Sampled point is aligned in plane.
Sphere sampling process is generally divided into three steps by the existing sphere method of sampling：The first step, mapping, spherical Map
For a region in plane；Second step, plane are sampled, and design the distribution side of sampled point based on the plane domain after mapping
Formula；3rd step, arrangement, sampled point is arranged as a rectangle.
The first step map during, be not often homalographic mapping, and the zones of different of sphere before the mapping after
The ratio of area is also different.During second step plane is sampled, often sampled point is designed in the mapped is flat
Face is uniformly distributed in region.The first step and second step combine, and will result in skewness of the sampled point on sphere.Reason
By upper, the equatorial sampling number of sphere should nearby sampling number be many than the two poles of the earth.3rd step tends not to do in arrangement
To the complete adjacent of content, it is unfavorable to bring to Video coding compression.
At present, there are three kinds of conventional sphere method of samplings：Longitude and latitude figure is sampled, and hexahedron sampling and pyramid are sampled.
The sampling of longitude and latitude figure is as shown in figure 1, any one point can be with residing longitude θ and latitude on sphereDescription, θ ∈
[0,2 π),Then spherical Map can be arrivedCoordinate system next one the ratio of width to height is 2:1 rectangle.Right
This rectangle carries out uniform sampling.Although the longitude and latitude figure method of sampling is sampled near the two poles of the earth of sphere with complete adjacency
Density is too high, can produce very big redundancy.
Hexahedron sampling as shown in Fig. 2 first by spherical Map for its circumscribed regular hexahedron six faces, so as to obtain six
Individual plane square, then uniform sampling is carried out to six plane squares, finally by some way six squares are combined into one
Individual rectangle.Distribution of the sampled point of hexahedron sampling on sphere is also uneven, still there is larger redundancy, and square
The content of shape does not have complete adjacency yet.
Pyramid sampling as shown in figure 3, be a circumscribed positive rectangular pyramid first by spherical Map, then by the every of the positive rectangular pyramid
Individual side (isosceles triangle) is compressed along the direction of base vertical line, until drift angle becomes at a right angle.So bottom surface and four warps
The side for crossing Quadratic Map can just be combined into a square.Finally uniform sampling is carried out to this square.Pyramid is sampled
Distribution of the sampled point on sphere be also uneven, the content of rectangle does not also have complete adjacency.Its degree of irregularity
Sample and hexahedron sampling between longitude and latitude figure, degree of redundancy is also sampled and hexahedron sampling between longitude and latitude figure.
In sum, the major defect of the existing panoramic video method of sampling is the presence of larger sampling structure redundancy and most
The rectangle that end form becomes does not have content intact adjacency.Sampled point uneven distribution on sphere, not only can bring sampling redundancy,
Returning video quality evaluation makes troubles, because the corresponding area of spherical surface of final sampled point is different, therefore each sampling
Impact of the distortion of point to video quality is also different, processes through certain panoramic video is calculated, for example compressed and decompressed
During rear mass loss, it is necessary to consider that the importance of each sampled point is different.Rectangular video in terms of content non-conterminous
Property is also unfavorable for the compressed encoding of Video coding.
Content of the invention
For overcoming the shortcomings of the presence of above-mentioned prior art, the purpose of the present invention is to provide a kind of sampling of panoramic video rhombus
Method and device, it is many which can make distribution of the sampled point on sphere meet equator sampling number, the neighbouring sampled point in the two poles of the earth
Number is little, so as to avoid sampling structure redundancy so that under conditions of identical spatial resolution is reached, sampling number subtracts
Few, and, the rectangle being combined into has complete content adjacency, can improve compression coding efficiency.
For reaching above and other purpose, the present invention proposes a kind of panoramic video rhombus method of sampling, comprises the steps：
Step one, requires according to spatial resolution, sphere is divided into N=2K annular surface with equally spaced parallel, N is
Even number, K are integer.The annular surface for obtaining is designated as O successivelyi, i=0,1 ..., N-1, observe from the angle of the centre of sphere, OiAccording to
Order arrangement from top to bottom；
Step 2, with equally spaced warp by annular surface Oi(i=K+M or i=K-1-M, M=0,1,2 ..., K-1)
2N-2-4M region is divided evenly into, wherein one warp is 0 ° of warp.The region for obtaining is designated as A successivelyi,j, j=0,
1 ..., 2N-3-4M, observe from the angle of the centre of sphere, Ai,jIncrease according to the east longitude number of degrees or the order of west longitude number of degrees minimizing is arranged, its
Middle Ai,0And Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp；
Step 3, each region A on the sphere that calculation procedure two is obtainedi,jThe mean value of interior light, used as the area
Sampled value S of the corresponding sampled point in domaini,j.
Step 4, sampled value is aligned in the matrix of a N × N, Bx,yThe element of representing matrix xth row y row, Ti
Represent OiAreal, then
Bx,y=Si,j.Work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j.Work as y-x>During K, j=x-Ti+ 1, i=y-K-1；
Bx,y=Si,j.Work as x-y>During K, j=Ti+ k-x, i=k+x；
Bx,y=Si,j.Work as x+y>During 3K-1, j=Ti+ x-2K, i=3k-1-y；
Bx,y=Si,j.When working as x, y and being not belonging to four kinds of situations above, j=y-Ti/ 2, i=x；
Further, in step one, N is even number, is the convenience of computer disposal, and N can take 16 multiple；
Further, in step 2, when the value of i increases from 0 to K-1, OiThe divided number of regions for obtaining is 2,6,
10 ..., 2N-2, become an arithmetic progression, tolerance is 4；When the value of i increases from K to 2K-1, OiThe divided number of regions for obtaining
For 2N-2,2N-6 ..., 6,2, become an arithmetic progression, tolerance is -4, and the sum of sampled point is N2.
Further, in step 3, the numbering of sampled point is (i, 0), (i, 1) ..., (i, Ti- 1), Ti=2N-4* | i-
(N-1)/2|.
Further, in step 3, numbering is the corresponding region of sampled point of (i, 0) and numbering is (i, Mi- 1) adopt
The corresponding region of sampling point is adjacent, and their cut-off rule is 0 degree of warp, observes from the angle of the centre of sphere, and numbering is adopting for (i, k)
The corresponding region of sampling point is in the left side in the corresponding region of sampled point that numbering is (i, k+1).
Further, the method also includes：In storage, N is recorded first；Then by the data of all sampled points of gained
Form a line in the following order：(0,0),(0,1),...,(0,M0-1),(1,0),(1,1),...,(1,M1-1),...,(N-
1,0),(N-1,1),...,(N-1,MN-1-1).
Further, the method also includes：When showing in flat-panel screens, the sample point data of gained is arranged in one
In individual N row, the rectangular area of M row, and by the alignment of data that each line number is (i, 0), other data are arranged in order, rectangle region
The part that does not fill up in domain is filled with arbitrary data.
Further, the method also includes：Need to tear the sampling number of each frame open and a N row, the rectangle of N row be combined into,
Specifically tearing splicing method open is：The sample point data of gained is first arranged in the rectangle of a N row, 2N row, then with 0 ° of warp both sides
Each K row, used as front hemisphere, remaining N-2 column data hemisphere data will be arranged together in one as rear quarter to common N column data in front and back
Individual N row, N row, in the rectangle of N row N-2 row, then the diamond data region of rear quarter are divided into 4 parts, by while while between phase
Adjacent relation is spliced to the area without data in front hemisphere rectangle respectively, makes all have video data in front hemisphere rectangle, and number
According between can realize according to step 4 with complete neighbouring relations, concrete permutation algorithm.
For reaching above-mentioned purpose, the present invention also provides a kind of panoramic video rhombus sampling apparatus, including：
Sphere cutting unit, requires according to spatial resolution, sphere is divided into N=2K annular with equally spaced parallel bent
Face, N are even number, and K is integer.The annular surface for obtaining is designated as O successivelyi, i=0,1 ..., N-1, see from the angle of the centre of sphere
Examine, OiArrange in accordance with the order from top to bottom；
Annular surface cutting unit, with equally spaced warp by annular surface Oi(i=K+M or i=K-1-M, M=0,1,
2 ..., K-1) 2N-2-4M region is divided evenly into, and wherein one warp is 0 ° of warp.The region for obtaining is designated as successively
Ai,j, j=0,1 ..., 2N-3-4M, observe from the angle of the centre of sphere, Ai,jThat reduced according to the increase of the east longitude number of degrees or the west longitude number of degrees is suitable
Sequence is arranged, wherein Ai,0And Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp；
Sampled value computing unit, each region A on the sphere that calculation procedure two is obtainedi,jThe mean value of interior light,
Sampled value S as the corresponding sampled point in the regioni,j.
Arrangement units, sampled value are aligned in the matrix of a N × N, Bx,yThe element of representing matrix xth row y row,
TiRepresent OiAreal, then
Bx,y=Si,j, work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j, work as y-x>During K, j=x-Ti+ 1, i=y-K-1；
Bx,y=Si,j, work as x-y>During K, j=Ti+ k-x, i=k+x；
Bx,y=Si,j, work as x+y>During 3K-1, j=Ti+ x-2K, i=3k-1-y；
Bx,y=Si,j, when working as x, y and being not belonging to four kinds of situations above, j=y-Ti/ 2, i=x；
Further, the device records N in storage, first；Then by the data of all sampled points of gained according to
Lower order forms a line：(0,0),(0,1),...,(0,T0-1),(1,0),(1,1),...,(1,T1-1),...,(N-1,0),
(N-1,1),...,(N-1,TN-1-1)；When showing in flat-panel screens, by the sample point data of gained be arranged in a N row,
In the rectangular area of 2N row, and by the alignment of data that each line number is (i, 0), other data are arranged in order, in rectangular area
The part that does not fill up is filled with arbitrary data.
Compared with prior art, a kind of panoramic video rhombus method of sampling of the present invention and device sampled point dividing on sphere
It is covered with sufficient equator sampling number many, nearby sampling number is little at the two poles of the earth, so as to avoid sampling structure redundancy so that reaching
To under conditions of identical spatial resolution, sampling number is reduced, and, the rectangle being combined into has complete content adjacency,
Compression coding efficiency can be improved.
Description of the drawings
Fig. 1 is the schematic diagram of longitude and latitude figure sampling in the prior art sphere method of sampling；
Fig. 2 is the schematic diagram of hexahedron sampling in the prior art sphere method of sampling；
Fig. 3 is the lab diagram of pyramid sampling in the prior art sphere method of sampling；
The step of Fig. 4 is a kind of panoramic video rhombus method of sampling of present invention flow chart；
Fig. 5 is a kind of system architecture diagram of panoramic video rhombus sampling apparatus of the present invention；
Fig. 6 show a wherein width figure of a panoramic video represented with the longitude and latitude figure that resolution ratio is 4096 × 2048
Picture；
Fig. 7 show the display image using gained after the present invention.
Fig. 8 show the intermediate image for tearing Heisei coded image using the display figure of gained after the present invention open.
Fig. 9 show the coded image using gained after the present invention.
Specific embodiment
Below by way of specific instantiation and embodiments of the present invention are described with reference to the drawings, those skilled in the art can
Understood further advantage and effect of the present invention by content disclosed in the present specification easily.The present invention also can be different by other
Instantiation implemented or applied, the every details in this specification also can based on different viewpoints and application, without departing substantially from
Various modifications and change is carried out under the spirit of the present invention.
The step of Fig. 4 is a kind of panoramic video rhombus method of sampling of present invention flow chart.As shown in figure 4, the present invention is a kind of
The panoramic video rhombus method of sampling, comprises the steps：
Step 401, requires according to spatial resolution, sphere is divided into N=2K annular surface, N with equally spaced parallel
For even number, K is integer.The annular surface for obtaining is designated as O successivelyi, i=0,1 ..., N-1, observe from the angle of the centre of sphere, OiPress
According to order arrangement from top to bottom；
Step 402, with equally spaced warp by annular surface Oi(i=K+M or i=K-1-M, M=0,1,2 ..., K-1)
2N-2-4M region is divided evenly into, wherein one warp is 0 ° of warp.The region for obtaining is designated as A successivelyi,j, j=0,
1 ..., 2N-3-4M, observe from the angle of the centre of sphere, Ai,jIncrease according to the east longitude number of degrees or the order of west longitude number of degrees minimizing is arranged, its
Middle Ai,0And Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp；
Step 403, each region A on the sphere that calculation procedure two is obtainedi,jThe mean value of interior light, used as this
Sampled value S of the corresponding sampled point in regioni,j.
Step 404, sampled value is aligned in the matrix of a N × N, Bx,yThe element of representing matrix xth row y row, Ti
Represent OiAreal, then
Bx,y=Si,j.Work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j.Work as y-x>During K, j=x-Ti+ 1, i=y-K-1；
Bx,y=Si,j.Work as x-y>During K, j=Ti+ k-x, i=k+x；
Bx,y=Si,j.Work as x+y>During 3K-1, j=Ti+ x-2K, i=3k-1-y；
Bx,y=Si,j.When working as x, y and being not belonging to four kinds of situations above, j=y-Ti/ 2, i=x；
In storage, N and M is recorded first.Then the data of all sampled points of gained are lined up one in the following order
Row：(0,0),(0,1),...,(0,T0-1),(1,0),(1,1),...,(1,T1-1),...,(N-1,0),(N-1,1),...,
(N-1,TN-1-1).
When showing in flat-panel screens, the sample point data of gained can be arranged in the rectangle region of a N row, M row
In domain, and by the alignment of data that each line number is (i, 0), other data are arranged in order.The portion that does not fill up in rectangular area
Divide and can be filled with arbitrary data.
When coding is compressed, need the sampling number of each frame is torn open the rectangle for being combined into that a N row, N are arranged, tool
Body tears splicing method open：A N row, the rectangle of 2N row are arranged in as stated above first, then with each K row in 0 ° of warp both sides, common N is arranged
Used as front hemisphere, remaining N-2 column data hemisphere data will be arranged together in one as rear quarter to data in front and back as stated above
N row, N row, in the rectangle of N row N-2 row, then the diamond data region of rear quarter are divided into 4 parts, by while while between adjacent
Relation is spliced to the area without data in front hemisphere rectangle respectively, makes all have video data, and data in front hemisphere rectangle
Between can realize according to step 404 with complete neighbouring relations, concrete permutation algorithm.
Fig. 5 is a kind of system architecture diagram of panoramic video rhombus sampling apparatus of the present invention.As shown in figure 5, the present invention is a kind of
Panoramic video rhombus sampling apparatus, including：Sphere cutting unit 501, annular surface cutting unit 502, sampled value computing unit
503 and arrangement units 504.
Wherein, sphere cutting unit 501, requires according to spatial resolution, sphere is divided into N=2K with equally spaced parallel
Individual annular surface, N are even number, and K is integer.The annular surface for obtaining is designated as O successivelyi, i=0,1 ..., N-1, from the centre of sphere
Angle is observed, OiArrange in accordance with the order from top to bottom.
Annular surface cutting unit 502, with equally spaced warp by annular surface Oi(i=K+M or i=K-1-M, M=0,
1,2 ..., K-1) 2N-2-4M region is divided evenly into, and wherein one warp is 0 ° of warp.The region for obtaining is designated as successively
Ai,j, j=0,1 ..., 2N-3-4M, observe from the angle of the centre of sphere, Ai,jThat reduced according to the increase of the east longitude number of degrees or the west longitude number of degrees is suitable
Sequence is arranged, wherein Ai,0And Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp.
Sampled value computing unit 503, calculates each region A on the sphere that annular surface cutting unit 502 is obtainedi,j
The mean value of interior light, used as sampled value S of the corresponding sampled point in the regioni,j.
Arrangement units 504, for sampled value being aligned in the matrix of a N × N, Bx,yRepresenting matrix xth row y is arranged
Element, TiRepresent OiAreal, then
Bx,y=Si,j.Work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j.Work as y-x>During K, j=x-Ti, i=y-K-1；
Bx,y=Si,j.Work as x-y>During K, j=Ti+ k+1-x, i=k+x；
Bx,y=Si,j.Work as x+y>During 3K-1, j=Ti+ x+1-2K, i=3k-1-y；
Bx,y=Si,j.When working as x, y and being not belonging to four kinds of situations above, j=y- (Ti+ 2)/2, i=x；
The present invention records N in storage, first.Then the data of all sampled points of gained are lined up in the following order
One row：(0,0),(0,1),...,(0,T0-1),(1,0),(1,1),...,(1,T1-1),...,(N-1,0),(N-1,
1),...,(N-1,TN-1-1).
When showing in flat-panel screens, the sample point data of gained can be arranged in the rectangle region of a N row, 2N row
In domain, and by the alignment of data that each line number is (i, 0), other data are arranged in order.The portion that does not fill up in rectangular area
Divide and can be filled with arbitrary data.
When coding is compressed, need the sampling number of each frame is torn open the rectangle for being combined into that a N row, N are arranged, tool
Body tears splicing method open：The rectangle of a N row, 2N row is first arranged in by method when showing in flat-panel screens, then with 0 ° of warp
The each K row in line both sides, common N column data used as front hemisphere, hemisphere data will press flat in front and back as rear quarter by remaining N-2 column data
Method when showing on the display of face is arranged together in a N row, N row, in the rectangle of N row N-2 row, then the rhombus by rear quarter
Data area is divided into 4 parts, by while while between neighbouring relations be spliced to the area without data in front hemisphere rectangle respectively, make
All have in front hemisphere rectangle between video data, and data with complete neighbouring relations, concrete permutation algorithm can be according to
Realized by arrangement units 504.
Hereinafter the present invention will be further illustrated by specific embodiment：
Embodiment one
It is illustrated in figure 6 a wherein width figure of a panoramic video represented with the longitude and latitude figure that resolution ratio is 4096 × 2048
Picture, in the specific embodiment of the invention, the panoramic video is color video, with three components.Assume that adopted color is divided
Amount is RGB, still represents the color of each sampled point after sampling with RGB.Assume spatial resolution requirement to three components be
Identical, is all N=1024, M=2048, and it is also identical that quantified precision is required to each component, is all to be quantified as 256 grades.
Then to each component, step one is repeated below to step 4：
Sphere is divided into 1024=2*512 annular surface with equally spaced parallel by the first step.By the annular surface for obtaining
O is designated as successivelyi, i=0,1 ..., 1023, observes from the angle of the centre of sphere, OiArrange in accordance with the order from top to bottom；
Second step, with equally spaced warp by annular surface Oi(i=512+M or i=512-1-M, M=0,1,2 ...,
K-1) 2048-2-4M region is divided evenly into, and wherein one warp is 0 ° of warp.The region for obtaining is designated as A successivelyi,j, j
=0,1 ..., 2048-3-4M, observe from the angle of the centre of sphere, Ai,jAccording to the order that the increase of the east longitude number of degrees or the west longitude number of degrees are reduced
Arrangement, wherein Ai,0And Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp；
3rd step, each region A on the sphere that calculation procedure two is obtainedi,jThe mean value of interior light, and carry out
256 grades of quantizations, obtain the integer value between 0 to 255, as the sampled value of the corresponding sampled point in the region, are designated as Si,j.
4th step, sampled value is aligned in the matrix of 1024 × 1024, Bx,yThe unit of representing matrix xth row y row
Element, TiRepresent OiAreal, then
Bx,y=Si,j.Work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j.Work as y-x>During K, j=x-Ti+ 1, i=y-K-1；
Bx,y=Si,j.Work as x-y>During K, j=Ti+ k-x, i=k+x；
Bx,y=Si,j.Work as x+y>During 3K-1, j=Ti+ x-2K, i=3k-1-y；
Bx,y=Si,j.When working as x, y and being not belonging to four kinds of situations above, j=y-Ti/ 2, i=x；
In storage, the line number 1024 of each component samples is recorded first.Then by the data of all sampled points of gained
Form a line in the following order：(0,0),(0,1),...,(0,T0-1),(1,0),(1,1),...,(1,T1-1),...,
(1023,0),(1023,1),...,(1023,T1023-1).Three components of same sampled point are arranged according to the order of B, G, R
Row.
When showing in flat-panel screens, the sampled point of gained can be arranged in the rectangle of 1024 row, 2048 row
In region, and the data by each line number for (i, 0) are placed on the 1024th position of every a line, and numbering is (i, k), k=
1..Ti/ 2, the data of sampled point be placed on the 1024+k position of the i-th row, numbering is (i, Ti- k), k=1..Ti/ 2-1, adopt
The data of sampling point are placed on the 1024-k position of the i-th row.The part that does not fill up in rectangular area 255 fillings, gained image
As shown in Figure 7
In compressed encoding, need to tear the sampling number of each frame open 1024 row, the rectangles of 1024 row are combined into, specifically
Tearing splicing method open is：The rectangle of 1024 row, 2048 row is first arranged in by method when showing in flat-panel screens, then basis
Diamond data region is divided into two rhombuses and exists in two 1024 row, the rectangle of 1024 row, as shown in figure 8, again by hemisphere in front and back
The diamond data region of rear quarter is divided into 4 parts, by while while between neighbouring relations be spliced in front hemisphere rectangle respectively
Area without data, make in front hemisphere rectangle, all have video data, gained image is as shown in Figure 9.
Embodiment two
It is illustrated in figure 6 a wherein width figure of a panoramic video represented with the longitude and latitude figure that resolution ratio is 4096 × 2048
Picture, in the specific embodiment of the invention, the panoramic video is color video, with three components.Assume that adopted color is divided
Amount is YcbCr, and oversampling ratio is 4:4:4, still represent the color of each sampled point after sampling with YCbCr.Assume that space is clear
The requirement of degree is N=1024,2N=2048 to Y-component, is N=512 to Cb and Cr component, 2N=1024, and quantified precision is required
It is identical to each component, is all to be quantified as 256 grades.
Then to Y-component, following steps are carried out：
Sphere is divided into 1024=2*512 annular surface with equally spaced parallel by the first step.By the annular surface for obtaining
O is designated as successivelyi, i=0,1 ..., 1023, observes from the angle of the centre of sphere, OiArrange in accordance with the order from top to bottom；
Second step, with equally spaced warp by annular surface Oi(i=512+M or i=512-1-M, M=0,1,2 ...,
K-1) 2048-2-4M region is divided evenly into, and wherein one warp is 0 ° of warp.The region for obtaining is designated as A successivelyi,j, j
=0,1 ..., 2048-3-4M, observe from the angle of the centre of sphere, Ai,jAccording to the order that the increase of the east longitude number of degrees or the west longitude number of degrees are reduced
Arrangement, wherein Ai,0And Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp；
3rd step, each region A on the sphere that calculation procedure two is obtainedi,jThe mean value of interior light, and carry out
256 grades of quantizations, obtain the integer value between 0 to 255, as the sampled value of the corresponding sampled point in the region, are designated as Si,j.
4th step, sampled value is aligned in the matrix of 1024 × 1024, Bx,yThe unit of representing matrix xth row y row
Element, TiRepresent OiAreal, then
Bx,y=Si,j.Work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j.Work as y-x>During K, j=x-Ti+ 1, i=y-K-1；
Bx,y=Si,j.Work as x-y>During K, j=Ti+ k-x, i=k+x；
Bx,y=Si,j.Work as x+y>During 3K-1, j=Ti+ x-2K, i=3k-1-y；
Bx,y=Si,j.When working as x, y and being not belonging to four kinds of situations above, j=y-Ti/ 2, i=x；
Then to Cb and Cr component, following steps are carried out respectively：
Sphere is divided into 512=2*256 annular surface with equally spaced parallel by the first step.By the annular surface for obtaining
O is designated as successivelyi, i=0,1 ..., 512, observes from the angle of the centre of sphere, OiArrange in accordance with the order from top to bottom；
Second step, with equally spaced warp by annular surface Oi(i=256+M or i=256-1-M, M=0,1,2 ...,
K-1) 1024-2-4M region is divided evenly into, and wherein one warp is 0 ° of warp.The region for obtaining is designated as A successivelyi,j, j
=0,1 ..., 1024-3-4M, observe from the angle of the centre of sphere, Ai,jAccording to the order that the increase of the east longitude number of degrees or the west longitude number of degrees are reduced
Arrangement, wherein Ai,0And Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp；
3rd step, each region A on the sphere that calculation procedure two is obtainedi,jThe mean value of interior light, and carry out
256 grades of quantizations, obtain the integer value between 0 to 255, as the sampled value of the corresponding sampled point in the region, are designated as Si,j.
4th step, sampled value is aligned in the matrix of 512 × 512, Bx,yThe unit of representing matrix xth row y row
Element, TiRepresent OiAreal, then
Bx,y=Si,j.Work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j.Work as y-x>During K, j=x-Ti+ 1, i=y-K-1；
Bx,y=Si,j.Work as x-y>During K, j=Ti+ k-x, i=k+x；
Bx,y=Si,j.Work as x+y>During 3K-1, j=Ti+ x-2K, i=3k-1-y；
Bx,y=Si,j.When working as x, y and being not belonging to four kinds of situations above, j=y-Ti/ 2, i=x；
In storage, the line number 1024 of record Y-component sampling and maximum sampling number 2048, Cb component of often going are adopted first
The line number 512 of sample and the often maximum sampling number 1024 of row.The line number 512 of Cr component samples and the often maximum sampling number of row
1024.Then the data of the Y-component sampled point of gained are formed a line in the following order：(0,0),(0,1),...,(0,M0-
1),(1,0),(1,1),...,(1,T1-1),...,(1023,0),(1023,1),...,(1023,T1023-1).Adopt in Y-component
The data of the Cb component samples point of gained are formed a line in the following order after the data of sampling point：(0,0),(0,1),...,
(0,T0-1),(1,0),(1,1),...,(1,T1-1),...,(511,0),(511,1),...,(511,T511-1).In Cb component
The data of the Cr component samples point of gained are formed a line in the following order after the data of sampled point：(0,0),(0,
1),...,(0,T0-1),(1,0),(1,1),...,(1,M1-1),...,(511,0),(511,1),...,(511,T511-1).
In compressed encoding, need to tear the Y-component sampling number of each frame open and be combined into 1024 row, the squares of 1024 row
Shape, Cb and Cr component are torn open respectively and are combined into 512 row, the rectangle of 512 row.Specifically tearing splicing method open is：First by flat-panel screens
Y-component is arranged in method during display the rectangles of 1024 row, 2048 row, then according to hemisphere in front and back by diamond data area
Domain is divided into two rhombuses to be present in two 1024 row, the rectangle of 1024 row, then the diamond data region of rear quarter is divided into 4
Part, by while while between neighbouring relations be spliced to the area without data in front hemisphere rectangle respectively, make in front hemisphere rectangle complete
There is video data in portion；Then Cb and Cr component is torn open respectively by the method for Y-component respectively and is combined into 512 row, the square of 512 row
Shape.
In sum, the distribution of a kind of panoramic video rhombus method of sampling of the present invention and device sampled point on sphere meets
Equator sampling number is many, and nearby sampling number is little at the two poles of the earth, so as to avoid sampling structure redundancy so that identical reaching
Spatial resolution under conditions of, sampling number reduce, and, the rectangle being combined into has complete content adjacency, can improve
Compression coding efficiency.
Above-described embodiment only principle of the illustrative present invention and its effect, not for the restriction present invention.Any
Skilled person all can be modified to above-described embodiment and is changed without prejudice under the spirit and the scope of the present invention.Therefore,
The scope of the present invention, should be as listed by claims.
Claims (10)
1. a kind of panoramic video rhombus method of sampling, comprises the steps：
Step one, requires according to spatial resolution, sphere is divided into N=2K annular surface with equally spaced parallel, and N is even
Number, K are integer, and the annular surface for obtaining is designated as O successivelyi, i=0,1 ..., N-1, observe from the angle of the centre of sphere, OiAccording to from
Order arrangement top to bottm；
Step 2, with equally spaced warp by annular surface Oi(i=K+M or i=K-1-M, M=0,1,2 ..., K-1) equably
It is divided into 2N-2-4M region, wherein one warp is 0 ° of warp, and the region for obtaining is designated as A successivelyi,j, j=0,1 ..., 2N-
3-4M, observes from the angle of the centre of sphere, Ai,jIncrease according to the east longitude number of degrees or the order of west longitude number of degrees minimizing is arranged, wherein Ai,0With
Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp；
Step 3, each region A on the sphere that calculation procedure two is obtainedi,jThe mean value of interior light, used as the region pair
Sampled value S of the sampled point that answersi,j,
Step 4, sampled value is aligned in the matrix of a N × N, Bx,yThe element of representing matrix xth row y row, TiRepresent Oi
Areal, then
Bx,y=Si,j, work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j, work as y-x>During K, j=x-Ti+ 1, i=y-K-1；
Bx,y=Si,j, work as x-y>During K, j=Ti+ k-x, i=k+x；
Bx,y=SI, j,Work as x+y>During 3K-1, j=Ti+ x-2K, i=3k-1-y；
Bx,y=Si,j, when working as x, y and being not belonging to four kinds of situations above, j=y-Ti/ 2, i=x.
2. a kind of panoramic video rhombus method of sampling as claimed in claim 1, it is characterised in that：In step one, N is even
Number, is the convenience of computer disposal, and N takes 16 multiple.
3. a kind of panoramic video rhombus method of sampling as claimed in claim 2, it is characterised in that：In step 2, when the value of i
When increasing from 0 to K-1, OiThe divided number of regions for obtaining is 2,6,10 ..., 2N-2, becomes an arithmetic progression, and tolerance is 4；Work as i
Value when increasing from K to 2K-1, OiThe divided number of regions for obtaining is 2N-2,2N-6 ..., 6,2, become an arithmetic progression, tolerance
For -4, the sum of sampled point is N2.
4. a kind of panoramic video rhombus method of sampling as claimed in claim 3, it is characterised in that：In step 3, sampled point
Numbering be (i, 0), (i, 1) ..., (i, Ti- 1), Ti=2N-4* | i- (N-1)/2 |.
5. a kind of panoramic video rhombus method of sampling as claimed in claim 4, it is characterised in that：In step 3, numbering is
The corresponding region of the sampled point of (i, 0) and numbering are (i, Ti- 1) the corresponding region of sampled point is adjacent, their segmentation
Line is 0 degree of warp, observes from the angle of the centre of sphere, and it is adopting for (i, k+1) in numbering that numbering is the corresponding region of sampled point of (i, k)
The left side in the corresponding region of sampling point.
6. a kind of panoramic video rhombus method of sampling as claimed in claim 5, it is characterised in that the method also includes：Depositing
Chu Shi, records N first；Then the data of all sampled points of gained are formed a line in the following order：(0,0),(0,
1),...,(0,T0-1),(1,0),(1,1),...,(1,T1-1),...,(N-1,0),(N-1,1),...,(N-1,TN-1-1).
7. a kind of panoramic video rhombus method of sampling as claimed in claim 6, it is characterised in that the method also includes：Flat
When showing on the display of face, the sample point data of gained is arranged in the rectangular area that a N row, 2N are arranged, and will be per a line
Numbering is the alignment of data of (i, 0), and other data are arranged in order, and data area is a rhombus, does not fill up in rectangular area
Part filled with arbitrary data.
8. a kind of panoramic video rhombus method of sampling as claimed in claim 7, it is characterised in that：The method is used for Video coding
During compression, need the sampling number of each frame is torn open the rectangle for being combined into that a N row, N are arranged, specifically tearing splicing method open is：First by gained
Sample point data be arranged in a N row, the rectangle of 2N row, then with each K row in 0 ° of warp both sides, common N column data is used as first half
Ball, remaining N-2 column data hemisphere data will be arranged together in a N row, N row, the rectangle of N row N-2 row in front and back as rear quarter
In, then the diamond data region of rear quarter is divided into 4 parts, by while while between neighbouring relations be spliced to front hemisphere square respectively
Area without data in shape, makes all to have with complete neighbouring relations between video data, and data in front hemisphere rectangle,
Concrete aligning method is realized according to step 4.
9. a kind of panoramic video rhombus sampling apparatus, including：
Sphere cutting unit, requires according to spatial resolution, sphere is divided into N=2K annular surface, N with equally spaced parallel
For even number, K is integer, and the annular surface for obtaining is designated as O successivelyi, i=0,1 ..., N-1, observe from the angle of the centre of sphere, OiPress
According to order arrangement from top to bottom；
Annular surface cutting unit, with equally spaced warp by annular surface Oi(i=K+M or i=K-1-M, M=0,1,2 ...,
K-1) 2N-2-4M region is divided evenly into, and wherein one warp is 0 ° of warp.The region for obtaining is designated as A successivelyi,j, j=
0,1 ..., 2N-3-4M, observe from the angle of the centre of sphere, Ai,jIncrease according to the east longitude number of degrees or the order of west longitude number of degrees minimizing arranged,
Wherein Ai,0And Ai,2N-3-4MAdjacent and cut-off rule is 0 ° of warp；
Sampled value computing unit, calculates each region A on the sphere that the annular surface cutting unit is obtainedi,jInterior light
Mean value, as sampled value S of the corresponding sampled point in the regioni,j,
Arrangement units, sampled value are aligned in the matrix of a N × N, Bx,yThe element of representing matrix xth row y row, TiRepresent
OiAreal, then
Bx,y=Si,j, work as y+x<During K-1, j=x, i=K-1-y；
Bx,y=Si,j, work as y-x>During K, j=x-Ti+ 1, i=y-K-1；
Bx,y=Si,j, work as x-y>During K, j=Ti+ k-x, i=k+x；
Bx,y=Si,j, work as x+y>During 3K-1, j=Ti+ x-2K, i=3k-1-y；
Bx,y=Si,j, when working as x, y and being not belonging to four kinds of situations above, j=y-Ti/ 2, i=x.
10. a kind of panoramic video rhombus sampling apparatus as claimed in claim 9, it is characterised in that：The device is in storage, first
N is first recorded；Then the data of all sampled points of gained are formed a line in the following order：(0,0),(0,1),...,(0,
T0-1),(1,0),(1,1),...,(1,T1-1),...,(N-1,0),(N-1,1),...,(N-1,TN-1-1)；Show in plane
When showing on device, the sample point data of gained is arranged in the rectangular area that a N row, 2N are arranged, and each line number is
The alignment of data of (i, 0), other data are arranged in order, and data area is a rhombus, the part that does not fill up in rectangular area
Filled with arbitrary data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610933426.1A CN106488233B (en) | 2016-10-31 | 2016-10-31 | A kind of panoramic video diamond shape method of sampling and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610933426.1A CN106488233B (en) | 2016-10-31 | 2016-10-31 | A kind of panoramic video diamond shape method of sampling and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106488233A true CN106488233A (en) | 2017-03-08 |
| CN106488233B CN106488233B (en) | 2019-08-23 |
Family
ID=58271320
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610933426.1A Active CN106488233B (en) | 2016-10-31 | 2016-10-31 | A kind of panoramic video diamond shape method of sampling and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106488233B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106897964A (en) * | 2017-03-09 | 2017-06-27 | 中国科学技术大学 | Keep the panoramic video frame rectangle mapping method of adjacent pixel correlation |
| CN106991642A (en) * | 2017-03-23 | 2017-07-28 | 上海国茂数字技术有限公司 | A kind of panoramic video octagonal method of sampling and device |
| CN107147910A (en) * | 2017-05-31 | 2017-09-08 | 上海国茂数字技术有限公司 | A kind of panoramic video hexagon method of sampling and device |
| CN107871304A (en) * | 2017-11-29 | 2018-04-03 | 中国科学技术大学 | Panoramic video frame rectangle mapping method based on sphere ring cutting and affine transformation |
| CN108520492A (en) * | 2018-03-16 | 2018-09-11 | 中国传媒大学 | panoramic video mapping method and system |
| CN108769680A (en) * | 2018-05-31 | 2018-11-06 | 上海大学 | A kind of panoramic video is based on slope block sampling method and device |
| CN109346004A (en) * | 2018-12-19 | 2019-02-15 | 广州励丰文化科技股份有限公司 | A kind of control system of the diamond shape LED screen for display canopy of the heavens |
| CN113362336A (en) * | 2021-05-10 | 2021-09-07 | 上海大学 | Panoramic video minimum deformation degree mapping method |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20020070015A (en) * | 2001-02-28 | 2002-09-05 | 김남국 | Method and apparatus for compressing and broadcasting the spherical or panoramic moving pictures |
| CN101000461A (en) * | 2006-12-14 | 2007-07-18 | 上海杰图软件技术有限公司 | Method for generating stereoscopic panorama by fish eye image |
| CN101252687A (en) * | 2008-03-20 | 2008-08-27 | 上海交通大学 | Method for implementing multichannel combined interested area video coding and transmission |
| WO2009069996A2 (en) * | 2007-11-27 | 2009-06-04 | Mimos Berhad | Apparatus and method for panoramic imaging |
| CN105245838A (en) * | 2015-09-29 | 2016-01-13 | 成都虚拟世界科技有限公司 | Panoramic video playing method and player |
| CN105812759A (en) * | 2016-04-15 | 2016-07-27 | 杭州当虹科技有限公司 | Planar projection method and coding method of 360-degree panoramic video |
| CN105898339A (en) * | 2016-04-12 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and device for transcoding panoramic video |
| CN105959702A (en) * | 2016-05-30 | 2016-09-21 | 北京奇艺世纪科技有限公司 | Spherical video coding method and device |
-
2016
- 2016-10-31 CN CN201610933426.1A patent/CN106488233B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20020070015A (en) * | 2001-02-28 | 2002-09-05 | 김남국 | Method and apparatus for compressing and broadcasting the spherical or panoramic moving pictures |
| CN101000461A (en) * | 2006-12-14 | 2007-07-18 | 上海杰图软件技术有限公司 | Method for generating stereoscopic panorama by fish eye image |
| WO2009069996A2 (en) * | 2007-11-27 | 2009-06-04 | Mimos Berhad | Apparatus and method for panoramic imaging |
| CN101252687A (en) * | 2008-03-20 | 2008-08-27 | 上海交通大学 | Method for implementing multichannel combined interested area video coding and transmission |
| CN105245838A (en) * | 2015-09-29 | 2016-01-13 | 成都虚拟世界科技有限公司 | Panoramic video playing method and player |
| CN105898339A (en) * | 2016-04-12 | 2016-08-24 | 乐视控股（北京）有限公司 | Method and device for transcoding panoramic video |
| CN105812759A (en) * | 2016-04-15 | 2016-07-27 | 杭州当虹科技有限公司 | Planar projection method and coding method of 360-degree panoramic video |
| CN105959702A (en) * | 2016-05-30 | 2016-09-21 | 北京奇艺世纪科技有限公司 | Spherical video coding method and device |
Non-Patent Citations (3)
| Title |
|---|
| PRAUN E等: "Spherical Parametrization and Remeshing", 《COMPUTER GRAPHICS PROCEEDINGS》 * |
| 万亮等: "等立方体球面映射", 《计算机辅助涉及与图形学学报》 * |
| 孙文彬: "一种近似等积球面菱形格网的构建方法", 《武汉大学学报· 信息科学版》 * |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106897964A (en) * | 2017-03-09 | 2017-06-27 | 中国科学技术大学 | Keep the panoramic video frame rectangle mapping method of adjacent pixel correlation |
| CN106897964B (en) * | 2017-03-09 | 2019-10-25 | 中国科学技术大学 | Keep the panoramic video frame rectangle mapping method of adjacent pixel correlation |
| CN106991642A (en) * | 2017-03-23 | 2017-07-28 | 上海国茂数字技术有限公司 | A kind of panoramic video octagonal method of sampling and device |
| CN107147910A (en) * | 2017-05-31 | 2017-09-08 | 上海国茂数字技术有限公司 | A kind of panoramic video hexagon method of sampling and device |
| CN107871304A (en) * | 2017-11-29 | 2018-04-03 | 中国科学技术大学 | Panoramic video frame rectangle mapping method based on sphere ring cutting and affine transformation |
| CN107871304B (en) * | 2017-11-29 | 2020-05-12 | 中国科学技术大学 | Panoramic video frame rectangular mapping method based on spherical surface circular cutting and affine transformation |
| CN108520492A (en) * | 2018-03-16 | 2018-09-11 | 中国传媒大学 | panoramic video mapping method and system |
| CN108769680A (en) * | 2018-05-31 | 2018-11-06 | 上海大学 | A kind of panoramic video is based on slope block sampling method and device |
| CN109346004A (en) * | 2018-12-19 | 2019-02-15 | 广州励丰文化科技股份有限公司 | A kind of control system of the diamond shape LED screen for display canopy of the heavens |
| CN113362336A (en) * | 2021-05-10 | 2021-09-07 | 上海大学 | Panoramic video minimum deformation degree mapping method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106488233B (en) | 2019-08-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106488233A (en) | A kind of panoramic video rhombus method of sampling and device | |
| CN106375760B (en) | A kind of panoramic video polygon method of sampling and device | |
| CN106210716B (en) | A kind of panoramic video isodensity method of sampling and device | |
| US9576519B2 (en) | Display method and display device | |
| WO2018040463A1 (en) | Data compression and decompression methods for demura table, and mura compensation method | |
| CN110543716B (en) | Three-dimensional overhead cable hierarchical power grid optimization method, device and computer equipment | |
| CN104112763A (en) | Pixel arrangement structure, display device and display method thereof | |
| JPH05506730A (en) | image generator | |
| CN113808261B (en) | Panorama-based self-supervised learning scene point cloud completion data set generation method | |
| CN107656717A (en) | A kind of display methods and image processing module, display device | |
| EP4270322A1 (en) | Image processing method and apparatus, and electronic device | |
| CN110322424B (en) | High-resolution image processing method and device, VR image display method and VR equipment | |
| CN106991642A (en) | A kind of panoramic video octagonal method of sampling and device | |
| US11042962B2 (en) | Hardware optimisation for generating 360° images | |
| CN111641822A (en) | Method for evaluating quality of repositioning stereo image | |
| CN106658009A (en) | Improved double-ring sampling method and device for panoramic video | |
| CN107147910B (en) | A kind of panoramic video hexagon method of sampling and device | |
| CN108520532A (en) | Identify the method and device of movement direction of object in video | |
| US20150123975A1 (en) | Visualization Method Of Numerical Weather Prediction Model Data On Six-Panels Grid Frame And Hardware Device Performing The Same | |
| CN108681989A (en) | A kind of image data Enhancement Method and device | |
| CN105739933B (en) | Display method, display device and computer system | |
| CN108154848B (en) | Display method and device for pixel arrangement and display equipment | |
| CN106791840A (en) | A kind of bicyclic band method of sampling and device of panoramic video | |
| CN105654853B (en) | Multi-view display apparatus | |
| CN108769680B (en) | Slope-based segmented sampling method and device for panoramic video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |