CN108307170A - A kind of stereo-picture method for relocating - Google Patents
A kind of stereo-picture method for relocating Download PDFInfo
- Publication number
- CN108307170A CN108307170A CN201711399351.4A CN201711399351A CN108307170A CN 108307170 A CN108307170 A CN 108307170A CN 201711399351 A CN201711399351 A CN 201711399351A CN 108307170 A CN108307170 A CN 108307170A
- Authority
- CN
- China
- Prior art keywords
- grid
- coordinate position
- indicate
- quadrilateral mesh
- denoted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000009466 transformation Effects 0.000 claims abstract description 42
- 239000011159 matrix material Substances 0.000 claims abstract description 34
- 230000000007 visual effect Effects 0.000 claims abstract description 21
- 238000006243 chemical reaction Methods 0.000 claims description 14
- 241000287196 Asthenes Species 0.000 claims description 7
- 230000014509 gene expression Effects 0.000 claims description 6
- 239000008186 active pharmaceutical agent Substances 0.000 claims description 4
- 238000013507 mapping Methods 0.000 claims description 3
- 239000004576 sand Substances 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 2
- 239000007787 solid Substances 0.000 claims 1
- 238000005457 optimization Methods 0.000 abstract description 2
- 230000000717 retained effect Effects 0.000 abstract 1
- 230000006870 function Effects 0.000 description 5
- 241000208340 Araliaceae Species 0.000 description 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 2
- 235000003140 Panax quinquefolius Nutrition 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 235000008434 ginseng Nutrition 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of stereo-picture method for relocating, it is by extracting the corresponding picture quality energy of left view point image, three-dimensional mass-energy and important content energy, and by optimization so that the corresponding gross energy of left view point image is minimum, obtain best similitude transformation matrix and depth value set, so that the reorientation stereo-picture obtained is preferably retained important notable semantic information, is kept visual adaptability in this way, and can adaptively control the scaling of important content according to the user's choice；It is carried out at the same time adjustment to the horizontal coordinate position, vertical coordinate position and depth value of stereo-picture, to remain the important notable information of the left view point image after reorientation, it can guarantee that with the right visual point image after the reorientation according to the left view difference image acquisition after reorientation be matched again simultaneously, so as to ensure the comfort and sense of depth of the stereo-picture after reorientation.
Description
Technical field
The present invention relates to a kind of processing methods of picture signal, more particularly, to a kind of stereo-picture method for relocating.
Background technology
With the fast development of stereo display technique, the various terminal devices with different three-dimensional display functions also go out extensively
It is existing, but since stereoscopic display terminal kinds are various, width height ratio is diversified in specifications, if therefore the certain image of width height ratio is placed on not
It shows, then first picture size must be adjusted, to achieve the effect that stereoscopic display in same stereoscopic display terminal.Traditional
Image-scaling method is either zoomed in and out by fixed proportion by cutting, and is done so it is possible that the content in image subtracts
Less or lead to obvious object deformation.
For stereo-picture, stretching or diminution processing along the horizontal or vertical direction can severely impact three-dimensional effect
Fruit leads to the variation of binocular parallax, changes so as to cause stereoscopic depth of perception, vision can be caused uncomfortable when serious, therefore,
How the left view point image of stereo-picture and right visual point image are zoomed in and out to reduce image deformation；After how ensureing scaling
The consistency of left view point image and parallax/depth distribution of right visual point image, to reduce, vision is uncomfortable, enhances sense of depth；
How according to the user's choice adaptively the scaling of control object is all to carry out weight to stereo-picture with the notable content of protrusion
The problem of needing to research and solve in position fixing process.
Invention content
Technical problem to be solved by the invention is to provide one kind meeting notable semantic feature, and can effectively adjust vertical
The stereo-picture method for relocating of body picture size size.
Technical solution is used by the present invention solves above-mentioned technical problem：A kind of stereo-picture method for relocating, it is special
Sign is to include the following steps：
1. the left view point image for the stereo-picture that pending width is W and height is H, right visual point image and left view is poor
Image correspondence is denoted as { L (x, y) }, { R (x, y) } and { dL(x,y)}；Wherein, 1≤x≤W, 1≤y≤H, W and H can be whole by 8
It removes, L (x, y) indicates that coordinate position is the pixel value of the pixel of (x, y) in { L (x, y) }, sits in R (x, y) expressions { R (x, y) }
Mark is set to the pixel value of the pixel of (x, y), dL(x, y) indicates { dL(x, y) } in coordinate position be (x, y) pixel
Pixel value；
2. { L (x, y) } is divided intoThe quadrilateral mesh that the size of a non-overlapping copies is 8 × 8；Then will
All quadrilateral mesh in { L (x, y) } constitute a set, are denoted as VL, VL={ UL,k|1≤k≤M}；Wherein, UL,kIndicate { L
(x, y) } in k-th of quadrilateral mesh, with the upper left of quadrilateral mesh, lower-left, 4 grid vertexes of upper right and bottom right set
It describes,K is positive integer, and 1≤k≤M, M indicate the network of quadrilaterals for including in { L (x, y) }
The total number of lattice,It is corresponding to indicate UL,kThe upper left grid as the 1st grid vertex
Vertex, as the lower-left grid vertex of the 2nd grid vertex, as the upper right grid vertex of the 3rd grid vertex, as the 4th
The bottom right grid vertex of a grid vertex,WithHorizontal coordinate positionWith vertical coordinate positionIt describes,WithHorizontal coordinate positionWith vertical coordinate positionIt describes,WithHorizontal coordinate positionWith vertical coordinate positionIt describes,WithHorizontal coordinate positionWith vertical coordinate positionIt describes,
4. going out the notable figure of { L (x, y) } using the notable model extraction of vision based on graph theory, it is denoted as { SML(x,
y)}；Then according to { SML(x, y) } and { dL(x, y) }, the visual saliency map of { L (x, y) } is obtained, { S is denoted asL(x,
Y) }, by { SL(x, y) } in coordinate position be that the pixel value of pixel of (x, y) is denoted as SL(x, y),Wherein, SML(x, y) indicates { SML(x, y) } in coordinate position be (x, y)
Pixel pixel value,Indicate SMLThe weight of (x, y),Indicate dLThe weight of (x, y),
5. the set that all object quadrangle grids of { L (x, y) } are constituted is denoted asAnd by upper left, lower-left, upper right and the right side of all object quadrangle grids of { L (x, y) }
The set that the depth value of lower grid vertex is constituted is denoted asThen according to the institute in { L (x, y) }
There is the corresponding object quadrangle grid of quadrilateral mesh, similarity transformation is carried out to each quadrilateral mesh in { L (x, y) }, is made
The mapping fault minimum for the object quadrangle grid that former quadrilateral mesh is obtained with former quadrilateral mesh after similarity transformation is obtained,
The similitude transformation matrix of the corresponding object quadrangle grid of each quadrilateral mesh in { L (x, y) } is obtained, by UL,kIt is corresponding
Object quadrangle gridSimilitude transformation matrix be denoted asWherein,It is corresponding to indicateThe upper left net as the 1st grid vertex
Lattice vertex, the lower-left grid vertex as the 2nd grid vertex, the upper right grid vertex as the 3rd grid vertex,
As the bottom right grid vertex of the 4th grid vertex,It indicatesI-th of grid vertex, i=1,2,3,4,It is corresponding to indicateRespective depth value,WithIt is corresponding to indicateHorizontal coordinate position and vertical sit
Cursor position,WithIt is corresponding to indicateHorizontal coordinate position and vertical coordinate position,WithIt is corresponding to indicate's
Horizontal coordinate position and vertical coordinate position,WithIt is corresponding to indicateHorizontal coordinate position and vertical coordinate position,
(AL,k)TFor AL,kTransposition, ((AL,k)TAL,k)-1For (AL,k)TAL,kIt is inverse；
6. according to the similitude transformation matrix of the corresponding object quadrangle grid of each quadrilateral mesh in { L (x, y) }, and
In conjunction with { SL(x, y) }, calculate the picture quality energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Amount, is denoted as EQ；
According to every in the depth value of each grid vertex of each quadrilateral mesh in { L (x, y) } and { L (x, y) }
The depth value of each grid vertex of the corresponding object quadrangle grid of a quadrilateral mesh, calculates all four in { L (x, y) }
The three-dimensional mass-energy of the corresponding object quadrangle grid of side shape grid, is denoted as ES；
According to the size scaling ratio and depth scalability ratio of the important content of user's selection, the institute in { L (x, y) } is calculated
The important content energy for having the corresponding object quadrangle grid of quadrilateral mesh, is denoted as EI；
7. calculating the gross energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }, it is denoted as
Etotal, Etotal=EQ+λS×ES+λI×EI；Then it is solved by Least-squares minimizationIt obtains in { L (x, y) }
All quadrilateral mesh in set that the corresponding optimum target quadrilateral mesh of all quadrilateral mesh is constituted and { L (x, y) }
The upper left of corresponding optimum target quadrilateral mesh, lower-left, upper right, the set that constitutes of depth value of bottom right grid vertex, it is corresponding
It is denoted asAndThen according toCalculate { L
(x, y) } in the corresponding optimum target quadrilateral mesh of each quadrilateral mesh similitude transformation matrix, by UL,kIt is corresponding most
Good object quadrangle gridSimilitude transformation matrix be denoted asAnd according toCalculate four sides each of { L (x, y) }
The depth conversion matrix of the corresponding optimum target quadrilateral mesh of shape grid, by UL,kCorresponding optimum target quadrilateral meshDepth conversion matrix be denoted asWherein, λSAnd λIIt is weighting ginseng
Number, min () are to be minimized function,Indicate UL,kCorresponding optimum target quadrilateral mesh,It indicatesUpper left,
Lower-left, upper right, bottom right grid vertex depth value constitute set,(BL,k)TFor BL,kTransposition,
((BL,k)TBL,k)-1For (BL,k)TBL,kIt is inverse, It is corresponding to indicateUpper left,
Lower-left, upper right and the respective depth value of bottom right grid vertex；
8. according to the similarity transformation square of the corresponding optimum target quadrilateral mesh of each quadrilateral mesh in { L (x, y) }
Battle array calculates horizontal coordinate of each pixel in each quadrilateral mesh in { L (x, y) } after similarity transformation rectangular transform
Position and vertical coordinate position, by UL,kMiddle horizontal coordinate position is x'L,kWith vertical coordinate position y'L,kPixel through similar
Horizontal coordinate position and vertical coordinate position after transformation matrix transformation, which correspond to, to be denoted asWith
Then the horizontal seat according to each pixel in each quadrilateral mesh in { L (x, y) } after similarity transformation rectangular transform
Cursor position and vertical coordinate position obtain the left view point image after reorientation, are denoted asWherein, 1≤x'L,k≤ W, 1
≤y'L,k≤ H,1≤x'≤W', 1≤y'≤H, W' indicate the stereo-picture after reorientation
Width, H also be reorientation after stereo-picture height,It indicatesMiddle coordinate position is (x', y''s)
The pixel value of pixel；
And according to the depth conversion square of the corresponding optimum target quadrilateral mesh of each quadrilateral mesh in { L (x, y) }
Battle array calculates the depth value of each pixel in each quadrilateral mesh in { L (x, y) } after depth conversion rectangular transform
Depth value, by UL,kMiddle horizontal coordinate position is x'L,kWith vertical coordinate position y'L,kPixel depth value z'L,kThrough too deep
Depth value after degree transformation matrix transformation is denoted asThen according to four sides each of { L (x, y) }
Depth value of the depth value of each pixel in shape grid after depth conversion rectangular transform obtains the left view point after reorientation
Depth map is denoted asThen according toThe left view difference image after reorientation is obtained, is denoted asIt willMiddle coordinate position is that the pixel value of the pixel of (x', y') is denoted as Wherein, B'L,k=[z'L,k1],It indicatesMiddle coordinate bit
It is set to the pixel value of the pixel of (x', y')；
9. basisWithThe right visual point image after reorientation is obtained, is denoted asIt willMiddle coordinate position is that the pixel value of the pixel of (x', y') is denoted as Then willWithConstitute the stereo-picture after reorientation；Its
In, 1≤x'≤W', 1≤y'≤H, W' indicate that the width of the stereo-picture after reorientation, H are also the stereo-picture after reorientation
Height,It indicatesMiddle coordinate position isPixel pixel
Value.
The step 6. in EQCalculating process be：
6. the shape of the corresponding object quadrangle grid of all quadrilateral mesh in _ 1a, calculating { L (x, y) } protects energy
Amount, is denoted as ESD,Wherein, SL(k) U is indicatedL,kIn all pixels point vision it is aobvious
The mean value of work value, namely indicate { SL(x, y) } in UL,kThe mean value of the pixel value of all pixels point in corresponding region, symbol
Number " | | | | " it is to seek Euclidean distance symbol；
6. _ 2a, according to ESDAnd ELB, calculate the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Picture quality ENERGY EQ, EQ=ESD+λLBELB；Wherein, λLBFor weighting parameters.
The step 6. in ESCalculating process be：
6. the shape of the corresponding object quadrangle grid of all quadrilateral mesh in _ 1b, calculating { L (x, y) } scales energy
Amount, is denoted as ESC,Wherein, symbol " | | | | " is to seek Euclidean distance symbol,It indicates
All grid vertexes edge composition matrix,Indicate UL,kI-th of net
Lattice vertexDepth value,It indicatesDepth value, eL,kIndicate UL,kAll grid vertexes edge composition square
Battle array,
And the deep-controlled energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) } is calculated, remember
For EDC,
Wherein, exp () is indicated using natural radix e as the exponential function at bottom, symbol " | | " it is the symbol that takes absolute value, zmaxIndicate L (x,
Y) maximum depth value }, zminIndicate the minimum depth value of { L (x, y) }, CVZminIndicate minimum comfortable viewing areas range,E indicates the horizontal base line distance between the left view point of pending stereo-picture and right viewpoint, D tables
Show the viewing distance between the left view point of pending stereo-picture and right viewpoint and display, η1Indicate that minimum comfortable viewing regards
Angle, CVZmaxIndicate maximum comfortable viewing areas range,η2Indicate maximum comfortable viewing visual angle；
6. _ 2b, according to ESCAnd EDC, calculate the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Three-dimensional mass-energy ES, ES=ESC+λDCEDC；Wherein, λDCFor weighting parameters.
The step 6. in EICalculating process be：
Wherein,Indicate the rectangular area range where the important content of user's selection, xi,jIt is in the horizontal direction in expression { L (x, y) }
J-th and vertical direction be i-th grid vertex horizontal coordinate position, xi,j+1It indicates in { L (x, y) } in the horizontal direction
The horizontal coordinate position for the grid vertex for being i-th for jth+1 and in vertical direction, zi,jIt indicates in { L (x, y) } in level
Direction be j-th and be i-th in vertical direction grid vertex depth value,It is in the horizontal direction in expression { L (x, y) }
J-th and in the horizontal coordinate position that vertical direction is the grid vertex of i-th of grid vertex in object quadrangle grid,Indicate { L (x, y) } in be in the horizontal direction jth+1 and vertical direction be i-th grid vertex on four side of target
The horizontal coordinate position of grid vertex in shape grid,It indicates in { L (x, y) } in the horizontal direction for j-th and in Vertical Square
To the depth value of grid vertex of the grid vertex for i-th in object quadrangle grid, s'xIndicate the level that user specifies
Zoom factor, s'zIndicate the depth scalability factor that user specifies, λDSFor weighting parameters.
Compared with the prior art, the advantages of the present invention are as follows：
1) the method for the present invention is by extracting the corresponding picture quality energy of left view point image, three-dimensional mass-energy and important interior
Hold energy, and by optimization so that the corresponding gross energy minimum of left view point image, obtains best similitude transformation matrix and depth
Value set, so that the reorientation stereo-picture of acquisition can preferably retain important notable semantic information, keep vision
Comfort, and the scaling of important content can be adaptively controlled according to the user's choice.
2) the method for the present invention is carried out at the same time tune to the horizontal coordinate position, vertical coordinate position and depth value of stereo-picture
It is whole, to remain the important notable information of left view point image after reorientation, while can guarantee again with according to reorientation after
Right visual point image after the reorientation that left view difference image obtains is matched, so as to ensure the stereo-picture after reorientation
Comfort and sense of depth.
Description of the drawings
Fig. 1 is that the overall of the method for the present invention realizes block diagram；
Fig. 2 a are " red green " figure of the original three-dimensional image of " Image1 "；
Fig. 2 b are " red green " figure being reoriented to after the width 60% of original three-dimensional image of " Image1 "；
Fig. 3 a are " red green " figure of the original three-dimensional image of " Image2 "；
Fig. 3 b are " red green " figure being reoriented to after the width 60% of original three-dimensional image of " Image2 "；
Fig. 4 a are " red green " figure of the original three-dimensional image of " Image3 "；
Fig. 4 b are " red green " figure being reoriented to after the width 60% of original three-dimensional image of " Image3 "；
Fig. 5 a are " red green " figure of the original three-dimensional image of " Image4 "；
Fig. 5 b are " red green " figure being reoriented to after the width 60% of original three-dimensional image of " Image4 ".
Specific implementation mode
Below in conjunction with attached drawing embodiment, present invention is further described in detail.
A kind of stereo-picture method for relocating proposed by the present invention, it is overall to realize that block diagram is as shown in Figure 1 comprising following
Step：
1. the left view point image for the stereo-picture that pending width is W and height is H, right visual point image and left view is poor
Image correspondence is denoted as { L (x, y) }, { R (x, y) } and { dL(x,y)}；Wherein, 1≤x≤W, 1≤y≤H, W and H can be whole by 8
It removes, L (x, y) indicates that coordinate position is the pixel value of the pixel of (x, y) in { L (x, y) }, sits in R (x, y) expressions { R (x, y) }
Mark is set to the pixel value of the pixel of (x, y), dL(x, y) indicates { dL(x, y) } in coordinate position be (x, y) pixel
Pixel value.
2. { L (x, y) } is divided intoThe quadrilateral mesh that the size of a non-overlapping copies is 8 × 8；Then will
All quadrilateral mesh in { L (x, y) } constitute a set, are denoted as VL, VL={ UL,k|1≤k≤M}；Wherein, UL,kIndicate { L
(x, y) } in k-th of quadrilateral mesh, with the upper left of quadrilateral mesh, lower-left, 4 grid vertexes of upper right and bottom right set
It describes,K is positive integer, and 1≤k≤M, M indicate the network of quadrilaterals for including in { L (x, y) }
The total number of lattice,It is corresponding to indicate UL,kThe upper left grid as the 1st grid vertex
Vertex, as the lower-left grid vertex of the 2nd grid vertex, as the upper right grid vertex of the 3rd grid vertex, as the 4th
The bottom right grid vertex of a grid vertex,WithHorizontal coordinate positionWith vertical coordinate positionIt describes,WithHorizontal coordinate positionWith vertical coordinate positionIt describes,WithHorizontal coordinate positionWith vertical coordinate positionIt describes,WithHorizontal coordinate positionWith vertical coordinate positionIt describes,
4. using the existing vision based on graph theory significantly (Graph-Based Visual Saliency, GBVS) model
The notable figure for extracting { L (x, y) }, is denoted as { SML(x,y)}；Then according to { SML(x, y) } and { dL(x, y) }, obtain L (x,
Y) visual saliency map }, is denoted as { SL(x, y) }, by { SL(x, y) } in coordinate position be that the pixel value of pixel of (x, y) is denoted as
SL(x, y),Wherein, SML(x, y) indicates { SML(x, y) } in coordinate bit
It is set to the pixel value of the pixel of (x, y),Indicate SMLThe weight of (x, y),Indicate dLThe weight of (x, y),
It takes in the present embodiment
5. the set that all object quadrangle grids of { L (x, y) } are constituted is denoted asAnd by upper left, lower-left, upper right and the right side of all object quadrangle grids of { L (x, y) }
The set that the depth value of lower grid vertex is constituted is denoted asThen according to the institute in { L (x, y) }
There is the corresponding object quadrangle grid of quadrilateral mesh, similarity transformation is carried out to each quadrilateral mesh in { L (x, y) }, is made
The mapping fault minimum for the object quadrangle grid that former quadrilateral mesh is obtained with former quadrilateral mesh after similarity transformation is obtained,
The similitude transformation matrix of the corresponding object quadrangle grid of each quadrilateral mesh in { L (x, y) } is obtained, by UL,kIt is corresponding
Object quadrangle gridSimilitude transformation matrix be denoted asWherein,It is corresponding to indicateThe upper left net as the 1st grid vertex
Lattice vertex, as the lower-left grid vertex of the 2nd grid vertex, as the upper right grid top of the 3rd grid vertex
Point, as the bottom right grid vertex of the 4th grid vertex,It indicatesI-th of grid vertex, i=1,2,3,4,It is corresponding to indicateRespective depth value,WithIt is corresponding to indicateHorizontal coordinate position and vertical sit
Cursor position,WithIt is corresponding to indicateHorizontal coordinate position and vertical coordinate position,WithIt is corresponding to indicate's
Horizontal coordinate position and vertical coordinate position,WithIt is corresponding to indicateHorizontal coordinate position and vertical coordinate position,
(AL,k)TFor AL,kTransposition, ((AL,k)TAL,k)-1For (AL,k)TAL,kIt is inverse.
6. when changing the size or the ratio of width to height of stereo-picture, in order to protect user's important object of concern not occur
Tensile deformation needs to keep picture quality as far as possible during grid deformation, therefore the present invention is according to every in { L (x, y) }
The similitude transformation matrix of the corresponding object quadrangle grid of a quadrilateral mesh, and combine { SL(x, y) }, it calculates in { L (x, y) }
The corresponding object quadrangle grid of all quadrilateral mesh picture quality energy, be denoted as EQ。
In this particular embodiment, step 6. in EQCalculating process be：
6. the shape of the corresponding object quadrangle grid of all quadrilateral mesh in _ 1a, calculating { L (x, y) } protects energy
Amount, is denoted as ESD,Wherein, SL(k) U is indicatedL,kIn all pixels point vision it is aobvious
The mean value of work value, namely indicate { SL(x, y) } in UL,kThe mean value of the pixel value of all pixels point in corresponding region, symbol
Number " | | | | " it is to seek Euclidean distance symbol.
6. _ 2a, according to ESDAnd ELB, calculate the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Picture quality ENERGY EQ, EQ=ESD+λLBELB；Wherein, λLBFor weighting parameters, λ is taken in the present embodimentLB=1.25.
In order to ensure to relocate the visual adaptability and sense of depth of stereo-picture, the present invention is according to each of { L (x, y) }
The corresponding object quadrangle of each quadrilateral mesh in the depth value of each grid vertex of quadrilateral mesh and { L (x, y) }
The depth value of each grid vertex of grid calculates the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Three-dimensional mass-energy, be denoted as ES。
In this particular embodiment, step 6. in ESCalculating process be：
6. the shape of the corresponding object quadrangle grid of all quadrilateral mesh in _ 1b, calculating { L (x, y) } scales energy
Amount, is denoted as ESC,Wherein, symbol " | | | | " is to seek Euclidean distance symbol,It indicates
All grid vertexes edge composition matrix,Indicate UL,kI-th of net
Lattice vertexDepth value,It indicatesDepth value, eL,kIndicate UL,kAll grid vertexes edge composition square
Battle array,
And the deep-controlled energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) } is calculated, remember
For EDC,
Wherein, exp () is indicated using natural radix e as the exponential function at bottom, e=2.71828183 ..., symbol " | | " it is to take absolute value
Symbol, zmaxIndicate the maximum depth value of { L (x, y) }, zminIndicate the minimum depth value of { L (x, y) }, CVZminIt indicates minimum to relax
Suitable viewing areas range,E indicates the water between the left view point of pending stereo-picture and right viewpoint
Flat parallax range, D indicate the viewing distance between the left view point of pending stereo-picture and right viewpoint and display, η1It indicates
Minimum comfortable viewing visual angle, takes η in the present embodiment1=-1 °, CVZmaxIndicate maximum comfortable viewing areas range,η2It indicates maximum comfortable viewing visual angle, takes η in the present embodiment2=1 °.
6. _ 2b, according to ESCAnd EDC, calculate the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Three-dimensional mass-energy ES, ES=ESC+λDCEDC；Wherein, λDCFor weighting parameters, λ is taken in the present embodimentDC=0.25.
In order to ensure to relocate the comfort and sense of depth of stereo-picture, the important content that the present invention is selected according to user
Size scaling ratio and depth scalability ratio calculate the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Important content energy, be denoted as EI。
In this particular embodiment, step 6. in EICalculating process be：Wherein,Indicate user's selection
Rectangular area range where important content, xi,jIt indicates in { L (x, y) } to be in the horizontal direction j-th and is the in vertical direction
The horizontal coordinate position of i grid vertexes, xi,j+1It indicates in { L (x, y) } in the horizontal direction for jth+1 and in vertical direction
For the horizontal coordinate position of i-th of grid vertex, zi,jIt indicates in { L (x, y) } in the horizontal direction for j-th and in Vertical Square
To the depth value of the grid vertex for i-th,It indicates in { L (x, y) } to be in the horizontal direction j-th and is the in vertical direction
The horizontal coordinate position of grid vertex of the i grid vertexes in object quadrangle grid,Indicate { L (x, y) } in
Horizontal direction be jth+1 and be i-th in vertical direction grid vertex of the grid vertex in object quadrangle grid
Horizontal coordinate position,Indicate { L (x, y) } in the horizontal direction be j-th and be i-th in vertical direction grid vertex exist
The depth value of grid vertex in object quadrangle grid, s'xIndicate the horizontal scaling factor that user specifies, s'zIndicate that user refers to
The fixed depth scalability factor, takes s' in the present embodimentx=1 and s'z=1, that is, the original size and depth of important content are kept,
λDSFor weighting parameters, λ is taken in the present embodimentDS=0.025.
7. calculating the gross energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }, it is denoted as
Etotal, Etotal=EQ+λS×ES+λI×EI；Then it is solved by Least-squares minimizationIt obtains in { L (x, y) }
All quadrilateral mesh in set that the corresponding optimum target quadrilateral mesh of all quadrilateral mesh is constituted and { L (x, y) }
The upper left of corresponding optimum target quadrilateral mesh, lower-left, upper right, the set that constitutes of depth value of bottom right grid vertex, it is corresponding
It is denoted asAndThen according toCalculate { L
(x, y) } in the corresponding optimum target quadrilateral mesh of each quadrilateral mesh similitude transformation matrix, by UL,kIt is corresponding most
Good object quadrangle gridSimilitude transformation matrix be denoted asAnd according toCalculate four sides each of { L (x, y) }
The depth conversion matrix of the corresponding optimum target quadrilateral mesh of shape grid, by UL,kCorresponding optimum target quadrilateral meshDepth conversion matrix be denoted asWherein, λSAnd λIIt is weighting ginseng
Number, takes λ in the present embodimentS=1.5 and λI=1.25, min () are to be minimized function,Indicate UL,kIt is corresponding best
Object quadrangle grid,It indicatesUpper left, lower-left, upper right, bottom right grid vertex depth value constitute set,(BL,k)TFor BL,kTransposition, ((BL,k)TBL,k)-1For (BL,k)TBL,kIt is inverse,It is corresponding to indicateUpper left, lower-left, upper right and bottom right grid vertex it is each
From depth value.
8. according to the similarity transformation square of the corresponding optimum target quadrilateral mesh of each quadrilateral mesh in { L (x, y) }
Battle array calculates horizontal coordinate of each pixel in each quadrilateral mesh in { L (x, y) } after similarity transformation rectangular transform
Position and vertical coordinate position, by UL,kMiddle horizontal coordinate position is x'L,kWith vertical coordinate position y'L,kPixel through similar
Horizontal coordinate position and vertical coordinate position after transformation matrix transformation, which correspond to, to be denoted asWith
Then the horizontal seat according to each pixel in each quadrilateral mesh in { L (x, y) } after similarity transformation rectangular transform
Cursor position and vertical coordinate position obtain the left view point image after reorientation, are denoted asWherein, 1≤x'L,k≤ W, 1
≤y'L,k≤ H,1≤x'≤W', 1≤y'≤H, W' indicate the stereo-picture after reorientation
Width, H also be reorientation after stereo-picture height,It indicatesMiddle coordinate position is (x', y''s)
The pixel value of pixel.
And according to the depth conversion square of the corresponding optimum target quadrilateral mesh of each quadrilateral mesh in { L (x, y) }
Battle array calculates the depth value of each pixel in each quadrilateral mesh in { L (x, y) } after depth conversion rectangular transform
Depth value, by UL,kMiddle horizontal coordinate position is x'L,kWith vertical coordinate position y'L,kPixel depth value z'L,kThrough too deep
Depth value after degree transformation matrix transformation is denoted asThen according to four sides each of { L (x, y) }
Depth value of the depth value of each pixel in shape grid after depth conversion rectangular transform obtains the left view point after reorientation
Depth map is denoted asThen according toThe left view difference image after reorientation is obtained, is denoted asIt willMiddle coordinate position is that the pixel value of the pixel of (x', y') is denoted as Wherein, B'L,k=[z'L,k1],It indicatesMiddle coordinate bit
It is set to the pixel value of the pixel of (x', y').
9. basisWithThe right visual point image after reorientation is obtained, is denoted as
It willMiddle coordinate position is that the pixel value of the pixel of (x', y') is denoted as Then willWithConstitute the stereo-picture after reorientation；Its
In, 1≤x'≤W', 1≤y'≤H, W' indicate that the width of the stereo-picture after reorientation, H are also the stereo-picture after reorientation
Height,It indicatesMiddle coordinate position isPixel pixel
Value.
The feasibility and validity of method in order to further illustrate the present invention, tests the method for the present invention.
Weight just is carried out to tetra- width stereo-picture of Image1, Image2, Image3 and Image4 using the method for the present invention below
Positioning experiment." red green " figure, Fig. 2 b that Fig. 2 a give the original three-dimensional image of " Image1 " give resetting for " Image1 "
" red green " figure behind position to the width 60% of original three-dimensional image；Fig. 3 a give the original three-dimensional image of " Image2 "
" red green " figure, Fig. 3 b give " red green " figure being reoriented to after the width 60% of original three-dimensional image of " Image2 "；Figure
4a gives " red green " figure, Fig. 4 b of the original three-dimensional image of " Image3 ", and to give being reoriented to for " Image3 " original vertical
" red green " figure after the width 60% of body image；Fig. 5 a give " red green " figure, the figure of the original three-dimensional image of " Image4 "
5b gives " red green " figure being reoriented to after the width 60% of original three-dimensional image of " Image4 ".From Fig. 2 a to Fig. 5 b
As can be seen that the reorientation stereo-picture obtained using the method for the present invention can preferably retain important notable semantic information,
It can guarantee the consistency of left view point image and right visual point image again simultaneously.
Claims (4)
1. a kind of stereo-picture method for relocating, it is characterised in that include the following steps：
1. by left view point image, right visual point image and the left view difference image of the stereo-picture that pending width is W and height is H
Correspondence is denoted as { L (x, y) }, { R (x, y) } and { dL(x,y)}；Wherein, 1≤x≤W, 1≤y≤H, W and H can be divided exactly by 8, L
(x, y) indicates that coordinate position is the pixel value of the pixel of (x, y) in { L (x, y) }, coordinate bit in R (x, y) expressions { R (x, y) }
It is set to the pixel value of the pixel of (x, y), dL(x, y) indicates { dL(x, y) } in coordinate position be (x, y) pixel pixel
Value；
2. { L (x, y) } is divided intoThe quadrilateral mesh that the size of a non-overlapping copies is 8 × 8；Then by { L
(x, y) } in all quadrilateral mesh constitute one set, be denoted as VL, VL={ UL,k|1≤k≤M}；Wherein, UL,kIndicate { L
(x, y) } in k-th of quadrilateral mesh, with the upper left of quadrilateral mesh, lower-left, 4 grid vertexes of upper right and bottom right set
It describes,K is positive integer, and 1≤k≤M, M indicate the network of quadrilaterals for including in { L (x, y) }
The total number of lattice, It is corresponding to indicate UL,kThe upper left grid as the 1st grid vertex
Vertex, as the lower-left grid vertex of the 2nd grid vertex, as the upper right grid vertex of the 3rd grid vertex, as the 4th
The bottom right grid vertex of a grid vertex,WithHorizontal coordinate positionWith vertical coordinate positionIt describes, WithHorizontal coordinate positionWith vertical coordinate positionIt describes, WithHorizontal coordinate positionWith vertical coordinate positionIt describes, WithHorizontal coordinate positionWith vertical coordinate positionIt describes,
3. calculating upper left, lower-left, upper right and the grid of bottom right 4 of each quadrilateral mesh in { L (x, y) }
The respective depth value in vertex, willRespective depth value correspondence is denoted as
Then the depth value of the upper left of all quadrilateral mesh in { L (x, y) }, lower-left, upper right and bottom right grid vertex is constituted one
A set, is denoted as ZL, ZL={ zL,k|1≤k≤M}；Wherein, e is indicated between the left view point of pending stereo-picture and right viewpoint
Horizontal base line distance, D indicates the viewing distance between the left view point of pending stereo-picture and right viewpoint and display, Wd
Indicate that the horizontal width of display, R indicate the horizontal resolution of display,It indicatesParallax value,It indicates's
Parallax value,It indicatesParallax value,It indicatesParallax value, zL,kForThe set of composition,
4. going out the notable figure of { L (x, y) } using the notable model extraction of vision based on graph theory, it is denoted as { SML(x,y)}；Then basis
{SML(x, y) } and { dL(x, y) }, the visual saliency map of { L (x, y) } is obtained, { S is denoted asL(x, y) }, by { SL(x, y) } in coordinate
Position is that the pixel value of the pixel of (x, y) is denoted as SL(x, y),Wherein,
SML(x, y) indicates { SML(x, y) } in coordinate position be (x, y) pixel pixel value,Indicate SMLThe weight of (x, y),Indicate dLThe weight of (x, y),
5. the set that all object quadrangle grids of { L (x, y) } are constituted is denoted as And it will
The upper lefts of all object quadrangle grids of { L (x, y) }, lower-left, upper right and bottom right grid vertex the set that constitutes of depth value
It is denoted as Then according to the corresponding object quadrangle of all quadrilateral mesh in { L (x, y) }
Grid carries out similarity transformation to each quadrilateral mesh in { L (x, y) } so that former quadrilateral mesh and former quadrilateral mesh
The mapping fault of the object quadrangle grid obtained after similarity transformation is minimum, obtains each network of quadrilaterals in { L (x, y) }
The similitude transformation matrix of the corresponding object quadrangle grid of lattice, by UL,kCorresponding object quadrangle gridSimilarity transformation square
Battle array is denoted as Wherein,
It is corresponding to indicateAs the upper left grid vertex of the 1st grid vertex, as the lower-left grid top of the 2nd grid vertex
Point, as the upper right grid vertex of the 3rd grid vertex, as the bottom right grid vertex of the 4th grid vertex,It indicatesI-th of grid vertex, i=1,2,3,4,It is corresponding to indicateRespective depth value, WithCorresponding table
ShowHorizontal coordinate position and vertical coordinate position,WithIt is corresponding to indicateHorizontal coordinate position and vertical coordinate
Position,WithIt is corresponding to indicateHorizontal coordinate position and vertical coordinate position,WithIt is corresponding to indicateWater
Flat coordinate position and vertical coordinate position, (AL,k)TFor AL,kTransposition, ((AL,k)TAL,k)-1For (AL,k)TAL,kIt is inverse；
6. according to the similitude transformation matrix of the corresponding object quadrangle grid of each quadrilateral mesh in { L (x, y) }, and combining
{SL(x, y) }, calculate the picture quality energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }, note
For EQ；
According to each of the depth value of each grid vertex of each quadrilateral mesh in { L (x, y) } and { L (x, y) } four
The depth value of each grid vertex of the corresponding object quadrangle grid of side shape grid calculates all quadrangles in { L (x, y) }
The three-dimensional mass-energy of the corresponding object quadrangle grid of grid, is denoted as ES；
According to the size scaling ratio and depth scalability ratio of the important content of user's selection, all four in { L (x, y) } are calculated
The important content energy of the corresponding object quadrangle grid of side shape grid, is denoted as EI；
7. calculating the gross energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }, it is denoted as Etotal,
Etotal=EQ+λS×ES+λI×EI；Then it is solved by Least-squares minimizationIt obtains all in { L (x, y) }
The set of the corresponding optimum target quadrilateral mesh composition of quadrilateral mesh and all quadrilateral mesh in { L (x, y) } correspond to
The upper left of optimum target quadrilateral mesh, lower-left, upper right, the set that constitutes of depth value of bottom right grid vertex, correspondence is denoted asAnd Then according toIt calculates { L (x, y) }
In the corresponding optimum target quadrilateral mesh of each quadrilateral mesh similitude transformation matrix, by UL,kCorresponding optimum target
Quadrilateral meshSimilitude transformation matrix be denoted asAnd according toCalculate each quadrilateral mesh in { L (x, y) }
The depth conversion matrix of corresponding optimum target quadrilateral mesh, by UL,kCorresponding optimum target quadrilateral meshDepth
Degree transformation matrix is denoted asWherein, λSAnd λIIt is weighting parameters, min
() is to be minimized function,Indicate UL,kCorresponding optimum target quadrilateral mesh,It indicatesUpper left, lower-left,
The set of upper right, the depth value composition of bottom right grid vertex,(BL,k)TFor BL,kTransposition, ((BL,k)TBL,k)-1For (BL,k)TBL,kIt is inverse, It is corresponding to indicateUpper left, lower-left, the right side
The upper and respective depth value of bottom right grid vertex；
8. according to the similitude transformation matrix of the corresponding optimum target quadrilateral mesh of each quadrilateral mesh in { L (x, y) }, meter
Calculate horizontal coordinate position of each pixel in each quadrilateral mesh in { L (x, y) } after similarity transformation rectangular transform
With vertical coordinate position, by UL,kMiddle horizontal coordinate position is x'L,kWith vertical coordinate position y'L,kPixel through similarity transformation
Horizontal coordinate position and vertical coordinate position after matrixing, which correspond to, to be denoted asWith Then
According to horizontal coordinate position of each pixel in each quadrilateral mesh in { L (x, y) } after similarity transformation rectangular transform
It sets and is denoted as with vertical coordinate position, the left view point image after acquisition reorientationWherein, 1≤x'L,k≤ W, 1≤
y'L,k≤ H,1≤x'≤W', 1≤y'≤H, W' indicate the stereo-picture after reorientation
Width, H are also the height of the stereo-picture after reorientation,It indicatesMiddle coordinate position is the picture of (x', y')
The pixel value of vegetarian refreshments；
And according to the depth conversion matrix of the corresponding optimum target quadrilateral mesh of each quadrilateral mesh in { L (x, y) }, meter
Calculate depth of the depth value of each pixel in each quadrilateral mesh in { L (x, y) } after depth conversion rectangular transform
Value, by UL,kMiddle horizontal coordinate position is x'L,kWith vertical coordinate position y'L,kPixel depth value z'L,kBecome by depth
The depth value changed after matrixing is denoted as Then according to each network of quadrilaterals in { L (x, y) }
It is deep to obtain the left view point after reorientation for depth value of the depth value of each pixel in lattice after depth conversion rectangular transform
Degree figure, is denoted asThen according toThe left view difference image after reorientation is obtained, is denoted as
It willMiddle coordinate position is that the pixel value of the pixel of (x', y') is denoted as Wherein, B'L,k=[z'L,k1],It indicatesMiddle coordinate bit
It is set to the pixel value of the pixel of (x', y')；
9. basisWithThe right visual point image after reorientation is obtained, is denoted as
It willMiddle coordinate position is that the pixel value of the pixel of (x', y') is denoted as Then willWithConstitute the stereo-picture after reorientation；Its
In, 1≤x'≤W', 1≤y'≤H, W' indicate that the width of the stereo-picture after reorientation, H are also the stereo-picture after reorientation
Height,It indicatesMiddle coordinate position isPixel pixel
Value.
2. a kind of stereo-picture method for relocating according to claim 1, it is characterised in that the step 6. in EQ's
Calculating process is：
6. the shape of the corresponding object quadrangle grid of all quadrilateral mesh in _ 1a, calculating { L (x, y) } protects energy, note
For ESD,Wherein, SL(k) U is indicatedL,kIn all pixels point vision saliency value
Mean value, namely indicate { SL(x, y) } in UL,kThe mean value of the pixel value of all pixels point in corresponding region, symbol " | |
| | " it is to seek Euclidean distance symbol；
And the boundary curvature energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) } is calculated, it is denoted as
ELB,Wherein, eL,kIndicate UL,kAll grid vertexes edge
The matrix of composition,(eL,k)TFor eL,kTransposition, ((eL,k)TeL,k)-1For (eL,k)TeL,k
It is inverse,It indicatesAll grid vertexes edge composition matrix,
6. _ 2a, according to ESDAnd ELB, calculate the image of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Mass-energy EQ, EQ=ESD+λLBELB；Wherein, λLBFor weighting parameters.
3. a kind of stereo-picture method for relocating according to claim 1 or 2, it is characterised in that the step 6. in
ESCalculating process be：
6. the shape of the corresponding object quadrangle grid of all quadrilateral mesh in _ 1b, calculating { L (x, y) } scales energy, note
For ESC,Wherein, symbol " | | | | " is to seek Euclidean distance symbol,It indicatesInstitute
The matrix being made of the edge of grid vertex, Indicate UL,kI-th of grid vertexDepth value,It indicatesDepth value, eL,kIndicate UL,kAll grid vertexes edge composition matrix,
And the deep-controlled energy of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) } is calculated, it is denoted as
EDC,
Wherein, exp () is indicated using natural radix e as the exponential function at bottom, symbol " | | " it is the symbol that takes absolute value, zmaxIndicate L (x,
Y) maximum depth value }, zminIndicate the minimum depth value of { L (x, y) }, CVZminIndicate minimum comfortable viewing areas range,E indicates the horizontal base line distance between the left view point of pending stereo-picture and right viewpoint, D tables
Show the viewing distance between the left view point of pending stereo-picture and right viewpoint and display, η1Indicate that minimum comfortable viewing regards
Angle, CVZmaxIndicate maximum comfortable viewing areas range,η2Indicate maximum comfortable viewing visual angle；
6. _ 2b, according to ESCAnd EDC, calculate the solid of the corresponding object quadrangle grid of all quadrilateral mesh in { L (x, y) }
Mass-energy ES, ES=ESC+λDCEDC；Wherein, λDCFor weighting parameters.
4. a kind of stereo-picture method for relocating according to claim 3, it is characterised in that the step 6. in EI's
Calculating process is：Wherein,Table
Show the rectangular area range where the important content of user's selection, xi,jIndicate { L (x, y) } in the horizontal direction be j-th and
The horizontal coordinate position for the grid vertex that vertical direction is i-th, xi,j+1Indicate to be jth+1 in the horizontal direction in { L (x, y) }
And vertical direction be i-th grid vertex horizontal coordinate position, zi,jIndicate to be jth in the horizontal direction in { L (x, y) }
The depth value of grid vertex that is a and being i-th in vertical direction,Indicate { L (x, y) } in the horizontal direction be j-th and
In the horizontal coordinate position that vertical direction is the grid vertex of i-th of grid vertex in object quadrangle grid,Table
Show in { L (x, y) } be in the horizontal direction jth+1 and vertical direction be i-th grid vertex in object quadrangle grid
In grid vertex horizontal coordinate position,It is j-th in the horizontal direction in expression { L (x, y) } and is i-th in vertical direction
The depth value of grid vertex of a grid vertex in object quadrangle grid, s'xIndicate the horizontal scaling specified of user because
Son, s'zIndicate the depth scalability factor that user specifies, λDSFor weighting parameters.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711399351.4A CN108307170B (en) | 2017-12-22 | 2017-12-22 | A kind of stereo-picture method for relocating |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711399351.4A CN108307170B (en) | 2017-12-22 | 2017-12-22 | A kind of stereo-picture method for relocating |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108307170A true CN108307170A (en) | 2018-07-20 |
| CN108307170B CN108307170B (en) | 2019-09-10 |
Family
ID=62870859
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711399351.4A Active CN108307170B (en) | 2017-12-22 | 2017-12-22 | A kind of stereo-picture method for relocating |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108307170B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111126243A (en) * | 2019-12-19 | 2020-05-08 | 北京科技大学 | Image data detection method and device and computer readable storage medium |
| CN112561993A (en) * | 2020-12-07 | 2021-03-26 | 宁波大学 | Three-dimensional image repositioning method |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060050338A1 (en) * | 2004-08-09 | 2006-03-09 | Hiroshi Hattori | Three-dimensional-information reconstructing apparatus, method and program |
| US20130129191A1 (en) * | 2010-08-31 | 2013-05-23 | Hailin Jin | Methods and Apparatus for Image Rectification for Stereo Display |
| CN104574404A (en) * | 2015-01-14 | 2015-04-29 | 宁波大学 | Three-dimensional image relocation method |
| CN106504186A (en) * | 2016-09-30 | 2017-03-15 | 天津大学 | A kind of stereo-picture reorientation method |
| CN106570900A (en) * | 2016-10-11 | 2017-04-19 | 宁波大学 | Three-dimensional image relocation method |
| CN107105214A (en) * | 2017-03-16 | 2017-08-29 | 宁波大学 | A kind of 3 d video images method for relocating |
-
2017
- 2017-12-22 CN CN201711399351.4A patent/CN108307170B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060050338A1 (en) * | 2004-08-09 | 2006-03-09 | Hiroshi Hattori | Three-dimensional-information reconstructing apparatus, method and program |
| US20130129191A1 (en) * | 2010-08-31 | 2013-05-23 | Hailin Jin | Methods and Apparatus for Image Rectification for Stereo Display |
| CN104574404A (en) * | 2015-01-14 | 2015-04-29 | 宁波大学 | Three-dimensional image relocation method |
| CN106504186A (en) * | 2016-09-30 | 2017-03-15 | 天津大学 | A kind of stereo-picture reorientation method |
| CN106570900A (en) * | 2016-10-11 | 2017-04-19 | 宁波大学 | Three-dimensional image relocation method |
| CN107105214A (en) * | 2017-03-16 | 2017-08-29 | 宁波大学 | A kind of 3 d video images method for relocating |
Non-Patent Citations (1)
| Title |
|---|
| 林文崇等: "一种基于人眼视觉注意力的三维视频重定向方法", 《光电子.激光》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111126243A (en) * | 2019-12-19 | 2020-05-08 | 北京科技大学 | Image data detection method and device and computer readable storage medium |
| CN111126243B (en) * | 2019-12-19 | 2023-04-07 | 北京科技大学 | Image data detection method and device and computer readable storage medium |
| CN112561993A (en) * | 2020-12-07 | 2021-03-26 | 宁波大学 | Three-dimensional image repositioning method |
| CN112561993B (en) * | 2020-12-07 | 2023-04-28 | 宁波大学 | Stereo image repositioning method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108307170B (en) | 2019-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106570900B (en) | A kind of stereo-picture method for relocating | |
| CN103971408B (en) | Three-dimensional facial model generating system and method | |
| CN107105214B (en) | A kind of 3 d video images method for relocating | |
| CN105574922B (en) | A kind of threedimensional model high quality texture mapping method of robust | |
| CN102223556B (en) | Multi-view stereoscopic image parallax free correction method | |
| CN105303616B (en) | Embossment modeling method based on single photo | |
| CN105023275B (en) | Super-resolution optical field acquisition device and its three-dimensional rebuilding method | |
| CN104093013B (en) | In a kind of stereo vision three-dimensional visualization system, automatically regulate the method for image parallactic | |
| CN100545864C (en) | Cylinder frame buffer texture re-labeling geometric correction method based on software | |
| TWI750710B (en) | Image processing method and apparatus, image processing device and storage medium | |
| CN108307170B (en) | A kind of stereo-picture method for relocating | |
| CN102447925A (en) | Method and device for synthesizing virtual viewpoint image | |
| CN106652015A (en) | Virtual figure head portrait generation method and apparatus | |
| CN106504186A (en) | A kind of stereo-picture reorientation method | |
| CN103761736B (en) | A kind of image partition method based on Bayes's harmony degree | |
| CN105376553B (en) | A kind of 3 D video method for relocating | |
| CN105427242B (en) | Interactive gridding restrained deformation image adaptive Zoom method based on perception of content | |
| CN102695070B (en) | Depth consistency fusion processing method for stereo image | |
| CN108810512B (en) | A kind of object-based stereo-picture depth method of adjustment | |
| CN108615221A (en) | Light field angle super-resolution rate method and device based on the two-dimentional epipolar plane figure of shearing | |
| CN108833876B (en) | A kind of stereoscopic image content recombination method | |
| CN102469319A (en) | Three-dimensional menu generation method and three-dimensional display device | |
| CN106920213A (en) | The acquisition methods and system of a kind of high-definition picture | |
| CN109413404B (en) | A kind of stereo-picture Zooming method | |
| CN106998460B (en) | A kind of hole-filling algorithm based on depth transition and depth item total variational |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230825 Address after: 230000 Room 203, building 2, phase I, e-commerce Park, Jinggang Road, Shushan Economic Development Zone, Hefei City, Anhui Province Patentee after: Hefei Jiuzhou Longteng scientific and technological achievement transformation Co.,Ltd. Address before: 230000 floor 1, building 2, phase I, e-commerce Park, Jinggang Road, Shushan Economic Development Zone, Hefei City, Anhui Province Patentee before: Dragon totem Technology (Hefei) Co.,Ltd. Effective date of registration: 20230825 Address after: 230000 floor 1, building 2, phase I, e-commerce Park, Jinggang Road, Shushan Economic Development Zone, Hefei City, Anhui Province Patentee after: Dragon totem Technology (Hefei) Co.,Ltd. Address before: 315211, Fenghua Road, Jiangbei District, Zhejiang, Ningbo 818 Patentee before: Ningbo University |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240129 Address after: Room 604, Building 57, No. 1 Jizuoyuan East Street, Qinhuai District, Nanjing City, Jiangsu Province, 210000 Patentee after: Mao Yi Country or region after: China Patentee after: Xia Ling Patentee after: Yang Yi Patentee after: Zhang Tingting Address before: 230000 Room 203, building 2, phase I, e-commerce Park, Jinggang Road, Shushan Economic Development Zone, Hefei City, Anhui Province Patentee before: Hefei Jiuzhou Longteng scientific and technological achievement transformation Co.,Ltd. Country or region before: China |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240222 Address after: 2nd Floor, Hualuogeng Innovation Center Office Building, No. 90 Jintan Avenue, Jintan District, Changzhou City, Jiangsu Province, 215000 Patentee after: Jiangsu Haijiang Aerospace Technology Co.,Ltd. Country or region after: China Address before: Room 604, Building 57, No. 1 Jizuoyuan East Street, Qinhuai District, Nanjing City, Jiangsu Province, 210000 Patentee before: Mao Yi Country or region before: China Patentee before: Xia Ling Patentee before: Yang Yi Patentee before: Zhang Tingting |
|
| TR01 | Transfer of patent right |