CN110933393B - Parallax image sequence synthesis method and system for holographic stereogram printing - Google Patents
Parallax image sequence synthesis method and system for holographic stereogram printing Download PDFInfo
- Publication number
- CN110933393B CN110933393B CN201911248569.9A CN201911248569A CN110933393B CN 110933393 B CN110933393 B CN 110933393B CN 201911248569 A CN201911248569 A CN 201911248569A CN 110933393 B CN110933393 B CN 110933393B
- Authority
- CN
- China
- Prior art keywords
- image sequence
- parallax image
- parallax
- size
- sequence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/128—Adjusting depth or disparity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention relates to a parallax image sequence synthesis method and a system for holographic stereogram printing, which comprises the steps of processing a first parallax image sequence and a second parallax image sequence with differences to obtain a first all-zero matrix and a second all-zero matrix; mapping each image pixel in the first parallax image sequence to a corresponding first all-zero matrix to generate a third parallax image sequence based on the corresponding relation between the third field angle and the third image size, and generating a fourth parallax image sequence in the same way; generating a foreground template according to the third parallax image sequence; multiplying each foreground template and each image of the fourth parallax image sequence to generate a fifth parallax image sequence; and correspondingly adding each image of the third parallax image sequence and each image of the fifth parallax image sequence to generate a synthesized parallax image sequence. The invention can realize correct and effective fusion processing on various light field information to obtain a parallax image sequence containing complex light field information, and is effectively applied to printing of the holographic stereogram.
Description
Technical Field
The invention relates to the field of printing of synthetic holographic volume views, in particular to a parallax image sequence synthesis method and system for printing the holographic volume views.
Background
The synthetic holographic volume view printing technology does not need to be subjected to complex diffraction calculation, is the only currently and really applied holographic printing technology, and has the basic principle that the characteristic of limited human eye resolution is utilized, continuous object light wave front information is approximately replaced by discrete light field sampling, and the true three-dimensional display effect of a scene is obtained by combining a binocular parallax principle and holography. Wherein the discrete light field samples correspond to an acquisition of a sequence of parallax images. For a complex light field, a differential sampling method is required, for example, a dense camera array is often used for sampling a small real object, and a virtual camera is used for sampling a virtual object. Parameters such as the size and the field angle of the parallax image obtained by different sampling methods are different, and at this time, an effective image sequence synthesis method needs to be developed to achieve correct and effective fusion processing on various light field information, so that the parallax image sequence containing complex light field information can be obtained, and the method is effectively applied to printing of the holographic stereogram.
Disclosure of Invention
The invention aims to provide a parallax image sequence synthesis method and a parallax image sequence synthesis system for printing a holographic volume view, which can realize correct and effective fusion processing on various light field information to obtain a parallax image sequence containing complex light field information, and can be effectively applied to printing of the holographic volume view.
In order to achieve the purpose, the invention provides the following scheme:
a method of synthesis of a sequence of parallax images for holographic volume view printing, comprising:
acquiring a first parallax image sequence and a second parallax image sequence; wherein a first field angle of the first parallax image sequence is different from a second field angle of the second parallax image sequence, a first virtual scene of the first parallax image sequence is different from a second virtual scene of the second parallax image sequence, a first image size of the first parallax image sequence is different from a second image size of the second parallax image sequence, and the number of images of the first parallax image sequence is the same as the number of images of the second parallax image sequence;
establishing a corresponding relation between a third field angle and a third image size;
performing size scaling processing on each image in the first parallax image sequence to obtain a first all-zero matrix, and performing size scaling processing on each image in the second parallax image sequence to obtain a second all-zero matrix; one image in the first parallax image sequence corresponds to a first all-zero matrix, and one image in the second parallax image sequence corresponds to a second all-zero matrix;
mapping each image pixel in the first parallax image sequence into a corresponding first all-zero matrix to generate a third parallax image sequence, and mapping each image pixel in the second parallax image sequence into a corresponding second all-zero matrix to generate a fourth parallax image sequence based on the corresponding relation between the third field angle and the third image size; the field angle of the third parallax image sequence is a third field angle, and the image size is a third image size; the field angle of the fourth parallax image sequence is a third field angle, and the image size is a third image size;
generating a plurality of foreground templates according to the third parallax image sequence; wherein one image of the third parallax image sequence corresponds to one foreground template;
multiplying each foreground template with each image of the fourth parallax image sequence to generate a fifth parallax image sequence;
correspondingly adding each image of the third parallax image sequence and each image of the fifth parallax image sequence to generate a synthesized parallax image sequence.
Optionally, the acquiring the first parallax image sequence and the second parallax image sequence specifically includes:
setting a first virtual scene in 3Ds Max three-dimensional modeling software, and rendering by using a free camera1 with a first field angle alpha to obtain a first parallax image sequence Ai(ii) a The first parallax image sequence AiAll of the first image sizes are HA×WA；
Setting a second virtual scene in 3Ds Max three-dimensional modeling software, and rendering by using a free camera2 with a second field angle of beta to obtain a second parallax image sequence BjThe second parallax image sequence BjAll of the second image sizes are HB×WB(ii) a Where i, j denotes the number of images, i, j being 0,1, 2.
Optionally, the establishing of the corresponding relationship between the third field angle and the third image size specifically includes:
and setting a free camera3 with a third field angle gamma by using 3Ds Max three-dimensional modeling software, rendering the first virtual scene and the second virtual scene respectively to obtain a third image with the size of M multiplied by M, and further establishing a corresponding relation between the third field angle gamma and the third image with the size of M multiplied by M.
Optionally, the performing size scaling processing on each image in the first parallax image sequence to obtain a first all-zero matrix, and performing size scaling processing on each image in the second parallax image sequence to obtain a second all-zero matrix specifically includes:
according to a first size scaling factor, performing size scaling processing on each image in the first parallax image sequence to obtain a first all-zero matrix; the image size of the first parallax image sequence is HA×WAThe third image size is M, and the first size scaling factor is (z)1,z2)，z1＝M/HA，z2＝M/WA；
According to a second size scaling factor, performing size scaling processing on each image in the second parallax image sequence to obtain a second all-zero matrix; the image size of the second parallax image sequence is HB×WBThe second size scaling factor is (z)3,z4)，z3＝M/HB，z4＝M/WB。
Optionally, the mapping, based on the corresponding relationship between the third field angle and the third image size, each image pixel in the first parallax image sequence to the corresponding first all-zero matrix to generate a third parallax image sequence, and mapping each image pixel in the second parallax image sequence to the corresponding second all-zero matrix to generate a fourth parallax image sequence, specifically including:
based on the corresponding relation between the third field angle and the third image size, expanding or reducing the image boundary of the first parallax image sequence to obtain a preliminary third parallax image sequence;
based on the corresponding relation between the third field angle and the third image size, expanding or reducing the image boundary of the second parallax image sequence to obtain a preliminary fourth parallax image sequence;
mapping pixels of each image in the preliminary third parallax image sequence back to the first parallax image sequence to obtain pixel positions of each pixel of each image in the preliminary third parallax image sequence;
mapping pixels of each image in the preliminary fourth parallax image sequence back to the second parallax image sequence to obtain pixel positions of each pixel of each image in the preliminary fourth parallax image sequence;
filling the first all-zero matrix by adopting bilinear interpolation operation according to each pixel of each image in the preliminary third parallax image sequence and the pixel position corresponding to each pixel until all the first all-zero matrices are filled, and generating a third parallax image sequence;
and filling the second all-zero matrix by adopting bilinear interpolation operation according to each pixel of each image in the preliminary fourth parallax image sequence and the pixel position corresponding to each pixel until all the second all-zero matrices are filled, and generating a fourth parallax image sequence.
A parallax image sequence synthesis system for holographic volumetric view printing, comprising:
the parallax image sequence acquisition module is used for acquiring a first parallax image sequence and a second parallax image sequence; wherein a first field angle of the first parallax image sequence is different from a second field angle of the second parallax image sequence, a first virtual scene of the first parallax image sequence is different from a second virtual scene of the second parallax image sequence, a first image size of the first parallax image sequence is different from a second image size of the second parallax image sequence, and the number of images of the first parallax image sequence is the same as the number of images of the second parallax image sequence;
the corresponding relation establishing module is used for establishing the corresponding relation between the third field angle and the third image size;
the all-zero matrix generation module is used for carrying out size scaling processing on each image in the first parallax image sequence to obtain a first all-zero matrix and carrying out size scaling processing on each image in the second parallax image sequence to obtain a second all-zero matrix; one image in the first parallax image sequence corresponds to a first all-zero matrix, and one image in the second parallax image sequence corresponds to a second all-zero matrix;
the third and fourth parallax image sequence generating module is used for mapping each image pixel in the first parallax image sequence to a corresponding first all-zero matrix to generate a third parallax image sequence and mapping each image pixel in the second parallax image sequence to a corresponding second all-zero matrix to generate a fourth parallax image sequence based on the corresponding relation between the third field angle and the third image size; the field angle of the third parallax image sequence is a third field angle, and the image size is a third image size; the field angle of the fourth parallax image sequence is a third field angle, and the image size is a third image size;
a foreground template generating module, configured to generate a plurality of foreground templates according to the third parallax image sequence; wherein one image of the third parallax image sequence corresponds to one foreground template;
a fifth parallax image sequence generation module, configured to multiply each image of the foreground template and the fourth parallax image sequence to generate a fifth parallax image sequence;
and the synthesized parallax image sequence generating module is used for correspondingly adding each image of the third parallax image sequence and each image of the fifth parallax image sequence to generate a synthesized parallax image sequence.
Optionally, the parallax image sequence obtaining module specifically includes:
a first parallax image sequence acquisition unit for setting a first virtual scene in 3Ds Max three-dimensional modeling software, using a free camera ca with a first field angle of alphaThe mera1 renders a first parallax image sequence Ai(ii) a The first parallax image sequence AiAll of the first image sizes are HA×WA；
A second parallax image sequence acquisition unit, configured to set a second virtual scene in the 3Ds Max three-dimensional modeling software, and render the second virtual scene using the free camera2 with a second field angle β to obtain a second parallax image sequence BjThe second parallax image sequence BjAll of the second image sizes are HB×WB(ii) a Where i, j denotes the number of images, i, j being 0,1, 2.
Optionally, the correspondence relationship establishing module specifically includes:
and the corresponding relation establishing unit is used for setting a free camera3 with a third field angle gamma by using 3Ds Max three-dimensional modeling software, rendering the first virtual scene and the second virtual scene respectively to obtain a third image with the size of M multiplied by M, and further establishing a corresponding relation between the third field angle gamma and the third image with the size of M multiplied by M.
Optionally, the all-zero matrix generation module specifically includes:
the first all-zero matrix generating unit is used for carrying out size scaling processing on each image in the first parallax image sequence according to a first size scaling factor to obtain a first all-zero matrix; the image size of the first parallax image sequence is HA×WAThe third image size is M, and the first size scaling factor is (z)1,z2)，z1＝M/HA，z2＝M/WA；
The second all-zero matrix generating unit is used for carrying out size scaling processing on each image in the second parallax image sequence according to a second size scaling factor to obtain a second all-zero matrix; the image size of the second parallax image sequence is HB×WBThe second size scaling factor is (z)3,z4)，z3＝M/HB，z4＝M/WB。
Optionally, the third and fourth parallax image sequence generating modules specifically include:
a preliminary third parallax image sequence determining unit, configured to expand or reduce an image boundary of the first parallax image sequence based on a corresponding relationship between the third field angle and a third image size to obtain a preliminary third parallax image sequence;
a preliminary fourth parallax image sequence determining unit, configured to expand or reduce an image boundary of the second parallax image sequence based on a corresponding relationship between the third field angle and a third image size to obtain a preliminary fourth parallax image sequence;
a pixel position first determining unit, configured to map pixels of each image in the preliminary third parallax image sequence back to the first parallax image sequence, so as to obtain a pixel position of each pixel of each image in the preliminary third parallax image sequence;
a pixel position second determining unit, configured to map pixels of each image in the preliminary fourth parallax image sequence back to the second parallax image sequence, so as to obtain a pixel position of each pixel of each image in the preliminary fourth parallax image sequence;
a third parallax image sequence generating unit, configured to fill the first all-zero matrix by using bilinear interpolation operation according to each pixel of each image in the preliminary third parallax image sequence and a pixel position corresponding to each pixel, until all the first all-zero matrices are filled, and generate a third parallax image sequence;
and the fourth parallax image sequence generating unit is used for filling the second all-zero matrix by adopting bilinear interpolation operation according to each pixel of each image in the preliminary fourth parallax image sequence and the pixel position corresponding to each pixel until all the second all-zero matrices are filled, and generating a fourth parallax image sequence.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects:
when the image size and the sampling field angle of the two parallax image sequences A and B for printing the holographic volume view are different, the parallax image sequence synthesis method and the parallax image sequence synthesis system for printing the holographic volume view can fuse two groups of parallax image sequences obtained by shooting with different sampling field angles and different image sizes to obtain a synthesized parallax image sequence containing correct shielding and front-back relation between two scenes A, B, namely the parallax image sequence containing complex light field information, and can be effectively applied to printing the holographic volume view.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
FIG. 1 is a flow chart of a parallax image sequence synthesis method for holographic volume view printing according to the present invention;
fig. 2 is a structural diagram of a parallax image sequence synthesizing system for holographic volume view printing according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention aims to provide a parallax image sequence synthesis method and a parallax image sequence synthesis system for printing a holographic volume view, which can realize correct and effective fusion processing on various light field information to obtain a parallax image sequence containing complex light field information, and can be effectively applied to printing of the holographic volume view.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
The method for synthesizing the parallax image sequences with different sizes and different field angles can effectively solve the sampling problem of the multi-source heterogeneous light field. The holographic view including the real-virtual mixed scene needs to sample each scene to obtain a parallax image sequence. In order to meet the printing requirement of the holographic stereogram, the virtual scene can accurately set the parameters of the virtual camera for sampling according to the printing requirement through 3Ds Max software; due to the limitation of factors such as cost, storage and field, the real scene often cannot acquire the parallax image sequence meeting the requirement. According to the method, the size and the view angle which meet the requirements of holographic printing can be obtained by processing the size and the view angle of a real scene sampling image (namely, a first parallax image sequence), and finally, the size and the view angle are synthesized with a virtual scene image sequence (namely, a second parallax image sequence), so that the method can be used for printing the holographic stereogram.
As shown in fig. 1, the present invention provides a parallax image sequence synthesis method for hologram view printing, including the following steps.
Step 101: acquiring a first parallax image sequence and a second parallax image sequence; wherein a first field angle of the first parallax image sequence is different from a second field angle of the second parallax image sequence, a first virtual scene of the first parallax image sequence is different from a second virtual scene of the second parallax image sequence, a first image size of the first parallax image sequence is different from a second image size of the second parallax image sequence, and the number of images of the first parallax image sequence is the same as the number of images of the second parallax image sequence. The method specifically comprises the following steps:
setting a virtual scene 1 in 3Ds Max three-dimensional modeling software, and rendering by using a free camera1 with an angle of view alpha to obtain a first parallax image sequence Ai(ii) a Setting a virtual scene 2 in 3Ds Max three-dimensional modeling software, and rendering by using a free camera2 with a view angle beta to obtain a second parallax image sequence BjWhere i, j denotes the number of images, i, j being 0,1, 2. First parallax image sequence AiAll have an image size of HA×WASecond parallax mapImage sequence BjAll have an image size of HB×WB。
Step 102: and establishing a corresponding relation between the third field angle and the third image size. The method specifically comprises the following steps:
and setting a free camera3 with a third field angle gamma by using 3Ds Max three-dimensional modeling software, rendering the first virtual scene 1 and the second virtual scene 2 respectively to obtain a third image with the size of M × M, and judging that the third image corresponding to the third field angle gamma is of the size of M × M.
Step 103: performing size scaling processing on each image in the first parallax image sequence to obtain a first all-zero matrix, and performing size scaling processing on each image in the second parallax image sequence to obtain a second all-zero matrix; one image in the first parallax image sequence corresponds to a first all-zero matrix, and one image in the second parallax image sequence corresponds to a second all-zero matrix. The method specifically comprises the following steps:
reading in a first parallax image sequence A by using matlab softwareiAnd a second parallax image sequence Bj，i,j＝0,1,2,...,n。
For the first parallax image sequence AiEach image of (2), defining a size scaling factor z1＝M/HA、z2＝M/WAThen generate one (z)1×HA)×(z2×WA) A first all-zero matrix of (a); for the second parallax image sequence BjEach image of (2), defining a size scaling factor z3＝M/HB、z4＝M/WBThen generate one (z)3×HB)×(z4×WB) The second all-zero matrix of (a).
Step 104: mapping each image pixel in the first parallax image sequence into a corresponding first all-zero matrix to generate a third parallax image sequence, and mapping each image pixel in the second parallax image sequence into a corresponding second all-zero matrix to generate a fourth parallax image sequence based on the corresponding relation between the third field angle and the third image size; the field angle of the third parallax image sequence is a third field angle, and the image size is a third image size; the field angle of the fourth parallax image sequence is a third field angle, and the image size is a third image size. The method specifically comprises the following steps:
step 1041: count symbols i and j are generated, and when initializing, the notation i is 0 and the notation j is 0.
Step 1042: based on the corresponding relation between the third field angle and the third image size, the first parallax image sequence AiThe image boundary of the first parallax image sequence B is expanded or reduced to obtain a preliminary third parallax image sequence BjAnd expanding or reducing the image boundary to obtain a preliminary fourth parallax image sequence. Mapping pixels (u, v) in the preliminary third and fourth parallax image sequences back to the first parallax image sequence images A, respectivelyiAnd a second parallax image sequence BjIn the step (b), since (x, y) may not be an integer, the pixel position (x, y) of each pixel in the preliminary third parallax image sequence and the preliminary fourth parallax image sequence is obtained, and (a, b) is obtained by rounding down, where x is a + δ, y is b + θ, 0 is ≦ δ, and θ < 1 is a fractional part.
Step 1043: and (3) carrying out bilinear interpolation operation:
f(u,v)＝f(x,y)＝(1-δ)(1-θ)f(a,b)+(1-δ)θf(a,b+1)
+δ(1-θ)f(a+1,b)+δθf(a+1,b+1)
step 1044: mapping (u, v) the preliminary third and fourth parallax image sequences pixel by pixel until the first all-zero matrix (z) is completely filled1×HA)×(z2×WA) And a second all-zero matrix (z)3×HB)×(z4×WB) An image with an image size of M × M and a field angle of γ is obtained.
Step 1045: judging whether the first parallax image sequence A is finished or not according to the value of the counting symbol iiAnd (4) processing. If i ≧ n is satisfied, a third parallax image sequence S with an image size of M × M and a field angle of γ is outputi(ii) a If i is less than n, let i be i +1, execute steps 1042-1044 until i is greater than or equal to n, at which time output a third parallax image sequence with size of M × M and viewing angle γColumn Si. Similarly, if j ≧ n is satisfied, the fourth parallax image sequence T with an image size of M × M and a field angle γ is outputj(ii) a If j is less than n, let j equal to j +1, execute steps 1042-1044 until j ≧ n, at which time the fourth parallax image sequence T with size of M × M and field angle γ is outputj。
Step 105: generating a plurality of foreground templates according to the third parallax image sequence; wherein one image of the third parallax image sequence corresponds to one foreground template. The method specifically comprises the following steps:
using a third parallax image sequence SiEach image S ofi(u, v) Generation of Foreground template Mi(u,v), (u, v are pixel coordinates). When the image SiWhen scene information is included in (u, v), the foreground template Mi(u, v) the pixel information of the corresponding position is transparent, and the rest positions are opaque. Wherein:
Si(u,v)alpharepresentation image SiThe alpha channel value in (u, v) represents the transparency of the pixel.
Step 106: and multiplying each foreground template and each image of the fourth parallax image sequence to generate a fifth parallax image sequence. The method specifically comprises the following steps:
with each foreground template Mi(u, v) times a fourth parallax image sequence TjEach image T ofj(u, v) to obtain a fifth parallax image sequence, i ═ j, that is, to obtain a fifth parallax image sequence
Ci(u,v)＝Mi(u,v)×Tj(u,v)。
Wherein the image of the fifth parallax image sequence is Ci(u,v)。
Step 107: correspondingly adding each image of the third parallax image sequence and each image of the fifth parallax image sequence to generate a synthesized parallax image sequence.
Image Si(u, v) and Ci(u, v) are added to each other,the resulting composite disparity image sequence D is obtainediIt can be formulated as:
Di(u,v)＝Si(u,v)+Ci(u,v)。
wherein the image of the synthesized parallax image sequence is Di(u,v)。
And performing three-dimensional reconstruction on each scene by adopting a three-dimensional reconstruction technology based on sequence images, and then sampling the combined model by adopting the same camera. The image-based three-dimensional model reconstruction technology has the characteristics of vivid modeling, high operation speed, less occupied system resources and the like, and is widely applied to the fields of industrial manufacturing, cultural relic digitization, medical education and the like. The method comprises the steps of firstly, independently sampling different three-dimensional scenes by using a camera to obtain respective view image sequences, then carrying out three-dimensional modeling on the three-dimensional scenes by using a three-dimensional reconstruction algorithm based on sequence images, and finally, only needing to use a virtual camera to render a combined model to obtain a full-parallax view image sequence fused with various scenes, wherein the full-parallax view image sequence comprises correct relations among the scenes, such as shielding, positions, sizes and the like.
To achieve the above object, the present invention further provides a parallax image sequence synthesis system for holographic volume view printing, as shown in fig. 2, comprising:
a parallax image sequence acquisition module 201, configured to acquire a first parallax image sequence and a second parallax image sequence; wherein a first field angle of the first parallax image sequence is different from a second field angle of the second parallax image sequence, a first virtual scene of the first parallax image sequence is different from a second virtual scene of the second parallax image sequence, a first image size of the first parallax image sequence is different from a second image size of the second parallax image sequence, and the number of images of the first parallax image sequence is the same as the number of images of the second parallax image sequence.
A corresponding relationship establishing module 202, configured to establish a corresponding relationship between the third field angle and the third image size.
An all-zero matrix generation module 203, configured to perform size scaling on each image in the first parallax image sequence to obtain a first all-zero matrix, and perform size scaling on each image in the second parallax image sequence to obtain a second all-zero matrix; one image in the first parallax image sequence corresponds to a first all-zero matrix, and one image in the second parallax image sequence corresponds to a second all-zero matrix.
A third and fourth parallax image sequence generating module 204, configured to map each image pixel in the first parallax image sequence into a corresponding first all-zero matrix to generate a third parallax image sequence, and map each image pixel in the second parallax image sequence into a corresponding second all-zero matrix to generate a fourth parallax image sequence, based on a corresponding relationship between the third field angle and a third image size; the field angle of the third parallax image sequence is a third field angle, and the image size is a third image size; the field angle of the fourth parallax image sequence is a third field angle, and the image size is a third image size.
A foreground template generating module 205, configured to generate a plurality of foreground templates according to the third parallax image sequence; wherein one image of the third parallax image sequence corresponds to one foreground template.
A fifth parallax image sequence generating module 206, configured to multiply each image of the foreground template and the fourth parallax image sequence to generate a fifth parallax image sequence.
And a synthesized parallax image sequence generating module 207, configured to add each image of the third parallax image sequence and each image of the fifth parallax image sequence correspondingly to generate a synthesized parallax image sequence.
The parallax image sequence acquiring module 201 specifically includes:
a first parallax image sequence acquisition unit, configured to set a first virtual scene in the 3Ds Max three-dimensional modeling software, and render the first virtual scene using the free camera1 with the first field angle α to obtain a first parallax image sequence ai(ii) a The first parallax image sequence AiAll of the first image sizes are HA×WA。
A second parallax image sequence acquisition unit, configured to set a second virtual scene in the 3Ds Max three-dimensional modeling software, and render the second virtual scene using the free camera2 with a second field angle β to obtain a second parallax image sequence BjThe second parallax image sequence BjAll of the second image sizes are HB×WB(ii) a Where i, j denotes the number of images, i, j being 0,1, 2.
The correspondence establishing module 202 specifically includes:
and the corresponding relation establishing unit is used for setting a free camera3 with a third field angle gamma by using 3Ds Max three-dimensional modeling software, rendering the first virtual scene and the second virtual scene respectively to obtain a third image with the size of M multiplied by M, and further establishing a corresponding relation between the third field angle gamma and the third image with the size of M multiplied by M.
The all-zero matrix generation module 203 specifically includes:
the first all-zero matrix generating unit is used for carrying out size scaling processing on each image in the first parallax image sequence according to a first size scaling factor to obtain a first all-zero matrix; the image size of the first parallax image sequence is HA×WAThe third image size is M, and the first size scaling factor is (z)1,z2)，z1＝M/HA，z2＝M/WA。
The second all-zero matrix generating unit is used for carrying out size scaling processing on each image in the second parallax image sequence according to a second size scaling factor to obtain a second all-zero matrix; the image size of the second parallax image sequence is HB×WBThe second size scaling factor is (z)3,z4)，z3＝M/HB，z4＝M/WB。
The third and fourth parallax image sequence generating module 204 specifically includes:
and the preliminary third parallax image sequence determining unit is used for expanding or reducing the image boundary of the first parallax image sequence based on the corresponding relation between the third field angle and the third image size to obtain a preliminary third parallax image sequence.
And the preliminary fourth parallax image sequence determining unit is used for expanding or reducing the image boundary of the second parallax image sequence based on the corresponding relation between the third field angle and the third image size to obtain a preliminary fourth parallax image sequence.
A pixel position first determining unit, configured to map pixels of each image in the preliminary third parallax image sequence back to the first parallax image sequence, so as to obtain a pixel position of each pixel of each image in the preliminary third parallax image sequence.
A pixel position second determining unit, configured to map pixels of each image in the preliminary fourth parallax image sequence back to the second parallax image sequence, so as to obtain a pixel position of each pixel of each image in the preliminary fourth parallax image sequence.
And the third parallax image sequence generating unit is used for filling the first all-zero matrix by adopting bilinear interpolation operation according to each pixel of each image in the preliminary third parallax image sequence and the pixel position corresponding to each pixel until all the first all-zero matrices are filled, and generating a third parallax image sequence.
And the fourth parallax image sequence generating unit is used for filling the second all-zero matrix by adopting bilinear interpolation operation according to each pixel of each image in the preliminary fourth parallax image sequence and the pixel position corresponding to each pixel until all the second all-zero matrices are filled, and generating a fourth parallax image sequence.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the method part for description.
The principles and embodiments of the present invention have been described herein using specific examples, which are provided only to help understand the method and the core concept of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the above, the present disclosure should not be construed as limiting the invention.
Claims (8)
1. A method of synthesizing a sequence of parallax images for holographic volume view printing, comprising:
acquiring a first parallax image sequence and a second parallax image sequence; wherein a first field angle of the first parallax image sequence is different from a second field angle of the second parallax image sequence, a first virtual scene of the first parallax image sequence is different from a second virtual scene of the second parallax image sequence, a first image size of the first parallax image sequence is different from a second image size of the second parallax image sequence, and the number of images of the first parallax image sequence is the same as the number of images of the second parallax image sequence;
establishing a corresponding relation between a third field angle and a third image size;
performing size scaling processing on each image in the first parallax image sequence to obtain a first all-zero matrix, and performing size scaling processing on each image in the second parallax image sequence to obtain a second all-zero matrix; one image in the first parallax image sequence corresponds to a first all-zero matrix, and one image in the second parallax image sequence corresponds to a second all-zero matrix;
mapping each image pixel in the first parallax image sequence into a corresponding first all-zero matrix to generate a third parallax image sequence, and mapping each image pixel in the second parallax image sequence into a corresponding second all-zero matrix to generate a fourth parallax image sequence based on the corresponding relation between the third field angle and the third image size; the field angle of the third parallax image sequence is a third field angle, and the image size is a third image size; the field angle of the fourth parallax image sequence is a third field angle, and the image size is a third image size;
generating a plurality of foreground templates according to the third parallax image sequence; wherein one image of the third parallax image sequence corresponds to one foreground template;
multiplying each foreground template with each image of the fourth parallax image sequence to generate a fifth parallax image sequence;
correspondingly adding each image of the third parallax image sequence and each image of the fifth parallax image sequence to generate a synthesized parallax image sequence;
the establishing of the corresponding relationship between the third field angle and the third image size specifically includes: and setting a free camera3 with a third field angle gamma by using 3Ds Max three-dimensional modeling software, rendering the first virtual scene and the second virtual scene respectively to obtain a third image with the size of M multiplied by M, and further establishing a corresponding relation between the third field angle gamma and the third image with the size of M multiplied by M.
2. The method as claimed in claim 1, wherein the acquiring the first parallax image sequence and the second parallax image sequence specifically includes:
setting a first virtual scene in 3Ds Max three-dimensional modeling software, and rendering by using a free camera1 with a first field angle alpha to obtain a first parallax image sequence Ai(ii) a The first parallax image sequence AiAll of the first image sizes are HA×WA；
Setting a second virtual scene in 3Ds Max three-dimensional modeling software, and rendering by using a free camera2 with a second field angle of beta to obtain a second parallax image sequence BjThe second parallax image sequence BjAll of the second image sizes are HB×WB(ii) a Where i, j denotes the number of images, i, j being 0,1, 2.
3. The method as claimed in claim 1, wherein the step of performing a size scaling process on each image in the first parallax image sequence to obtain a first all-zero matrix and performing a size scaling process on each image in the second parallax image sequence to obtain a second all-zero matrix specifically includes:
according to a first size scaling factor, performing size scaling processing on each image in the first parallax image sequence to obtain a first all-zero matrix; the image size of the first parallax image sequence is HA×WAThe third image size is M, and the first size scaling factor is (z)1,z2)，z1＝M/HA，z2＝M/WA；
According to a second size scaling factor, performing size scaling processing on each image in the second parallax image sequence to obtain a second all-zero matrix; the image size of the second parallax image sequence is HB×WBThe second size scaling factor is (z)3,z4)，z3＝M/HB，z4＝M/WB。
4. The method as claimed in claim 1, wherein the mapping each image pixel in the first parallax image sequence to a corresponding first all-zero matrix to generate a third parallax image sequence and mapping each image pixel in the second parallax image sequence to a corresponding second all-zero matrix to generate a fourth parallax image sequence based on a corresponding relationship between the third field angle and a third image size comprises:
based on the corresponding relation between the third field angle and the third image size, expanding or reducing the image boundary of the first parallax image sequence to obtain a preliminary third parallax image sequence;
based on the corresponding relation between the third field angle and the third image size, expanding or reducing the image boundary of the second parallax image sequence to obtain a preliminary fourth parallax image sequence;
mapping pixels of each image in the preliminary third parallax image sequence back to the first parallax image sequence to obtain pixel positions of each pixel of each image in the preliminary third parallax image sequence;
mapping pixels of each image in the preliminary fourth parallax image sequence back to the second parallax image sequence to obtain pixel positions of each pixel of each image in the preliminary fourth parallax image sequence;
filling the first all-zero matrix by adopting bilinear interpolation operation according to each pixel of each image in the preliminary third parallax image sequence and the pixel position corresponding to each pixel until all the first all-zero matrices are filled, and generating a third parallax image sequence;
and filling the second all-zero matrix by adopting bilinear interpolation operation according to each pixel of each image in the preliminary fourth parallax image sequence and the pixel position corresponding to each pixel until all the second all-zero matrices are filled, and generating a fourth parallax image sequence.
5. A parallax image sequence synthesis system for holographic volume view printing, comprising:
the parallax image sequence acquisition module is used for acquiring a first parallax image sequence and a second parallax image sequence; wherein a first field angle of the first parallax image sequence is different from a second field angle of the second parallax image sequence, a first virtual scene of the first parallax image sequence is different from a second virtual scene of the second parallax image sequence, a first image size of the first parallax image sequence is different from a second image size of the second parallax image sequence, and the number of images of the first parallax image sequence is the same as the number of images of the second parallax image sequence;
the corresponding relation establishing module is used for establishing the corresponding relation between the third field angle and the third image size;
the all-zero matrix generation module is used for carrying out size scaling processing on each image in the first parallax image sequence to obtain a first all-zero matrix and carrying out size scaling processing on each image in the second parallax image sequence to obtain a second all-zero matrix; one image in the first parallax image sequence corresponds to a first all-zero matrix, and one image in the second parallax image sequence corresponds to a second all-zero matrix;
the third and fourth parallax image sequence generating module is used for mapping each image pixel in the first parallax image sequence to a corresponding first all-zero matrix to generate a third parallax image sequence and mapping each image pixel in the second parallax image sequence to a corresponding second all-zero matrix to generate a fourth parallax image sequence based on the corresponding relation between the third field angle and the third image size; the field angle of the third parallax image sequence is a third field angle, and the image size is a third image size; the field angle of the fourth parallax image sequence is a third field angle, and the image size is a third image size;
a foreground template generating module, configured to generate a plurality of foreground templates according to the third parallax image sequence; wherein one image of the third parallax image sequence corresponds to one foreground template;
a fifth parallax image sequence generation module, configured to multiply each image of the foreground template and the fourth parallax image sequence to generate a fifth parallax image sequence;
a synthesized parallax image sequence generating module, configured to add each image of the third parallax image sequence and each image of the fifth parallax image sequence correspondingly to generate a synthesized parallax image sequence;
the corresponding relationship establishing module specifically includes: and the corresponding relation establishing unit is used for setting a free camera3 with a third field angle gamma by using 3Ds Max three-dimensional modeling software, rendering the first virtual scene and the second virtual scene respectively to obtain a third image with the size of M multiplied by M, and further establishing a corresponding relation between the third field angle gamma and the third image with the size of M multiplied by M.
6. The system of claim 5, wherein the parallax image sequence acquiring module specifically comprises:
a first parallax image sequence acquisition unit, configured to set a first virtual scene in the 3Ds Max three-dimensional modeling software, and render the first virtual scene using the free camera1 with the first field angle α to obtain a first parallax image sequence ai(ii) a The first parallax image sequence AiAll of the first image sizes are HA×WA；
A second parallax image sequence acquisition unit, configured to set a second virtual scene in the 3Ds Max three-dimensional modeling software, and render the second virtual scene using the free camera2 with a second field angle β to obtain a second parallax image sequence BjThe second parallax image sequence BjAll of the second image sizes are HB×WB(ii) a Where i, j denotes the number of images, i, j being 0,1, 2.
7. The system of claim 5, wherein the all-zero matrix generation module comprises:
the first all-zero matrix generating unit is used for carrying out size scaling processing on each image in the first parallax image sequence according to a first size scaling factor to obtain a first all-zero matrix; the image size of the first parallax image sequence is HA×WAThe third image size is M, and the first size scaling factor is (z)1,z2)，z1＝M/HA，z2＝M/WA；
The second all-zero matrix generating unit is used for carrying out size scaling processing on each image in the second parallax image sequence according to a second size scaling factor to obtain a second all-zero matrix; the image size of the second parallax image sequence is HB×WBThe second size scaling factor is (z)3,z4)，z3＝M/HB，z4＝M/WB。
8. The system of claim 5, wherein the third and fourth parallax image sequence generation modules specifically comprise:
a preliminary third parallax image sequence determining unit, configured to expand or reduce an image boundary of the first parallax image sequence based on a corresponding relationship between the third field angle and a third image size to obtain a preliminary third parallax image sequence;
a preliminary fourth parallax image sequence determining unit, configured to expand or reduce an image boundary of the second parallax image sequence based on a corresponding relationship between the third field angle and a third image size to obtain a preliminary fourth parallax image sequence;
a pixel position first determining unit, configured to map pixels of each image in the preliminary third parallax image sequence back to the first parallax image sequence, so as to obtain a pixel position of each pixel of each image in the preliminary third parallax image sequence;
a pixel position second determining unit, configured to map pixels of each image in the preliminary fourth parallax image sequence back to the second parallax image sequence, so as to obtain a pixel position of each pixel of each image in the preliminary fourth parallax image sequence;
a third parallax image sequence generating unit, configured to fill the first all-zero matrix by using bilinear interpolation operation according to each pixel of each image in the preliminary third parallax image sequence and a pixel position corresponding to each pixel, until all the first all-zero matrices are filled, and generate a third parallax image sequence;
and the fourth parallax image sequence generating unit is used for filling the second all-zero matrix by adopting bilinear interpolation operation according to each pixel of each image in the preliminary fourth parallax image sequence and the pixel position corresponding to each pixel until all the second all-zero matrices are filled, and generating a fourth parallax image sequence.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911248569.9A CN110933393B (en) | 2019-12-09 | 2019-12-09 | Parallax image sequence synthesis method and system for holographic stereogram printing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911248569.9A CN110933393B (en) | 2019-12-09 | 2019-12-09 | Parallax image sequence synthesis method and system for holographic stereogram printing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110933393A CN110933393A (en) | 2020-03-27 |
| CN110933393B true CN110933393B (en) | 2021-07-23 |
Family
ID=69858362
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911248569.9A Active CN110933393B (en) | 2019-12-09 | 2019-12-09 | Parallax image sequence synthesis method and system for holographic stereogram printing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110933393B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113014901B (en) * | 2021-02-25 | 2022-05-17 | 深圳臻像科技有限公司 | Parallax image sequence synthesis method and system for holographic volume view printing and storage medium |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160210780A1 (en) * | 2015-01-20 | 2016-07-21 | Jonathan Paulovich | Applying real world scale to virtual content |
| CN105867615A (en) * | 2016-03-24 | 2016-08-17 | 联想(北京)有限公司 | Information processing method and electronic device |
| WO2017182315A1 (en) * | 2016-04-22 | 2017-10-26 | Thomson Licensing | Method and device for compositing an image |
| CN106997281A (en) * | 2017-04-10 | 2017-08-01 | 北京小米移动软件有限公司 | The method and smart machine of shared virtual objects |
| CN107085509B (en) * | 2017-04-19 | 2019-07-05 | 腾讯科技（深圳）有限公司 | A kind of processing method and terminal of the foreground picture in virtual scene |
| CN110321089B (en) * | 2019-07-10 | 2023-03-31 | 中国人民解放军陆军装甲兵学院 | Holographic volume view printing method and system |
-
2019
- 2019-12-09 CN CN201911248569.9A patent/CN110933393B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110933393A (en) | 2020-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4803594B2 (en) | Apparatus and program for generating free viewpoint image by local region segmentation | |
| CN114549731A (en) | Method and device for generating visual angle image, electronic equipment and storage medium | |
| KR20100073173A (en) | Method and apparatus for reconstruction 3 dimension model | |
| NZ587839A (en) | Creating left eye and right eye composite layers using a layer of a 2-D frame | |
| CN110246146A (en) | Full parallax light field content generating method and device based on multiple deep image rendering | |
| CN111127536A (en) | Light field multi-plane representation reconstruction method and device based on neural network | |
| KR20110062083A (en) | Video restoration apparatus and its method | |
| CN110321089B (en) | Holographic volume view printing method and system | |
| CN110933393B (en) | Parallax image sequence synthesis method and system for holographic stereogram printing | |
| CN108924528A (en) | A kind of binocular stylization real-time rendering method based on deep learning | |
| Kwon et al. | Advanced three-dimensional visualization system for an integral imaging microscope using a fully convolutional depth estimation network | |
| CN108305281A (en) | Calibration method, device, storage medium, program product and the electronic equipment of image | |
| KR100321897B1 (en) | Stereoscopic image conversion method and apparatus | |
| CN115272608A (en) | Human hand reconstruction method and equipment | |
| Guo et al. | Content-aware warping for view synthesis | |
| CN113888694A (en) | SDF field micro-renderable-based transparent object reconstruction method and system | |
| US8786681B1 (en) | Stereoscopic conversion | |
| Zhou et al. | Single-view view synthesis with self-rectified pseudo-stereo | |
| US9118902B1 (en) | Stereoscopic conversion | |
| CN111010559B (en) | Method and device for generating naked eye three-dimensional light field content | |
| Knorr et al. | From 2D-to stereo-to multi-view video | |
| Yan et al. | Stereoscopic image generation from light field with disparity scaling and super-resolution | |
| Schnyder et al. | Depth image based compositing for stereo 3D | |
| Cho et al. | Depth image processing technique for representing human actors in 3DTV using single depth camera | |
| JP2023517461A (en) | Training the alignment of multiple images |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |