CN103513433A - Method and system for generating 3D integrated image based on display equipment - Google Patents

Abstract

The invention discloses a method and system for generating a 3D integrated image based on display equipment. The method includes the steps shat, firstly, parameters of the display equipment and a 3D model file are obtained, wherein the parameters of the display equipment include the number of micro lenses and the number of pixels of the display equipment covered by the micro lenses; then, the number of the micro lenses is compared with the number of the pixels of the display equipment covered by the micro lenses, and according to the comparison result, the 3D integrated image is generated through a parallel projection algorithm or a conical projection algorithm. According to the method for generating the 3D integrated image based on the display equipment, a 3D scene model can be quickly converted to the integrated image to be used for 3D integrated image display and provide the true three-dimensional image which is full in parallax, life-like in color and continuous in viewing point.

Description

A kind of generation method and system of the 3D integrated image based on display device

Technical field

The present invention relates to technical field of image processing, relate in particular to a kind of generation method and system of the 3D integrated image based on display device.

Background technology

Dimension display technologies based on integration imaging is the true dimension display technologies of a kind of bore hole.It is without wearing spectacles, can provide that full parallax, color are true to nature, the true 3-D view of continuous viewpoint, and can avoid the visual fatigue phenomenon that in multi-view auto stereo display, disparity map sudden change causes, and is the effective scheme that a kind of bore hole 3D shows.Integration imaging technology is the earliest by Lippmann[1] propose, be a kind of display technique of utilizing microlens array to carry out recording and reconstruction 3D scene.

While recording, by microlens array by the information of three-dimensional scenic different directions in focal plane enterprising line item.Also can adopt camera array to obtain the information of three-dimensional scenic different directions.The image primitive of each lenticule or cameras record one width two dimension.This optical system being comprised of lens arra and photo-sensitive cell obtains the method for 3D integrated image, although convenient and swift, the image obtaining and reproduced Existential Space degree of depth reversion.In order to address this problem, the people such as Ives have proposed two step writing-methods.And integrated image is through record repeatedly, image resolution ratio and quality are reduced widely.

Along with the development of computer graphic image treatment technology, people start to adopt computer Simulation calculation to replace optical means to obtain integrated image.This method not only can solve degree of depth reversion and resolution problem, and can obtain the integrated image of any 3D model optional position any direction.In calculation of complex 3D scene process, there is a large amount of pixel corresponding relations, block with the image such as pinup picture and process, this will expend a large amount of time.

Therefore, prior art has yet to be improved and developed.

Summary of the invention

In view of above-mentioned the deficiencies in the prior art, the object of the present invention is to provide a kind of generation method and system of the 3D integrated image based on display device, the long problem of elapsed time when the 3D model of place that is intended to solve prior art is converted into integrated image.

Technical scheme of the present invention is as follows:

A generation method for the 3D integrated image of display device, wherein, comprises the following steps:

A, obtain display device parameter and 3D model file, described display device parameter comprises that lenticule number N and lenticule cover display device number of pixels M;

B, lenticule number N and lenticule are covered to display device number of pixels M compare;

C, when lenticule number N is greater than lenticule and covers display device number of pixels M, the dough sheet of 3D model is carried out to parallel projection, and hiding relation before and after the dough sheet after parallel projection is processed, then on display device, carry out pinup picture, form M width parallel projection figure;

When lenticule number is less than lenticule covering display device number of pixels, the dough sheet of 3D model is carried out to conical projection, and hiding relation before and after the dough sheet after conical projection is processed, then on display device, carry out pinup picture, form N width conical projection figure;

D, described M width parallel projection figure intert arranged or described N width conical projection figure is arranged side by side, generating 3D integrated image;

Wherein, M, N are natural number.

The generation method of described 3D integrated image, wherein, the projecting direction vector of the parallel projection figure in described step C

expression formula be:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g),$

Wherein, Δ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display device arrives lenticular distance; M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

The generation method of described 3D integrated image, wherein, the expression formula of the parallel projection figure in described step C is:

F _mn(x _s, y _s)=I _o(x _o, y _o, z _o); And, $\left\{\begin{array}{c}{x}_s=\frac{(\mathrm{m\Δs}-p/2)(g+z_o)}{g}+x_o\\ y_s=\frac{(\mathrm{n\Δs}-p/2)(g+z_o)}{g}+y_o\end{array};\right.$

Wherein, F _mn(x _s, y _s) represent that on display device, coordinate is (x _s, y _s) the colouring information of pixel; I _o(x _o, y _o, z _o): represent that on 3D model, coordinate is (x _o, y _o, z _o) the colouring information of pixel.

The generation method of described 3D integrated image, wherein, the expression formula that the arrangement that in described step D, described M width parallel projection figure interted generates 3D integrated image I is:

$I={\mathrm{\Σ}}_{m=1,n=1}^{m=\mathrm{Ms},n=\mathrm{Ms}}{F}_{\mathrm{mn}};$

Wherein, the number of pixels of the image primitive that each lens is corresponding is Ms * Ms, M=Ms * Ms, and described interting is arranged as the interspersed stack of pixel, is about to F _mnin (i, j) individual pixel insert (m, n) individual pixel in (i, j) individual image primitive.

The generation method of described 3D integrated image, wherein, the projecting direction vector of described conical projection figure

expression formula be:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g);$

Wherein, Δ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display device arrives lenticular distance; M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

The generation method of described 3D integrated image, wherein, the expression formula of described conical projection figure is:

E _ij(x _s, y _s)=I _o(x _o, y _o, z _o); And, $\left\{\begin{array}{c}{x}_s=\frac{g(x_i-x_o)}{z_o}{+x}_i\\ y_s=\frac{g(y_i-y_o)}{z_o}+y_i\end{array}\right.;$

Wherein, E _ijfor with display device corresponding to (i, j) individual lenticule on the colouring information of image primitive, i, j are respectively the lens ordinal number in x, y direction, g is the distance between display device and lenticule; I _o(x _o, y _o, z _o): represent that on 3D model, coordinate is (x _o, y _o, z _o) the colouring information of pixel.

The generation method of described 3D integrated image, wherein, in described step D is arranged side by side described N width conical projection figure, and the expression formula that generates 3D integrated image I is:

$I={\mathrm{\Σ}}_{i=1,j=1}^{i=\mathrm{Nx},j=\mathrm{Ny}}{E}_{i,j};$

Wherein, Nx represents the number of lenticule in x direction, and Ny represents the number of lenticule in y direction, N=Nx * Ny.

A generation system for the 3D integrated image of display device, wherein, comprising:

Display device parameter and 3D model file acquisition module, for obtaining display device parameter and 3D model file, described display device parameter comprises that lenticule number N and lenticule cover display device number of pixels M;

Comparison module, for comparing lenticule number N and lenticule covering display device number of pixels M;

Parallel projection figure or conical projection figure generation module, while covering display device number of pixels M for be greater than lenticule as lenticule number N, the dough sheet of 3D model is carried out to parallel projection, and hiding relation before and after the dough sheet after parallel projection is processed, then on display device, carry out pinup picture, form M width parallel projection figure; When lenticule number is less than lenticule covering display device number of pixels, the dough sheet of 3D model is carried out to conical projection, and hiding relation before and after the dough sheet after conical projection is processed, then on display device, carry out pinup picture, form N width conical projection figure;

3D integrated image generation module, for when described M width parallel projection figure is interted and arranges or described N width conical projection figure is arranged side by side, generates 3D integrated image; Wherein, M, N are natural number.

Beneficial effect: according to the generation method and system of the 3D integrated image based on display device of the present invention, lenticule number N and lenticule covering display device number of pixels M are compared, according to comparative result, take parallel projection algorithm or conical projection algorithm to generate 3D integrated image, calculate relatively less perspective view, improved 3D integrated graphics formation efficiency, can fast 3D model of place be converted into integrated image, for 3D integration imaging, show, provide that full parallax, color are true to nature, the true 3-D view of continuous viewpoint.

Accompanying drawing explanation

Fig. 1 is the process flow diagram of the generation method of the 3D integrated image based on display device of the present invention.

Fig. 2 is the schematic diagram of the parallel projection algorithm in embodiments of the invention.

Fig. 3 is the schematic diagram of the conical projection algorithm in embodiments of the invention.

Fig. 4 is the structured flowchart of the generation system of the 3D integrated image based on display device of the present invention.

Embodiment

The invention provides a kind of generation method and system of the 3D integrated image based on display device, for making object of the present invention, technical scheme and effect clearer, clear and definite, below the present invention is described in more detail.Should be appreciated that specific embodiment described herein, only in order to explain the present invention, is not intended to limit the present invention.

Refer to Fig. 1, it is the process flow diagram of the generation method of the 3D integrated image based on display device of the present invention.As shown in the figure, said method comprising the steps of: (wherein, M, N are natural number)

S1, obtain display device parameter and 3D model file, described display device parameter comprises that lenticule number N and lenticule cover display device number of pixels M;

S2, lenticule number N and lenticule are covered to display device number of pixels M compare;

S3, when lenticule number N is greater than lenticule and covers display device number of pixels M, the dough sheet of 3D model is carried out to parallel projection, and hiding relation before and after the dough sheet after parallel projection is processed, then on display device, carry out pinup picture, form M width parallel projection figure; When lenticule number is less than lenticule covering display device number of pixels, the dough sheet of 3D model is carried out to conical projection, and hiding relation before and after the dough sheet after conical projection is processed, then on display device, carry out pinup picture, form N width conical projection figure;

S4, described M width parallel projection figure intert arranged or described N width conical projection figure is arranged side by side, generating 3D integrated image.

Respectively above-mentioned steps is described in detail below:

Described step S1 is for obtaining display device parameter and 3D model file, and wherein, display device parameter comprises that lenticule number N and lenticule cover display device number of pixels M; In the present embodiment, the form of described 3D model file is obj form, and it comprises triangular apex coordinate, triangulation method line vector, pinup picture coordinate and the pinup picture file etc. that form 3D model surface.Wherein, the 3D model file of obj form can be generated and be obtained by 3D design softwares such as 3D max.It should be noted that the source document that this 3D model file is integrated image, is also the target image that final beholder sees by integration imaging display (being display device).

Described step S2 is for comparing lenticule number N and lenticule covering display device number of pixels M, and this step is the key of invention, from actual observation effect, and from the 3D model of wishing that beholder sees, the anti-integrated image that is pushed into.But not simulate traditional optical shooter, carry out calculating integrated image.Can avoid degree of depth Inversion Problem like this.In process due to calculating integrated image, need to carry out the calculating of a large amount of perspective views, every calculating one width perspective view, image is processed all will to carry out projection, pinup picture to 3D model, block etc., need to expend a large amount of time, so the spent time of calculating integrated image is proportional to the quantity of perspective view.In order to reduce computing time, before calculating, judge: lenticule number N and lenticule cover differing of display device number of pixels M, these two data differ larger, the time spending when the parallel projection method adopting respectively and conical projection method also differs very large, so by these two data, the projecting method that intelligent selection is different, the perspective view of calculating lesser amt, can save the integrated image rise time greatly.

In step S3, when lenticule number N is greater than lenticule covering display device number of pixels M, the dough sheet of 3D model is carried out to parallel projection, and hiding relation before and after the dough sheet after parallel projection is processed, then on display device, carry out pinup picture, form M width parallel projection figure; And when lens number is less than lenticule covering display device number of pixels, the dough sheet of 3D model is carried out to conical projection, and hiding relation before and after the dough sheet after conical projection is processed, then on display device, carry out pinup picture, form N width conical projection figure.In brief, when lenticule covers display device number of pixels M hour, select parallel projection algorithm; When lenticule number N hour, select conical projection algorithm.Because while selecting to calculate perspective view negligible amounts, required time is also few.After can introduce in detail two kinds of projection algorithms.

Finally, step S4, for described M width parallel projection figure is interted and arranges or described N width conical projection figure is arranged side by side, generates 3D integrated image.

Introduce in detail respectively parallel projection algorithm and conical projection algorithm below:

Please continue to refer to Fig. 2, it (represents lenticule with lens arra in figure for the schematic diagram of parallel projection algorithm, display screen represents display device): when described parallel projection algorithm covers display device number of pixels M for be greater than lenticule as lenticule number N, the dough sheet of 3D model is carried out to parallel projection, and hiding relation before and after the dough sheet after parallel projection is processed, then on display device, carry out pinup picture, form M width parallel projection figure.Wherein, the projecting direction vector of described parallel projection figure

expression formula be:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g);---\left(1\right)$

In formula (1), Δ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display device arrives lenticular distance; M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

So, the expression formula of described parallel projection figure is:

F _mn(x _s, y _s)=I _o(x _o, y _o, z _o); And, $\left\{\begin{array}{c}{x}_s=\frac{g(x_i-x_o)}{z_o}{+x}_i\\ y_s=\frac{g(y_i-y_o)}{z_o}+y_i\end{array}\right.;---\left(2\right)$

In formula (2), F _mn(x _s, y _s) represent that on display device, coordinate is (x _s, y _s) the colouring information of pixel; I _o(x _o, y _o, z _o): represent that on 3D model, coordinate is (x _o, y _o, z _o) the colouring information of pixel, described colouring information comprises gray-scale value, brightness value of image etc.

Finally, by the interspersed expression formula of arranging generation 3D integrated image I of described M width parallel projection figure, be:

$I={\mathrm{\Σ}}_{m=1,n=1}^{m=\mathrm{Ms},n=\mathrm{Ms}}{F}_{\mathrm{mn}};---\left(3\right)$

In formula (3), the number of pixels of the image primitive that each lens is corresponding be Ms * Ms (be that aforesaid lenticule covers display device number of pixels M, M=Ms * Ms, lower with), described interting is arranged as pixel and interts stack, is about to F _mnin (i, j) individual pixel insert (m, n) individual pixel in (i, j) individual image primitive.

Generally speaking, the perspective view quantity of the required calculating of parallel projection algorithm is Ms * Ms, and due to now, the value that lenticule covers display device number of pixels M is less, so select the method can calculate relatively less perspective view, spends the less time.

Refer to Fig. 3, it is for the schematic diagram of conical projection algorithm.When lenticule number N is less than lenticule covering display device number of pixels M, the dough sheet of 3D model is carried out to conical projection, and hiding relation before and after the dough sheet after conical projection is processed, then on display device, carry out pinup picture, form N width conical projection figure.

The projecting direction vector of described conical projection figure

expression formula be:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g);$

Wherein, Δ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display device arrives lenticular distance; M, n represent that each lenticule covers the (m in display device pixel, n) individual pixel, but in parallel projection, (m, n) also represent (m, n) width parallel projection figure, each pixel projection direction of every width parallel projection figure is identical, and in conical projection, (m, n) represent (m, n) individual pixel in conical projection figure, each pixel has different projecting directions.

In the present embodiment, the expression formula of described conical projection figure is:

E _ij(x _s, y _s)=I _o(x _o, y _o, z _o); And, $\left\{\begin{array}{c}{x}_s=\frac{g(x_i-x_o)}{z_o}{+x}_i\\ y_s=\frac{g(y_i-y_o)}{z_o}+y_i\end{array}\right.;---\left(4\right)$

In formula (4), E _ijfor with display device corresponding to (i, j) individual lenticule on the colouring information of image primitive, i, j are respectively the lens ordinal number in x, y direction, g is the distance between display device and lenticule; I _o(x _o, y _o, z _o): represent that on 3D model, coordinate is (x _o, y _o, z _o) the colouring information of pixel.In calculating, adopt the ideal model of pinhole imaging system, aperture is regarded at each lenticule center as, and object is by aperture imaging on display device (also claiming display screen).

Further, the expression formula of the 3D integrated image I that conical projection algorithm generates is:

$I={\mathrm{\Σ}}_{i=1,j=1}^{i=\mathrm{Nx},j=\mathrm{Ny}}{E}_{i,j};---\left(5\right)$

In formula (5), Nx represents the number of lenticule in x direction, and Ny represents the number of lenticule in y direction, N=Nx * Ny.In short, when 3D model more complicated, often adopt conical projection algorithm.It has certain advantage in large area tiled display.

Based on said method, the present invention also provides a kind of generation system of the 3D integrated image based on display device, as shown in Figure 4, comprising:

Display device parameter and 3D model file acquisition module 100, for obtaining display device parameter and 3D model file, described display device parameter comprises that lenticule number N and lenticule cover display device number of pixels M;

Comparison module 200, for comparing lenticule number N and lenticule covering display device number of pixels M;

Parallel projection figure or conical projection figure generation module 300, while covering display device number of pixels M for be greater than lenticule as lenticule number N, the dough sheet of 3D model is carried out to parallel projection, and hiding relation before and after the dough sheet after parallel projection is processed, then on display device, carry out pinup picture, form M width parallel projection figure; When lenticule number is less than lenticule covering display device number of pixels, the dough sheet of 3D model is carried out to conical projection, and hiding relation before and after the dough sheet after conical projection is processed, then on display device, carry out pinup picture, form N width conical projection figure;

3D integrated image generation module 400, for when described M width parallel projection figure is interted and arranges or described N width conical projection figure is arranged side by side, generates 3D integrated image; Wherein, M, N are natural number.

In sum, the generation method and system of the 3D integrated image based on display device of the present invention, first obtain display device parameter and 3D model file, and described display device parameter comprises that lenticule number N and lenticule cover display device number of pixels M; Then, lenticule number N and lenticule covering display device number of pixels M are compared, according to comparative result, take parallel projection algorithm or conical projection algorithm to generate 3D integrated image.According to the generation method of the 3D integrated image based on display device of the present invention, owing to calculating the negligible amounts of perspective view, can fast 3D model of place be converted into integrated image, for 3D integration imaging, show, provide that full parallax, color are true to nature, the true 3-D view of continuous viewpoint.

Should be understood that, application of the present invention is not limited to above-mentioned giving an example, and for those of ordinary skills, can be improved according to the above description or convert, and all these improvement and conversion all should belong to the protection domain of claims of the present invention.

Claims (8)

1. a generation method for the 3D integrated image based on display device, is characterized in that, comprises the following steps:

A, obtain display device parameter and 3D model file, described display device parameter comprises that lenticule number N and lenticule cover display device number of pixels M;

B, lenticule number N and lenticule are covered to display device number of pixels M compare;

C, when lenticule number N is greater than lenticule and covers display device number of pixels M, the dough sheet of 3D model is carried out to parallel projection, and hiding relation before and after the dough sheet after parallel projection is processed, then on display device, carry out pinup picture, form M width parallel projection figure;

When lenticule number is less than lenticule covering display device number of pixels, the dough sheet of 3D model is carried out to conical projection, and hiding relation before and after the dough sheet after conical projection is processed, then on display device, carry out pinup picture, form N width conical projection figure;

D, described M width parallel projection figure intert arranged or described N width conical projection figure is arranged side by side, generating 3D integrated image;

Wherein, M, N are natural number.

2. the generation method of 3D integrated image according to claim 1, is characterized in that, the projecting direction vector of the parallel projection figure in described step C

expression formula be:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g);$

Wherein, Δ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display device arrives lenticular distance; M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

3. the generation method of 3D integrated image according to claim 2, is characterized in that, the expression formula of the parallel projection figure in described step C is:

F _mn(x _s, y _s)=I _o(x _o, y _o, z _o); And, $\left\{\begin{array}{c}{x}_s=\frac{(\mathrm{m\Δs}-p/2)(g+z_o)}{g}+x_o\\ y_s=\frac{(\mathrm{n\Δs}-p/2)(g+z_o)}{g}+y_o\end{array};\right.$

Wherein, F _mn(x _s, y _s) represent that on display device, coordinate is (x _s, y _s) the colouring information of pixel; I _o(x _o, y _o, z _o): represent that on 3D model, coordinate is (x _o, y _o, z _o) the colouring information of pixel.

4. the generation method of 3D integrated image according to claim 3, is characterized in that, the expression formula that the arrangement that in described step D, described M width parallel projection figure interted generates 3D integrated image I is:

$I={\mathrm{\Σ}}_{m=1,n=1}^{m=\mathrm{Ms},n=\mathrm{Ms}}{F}_{\mathrm{mn}};$

Wherein, the number of pixels of the image primitive that each lens is corresponding is Ms * Ms, M=Ms * Ms, and described interting is arranged as the interspersed stack of pixel, is about to F _mnin (i, j) individual pixel insert (m, n) individual pixel in (i, j) individual image primitive.

5. the generation method of 3D integrated image according to claim 1, is characterized in that, the projecting direction vector of described conical projection figure

expression formula be:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g);$

Wherein, Δ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display device arrives lenticular distance; M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

6. the generation method of 3D integrated image according to claim 5, is characterized in that, the expression formula of described conical projection figure is:

E _ij(x _s, y _s)=I _o(x _o, y _o, z _o); And, $\left\{\begin{array}{c}{x}_s=\frac{g(x_i-x_o)}{z_o}{+x}_i\\ y_s=\frac{g(y_i-y_o)}{z_o}+y_i\end{array}\right.;$

Wherein, E _ijfor with display device corresponding to (i, j) individual lenticule on the colouring information of image primitive, i, j are respectively the lens ordinal number in x, y direction, g is the distance between display device and lenticule; I _o(x _o, y _o, z _o): represent that on 3D model, coordinate is (x _o, y _o, z _o) the colouring information of pixel.

7. the generation method of 3D integrated image according to claim 6, is characterized in that, in described step D, described N width conical projection figure is arranged side by side, and the expression formula that generates 3D integrated image I is:

$I={\mathrm{\Σ}}_{i=1,j=1}^{i=\mathrm{Nx},j=\mathrm{Ny}}{E}_{i,j};$

Wherein, Nx represents the number of lenticule in x direction, and Ny represents the number of lenticule in y direction, N=Nx * Ny.

8. a generation system for the 3D integrated image based on display device, is characterized in that, comprising:

Display device parameter and 3D model file acquisition module, for obtaining display device parameter and 3D model file, described display device parameter comprises that lenticule number N and lenticule cover display device number of pixels M;

Comparison module, for comparing lenticule number N and lenticule covering display device number of pixels M;

Parallel projection figure or conical projection figure generation module, while covering display device number of pixels M for be greater than lenticule as lenticule number N, the dough sheet of 3D model is carried out to parallel projection, and hiding relation before and after the dough sheet after parallel projection is processed, then on display device, carry out pinup picture, form M width parallel projection figure; When lenticule number is less than lenticule covering display device number of pixels, the dough sheet of 3D model is carried out to conical projection, and hiding relation before and after the dough sheet after conical projection is processed, then on display device, carry out pinup picture, form N width conical projection figure;

3D integrated image generation module, for when described M width parallel projection figure is interted and arranges or described N width conical projection figure is arranged side by side, generates 3D integrated image; Wherein, M, N are natural number.

Images