CN103513433B - A kind of generation method and system of 3D integrated image based on display device - Google Patents

Abstract

The invention discloses the generation method and system of a kind of 3D integrated image based on display device, first obtain display device parameter and 3D model file, described display device parameter includes that lenticule number and lenticule cover display device number of pixels；Then, lenticule number and lenticule are covered display device number of pixels and compares, according to comparative result, take parallel projection algorithm or conical projection algorithm to generate 3D integrated image.The generation method of the 3D integrated image based on display device according to the present invention, quickly can be converted into integrated image by 3D model of place, show for 3D integration imaging, it is provided that full parallax, color are true to nature, the true 3-D view of continuous viewpoint.

Description

A kind of generation method and system of 3D integrated image based on display device

Technical field

The present invention relates to technical field of image processing, particularly relate to the generation of a kind of 3D integrated image based on display device Method and system.

Background technology

Dimension display technologies based on integration imaging is a kind of bore hole true three-dimension display technlolgies.It is without wearing spectacles, can There is provided that full parallax, color be true to nature, the true 3-D view of continuous viewpoint, and parallax in multi-view auto stereo display can be avoided The figure visual fatigue phenomenon that caused of sudden change, is the effective scheme that shows of a kind of bore hole 3D.Integration imaging technology the earliest by Lippmann [1] proposes, and is a kind of Display Technique utilizing microlens array to record and to reproduce 3D scene.

During record, by microlens array, the information of three-dimensional scenic different directions is carried out record on focal plane.Also may be used Camera array is used to obtain the information of three-dimensional scenic different directions.Each lenticule or the image of cameras record one width two dimension Unit.This optical system being made up of lens arra and photo-sensitive cell is to the method obtaining 3D integrated image, although convenient and swift, But the image obtained inverts with reproducing the Existential Space degree of depth.In order to solve this problem, Ives et al. proposes two step notes Record method.And integrated image is significantly reduced through repeatedly record, image resolution ratio and quality.

Along with the development of computer graphic image treatment technology, people begin with computer Simulation calculation to replace optics Method obtains integrated image.This method is possible not only to solve degree of depth reversion and resolution problem, and can obtain any 3D mould The integrated image of type optional position any direction.During calculating complicated 3D scene, there is substantial amounts of pixel correspondence and close System, blocking and the image procossing such as pinup picture, this will take a substantial amount of time.

Therefore, prior art has yet to be improved and developed.

Summary of the invention

In view of above-mentioned the deficiencies in the prior art, it is an object of the invention to provide a kind of integrated figure of 3D based on display device The generation method and system of picture, it is intended to when the 3D model of place of solution prior art is converted into integrated image, elapsed time is long Problem.

Technical scheme is as follows:

A kind of generation method of 3D integrated image based on display device, wherein, comprises the following steps:

A, obtaining display device parameter and 3D model file, described display device parameter includes lenticule number N and micro- Mirror covers display device number of pixels M；

B, lenticule number N and lenticule are covered display device number of pixels M compare；

C, when lenticule number N more than lenticule cover display device number of pixels M time, the dough sheet of 3D model is put down Row projection, and to hiding relation before and after the dough sheet process after parallel projection, carry out pinup picture the most on the display device, form M width Parallel projection figure；

When lenticule number covers display device number of pixels less than lenticule, the dough sheet of 3D model is carried out taper throwing Shadow, and to hiding relation before and after the dough sheet process after conical projection, carry out pinup picture the most on the display device, form N width taper Projection；

D, by described M width parallel projection figure intert arrangement or described N width conical projection figure is arranged side by side, generate 3D integrated Image；

Wherein, M, N are natural number.

The generation method of described 3D integrated image, wherein, the projecting direction vector of the parallel projection figure in described step CExpression formula be:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g),$

Wherein, Δ s represents the size of each pixel of display device, and p is lenticular diameter, and it is micro-that g is that display device arrives The distance of lens；M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

The generation method of described 3D integrated image, wherein, the expression formula of the parallel projection figure in described step C is:

F_mn(x_s, y_s)=I_o(x_o, y_o, z_o)；And, $\left\{\begin{array}{c}{x}_s=\frac{(\mathrm{m\Δs}-p/2)(g+z_o)}{g}+x_o\\ y_s=\frac{(\mathrm{n\Δs}-p/2)(g+z_o)}{g}+y_o\end{array};\right.$

Wherein, F_mn(x_s, y_s) represent that on display device, coordinate is (x_s, y_s) the colouring information of pixel；I_o(x_o,y_o, z_o): represent that on 3D model, coordinate is (x_o, y_o, z_o) the colouring information of pixel.

The generation method of described 3D integrated image, wherein, interts described M width parallel projection figure in described step D and arranges The expression formula of column-generation 3D integrated image I is:

$I={\mathrm{\Σ}}_{m=1,n=1}^{m=\mathrm{Ms},n=\mathrm{Ms}}{F}_{\mathrm{mn}};$

Wherein, the number of pixels of the image primitive that each lens are corresponding is Ms × Ms, M=Ms × Ms, and described interting is arranged as Pixel interts superposition, will F_mnIn (i, j) individual pixel inserts (i, j) (m, n) individual pixel in individual image primitive.

The generation method of described 3D integrated image, wherein, the projecting direction vector of described conical projection figureExpression Formula is:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g);$

Wherein, Δ s represents the size of each pixel of display device, and p is lenticular diameter, and it is micro-that g is that display device arrives The distance of lens；M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

The generation method of described 3D integrated image, wherein, the expression formula of described conical projection figure is:

E_ij(x_s, y_s)=I_o(x_o, y_o, z_o)；And, $\left\{\begin{array}{c}{x}_s=\frac{g(x_i-x_o)}{z_o}{+x}_i\\ y_s=\frac{g(y_i-y_o)}{z_o}+y_i\end{array}\right.;$

Wherein, E_ijFor with the (i, j) colouring information of the image primitive on the display device that individual lenticule is corresponding, i, j are respectively For the lens ordinal number on x, y direction, g is the distance between display device and lenticule；I_o(x_o, y_o, z_o): represent 3D model Upper coordinate is (x_o, y_o, z_o) the colouring information of pixel.

The generation method of described 3D integrated image, wherein, arranges described N width conical projection figure in described step D side by side Row, the expression formula generating 3D integrated image I is:

$I={\mathrm{\Σ}}_{i=1,j=1}^{i=\mathrm{Nx},j=\mathrm{Ny}}{E}_{i,j};$

Wherein, Nx represents lenticule number in the x direction, and Ny represents lenticule number in y-direction, N=Nx × Ny。

A kind of generation system of 3D integrated image based on display device, wherein, including:

Display device parameter and 3D model file acquisition module, be used for obtaining display device parameter and 3D model file, institute State display device parameter and include that lenticule number N and lenticule cover display device number of pixels M；

Comparison module, compares for lenticule number N and lenticule are covered display device number of pixels M；

Parallel projection figure or conical projection figure generation module, for setting when lenticule number N covers display more than lenticule During standby number of pixels M, the dough sheet of 3D model is carried out parallel projection, and blocks pass to before and after the dough sheet process after parallel projection System, carries out pinup picture the most on the display device, forms M width parallel projection figure；When lenticule number covers display less than lenticule During device pixel number, the dough sheet of 3D model is carried out conical projection, and blocks pass to before and after the dough sheet process after conical projection System, carries out pinup picture the most on the display device, forms N width conical projection figure；

3D integrated image generation module, for when by interspersed for described M width parallel projection figure arrangement or described N width taper being thrown Shadow figure is arranged side by side, and generates 3D integrated image；Wherein, M, N are natural number.

Beneficial effect: according to the generation method and system of the 3D integrated image based on display device of the present invention, by micro- Mirror number N and lenticule cover display device number of pixels M and compare, according to comparative result, take parallel projection algorithm or Person's conical projection algorithm generates 3D integrated image, calculates relatively small number of projection, improves 3D integrated graphics formation efficiency, Quickly 3D model of place can be converted into integrated image, show for 3D integration imaging, it is provided that full parallax, color are true to nature, even The true 3-D view of continuous viewpoint.

Accompanying drawing explanation

Fig. 1 is the flow chart of the generation method of the 3D integrated image based on display device of the present invention.

Fig. 2 is the schematic diagram of the parallel projection algorithm in embodiments of the invention.

Fig. 3 is the schematic diagram of the conical projection algorithm in embodiments of the invention.

Fig. 4 is the structured flowchart of the generation system of the 3D integrated image based on display device of the present invention.

Detailed description of the invention

The present invention provides the generation method and system of a kind of 3D integrated image based on display device, for making the mesh of the present invention , technical scheme and effect clearer, clear and definite, the present invention is described in more detail below.Should be appreciated that described herein Specific embodiment only in order to explain the present invention, be not intended to limit the present invention.

Referring to Fig. 1, it is the flow chart of generation method of 3D integrated image based on display device of the present invention.Such as figure Shown in, said method comprising the steps of: (wherein, M, N are natural number)

S1, obtaining display device parameter and 3D model file, described display device parameter includes lenticule number N and micro- Mirror covers display device number of pixels M；

S2, lenticule number N and lenticule are covered display device number of pixels M compare；

S3, when lenticule number N more than lenticule cover display device number of pixels M time, the dough sheet of 3D model is carried out Parallel projection, and to hiding relation before and after the dough sheet process after parallel projection, carry out pinup picture the most on the display device, form M Width parallel projection figure；When lenticule number covers display device number of pixels less than lenticule, the dough sheet of 3D model is carried out Conical projection, and to hiding relation before and after the dough sheet process after conical projection, carry out pinup picture the most on the display device, form N Width conical projection figure；

S4, by described M width parallel projection figure intert arrangement or described N width conical projection figure is arranged side by side, generate 3D collection Become image.

Separately below above-mentioned steps is described in detail:

Described step S1 is for obtaining display device parameter and 3D model file, and wherein, display device parameter includes lenticule Number N and lenticule cover display device number of pixels M；In the present embodiment, the form of described 3D model file is obj lattice Formula, it comprises the composition triangular apex coordinate of 3D model surface, triangulation method line vector, mapping coordinates and pinup picture file Deng.Wherein, the 3D model file of obj form can be generated by 3D design softwares such as 3D max and obtain.It should be noted that this 3D mould Type file is the original document of integrated image, and the most final beholder is seen by integration imaging display (i.e. display device) Target image.

Described step S2 compares for lenticule number N and lenticule are covered display device number of pixels M, this step The rapid key for invention, from actual observation effect, from the 3D model wishing that beholder sees, counter is pushed into integrated image.And The optical shooter that non-analog is traditional carrys out calculating integrated image.So can avoid degree of depth Inversion Problem.Owing to calculating integrated figure During Xiang, need to carry out the calculating of a large amount of projection, often calculate a width projection, 3D model will be projected, paste The image procossing such as scheming, block, need to take a substantial amount of time, therefore the time spent by calculating integrated image is proportional to projection Quantity.In order to reduce the calculating time, judge before calculating: lenticule number N covers display device pixel with lenticule The difference of number M, the two data difference bigger, spent when the parallel projection method being respectively adopted and conical projection method time Between also differ very big, so by the two data, the projecting method that intelligent selection is different, calculating the projection of lesser amt Figure, can be greatly saved integrated image and generate the time.

In step S3, when lenticule number N covers display device number of pixels M more than lenticule, the face to 3D model Sheet carries out parallel projection, and to hiding relation before and after the dough sheet process after parallel projection, carries out pinup picture the most on the display device, Form M width parallel projection figure；And when lens number covers display device number of pixels less than lenticule, the dough sheet to 3D model Carry out conical projection, and to hiding relation before and after the dough sheet process after conical projection, carry out pinup picture, shape the most on the display device Become N width conical projection figure.In brief, when lenticule covering display device number of pixels M is less, parallel projection is selected to calculate Method；When lenticule number N is less, select conical projection algorithm.During because selecting to calculate projection negligible amounts, required time Also few.Two kind projection algorithms can be discussed in detail below.

Finally, step S4 arranges for being interted by described M width parallel projection figure or is arranged side by side by described N width conical projection figure Row, generate 3D integrated image.

Parallel projection algorithm and conical projection algorithm be discussed in detail separately below:

Please continue to refer to Fig. 2, it is that the schematic diagram of parallel projection algorithm (represents lenticule with lens arra in figure, display Screen represents display device): described parallel projection algorithm is when lenticule number N covers display device number of pixels more than lenticule During M, the dough sheet of 3D model is carried out parallel projection, and to hiding relation before and after the dough sheet process after parallel projection, then aobvious Show and on equipment, carry out pinup picture, form M width parallel projection figure.Wherein, the projecting direction vector of described parallel projection figureExpression Formula is:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g);---\left(1\right)$

In formula (1), Δ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display sets Standby to lenticular distance；M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

So, the expression formula of described parallel projection figure is:

F_mn(x_s, y_s)=I_o(x_o, y_o, z_o)；And, $\left\{\begin{array}{c}{x}_s=\frac{g(x_i-x_o)}{z_o}{+x}_i\\ y_s=\frac{g(y_i-y_o)}{z_o}+y_i\end{array}\right.;---\left(2\right)$

In formula (2), F_mn(x_s, y_s) represent that on display device, coordinate is (x_s, y_s) the colouring information of pixel；I_o(x_o, y_o, z_o): represent that on 3D model, coordinate is (x_o, y_o, z_o) the colouring information of pixel, described colouring information includes the ash of image Angle value, brightness value etc..

Finally, the arrangement that interted by described M width parallel projection figure generates the expression formula of 3D integrated image I:

$I={\mathrm{\Σ}}_{m=1,n=1}^{m=\mathrm{Ms},n=\mathrm{Ms}}{F}_{\mathrm{mn}};---\left(3\right)$

In formula (3), the number of pixels of the image primitive that each lens are corresponding is that (the most aforesaid lenticule covers aobvious Ms × Ms Show device pixel number M, M=Ms × Ms, lower with), described interting is arranged as pixel and interts superposition, will F_mnIn (i, j) Individual pixel inserts (i, j) (m, n) individual pixel in individual image primitive.

Generally speaking, the required projection quantity calculated of parallel projection algorithm is Ms × Ms, and due to now, lenticule covers The value of lid display device number of pixels M is less, so selecting the method can calculate relatively small number of projection, when spending less Between.

Referring to Fig. 3, it is the schematic diagram of conical projection algorithm.Set when lenticule number N covers display less than lenticule During standby number of pixels M, the dough sheet of 3D model is carried out conical projection, and blocks pass to before and after the dough sheet process after conical projection System, carries out pinup picture the most on the display device, forms N width conical projection figure.

The projecting direction vector of described conical projection figureExpression formula be:

${\stackrel{\‾}{k}}_{\mathrm{mn}}=(\mathrm{m\Δs}-\frac{p}{2},\mathrm{n\Δs}-\frac{p}{2},-g);$

Wherein, Δ s represents the size of each pixel of display device, and p is lenticular diameter, and it is micro-that g is that display device arrives The distance of lens；M, n represent each lenticule cover in display device pixel the (m, n) individual pixel, but in parallel projection, (m, n) also represent (m, n) width parallel projection figure, each pixel projection direction of every width parallel projection figure is identical, and in taper In projection, (m, (m, n) individual pixel, each pixel has different projecting directions n) then to represent in conical projection figure.

In the present embodiment, the expression formula of described conical projection figure is:

E_ij(x_s, y_s)=I_o(x_o, y_o, z_o)；And, $\left\{\begin{array}{c}{x}_s=\frac{g(x_i-x_o)}{z_o}{+x}_i\\ y_s=\frac{g(y_i-y_o)}{z_o}+y_i\end{array}\right.;---\left(4\right)$

In formula (4), E_ijFor with (i, j) colouring information of the image primitive on the display device that individual lenticule is corresponding, i, j Being respectively the lens ordinal number on x, y direction, g is the distance between display device and lenticule；I_o(x_o, y_o, z_o): represent 3D On model, coordinate is (x_o, y_o, z_o) the colouring information of pixel.In calculating, use the ideal model of pinhole imaging system, the most each Aperture is regarded at lenticule center as, and object passes through aperture in the upper imaging of display device (also referred to as display screen).

Further, the expression formula of the 3D integrated image I that conical projection algorithm generates is:

$I={\mathrm{\Σ}}_{i=1,j=1}^{i=\mathrm{Nx},j=\mathrm{Ny}}{E}_{i,j};---\left(5\right)$

In formula (5), Nx represents lenticule number in the x direction, and Ny represents lenticule number in y-direction, N= Nx×Ny.In short, when 3D model is more complicated, through frequently with conical projection algorithm.It is in large area tiled display There is certain advantage.

Based on said method, the present invention also provides for the generation system of a kind of 3D integrated image based on display device, such as Fig. 4 Shown in, including:

Display device parameter and 3D model file acquisition module 100, be used for obtaining display device parameter and 3D model file, Described display device parameter includes that lenticule number N and lenticule cover display device number of pixels M；

Comparison module 200, compares for lenticule number N and lenticule are covered display device number of pixels M；

Parallel projection figure or conical projection figure generation module 300, for covering display when lenticule number N more than lenticule During device pixel number M, the dough sheet of 3D model is carried out parallel projection, and blocks pass to before and after the dough sheet process after parallel projection System, carries out pinup picture the most on the display device, forms M width parallel projection figure；When lenticule number covers display less than lenticule During device pixel number, the dough sheet of 3D model is carried out conical projection, and blocks pass to before and after the dough sheet process after conical projection System, carries out pinup picture the most on the display device, forms N width conical projection figure；

3D integrated image generation module 400, for when by interspersed for described M width parallel projection figure arrangement or being bored by described N width Shape projection is arranged side by side, and generates 3D integrated image；Wherein, M, N are natural number.

In sum, the generation method and system of the 3D integrated image based on display device of the present invention, first obtain aobvious Show that device parameter and 3D model file, described display device parameter include that lenticule number N and lenticule cover display device picture Element number M；Then, lenticule number N and lenticule are covered display device number of pixels M and compares, according to comparative result, Take parallel projection algorithm or conical projection algorithm to generate 3D integrated image.3D based on display device according to the present invention The generation method of integrated image, owing to calculating the negligible amounts of projection, quickly can be converted into integrated figure by 3D model of place Picture, shows for 3D integration imaging, it is provided that full parallax, color are true to nature, the true 3-D view of continuous viewpoint.

It should be appreciated that the application of the present invention is not limited to above-mentioned citing, for those of ordinary skills, can To be improved according to the above description or to convert, all these modifications and variations all should belong to the guarantor of claims of the present invention Protect scope.

Claims (7)

1. the generation method of a 3D integrated image based on display device, it is characterised in that comprise the following steps:

A, acquisition display device parameter and 3D model file, described display device parameter includes that lenticule number N and lenticule cover Lid display device number of pixels M；

B, lenticule number N and lenticule are covered display device number of pixels M compare；

C, when lenticule number N more than lenticule cover display device number of pixels M time, the dough sheet of 3D model is carried out parallel throwing Shadow, and to after parallel projection dough sheet process before and after hiding relation, carry out pinup picture the most on the display device, formed M parallel Projection；

When lenticule number N covers display device number of pixels M less than lenticule, the dough sheet of 3D model is carried out taper throwing Shadow, and to hiding relation before and after the dough sheet process after conical projection, carry out pinup picture the most on the display device, form N width taper Projection；

D, by described M width parallel projection figure intert arrangement or described N width conical projection figure is arranged side by side, generate the integrated figure of 3D Picture；

Wherein, M, N are natural number.

The generation method of 3D integrated image the most according to claim 1, it is characterised in that the parallel projection figure in step C Projecting direction vectorExpression formula be:

Wherein, △ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display device is to lenticule Distance；M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

The generation method of 3D integrated image the most according to claim 2, it is characterised in that the parallel projection figure in step C Expression formula be:

F_mn(x_s, y_s)=I_o(x_o, y_o, z_o)；And,

Wherein, F_mn(x_s, y_s) represent that on display device, coordinate is (x_s, y_s) the colouring information of pixel；I₀(x₀,y₀,z₀) represent On 3D model, coordinate is (x_o, y_o, z_o) the colouring information of pixel.

The generation method of 3D integrated image the most according to claim 1, it is characterised in that the projection of described conical projection figure Direction vectorExpression formula be:

Wherein, △ s represents the size of each pixel of display device, and p is lenticular diameter, and g is that display device is to lenticule Distance；M, n represent that each lenticule covers (m, n) the individual pixel in display device pixel.

The generation method of 3D integrated image the most according to claim 4, it is characterised in that the expression of described conical projection figure Formula is:

E_ij(x_s, y_s)=I_o(x_o, y_o, z_o)；And,

Wherein, E_ij(x_s,y_s) it is with (i, j) colouring information of the image primitive on the display device that individual lenticule is corresponding, i, j divide Wei lenticule ordinal number on x, y direction；I₀(x₀,y₀,z₀) represent that on 3D model, coordinate is (x_o, y_o, z_o) pixel Colouring information；x_lIt is (i, j) individual lenticular x-axis coordinate, y_lIt is (i, j) individual lenticular y-axis coordinate；x_sFor with (i, J) the x-axis coordinate of the image primitive on the display device that individual lenticule is corresponding, y_sFor with (i, j) display that individual lenticule is corresponding sets The y-axis coordinate of standby upper image primitive.

The generation method of 3D integrated image the most according to claim 5, it is characterised in that by described N width taper in step D Projection is arranged side by side, and generates 3D integrated image, and described 3D integrated image is designated as the expression formula of I, I and is:

$I={\Σ}_{i=1,j=1}^{i=Nx,j=Ny}{E}_{ij}(X_s,y_s);$

Wherein, Nx represents lenticule number in the x direction, and Ny represents lenticule number in y-direction, N=Nx × Ny.

7. the generation system of a 3D integrated image based on display device, it is characterised in that including:

Display device parameter and 3D model file acquisition module, be used for obtaining display device parameter and 3D model file, described aobvious Show that device parameter includes that lenticule number N and lenticule cover display device number of pixels M；

Comparison module, compares for lenticule number N and lenticule are covered display device number of pixels M；

Parallel projection figure or conical projection figure generation module, for covering display device picture when lenticule number N more than lenticule During element number M, the dough sheet of 3D model is carried out parallel projection, and to hiding relation before and after the dough sheet process after parallel projection, so After carry out pinup picture on the display device, form M width parallel projection figure；When lenticule number N covers display device less than lenticule During number of pixels M, the dough sheet of 3D model is carried out conical projection, and to hiding relation before and after the dough sheet process after conical projection, Carry out pinup picture the most on the display device, form N width conical projection figure；

3D integrated image generation module, for by described M width parallel projection figure intert arrangement or by described N width conical projection figure also Row's arrangement, generates 3D integrated image；Wherein, M, N are natural number.