CN106991715A - Grating prism Three-dimensional Display rendering intent based on optical field acquisition - Google Patents
Grating prism Three-dimensional Display rendering intent based on optical field acquisition Download PDFInfo
- Publication number
- CN106991715A CN106991715A CN201710329750.7A CN201710329750A CN106991715A CN 106991715 A CN106991715 A CN 106991715A CN 201710329750 A CN201710329750 A CN 201710329750A CN 106991715 A CN106991715 A CN 106991715A
- Authority
- CN
- China
- Prior art keywords
- viewpoint
- index map
- light field
- image
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000009877 rendering Methods 0.000 title claims abstract description 20
- 230000003287 optical effect Effects 0.000 title claims abstract description 16
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 44
- 238000003786 synthesis reaction Methods 0.000 claims abstract description 44
- 238000000034 method Methods 0.000 claims abstract description 41
- 238000013507 mapping Methods 0.000 claims abstract description 24
- 230000000007 visual effect Effects 0.000 claims abstract description 18
- 239000011159 matrix material Substances 0.000 claims description 17
- 238000005457 optimization Methods 0.000 claims description 17
- 238000000605 extraction Methods 0.000 claims description 10
- 238000001914 filtration Methods 0.000 claims description 6
- 238000010586 diagram Methods 0.000 claims description 5
- 239000002131 composite material Substances 0.000 claims description 3
- 238000012545 processing Methods 0.000 claims description 3
- 238000011160 research Methods 0.000 abstract description 6
- 230000006870 function Effects 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 3
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 2
- 210000004556 brain Anatomy 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 239000000203 mixture Substances 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 241000208340 Araliaceae Species 0.000 description 1
- 101150096839 Fcmr gene Proteins 0.000 description 1
- 229920005479 Lucite® Polymers 0.000 description 1
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 1
- 235000003140 Panax quinquefolius Nutrition 0.000 description 1
- 230000004888 barrier function Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000000205 computational method Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 235000008434 ginseng Nutrition 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 239000004926 polymethyl methacrylate Substances 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 238000001028 reflection method Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/06—Ray-tracing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2215/00—Indexing scheme for image rendering
- G06T2215/06—Curved planar reformation of 3D line structures
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Image Processing (AREA)
Abstract
The present invention relates to a kind of grating prism Three-dimensional Display rendering intent based on optical field acquisition, multiple viewpoints are equably preset on the lcd panel, and the multiple views rendering intent proposed with Philip research laboratory renders the initial synthesis index map of each viewpoint respectively；Camera is moved to each viewpoint, and shows above-mentioned initial synthesis index map successively, the optical field acquisition of image is carried out, merging turns into the light field of a reality；Optimize the actual light field to be allowed to maximize close to preferable light field, and according to the mapping rule of the initial synthesis index map shown in LCD to viewing plane, reverse search obtains target synthesis index map.For the three dimensional display of different size, target synthesis index map is obtained using above-mentioned scaling method.To 3-D view on the display apparatus will be shown, rendered using corresponding target synthesis index map, can effectively mitigate crosstalk, the Three-dimensional Display of excess of export various visual angles can also be rendered, without increasing hardware device.
Description
Technical field
The present invention relates to the Three-dimensional Display optimisation technique field of image, and in particular to a kind of grating rib based on optical field acquisition
Post Three-dimensional Display rendering intent.
Background technology
Dimension display technologies have broad prospects because it more presses close to mankind's actual perceived.Light field three-dimensional display system
Research purpose be exactly to explore how to be reduced light field, that is, how to control the exit direction and angle of each light.
Grating prism display device includes LCD display (Liquid Crystal Display, liquid crystal display), transparent
Lucite and column mirror grating plate.By installing transparent organic glass additional in the middle of LCD display and column mirror grating plate so that both
Distance be column mirror grating unit focal length.The pixel of N number of viewpoint can by whole enlarging projections to observer at the moment, if observation
The sight of person falls in any two adjacent viewpoint, it is possible to watches the image of correspondence viewpoint respectively and then forms stereoscopic vision.
Key and difficult point of the high-quality virtual view synthesis with showing exactly current 3D technology, what true Three-dimensional Display presently, there are asks
Topic：
1st, grating prism shows the problem of still suffering from crosstalk (crosstalk) between adjacent viewpoint；
2nd, grating prism shows that viewpoint number is less, the final effect that influence 3D is shown.
Wherein, crosstalk is due to that adjacent viewpoint light is not completely separated from and transmitted to caused by the eyes of beholder, viewing
The left eye of person can receive part and should transmit to the light of right eye, and similarly, right eye can also receive part and should pass
Transport to the light of left eye.Crosstalk phenomenon have become influence one of high-quality grating prism dimension display technologies it is very big because
Element, current solution can typically be generalized into two kinds：One is the method based on equipment, such as with disparity barrier technology or
The mode of time control；It is another be based on sub-pixel (each pixel is made up of RGB three primary colors, each color in each pixel
One " sub-pixel ") value amendment mode, for example calculate the crosstalk factor mode.Although these methods are solved to a certain extent
Viewpoint cross-interference issue, but the expense of hardware cost is larger, or amount of calculation is larger.
The content of the invention
In order to solve above mentioned problem of the prior art, the present invention proposes a kind of grating prism three based on optical field acquisition
Dimension shows rendering intent, and on the premise of hardware cost is not increased, effect of optimization more preferably, and can render excess of export various visual angles
Three-dimensional Display (super multiview display).
The present invention proposes a kind of grating prism Three-dimensional Display rendering intent based on optical field acquisition, utilizes generated target
Synthesis index map is rendered to 3-D view；
The target synthesizes index map, the display match specifications with current display 3-D view；
The target synthesis index map is generated by following scaling method, is specifically included：
Step S1, using multi-viewpoint image rendering method, renders the initial synthesis index map of each default viewpoint respectively；
Step S2, camera is moved to each default viewpoint, shows the first of each default viewpoint successively on the lcd panel
Begin synthesis index map, and uses camera captures images；The image that camera is captured in each default viewpoint, is pre-processed, bag
Include：Anti- distortion, region of interesting extraction, 2D projections change, filtering operation；Pretreated image is obtained by Nonlinear Mapping
To the light field image of corresponding each default viewpoint；
The light field image in each default viewpoint obtained in step S3, combining step S2, obtains actual light field；According to capture
When camera calibration relation, calculate the preferable light field on actual camera position；
Step S4, sets up the initial synthesis index map shown from LCD to the mapping rule of viewing plane, recorded
In look-up table；
Step S5, by minimizing | | L-wL~||2Try to achieve optimization matrix w；Using the optimization matrix w, to the reality
Light field L~Optimize, obtain wL~；Wherein, L is preferable light field；
Step S6, according to the actual light field after optimization, using the look-up table, reverse search obtains target synthesis rope
Draw figure.
Preferably, it is to the rendering intent of each visual angle figure in step S1：
I-th of visual angle figure is set to white, remaining visual angle figure is set to black, using multi-viewpoint image rendering method, renders
Go out the initial synthesis index map of i-th of default viewpoint；Wherein, i=1,2,3 ..., quantity that N, N are default viewpoint.
Preferably, step S2 is specially：
Step S21, makes m=1；Wherein, m is the sequence number of default viewpoint；
Step S22, mobile camera to m-th of default viewpoint, show successively the 1st, the 2nd ..., n-th viewpoint correspondence
Initial synthesis index map, and capture with camera the image that each width initially synthesizes index map；
Step S23, m=m+1；If m≤N, step S22 is gone to；Otherwise, step S24 is gone to；Wherein, N is default viewpoint
Quantity；
Step S24, is pre-processed to the image of capture, including：Anti- distortion, region of interesting extraction, 2D projections change,
Filtering operation；
Step S25, carries out Nonlinear Mapping to pretreated image, obtains the light field figure of corresponding each default viewpoint
Picture.
Preferably, mapping rule described in step S4 is light from each sub-pixel point in LCD to viewing plane
Map one by one.
Preferably, the method for the region of interesting extraction is：Capture images are carried out after anti-distortion processing, image is extracted
On 3D display screens region be used as area-of-interest；
The method of the 2D projections change：After 4 summits and correspondence viewpoint for extracting the area-of-interest are instead distorted
Light field image 4 summits, calculating obtain homography matrix；Capture images are carried out with 2D projections by the homography matrix to become
Change.
Preferably, in step S2, when using camera captures images, scaling board is placed between 3D display screens and camera.
Preferably, Nonlinear Mapping is described in step S2：
X=Mr_sp -1(Vsub)；
For from pretreated image sub-pixels value VsubRecover the brightness value X of correspondence light.
Preferably, in step S3, preferable light field is according to a light for preferably presetting number of views remained without crosstalk
Distribution map is obtained.
Preferably, it is described that 3-D view is rendered using the target generated synthesis index map, be specially：
Wherein, IImIndex map, View are synthesized for the target in m-th of viewpointmTo pass through OpenGL (Open Graphics
Library, open graphic library) or 3d Max (3D Studio Max are often simply called 3d Max or 3ds Max, are Discreet
The three-dimensional animation based on PC systems of company's exploitation is rendered and Software for producing) m-th of visual angle figure of threedimensional model for rendering,
IIdisplayFor the composite diagram being eventually displayed on 3D displays.
Grating prism Three-dimensional Display scaling method proposed by the present invention based on optical field acquisition, on the lcd panel equably
Multiple viewpoints are preset, multiple views rendering intent is used, the initial synthesis index map of each default viewpoint is rendered respectively；Camera is moved
To each viewpoint, and above-mentioned initial synthesis index map is shown successively, carry out the optical field acquisition of image；The light that will be obtained in each viewpoint
Occasion and the light field as reality, using camera calibration relation when gathering image, calculating obtains desired light；Set up from
The initial synthesis index map shown in LCD recorded in look-up table to the mapping rule of viewing plane；Again to the reality
Light field is optimized, and is allowed to substantially close to the preferable light field；According to the actual light field after optimization, looked into using described
Table is looked for, reverse search obtains target synthesis index map.By above-mentioned scaling method, we have been obtained for current display setup
Target synthesizes index map.
Grating prism Three-dimensional Display rendering intent proposed by the present invention based on optical field acquisition, shows to that will be shown in 3D
3-D view in equipment, synthesizes index map using the target matched with the 3D display devices being generated in advance and carries out wash with watercolours
Dye, it becomes possible to effectively mitigate crosstalk, compared with traditional optimal way, without increasing hardware device, effect of optimization more preferably, and
The Three-dimensional Display (super multiview display) of excess of export various visual angles can be rendered.
Brief description of the drawings
Fig. 1 is in the present embodiment, light finally falls within the path schematic diagram passed through when in viewing plane；
Fig. 2 be the present embodiment in, the grating prism Three-dimensional Display scaling method schematic flow sheet based on optical field acquisition；
Fig. 3 simultaneously sets up the schematic diagram for mapping rule in the present embodiment, to generate actual light field.
Embodiment
The preferred embodiment of the present invention described with reference to the accompanying drawings.It will be apparent to a skilled person that this
A little embodiments are used only for explaining the technical principle of the present invention, it is not intended that limit the scope of the invention.
Grating prism Three-dimensional Display is treated with optical angle, such as one hardware parameter is the grating prism three of 9 viewpoints
Display is tieed up, when bore hole is watched, if two eyes light just fall within two adjacent viewpoint areas, two will receive respectively
From the light of two different points of view, three-dimensional perception is formed in the brain, produces stereoscopic vision.When the sight of people falls within non-viewpoint area
Domain, can receive light of the part from a viewpoint, partly the light from adjacent viewpoint.This viewpoint crosstalk phenomenon,
There is also become apparent view region in non-view region.It is aobvious that crosstalk phenomenon has become influence high-quality grating prism three-dimensional
Show one of technology very big factor.
People receives the information of light by eyes, and the perception to surrounding enviroment is obtained after being handled by brain.Surrounding environment
Any visible object is all by the way that constantly itself is luminous or goes out light by light source irradiation back reflection, into the eyes of people
After be seen.The light that these light sources and object are sent forms the set of a light, referred to as light field in space.
In theory, if a system can completely be reduced according to the light field of some object, people, which will be unable to distinguish by eyes, is
The object light field of the system reconfiguration, or object is in itself.The research purpose of light field three-dimensional display system is exactly how to explore by light
Field is reduced, that is, how to control the exit direction and angle of each light.It can be used in producing light and control light
The optics of direction and information has a many kinds, such as laser, display screen, lens, the research of light field Three-dimensional Display be as
What realizes direction and the information control of light with existing device, or produces new device.
In real world, the light field that an object is sent is continuous, and we can only be with discrete in actually calculating
Light field carry out the continuous light field of approximate simulation, that is, it is N light field pictures to be presented on before human eye.We return to light described before
Grid prism shows, it in the optimal viewing location apart from the display that hardware parameter is 9 viewpoints is beholder that our purpose, which is,
N number of visual point image is rendered in view region, can be received when the sight of people is fallen within the viewpoint and all be from this and regard
The light of point, just looks like that this width viewpoint figure is placed on before human eye equally.Viewpoint number N span is：
Wherein, Z+The positive integer times that positive integer, i.e. N are 9 are represented, and are still positive integer after extraction of square root, such as：9、36、
81、….In our experiment, N=9 or 36 works as N=36, is just called super multi-view angle three-dimensional and shows (super multiview
Display), as shown in figure 1, sub-pixel of the light from LCD, by the raster unit on original screen panel, finally exists
Terminate in optimal viewing plane.
The present invention proposes a kind of grating prism Three-dimensional Display scaling method based on optical field acquisition, in optimal viewing location
What we received is the set of the light from N number of visual point image, and they are from the H × W × 3 sub-pixel (H in LCD
It is respectively the height and width of LCD with W, each pixel is divided into 3 sub-pixels of red, green, blue) emit, by lens
Afterwards, it is scattered in each viewpoint.What we needed distribution is the value of H × W × 3 sub-pixel in LCD.We use respectively
II~、II、L~, L is the actual light field and ideal that represent initial synthesis index map, target synthesis index map, camera capture are obtained
Light field.Our purpose is exactly to calculate actual light field L~, and optimizing makes it substantially close with preferable light field.
In the present embodiment, we take N=36, and determining 9 in the optimal viewing plane of 9 viewpoint hardware devices first regards
The position of point, and adjacent two viewpoint is bisected into N/9 parts, then obtain 36 default viewpoints.The hardware parameter of display system
As shown in table 1：
Table 1
| The hardware parameter of display system | Specification |
| LCD sizes | 21.5 inches |
| LCD resolution (H × W) | 1080×1920 |
| The lateral length p of raster unit | 0.5046mm |
| Raster unit inclined angle alpha | 15.524° |
| Viewpoint number M | 9 |
In each default viewpoint, the multiple views rendering intent proposed using Philip research laboratory is generated corresponding
Initial synthesis index map；Camera is moved to each default viewpoint, and shows above-mentioned initial synthesis index map successively, image is carried out
Optical field acquisition；The light field obtained in each viewpoint, which is merged, turns into the light field of reality, utilizes camera mark when gathering image
Determine relation, calculating obtains desired light；Reflection method of the initial synthesis index map that foundation is shown from LCD to viewing plane
Then, it recorded in look-up table；The actual light field is optimized again, is allowed to substantially close to the preferable light field；According to
The actual light field after optimization, using the look-up table, reverse search obtains target synthesis index map.
The present invention proposes a kind of grating prism Three-dimensional Display rendering intent based on optical field acquisition, is exactly to utilize above-mentioned demarcation
Method obtains the target synthesis index map corresponding to current three-dimensional LCD display, then synthesizes index map using the target, right
The 3-D view that will be shown on the LCD display of same specification is rendered.
In the present embodiment, as shown in Fig. 2 target synthesis index map is generated by following scaling method, specifically include：
Step S1, white is set to by i-th of visual angle figure, and remaining visual angle figure is set to black, utilizes Philip research laboratory
The multiple views rendering intent of proposition, renders the initial synthesis index map II of i-th of default viewpointi ~；According to said method render respectively
Go out the initial synthesis index map II of each default viewpointi ~(i=1,2,3 ..., N)；One set of composition：
N is the quantity (being 36 in the present embodiment) of default viewpoint；
Step S2, camera is moved to each default viewpoint, shows the first of each default viewpoint successively on the lcd panel
Begin synthesis index map IIi ~(i=1,2,3 ..., N), and use camera captures images；Camera is captured in each default viewpoint
Image, pre-processed, including：Anti- distortion, region of interesting extraction, 2D projections change, filtering operation；Will be pretreated
Image obtains the light field image of corresponding each default viewpoint by Nonlinear Mapping；
When using camera captures images, camera calibration plate is placed between 3D displays and camera, during capture
Camera is moved altogether N-1 times；
The light field image in each default viewpoint obtained in step S3, combining step S2, obtains actual light field L~；According to catching
Camera calibration relation when obtaining, calculates the preferable light field L on actual camera position；
Actual light field L~It is set as：Wherein,
Represent set；
Because camera perspective position set in advance and the position of actual movement are devious, we pass through camera calibration
Obtain camera position during actual acquisition light field image.When camera moves horizontally the light field picture for obtaining each viewpoint, demarcation
Plate is placed between 3D displays and camera；Preferable light field L in actual camera position can be remained according to one without crosstalk
The bright distribution maps of preferable N viewpoints obtain；Two can receive two (and only two) simultaneously no at an arbitrary position
Same visual angle figure；
Step S4, sets up the initial synthesis index map shown from LCD to the mapping rule of viewing plane, recorded
In look-up table；The mapping rule is light from each sub-pixel point in LCD to the mapping one by one of viewing plane；
Step S5, by minimizing | | L-wL~||2Try to achieve optimization matrix w；Using the optimization matrix w, to the reality
Light field L~Optimize, obtain wL~；Wherein, L is preferable light field；
Step S6, according to the actual light field after optimization, using the look-up table, reverse search obtains target synthesis rope
Draw figureWherein, IImThe target synthesis index map II of m-th of viewpointm,Represent the target of N number of viewpoint
Synthesize the set of index map.
In the present embodiment, step S2 is specially：
Step S21, makes m=1；Wherein, m is the sequence number of default viewpoint；
Step S22, mobile camera to m-th of default viewpoint, show successively the 1st, the 2nd ..., n-th viewpoint correspondence
Initial synthesis index map IIi ~(i=1,2 ..., N), and capture with camera the image that each width initially synthesizes index map；
Step S23, m=m+1；If m≤N, step S22 is gone to；Otherwise, step S24 is gone to；Wherein, N is default viewpoint
Quantity；
Step S24, is pre-processed to the image of capture, including：Anti- distortion, region of interesting extraction, 2D projections change,
Filtering operation；Image is obtained after pretreatmentWherein, m is the sequence number of viewpoint, m=1,2 ..., N；N is in m
The sequence number of the image captured in individual viewpoint, n=1,2 ..., N；
Step S25, to pretreated imageNonlinear Mapping is carried out, corresponding each preset is obtained and regards
The light field image of point
In the present embodiment, optimization matrix w computational methods are as follows：
As shown in figure 3, due to for a fixed display device, the physical location of original screen panel and LCD
It is constant, so display II1 ~When, the light path of H × W × 3 light projected from LCD to N number of capture viewpoint, and
Show II2 ~When, the light path of H × W × 3 light projected from LCD is the same.All light paths can pass through
Back mapping method is calculated and obtained.We are with a look-up table LUT1It is flat from the sub-pixel point in LCD to viewing to preserve
Shown in the mapping relations in face, such as formula (1)：
L~=LUT1(II~) (1)
In our algorithm, actual light field L~It is expressed as the two-dimensional matrix that a dimension is (H × W × 3, N).Accordingly
Ground, look-up table is from LUT1Become LUT2.For each row of matrixFor, record be m-th of visual angle point light field, Note
Record is to calculate obtained light field picture after capturing.
It is desirable that finding an optimization matrix w so that min | | L-wL~||2, introduce a Gauss white noise vector v, its side
Difference is σ2, find a w and likelihood equation P (L | w) maximized.lmWithThat represent respectively is L and L~M row.Due to lm
It is separate, so shown in likelihood equation such as formula (2)：
And due toSo formula (2) can
To be calculated as the method shown in formula (3)：
Wherein,The light field of m-th of viewpoint is represented, we estimate one from No. 100 camera light-field capturesProbability
Distribution.Use functionCome approximateProbability distributionβ can pass through parameter Estimation
Method is obtained, and then formula (3) can be rewritten as formula (4)：
Wherein, the constant that to be two different of c and c ' representatives.Then whole problem becomes the minimum shown in the derivation of equation (5)
Value：
We solve formula (5) with the method for iteration, such as shown in formula (6)：
Once optimization matrix w is computed, the synthesis index map II after optimization can be obtained by the method for reverse search
, such as shown in formula (7)：
In the present embodiment, the method for the region of interesting extraction is：Capture images are carried out after anti-distortion processing, extracted
3D display screens region on image is used as area-of-interest；
The method of the 2D projections change：After 4 summits and correspondence viewpoint for extracting the area-of-interest are instead distorted
Light field image (regular rectangle) 4 summits：(0,0)、
Calculating obtains homography matrix；Capture images are carried out with 2D projections by the homography matrix to change.
In the present embodiment, shown in Nonlinear Mapping described in step S2, such as formula (8)：
X=Mr_sp -1(Vsub) (8)
For from pretreated image sub-pixels value VsubRecover the brightness value X of correspondence light.
In the present embodiment, nonlinear mapping function Mr_spApproximating method it is as follows：
We will be introduced from light luminance value (light field image in the portion) arrive camera captures imagesSub-pixel value Mr_spThe recovery algorithms of mapping function, i.e. formula (9)：
We carry out gathering (change of light can be ignored) with the camera of exposure to same scene.Gathering
Afterwards, we obtain the sub-pixel numerical value z of every capture imagesi.We can be to each original ray brightness value liWrite out non-thread
Property equation such as formula (10) shown in：
zi=Mr_sp(li) (10)
Assuming that Mr_spIt is smooth, i is the sequence number of all sub-pixels since 0, ziAnd liIt is known, unknown is
Equation Mr_sp.It is desirable that a M can be estimatedr_spFunction, makes it substantially meet formula (10).Therefore, minimize as public
(parameter Estimation of nonlinear equation finds a M to quadratic objective function shown in formula (11)r_spSo that E is minimum)：
Wherein, what N was represented is the number of sub-pixel, and α is the weighting carried out relative to data fit term to smooth item.We
With one three ginseng function t (x)=a+bxcGo approximately to portray Mr_sp.Light when parameter a, b, c concrete numerical value are gathered according to camera
According to environment, camera parameter (such as form and aspect, saturation degree are relevant), obtained with nonlinear least square method estimation, in the present embodiment,
A=0.13, b=1.24, c=0.92.
Because the pixel value in the middle part of span is more reliable, and Mr_spIt is changed near saturation value single.We
Increase a weighting function k (z), k (z) decays to 0, wherein z at two of pixel value rangemin=0, zmax=255, such as formula
(12) shown in：
Formula (13) can be obtained by adding it in (11)：
Wherein, γ1And γ2For weight coefficient.Calculate the M for meeting formula (13)r_spFunction, as required for us
Nonlinear mapping function.
It is described that 3-D view is rendered using the target generated synthesis index map in the present embodiment, such as formula
(14) shown in：
Wherein, IImIndex map, View are synthesized for the target in m-th of viewpointmTo be rendered by OpenGL or 3d Max
Threedimensional model m-th of visual angle figure, IIdisplayFor the composite diagram being eventually displayed on 3D displays.
Those skilled in the art should be able to recognize that, the side of each example described with reference to the embodiments described herein
Method step, can be realized with electronic hardware, computer software or the combination of the two, in order to clearly demonstrate electronic hardware and
The interchangeability of software, generally describes the composition and step of each example according to function in the above description.These
Function is performed with electronic hardware or software mode actually, depending on the application-specific and design constraint of technical scheme.
Those skilled in the art can realize described function to each specific application using distinct methods, but this reality
Now it is not considered that beyond the scope of this invention.
So far, combined preferred embodiment shown in the drawings describes technical scheme, still, this area
Technical staff is it is easily understood that protection scope of the present invention is expressly not limited to these embodiments.Without departing from this
On the premise of the principle of invention, those skilled in the art can make equivalent change or replacement to correlation technique feature, these
Technical scheme after changing or replacing it is fallen within protection scope of the present invention.
Claims (9)
1. a kind of grating prism Three-dimensional Display rendering intent based on optical field acquisition, it is characterised in that utilize generated target
Synthesis index map is rendered to 3-D view；
The target synthesizes index map, the display match specifications with current display 3-D view；
The target synthesis index map is generated by following scaling method, is specifically included：
Step S1, using multi-viewpoint image rendering method, renders the initial synthesis index map of each default viewpoint respectively；
Step S2, camera is moved to each default viewpoint, shows the initial conjunction of each default viewpoint successively on the lcd panel
Into index map, and use camera captures images；The image that camera is captured in each default viewpoint, is pre-processed, including：Instead
Distortion, region of interesting extraction, 2D projections change, filtering operation；Pretreated image is obtained pair by Nonlinear Mapping
The light field image for each default viewpoint answered；
The light field image in each default viewpoint obtained in step S3, combining step S2, obtains actual light field；According to capture when
Camera calibration relation, calculates the preferable light field on actual camera position；
Step S4, sets up the initial synthesis index map shown from LCD to the mapping rule of viewing plane, recorded lookup
In table；
Step S5, by minimizing | | L-wL~||2Try to achieve optimization matrix w；Using the optimization matrix w, to the actual light field L~Optimize, obtain wL~；Wherein, L is preferable light field；
Step S6, according to the actual light field after optimization, using the look-up table, reverse search obtains target synthesis index
Figure.
2. according to the method described in claim 1, it is characterised in that be to the rendering intent of each visual angle figure in step S1：
I-th of visual angle figure is set to white, remaining visual angle figure is set to black, using multi-viewpoint image rendering method, renders i-th
The initial synthesis index map of individual default viewpoint；Wherein, i=1,2,3 ..., quantity that N, N are default viewpoint.
3. according to the method described in claim 1, it is characterised in that step S2 is specially：
Step S21, makes m=1；Wherein, m is the sequence number of default viewpoint；
Step S22, mobile camera to m-th of default viewpoint, show successively the 1st, the 2nd ..., n-th viewpoint it is corresponding just
Begin synthesis index map, and captures with camera the image that each width initially synthesizes index map；
Step S23, m=m+1；If m≤N, step S22 is gone to；Otherwise, step S24 is gone to；Wherein, N is the number of default viewpoint
Amount；
Step S24, is pre-processed to the image of capture, including：Anti- distortion, region of interesting extraction, 2D projections change, filtering
Operation；
Step S25, carries out Nonlinear Mapping to pretreated image, obtains the light field image of corresponding each default viewpoint.
4. according to the method described in claim 1, it is characterised in that it is light from LCD that rule is mapped described in step S4
On each sub-pixel point to viewing plane mapping one by one.
5. method according to claim 3, it is characterised in that
The method of the region of interesting extraction is：Capture images are carried out after anti-distortion processing, the 3D extracted on image is shown
Screen region is used as area-of-interest；
The method of the 2D projections change：Extract 4 summits of the area-of-interest and correspond to the light after viewpoint instead distorts
4 summits of field picture, calculating obtains homography matrix；Capture images are carried out with 2D projections by the homography matrix to change.
6. according to the method described in claim 1, it is characterised in that in step S2, when using camera captures images, scaling board is put
Put between 3D display screens and camera.
7. according to the method described in claim 1, it is characterised in that Nonlinear Mapping is described in step S2：
X=Mr_sp -1(Vsub)；
For from pretreated image sub-pixels value VsubRecover the brightness value X of correspondence light.
8. according to the method described in claim 1, it is characterised in that in step S3, preferable light field is remained according to one without crosstalk
The bright distribution map of preferably default number of views obtain.
9. according to the method described in claim 1, it is characterised in that described to utilize generated target to synthesize index map to three-dimensional
Image is rendered, and is specially：
Wherein, IImIndex map, View are synthesized for the target in m-th of viewpointmFor the three-dimensional rendered by OpenGL or 3dMAX
M-th of visual angle figure of model, IIdisplayFor the composite diagram being eventually displayed on 3D displays.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710329750.7A CN106991715A (en) | 2017-05-11 | 2017-05-11 | Grating prism Three-dimensional Display rendering intent based on optical field acquisition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710329750.7A CN106991715A (en) | 2017-05-11 | 2017-05-11 | Grating prism Three-dimensional Display rendering intent based on optical field acquisition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106991715A true CN106991715A (en) | 2017-07-28 |
Family
ID=59418559
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710329750.7A Pending CN106991715A (en) | 2017-05-11 | 2017-05-11 | Grating prism Three-dimensional Display rendering intent based on optical field acquisition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106991715A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107563088A (en) * | 2017-09-14 | 2018-01-09 | 北京邮电大学 | A kind of light field display device emulation mode based on Ray Tracing Algorithm |
| CN108495117A (en) * | 2018-03-29 | 2018-09-04 | 香港光云科技有限公司 | Hologram image various visual angles processing conversion, display methods and equipment |
| CN112750156A (en) * | 2020-03-16 | 2021-05-04 | 奕目(上海)科技有限公司 | Light field imaging system, processing method and device |
| CN113808271A (en) * | 2020-06-17 | 2021-12-17 | 广东博智林机器人有限公司 | Rendering method and device of three-dimensional model, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101800906A (en) * | 2009-02-11 | 2010-08-11 | 中国科学院自动化研究所 | True three-dimensional imaging display screen |
| CN101982741A (en) * | 2010-09-08 | 2011-03-02 | 北京航空航天大学 | Underwater light field sampling and simulating method |
| US8044994B2 (en) * | 2006-04-04 | 2011-10-25 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for decoding and displaying 3D light fields |
| CN103345771A (en) * | 2013-06-28 | 2013-10-09 | 中国科学技术大学 | Efficient image rendering method based on modeling |
| CN106257995A (en) * | 2016-07-25 | 2016-12-28 | 深圳大学 | A kind of light field three-D imaging method and system thereof |
-
2017
- 2017-05-11 CN CN201710329750.7A patent/CN106991715A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8044994B2 (en) * | 2006-04-04 | 2011-10-25 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for decoding and displaying 3D light fields |
| CN101800906A (en) * | 2009-02-11 | 2010-08-11 | 中国科学院自动化研究所 | True three-dimensional imaging display screen |
| CN101982741A (en) * | 2010-09-08 | 2011-03-02 | 北京航空航天大学 | Underwater light field sampling and simulating method |
| CN103345771A (en) * | 2013-06-28 | 2013-10-09 | 中国科学技术大学 | Efficient image rendering method based on modeling |
| CN106257995A (en) * | 2016-07-25 | 2016-12-28 | 深圳大学 | A kind of light field three-D imaging method and system thereof |
Non-Patent Citations (2)
| Title |
|---|
| PEI R ET AL.: "A Real-Time Depth Map Refinement and Disparity Ranges Expansion System(DRDE) for Multiview Rendering", 《THE 33D COMPUTER GRAPHICS INTERNATIONAL》 * |
| PEI R,ET AL: "Three-dimensional lenticular display synthetic image rendering based on light field acquisition", 《 JOURNAL OF THE SOCIETY FOR INFORMATION DISPLAY》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107563088A (en) * | 2017-09-14 | 2018-01-09 | 北京邮电大学 | A kind of light field display device emulation mode based on Ray Tracing Algorithm |
| CN107563088B (en) * | 2017-09-14 | 2019-10-01 | 北京邮电大学 | A kind of light field display device simulating method based on Ray Tracing Algorithm |
| CN108495117A (en) * | 2018-03-29 | 2018-09-04 | 香港光云科技有限公司 | Hologram image various visual angles processing conversion, display methods and equipment |
| CN112750156A (en) * | 2020-03-16 | 2021-05-04 | 奕目(上海)科技有限公司 | Light field imaging system, processing method and device |
| CN112750156B (en) * | 2020-03-16 | 2022-09-09 | 奕目(上海)科技有限公司 | Light field imaging system, processing method and device |
| CN113808271A (en) * | 2020-06-17 | 2021-12-17 | 广东博智林机器人有限公司 | Rendering method and device of three-dimensional model, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10375372B2 (en) | 3D system including a marker mode | |
| CN105611278B (en) | The image processing method and system and display equipment of anti-bore hole 3D viewings spinning sensation | |
| Schmidt et al. | Multiviewpoint autostereoscopic dispays from 4D-Vision GmbH | |
| US20010048507A1 (en) | Processing of images for 3D display | |
| CN106131536A (en) | A kind of bore hole 3D augmented reality interactive exhibition system and methods of exhibiting thereof | |
| US20160232710A1 (en) | Generation of three-dimensional imagery from a two-dimensional image using a depth map | |
| CN101729920B (en) | Method for displaying stereoscopic video with free visual angles | |
| JP6060329B2 (en) | Method for visualizing 3D image on 3D display device and 3D display device | |
| CN106991715A (en) | Grating prism Three-dimensional Display rendering intent based on optical field acquisition | |
| CN105763865A (en) | Naked eye 3D augmented reality method and device based on transparent liquid crystals | |
| JP2008090617A (en) | Device, method and program for creating three-dimensional image | |
| CN202168171U (en) | Three-dimensional image display system | |
| CN105704479A (en) | Interpupillary distance measuring method and system for 3D display system and display device | |
| CN107340602A (en) | 3D display apparatus and method | |
| CN108573521B (en) | Real-time interactive naked eye 3D display method based on CUDA parallel computing framework | |
| US20180184066A1 (en) | Light field retargeting for multi-panel display | |
| US20240040098A1 (en) | 3d system | |
| EP3057316B1 (en) | Generation of three-dimensional imagery to supplement existing content | |
| US20170142392A1 (en) | 3d system including additional 2d to 3d conversion | |
| KR101731113B1 (en) | 2d-3d image conversion method and stereoscopic image display using the same | |
| CN115236871A (en) | Desktop type light field display system and method based on human eye tracking and bidirectional backlight | |
| Ebisu et al. | Realization of electronic 3D display combining multiview and volumetric solutions | |
| US11172190B2 (en) | Stereo weaving for head-tracked autostereoscopic displays | |
| Nguyen Hoang et al. | A real-time rendering technique for view-dependent stereoscopy based on face tracking | |
| Liao et al. | Autostereoscopic integral photography imaging using pixel distribution of computer graphics generated image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20170728 |