CN110225332A - A kind of three-dimensional element image array generation method based on Photon Mapping - Google Patents

A kind of three-dimensional element image array generation method based on Photon Mapping Download PDF

Info

Publication number
CN110225332A
CN110225332A CN201910467325.3A CN201910467325A CN110225332A CN 110225332 A CN110225332 A CN 110225332A CN 201910467325 A CN201910467325 A CN 201910467325A CN 110225332 A CN110225332 A CN 110225332A
Authority
CN
China
Prior art keywords
photon
scene
dimensional element
element image
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910467325.3A
Other languages
Chinese (zh)
Inventor
赵岩
许正男
张艾嘉
王世刚
王学军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jilin University
Original Assignee
Jilin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jilin University filed Critical Jilin University
Priority to CN201910467325.3A priority Critical patent/CN110225332A/en
Publication of CN110225332A publication Critical patent/CN110225332A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/06Ray-tracing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/282Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems

Abstract

A kind of three-dimensional element image array generation method category 3D rendering processing technology field based on Photon Mapping, the present invention includes the following steps: that (1) obtains scene information into scene from transmitting photon from light source, and saves as a photon figure;(2) emit sight to scene from the viewpoint of setting and carry out radiance estimation, the picture under the viewpoint is calculated by the information in the photon figure that has saved;(3) multiple viewpoints are set and carry out analogue camera array acquisition image, is not necessarily to repeat step 1 at this time, acquisition image can be directly calculated by the information of photon figure;(4) pattern matrix obtained in step 3 is converted, becomes three-dimensional element image array;By the present invention in that can be reduced the light for needing constantly to compute repeatedly in ray tracing algorithm with photon mapping algorithm, the formation speed of three-dimensional element image array can be improved.

Description

A kind of three-dimensional element image array generation method based on Photon Mapping
Technical field
The invention belongs to 3D rendering processing technology fields, and in particular to a kind of three-dimensional element image array based on Photon Mapping Generation method.
Background technique
Integration imaging technology is as a kind of true three-dimension display technlolgies, since starting, due to its do not need it is aobvious by view Show equipment, viewing well waits dramatic benefits to obtain the attention of people without fatigue and display effect;It is current development prospect The application prospect of one of best free 3 D display technology, optical field imaging technology included in this is even more extensive.Benefit Optical field imaging technology is studied with computer simulation means, can be overcome in optics integrated imaging system due to experimental tool Limitation caused by problems, therefore in the concrete realization, using computer generate three-dimensional element image array also gradually at For the hot spot of research, this method is usually that other means is used to obtain three-dimensional scene images, synthesizes virtual three-dimensional scene, last benefit Three-dimensional scenic is virtually shot with Ray Tracing Algorithm, then three-dimensional element image array is generated by related algorithm.
Although it is very convenient to generate three-dimensional element image array using computer, for more complex three-dimension object and scene, The calculation amount of Ray Tracing Algorithm is very big, and when needing analogue camera array, calculation amount will be huger, therefore how It reduces calculation amount when pattern matrix generates and becomes the direction for needing to pay close attention to for us.
Summary of the invention
The purpose of the present invention is to provide it is a kind of can effectively reduce virtual shooting when using big caused by Ray Tracing Algorithm Amount calculates, reduces pattern matrix generation time, the three-dimensional element image array generation method based on Photon Mapping.
The present invention is based on the three-dimensional element image array generation methods of Photon Mapping, including the following steps:
1.1 from from light source emit photon into scene, including the following steps:
1.1.1 a kind of light source is selected from point light source, source of parallel light, area light source, setting in the scene, and calculates photon Emit vector;
1.1.2 the photon launched is tracked, when photon and a diffusing reflection surface collide, stores the energy of the photon Amount and incident direction are into global photon figure;When photon and a smooth surface collide, then pass through normal to a surface side Always the reflection direction of photon is calculated, and continues to track photon in the scene, any change is not made to global photon figure, is reflected towards Measure calculation formula are as follows:
R=2 (nd) n-d
Wherein: r is required reflection light vector;N is surface normal vector;D is incident vector;
1.2 are rendered using ray trace and collect photon, including the following steps:
1.2.1 emit light from viewpoint to each pixel of two-dimensional imaging plane, record light enters the of scene The Facing material of one point of impingement;
1.2.2 if surface is smooth material, a new reflection light will be calculated by reflective vector in step 1.1.2 Formula generates;
1.2.3 if surface is coarse material, the illumination L at the x of positionrCalculated by photon figure, find wherein away from The M photon nearest from x estimated, estimation formulas are as follows:
Wherein: φiThe energy or flux for including for photon;ωiFor input direction;ω is reflection direction;piFor position letter Breath;frFor bidirectional reflectance distribution function;rMIt (x) is the distance away from that estimated location x farthest photon in M photon;
1.2.4 the illumination that each pixel is calculated using the formula in step 1.2.3, ultimately produces entire image;
The 1.3 multiple viewpoints of setting carry out analogue camera array and obtain image, carry out step 1.2 under different points of view to obtain figure Picture;
1.4 convert the pattern matrix obtained in step 1.3, become three-dimensional element image array.
The present invention replaces the biggish Ray Tracing Algorithm of calculation amount with photon mapping algorithm, come be arranged virtual camera array into Row shooting is subtracted by emitting the photon figure that photon generates into three-dimensional scenic in advance to reduce the quantity for needing to calculate light The calculation amount for generating image using Ray Tracing Algorithm is lacked, and has compensated for and required from the beginning when generating every piece image The shortcomings that recalculating improves the speed for generating three-dimensional element image.
Detailed description of the invention
Fig. 1 is the flow chart of the three-dimensional element image array generation method based on Photon Mapping
Fig. 2 is the complicated image result schematic diagram that two kinds of algorithms generate
Wherein: (a) being ray traced image;It (b) is Photon Mapping image;
Fig. 3 is the simple image result schematic diagram that two kinds of algorithms generate
Wherein: (a) being ray traced image;It (b) is Photon Mapping image;
Fig. 4 is the three-dimensional element image array ultimately generated
Wherein: (a) being complex environment image;It (b) is simple ambient image;
Specific embodiment
A specific embodiment of the invention is described with reference to the accompanying drawing.
The present invention is based on the three-dimensional element image array generation methods of Photon Mapping, including the following steps:
1.1 from from light source emit photon into scene, including the following steps:
1.1.1 a kind of light source is selected from point light source, source of parallel light, area light source, setting in the scene, and calculates photon Emit vector;
1.1.2 the photon launched is tracked, when photon and a diffusing reflection surface collide, stores the energy of the photon Amount and incident direction are into global photon figure;When photon and a smooth surface collide, then pass through normal to a surface side Always the reflection direction of photon is calculated, and continues to track photon in the scene, any change is not made to global photon figure, is reflected towards Measure calculation formula are as follows:
R=2 (nd) n-d
Wherein: r is required reflection light vector;N is surface normal vector;D is incident vector;
1.2 are rendered using ray trace and collect photon, including the following steps:
1.2.1 emit light from viewpoint to each pixel of two-dimensional imaging plane, record light enters the of scene The Facing material of one point of impingement;
1.2.2 if surface is smooth material, a new reflection light will be calculated by reflective vector in step 1.1.2 Formula generates;
1.2.3 if surface is coarse material, the illumination L at the x of positionrCalculated by photon figure, find wherein away from The M photon nearest from x estimated, estimation formulas are as follows:
Wherein: φiThe energy or flux for including for photon;ωiFor input direction;ω is reflection direction;piFor position letter Breath;frFor bidirectional reflectance distribution function;rMIt (x) is the distance away from that estimated location x farthest photon in M photon;
1.2.4 the illumination that each pixel is calculated using the formula in step 1.2.3, ultimately produces entire image, such as Fig. 2 And shown in Fig. 3;
The 1.3 multiple viewpoints of setting carry out analogue camera array and obtain image, carry out step 1.2 under different points of view to obtain figure Picture, the step simplify the process using Ray Tracing Algorithm, without from the beginning repeating each step, to reduce image generation Time;
1.4 convert the pattern matrix obtained in step 1.3, become the three-dimensional element image array in Fig. 4.
Compare superiority and inferiority (do not calculate conversion time) of two kinds of algorithms in imaging below by specific experimental data:
Two kinds of algorithm imaging times (s) under 1 complex scene of table
Photon Mapping Ray trace
Single width figure 271 1311.5
5 width figures 1305 6557.5
20 width figures 5220 26228
Two kinds of algorithm imaging times (s) under 2 simple scenario of table
Photon Mapping Ray trace
Single width figure 29.18 24.76
5 width figures 116.94 123.8
20 width figures 446.04 495.2
The experimental results showed that, the Photon Mapping algorithm that the present invention uses in virtual camera array is greatly improved by above The formation speed of three-dimensional element image array under complex scene, in particular for the life for using camera array to carry out several figures At better reflecting its advantage;And under simple scenario, although Photon Mapping generates the time slightly slow one of single width figure A bit, but under conditions of generating several figures its advantage is still embodied.

Claims (1)

1. a kind of three-dimensional element image array generation method based on Photon Mapping, it is characterised in that include the following steps:
1.1 from from light source emit photon into scene, including the following steps:
1.1.1 a kind of light source is selected from point light source, source of parallel light, area light source, setting in the scene, and calculates photon transmitting Vector;
1.1.2 track the photon launched, when photon and a diffusing reflection surface collide, store the photon energy and Incident direction is into global photon figure;When photon and a smooth surface collide, then by normal to a surface direction come The reflection direction of photon is calculated, and continues to track photon in the scene, any change is not made to global photon figure, is reflected towards meter Calculate formula are as follows:
R=2 (nd) n-d
Wherein: r is required reflection light vector;N is surface normal vector;D is incident vector;
1.2 are rendered using ray trace and collect photon, including the following steps:
1.2.1 emit light from viewpoint to each pixel of two-dimensional imaging plane, record light enters first of scene The Facing material of the point of impingement;
1.2.2 if surface is smooth material, a new reflection light will pass through reflective vector calculation formula in step 1.1.2 It generates;
1.2.3 if surface is coarse material, the illumination L at the x of positionrIt is calculated by photon figure, finds distance x wherein most M close photon estimated, estimation formulas are as follows:
Wherein: φiThe energy or flux for including for photon;ωiFor input direction;ω is reflection direction;piFor location information;frFor Bidirectional reflectance distribution function -- BRDF;rMIt (x) is the distance away from that estimated location x farthest photon in M photon;
1.2.4 the illumination that each pixel is calculated using the formula in step 1.2.3, ultimately produces entire image;
The 1.3 multiple viewpoints of setting carry out analogue camera array and obtain image, carry out step 1.2 under different points of view to obtain image;
1.4 convert the pattern matrix obtained in step 1.3, become three-dimensional element image array.
CN201910467325.3A 2019-05-31 2019-05-31 A kind of three-dimensional element image array generation method based on Photon Mapping Pending CN110225332A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910467325.3A CN110225332A (en) 2019-05-31 2019-05-31 A kind of three-dimensional element image array generation method based on Photon Mapping

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910467325.3A CN110225332A (en) 2019-05-31 2019-05-31 A kind of three-dimensional element image array generation method based on Photon Mapping

Publications (1)

Publication Number Publication Date
CN110225332A true CN110225332A (en) 2019-09-10

Family

ID=67819085

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910467325.3A Pending CN110225332A (en) 2019-05-31 2019-05-31 A kind of three-dimensional element image array generation method based on Photon Mapping

Country Status (1)

Country Link
CN (1) CN110225332A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101826214A (en) * 2010-03-29 2010-09-08 中山大学 Photon mapping-based global illumination method
CN103238325A (en) * 2010-12-01 2013-08-07 阿尔卡特朗讯公司 Method and devices for transmitting 3d video information from server to client
CN104200509A (en) * 2014-08-19 2014-12-10 山东大学 Photon mapping accelerating method based on point cache
CN107274474A (en) * 2017-07-03 2017-10-20 长春理工大学 Indirect light during three-dimensional scenic stereoscopic picture plane is drawn shines multiplexing method
CN108364292A (en) * 2018-03-26 2018-08-03 吉林大学 A kind of illumination estimation method based on several multi-view images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101826214A (en) * 2010-03-29 2010-09-08 中山大学 Photon mapping-based global illumination method
CN103238325A (en) * 2010-12-01 2013-08-07 阿尔卡特朗讯公司 Method and devices for transmitting 3d video information from server to client
CN104200509A (en) * 2014-08-19 2014-12-10 山东大学 Photon mapping accelerating method based on point cache
CN107274474A (en) * 2017-07-03 2017-10-20 长春理工大学 Indirect light during three-dimensional scenic stereoscopic picture plane is drawn shines multiplexing method
CN108364292A (en) * 2018-03-26 2018-08-03 吉林大学 A kind of illumination estimation method based on several multi-view images

Similar Documents

Publication Publication Date Title
Attal et al. Törf: Time-of-flight radiance fields for dynamic scene view synthesis
US10636149B2 (en) Devices for refractive field visualization
Gardner et al. Deep parametric indoor lighting estimation
CN109523617B (en) Illumination estimation method based on monocular camera
CN100594519C (en) Method for real-time generating reinforced reality surroundings by spherical surface panoramic camera
CN109919911B (en) Mobile three-dimensional reconstruction method based on multi-view photometric stereo
CN107341853B (en) Virtual-real fusion method and system for super-large virtual scene and dynamic screen shooting
CN109087382A (en) A kind of three-dimensional reconstruction method and 3-D imaging system
Fahringer et al. Tomographic reconstruction of a 3-D flow field using a plenoptic camera
Kang et al. Two-view underwater 3D reconstruction for cameras with unknown poses under flat refractive interfaces
CN110728671A (en) Dense reconstruction method of texture-free scene based on vision
Okura et al. Mixed-reality world exploration using image-based rendering
Caspi et al. Vertical parallax from moving shadows
CN110264540A (en) A kind of parallel single pixel imaging method
Fan et al. Underwater optical 3-D reconstruction of photometric stereo considering light refraction and attenuation
JP4977436B2 (en) Light source position estimation device
Ichimaru et al. Unified underwater structure-from-motion
CN115359127A (en) Polarization camera array calibration method suitable for multilayer medium environment
Wu et al. Depth extraction from unidirectional integral image using a modified multibaseline technique
JP2010273091A (en) Broad band multi-view-point camera calibration method, broad band multi-view-point camera calibration device, and program
CN110225332A (en) A kind of three-dimensional element image array generation method based on Photon Mapping
Ihrke et al. Fast incident light field acquisition and rendering
CN103093491A (en) Three-dimensional model high sense of reality virtuality and reality combination rendering method based on multi-view video
Korn et al. Interactive augmentation of live images using a hdr stereo camera
Ferstl et al. aTGV-SF: Dense variational scene flow through projective warping and higher order regularization

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190910