CN113093500B - Hologram generation method and system - Google Patents
Hologram generation method and system Download PDFInfo
- Publication number
- CN113093500B CN113093500B CN202110210161.3A CN202110210161A CN113093500B CN 113093500 B CN113093500 B CN 113093500B CN 202110210161 A CN202110210161 A CN 202110210161A CN 113093500 B CN113093500 B CN 113093500B
- Authority
- CN
- China
- Prior art keywords
- dimensional scene
- ray
- depth
- length
- light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 238000004364 calculation method Methods 0.000 claims abstract description 44
- 238000004590 computer program Methods 0.000 claims description 10
- 230000006870 function Effects 0.000 claims description 8
- 238000012546 transfer Methods 0.000 claims description 8
- 238000012545 processing Methods 0.000 abstract description 8
- 238000010586 diagram Methods 0.000 description 10
- 238000004422 calculation algorithm Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000001228 spectrum Methods 0.000 description 4
- 238000003384 imaging method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000001093 holography Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000004926 polymethyl methacrylate Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
- G03H1/0891—Processes or apparatus adapted to convert digital holographic data into a hologram
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/06—Ray-tracing
Abstract
The invention provides a hologram generating method and a system, comprising the following steps: initializing a three-dimensional scene, and starting ray tracing based on three-dimensional scene initialization information; calculating to obtain color information and depth information of the three-dimensional scene; calculating to obtain holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene; and encoding the holographic surface complex amplitude to obtain a hologram. The invention obtains the information of the three-dimensional scene by using ray tracing, and utilizes the parallel processing of the image processor to realize real-time calculation, simulate the propagation of real light waves in a layering method and correctly display the complex scene.
Description
Technical Field
The invention relates to the technical field of three-dimensional imaging, in particular to a hologram generation method and system.
Background
Holographic display is an ideal way of three-dimensional display. The method for generating the hologram by using the physical process of computer simulation interference diffraction is called as computer-generated hologram, can calculate the hologram of a virtual scene, and has wide application prospect.
Ray tracing is a method for calculating information such as object color by simulating real propagation of rays, and can realize occlusion processing and improve the fidelity of images. For example, OptiX is a ray tracing engine from great intel corporation that uses GPU parallel computing to achieve the effect of real-time computing.
The existing holographic computing method can only compute the hologram of a common model generally and is difficult to express a complex three-dimensional scene, and the existing computing method generally takes a reflection and refraction effect as the texture of the surface of an object and is not in accordance with the viewing effect of the real world. Because the data volume of the computed holography processing is large, a layering method is generally adopted for real-time computation, and the traditional layering method is not suitable for computing the complex scene.
Disclosure of Invention
The invention provides a hologram generation method and a hologram generation system, which are used for solving the defect that in the prior art, only a common hologram can be calculated and a complex scene cannot be expressed.
In a first aspect, the present invention provides a hologram generating method, including:
initializing a three-dimensional scene, and starting ray tracing based on three-dimensional scene initialization information;
calculating to obtain color information and depth information of the three-dimensional scene;
calculating to obtain holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene;
and encoding the holographic surface complex amplitude to obtain a hologram.
In an embodiment, the initializing a three-dimensional scene, and starting ray tracing based on three-dimensional scene initialization information specifically include:
initializing a three-dimensional scene, and determining to obtain a plurality of three-dimensional scene parameters;
and emitting light rays to the three-dimensional scene by a camera positioned in the center of the holographic surface.
In one embodiment, the initializing a three-dimensional scene, starting ray tracing based on three-dimensional scene initialization information, and then further comprising:
and judging whether the ray emitted in the ray tracing intersects with the object or not.
In one embodiment, the calculating to obtain the color information and the depth information of the three-dimensional scene specifically includes:
if the light does not intersect with the object, setting the color corresponding to the light as a background color, otherwise, calculating the color of the surface of the object, and storing the length of the light;
and calculating the surface depth of the object, the depth of the reflected image of the object and the depth of the refracted image of the object based on the length of the light ray.
In an embodiment, the calculating the object surface depth, the object reflection image depth and the object refraction image depth based on the ray length specifically includes:
determining a first unit vector pointing to a fixation point from a camera position, a second unit vector of a light direction and a length of a light ray of a hit object, and obtaining the surface depth of the object based on the first unit vector, the second unit vector and the length of the light ray of the hit object;
determining an initial light length and a reflected light length, and obtaining the depth of the object reflected image based on the first unit vector, the second unit vector, the initial light length and the reflected light length;
determining the length of the refracted ray, recursively calculating the distance from the initial ray hitting position to the refracted image according to the length of the refracted ray, the medium refractive index, the air refractive index, the included angle between the refracted ray and the normal, and the included angle between the incident ray and the normal, and obtaining the object refracted image depth based on the first unit vector, the second unit vector, the initial ray length and the distance from the initial ray hitting position to the refracted image.
In one embodiment, the calculating obtains color information and depth information of the three-dimensional scene, and then further comprises:
the three-dimensional scene is divided into several layers according to depth information.
In an embodiment, the calculating, based on the color information and the depth information of the three-dimensional scene, a holographic surface complex amplitude by using a preset diffraction fast calculation method specifically includes:
obtaining object complex amplitude, wave vector and diffraction distance;
obtaining a transfer function based on the wave vector and the diffraction distance;
and performing fast Fourier transform and inverse fast Fourier transform based on the object complex amplitude and the transfer function to obtain the holographic surface complex amplitude.
In a second aspect, the present invention also provides a hologram generating system comprising:
the initialization module is used for initializing a three-dimensional scene and starting ray tracing based on three-dimensional scene initialization information;
the first calculation module is used for calculating and obtaining color information and depth information of the three-dimensional scene;
the second calculation module is used for calculating to obtain the holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene;
and the encoding module is used for encoding the holographic surface complex amplitude to obtain the hologram.
In a third aspect, the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the hologram generating method according to any one of the above-mentioned methods.
In a fourth aspect, the present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the hologram generation method as described in any one of the above.
According to the method and the system for generating the hologram, provided by the invention, the information of the three-dimensional scene is acquired by using ray tracing, and the real-time calculation can be realized by utilizing the parallel processing of the graphic processor, so that the real light wave propagation is simulated in a layering method, and the complex scene is correctly displayed.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a schematic flow diagram of a hologram generation method provided by the present invention;
FIG. 2 is a schematic overall flow diagram provided by the present invention;
FIG. 3 is a schematic diagram of ray tracing provided by the present invention;
FIG. 4 is a schematic diagram of a ray tracing computed reflection image provided by the present invention;
FIG. 5 is a schematic diagram of a ray tracing computed refraction image provided by the present invention;
FIG. 6 is a diagram of the numerical reconstruction and optical experimental results provided by the present invention;
FIG. 7 is a schematic diagram of a hologram generating system provided by the present invention;
fig. 8 is a schematic structural diagram of an electronic device provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Because the existing holographic computing method can only compute the hologram of a common model generally and is difficult to express a complex three-dimensional scene, the invention provides a real-time holographic computing generating method for simulating a real scene based on ray tracing.
The following explanation is given of a plurality of terms to which the present invention relates:
hologram pattern: generally, the principle of diffraction and interference is applied to record an interference pattern of light waves of an object, which is called a hologram. When the hologram is illuminated with a specified reconstruction light, the object's light wave can be reconstructed.
Spatial Light Modulator (SLM): is a core device in the process of calculating holographic reconstruction. The SLM can realize modulation of the input light wave, change the phase, amplitude, etc. of the input light wave. The hologram can be loaded onto a spatial light modulator to achieve holographic display.
Ray tracing: a method of simulating real ray propagation emits rays from a camera into a three-dimensional scene and calculates the color of each pixel. Complex scenes such as catadioptric scenes can be computed by recursively emitting rays. The method can be used for acquiring three-dimensional scene information in three-dimensional display.
Fresnel diffraction: fresnel diffraction refers to the diffraction of light waves in the near field region. Fresnel diffraction integration can be used to calculate the propagation of light waves in the near field region.
Diffraction fast calculation: because the Fresnel diffraction integral is large in calculation amount, a fast calculation method comprising a Fourier transform form is deduced according to the Fresnel diffraction integral, such as an S-FFT algorithm comprising a single Fourier transform, a D-FFT algorithm comprising two Fourier transforms, and a fast algorithm comprising an angular spectrum algorithm comprising two Fourier transforms.
Fig. 1 is a schematic flow chart of a hologram generation method provided by the present invention, as shown in fig. 1, including:
s1, initializing a three-dimensional scene, and starting ray tracing based on the three-dimensional scene initialization information;
s2, calculating to obtain color information and depth information of the three-dimensional scene;
s3, calculating to obtain holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene;
and S4, encoding the holographic surface complex amplitude to obtain a hologram.
Specifically, as shown in fig. 2, the sorting process includes initializing information such as a three-dimensional scene, starting ray tracing, and then processing by the GPU as follows: and emitting light rays to the three-dimensional scene, calculating to obtain color information and depth information of the three-dimensional scene, further diffracting to the holographic surface by a diffraction fast calculation method, finally obtaining the complex amplitude of the holographic surface, encoding the complex amplitude, and calculating the hologram. The system can obtain and display clear and complete hologram information through repeated iterative judgment and calculation.
The invention obtains the information of the three-dimensional scene by using ray tracing, and utilizes the parallel processing of the image processor to realize real-time calculation, simulate the propagation of real light waves in a layering method and correctly display the complex scene.
Based on the above embodiment, step S1 in the method specifically includes:
initializing a three-dimensional scene, and determining to obtain a plurality of three-dimensional scene parameters;
and emitting light rays to the three-dimensional scene by a camera positioned in the center of the holographic surface.
Specifically, firstly, initializing operation is carried out, a three-dimensional scene is initialized, and required parameters are determined; and starting ray tracing to enable the camera to be positioned in the center of the holographic surface and emit rays to the three-dimensional scene.
Based on any embodiment, the method further includes, after step S1:
and judging whether the ray emitted in the ray tracing intersects with the object or not.
Optionally, after the camera emits the light to the three-dimensional scene, for each emitted light, whether the light intersects with the object is judged, and subsequent calculation operation is performed according to the judgment result.
Based on any of the above embodiments, step S2 in the method specifically includes:
if the light does not intersect with the object, setting the color corresponding to the light as a background color, otherwise, calculating the color of the surface of the object, and storing the length of the light;
and calculating the surface depth of the object, the depth of the reflected image of the object and the depth of the refracted image of the object based on the length of the light ray.
Wherein the calculating based on the light length to obtain the object surface depth, the object reflection image depth and the object refraction image depth specifically comprises:
determining a first unit vector pointing to a fixation point from a camera position, a second unit vector of a light direction and a length of a light ray of a hit object, and obtaining the surface depth of the object based on the first unit vector, the second unit vector and the length of the light ray of the hit object;
determining an initial ray length and a reflected ray length, and obtaining the depth of the object reflected image based on the first unit vector, the second unit vector, the initial ray length and the reflected ray length;
determining the length of the refracted ray, recursively calculating the distance from the initial ray hitting position to the refracted image according to the length of the refracted ray, the medium refractive index, the air refractive index, the included angle between the refracted ray and the normal, and the included angle between the incident ray and the normal, and obtaining the object refracted image depth based on the first unit vector, the second unit vector, the initial ray length and the distance from the initial ray hitting position to the refracted image.
Specifically, if it is determined that the rays do not intersect the object, the color is set to the background color, the color of the surface of the object is calculated for the rays intersecting the object, and the length of the rays is stored, as shown in fig. 3,
for a unit vector pointing from the camera position to the gaze point,
the unit vector of the light direction is adopted, d is the length of the light, after the light hits the object, the depth of the surface of the object is calculated, the depth of the surface point of the object is calculated according to the length of the light, and the calculation method is shown as formula (1):
for an object with refraction and reflection effects, continuously emitting light from the intersection point, calculating a refraction and reflection image, and calculating the depth of the object reflection image, wherein the reflection image is calculated as shown in FIG. 4, the corresponding depth calculation method is shown as formula (2), and the depth calculation method is also shown as formula (2)
For a unit vector pointing from the camera position to the gaze point,
is the unit vector of the initial ray direction, d1 is the initial ray length, d2 is the reflected ray length, the inverse is calculated according to the following formulaDepth of the ray image:
the object refraction image calculation is shown in FIG. 5, and the corresponding depth calculation is shown in equations (3) and (4), and the same applies to
For a unit vector pointing from the camera position to the gaze point,
and d1 is the initial ray length, and d2 is the refracted ray length. The distance d2' from the initial ray hitting location to the refracted image is calculated according to the following formula:
where n1 is the refractive index of the medium, n2 is the refractive index of air, i1Is the angle of the refracted ray from the normal, i2Is the angle between the incident ray and the normal. If there are multiple refractions, the length of d2' needs to be calculated recursively. Calculating depth of the reflection image according to the following formula:
the invention obtains the object surface depth, the object reflection depth and the object refraction depth through respective calculation, and reflects the multi-angle corresponding information of the object in all directions to obtain the hologram under the complex scene.
Based on any embodiment, the method further includes, after step S2:
the three-dimensional scene is divided into several layers according to depth information.
Optionally, the three-dimensional scene is divided into a plurality of layers according to the depth information, and for a complex scene, the real-time calculation of the hologram can be realized by adopting layering processing and combining with diffraction fast calculation.
Based on any of the above embodiments, step S3 in the method specifically includes:
obtaining object complex amplitude, wave vector and diffraction distance;
obtaining a transfer function based on the wave vector and the diffraction distance;
and performing fast Fourier transform and inverse fast Fourier transform based on the object complex amplitude and the transfer function to obtain the holographic surface complex amplitude.
Specifically, in each layer of the three-dimensional scene, for a common object, a method of diffraction fast calculation is used for diffraction to a holographic surface, and methods of S-FFT, D-FFT and angular spectrum can be used, and the angular spectrum method is taken as an example in the invention:
p is the object complex amplitude, k is the wavevector, z is the diffraction distance, the transfer function trans is calculated according to the formula (5), and the holographic surface complex amplitude h is calculated according to the formula (6):
h＝IFFT[FFT(p)·trans] (6)
when the layering number and the imaging range are determined, the transfer function can be determined, the median value is not changed in the interaction process, the values can be calculated firstly and stored in a cache, the subsequent calculation is directly read, the calculated amount is reduced, and the calculation speed is increased.
For the reflection refraction images, the complex amplitude of the reflection refraction images is firstly transmitted to the reflection refraction surface, and then only the complex amplitude of the reflection refraction surface is reserved and transmitted to the holographic surface.
Based on any of the above embodiments, the present invention verifies the validity of the method with specific embodiments, such as the data shown in table 1:
TABLE 1
| Number of layers | Existing methods | Proposed method (S-FFT) | Proposed method (D-FFT and angular Spectrum) |
| 10 | 35fps | 99fps | 65fps |
| 30 | 15fps | 47fps | 28fps |
| 50 | 9fps | 29fps | 17fps |
The velocity comparison was calculated at 1024 × 1024 resolution, and the specific test configuration was: the resulting numerical reconstruction and comparison of the optical experimental results for the CPU (Intel i7-9750h) and the GPU (GTX1660ti) are shown in FIG. 6.
The hologram generating system provided by the present invention is described below, and the hologram generating system described below and the hologram generating method described above may be referred to correspondingly.
Fig. 7 is a schematic structural diagram of a hologram generating system provided in the present invention, as shown in fig. 7, including: an initialization module 71, a first calculation module 72, a second calculation module 73 and an encoding module 74; wherein:
the initialization module 71 is configured to initialize a three-dimensional scene, and start ray tracing based on three-dimensional scene initialization information; the first calculating module 72 is configured to calculate and obtain color information and depth information of the three-dimensional scene; the second calculating module 73 is configured to calculate, based on the color information and the depth information of the three-dimensional scene, a holographic surface complex amplitude by using a preset diffraction fast calculating method; the encoding module 74 is configured to encode the holographic surface complex amplitude to obtain a hologram.
The invention obtains the information of the three-dimensional scene by using ray tracing, and utilizes the parallel processing of the image processor to realize real-time calculation, simulate the propagation of real light waves in a layering method and correctly display the complex scene.
Fig. 8 illustrates a physical structure diagram of an electronic device, and as shown in fig. 8, the electronic device may include: a processor (processor)810, a communication interface 820, a memory 830 and a communication bus 840, wherein the processor 810, the communication interface 820 and the memory 830 communicate with each other via the communication bus 840. Processor 810 may invoke logic instructions in memory 830 to perform a hologram generation method comprising: initializing a three-dimensional scene, and starting ray tracing based on three-dimensional scene initialization information; calculating to obtain color information and depth information of the three-dimensional scene; calculating to obtain holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene; and encoding the holographic surface complex amplitude to obtain a hologram.
In addition, the logic instructions in the memory 830 may be implemented in software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform a hologram generating method provided by the above methods, the method comprising: initializing a three-dimensional scene, and starting ray tracing based on three-dimensional scene initialization information; calculating to obtain color information and depth information of the three-dimensional scene; calculating to obtain holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene; and encoding the holographic surface complex amplitude to obtain a hologram.
In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, is implemented to perform the hologram generating method provided above, the method comprising: initializing a three-dimensional scene, and starting ray tracing based on three-dimensional scene initialization information; calculating to obtain color information and depth information of the three-dimensional scene; calculating to obtain holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene; and encoding the holographic surface complex amplitude to obtain a hologram.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (6)
1. A hologram generation method, comprising:
initializing a three-dimensional scene, and starting ray tracing based on three-dimensional scene initialization information;
calculating to obtain color information and depth information of the three-dimensional scene;
calculating to obtain holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene;
encoding the holographic surface complex amplitude to obtain a hologram;
the initializing the three-dimensional scene starts ray tracing based on the three-dimensional scene initializing information, and specifically includes:
initializing a three-dimensional scene, and determining to obtain a plurality of three-dimensional scene parameters;
emitting light rays to the three-dimensional scene by a camera positioned in the center of the holographic surface;
the initializing the three-dimensional scene starts ray tracing based on the three-dimensional scene initialization information, and then further comprises:
judging whether the ray emitted in the ray tracing intersects with the object or not;
the calculating to obtain the color information and the depth information of the three-dimensional scene specifically includes:
if the light does not intersect with the object, setting the color corresponding to the light as a background color, otherwise, calculating the color of the surface of the object, and storing the length of the light;
calculating to obtain the depth of the surface of the object, the depth of the reflected image of the object and the depth of the refracted image of the object based on the length of the light;
the calculating based on the light length to obtain the object surface depth, the object reflection image depth and the object refraction image depth specifically comprises:
determining a first unit vector pointing to a fixation point from a camera position, a second unit vector of a light direction and a length of a light ray of a hit object, and obtaining the surface depth of the object based on the first unit vector, the second unit vector and the length of the light ray of the hit object;
determining an initial light length and a reflected light length, and obtaining the depth of the object reflected image based on the first unit vector, the second unit vector, the initial light length and the reflected light length;
determining the length of the refracted ray, recursively calculating the distance from the initial ray hitting position to the refracted image according to the length of the refracted ray, the medium refractive index, the air refractive index, the included angle between the refracted ray and the normal, and the included angle between the incident ray and the normal, and obtaining the object refracted image depth based on the first unit vector, the second unit vector, the initial ray length and the distance from the initial ray hitting position to the refracted image.
2. The hologram generating method according to claim 1, wherein the calculating obtains color information and depth information of the three-dimensional scene, and then further comprises:
the three-dimensional scene is divided into several layers according to depth information.
3. The hologram generating method according to claim 1, wherein the obtaining of the complex amplitude of the hologram surface by calculation using a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene specifically comprises:
obtaining object complex amplitude, wave vector and diffraction distance;
obtaining a transfer function based on the wave vector and the diffraction distance;
and performing fast Fourier transform and inverse fast Fourier transform based on the object complex amplitude and the transfer function to obtain the holographic surface complex amplitude.
4. A hologram generating system, comprising:
the initialization module is used for initializing a three-dimensional scene and starting ray tracing based on three-dimensional scene initialization information;
the first calculation module is used for calculating and obtaining color information and depth information of the three-dimensional scene;
the second calculation module is used for calculating to obtain the holographic surface complex amplitude by adopting a preset diffraction fast calculation method based on the color information and the depth information of the three-dimensional scene;
the encoding module is used for encoding the holographic surface complex amplitude to obtain a hologram;
the initialization module is specifically configured to:
initializing a three-dimensional scene, and determining to obtain a plurality of three-dimensional scene parameters;
emitting light rays to the three-dimensional scene by a camera positioned in the center of the holographic surface;
the initialization module is further specifically configured to:
judging whether the ray emitted in the ray tracing intersects with the object or not;
the first calculation module is specifically configured to:
if the light does not intersect with the object, setting the color corresponding to the light as a background color, otherwise, calculating the color of the surface of the object, and storing the length of the light;
calculating to obtain the depth of the surface of the object, the depth of the reflected image of the object and the depth of the refracted image of the object based on the length of the light;
the second calculation module is specifically configured to:
determining a first unit vector pointing to a fixation point from a camera position, a second unit vector of a light direction and a length of a light ray of a hit object, and obtaining the surface depth of the object based on the first unit vector, the second unit vector and the length of the light ray of the hit object;
determining an initial light length and a reflected light length, and obtaining the depth of the object reflected image based on the first unit vector, the second unit vector, the initial light length and the reflected light length;
determining the length of the refracted ray, recursively calculating the distance from the initial ray hitting position to the refracted image according to the length of the refracted ray, the medium refractive index, the air refractive index, the included angle between the refracted ray and the normal, and the included angle between the incident ray and the normal, and obtaining the object refracted image depth based on the first unit vector, the second unit vector, the initial ray length and the distance from the initial ray hitting position to the refracted image.
5. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the steps of the hologram generation method according to any of the claims 1 to 3 when executing the computer program.
6. A non-transitory computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the hologram generation method according to any one of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110210161.3A CN113093500B (en) | 2021-02-24 | 2021-02-24 | Hologram generation method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110210161.3A CN113093500B (en) | 2021-02-24 | 2021-02-24 | Hologram generation method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113093500A CN113093500A (en) | 2021-07-09 |
| CN113093500B true CN113093500B (en) | 2022-05-17 |
Family
ID=76667371
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110210161.3A Active CN113093500B (en) | 2021-02-24 | 2021-02-24 | Hologram generation method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113093500B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008142000A1 (en) * | 2007-05-21 | 2008-11-27 | Seereal Technologies S.A. | Holographic reconstruction system with tracking of the reconstruction |
| CN101689036A (en) * | 2007-05-16 | 2010-03-31 | 视瑞尔技术公司 | Method for rendering and generating color video holograms in real time |
| JP2010200188A (en) * | 2009-02-27 | 2010-09-09 | National Institute Of Information & Communication Technology | Multi-viewpoint image generation apparatus, multi-viewpoint image generation method, and multi-viewpoint image generation program |
| CN109683461A (en) * | 2019-01-24 | 2019-04-26 | 杭州光粒科技有限公司 | Method for generating holograms, system, storage medium and nearly eye AR hologram three-dimensional display system based on light field rendering |
| WO2019122295A2 (en) * | 2017-12-21 | 2019-06-27 | Seereal Technologies S.A. | Display device and method for tracking a virtual visibility region |
| CN110750043A (en) * | 2019-10-31 | 2020-02-04 | 北京航空航天大学 | Holographic axial chromatic aberration compensation method based on digital axicon |
| CN111812956A (en) * | 2020-06-12 | 2020-10-23 | 北京邮电大学 | Volume data-based computer generated hologram method, device and electronic equipment |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102007024236A1 (en) * | 2007-05-21 | 2008-11-27 | Seereal Technologies S.A. | Holographic reconstruction system with an array of controllable microprisms |
| CN106707680B (en) * | 2017-03-10 | 2019-03-12 | 东南大学 | A kind of holographic projection methods based on light field |
-
2021
- 2021-02-24 CN CN202110210161.3A patent/CN113093500B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101689036A (en) * | 2007-05-16 | 2010-03-31 | 视瑞尔技术公司 | Method for rendering and generating color video holograms in real time |
| WO2008142000A1 (en) * | 2007-05-21 | 2008-11-27 | Seereal Technologies S.A. | Holographic reconstruction system with tracking of the reconstruction |
| JP2010200188A (en) * | 2009-02-27 | 2010-09-09 | National Institute Of Information & Communication Technology | Multi-viewpoint image generation apparatus, multi-viewpoint image generation method, and multi-viewpoint image generation program |
| WO2019122295A2 (en) * | 2017-12-21 | 2019-06-27 | Seereal Technologies S.A. | Display device and method for tracking a virtual visibility region |
| CN109683461A (en) * | 2019-01-24 | 2019-04-26 | 杭州光粒科技有限公司 | Method for generating holograms, system, storage medium and nearly eye AR hologram three-dimensional display system based on light field rendering |
| CN110750043A (en) * | 2019-10-31 | 2020-02-04 | 北京航空航天大学 | Holographic axial chromatic aberration compensation method based on digital axicon |
| CN111812956A (en) * | 2020-06-12 | 2020-10-23 | 北京邮电大学 | Volume data-based computer generated hologram method, device and electronic equipment |
Non-Patent Citations (2)
| Title |
|---|
| 三维物场多重分数傅里叶变换全息图光电再现实验研究;郑华东等;《激光与光电子学进展》;20110210(第02期);全文 * |
| 基于OptiX光线跟踪引擎的光线跟踪全息图生成算法;孙敏远等;<激光与光电子学进展>;20201231(第24期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113093500A (en) | 2021-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR101384728B1 (en) | Method for rendering and generating computer-generated video holograms in real-time | |
| US10290142B2 (en) | Water surface rendering in virtual environment | |
| CN111812956B (en) | Volume data-based computer generated hologram method, device and electronic equipment | |
| CN113093500B (en) | Hologram generation method and system | |
| Wang et al. | Real-time photorealistic computer-generated holograms based on backward ray tracing and wavefront recording planes | |
| CN110426688A (en) | A kind of SAR analogue echoes method based on terrain backgrounds target | |
| CN116543086A (en) | Nerve radiation field processing method and device and electronic equipment | |
| Hall et al. | Algorithms for realistic image synthesis | |
| Liu et al. | Occlusion calculation algorithm for computer generated hologram based on ray tracing | |
| Starkov et al. | Ultrasound simulation with deformable and patient-specific scatterer maps | |
| CN115830202A (en) | Three-dimensional model rendering method and device | |
| Pang et al. | Dynamic holographic imaging of real-life scene | |
| CN111830810A (en) | Method and device for generating computer hologram representing real illumination on voxel | |
| JP5848071B2 (en) | A method for estimating the scattering of light in a homogeneous medium. | |
| Wang et al. | Ocean wave real-time simulation based on adaptive fusion | |
| KR20210085177A (en) | Method and apparatus for generating hologram with wide viewing angle | |
| Zhou | Accurate depth based post-processing for perception enhancement in real time three-dimensional graphics | |
| US11861785B2 (en) | Generation of tight world space bounding regions | |
| Hall et al. | Networked and multimodal 3d modeling of cities for collaborative virtual environments | |
| CN117274353B (en) | Synthetic image data generating method, control device and readable storage medium | |
| Chan et al. | Particle–mesh coupling in the interaction of fluid and deformable bodies with screen space refraction rendering | |
| WO2023179091A1 (en) | Three-dimensional model rendering method and apparatus, and device, storage medium and program product | |
| Forchhammer | A Simulation System for Scene Synthesis in Virtual Reality | |
| CN116090251A (en) | Sea wave simulation method, equipment and storage medium based on Gerstner model | |
| Liu et al. | A Simulation System for Scene Synthesis in Virtual Reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |