CN115327770A - Self-adaptive holographic function screen modulation method - Google Patents
Self-adaptive holographic function screen modulation method Download PDFInfo
- Publication number
- CN115327770A CN115327770A CN202210886762.0A CN202210886762A CN115327770A CN 115327770 A CN115327770 A CN 115327770A CN 202210886762 A CN202210886762 A CN 202210886762A CN 115327770 A CN115327770 A CN 115327770A
- Authority
- CN
- China
- Prior art keywords
- light
- holographic
- function
- light vector
- display system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 239000013598 vector Substances 0.000 claims abstract description 140
- 230000003044 adaptive effect Effects 0.000 claims abstract description 14
- 238000013527 convolutional neural network Methods 0.000 claims description 36
- 238000011084 recovery Methods 0.000 claims description 22
- 238000012549 training Methods 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 4
- 238000000576 coating method Methods 0.000 claims description 3
- 238000001125 extrusion Methods 0.000 claims description 3
- 238000009826 distribution Methods 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 145
- 230000003287 optical effect Effects 0.000 description 16
- 238000010586 diagram Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 6
- 238000004590 computer program Methods 0.000 description 6
- 238000003860 storage Methods 0.000 description 6
- 238000003491 array Methods 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 5
- 238000009792 diffusion process Methods 0.000 description 4
- 238000004519 manufacturing process Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 229920002120 photoresistant polymer Polymers 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000008030 elimination Effects 0.000 description 1
- 238000003379 elimination reaction Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000036544 posture Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000013139 quantization Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0012—Optical design, e.g. procedures, algorithms, optimisation routines
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2202—Reconstruction geometries or arrangements
- G03H1/2205—Reconstruction geometries or arrangements using downstream optical component
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2202—Reconstruction geometries or arrangements
- G03H1/2205—Reconstruction geometries or arrangements using downstream optical component
- G03H2001/2213—Diffusing screen revealing the real holobject, e.g. container filed with gel to reveal the 3D holobject
Abstract
The invention provides a self-adaptive holographic function screen modulation method, which comprises the following steps: acquiring intersection point coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated and a viewing plane and a preset holographic function screen plane respectively; acquiring an integral modulation function of the holographic function screen according to intersection point coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic function screen plane; and acquiring the holographic function screen with the integral modulation function as the holographic function screen of the three-dimensional light field display system to be modulated. The invention enables the light reconstruction error of the holographic function screen and the three-dimensional light field display system to be adaptive, can carry out adaptive modulation on the holographic function screen aiming at the uneven light distribution of the three-dimensional light field display system to be modulated, and obviously improves the three-dimensional display quality on the premise of not introducing crosstalk.
Description
Technical Field
The invention relates to the technical field of three-dimensional light field display, in particular to a self-adaptive holographic functional screen modulation method.
Background
The three-dimensional light field display technology is considered to be one of the most promising technologies in the field of three-dimensional display because the formed naked eye stereoscopic effect is real and remarkable and can process imaging in real time. In three-dimensional light field display, a three-dimensional light field display system based on a holographic functional screen is often used for three-dimensional imaging. The three-dimensional light field display system based on the holographic function screen comprises a flat panel display, a light control device and the holographic function screen which are sequentially arranged in parallel at intervals, wherein the holographic function screen is an optical information multiplexing device capable of modulating light rays of a light field reconstructed by the flat panel display and the light control device, the quantity of the reconstructed light rays can be increased, and the monocular resolution and the three-dimensional sense are further improved.
However, the light control devices in the three-dimensional light field display system are generally lens arrays, cylindrical lens arrays, slit gratings, and the like, and in the process of manufacturing and assembling these optical devices, manufacturing errors and assembling errors may occur, which causes the light control devices to have errors such as surface damage, axial deviation, and lateral deviation. These errors lead to problems with light reconstruction errors and thus to local non-uniformities of the light in the reconstructed light field. The existing holographic functional screen has uniform and consistent modulation functions, when optical information multiplexing is carried out on an optical field with locally non-uniform light rays, the light rays which are not uniformly distributed are diffused at the same angle, so that the optical information multiplexing effect is not obvious, even larger crosstalk occurs, and the display quality is seriously deteriorated.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a self-adaptive holographic function screen modulation method.
The invention provides a self-adaptive holographic function screen modulation method, which comprises the following steps:
acquiring intersection point coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated and a viewing plane and a preset holographic function screen plane respectively;
acquiring an integral modulation function of the holographic function screen according to intersection point coordinates of each light vector of the real light vector field and a viewing plane and a preset holographic function screen plane respectively;
and acquiring the holographic function screen with the integral modulation function as the holographic function screen of the three-dimensional light field display system to be modulated.
According to the self-adaptive holographic function screen modulation method provided by the invention, the step of acquiring the coordinates of the intersection points of each light vector of the real light vector field of the three-dimensional light field display system to be modulated, the viewing plane and the preset holographic function screen plane respectively comprises the following steps:
acquiring a calibration recovery graph array corresponding to an original primitive image array of an object to be imaged in a three-dimensional light field display system to be modulated;
acquiring an optical vector of a real optical vector field of the three-dimensional optical field display system to be modulated according to the central coordinate of the light control device unit of the three-dimensional optical field display system to be modulated and the calibration recovery graph array;
and confirming the intersection point coordinates of each light vector of the real light vector field and the viewing plane and the preset holographic function screen plane respectively.
According to the self-adaptive holographic function screen modulation method provided by the invention, the step of acquiring the calibration recovery map array corresponding to the original primitive image array of the object to be imaged in the three-dimensional light field display system to be modulated comprises the following steps:
and inputting the original primitive image array of the object to be imaged into a pre-trained convolutional neural network to obtain a calibration restoration image array.
According to the self-adaptive holographic function screen modulation method provided by the invention, the convolutional neural network comprises a calibration convolutional neural network unit and a point spread function unit, an original primitive image array input into the convolutional neural network is processed by the calibration convolutional neural network unit and then is subjected to convolution operation with the point spread function unit to obtain a calibration recovery map array, and the point spread function unit is a point spread function array of a light control device of a three-dimensional light field display system to be modulated.
According to the self-adaptive holographic function screen modulation method provided by the invention, the training step of the convolutional neural network comprises the following steps:
acquiring a plurality of side images of a three-dimensional image of an object as a comparison set;
inputting the original primitive image array of the object into a convolutional neural network to obtain a calibration recovery map array;
and respectively carrying out fast Fourier transform on the data in the calibration restoration graph array and the comparison set, and carrying out loss function operation on the data after the fast Fourier transform of the comparison set and the data after the fast Fourier transform of the calibration restoration graph array to complete the training and calibration of the parameters of the convolutional neural network.
According to the self-adaptive holographic function screen modulation method provided by the invention, the step of acquiring the light vector of the real light vector field of the three-dimensional light field display system to be modulated according to the central coordinate of the light control device unit of the three-dimensional light field display system to be modulated and the calibration recovery map array comprises the following steps:
and carrying out difference operation on the pixel coordinates of the calibration recovery image array corresponding to each pixel in the original primitive image array of the three-dimensional light field display system to be modulated and the central coordinates of the light control device unit of the three-dimensional light field display system to be modulated to obtain the light vector of the real light vector field corresponding to each pixel.
According to the method for modulating the self-adaptive holographic function screen provided by the invention, the step of acquiring the integral modulation function of the holographic function screen according to the intersection point coordinates of each light vector of the real light vector field, the viewing plane and the preset holographic function screen plane respectively comprises the following steps:
acquiring a modulation function of each point on the holographic function screen according to intersection point coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic function screen plane;
and acquiring the integral modulation function of the holographic function screen according to the modulation function of each point on the holographic function screen.
According to the modulation method of the self-adaptive holographic function screen, the point A on the holographic function screen k i The calculation formula of the modulation function of (b) includes:
wherein A is k i The coordinates of the intersection point of the light vector of the real light vector field passing through the ith light control device unit in the light ray channel k and the holographic functional screen, (x, y) are the coordinates of any point on the holographic functional screen, and k is the passing point A k i I is the ray path of the light vector of the real light vector field, i is the crossing point A k i Number of light vector control device units of the light vector of the real light vector field, (x) k i ,y k i ) Is point A k i Is determined by the coordinate of (a) in the space,
is a point modulation function parameter;
the formula of the point modulation function parameter is as follows:
where num is the number of light vectors in the light channel k that contain the real light vector field,
as the intersection point V of the light vector in the light channel k and the viewing plane k i 、V k j A distance between, V k i Is the intersection point, V, of the light vector of the real light vector field passing through the ith light-controlling device unit in the light ray channel k and the viewing plane k ji Is the intersection of the light vector of the real light vector field in light channel k through the jth light-controlling device unit and the viewing plane.
According to the self-adaptive holographic function screen modulation method provided by the invention, the calculation formula of the whole modulation function is as follows:
wherein the content of the first and second substances,F model (x, y) is the integral modulation function, (x, y) is the coordinate of any point on the holographic functional screen, (x i ,y i ) F (x, y) is the modulation function of the point (x, y) on the holographic functional screen, and b is the overall modulation function parameter.
According to the self-adaptive holographic function screen modulation method provided by the invention, the step of obtaining the holographic function screen with the integral modulation function comprises the following steps:
and obtaining the holographic functional screen with the integral modulation function by adopting a directional laser speckle method or an extrusion method or a coating method.
The invention provides a self-adaptive holographic function screen modulation method, which confirms the integral modulation function of a holographic function screen matched with a three-dimensional light field display system to be modulated by acquiring intersection point coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated with a viewing plane and a preset holographic function screen plane respectively, adopts the holographic function screen with the integral modulation function as the holographic function screen of the three-dimensional light field display system to be modulated, enables the holographic function screen to be matched with a light reconstruction error of the three-dimensional light field display system, can perform self-adaptive modulation of the holographic function screen aiming at uneven light distribution of the three-dimensional light field display system to be modulated, and obviously improves the three-dimensional display quality on the premise of not introducing crosstalk.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a schematic flow chart of a modulation method for an adaptive holographic functional screen provided by the invention;
FIG. 2 is a schematic structural diagram of a three-dimensional light field display system based on a holographic functional screen provided by the invention;
FIG. 3 is a schematic diagram of a three-dimensional light field display system based on a holographic functional screen provided by the present invention;
FIG. 4 is a schematic diagram of a training process of a convolutional neural network provided in the present invention;
FIG. 5 is a schematic diagram of the structure of a calibration convolutional neural network unit of the convolutional neural network provided by the present invention;
FIG. 6 is a schematic diagram of the spatial location of an array of calibration restitution maps provided by the present invention;
FIG. 7 is a schematic diagram of a directed laser speckle method provided by the present invention;
FIG. 8 is a schematic structural diagram of an adaptive holographic functional screen modulation device provided by the present invention;
fig. 9 is a schematic structural diagram of an electronic device provided by the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The three-dimensional light field display technology usually adopts a three-dimensional light field display system based on a holographic function screen to display, and the three-dimensional light field display system comprises a planar display, a light control device and the holographic function screen which are sequentially arranged in parallel at intervals, wherein the holographic function screen is an optical information multiplexing device capable of modulating light field rays reconstructed by the planar display and the light control device again, the quantity of the reconstructed light rays can be increased, and the monocular resolution and the three-dimensional sense can be further improved.
However, the light control devices in the three-dimensional light field display system are generally lens arrays, cylindrical lens arrays, slit gratings, and the like, and in the process of manufacturing and assembling these optical devices, manufacturing errors and assembling errors may occur, which causes the light control devices to have errors such as surface damage, axial deviation, and lateral deviation. These errors lead to problems with light reconstruction errors and thus to local non-uniformity of the light in the reconstructed light field.
In order to solve the above problems, embodiments of the present invention provide a method for modulating an adaptive holographic functional screen.
First, regarding the three-dimensional light field display system based on the holographic function screen, as shown in fig. 2, the structural diagram includes a planar display 201, a light control device 202, and a holographic function screen 203, which are arranged in parallel and spaced apart from each other. Taking a lens array as the light control device 202 as an example, as shown in fig. 3, light rays emitted by pixels on the flat panel display 201 pass through the lens array to construct light rays in a specific direction, the holographic functional screen can multiplex the constructed light rays, and continuous light rays are multiplexed within the range of the angle θ, so that the constructed light ray density is improved, and the monocular resolution and the three-dimensional stereoscopic impression are increased. The angle θ of the holographic functional screen is the diffusion angle of the holographic functional screen, which is determined by the modulation function f (x, y) of the holographic functional screen:
f(x,y)＝θ
in the formula, x and y are horizontal and vertical coordinates of the plane of the holographic functional screen on which the holographic functional screen is placed.
As shown in fig. 1, the steps of the present invention specifically include:
s1: and acquiring intersection point coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated, the viewing plane and a preset holographic function screen plane respectively.
S2: and acquiring the integral modulation function of the holographic function screen according to the intersection point coordinates of each light vector of the real light vector field and the viewing plane and the preset holographic function screen plane.
S3: and acquiring the holographic function screen with the integral modulation function as the holographic function screen of the three-dimensional light field display system to be modulated.
Specifically, the three-dimensional light field display system to be modulated comprises a planar display and a light control device which are arranged at intervals, and a holographic function screen plane for placing a holographic function screen is preset in the three-dimensional light field display system to be modulated.
The light control device is a lens array or a cylindrical lens array or a slit grating and the like which can realize three-dimensional imaging.
Further, in an embodiment, S1 specifically includes:
s11: acquiring a calibration recovery graph array corresponding to an original primitive image array of an object to be imaged in a three-dimensional light field display system to be modulated;
s12: acquiring a light vector of a real light vector field of the three-dimensional light field display system to be modulated according to a central coordinate of a light control device unit of the three-dimensional light field display system to be modulated and a calibration restoration image array;
s13: and confirming the intersection point coordinates of each light vector of the real light vector field and the viewing plane and the preset holographic function screen plane respectively.
In S11, the object to be imaged may be an object dedicated to acquiring the calibrated restoration image array, and the original primitive image array of the object may be acquired by using the camera array and then used as the object to be imaged of the present invention. The center coordinates of the light control device unit in S12 are the center coordinates of the light control device unit of the light control device, and the light control device is taken as a lens array as an example, and the light control device unit is each lens in the lens array.
The calibration recovery graph array of the three-dimensional light field display system to be modulated is acquired, pixel information stored in the calibration recovery graph array comprises three-dimensional imaging error information caused by light reconstruction errors, light vectors of a real light vector field can be acquired on the basis of the calibration recovery graph array, intersection point coordinates of the light vectors and a viewing plane and a preset holographic function screen plane are further acquired, accuracy and reliability of the real light vector field are improved, modulation reliability is further improved, and three-dimensional display quality is improved.
Further, in an embodiment, S11 specifically includes:
and inputting the original primitive image array of the object to be imaged into a pre-trained convolutional neural network to obtain a calibration restoration image array.
The method adopts the convolutional neural network to acquire the calibration restoration image array, can effectively improve the accuracy of the calibration restoration image, and improves the processing efficiency.
Further, in one embodiment, the convolutional neural network comprises a calibration convolutional neural network unit and a point spread function unit, the primitive image array input into the convolutional neural network is processed by the calibration convolutional neural network unit and then is subjected to convolution operation with the point spread function unit to obtain a calibration recovery map array, and the point spread function unit is a point spread function array of a light control device of the three-dimensional light field display system to be modulated.
The convolutional neural network processes the primitive image array through the calibration convolutional neural network unit, a point diffusion function unit is introduced, the point diffusion function unit is utilized to simulate the influence of a light control device in the three-dimensional light field display system to be modulated on the calibration restoration image, and the accuracy of the calibration restoration image output by the convolutional neural network is improved.
The method adopts a calibration convolutional neural network unit, constructs a deep network architecture of a multi-feature extraction channel by stacking single convolutional feature layers, realizes high-precision fitting of a high-order nonlinear optical decoding function, and simultaneously ensures that the training process is rapidly converged and has strong generalization.
Specifically, the network architecture of the calibration convolutional neural network unit of the present invention includes, but is not limited to, convolutional neural network architectures such as a feature pyramid network, a VGGet network, and a ResNet network, as shown in fig. 5, taking the feature pyramid network as an example, the calibration convolutional neural network unit includes a channel 1, a channel 2, a channel 3, and a channel 4, respectively, an elementary image array input to the calibration convolutional neural network unit is processed by the channel 1 and is from top to bottom step by step, is convolved by the channels 2, 3, and 4 after downsampling, and then outputs of the channels 2, 3, and 4 are spliced by upsampling step by step and output of the channel 1 to output a calibration recovery image array.
Taking a full-parallax display with M × N viewpoints as an example, the array of calibration restoration maps is located on the viewing plane, representing the spatial position of the actual reconstruction ray passing through the viewing plane, as shown in fig. 6. The resolution of the calibrated restoration images in the calibrated restoration image array is n × m, the spatial arrangement sequence of the calibrated restoration images on the viewing plane is shown in fig. 6, and the central position of the calibrated restoration images on the viewing plane is coaxial with the central position of the camera using the camera array in the optical vector field acquisition process. Before correction, the parallax images of the object to be imaged are collected according to the camera arrays arranged at the center positions of the cameras, and then the parallax images are synthesized into the original primitive image array through a synthesis algorithm.
Further, in one embodiment, as shown in fig. 4, the training step of the convolutional neural network comprises:
acquiring a plurality of side images of a three-dimensional image of an object as a comparison set;
inputting the original primitive image array of the object into a convolutional neural network to obtain a calibration recovery map array;
and respectively carrying out fast Fourier transform on the data in the calibration restoration graph array and the comparison set, and carrying out loss function operation on the data after the fast Fourier transform of the comparison set and the data after the fast Fourier transform of the calibration restoration graph array to complete the training and calibration of the parameters of the convolutional neural network.
Further, in an embodiment, the step S12 specifically includes:
and carrying out difference operation on the pixel coordinates of the calibration recovery image array corresponding to each pixel in the original primitive image array of the three-dimensional light field display system to be modulated and the central coordinates of the light control device unit of the three-dimensional light field display system to be modulated to obtain the light vector of the real light vector field corresponding to each pixel.
The real light vector field of the three-dimensional light field display system to be modulated can be effectively reflected by using the light vector obtained by subtracting the pixel coordinate of the calibration recovery graph array from the central coordinate of the light control device unit of the three-dimensional light field display system to be modulated, and the elimination of the light reconstruction error in the modulation process is facilitated.
Specifically, taking the light control device as an example of a lens array, the formula of the real light vector is as follows:
wherein, the first and the second end of the pipe are connected with each other,
is a true light vector (s ') corresponding to a pixel (p, q) in the original elementary image array' (p,q) ,t′ (p,q) ,z 2 ) DPI For the pixel coordinates of the array of calibration restoration maps corresponding to pixel (p, q) in the array of original primitive images, (α) i ,β i ,z 4 ) MP The central coordinate, z, of the ith light control device unit of the three-dimensional light field display system to be modulated corresponding to the pixel (p, q) in the original primitive image array 2 Is the plane of the flat panel display, z 4 Is the plane of the light control device.
The above formula of the real light vector is described by taking the lens array as an example in this embodiment, and when the light control device is a light control device capable of realizing three-dimensional imaging, such as a cylindrical lens array, a slit grating, and the like, a person skilled in the art can also obtain a light vector of a corresponding real light vector field based on the step of step S12.
Further, in one embodiment, the coordinates of the intersection points of the light vectors of the real light vector field confirmed in step S13 and the viewing plane respectively are V k i Representing the intersection point of the light vector of the real light vector field passing through the ith light-controlling device unit in the light channel k and the viewing plane; the coordinate of the intersection point of each light vector of the real light vector field and the preset plane of the holographic function screen is A k i And the coordinates of the intersection point of the light vector of the real light vector field passing through the ith light control device unit in the light channel k and the holographic functional screen are represented.
The light channel is a set of light vectors forming a specific viewpoint. Forming a specific viewpoint in a given direction is a principle of naked eye three-dimensional display: at a microscopic angle, each viewpoint is formed by light vectors with a specific direction angle range, that is, the directions of the light vectors are gathered in a certain angle, so that human eyes see the light vectors to see a certain viewpoint, that is, one side surface of a 3D image, and therefore, a certain viewpoint can be regarded as a certain light channel or a light vector beam (cluster) with a direction angle in a certain range for a certain beam; the light path is determined in the system design stage and is determined by the arrangement of pixels in the elementary image array on the flat panel display and the position of the light control device. That is, each light vector has a unique corresponding light channel, and each light channel corresponds to a plurality of light vectors.
Further, in an embodiment, the step S2 specifically includes:
s21: acquiring a modulation function of each point on the holographic function screen according to intersection point coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic function screen plane;
s22: and acquiring the integral modulation function of the holographic function screen according to the modulation function of each point on the holographic function screen.
According to the method, the local modulation function of each point of the holographic function screen is obtained through the real light vector field, the self-adaptive light information multiplexing is realized on the actual reconstruction deviation of the light field, the whole modulation function is obtained based on the modulation function of each point, the self-adaptive holographic function screen matched with the three-dimensional light field display system to be modulated is obtained, the light reconstruction error of the three-dimensional light field display system is effectively overcome, and the display effect is improved.
Further, in one embodiment, the holographic function screen has a point A k i The calculation formula of the modulation function of (b) includes:
wherein A is k i The coordinates of the intersection point of the light vector of the real light vector field passing through the ith light control device unit in the light ray channel k and the holographic functional screen, (x, y) are the coordinates of any point on the holographic functional screen, and k is the passing point A k i I is the ray path of the light vector of the real light vector field, i is the crossing point A k i Number of light vector controlling device units of the light vector of the true light vector field of (x) k i ,y k i ) Is point A k i Is determined by the coordinate of (a) in the space,
is a point modulation function parameter;
the formula for the point modulation function parameters is:
where num is the number of light vectors in the light channel k that contain the real light vector field,
is the intersection point V of the light vector in the light channel k and the viewing plane k i 、V k j A distance between, V k i Is the intersection point, V, of the light vector of the real light vector field passing through the ith light-controlling device unit in the light ray channel k and the viewing plane k ji Is the intersection point of the light vector of the real light vector field passing through the jth light-controlling device unit in the light ray channel k and the viewing plane.
Further, in one embodiment, the overall modulation function is calculated as:
wherein, F model (x, y) is the integral modulation function, (x, y) is the coordinate of any point on the holographic function screen, (x i ,y i ) F (x, y) is the modulation function of the point (x, y) on the holographic functional screen, and b is the overall modulation function parameter.
Further, in one embodiment, the method for obtaining the holographic functional screen with the integral modulation function is a directional laser speckle method, or an extrusion method, or a coating method, and the method for obtaining the holographic functional screen with the integral modulation function is not limited to the above three methods.
In the present invention, a directional laser speckle method is taken as an example, as shown in FIG. 7, a schematic diagram of the directional laser speckle method is provided, a photoresist plate is placed on a stepping motor, and an integral modulation function F is adopted model The (x, y) control signal after gray coding and quantization can be quantitatively controlled by a driverThe positions and postures of the door, the diffuse reflection screen, the diaphragm and the stepping mobile platform enable all optical devices to work cooperatively, and local accurate exposure is carried out at different positions of the photoresist plate, so that each formed holographic speckle has a required diffusion angle, and a self-adaptive integral modulation function F is obtained model (x, y) the surface type of the holographic functional screen.
Modulated with integral modulation function F model And (x, y) placing the holographic function screen on the plane of the holographic function screen, and completing the modulation of the holographic function screen of the three-dimensional light field display system to be modulated.
The adaptive holographic function screen modulation device provided by the invention is described below, and the adaptive holographic function screen modulation device described below and the adaptive holographic function screen modulation method described above can be referred to correspondingly.
As shown in fig. 8, the adaptive holographic functional screen modulation apparatus provided in the present invention includes:
an intersection coordinate obtaining module 801, configured to obtain intersection coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated, with the viewing plane and a preset holographic function screen plane, respectively;
a modulation function obtaining module 802, configured to obtain an overall modulation function of the holographic functional screen according to intersection coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic functional screen plane;
and the modulation module 803 is configured to acquire the holographic functional screen with the integral modulation function as the holographic functional screen of the three-dimensional light field display system to be modulated.
Fig. 9 illustrates a physical structure diagram of an electronic device, and as shown in fig. 9, the electronic device may include: a processor (processor) 910, a communication Interface (Communications Interface) 920, a memory (memory) 930, and a communication bus 940, wherein the processor 910, the communication Interface 920, and the memory 930 are coupled for communication via the communication bus 940. Processor 910 may invoke logic instructions in memory 930 to perform an adaptive holographic functional screen modulation method comprising: acquiring intersection point coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated and a viewing plane and a preset holographic function screen plane respectively; acquiring an integral modulation function of the holographic function screen according to intersection point coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic function screen plane; and acquiring the holographic function screen with the integral modulation function as the holographic function screen of the three-dimensional light field display system to be modulated.
In addition, the logic instructions in the memory 830 can be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention or a part thereof which substantially contributes to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, the present invention also provides a computer program product, the computer program product comprising a computer program, the computer program being stored on a non-transitory computer-readable storage medium, wherein when the computer program is executed by a processor, the computer is capable of executing a method for adaptive holographic function screen modulation provided by the above methods, the method comprising: acquiring intersection point coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated and a viewing plane and a preset holographic function screen plane respectively; acquiring an integral modulation function of the holographic function screen according to intersection point coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic function screen plane; and acquiring the holographic function screen with the integral modulation function as the holographic function screen of the three-dimensional light field display system to be modulated.
In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements an adaptive holographic function screen modulation method provided by performing the above methods, the method comprising: acquiring intersection point coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated and a viewing plane and a preset holographic function screen plane respectively; acquiring an integral modulation function of the holographic function screen according to intersection point coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic function screen plane; and acquiring the holographic function screen with the integral modulation function as the holographic function screen of the three-dimensional light field display system to be modulated.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A self-adaptive holographic functional screen modulation method is characterized by comprising the following steps:
acquiring intersection point coordinates of each light vector of a real light vector field of the three-dimensional light field display system to be modulated and a viewing plane and a preset holographic function screen plane respectively;
acquiring an integral modulation function of the holographic function screen according to intersection point coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic function screen plane;
and acquiring the holographic function screen with the integral modulation function as the holographic function screen of the three-dimensional light field display system to be modulated.
2. The method as claimed in claim 1, wherein the step of obtaining coordinates of intersection points of each light vector of the real light vector field of the three-dimensional light field display system to be modulated with the viewing plane and the predetermined holographic function screen plane comprises:
acquiring a calibration recovery graph array corresponding to an original primitive image array of an object to be imaged in a three-dimensional light field display system to be modulated;
acquiring the light vector of the real light vector field of the three-dimensional light field display system to be modulated according to the central coordinate of the light control device unit of the three-dimensional light field display system to be modulated and the calibration recovery graph array;
and confirming the intersection point coordinates of each light vector of the real light vector field and the viewing plane and the preset holographic function screen plane respectively.
3. The method for modulating the adaptive holographic functional screen according to claim 2, wherein the step of obtaining the calibration recovery map array corresponding to the original primitive image array of the object to be imaged in the three-dimensional light field display system to be modulated comprises:
and inputting the original primitive image array of the object to be imaged into a pre-trained convolutional neural network to obtain a calibration restoration image array.
4. The method for modulating the self-adaptive holographic functional screen according to claim 3, wherein the convolutional neural network comprises a calibration convolutional neural network unit and a point spread function unit, an original primitive image array input to the convolutional neural network is processed by the calibration convolutional neural network unit and then is subjected to convolution operation with the point spread function unit to obtain a calibration recovery map array, and the point spread function unit is a point spread function array of a light control device of the three-dimensional light field display system to be modulated.
5. The method as claimed in claim 3, wherein the training step of the convolutional neural network comprises:
acquiring a plurality of side images of a three-dimensional image of an object as a contrast set;
inputting the original primitive image array of the object into a convolutional neural network to obtain a calibration recovery map array;
and respectively carrying out fast Fourier transform on the data in the calibration restoration graph array and the comparison set, and carrying out loss function operation on the data after the fast Fourier transform of the comparison set and the data after the fast Fourier transform of the calibration restoration graph array to complete the training and calibration of the parameters of the convolutional neural network.
6. The method as claimed in claim 2, wherein the step of obtaining the light vector of the real light vector field of the three-dimensional light field display system to be modulated according to the central coordinates of the light control device unit of the three-dimensional light field display system to be modulated and the calibration restoration map array comprises:
and carrying out difference operation on the pixel coordinates of the calibration recovery image array corresponding to each pixel in the original primitive image array of the three-dimensional light field display system to be modulated and the central coordinates of the light control device unit of the three-dimensional light field display system to be modulated to obtain the light vector of the real light vector field corresponding to each pixel.
7. The method as claimed in claim 1, wherein the step of obtaining the overall modulation function of the holographic functional screen according to the coordinates of the intersection points of the light vectors of the real light vector field and the viewing plane and the predetermined holographic functional screen plane comprises:
acquiring a modulation function of each point on the holographic function screen according to intersection point coordinates of each light vector of the real light vector field, the viewing plane and a preset holographic function screen plane;
and acquiring the integral modulation function of the holographic function screen according to the modulation function of each point on the holographic function screen.
8. The method as claimed in claim 7, wherein the point A on the holographic functional screen is k i The calculation formula of the modulation function of (b) includes:
wherein A is k i The coordinates of the intersection point of the light vector of the real light vector field passing through the ith light control device unit in the light ray channel k and the holographic functional screen, (x, y) are the coordinates of any point on the holographic functional screen, and k is the passing point A k i I is the ray path of the light vector of the real light vector field, i is the crossing point A k i Number of light vector control device units of the light vector of the real light vector field, (x) k i ,y k i ) Is point A k i Is determined by the coordinate of (a) in the space,
is a point modulation function parameter;
the formula of the point modulation function parameter is as follows:
where num is the number of light vectors in the light channel k that contain the real light vector field,
is the intersection point V of the light vector in the light channel k and the viewing plane k i 、
A distance between, V k i Is the intersection of the light vector of the real light vector field in light channel k through the ith light-controlling device unit and the viewing plane,
is the intersection of the light vector of the real light vector field in light channel k through the jth light-controlling device unit and the viewing plane.
9. The method of claim 7, wherein the overall modulation function is calculated by the formula:
wherein, F model (x, y) is the integral modulation function, (x, y) is the coordinate of any point on the holographic functional screen, (x i ,y i ) F (x, y) is the modulation function of the point (x, y) on the screen of the holographic function, and b is the parameter of the integral modulation function.
10. The method for modulating an adaptive holographic functional screen according to claim 1, wherein the step of obtaining the holographic functional screen having the integral modulation function comprises:
and obtaining the holographic functional screen with the integral modulation function by adopting a directional laser speckle method or an extrusion method or a coating method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210886762.0A CN115327770A (en) | 2022-07-26 | 2022-07-26 | Self-adaptive holographic function screen modulation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210886762.0A CN115327770A (en) | 2022-07-26 | 2022-07-26 | Self-adaptive holographic function screen modulation method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115327770A true CN115327770A (en) | 2022-11-11 |
Family
ID=83919237
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210886762.0A Pending CN115327770A (en) | 2022-07-26 | 2022-07-26 | Self-adaptive holographic function screen modulation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115327770A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115937482A (en) * | 2022-11-24 | 2023-04-07 | 西南交通大学 | Holographic scene dynamic construction method and system capable of adapting to screen size |
-
2022
- 2022-07-26 CN CN202210886762.0A patent/CN115327770A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115937482A (en) * | 2022-11-24 | 2023-04-07 | 西南交通大学 | Holographic scene dynamic construction method and system capable of adapting to screen size |
| CN115937482B (en) * | 2022-11-24 | 2023-09-15 | 西南交通大学 | Holographic scene dynamic construction method and system for self-adapting screen size |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200311881A1 (en) | Systems and Methods for Generating Defocus Blur Effects | |
| CN109564403B (en) | Method for generating a hologram | |
| US11663691B2 (en) | Method and apparatus for restoring image | |
| WO2021216747A1 (en) | Real-Time Photorealistic 3D Holography with Deep Neural Networks | |
| CN113763301B (en) | Three-dimensional image synthesis method and device for reducing miscut probability | |
| US20230205133A1 (en) | Real-time Photorealistic 3D Holography With Deep Neural Networks | |
| CN110517352B (en) | Three-dimensional reconstruction method, storage medium, terminal and system of object | |
| US11561508B2 (en) | Method and apparatus for processing hologram image data | |
| CN115327770A (en) | Self-adaptive holographic function screen modulation method | |
| CN111768484A (en) | Electronic sand table display method and system based on synthetic image coding | |
| Guo et al. | Real-time dense-view imaging for three-dimensional light-field display based on image color calibration and self-supervised view synthesis | |
| US10529057B2 (en) | Image processing apparatus and image processing method | |
| CN113746999A (en) | Imaging method, imaging device, optical imaging system and vehicle | |
| CN116109768A (en) | Super-resolution imaging method and system for Fourier light field microscope | |
| DE10196664T5 (en) | Scene reconstruction and camera calibration with robust use of chirality | |
| Zhou et al. | Depth of field expansion method for integral imaging based on diffractive optical element and CNN | |
| CN115713678A (en) | Arrow picture data augmentation method and system, electronic device and storage medium | |
| CN115373782A (en) | Three-dimensional holographic display method and device based on polygon | |
| JP2018133064A (en) | Image processing apparatus, imaging apparatus, image processing method, and image processing program | |
| JP2022544287A (en) | Optical design and optimization techniques for 3D brightfield displays | |
| CN113935907A (en) | Method, apparatus, electronic device, and medium for pre-correcting image aberration | |
| US20180267465A1 (en) | Method for processing a holographic image | |
| CN113132706A (en) | Controllable position virtual viewpoint generation method and device based on reverse mapping | |
| CN112967370A (en) | Three-dimensional light field reconstruction method and device and storage medium | |
| CN115061348B (en) | Three-dimensional dynamic holographic display method and device based on object points |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |