CN113238472A - High-resolution light field display method and device based on frequency domain displacement - Google Patents
High-resolution light field display method and device based on frequency domain displacement Download PDFInfo
- Publication number
- CN113238472A CN113238472A CN202110439544.8A CN202110439544A CN113238472A CN 113238472 A CN113238472 A CN 113238472A CN 202110439544 A CN202110439544 A CN 202110439544A CN 113238472 A CN113238472 A CN 113238472A
- Authority
- CN
- China
- Prior art keywords
- image
- frequency
- element array
- light field
- dimensional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 22
- 238000006073 displacement reaction Methods 0.000 title claims abstract description 16
- 238000001228 spectrum Methods 0.000 claims abstract description 41
- 238000013519 translation Methods 0.000 claims abstract description 10
- 230000004927 fusion Effects 0.000 claims abstract description 7
- 238000007781 pre-processing Methods 0.000 claims abstract description 7
- 238000000926 separation method Methods 0.000 claims abstract description 7
- 230000000007 visual effect Effects 0.000 claims description 6
- 230000000694 effects Effects 0.000 claims description 5
- 238000010606 normalization Methods 0.000 claims description 3
- 230000002688 persistence Effects 0.000 claims description 3
- 230000007480 spreading Effects 0.000 claims description 3
- 230000000149 penetrating effect Effects 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims 1
- 238000005070 sampling Methods 0.000 abstract description 6
- 238000004364 calculation method Methods 0.000 abstract description 2
- 230000007547 defect Effects 0.000 abstract description 2
- 238000005516 engineering process Methods 0.000 description 14
- 238000012545 processing Methods 0.000 description 10
- 241000282414 Homo sapiens Species 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 238000005457 optimization Methods 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000003786 synthesis reaction Methods 0.000 description 2
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 1
- 206010047571 Visual impairment Diseases 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
- G02B30/26—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type
- G02B30/27—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the autostereoscopic type involving lenticular arrays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/32—Determination of transform parameters for the alignment of images, i.e. image registration using correlation-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Optics & Photonics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Holo Graphy (AREA)
Abstract
The invention discloses a high-resolution light field display method based on frequency domain displacement, which comprises the following steps: s1, constructing an element array image of a virtual three-dimensional object through virtual three-dimensional software; s2, constructing a frequency domain translation vector, and moving image elements of all sub-images of the element array image from high frequency to low frequency; s3, carrying out image preprocessing on the frequency-shifted image, then carrying out frequency spectrum separation, and carrying out frequency spectrum registration on the frequency-spectrum separated image to obtain a high-frequency component and a low-frequency component; s4, carrying out spectrum fusion and image reconstruction on the image subjected to spectrum registration; s5, refreshing the high-resolution element array image on the display panel at high speed; and S6, further converging the light by a micro-lens array, and enabling the light to be incident on the holographic scattering screen to realize three-dimensional display. The invention overcomes the defect of low sampling rate of the micro-lens array in the prior art, thereby obtaining a display result with higher resolution, reducing the calculation complexity and having better application prospect.
Description
Technical Field
The invention relates to the field of three-dimensional display, in particular to a high-resolution light field display method and device based on frequency domain displacement.
Background
The real world around human beings is three-dimensional, and people need to fully understand and accurately judge things by means of three-dimensional information in scenes such as life and work. However, the conventional flat panel display can only display two-dimensional flat information to a viewer, and the depth information is lost, which cannot meet the requirement of various industries on visualization of three-dimensional data and depth information. The three-dimensional display technology can show three-dimensional images containing real scene depth information for audiences, and in recent years, the technology is widely concerned by researchers at home and abroad. The autostereoscopic display technology includes multi-view 3D display and light field display technology, and a viewer can view a 3D image without wearing auxiliary glasses. The light field display technology can simulate the light field information of the original three-dimensional scene realistically, and is considered as the main development direction of the self-owned three-dimensional display technology.
The light field display technology is a technology for reproducing an original object by recording three-dimensional position information of object information in a propagation process, and if light rays with seven dimensions in a full light function can be collected and projected, all people in the environment can obtain an immersive brand new visual experience at the same time. The light field as an ideal three-dimensional display technology is obviously different from the traditional two-dimensional display technology: traditional two-dimensional displays can only provide psycho-visual information such as affine, occlusion, lighting shadow, texture, and the like. The light field display technology can generate all information of a traditional two-dimensional display, can provide physiological visual information of binocular parallax, mobile parallax and focus blurring, and can provide more real viewing experience for an observer. And a large amount of experimental data is needed to be used as theoretical support for constructing a light field display system, so that a three-dimensional light field display simulation technology appears.
The three-dimensional light field display technology is divided into two stages of light field acquisition and reconstruction, and in the stage of light field acquisition, three-dimensional information of an object is acquired by a Charge-coupled Device (CCD) through a plurality of micro lenses or cameras. The plurality of microlenses is composed of a plurality of identical small lenses, which are referred to as unit lenses, and the element array images recorded by the unit lenses are unit images. The biliary image is recorded and stored by the CCD. In the three-dimensional information reconstruction display stage, the unit image array is displayed on an LCD screen, light emitted by the unit images is overlapped in space through the micro lens, a light field of an original object is reproduced, and then the three-dimensional image of the original object can be seen. However, the light field display technology at the present stage still has some problems to be solved, for example, the construction of a complete light field display system needs a large amount of experimental data as a theoretical basis, and the process of testing by constructing the light field display system is complex and tedious, so the light field display simulation system is very important.
Disclosure of Invention
The invention mainly aims to provide a high-resolution light field display device based on frequency domain displacement, which can realize three-dimensional stereoscopic display.
The technical scheme adopted by the invention is as follows:
the high-resolution light field display method based on frequency domain displacement comprises the following steps:
s1, constructing an element array image of a virtual three-dimensional object through virtual three-dimensional software;
s2, constructing a frequency domain translation vector, and moving image elements of all sub-images of the element array image from high frequency to low frequency;
s3, carrying out image preprocessing on the frequency-shifted image, then carrying out frequency spectrum separation, and carrying out frequency spectrum registration on the frequency-spectrum separated image to obtain a high-frequency component and a low-frequency component;
s4, carrying out frequency spectrum fusion and image reconstruction on the image subjected to frequency spectrum registration, specifically, superposing and fusing a high-frequency component and a low-frequency component to obtain a spread spectrum, and then carrying out inverse Fourier transform to obtain a high-resolution element array image subjected to frequency spectrum spreading;
s5, refreshing the high-resolution element array image on the display panel at high speed;
and S6, converging the high-resolution element array image displayed on the display panel through a micro lens array, and enabling the high-resolution element array image to be incident on the holographic scattering screen to realize three-dimensional display.
In step S2, the frequency domain translational motion magnitude is a pitch length of a single lens element, which is one of the microlens photosensitive elements in the microlens array.
In connection with the above technical solution, step S1 specifically includes:
s11, selecting a virtual three-dimensional object;
s12, constructing a virtual camera array according to the three-dimensional information of the virtual three-dimensional object;
and S13, acquiring the light field information of the three-dimensional object by using the virtual camera array to obtain an element array image.
In step S2, different phase values are selected in different directions for frequency translation, all image elements of the acquired single element array image are translated to obtain a new element array image, and the above steps are repeated to obtain a plurality of element array images containing different phase information.
According to the technical scheme, the virtual camera array is formed by arranging a plurality of cloned virtual cameras in an array shape.
In connection with the above technical solution, step S1 specifically includes:
s11, selecting a virtual three-dimensional object;
s12, constructing a single virtual camera according to the three-dimensional information of the virtual three-dimensional object;
s13, setting a single virtual camera and planning the moving route thereof, and carrying out light field acquisition on the light field information of the three-dimensional object from a plurality of different positions and visual angles to obtain an element array image.
According to the technical scheme, the high-speed refreshing frequency of the element array image is greater than or equal to the frequency of causing the visual persistence effect of human eyes.
In step S3, the image preprocessing specifically includes removing background noise, intensity normalization processing, and edge blurring processing.
The invention also provides a high-resolution optical field display device based on frequency domain displacement, which sequentially comprises a backlight source, a display panel, a micro-lens array and a holographic scattering screen, wherein:
a backlight comprising a circular array of single or multiple point-like light sources;
a display panel for displaying an element array image, the element array image being the high resolution element array image according to the above technical solution;
a microlens array formed by a plurality of lens elements arranged at equal intervals, for converging parallel light of a high-resolution element array image displayed on a display panel to generate a light source array having a specific propagation direction and a specific divergence angle;
and the holographic scattering screen establishes a three-dimensional coordinate system by taking the center of the holographic scattering screen as an origin for displaying the element array image penetrating through the micro lens array as a three-dimensional image.
According to the technical scheme, the aperture images on the photosensitive element of the micro lens are arranged in a hexagonal shape, the hexagonal image blocks are subjected to regularized conversion, and finally the orthogonal element array image is obtained.
According to the technical scheme, the horizontal scattering angle of the holographic scattering screen is 1 degree, and the vertical scattering angle is 60 degrees.
The invention has the following beneficial effects: according to the invention, by constructing a frequency domain translation vector, image elements of all sub-images of the element array image are moved from high frequency to low frequency, and spectrum expansion can be realized by frequency shift on the premise of fixing the system bandwidth, namely, high-frequency components larger than cut-off frequency are coded to a low-frequency area of an optical transfer function, so that a more complete three-dimensional target image with higher resolution is obtained. The invention overcomes the defect of low sampling rate of the micro-lens array in the prior art, can obtain a display result with higher resolution, reduces the calculation complexity and has better application prospect.
Drawings
The invention will be further described with reference to the accompanying drawings and examples, in which:
FIG. 1 is a flow chart of a high resolution light field display method based on frequency domain displacement according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of a high-resolution light field display device based on frequency domain displacement according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, the high resolution light field display method based on frequency domain displacement according to the embodiment of the present invention is characterized by comprising the following steps:
s1, constructing an element array image of a virtual three-dimensional object through virtual three-dimensional software;
s2, constructing a frequency domain translation vector, and moving image elements of all sub-images of the element array image from high frequency to low frequency;
s3, carrying out image preprocessing on the frequency-shifted image, then carrying out frequency spectrum separation, and carrying out frequency spectrum registration on the frequency-spectrum separated image to obtain a high-frequency component and a low-frequency component;
s4, carrying out frequency spectrum fusion and image reconstruction on the image subjected to frequency spectrum registration, specifically, superposing and fusing a high-frequency component and a low-frequency component to obtain a spread spectrum, and then carrying out inverse Fourier transform to obtain a high-resolution element array image subjected to frequency spectrum spreading;
s5, refreshing the high-resolution element array image on the display panel at high speed;
and S6, converging the high-resolution element array image displayed on the display panel through a micro lens array, and enabling the high-resolution element array image to be incident on the holographic scattering screen to realize three-dimensional display.
Further, step S1 specifically includes:
s11, selecting a virtual three-dimensional object;
s12, constructing a virtual camera array according to the three-dimensional information of the virtual three-dimensional object;
and S13, acquiring the light field information of the three-dimensional object by using the virtual camera array to obtain an element array image.
The element array image is acquired by a virtual camera array to a specified virtual three-dimensional object, if the virtual camera array is constructed through simulation software to carry out light field acquisition, a plurality of clone virtual cameras are arranged into an array shape, and parameters meeting experimental requirements are set to carry out light field acquisition on the target three-dimensional object. The scene needs to be detected before the acquisition, namely, the necessary distortion inspection and correction processing are carried out on the lens on the premise of ensuring the normal operation of the camera array, the acquired image is corrected, and finally, a single element array image is obtained. If a single image element is taken as a research object, the single image element can be regarded as an imaging system through the process of a micro lens array, and the cut-off frequency of the optical transfer function of the imaging system directly determines the resolution level of the optical imaging system.
If a single virtual camera is constructed through simulation software to carry out light field acquisition, a plurality of images in different positions and visual angles are obtained by setting the single virtual camera and planning the moving route of the single virtual camera, and the light field acquisition is carried out on the target three-dimensional object.
The light field information of the target three-dimensional object can also be acquired by adopting a light field acquisition system, the acquired data is transmitted to a simulation program by the back end of a computer through rendering, and the computer controller carries out data processing on the acquired light field image; the light field acquisition system may record light field information of the target three-dimensional object using a microlens array or a camera array.
In step S3, the image after frequency shift needs to be subjected to image preprocessing, mainly including background noise removal, intensity normalization, edge blurring, and the like; carrying out frequency spectrum separation on the preprocessed image, calibrating an initial phase, and repeatedly iterating to ensure accurate separation of each order of frequency spectrum and avoid generating grid artifacts; carrying out spectrum registration on the image after the spectrum separation, and decoding a high-frequency component; and finally, carrying out frequency spectrum fusion and image reconstruction on the image subjected to frequency spectrum registration, superposing and fusing the translated high-order frequency spectrum and the primary frequency spectrum to obtain an expanded frequency spectrum, and then obtaining a sub-image subjected to frequency spectrum expansion through inverse Fourier transform. The element array image for realizing high-resolution light field display can be obtained by repeating the steps.
In another embodiment of the present invention, the light field is collected in the following manner: under the condition of meeting sampling requirements and experimental conditions, carrying out primary sampling on a target, extracting a plurality of sub-images in an element array image, and carrying out binarization processing to obtain a gray scale image; and analyzing the sub-graph and the gray-scale graph by utilizing a threshold analysis method, judging whether the sampling mode accords with an expected experimental result, repeating the process and determining the optimal sampling distance. After light field information of a target three-dimensional object is obtained, an element array image can be obtained, an element array image frequency domain image signal is obtained, processing of the element array image is carried out, and image optimization synthesis is carried out, wherein:
1) obtaining an element array image, setting the element array image in front of the whole light field display simulation system, and serving as an input source of the method; the step length of the camera array is consistent with the pitch of the lens elements, and the step length and the pitch of the lens elements are both set to be p equal to 2.36 mm;
2) the element array image is processed, the high frequency of an image element is moved to a low frequency position, the high frequency component is decoded by an image reconstruction algorithm, a frequency shift value is set to be the length of a single lens element pitch, and the frequency shift can realize frequency spectrum expansion on the premise of fixing the system bandwidth and send the frequency spectrum expansion to a terminal for response;
3) the image optimization synthesis is used for storing and managing the light field information after the optimization processing, and the light field information after the acquisition and frequency domain processing is reconstructed at the synchronous terminal, wherein:
furthermore, the obtained element array image is integrated and refreshed on the display panel at a high speed, parallel light emitted by the backlight source reaches the display panel and then illuminates the element array image displayed on the display panel, and light sources of the element array image are further converged through the micro-lens array and finally enter the holographic scattering screen to realize the reconstruction display of the three-dimensional image point.
In this embodiment, the specific parameters are set as follows: the lens pitch, the element array image pitch, and the camera array step p required for light field acquisition are 2.36mm, the lens focal length f is 14.6mm, and the microlens specification is set to 43 × 35. That is, the number of lens elements in the one-dimensional horizontal direction is 43, and the number of lens elements included in the one-dimensional vertical direction is 35. The horizontal distance between the viewer and the holographic functional screen is L-450 mm.
And after the display is finished, judging whether to continue to operate, if so, continuing to return to the initial state, reselecting a target three-dimensional object to acquire the light field information, and if not, ending the processing process.
The method runs based on MATLAB in a Win10 environment. On the basis of MATLAB, new element array images are continuously acquired and are refreshed and read at the rear end, and the refreshing frequency is consistent with the afterimage effect time of human eyes.
The light field display method based on frequency domain translation can obtain more complete target images with higher resolution. The system has high potential and desirability in modern informatization applications such as three-dimensional measurement, three-dimensional display, medical detection and the like.
As shown in fig. 2, the high-resolution light field display device based on frequency domain displacement according to the embodiment of the present invention sequentially includes a backlight 10, a display panel 20, a microlens array 30, and a holographic scattering screen 40, where:
the backlight 10 is located right to the left of the display panel, and is formed by circularly arranging one or more point-like light sources and simultaneously lighting. The display panel 20 is used for displaying an element array image, which is a micro image array composed of a plurality of image elements acquired by a light field. The refresh frequency of the element array image is greater than or equal to the frequency of causing the effect of persistence of vision of the human eye. The microlens array 30 is formed by arranging a plurality of lens elements at equal intervals, and is used for converging incident parallel light to generate a light source array with a specific propagation direction and a specific divergence angle. The horizontal scattering angle of the holographic scattering screen 40 is 1 degree, the vertical scattering angle is 60 degrees, a three-dimensional coordinate system is established with the center of the holographic scattering screen as an origin, and the element array image is displayed on the holographic scattering screen through the micro lens array to display a three-dimensional image.
And setting the frequency shift value as the pitch length of a single lens element, moving the high frequency of the image element to a low frequency position, decoding a high frequency component by an image reconstruction algorithm, and finally obtaining a new element array image by inverse Fourier transform. The frequency shift can realize spectrum expansion on the premise of fixing the system bandwidth, and the frequency shift is sent to a terminal for response; and then the synchronous terminal reconstructs the light field information after acquisition and frequency domain processing. The reconstructed element array image is refreshed on the display panel 20 at a high speed, parallel light emitted by the backlight source 10 reaches the display panel and then illuminates the element array image displayed on the display panel, and light sources of the element array image are further converged by the micro-lens array 30 and finally enter the holographic scattering screen to realize the reconstruction display of the three-dimensional image point.
In this embodiment of the invention, the ordinary wide-field spectrum of the picture element, after being shifted by a fraction, corresponds to encoding high-frequency components larger than the cut-off frequency into the low-frequency region of the optical transfer function. In order to ensure the quality of the reconstructed image, different phase values can be selected in a plurality of different directions according to the display requirement for translation, all image elements of the acquired single element array image are translated to obtain a new element array image, and the step is repeated to obtain a plurality of element array images containing different phase information.
Further, the obtained element array image is refreshed on the display panel 20 at a high speed, the display result is fused in the human brain through time division multiplexing and afterglow effect of human eyes, and a three-dimensional display result with high resolution can be obtained, wherein the two EIAs before and after frequency domain translation are P1，P2The camera array specification is M × N, and the image size is i × j, P1(x, y) represents P1The gray value at (x, y). The image obtained by time division multiplexing fusion is P3，P3＝[σ1P1(x,y)+σ2P2(x,y)+I]，σ1，σ2Is a time division multiplexing fusion coefficient, and I is a brightness parameter. Calculating P1，P2，P3Average gradient of from G1,G2And G3As indicated by the general representation of the,
the pitch of the microlens array is the same as that of the element array image, namely the acquisition step length of the camera array is consistent with that of the microlens array, the acquisition step length is p, and the focal length of the microlens array is f.
It will be understood that modifications and variations can be made by persons skilled in the art in light of the above teachings and all such modifications and variations are intended to be included within the scope of the invention as defined in the appended claims.
Claims (10)
1. A high-resolution light field display method based on frequency domain displacement is characterized by comprising the following steps:
s1, constructing an element array image of a virtual three-dimensional object through virtual three-dimensional software;
s2, constructing a frequency domain translation vector, and moving image elements of all sub-images of the element array image from high frequency to low frequency;
s3, carrying out image preprocessing on the frequency-shifted image, then carrying out frequency spectrum separation, and carrying out frequency spectrum registration on the frequency-spectrum separated image to obtain a high-frequency component and a low-frequency component;
s4, carrying out frequency spectrum fusion and image reconstruction on the image subjected to frequency spectrum registration, specifically, superposing and fusing a high-frequency component and a low-frequency component to obtain a spread spectrum, and then carrying out inverse Fourier transform to obtain a high-resolution element array image subjected to frequency spectrum spreading;
s5, refreshing the high-resolution element array image on the display panel at high speed;
and S6, converging the high-resolution element array image displayed on the display panel through a micro lens array, and enabling the high-resolution element array image to be incident on the holographic scattering screen to realize three-dimensional display.
2. The method for displaying a high resolution light field according to claim 1 wherein in step S2, the magnitude of the frequency domain translational motion is the pitch length of a single lens element, which is one of the photosensitive elements of the micro-lenses in the micro-lens array.
3. The method for displaying the high resolution light field according to the claim 1, wherein the step S1 specifically comprises:
s11, selecting a virtual three-dimensional object;
s12, constructing a virtual camera array according to the three-dimensional information of the virtual three-dimensional object;
and S13, acquiring the light field information of the three-dimensional object by using the virtual camera array to obtain an element array image.
4. The method as claimed in claim 3, wherein in step S2, different phase values are selected in different directions for frequency translation, all image elements of the acquired single element array image are translated to obtain a new element array image, and the steps are repeated to obtain a plurality of element array images containing different phase information.
5. The method for displaying the high resolution light field according to the claim 1, wherein the step S1 specifically comprises:
s11, selecting a virtual three-dimensional object;
s12, constructing a single virtual camera according to the three-dimensional information of the virtual three-dimensional object;
s13, setting a single virtual camera and planning the moving route thereof, and carrying out light field acquisition on the light field information of the three-dimensional object from a plurality of different positions and visual angles to obtain an element array image.
6. The frequency-domain displacement-based high-resolution light-field display method according to claim 1, wherein the high-speed refresh frequency of the element array image is greater than or equal to a frequency that causes a human-eye persistence of vision effect.
7. The method for displaying the light field with high resolution based on the frequency domain displacement according to any one of the claims 1 to 6, wherein in the step S3, the image preprocessing is specifically background noise removal, intensity normalization and edge blurring.
8. The utility model provides a high resolution light field display device based on frequency domain displacement which characterized in that includes backlight, display panel, microlens array and holographic scattering screen in proper order, wherein:
a backlight comprising a circular array of single or multiple point-like light sources;
a display panel for displaying an element array image which is the high resolution element array image described in claim 1;
a microlens array formed by a plurality of lens elements arranged at equal intervals, for converging parallel light of a high-resolution element array image displayed on a display panel to generate a light source array having a specific propagation direction and a specific divergence angle;
and the holographic scattering screen establishes a three-dimensional coordinate system by taking the center of the holographic scattering screen as an origin for displaying the element array image penetrating through the micro lens array as a three-dimensional image.
9. The device as claimed in claim 8, wherein the aperture images on the microlens are arranged in a hexagon, and the regular transformation is performed on the hexagonal image blocks to obtain the orthogonal element array image.
10. The frequency-domain displacement-based high-resolution light-field display device according to claim 9, wherein the holographic scattering screen has a horizontal scattering angle of 1 degree and a vertical scattering angle of 60 degrees.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110439544.8A CN113238472B (en) | 2021-04-23 | 2021-04-23 | High-resolution light field display method and device based on frequency domain displacement |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110439544.8A CN113238472B (en) | 2021-04-23 | 2021-04-23 | High-resolution light field display method and device based on frequency domain displacement |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113238472A true CN113238472A (en) | 2021-08-10 |
| CN113238472B CN113238472B (en) | 2022-05-10 |
Family
ID=77128894
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110439544.8A Active CN113238472B (en) | 2021-04-23 | 2021-04-23 | High-resolution light field display method and device based on frequency domain displacement |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113238472B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113934042A (en) * | 2021-10-13 | 2022-01-14 | 武汉工程大学 | Polymer dispersed liquid crystal film, light field display system and method |
| CN113938668A (en) * | 2021-09-07 | 2022-01-14 | 北京邮电大学 | Three-dimensional light field display and model training method, device and storage medium |
| CN115035178A (en) * | 2022-05-25 | 2022-09-09 | 武汉工程大学 | Augmented reality display system, method and storage medium |
| CN115514950A (en) * | 2022-07-25 | 2022-12-23 | 浪潮通信信息系统有限公司 | Microlens light field collecting method, system, electronic device and computer readable medium |
| CN115035178B (en) * | 2022-05-25 | 2024-10-01 | 武汉工程大学 | Augmented reality display system, method and storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080106542A1 (en) * | 2006-11-02 | 2008-05-08 | Park Dong-Won | Display system and method for driving the same |
| CN104166242A (en) * | 2014-08-27 | 2014-11-26 | 深圳市华星光电技术有限公司 | Three-dimensional image display device and three-dimensional image displayer |
| CN106199941A (en) * | 2016-08-30 | 2016-12-07 | 浙江大学 | A kind of shift frequency light field microscope and three-dimensional super-resolution microcosmic display packing |
| CN106408537A (en) * | 2016-09-24 | 2017-02-15 | 微美光速资本投资管理（北京）有限公司 | Naked-eye 3D reproduced image speckle suppression method |
| CN108388102A (en) * | 2018-02-12 | 2018-08-10 | 东南大学 | A kind of random polynary search binaryzation phase hologram drawing generating method that low frequency inhibits |
| CN110662014A (en) * | 2019-09-25 | 2020-01-07 | 江南大学 | Light field camera four-dimensional data large depth-of-field three-dimensional display method |
| CN111427166A (en) * | 2020-03-31 | 2020-07-17 | 京东方科技集团股份有限公司 | Light field display method and system, storage medium and display panel |
| CN111798396A (en) * | 2020-07-01 | 2020-10-20 | 中通服咨询设计研究院有限公司 | Multifunctional image processing method based on wavelet transformation |
-
2021
- 2021-04-23 CN CN202110439544.8A patent/CN113238472B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080106542A1 (en) * | 2006-11-02 | 2008-05-08 | Park Dong-Won | Display system and method for driving the same |
| CN104166242A (en) * | 2014-08-27 | 2014-11-26 | 深圳市华星光电技术有限公司 | Three-dimensional image display device and three-dimensional image displayer |
| CN106199941A (en) * | 2016-08-30 | 2016-12-07 | 浙江大学 | A kind of shift frequency light field microscope and three-dimensional super-resolution microcosmic display packing |
| CN106408537A (en) * | 2016-09-24 | 2017-02-15 | 微美光速资本投资管理（北京）有限公司 | Naked-eye 3D reproduced image speckle suppression method |
| CN108388102A (en) * | 2018-02-12 | 2018-08-10 | 东南大学 | A kind of random polynary search binaryzation phase hologram drawing generating method that low frequency inhibits |
| CN110662014A (en) * | 2019-09-25 | 2020-01-07 | 江南大学 | Light field camera four-dimensional data large depth-of-field three-dimensional display method |
| CN111427166A (en) * | 2020-03-31 | 2020-07-17 | 京东方科技集团股份有限公司 | Light field display method and system, storage medium and display panel |
| CN111798396A (en) * | 2020-07-01 | 2020-10-20 | 中通服咨询设计研究院有限公司 | Multifunctional image processing method based on wavelet transformation |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113938668A (en) * | 2021-09-07 | 2022-01-14 | 北京邮电大学 | Three-dimensional light field display and model training method, device and storage medium |
| CN113938668B (en) * | 2021-09-07 | 2022-08-05 | 北京邮电大学 | Three-dimensional light field display and model training method, device and storage medium |
| CN113934042A (en) * | 2021-10-13 | 2022-01-14 | 武汉工程大学 | Polymer dispersed liquid crystal film, light field display system and method |
| CN115035178A (en) * | 2022-05-25 | 2022-09-09 | 武汉工程大学 | Augmented reality display system, method and storage medium |
| CN115035178B (en) * | 2022-05-25 | 2024-10-01 | 武汉工程大学 | Augmented reality display system, method and storage medium |
| CN115514950A (en) * | 2022-07-25 | 2022-12-23 | 浪潮通信信息系统有限公司 | Microlens light field collecting method, system, electronic device and computer readable medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113238472B (en) | 2022-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113238472B (en) | High-resolution light field display method and device based on frequency domain displacement | |
| US10560687B2 (en) | LED-based integral imaging display system as well as its control method and device | |
| CN108513123B (en) | Image array generation method for integrated imaging light field display | |
| CN101729920B (en) | Method for displaying stereoscopic video with free visual angles | |
| RU2453922C2 (en) | Method of displaying original three-dimensional scene based on results of capturing images in two-dimensional projection | |
| CN107105216B (en) | A kind of 3 d light fields display device of continuous parallax based on pinhole array, wide viewing angle | |
| US8094148B2 (en) | Texture processing apparatus, method and program | |
| CN111427166B (en) | Light field display method and system, storage medium and display panel | |
| WO2019085022A1 (en) | Generation method and device for optical field 3d display unit image | |
| US20180184066A1 (en) | Light field retargeting for multi-panel display | |
| JP5852093B2 (en) | Video processing apparatus, video processing method, and program | |
| JP2009175866A (en) | Stereoscopic image generation device, its method, and its program | |
| Javidi et al. | Breakthroughs in photonics 2014: recent advances in 3-D integral imaging sensing and display | |
| Wu et al. | Depth mapping of integral images through viewpoint image extraction with a hybrid disparity analysis algorithm | |
| Park et al. | Viewpoint vector rendering for efficient elemental image generation | |
| CN106991715A (en) | Grating prism Three-dimensional Display rendering intent based on optical field acquisition | |
| KR101289283B1 (en) | A holographic display method using a hybrid image acquisition system | |
| CN116708746A (en) | Naked eye 3D-based intelligent display processing method | |
| KR20130076050A (en) | Method for obtaining of three-dimensional integral imaging using the depth camera and display system thereof | |
| Xing et al. | Multi-projector three-dimensional display for 3D Geographic Information System | |
| JP6768431B2 (en) | Image generator and program | |
| Lin et al. | Perceived depth analysis for view navigation of stereoscopic three-dimensional models | |
| CN113821107B (en) | Indoor and outdoor naked eye 3D system with real-time and free viewpoint | |
| KR101784208B1 (en) | System and method for displaying three-dimension image using multiple depth camera | |
| CN212364739U (en) | Holographic image display system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |