CN113671813B - Virtual and real scene fused full-parallax holographic volume view manufacturing method and system - Google Patents
Virtual and real scene fused full-parallax holographic volume view manufacturing method and system Download PDFInfo
- Publication number
- CN113671813B CN113671813B CN202110958979.3A CN202110958979A CN113671813B CN 113671813 B CN113671813 B CN 113671813B CN 202110958979 A CN202110958979 A CN 202110958979A CN 113671813 B CN113671813 B CN 113671813B
- Authority
- CN
- China
- Prior art keywords
- full
- parallax
- scene
- holographic
- virtual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 13
- 238000007639 printing Methods 0.000 claims abstract description 87
- 230000004927 fusion Effects 0.000 claims abstract description 57
- 238000003491 array Methods 0.000 claims abstract description 53
- 238000000034 method Methods 0.000 claims abstract description 44
- 238000005070 sampling Methods 0.000 claims abstract description 41
- 230000010287 polarization Effects 0.000 claims description 22
- 230000003287 optical effect Effects 0.000 claims description 11
- 238000004061 bleaching Methods 0.000 claims description 6
- 238000003709 image segmentation Methods 0.000 claims description 6
- 230000011218 segmentation Effects 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 5
- 230000006798 recombination Effects 0.000 claims description 5
- 238000005215 recombination Methods 0.000 claims description 5
- 238000009877 rendering Methods 0.000 claims description 5
- 238000010586 diagram Methods 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 9
- 230000000007 visual effect Effects 0.000 description 4
- 230000003190 augmentative effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007500 overflow downdraw method Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0402—Recording geometries or arrangements
- G03H2001/0421—Parallax aspect
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0402—Recording geometries or arrangements
- G03H2001/0428—Image holography, i.e. an image of the object or holobject is recorded
Abstract
The invention discloses a method and a system for manufacturing a full-parallax holographic view fused with virtual and real scenes. The method comprises the following steps: carrying out full-view shooting on a real scene to obtain a plurality of view angle images; reconstructing three-dimensional point cloud data of a real scene by adopting a plurality of view angle images; importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of a real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene to obtain a plurality of scene fusion images; carrying out full parallax sampling and coding on the multiple scene fusion images to obtain a plurality of exposure image arrays; and controlling a printing mechanism to perform full parallax printing on the plurality of exposure image arrays to obtain a full parallax holographic view. The invention can improve the reconstruction quality of the holographic volume view and improve the display effect of the holographic volume view.
Description
Technical Field
The invention relates to the field of holographic volume views, in particular to a method and a system for manufacturing a full-parallax holographic volume view with fused virtual and real scenes.
Background
The full parallax holographic stereogram view can realize 3D recording and displaying of a scene, and the scene can be a real scene or a virtual scene. By taking the experience in the field of augmented reality as a reference, the characteristic of the full parallax holographic view brings opportunity for augmented reality display of a real scene.
The 3D display of the full parallax holographic view can enhance the perception of people to the real world and achieve the effect of augmented reality. For example, in the cultural relic exhibition, in order to protect the cultural relic and simultaneously exhibit the three-dimensional image and the specific information of the cultural relic, some virtual introductory characters, patterns and the like can be superimposed on the cultural relic image.
At present, the following methods are generally adopted for making a full parallax holographic view: one is a pixel replacement method, and the basic principle of the method is as follows: and respectively sampling the real scene and the virtual scene, and directly superposing the virtual scene information on the real scene. The method can only realize the spatial position relation that the virtual scene shields the real scene, and can not realize the image fusion coding of more complex scenes, so that the reconstructed holographic volume view has poor quality and poor appearance effect; and secondly, a virtual-real fusion method based on a depth map can realize virtual-real scene fusion coding and reproduction with simple occlusion relation, but the solution of the depth map is a difficult problem, and inaccurate depth values often make the occlusion relation not meet the set requirement, so that the quality and the display effect of the reconstructed holographic volume view are also to be improved.
Disclosure of Invention
Based on this, the embodiment of the invention provides a method and a system for manufacturing a full-parallax holographic volume view fused with virtual and real scenes, which can realize a relatively complex spatial position relationship between the virtual and real scenes, do not need to calculate an accurate depth value, can improve the reconstruction quality of the holographic volume view, and improve the display effect of the holographic volume view.
In order to achieve the purpose, the invention provides the following scheme:
a method for manufacturing a full-parallax holographic view fused with virtual and real scenes comprises the following steps:
carrying out full-view shooting on a real scene to obtain a plurality of view angle images;
reconstructing three-dimensional point cloud data of the real scene by adopting the plurality of view angle images;
importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of the real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene in the three-dimensional modeling software to obtain a plurality of scene fusion images;
carrying out full parallax sampling and coding on the plurality of scene fusion images to obtain a plurality of exposure image arrays;
and controlling a printing mechanism to perform full parallax printing on the plurality of exposure image arrays to obtain a full parallax hologram view.
Optionally, the importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of the real scene, and adjusting a spatial position relationship between the three-dimensional model and a virtual scene in the three-dimensional modeling software to obtain a plurality of scene fusion images specifically includes:
converting the three-dimensional point cloud data into patch data by adopting a Poisson surface reconstruction algorithm;
importing the patch data into the three-dimensional modeling software to construct a three-dimensional model of the real scene;
rendering a virtual scene in the three-dimensional modeling software or importing the rendered virtual scene into the three-dimensional modeling software, and adjusting the spatial position relationship between the three-dimensional model and the virtual scene to obtain a plurality of scene fusion images.
Optionally, the performing full-parallax sampling and encoding on the multiple scene fusion images to obtain multiple exposure image arrays specifically includes:
carrying out full parallax sampling on a plurality of scene fusion images by adopting a virtual camera according to a set holographic printing requirement to obtain a plurality of sampling image arrays;
and coding each sampling image array by adopting an infinite camera method, a perspective segmentation method or a view image segmentation and recombination method to obtain a plurality of exposure image arrays.
Optionally, the controlling the printing mechanism performs full-parallax printing on the plurality of exposure image arrays to obtain a full-parallax hologram view, and specifically includes:
and loading the exposure image arrays into a printing mechanism one by one, and printing the exposure image arrays loaded into the printing mechanism one by one with full parallax to obtain a full parallax holographic view.
Optionally, the printing mechanism is a full parallax printing optical path component; the full parallax printing light path component comprises: a laser; the electronic shutter and the polarization beam splitter prism are sequentially arranged on the emergent light path of the laser; the first beam expander, the display screen, the scattering screen, the rectangular diaphragm and the holographic plate are sequentially arranged on a transmission light path of the polarization beam splitter prism; the reflecting mirror is arranged on a reflecting light path of the polarization beam splitter prism; the second beam expander is arranged on an emergent light path of the reflector; the rectangular diaphragm is positioned on an emergent light path of the second beam expander;
the printing of the full parallax of the exposure image array loaded into the printing mechanism one by one to obtain a full parallax holographic volume view specifically includes:
when an nth exposure image array is printed, loading the nth exposure image array on the display screen, controlling the holographic plate to move for a set distance, controlling the electronic shutter to open, dividing laser emitted by the laser into an object beam and a reference beam by the polarization beam splitter prism, forming a scattered object beam on the rectangular diaphragm after the object beam sequentially passes through the first beam expander, the display screen and the scattering screen, forming a expanded reference beam on the rectangular diaphragm after the reference beam sequentially passes through the reflector and the second beam expander, performing interference exposure on the scattered object beam and the expanded reference beam on the rectangular diaphragm, and presenting an exposure pattern on the holographic plate;
and when all the exposure image arrays show exposure images on the holographic plate, developing, fixing and bleaching the holographic plate to obtain a full-parallax holographic view.
The invention also provides a system for making the virtual-real scene fused full-parallax holographic view, which comprises the following steps: a processor and a printing mechanism; the processor is connected with the printing mechanism;
a virtual-real fusion program is built in the processor; the virtual-real fusion program comprises:
the image acquisition module is used for carrying out full-view shooting on a real scene to obtain a plurality of view angle images;
the three-dimensional point cloud computing module is used for reconstructing three-dimensional point cloud data of the real scene by adopting the plurality of view angle images;
the virtual-real scene fusion module is used for importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of the real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene in the three-dimensional modeling software to obtain a plurality of scene fusion images;
the sampling and encoding module is used for carrying out full parallax sampling and encoding on the scene fusion images to obtain a plurality of exposure image arrays;
and the full-parallax printing module is used for controlling the printing mechanism to perform full-parallax printing on the plurality of exposure image arrays to obtain a full-parallax holographic view.
Optionally, the virtual-real scene fusion module specifically includes:
the data conversion unit is used for converting the three-dimensional point cloud data into patch data by adopting a Poisson surface reconstruction algorithm;
the three-dimensional model building unit is used for importing the patch data into the three-dimensional modeling software to build a three-dimensional model of the real scene;
and the scene fusion unit is used for rendering a virtual scene in the three-dimensional modeling software or importing the rendered virtual scene into the three-dimensional modeling software, and adjusting the spatial position relationship between the three-dimensional model and the virtual scene to obtain a plurality of scene fusion images.
Optionally, the sampling encoding module specifically includes:
the full-parallax sampling unit is used for performing full-parallax sampling on the scene fusion images by adopting a virtual camera according to the set holographic printing requirement to obtain a plurality of sampling image arrays;
and the coding unit is used for coding each sampling image array by adopting an infinite camera method, a perspective segmentation method or a view image segmentation and recombination method to obtain a plurality of exposure image arrays.
Optionally, the full parallax printing module specifically includes:
and the printing unit is used for loading the exposure image arrays into a printing mechanism one by one and printing the exposure image arrays loaded into the printing mechanism one by one in a full parallax way to obtain a full parallax holographic view.
Optionally, the printing mechanism is a full parallax printing optical path component; the full parallax printing light path component comprises: a laser; the electronic shutter and the polarization beam splitter prism are sequentially arranged on the emergent light path of the laser; the first beam expander, the display screen, the scattering screen, the rectangular diaphragm and the holographic plate are sequentially arranged on a transmission light path of the polarization splitting prism; the reflecting mirror is arranged on a reflecting light path of the polarization beam splitter prism; the second beam expander is arranged on an emergent light path of the reflector; the rectangular diaphragm is positioned on an emergent light path of the second beam expander;
the printing unit specifically comprises:
the one-by-one printing subunit is used for loading the nth exposure image array onto the display screen when the nth exposure image array is printed, controlling the holographic plate to move for a set distance, controlling the electronic shutter to be opened, dividing laser emitted by the laser into an object beam and a reference beam by the polarization beam splitter prism, forming a scattered object beam on the rectangular diaphragm after the object beam sequentially passes through the first beam expander, the display screen and the scattering screen, forming a post-expansion reference beam on the rectangular diaphragm after the reference beam sequentially passes through the reflector and the second beam expander, and exposing the scattered object beam and the post-expansion reference beam on the rectangular diaphragm in an interference manner, wherein the exposure image is presented on the holographic plate;
and the holographic plate processing subunit is used for developing, fixing and bleaching the holographic plate to obtain a full-parallax holographic view when all the exposure image arrays present exposure images on the holographic plate.
Compared with the prior art, the invention has the beneficial effects that:
the embodiment of the invention provides a method and a system for manufacturing a full-parallax holographic stereogram with fused virtual and real scenes, which comprises the steps of firstly reconstructing three-dimensional point cloud data of a real scene by adopting a plurality of visual angle images obtained by full-visual-angle shooting of the real scene; importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of a real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene to obtain a plurality of scene fusion images; carrying out full parallax sampling and coding on the multiple scene fusion images to obtain a plurality of exposure image arrays; and controlling a printing mechanism to perform full parallax printing on the plurality of exposure image arrays to obtain a full parallax holographic view. According to the invention, the images after the fusion of the virtual and real scenes are sampled and coded, so that the relatively complex spatial position relation between the virtual and real scenes can be realized, the accurate depth value does not need to be calculated, the reconstruction quality of the holographic volume view can be improved, and the display effect of the holographic volume view is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
Fig. 1 is a flowchart of a method for making a virtual-real scene fused full-parallax holographic view according to an embodiment of the present invention;
fig. 2 is a diagram of an optical path layout of a full-parallax printing optical path component according to an embodiment of the present invention;
fig. 3 is a structural diagram of a full parallax holographic view production system with virtual and real scene fusion according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
As an effective 3D display technology, a full parallax holographic view can display both real world scenes and virtual scenes rendered by a computer. The embodiment provides a method for manufacturing a full parallax holographic view fused with virtual and real scenes, which has high reconstruction quality and good display effect, and with reference to fig. 1, the method includes:
step 101: and carrying out full-view shooting on the real scene to obtain a plurality of view angle images.
This step is sampling the real scene. The method comprises the following steps: the method comprises the steps of shooting and sampling a real scene, shooting the scene in multiple angles by adopting a camera array or a motion camera, ensuring that each position of the scene can be displayed in a sampled image, and ensuring that the number of the sampled images is not clear, but generally, the more the number of the sampled images is, the denser the sampling angle is, the better the three-dimensional reconstruction effect is, and finally, a plurality of visual angle images with the full visual angle of the real scene need to be obtained.
Step 102: and reconstructing three-dimensional point cloud data of the real scene by adopting a plurality of the view angle images.
The step is to reconstruct the three-dimensional point cloud. The method specifically comprises the following steps:
and calculating the plurality of view angle graphs by adopting related software based on an SFM algorithm, such as a motion recovery Structure (SFM) algorithm or VisaulSFM and the like, so as to obtain the three-dimensional point cloud data of the real scene.
Step 103: and importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of the real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene in the three-dimensional modeling software to obtain a plurality of scene fusion images.
1) and (5) reconstructing a three-dimensional patch. The three-dimensional point cloud data is converted into patch data by adopting a Poisson surface reconstruction algorithm, and the method mainly aims at: the obtained three-dimensional model data (patch data) can be ensured to be correctly opened in the 3D modeling software.
2) And importing the patch data into the three-dimensional modeling software (such as 3D Studio Max) to construct a three-dimensional model of the real scene.
3) And acquiring a virtual scene, and manually adjusting the spatial position relationship between the three-dimensional model and the virtual scene to obtain a plurality of scene fusion images. The virtual scene may adopt an existing computer model, or may be directly drawn in software, that is, the virtual scene may be rendered in the three-dimensional modeling software or the drawn virtual scene may be introduced into the three-dimensional modeling software.
Step 104: and carrying out full parallax sampling and coding on the plurality of scene fusion images to obtain a plurality of exposure image arrays.
1) and according to the set holographic printing requirement, carrying out full parallax sampling on the scene fusion images by adopting a virtual camera carried by software to obtain a plurality of sampling image arrays.
2) The sampled image is usually not directly available for holographic volume view production and needs to be further efficiently encoded. Therefore, each of the sample image arrays is encoded by an infinite camera method, a perspective segmentation method, or an angle-of-view image segmentation and reconstruction method (EPISM), thereby obtaining a plurality of exposure image arrays.
Step 105: and controlling a printing mechanism to perform full parallax printing on the plurality of exposure image arrays to obtain a full parallax holographic view. Full parallax includes both horizontal and vertical parallax.
Wherein the printing mechanism is a full parallax printing optical path component; referring to fig. 2, the full parallax printing optical path assembly includes: a laser 1; the electronic shutter 2 and the polarization beam splitter prism 3 are sequentially arranged on an emergent light path of the laser 1; the first beam expander 4, the display screen 5, the scattering screen 6, the rectangular diaphragm 7 and the holographic plate 8 are sequentially arranged on a transmission light path of the polarization splitting prism 3; a reflecting mirror 9 disposed on a reflection optical path of the polarization splitting prism 3; a second beam expander 10 disposed on an exit optical path of the mirror 8; the rectangular diaphragm 7 is located on the emergent light path of the second beam expander 10.
loading the exposure image arrays into a printing mechanism one by one, and printing the exposure image arrays loaded into the printing mechanism one by one with full parallax to obtain a full parallax hologram view, which specifically comprises the following steps:
when an nth exposure image array is printed, the nth exposure image array is loaded on the display screen 5, the holographic plate 8 is controlled to move a set distance (the distance of one holographic unit), the electronic shutter 2 is controlled to be opened, the polarization beam splitter prism 3 divides laser emitted by the laser 1 into an object beam and a reference beam, the object beam sequentially passes through the first beam expander 4, the display screen 5 and the scattering screen 6 and then forms a scattered object beam on the rectangular diaphragm 7, the reference beam sequentially passes through the reflector 9 and the second beam expander 10 and then forms a post-expansion reference beam on the rectangular diaphragm 7, the scattered object beam and the post-expansion reference beam are subjected to interference exposure on the rectangular diaphragm 7, and an exposure image is presented on the holographic plate 8.
When all the exposure image arrays present exposure images on the holographic plate 8, developing, fixing and bleaching the holographic plate 8 to obtain a full parallax holographic view.
In the method for manufacturing the virtual-real scene fused full-parallax holographic view, three-dimensional point cloud data of a real scene is obtained through a multi-view-based three-dimensional reconstruction method; converting the three-dimensional point cloud data into other data formats which can be imported into 3D modeling software by using a Poisson surface reconstruction algorithm; importing a three-dimensional model of a real scene, drawing or merging the imported virtual scene, and manually adjusting the spatial position relation of the real scene and the virtual scene; the full-parallax holographic stereogram is sampled by using a virtual camera carried by software, then holographic printing is carried out, and the obtained full-parallax holographic stereogram can simultaneously display the information of virtual and real scenes, so that the visual enhancement of the real scenes is achieved, and the method has important significance in various fields such as cultural relic appreciation, commercial propaganda and the like.
The invention also provides a system for making a virtual-real scene fused full-parallax holographic view, referring to fig. 3, the system comprises: a processor 11 and a printing mechanism; the processor 11 is connected to the printing mechanism. The processor 11 may be a computer.
The processor 11 is internally provided with a virtual-real fusion program; the virtual-real fusion program comprises:
and the image acquisition module is used for carrying out full-view shooting on the real scene to obtain a plurality of view angle images.
And the three-dimensional point cloud computing module is used for reconstructing the three-dimensional point cloud data of the real scene by adopting a plurality of the view angle maps.
And the virtual-real scene fusion module is used for importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of the real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene in the three-dimensional modeling software to obtain a plurality of scene fusion images.
And the sampling and encoding module is used for carrying out full parallax sampling and encoding on the plurality of scene fusion images to obtain a plurality of exposure image arrays.
And the full-parallax printing module is used for controlling the printing mechanism to perform full-parallax printing on the plurality of exposure image arrays to obtain a full-parallax holographic view.
In an example, the virtual-real scene fusion module specifically includes:
and the data conversion unit is used for converting the three-dimensional point cloud data into patch data by adopting a Poisson surface reconstruction algorithm.
And the three-dimensional model building unit is used for importing the patch data into the three-dimensional modeling software to build a three-dimensional model of the real scene.
And the scene fusion unit is used for rendering a virtual scene in the three-dimensional modeling software or importing the rendered virtual scene into the three-dimensional modeling software, and adjusting the spatial position relationship between the three-dimensional model and the virtual scene to obtain a plurality of scene fusion images.
In an example, the sampling encoding module specifically includes:
and the full-parallax sampling unit is used for performing full-parallax sampling on the scene fusion images by adopting a virtual camera according to the set holographic printing requirement to obtain a plurality of sampling image arrays.
And the coding unit is used for coding each sampling image array by adopting an infinite camera method, a perspective segmentation method or a view angle image segmentation and recombination method to obtain a plurality of exposure image arrays.
In one example, the full parallax printing module specifically includes:
and the printing unit is used for loading the exposure image arrays into a printing mechanism one by one and printing the exposure image arrays loaded into the printing mechanism with full parallax one by one to obtain a full parallax hologram view.
In one example, the printing mechanism is a full parallax printing optical path component, the optical path diagram of which is shown in fig. 2. Referring to fig. 3, the processor 11 is connected to the electronic shutter 2, the display screen 5, and the hologram plate 8, respectively. The laser 1 is used as a light source, and light beams are divided into object beams and reference beams after passing through an electronic shutter 2 and a polarization beam splitter prism 3. The object light is modulated by the first beam expander 4, uniformly irradiates the display screen 5, is scattered by the scattering screen 6, and meets the reference light after beam expansion at the rectangular diaphragm 7 for interference exposure. The obtained exposure image arrays are loaded on the display screen 5 one by one, the holographic plate 8 is moved once when one image is exposed (after the previous image is exposed, the electronic shutter 2 is closed, the light path is cut off, the holographic plate 8 moves by the distance of one holographic unit, the image loaded on the display screen 5 jumps to the next exposure image, then the electronic shutter 2 is opened, and the light path exposes the holographic unit in the way of exposing the previous holographic unit, and so on). After exposure of the entire image, a holographic plate 8 with a rectangular array is obtained. The holographic plate 8 is developed, fixed and bleached to obtain a full parallax holographic view capable of three-dimensionally reproducing a virtual and real fusion scene.
The printing unit specifically comprises:
print subunit one by one for when printing nth exposure image array, load nth exposure image array on the display screen, control holographic board removes the set distance, control electronic shutter opens, polarization beam splitter prism will laser that the laser instrument sent is divided into object beam and reference beam, object beam passes through in proper order first beam expander the display screen with behind the scattering screen form the object beam after the scattering on the rectangular diaphragm, reference beam passes through in proper order the reflector with behind the second beam expander form the reference beam after the expansion on the rectangular diaphragm, the object beam after the scattering with the reference beam after the expansion is in interference exposure on the rectangular diaphragm, present the exposure image on the holographic board.
And the holographic plate processing subunit is used for developing, fixing and bleaching the holographic plate to obtain a full-parallax holographic view when all the exposure image arrays present exposure images on the holographic plate.
The system for manufacturing the virtual-real scene fused full-parallax holographic view carries out sampling coding on the images after the virtual-real scene fusion, can realize the relatively complex spatial position relation between the virtual scene and the real scene, does not need to accurately calculate a certain parameter, and the effect of the fusion coding and the display mainly depends on the quality of three-dimensional reconstruction.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the description of the method part.
The principles and embodiments of the present invention have been described herein using specific examples, which are provided only to help understand the method and the core concept of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the above, the present disclosure should not be construed as limiting the invention.
Claims (6)
1. A method for making a virtual and real scene fused full-parallax holographic view is characterized by comprising the following steps:
carrying out full-view shooting on a real scene to obtain a plurality of view angle images;
reconstructing three-dimensional point cloud data of the real scene by adopting the plurality of view angle images;
importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of the real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene in the three-dimensional modeling software to obtain a plurality of scene fusion images;
carrying out full parallax sampling and coding on the plurality of scene fusion images to obtain a plurality of exposure image arrays;
controlling a printing mechanism to perform full-parallax printing on the plurality of exposure image arrays to obtain a full-parallax holographic view;
importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of the real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene in the three-dimensional modeling software to obtain a plurality of scene fusion images, wherein the method specifically comprises the following steps:
converting the three-dimensional point cloud data into patch data by adopting a Poisson surface reconstruction algorithm;
importing the patch data into the three-dimensional modeling software to construct a three-dimensional model of the real scene;
rendering a virtual scene in the three-dimensional modeling software or importing the rendered virtual scene into the three-dimensional modeling software, and adjusting the spatial position relationship between the three-dimensional model and the virtual scene to obtain a plurality of scene fusion images;
the full parallax sampling and encoding of the multiple scene fusion images to obtain multiple exposure image arrays specifically includes:
carrying out full parallax sampling on a plurality of scene fusion images by adopting a virtual camera according to a set holographic printing requirement to obtain a plurality of sampling image arrays;
and coding each sampling image array by adopting an infinite camera method, a perspective segmentation method or a view image segmentation and recombination method to obtain a plurality of exposure image arrays.
2. The method for producing a full parallax holographic stereogram with a virtual-real scene fusion function according to claim 1, wherein the controlling the printing mechanism to print the full parallax of the plurality of exposure image arrays to obtain the full parallax holographic stereogram specifically comprises:
and loading the exposure image arrays into a printing mechanism one by one, and printing the exposure image arrays loaded into the printing mechanism one by one with full parallax to obtain a full parallax holographic view.
3. The method of claim 2, wherein the holographic view of full parallax comprises a holographic view of a virtual scene and a real scene,
the printing mechanism is a full parallax printing light path component; the full parallax printing light path component comprises: a laser; the electronic shutter and the polarization beam splitter prism are sequentially arranged on the emergent light path of the laser; the first beam expander, the display screen, the scattering screen, the rectangular diaphragm and the holographic plate are sequentially arranged on a transmission light path of the polarization beam splitter prism; the reflecting mirror is arranged on a reflecting light path of the polarization beam splitter prism; the second beam expander is arranged on an emergent light path of the reflector; the rectangular diaphragm is positioned on an emergent light path of the second beam expander;
the printing of the full parallax of the exposure image arrays loaded into the printing mechanism one by one to obtain a full parallax holographic stereogram specifically includes:
when an nth exposure image array is printed, loading the nth exposure image array on the display screen, controlling the holographic plate to move for a set distance, controlling the electronic shutter to open, dividing laser emitted by the laser into an object beam and a reference beam by the polarization beam splitter prism, forming a scattered object beam on the rectangular diaphragm after the object beam sequentially passes through the first beam expander, the display screen and the scattering screen, forming a expanded reference beam on the rectangular diaphragm after the reference beam sequentially passes through the reflector and the second beam expander, performing interference exposure on the scattered object beam and the expanded reference beam on the rectangular diaphragm, and presenting an exposure pattern on the holographic plate;
and when all the exposure image arrays show exposure images on the holographic plate, developing, fixing and bleaching the holographic plate to obtain a full-parallax holographic view.
4. A system for producing a full parallax holographic view of virtual and real scene fusion, comprising: a processor and a printing mechanism; the processor is connected with the printing mechanism;
a virtual-real fusion program is built in the processor; the virtual-real fusion program comprises:
the image acquisition module is used for carrying out full-view shooting on a real scene to obtain a plurality of view angle images;
the three-dimensional point cloud computing module is used for reconstructing three-dimensional point cloud data of the real scene by adopting the plurality of view angle diagrams;
the virtual-real scene fusion module is used for importing the three-dimensional point cloud data into three-dimensional modeling software to construct a three-dimensional model of the real scene, and adjusting the spatial position relationship between the three-dimensional model and a virtual scene in the three-dimensional modeling software to obtain a plurality of scene fusion images;
the sampling and coding module is used for carrying out full parallax sampling and coding on the plurality of scene fusion images to obtain a plurality of exposure image arrays;
the full-parallax printing module is used for controlling the printing mechanism to perform full-parallax printing on the exposure image arrays to obtain a full-parallax holographic view;
the virtual and real scene fusion module specifically comprises:
the data conversion unit is used for converting the three-dimensional point cloud data into patch data by adopting a Poisson surface reconstruction algorithm;
the three-dimensional model building unit is used for importing the patch data into the three-dimensional modeling software to build a three-dimensional model of the real scene;
the scene fusion unit is used for rendering a virtual scene in the three-dimensional modeling software or importing the rendered virtual scene into the three-dimensional modeling software, and adjusting the spatial position relationship between the three-dimensional model and the virtual scene to obtain a plurality of scene fusion images;
the sampling coding module specifically includes:
the full-parallax sampling unit is used for performing full-parallax sampling on the scene fusion images by adopting a virtual camera according to the set holographic printing requirement to obtain a plurality of sampling image arrays;
and the coding unit is used for coding each sampling image array by adopting an infinite camera method, a perspective segmentation method or a view image segmentation and recombination method to obtain a plurality of exposure image arrays.
5. The system for producing full parallax holographic view of virtual and real scene fusion according to claim 4, wherein the full parallax printing module specifically comprises:
and the printing unit is used for loading the exposure image arrays into a printing mechanism one by one and printing the exposure image arrays loaded into the printing mechanism one by one in a full parallax way to obtain a full parallax holographic view.
6. The system of claim 5, wherein the holographic stereogram system comprises a holographic optical system,
the printing mechanism is a full parallax printing light path component; the full parallax printing light path component comprises: a laser; the electronic shutter and the polarization beam splitter prism are sequentially arranged on the emergent light path of the laser; the first beam expander, the display screen, the scattering screen, the rectangular diaphragm and the holographic plate are sequentially arranged on a transmission light path of the polarization beam splitter prism; the reflecting mirror is arranged on a reflecting light path of the polarization splitting prism; the second beam expander is arranged on an emergent light path of the reflector; the rectangular diaphragm is positioned on an emergent light path of the second beam expander;
the printing unit specifically comprises:
the one-by-one printing subunit is used for loading the nth exposure image array onto the display screen when the nth exposure image array is printed, controlling the holographic plate to move for a set distance, controlling the electronic shutter to be opened, dividing laser emitted by the laser into an object beam and a reference beam by the polarization beam splitter prism, forming a scattered object beam on the rectangular diaphragm after the object beam sequentially passes through the first beam expander, the display screen and the scattering screen, forming a post-expansion reference beam on the rectangular diaphragm after the reference beam sequentially passes through the reflector and the second beam expander, and exposing the scattered object beam and the post-expansion reference beam on the rectangular diaphragm in an interference manner, wherein the exposure image is presented on the holographic plate;
and the holographic plate processing subunit is used for developing, fixing and bleaching the holographic plate to obtain a full-parallax holographic view when all the exposure image arrays present exposure images on the holographic plate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110958979.3A CN113671813B (en) | 2021-08-20 | 2021-08-20 | Virtual and real scene fused full-parallax holographic volume view manufacturing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110958979.3A CN113671813B (en) | 2021-08-20 | 2021-08-20 | Virtual and real scene fused full-parallax holographic volume view manufacturing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113671813A CN113671813A (en) | 2021-11-19 |
| CN113671813B true CN113671813B (en) | 2022-09-13 |
Family
ID=78544361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110958979.3A Active CN113671813B (en) | 2021-08-20 | 2021-08-20 | Virtual and real scene fused full-parallax holographic volume view manufacturing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113671813B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115202174B (en) * | 2022-07-14 | 2023-11-10 | 浙江理工大学 | Holographic view acquisition method, system and application based on light field image |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102866616A (en) * | 2012-07-03 | 2013-01-09 | 上海大学 | Full-parallax error hologram rapid calculating and manufacturing device and method |
| CN103425035A (en) * | 2013-07-10 | 2013-12-04 | 中国人民解放军装甲兵工程学院 | Printing system of holographic stereogram and with abnormal-shaped mask plate |
| CN103955127A (en) * | 2014-04-17 | 2014-07-30 | 中国人民解放军装甲兵工程学院 | Phase modulation full-parallax holographic stereogram implementation method |
| CN105700320A (en) * | 2016-04-13 | 2016-06-22 | 苏州大学 | Holographic three-dimensional display method and device based on spatial light modulator |
| CN106647211A (en) * | 2017-01-19 | 2017-05-10 | 中国人民解放军装甲兵工程学院 | Visual angle picture segmentation and recombination printing method of synthesized holographic stereogram |
| WO2018058601A1 (en) * | 2016-09-30 | 2018-04-05 | 深圳达闼科技控股有限公司 | Method and system for fusing virtuality and reality, and virtual reality device |
| CN108732902A (en) * | 2017-04-17 | 2018-11-02 | 天津工业大学 | A kind of adjustable amplitude type hologram type method for rebuilding three-dimensional scenic lengthwise position |
| CN109884868A (en) * | 2019-01-18 | 2019-06-14 | 中国人民解放军陆军装甲兵学院 | A kind of Method of printing and system of full parallax holographic stereogram |
| CN113066191A (en) * | 2021-04-10 | 2021-07-02 | 中国人民解放军陆军装甲兵学院 | Virtual and real fusion method and system of holographic volume view parallax image based on depth map |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106251403B (en) * | 2016-06-12 | 2018-02-16 | 深圳超多维光电子有限公司 | A kind of methods, devices and systems of virtual three-dimensional Scene realization |
| US11087549B2 (en) * | 2018-10-15 | 2021-08-10 | University Of Maryland, College Park | Methods and apparatuses for dynamic navigable 360 degree environments |
-
2021
- 2021-08-20 CN CN202110958979.3A patent/CN113671813B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102866616A (en) * | 2012-07-03 | 2013-01-09 | 上海大学 | Full-parallax error hologram rapid calculating and manufacturing device and method |
| CN103425035A (en) * | 2013-07-10 | 2013-12-04 | 中国人民解放军装甲兵工程学院 | Printing system of holographic stereogram and with abnormal-shaped mask plate |
| CN103955127A (en) * | 2014-04-17 | 2014-07-30 | 中国人民解放军装甲兵工程学院 | Phase modulation full-parallax holographic stereogram implementation method |
| CN105700320A (en) * | 2016-04-13 | 2016-06-22 | 苏州大学 | Holographic three-dimensional display method and device based on spatial light modulator |
| WO2018058601A1 (en) * | 2016-09-30 | 2018-04-05 | 深圳达闼科技控股有限公司 | Method and system for fusing virtuality and reality, and virtual reality device |
| CN106647211A (en) * | 2017-01-19 | 2017-05-10 | 中国人民解放军装甲兵工程学院 | Visual angle picture segmentation and recombination printing method of synthesized holographic stereogram |
| CN108732902A (en) * | 2017-04-17 | 2018-11-02 | 天津工业大学 | A kind of adjustable amplitude type hologram type method for rebuilding three-dimensional scenic lengthwise position |
| CN109884868A (en) * | 2019-01-18 | 2019-06-14 | 中国人民解放军陆军装甲兵学院 | A kind of Method of printing and system of full parallax holographic stereogram |
| CN113066191A (en) * | 2021-04-10 | 2021-07-02 | 中国人民解放军陆军装甲兵学院 | Virtual and real fusion method and system of holographic volume view parallax image based on depth map |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113671813A (en) | 2021-11-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP0407497B1 (en) | Computer aided holography and holographic computer graphics | |
| US5194971A (en) | Computer aided holography and holographic computer graphics | |
| US20210389724A1 (en) | Holographic display system | |
| US20110249087A1 (en) | Multiple view display of three-dimensional images | |
| CN110069006B (en) | Holographic volume view synthesis parallax image generation method and system | |
| CN106707680B (en) | A kind of holographic projection methods based on light field | |
| Underkoffler | Occlusion processing and smooth surface shading for fully computed synthetic holography | |
| CN107390379A (en) | A kind of nearly eye hologram three-dimensional display system and display methods | |
| CN113671813B (en) | Virtual and real scene fused full-parallax holographic volume view manufacturing method and system | |
| US6757086B1 (en) | Hologram forming apparatus and method, and hologram | |
| KR100852009B1 (en) | Holographic stereogram printing apparatus and a method therefor | |
| Matsushima et al. | Computer holography: 3D digital art based on high-definition CGH | |
| Sánchez et al. | Design, development, and implementation of a low-cost full-parallax holoprinter | |
| CN110874047A (en) | Method and device for holographing image under endoscope | |
| JP2018180261A (en) | Hologram generating device, hologram generating program and holographic projection system | |
| Jepsen | Holographic video: design and implementation of a display system | |
| Khuderchuluun et al. | Simplified content generation for holographic printer using computer-generated integral imaging | |
| JP2012008207A (en) | Method for calculating computer-synthesized hologram of three-dimensional moving image using lookup table and temporal overlapping of image, and apparatus thereof | |
| JPH06266274A (en) | Formation of holographic stereoscopic hard copy and device | |
| Zhou | Accurate depth based post-processing for perception enhancement in real time three-dimensional graphics | |
| KR102654323B1 (en) | Apparatus, method adn system for three-dimensionally processing two dimension image in virtual production | |
| Klug | Display applications of large-scale digital holography | |
| Li et al. | Research on Hologram Based on Holographic Projection Technology | |
| Choi et al. | Computer Science Department | |
| CN116091683A (en) | Method, system and storage medium for displaying virtual image based on virtual-real combination technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |