CN108537835A - Hologram image generation, display methods and equipment - Google Patents
Hologram image generation, display methods and equipment Download PDFInfo
- Publication number
- CN108537835A CN108537835A CN201810270429.0A CN201810270429A CN108537835A CN 108537835 A CN108537835 A CN 108537835A CN 201810270429 A CN201810270429 A CN 201810270429A CN 108537835 A CN108537835 A CN 108537835A
- Authority
- CN
- China
- Prior art keywords
- image
- hologram
- data
- image data
- rendering
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/50—Lighting effects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
Abstract
The invention discloses a kind of hologram image generation methods, include the following steps：（1）Depth image data is obtained according to original image；（2）Obtain simulation light field data：Ligh field model is established according to the depth image data, the ligh field model includes an at least display surface, 3D rendering in front of display surface and the correspondence viewing surface in front of the 3D rendering, in the viewing surface, at least two virtual views are set, it is illumination starting point with display surface, establish several ray models projected from display surface by each pixel of the 3D rendering to each virtual view, the vector of the ray across the pixel is determined according to the luminous intensity of corresponding pixel points, to obtain the angle for including several rays, the simulation light field data of position and length data；（3）Holographic image data is generated according to simulation light field data.The invention enables ligh field models as a kind of generic structure, generates holographic image data, to be provided great flexibility when design 3D display.
Description
Technical field
The present invention relates to the generation of holophotal system more particularly to hologram image, display methods and equipment.
Background technology
Known image hologram display device is produced to correct anaglyph using image-watching person binocular vision
Raw holographic sense.Glasses system and bore hole system can be simply divided into from the mode of appearance of display device, glasses system is will to regard
Difference image is directly inputted to right and left eyes, and bore hole system is then the holographic display that do not observed by glasses.
Glasses holophotal system is to use separate type（It is active and passive）Mode, make binocular vision to correct left and right view,
The problem of being arranged there is no hologram image.And in the image hologram display device of bore hole system, except holographic projector, other
Can all it be attributed to " free image hologram display device ", principle is then to be obtained specific permutation algorithm by optical fractionation unit
The two dimensional image gone out is shielded or is reflected, and then allows viewer it can be seen that accurate anaglyph, to generate holography
Sense.
The free holographic display device of bore hole based on Binocular Vision Principle is mainly raster type free 3 holographic display device.Its work
Principle is to install holographic grating additional on the 2 d display, and holographic grating is broadly divided into two classes：Column mirror grating and slit grating.By complete
Grating is ceased, the right and left eyes for the viewer that the N viewpoint holography views being displayed on display sub-pixel accurately project are complete to realize
Cease the accurate display of image.In addition, also a kind of free holographic technique of new bore hole, the backlight of display screen and suitable is utilized
Light splitting technology realizes horizontal and vertical two-way holography, enable a viewer to the different angle in display screen it can be seen that
Correct holographic effect, the one direction holographic effect for the free holographic display screen of original grating that extended.
Qingdao Hisense Electric Appliance Co., Ltd proposes a kind of signal processing method and device（CN103167305A,
A kind of signal processing method and device）In, it is proposed that from 2D picture signals to the processing method of N viewpoint view sequence images：Root
Benchmark image information and N viewpoint view sequence depth informations are obtained according to the original image information, is extracting the reference map
As information and after generating the N viewpoints view sequence depth information, it can be regarded according to the benchmark image information and the N viewpoints
Graphic sequence depth information synthesizes the 3D subgraphs of each viewpoint in N viewpoints, it is hereby achieved that N viewpoint view sequences.The above method is only
It can be used for the holographic display of scheduled several viewpoints, there is significant limitation when designing 3D display.
Therefore it is badly in need of a kind of hologram image generation, display methods and device to solve the above problems.
Invention content
The object of the present invention is to provide method and equipment, the computer-readable storages of a kind of generation of hologram image and display
Medium is used as the framework of image procossing by ligh field model, to be provided great flexibility when design 3D display, in combination with complete
It ceases display screen and realizes that multiple views Three-dimensional Display, even full viewpoint holography are shown.
Upper purposeful in order to realize, the invention discloses a kind of hologram image generation methods, include the following steps：（1）According to
Depth image data is obtained according to original image；（2）Obtain simulation light field data：Light field mould is established according to the depth image data
Type, the ligh field model include an at least display surface, the 3D rendering in front of display surface and in front of the 3D rendering
Corresponding viewing surface is arranged at least two virtual views in the viewing surface, is illumination starting point with display surface, establishes from display surface
Project several ray models to each virtual view by each pixel of the 3D rendering, the light according to corresponding pixel points
Intensity determines the vector of the ray across the pixel, to obtain the angle comprising several rays, position and length data
Simulate light field data；（3）Holographic image data is generated according to simulation light field data.
Compared with prior art, the present invention simulates 3D rendering by ligh field model and obtains simulation light field data, is passing
On the three-dimensional basis for solving a calculating space structure of system, it is added to the solution procedure of x-ray angle and vector, to simulate
The true light field of 3D scenes, and another parameter of the luminous intensity as 3D rendering is extracted, it is used for the display of 3D rendering.Make light field mould
Type is as a kind of framework more general than multiple views model, to be provided great flexibility when design 3D display.Pass through light field
Light can be designed to converge to several points of observation, to realize multiple views Three-dimensional Display, light can also be arranged by model
For all angular distributions, to realize that full viewpoint holography is shown.
Wherein, in the ligh field model, can have there are one display surface, it is possible to have multiple display surfaces, such as can be with
There are two tools, three, four, eight intersection display surfaces, this be even up to 256 display surfaces, corresponding viewing surface for institute
State the parallel plane of display surface, or there is certain angle with the display surface（On-right angle）And opposite face so that user
Hologram image can be watched from a direction or multiple directions..
Preferably, the 3D rendering has M pixel, L virtual view is set in the viewing surface, determines M respectively
The three-dimensional coordinate of a pixel（x,y,z）, respectively determine each pixel to L virtual view polar coordinates (θ), to obtain
Five dimension plenoptic function I (x, y, z, θ) of M*L light are obtained, wherein the vector size of five dimension plenoptic function I (x, y, z, θ)
It is corresponding with the luminous intensity of corresponding pixel points, to obtain the light field simulation data of 3D rendering.It is only calculated in traditional three-dimensional solve
On the basis of space structure, it is added to the solution procedure of deflection (θ) vector, to simulate the true light field of 3D scenes,
And luminous intensity is extracted, as another parameter of 3D rendering, it is used for the display of 3D rendering.
Preferably, the step（2）In, a display surface is divided into several virtual views.The program to use
Hologram image is watched in family from anywhere in can be in the display surface region, and can meet the needs of more people while viewing.
Preferably, when the original image is 2D original images, the step（1）Including：Empirically to 2D originals
Beginning image carries out space according to depth and divides to generate spatial relationship reference chart, according to the spatial relationship reference chart to the 2D
Original image is layered to be converted to depth image data.Compared to traditional depth solving algorithm, this patent is in 2D figures
Spatial relationship reference chart is used in solution procedure to help to obtain more accurate spatial relationship, this spatial relationship reference chart is
The result that server end is continued to optimize by the method for machine learning.Compared to traditional manual type, solution procedure is more
Rapidly；In terms of automatic calculation, also greatly promoted than other methods in the accuracy and precision in space.
Preferably, when the original image is 3D original images, the step（1）Including：Not according to 3D original images
The 3D original images are layered according to depth with visual angle figure.
Preferably, the step（1）Further include being optimized to the original image after layering to obtain depth image number
According to.
More preferably, the original image after layering is optimized specifically include to after layering original image carry out filling-up hole,
Space excessively optimizes, errors repair and/or details reparation are to obtain depth image data.
The invention also discloses a kind of hologram image display methods, including：It is generated according to above-mentioned hologram image generation method
Holographic image data；Holographic row is carried out according to the steric parameter of hologram screen and the holographic image data to scheme and show.
The invention also discloses a kind of electronic equipment, including：One or more processors；Memory；And one or more
A program wherein one or more of programs are stored in the memory, and is configured to by one or more
It manages device to execute, described program includes the instruction for executing above-mentioned hologram image generation method.
The invention also discloses a kind of electronic equipment, including：Hologram screen known to steric parameter；One or more processing
Device；Memory；And one or more programs, wherein one or more of programs are stored in the memory, and
It is configured to be executed by one or more processors, described program includes for executing hologram image display methods described above
Instruction.
Include being combined to make with the electronic equipment with memory the invention also discloses a kind of computer readable storage medium
Computer program, the computer program can be executed by processor to execute the instruction of above-mentioned hologram image generation method.
Include being combined to make with the electronic equipment with memory the invention also discloses a kind of computer readable storage medium
Computer program, the computer program can be executed by processor to execute the instruction of above-mentioned hologram image display methods.
Description of the drawings
Fig. 1 is the flow chart of hologram image generation method of the present invention.
Fig. 2 is the schematic diagram of ligh field model of the present invention.
Fig. 3 is the flow chart that advanced treating is carried out to 2D images.
Fig. 4 is the flow chart that advanced treating is carried out to 3D rendering.
Fig. 5 is the flow chart of hologram image display methods of the present invention.
Specific implementation mode
In order to describe the technical content, the structural feature, the achieved object and the effect of this invention in detail, below in conjunction with embodiment
And attached drawing is coordinated to be explained in detail.
With reference to figure 1, the invention discloses a kind of hologram image generation methods 100, include the following steps：（11）According to original
Image obtains depth image data；（12）Obtain simulation light field data：Ligh field model is established according to the depth image data（Such as
Shown in Fig. 2）, the ligh field model include an at least display surface, the 3D rendering in front of display surface and be located at the 3D rendering
The correspondence viewing surface in front, the viewing surface be arranged at least two virtual views, with display surface be illumination starting point, establish from
Display surface projects several ray models to each virtual view by each pixel of the 3D rendering, according to respective pixel
The luminous intensity of point determines the vector of the ray across the pixel, to obtain the angle, position and the length that include several rays
The simulation light field data of data；（13）Holographic image data is generated according to simulation light field data.Wherein, which can be
2D images may be 3D rendering.
Wherein, in the ligh field model, can have there are one display surface, it is possible to have multiple display surfaces, such as can be with
There are two tools, three, four even eight display surfaces intersected, and corresponding viewing surface is the face parallel with the display surface,
Can be that there is certain angle with the display surface（On-right angle）And opposite face so that user can be from a direction or multiple
Hologram image is watched in direction.
Preferably, with reference to figure 2, the ligh field model includes a display plane A, the 3D figures in front of display plane A
L virtual view, the 3D figures is arranged in the viewing plane B in picture and the correspondence viewing plane B in front of the 3D rendering
It is illumination starting point with display plane A as having M pixel, foundation is projected empty by pixel D to one from display plane A
The ray of quasi- viewpoint Q, establishes each pixel penetrating to each virtual view from display plane A approach 3D renderings successively
Line, to obtain the ray model model of M*L ray, the luminous intensity according to corresponding pixel points is determined across several ray models
Vector simulate light field data to obtain five dimension plenoptic function I (x, y, z, θ) of M*L light,（x,y,z）For picture
The three-dimensional coordinate of vegetarian refreshments, (θ) are polar coordinates of the pixel to virtual view.Certainly, the display plane may be curved surface,
It may be face corresponding with hologram screen.Viewing plane can be plane, or curved surface.
Better, in the present embodiment, a display surface is divided into several virtual views, specifically, described in one
Display surface is equally spacedly divided into several virtual views, and in the program, several virtual views are continuous virtual view, example
If display surface can be with 256 rows, 256 row, the altogether display surface of 256*256 virtual view so that user can show at this
The needs of watching hologram image from anywhere in showing in the region of face, and can meeting more people while watch.
With reference to figure 3, when the original image is 2D original images, the step（11）Including：Empirically to the 2D
Original image carries out space according to depth and divides to generate spatial relationship reference chart, according to the spatial relationship reference chart to described
2D original images are layered to obtain rough depth map picture, optimize rough depth map picture to obtain depth image.Its
In, spatial relationship reference chart is that the image space rule of thumb carried out divides（It is determined with the stroke of the different depths each in image
The depth in space）, rough depth map seems to do a judgement in the continuity of color space according to the pixel where stroke, into
And whole image is carried out to the division on level.And it is the image optimization for carrying machine-learning process by one to optimize（Mainly
Be filling-up hole, space excessively optimize, errors repair, the operations such as details reparation）Later, one can be obtained and more meets original image space
Structure（Mistake is few, details is more）Depth image.
With reference to figure 4, when the original image is 3D original images, the step（1）Including：Not according to 3D original images
The 3D original images are layered with visual angle figure to obtain rough depth map picture according to depth, rough depth map picture is carried out
Optimization is to obtain depth image.Wherein, the original image specifically included to after layering is optimized to the original image after layering
Progress filling-up hole, space excessively optimizes, errors repair and/or details reparation are to obtain depth image data.
With reference to figure 5, the invention also discloses a kind of hologram image display methods 200, including：（11）It is obtained according to original image
Take depth image data；（12）Obtain simulation light field data：Ligh field model is established according to the depth image data（Such as Fig. 2 institutes
Show）, the ligh field model includes an at least display surface, the 3D rendering in front of display surface and in front of the 3D rendering
Corresponding viewing surface is arranged at least two virtual views in the viewing surface, is illumination starting point with display surface, establishes from display surface
Project several ray models to each virtual view by each pixel of the 3D rendering, the light according to corresponding pixel points
Intensity determines the vector of the ray across the pixel, to obtain the angle comprising several rays, position and length data
Simulate light field data；（13）Holographic image data is generated according to simulation light field data；（21）Steric parameter according to hologram screen
Holographic row's figure is carried out with the holographic image data；（22）Push to the hologram image number after the holographic row's figure of hologram screen display
According to.
The invention also discloses a kind of electronic equipment, including：One or more processors；Memory；And one or more
A program wherein one or more of programs are stored in the memory, and is configured to by one or more
It manages device to execute, described program includes the instruction for executing above-mentioned hologram image generation method.
The invention also discloses a kind of electronic equipment, including：Hologram screen known to steric parameter；One or more processing
Device；Memory；And one or more programs, wherein one or more of programs are stored in the memory, and
It is configured to be executed by one or more processors, described program includes for executing hologram image display methods described above
Instruction.
Include being combined to make with the electronic equipment with memory the invention also discloses a kind of computer readable storage medium
Computer program, the computer program can be executed by processor to execute the instruction of above-mentioned hologram image generation method.
Include being combined to make with the electronic equipment with memory the invention also discloses a kind of computer readable storage medium
Computer program, the computer program can be executed by processor to execute the instruction of above-mentioned hologram image display methods.
It is above disclosed to be merely a preferred embodiment of the present invention, the right of the present invention cannot be limited with this certainly
Range, therefore according to equivalent variations made by scope of the present invention patent, be still within the scope of the present invention.
Claims (10)
1. a kind of hologram image generation method, it is characterised in that：Include the following steps：
（1）Depth image data is obtained according to original image；
（2）Obtain simulation light field data：Ligh field model is established according to the depth image data, the ligh field model includes at least
One display surface, the 3D rendering in front of display surface and the correspondence viewing surface in front of the 3D rendering, in the viewing surface
At least two virtual views are set, are illumination starting point with display surface, are established each by the 3D rendering from display surface injection
Pixel is to several ray models of each virtual view, and the luminous intensity determination according to corresponding pixel points is across the pixel
The vector of ray, to obtain the simulation light field data of the angle comprising several rays, position and length data；
（3）Holographic image data is generated according to simulation light field data.
2. hologram image generation method as described in claim 1, it is characterised in that：The 3D rendering has M pixel,
L virtual view is arranged in the viewing surface, determines the three-dimensional coordinate of M pixel respectively（x,y,z）, each pixel is determined respectively
For point to the polar coordinates (θ) of L virtual view, five to obtain M*L light tie up plenoptic function I (x, y, z, θ), wherein
The vector size of five dimension plenoptic function I (x, y, z, θ) is corresponding with the luminous intensity of corresponding pixel points, to obtain the light of 3D rendering
Field stimulation data.
3. hologram image generation method as described in claim 1, it is characterised in that：The step（2）In, by a display
Face is divided into several virtual views.
4. hologram image generation method as described in claim 1, it is characterised in that：The original image is 2D original images
When, the step（1）Including：Empirically space is carried out according to depth to the 2D original images to divide to generate spatial relationship
Reference chart is layered the 2D original images according to the spatial relationship reference chart and is converted to depth image data；Institute
State original image be 3D original images when, the step（1）Including：According to the different visual angles figure of 3D original images to 3D originals
Beginning image is layered according to depth and is converted to depth image data.
5. hologram image generation method as described in claim 1, it is characterised in that：The step（1）Further include, after layering
Original image optimize to obtain depth image data.
6. a kind of hologram image display methods, it is characterised in that：Including：According to the hologram image life as described in claim 1-5
At method, holographic image data is generated；Holographic row's figure is carried out according to the steric parameter of hologram screen and the holographic image data
And it shows.
7. a kind of electronic equipment, including：
One or more processors；
Memory；And
One or more programs, wherein one or more of programs are stored in the memory, and be configured to by
One or more processors execute, and described program includes for executing the hologram image as described in any one of claim 1-5
The instruction of generation method.
8. a kind of electronic equipment, including：
Hologram screen known to steric parameter；
One or more processors；
Memory；And
One or more programs, wherein one or more of programs are stored in the memory, and be configured to by
One or more processors execute, and described program includes aobvious for executing hologram image as described in any of claims 6
Show the instruction of method.
9. a kind of computer readable storage medium includes the computer program being used in combination with the electronic equipment with memory,
It is characterized in that：The computer program can be executed by processor to execute the holography as described in any one of claim 1-5
The instruction of image generating method.
10. a kind of computer readable storage medium includes the computer program being used in combination with the electronic equipment with memory,
It is characterized in that：The computer program can be executed by processor to execute hologram as described in any of claims 6
As the instruction of display methods.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810270429.0A CN108537835A (en) | 2018-03-29 | 2018-03-29 | Hologram image generation, display methods and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810270429.0A CN108537835A (en) | 2018-03-29 | 2018-03-29 | Hologram image generation, display methods and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108537835A true CN108537835A (en) | 2018-09-14 |
Family
ID=63482363
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810270429.0A Pending CN108537835A (en) | 2018-03-29 | 2018-03-29 | Hologram image generation, display methods and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108537835A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102592275A (en) * | 2011-12-16 | 2012-07-18 | 天津大学 | Virtual viewpoint rendering method |
| CN104104936A (en) * | 2013-04-05 | 2014-10-15 | 三星电子株式会社 | Apparatus and method for forming light field image |
| CN104349073A (en) * | 2014-11-12 | 2015-02-11 | 清华大学深圳研究生院 | Light field compilation transmission method and device |
| CN104820981A (en) * | 2015-04-22 | 2015-08-05 | 上海交通大学 | Image three-dimensional representation method based on parallax hierarchical segmentation, and system |
| CN106898039A (en) * | 2017-02-23 | 2017-06-27 | 京东方科技集团股份有限公司 | Method and system for generating computed hologram |
| CN206532100U (en) * | 2017-01-17 | 2017-09-29 | 北京铅笔视界科技有限公司 | Nearly eye holographic display system |
-
2018
- 2018-03-29 CN CN201810270429.0A patent/CN108537835A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102592275A (en) * | 2011-12-16 | 2012-07-18 | 天津大学 | Virtual viewpoint rendering method |
| CN104104936A (en) * | 2013-04-05 | 2014-10-15 | 三星电子株式会社 | Apparatus and method for forming light field image |
| CN104349073A (en) * | 2014-11-12 | 2015-02-11 | 清华大学深圳研究生院 | Light field compilation transmission method and device |
| CN104820981A (en) * | 2015-04-22 | 2015-08-05 | 上海交通大学 | Image three-dimensional representation method based on parallax hierarchical segmentation, and system |
| CN206532100U (en) * | 2017-01-17 | 2017-09-29 | 北京铅笔视界科技有限公司 | Nearly eye holographic display system |
| CN106898039A (en) * | 2017-02-23 | 2017-06-27 | 京东方科技集团股份有限公司 | Method and system for generating computed hologram |
Non-Patent Citations (3)
| Title |
|---|
| CHAZHANG等: "A survey on image-based rendering—representation, sampling and compression", 《IMAGE COMMUNICATION》 * |
| 姚玉杰等: "《3D影视概论》", 31 August 2016 * |
| 张蔷: "多视点立体图像虚拟视点生成算法研究与实现", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10096157B2 (en) | Generation of three-dimensional imagery from a two-dimensional image using a depth map | |
| US9288476B2 (en) | System and method for real-time depth modification of stereo images of a virtual reality environment | |
| JP4764305B2 (en) | Stereoscopic image generating apparatus, method and program | |
| US7796134B2 (en) | Multi-plane horizontal perspective display | |
| US10739936B2 (en) | Zero parallax drawing within a three dimensional display | |
| CN108513123B (en) | Image array generation method for integrated imaging light field display | |
| CN103337095B (en) | The tridimensional virtual display methods of the three-dimensional geographical entity of a kind of real space | |
| US9460555B2 (en) | System and method for three-dimensional visualization of geographical data | |
| US20050219695A1 (en) | Horizontal perspective display | |
| KR20080065889A (en) | Apparatus and method for generating a stereoscopic image from a two-dimensional image using the mesh map | |
| CN104702936A (en) | Virtual reality interaction method based on glasses-free 3D display | |
| CN106412556B (en) | A kind of image generating method and device | |
| US20060221071A1 (en) | Horizontal perspective display | |
| US20060250390A1 (en) | Horizontal perspective display | |
| JP2006163547A (en) | Program, system and apparatus for solid image generation | |
| US20210327121A1 (en) | Display based mixed-reality device | |
| CN108495117A (en) | Hologram image various visual angles processing conversion, display methods and equipment | |
| CN108537835A (en) | Hologram image generation, display methods and equipment | |
| JPH03296176A (en) | High-speed picture generating/displaying method | |
| Songnian et al. | The representation of visual depth perception based on the plenoptic function in the retina and its neural computation in visual cortex V1 | |
| CN108847109A (en) | A kind of human body acupoint selection practice wire examination method and system based on three-dimensional modeling | |
| Thatte et al. | Real-World Virtual Reality With Head-Motion Parallax | |
| WO2024095358A1 (en) | Image display system and display device | |
| WO2017031117A1 (en) | System and method for real-time depth modification of stereo images of a virtual reality environment | |
| Szabó et al. | Processing 3D scanner data for virtual reality |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180914 |
|
| RJ01 | Rejection of invention patent application after publication |