KR101090787B1  Apparatus and Method for Processing by Using Depth Transformation  Google Patents
Apparatus and Method for Processing by Using Depth Transformation Download PDFInfo
 Publication number
 KR101090787B1 KR101090787B1 KR1020100047542A KR20100047542A KR101090787B1 KR 101090787 B1 KR101090787 B1 KR 101090787B1 KR 1020100047542 A KR1020100047542 A KR 1020100047542A KR 20100047542 A KR20100047542 A KR 20100047542A KR 101090787 B1 KR101090787 B1 KR 101090787B1
 Authority
 KR
 South Korea
 Prior art keywords
 depth
 depth data
 data
 information
 input
 Prior art date
Links
 230000001131 transforming Effects 0.000 title claims abstract description 29
 238000003672 processing method Methods 0.000 claims abstract description 8
 230000000873 masking Effects 0.000 claims description 14
 238000006243 chemical reactions Methods 0.000 claims description 5
 238000010586 diagrams Methods 0.000 description 9
 238000000034 methods Methods 0.000 description 6
 238000001093 holography Methods 0.000 description 5
 230000000694 effects Effects 0.000 description 2
 239000000284 extracts Substances 0.000 description 2
 230000003760 hair shine Effects 0.000 description 2
 230000000007 visual effect Effects 0.000 description 2
 280000024908 Next Generation companies 0.000 description 1
 238000007796 conventional methods Methods 0.000 description 1
 230000000875 corresponding Effects 0.000 description 1
 239000010408 films Substances 0.000 description 1
 238000003384 imaging method Methods 0.000 description 1
 230000004048 modification Effects 0.000 description 1
 238000006011 modification reactions Methods 0.000 description 1
Images
Classifications

 G—PHYSICS
 G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
 G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
 G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
 G03H1/04—Processes or apparatus for producing holograms
 G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
 G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
Abstract
Description
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a hologram processing method, and more particularly, to an apparatus and method for hologram processing using depth map transformation for processing input depth data by depth map transformation to generate enhanced hologram data.
Threedimensional image and video playback technologies are actively being researched, and nextgeneration displays are expected to be developed as new immersive visual media that raises the level of visual information.
Threedimensional image reproduction technologies include stereoscopy, holography, and intergral imaging.
Among these, the holography method is a method in which a viewer observes a virtual image of a virtual image while looking at the holography at a certain distance from the front of the holography when the light source is illuminated on the holography.
The principle of the hologram is to divide the beam from the laser into two, so that one ray is directly on the screen and the other is on the target.
In this case, a light beam that directly shines on the screen is called a reference wave, and a light beam that shines on an object is called an object wave.
The object wave is the light reflected from each surface of the object, so the phase difference is different depending on the distance from the object surface to the screen.
At this time, the interference pattern generated by the unmodified reference wave interferes with the object wave and is stored on the screen. Films in which such interference fringes are stored are called holograms.
The hologram processing receives the depth data, generates a hologram pattern, and outputs the hologram data using the hologram reconstruction tool hologram.
Recognition of hologram data is based on attributes of depth data input to hologram processing.
However, until now, in order to improve the recognition of the hologram data, the research has focused on the method of outputting the hologram data by hologram processing the depth data rather than focusing on the attributes of the input depth data.
That is, there is no conventional method for outputting enhanced hologram data by processing an attribute of input depth data.
In order to solve such a problem, an object of the present invention is to provide a hologram processing apparatus and method using a depth map transform to process the input depth data by the depth map transform to generate improved hologram data.
According to an aspect of the present invention, there is provided a hologram processing apparatus including an unsharp masking processor configured to calculate a high frequency component of an input data by changing a depth of a discontinuous pixel according to a boundary change of an input depth data. ; Depth change information is generated by calculating an absolute value of the high frequency component, and includes average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information. An average envelope processing unit for calculating; A depth map converter for calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component based on the average envelope information; A final depth data calculator configured to calculate final depth data by adding the input depth data and the depth map transformation information; And a CGH generator configured to generate computer generated hologram (CGH) output data using the final depth data.
According to an aspect of the present invention, there is provided a hologram processing method comprising: calculating a high frequency component of the input data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data; Generating depth change information by calculating an absolute value of the high frequency component; Calculating average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information; Calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component as the average envelope information; And calculating final depth data by adding the input depth data and the depth map transformation information, and generating computer generated hologram (CGH) output data using the final depth data.
By the abovedescribed configuration, the present invention has the effect of generating the improved hologram data by processing the input depth data by the depth map transformation.
1 is a diagram illustrating a hologram processing apparatus using a depth map transformation according to an exemplary embodiment of the present invention.
2 is a block diagram illustrating a hologram processing process according to an embodiment of the present invention.
3 is a diagram illustrating Gaussian filtered depth data in an unsharp masking processor according to an exemplary embodiment of the present invention.
4 is a diagram illustrating average envelope information in an average envelope processor according to an exemplary embodiment of the present invention.
5 is a diagram illustrating depth map transformation information in a depth map transformation unit according to an embodiment of the present invention.
6A illustrates final depth data to which DELTA D / De is applied in the final depth data calculator according to an exemplary embodiment of the present invention.
6B illustrates final depth data to which DELTA D is applied in the final depth data calculator according to an exemplary embodiment of the present invention.
7 is a diagram illustrating a hologram processing method using a depth map transformation according to an embodiment of the present invention.
DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.
Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise.
1 is a diagram illustrating a hologram processing apparatus using a depth map transformation according to an embodiment of the present invention, and FIG. 2 is a block diagram illustrating a hologram processing process according to an embodiment of the present invention.
The hologram processing apparatus 100 according to the embodiment of the present invention includes a threedimensional information extractor 110, an unsharp masking processor 120, an average envelope processor 130, and a depth map converter. 140, a final depth data calculator 150, a computer generated hologram (CGH) generator 160, and a CGH pattern restorer 170.
The 3D information extractor 110 extracts the input depth data of the target object by extracting the color image and the depth image.
The unsharp masking processor 120 applies a Gaussian low frequency filter (G) to the input depth data Depth to remove the high frequency components of the input depth data and calculates the low frequency components. Here, the input depth data according to the embodiment of the present invention may be described as an original object image and a depth map.
The unsharp masking processing unit 120 subtracts the low frequency component of the input depth data from the input depth data to calculate ΔD, which is a high frequency component.
A process of obtaining DELTA D, which is the output data of the unsharp masking processing unit 120, is represented by Equation 1 below.
Where D is input depth data,
Denotes data obtained by applying a Gaussian low frequency filter (G) to the input depth data.As shown in FIG. 3, when the input depth data is given, the unsharp masking processor 120 changes the left and right depths of the discontinuous pixels according to the boundary change of the input depth data.
In more detail, when the depth value of a pixel of a scan line is 100, 100, 100, 150, 150, 150, the edge of the depth map is in the middle of 100 and 150.
Accordingly, when the unsharp masking processing unit 120 converts the depth map, the unsharp masking processing unit 120 makes a difference value of 100, 90, 80, 170, 190, 150, etc. in the depth value of the pixel of the scan line. Will be given.
The average envelope processing unit 130 calculates an absolute value at ΔD output from the unsharp masking processing unit 120 (
), As shown in FIG. 4, The average envelope information along the trajectory of Calculate Here, the average envelope information includes change information about a depth of a discontinuous pixel of the input depth data.Average envelope information (output data of the average envelope processing unit 130 (
) Is expressed as in [Equation 2].
Here, G denotes a spatial low pass filter with variance σ.
As illustrated in FIG. 5, the depth map converter 140 may use the average envelope information calculated by the average envelope processor 130 as ΔD, which is output data of the unsharp masking processor 120.
), The depth map transformation is performed to calculate the depth map transformation information (Ds). Here, the depth map transformation information includes boundary information according to a change in depth of the input depth data.A process of obtaining the depth map conversion information Ds, which is the output data of the depth map converter 140, is represented by Equation 3 below.
Here, D _{max} uses 1.4 as the scan sector and is a parameter that scales the boundary change of the input depth data.
The depth map converter 140 prevents the abrupt change in D from the boundary where the depth data is changed by using D / D rather than using only D to calculate the depth map conversion information Ds. do.
The final depth data calculator 150 calculates final depth data by adding depth map transformation information Ds of the depth map converter 140 to the input depth data D (D ′ = Ds + D).
6A illustrates a case where D / De is used to obtain depth map transformation information Ds, and FIG. 5B illustrates a case where DELTA D is used to obtain depth map transformation information Ds.
As shown in FIG. 6B, it can be seen that D 'suddenly changes at the boundary at which the input depth data changes.
Such abrupt changes in D 'are not good for computer generated holograms (CGHs) and reconstructed images.
Since the method of generating and restoring the fringe pattern is obvious to those skilled in the art, detailed descriptions thereof will be omitted within the scope of not obscuring the features of the present invention.
The CGH generation method receives normalized depth data, generates an intermediate parameter to create a hologram using the normalized depth data (z), and uses the input depth data (Depth) and an intermediate parameter to create a hologram as the CGH output data. Create a fringe pattern.
The normalized depth data z is calculated using Equation 4 below using the input depth data Depth.
Here, D [i] [j] represents input depth data, and i and j represent integer values.
The intermediate parameter R for making a hologram is calculated using Equation 5 using normalized depth data.
Here, P represents 0.0000104 in pixel pitch and x, y represents image size.
The fringe pattern is calculated as shown in Equation 6 using the input depth data D and the intermediate parameter R that makes the hologram.
Where W and H represent a width and a length that are the size of the input depth data, and k is a wave number.
Respectively. λ represents 9926043.4154818337 (red). Red, blue, and yellow use different wavelength values, and red produces the best hologram.The CGH generator 160 calculates normalized depth data z 'based on the input depth data D and the depth map transformation information Ds.
Since D '= D + Ds, the normalized depth data z' according to an embodiment of the present invention uses the input depth data D [i] [j] and the depth map transformation information Ds. Is calculated as shown in Equation 7].
The CGH generating unit 160 calculates the intermediate parameter R 'for making a hologram using the normalized depth data z' and the abovedescribed Equation 5 above.
The intermediate parameter R 'for making a hologram is calculated using Equation 8 using normalized depth data z'.
Since Ds << 255, this can be assumed to be R '= R.
The CGH generating unit 160 generates a fringe pattern using the CGH output data by using the intermediate parameter R 'for forming the hologram and the abovedescribed Equation 6.
The fringe pattern is calculated as shown in Equation 9 by using the input depth data D [i] [j], the depth map conversion information Ds, and the intermediate parameter R 'for creating a hologram.
As shown in Equation 9, since the Ds value is 0 in the flat region, there is no effect. However, if the Ds value is not 0, it has a negative or positive value and thus affects the fringe pattern.
The CGH pattern restoration unit 170 reproduces the improved hologram data by restoring the fringe pattern output from the CGH generation unit 160 using the holvision technique.
7 is a diagram illustrating a hologram processing method using a depth map transformation according to an embodiment of the present invention.
The 3D information extractor 110 extracts input depth data of the target object by extracting the color image and the depth image (S100).
The unsharp masking processor 120 calculates a low frequency component of the input depth data by applying a Gaussian low frequency filter to the input depth data, and calculates a high frequency component ΔD of the input depth data by subtracting the low frequency component from the input depth data. (S102).
The average envelope processing unit 130 calculates the absolute value of the high frequency component to determine the depth change information (
) Is calculated along with the trajectory of the depth change information, and the average envelope information De including the change information about the depth of the discontinuous pixel of the input depth data is calculated (S104).The depth map converter 140 calculates depth map conversion information Ds representing boundary information according to a change in depth of the input depth data by dividing the high frequency component into average envelope information (S106).
The final depth data calculator 150 calculates final depth data D ′ by adding input depth data and depth map transformation information (S108).
The CGH generating unit 160 generates computer generated hologram (CGH) output data using the final depth data (S110).
The embodiments of the present invention described above are not implemented only by the apparatus and / or method, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention, a recording medium on which the program is recorded And such an embodiment can be easily implemented by those skilled in the art from the description of the embodiments described above.
Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.
Claims (6)
 An Unsharp Masking processor configured to calculate a high frequency component of the input data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data;
Depth change information is generated by calculating an absolute value of the high frequency component, and includes average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information. An average envelope processing unit for calculating;
A depth map converter for calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component based on the average envelope information;
A final depth data calculator configured to calculate final depth data by adding the input depth data and the depth map transformation information; And
CGH generator for generating Computer Generated Hologram (CGH) output data using the final depth data
Hologram processing apparatus comprising a.  The method of claim 1,
The unsharp masking processing unit,
And a high frequency component of the input depth data is calculated by applying a Gaussian low frequency filter to the input depth data and subtracting the low frequency component from the input depth data.  The method of claim 1,
The depth map converter,
And dividing the high frequency component into the average envelope information and calculating the depth map transformation information using a parameter for scaling a boundary change of the input depth data.  Calculating a high frequency component of the input depth data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data;
Generating depth change information by calculating an absolute value of the high frequency component;
Calculating average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information;
Calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component as the average envelope information; And
Calculating final depth data by adding the input depth data and the depth map conversion information and generating computer generated hologram (CGH) output data using the final depth data.
Hologram processing method comprising a.  The method of claim 4, wherein
The step of calculating the high frequency component,
Calculating a high frequency component of the input depth data by applying a Gaussian low frequency filter to the input depth data and subtracting the low frequency component from the input depth data.
Hologram processing method comprising a.  The method of claim 4, wherein
Generating the depth change information,
Generating the depth change information by applying a spatial low pass filter to the absolute value;
Hologram processing method comprising a.
Priority Applications (1)
Application Number  Priority Date  Filing Date  Title 

KR1020100047542A KR101090787B1 (en)  20100520  20100520  Apparatus and Method for Processing by Using Depth Transformation 
Applications Claiming Priority (1)
Application Number  Priority Date  Filing Date  Title 

KR1020100047542A KR101090787B1 (en)  20100520  20100520  Apparatus and Method for Processing by Using Depth Transformation 
Publications (2)
Publication Number  Publication Date 

KR20110127981A KR20110127981A (en)  20111128 
KR101090787B1 true KR101090787B1 (en)  20111208 
Family
ID=45396402
Family Applications (1)
Application Number  Title  Priority Date  Filing Date 

KR1020100047542A KR101090787B1 (en)  20100520  20100520  Apparatus and Method for Processing by Using Depth Transformation 
Country Status (1)
Country  Link 

KR (1)  KR101090787B1 (en) 
Families Citing this family (4)
Publication number  Priority date  Publication date  Assignee  Title 

KR101906936B1 (en) *  20120119  20181011  삼성전자주식회사  Apparatus and method of generating light field hologram 
EP2629156A1 (en)  20120127  20130821  Samsung Electronics Co., Ltd  Image processing apparatus and method 
KR101421984B1 (en) *  20121016  20140728  목포해양대학교 산학협력단  A Fast Generation Method of Digital Hologram Using Depth Difference Temporal Filtering 
KR102083584B1 (en)  20130415  20200302  삼성전자주식회사  Apparatus and method for generating hologram pattern 
Citations (2)
Publication number  Priority date  Publication date  Assignee  Title 

JP2007164862A (en)  20051212  20070628  Fuji Xerox Co Ltd  Hologram recording method and hologram recording device 
KR100973031B1 (en)  20090406  20100730  광운대학교 산학협력단  Method for generating 3d video computer generated hologram using lookup table and temporal redundancy, and apparatus thereof 

2010
 20100520 KR KR1020100047542A patent/KR101090787B1/en not_active IP Right Cessation
Patent Citations (2)
Publication number  Priority date  Publication date  Assignee  Title 

JP2007164862A (en)  20051212  20070628  Fuji Xerox Co Ltd  Hologram recording method and hologram recording device 
KR100973031B1 (en)  20090406  20100730  광운대학교 산학협력단  Method for generating 3d video computer generated hologram using lookup table and temporal redundancy, and apparatus thereof 
Also Published As
Publication number  Publication date 

KR20110127981A (en)  20111128 
Similar Documents
Publication  Publication Date  Title 

Kalantari et al.  Learningbased view synthesis for light field cameras  
Tsang et al.  Novel method for converting digital Fresnel hologram to phaseonly hologram based on bidirectional error diffusion  
US8860712B2 (en)  System and method for processing video images  
US9171372B2 (en)  Depth estimation based on global motion  
Uzan et al.  Speckle denoising in digital holography by nonlocal means filtering  
Kim et al.  Fast computation of hologram patterns of a 3D object using runlength encoding and novel lookup table methods  
US8791941B2 (en)  Systems and methods for 2D to 3D image conversion using mask to model, or model to mask, conversion  
Dufaux et al.  Emerging technologies for 3D video: creation, coding, transmission and rendering  
Picart et al.  General theoretical formulation of image formation in digital Fresnel holography  
Matsushima et al.  Digitized holography: modern holography for 3D imaging of virtual and real objects  
JP6214562B2 (en)  Adaptive multidimensional data decomposition  
Abookasis et al.  Computergenerated holograms of threedimensional objects synthesized from their multiple angular viewpoints  
US9047681B2 (en)  Depth image conversion apparatus and method  
Casas et al.  4D video textures for interactive character appearance  
JP5156837B2 (en)  System and method for depth map extraction using regionbased filtering  
JP4896230B2 (en)  System and method of object model fitting and registration for transforming from 2D to 3D  
Javidi et al.  Threedimensional image fusion by use of multiwavelength digital holography  
Yang et al.  Application of the correlation coefficient method for determination of the focal plane to digital particle holography  
JP5879528B2 (en)  Image generating apparatus and image generating method  
US20120127267A1 (en)  Depth estimation based on global motion  
US20120032948A1 (en)  System and method for processing video images for camera recreation  
JP6309210B2 (en)  Depth image generation method and apparatus, depth image processing method and apparatus  
US20100073364A1 (en)  Conversion method and apparatus with depth map generation  
KR100793076B1 (en)  Edgeadaptive stereo/multiview image matching apparatus and its method  
Malik et al.  A novel algorithm for estimation of depth map using image focus for 3D shape recovery in the presence of noise 
Legal Events
Date  Code  Title  Description 

A201  Request for examination  
E902  Notification of reason for refusal  
E701  Decision to grant or registration of patent right  
GRNT  Written decision to grant  
FPAY  Annual fee payment 
Payment date: 20140912 Year of fee payment: 4 

FPAY  Annual fee payment 
Payment date: 20151012 Year of fee payment: 5 

FPAY  Annual fee payment 
Payment date: 20160927 Year of fee payment: 6 

LAPS  Lapse due to unpaid annual fee 