KR101090787B1 - Apparatus and Method for Processing by Using Depth Transformation - Google Patents

Apparatus and Method for Processing by Using Depth Transformation Download PDF

Info

Publication number
KR101090787B1
KR101090787B1 KR1020100047542A KR20100047542A KR101090787B1 KR 101090787 B1 KR101090787 B1 KR 101090787B1 KR 1020100047542 A KR1020100047542 A KR 1020100047542A KR 20100047542 A KR20100047542 A KR 20100047542A KR 101090787 B1 KR101090787 B1 KR 101090787B1
Authority
KR
South Korea
Prior art keywords
depth
depth data
data
information
input
Prior art date
Application number
KR1020100047542A
Other languages
Korean (ko)
Other versions
KR20110127981A (en
Inventor
김만배
Original Assignee
강원대학교산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 강원대학교산학협력단 filed Critical 강원대학교산학협력단
Priority to KR1020100047542A priority Critical patent/KR101090787B1/en
Publication of KR20110127981A publication Critical patent/KR20110127981A/en
Application granted granted Critical
Publication of KR101090787B1 publication Critical patent/KR101090787B1/en

Links

Images

Classifications

    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infra-red or ultra-violet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04Processes or apparatus for producing holograms
    • G03H1/08Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific

Abstract

The hologram processing method generates depth change information by calculating the high frequency component of the input data by calculating the high frequency component of the input data by changing the depth of the discontinuous pixel according to the boundary change of the input depth data, and follows the trajectory of the depth change information. Calculate average envelope information including change information about the depth of non-contiguous pixels of input depth data, and convert the depth map representing boundary information according to the depth change of input depth data based on the high frequency component as average envelope information. The final depth data is calculated by calculating the information, adding the input depth data and the depth map transformation information, and generating computer generated hologram (CGH) output data using the final depth data.

Description

Apparatus and Method for Processing by Using Depth Transformation

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a hologram processing method, and more particularly, to an apparatus and method for hologram processing using depth map transformation for processing input depth data by depth map transformation to generate enhanced hologram data.

Three-dimensional image and video playback technologies are actively being researched, and next-generation displays are expected to be developed as new immersive visual media that raises the level of visual information.

Three-dimensional image reproduction technologies include stereoscopy, holography, and intergral imaging.

Among these, the holography method is a method in which a viewer observes a virtual image of a virtual image while looking at the holography at a certain distance from the front of the holography when the light source is illuminated on the holography.

The principle of the hologram is to divide the beam from the laser into two, so that one ray is directly on the screen and the other is on the target.

In this case, a light beam that directly shines on the screen is called a reference wave, and a light beam that shines on an object is called an object wave.

The object wave is the light reflected from each surface of the object, so the phase difference is different depending on the distance from the object surface to the screen.

At this time, the interference pattern generated by the unmodified reference wave interferes with the object wave and is stored on the screen. Films in which such interference fringes are stored are called holograms.

The hologram processing receives the depth data, generates a hologram pattern, and outputs the hologram data using the hologram reconstruction tool hologram.

Recognition of hologram data is based on attributes of depth data input to hologram processing.

However, until now, in order to improve the recognition of the hologram data, the research has focused on the method of outputting the hologram data by hologram processing the depth data rather than focusing on the attributes of the input depth data.

That is, there is no conventional method for outputting enhanced hologram data by processing an attribute of input depth data.

In order to solve such a problem, an object of the present invention is to provide a hologram processing apparatus and method using a depth map transform to process the input depth data by the depth map transform to generate improved hologram data.

According to an aspect of the present invention, there is provided a hologram processing apparatus including an unsharp masking processor configured to calculate a high frequency component of an input data by changing a depth of a discontinuous pixel according to a boundary change of an input depth data. ; Depth change information is generated by calculating an absolute value of the high frequency component, and includes average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information. An average envelope processing unit for calculating; A depth map converter for calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component based on the average envelope information; A final depth data calculator configured to calculate final depth data by adding the input depth data and the depth map transformation information; And a CGH generator configured to generate computer generated hologram (CGH) output data using the final depth data.

According to an aspect of the present invention, there is provided a hologram processing method comprising: calculating a high frequency component of the input data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data; Generating depth change information by calculating an absolute value of the high frequency component; Calculating average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information; Calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component as the average envelope information; And calculating final depth data by adding the input depth data and the depth map transformation information, and generating computer generated hologram (CGH) output data using the final depth data.

By the above-described configuration, the present invention has the effect of generating the improved hologram data by processing the input depth data by the depth map transformation.

1 is a diagram illustrating a hologram processing apparatus using a depth map transformation according to an exemplary embodiment of the present invention.
2 is a block diagram illustrating a hologram processing process according to an embodiment of the present invention.
3 is a diagram illustrating Gaussian filtered depth data in an unsharp masking processor according to an exemplary embodiment of the present invention.
4 is a diagram illustrating average envelope information in an average envelope processor according to an exemplary embodiment of the present invention.
5 is a diagram illustrating depth map transformation information in a depth map transformation unit according to an embodiment of the present invention.
6A illustrates final depth data to which DELTA D / De is applied in the final depth data calculator according to an exemplary embodiment of the present invention.
6B illustrates final depth data to which DELTA D is applied in the final depth data calculator according to an exemplary embodiment of the present invention.
7 is a diagram illustrating a hologram processing method using a depth map transformation according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise.

1 is a diagram illustrating a hologram processing apparatus using a depth map transformation according to an embodiment of the present invention, and FIG. 2 is a block diagram illustrating a hologram processing process according to an embodiment of the present invention.

The hologram processing apparatus 100 according to the embodiment of the present invention includes a three-dimensional information extractor 110, an unsharp masking processor 120, an average envelope processor 130, and a depth map converter. 140, a final depth data calculator 150, a computer generated hologram (CGH) generator 160, and a CGH pattern restorer 170.

The 3D information extractor 110 extracts the input depth data of the target object by extracting the color image and the depth image.

The unsharp masking processor 120 applies a Gaussian low frequency filter (G) to the input depth data Depth to remove the high frequency components of the input depth data and calculates the low frequency components. Here, the input depth data according to the embodiment of the present invention may be described as an original object image and a depth map.

The unsharp masking processing unit 120 subtracts the low frequency component of the input depth data from the input depth data to calculate ΔD, which is a high frequency component.

A process of obtaining DELTA D, which is the output data of the unsharp masking processing unit 120, is represented by Equation 1 below.

Figure 112010032580553-pat00001

Where D is input depth data,

Figure 112010032580553-pat00002
Denotes data obtained by applying a Gaussian low frequency filter (G) to the input depth data.

As shown in FIG. 3, when the input depth data is given, the unsharp masking processor 120 changes the left and right depths of the discontinuous pixels according to the boundary change of the input depth data.

In more detail, when the depth value of a pixel of a scan line is 100, 100, 100, 150, 150, 150, the edge of the depth map is in the middle of 100 and 150.

Accordingly, when the unsharp masking processing unit 120 converts the depth map, the unsharp masking processing unit 120 makes a difference value of 100, 90, 80, 170, 190, 150, etc. in the depth value of the pixel of the scan line. Will be given.

The average envelope processing unit 130 calculates an absolute value at ΔD output from the unsharp masking processing unit 120 (

Figure 112010032580553-pat00003
), As shown in FIG. 4,
Figure 112010032580553-pat00004
The average envelope information along the trajectory of
Figure 112010032580553-pat00005
Calculate Here, the average envelope information includes change information about a depth of a discontinuous pixel of the input depth data.

Average envelope information (output data of the average envelope processing unit 130 (

Figure 112010032580553-pat00006
) Is expressed as in [Equation 2].

Figure 112010032580553-pat00007

Here, G denotes a spatial low pass filter with variance σ.

As illustrated in FIG. 5, the depth map converter 140 may use the average envelope information calculated by the average envelope processor 130 as ΔD, which is output data of the unsharp masking processor 120.

Figure 112010032580553-pat00008
), The depth map transformation is performed to calculate the depth map transformation information (Ds). Here, the depth map transformation information includes boundary information according to a change in depth of the input depth data.

A process of obtaining the depth map conversion information Ds, which is the output data of the depth map converter 140, is represented by Equation 3 below.

Figure 112010032580553-pat00009

Here, D max uses 1.4 as the scan sector and is a parameter that scales the boundary change of the input depth data.

The depth map converter 140 prevents the abrupt change in D from the boundary where the depth data is changed by using D / D rather than using only D to calculate the depth map conversion information Ds. do.

The final depth data calculator 150 calculates final depth data by adding depth map transformation information Ds of the depth map converter 140 to the input depth data D (D ′ = Ds + D).

6A illustrates a case where D / De is used to obtain depth map transformation information Ds, and FIG. 5B illustrates a case where DELTA D is used to obtain depth map transformation information Ds.

As shown in FIG. 6B, it can be seen that D 'suddenly changes at the boundary at which the input depth data changes.

Such abrupt changes in D 'are not good for computer generated holograms (CGHs) and reconstructed images.

Since the method of generating and restoring the fringe pattern is obvious to those skilled in the art, detailed descriptions thereof will be omitted within the scope of not obscuring the features of the present invention.

The CGH generation method receives normalized depth data, generates an intermediate parameter to create a hologram using the normalized depth data (z), and uses the input depth data (Depth) and an intermediate parameter to create a hologram as the CGH output data. Create a fringe pattern.

The normalized depth data z is calculated using Equation 4 below using the input depth data Depth.

Figure 112010032580553-pat00010

Here, D [i] [j] represents input depth data, and i and j represent integer values.

The intermediate parameter R for making a hologram is calculated using Equation 5 using normalized depth data.

Figure 112010032580553-pat00011

Here, P represents 0.0000104 in pixel pitch and x, y represents image size.

The fringe pattern is calculated as shown in Equation 6 using the input depth data D and the intermediate parameter R that makes the hologram.

Figure 112010032580553-pat00012

Where W and H represent a width and a length that are the size of the input depth data, and k is a wave number.

Figure 112010032580553-pat00013
Respectively. λ represents 9926043.4154818337 (red). Red, blue, and yellow use different wavelength values, and red produces the best hologram.

The CGH generator 160 calculates normalized depth data z 'based on the input depth data D and the depth map transformation information Ds.

Since D '= D + Ds, the normalized depth data z' according to an embodiment of the present invention uses the input depth data D [i] [j] and the depth map transformation information Ds. Is calculated as shown in Equation 7].

Figure 112010032580553-pat00014

The CGH generating unit 160 calculates the intermediate parameter R 'for making a hologram using the normalized depth data z' and the above-described Equation 5 above.

The intermediate parameter R 'for making a hologram is calculated using Equation 8 using normalized depth data z'.

Figure 112010032580553-pat00015

Since Ds << 255, this can be assumed to be R '= R.

The CGH generating unit 160 generates a fringe pattern using the CGH output data by using the intermediate parameter R 'for forming the hologram and the above-described Equation 6.

The fringe pattern is calculated as shown in Equation 9 by using the input depth data D [i] [j], the depth map conversion information Ds, and the intermediate parameter R 'for creating a hologram.

Figure 112010032580553-pat00016

As shown in Equation 9, since the Ds value is 0 in the flat region, there is no effect. However, if the Ds value is not 0, it has a negative or positive value and thus affects the fringe pattern.

The CGH pattern restoration unit 170 reproduces the improved hologram data by restoring the fringe pattern output from the CGH generation unit 160 using the holvision technique.

7 is a diagram illustrating a hologram processing method using a depth map transformation according to an embodiment of the present invention.

The 3D information extractor 110 extracts input depth data of the target object by extracting the color image and the depth image (S100).

The unsharp masking processor 120 calculates a low frequency component of the input depth data by applying a Gaussian low frequency filter to the input depth data, and calculates a high frequency component ΔD of the input depth data by subtracting the low frequency component from the input depth data. (S102).

The average envelope processing unit 130 calculates the absolute value of the high frequency component to determine the depth change information (

Figure 112010032580553-pat00017
) Is calculated along with the trajectory of the depth change information, and the average envelope information De including the change information about the depth of the discontinuous pixel of the input depth data is calculated (S104).

The depth map converter 140 calculates depth map conversion information Ds representing boundary information according to a change in depth of the input depth data by dividing the high frequency component into average envelope information (S106).

The final depth data calculator 150 calculates final depth data D ′ by adding input depth data and depth map transformation information (S108).

The CGH generating unit 160 generates computer generated hologram (CGH) output data using the final depth data (S110).

The embodiments of the present invention described above are not implemented only by the apparatus and / or method, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention, a recording medium on which the program is recorded And such an embodiment can be easily implemented by those skilled in the art from the description of the embodiments described above.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

Claims (6)

  1. An Unsharp Masking processor configured to calculate a high frequency component of the input data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data;
    Depth change information is generated by calculating an absolute value of the high frequency component, and includes average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information. An average envelope processing unit for calculating;
    A depth map converter for calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component based on the average envelope information;
    A final depth data calculator configured to calculate final depth data by adding the input depth data and the depth map transformation information; And
    CGH generator for generating Computer Generated Hologram (CGH) output data using the final depth data
    Hologram processing apparatus comprising a.
  2. The method of claim 1,
    The unsharp masking processing unit,
    And a high frequency component of the input depth data is calculated by applying a Gaussian low frequency filter to the input depth data and subtracting the low frequency component from the input depth data.
  3. The method of claim 1,
    The depth map converter,
    And dividing the high frequency component into the average envelope information and calculating the depth map transformation information using a parameter for scaling a boundary change of the input depth data.
  4. Calculating a high frequency component of the input depth data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data;
    Generating depth change information by calculating an absolute value of the high frequency component;
    Calculating average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information;
    Calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component as the average envelope information; And
    Calculating final depth data by adding the input depth data and the depth map conversion information and generating computer generated hologram (CGH) output data using the final depth data.
    Hologram processing method comprising a.
  5. The method of claim 4, wherein
    The step of calculating the high frequency component,
    Calculating a high frequency component of the input depth data by applying a Gaussian low frequency filter to the input depth data and subtracting the low frequency component from the input depth data.
    Hologram processing method comprising a.
  6. The method of claim 4, wherein
    Generating the depth change information,
    Generating the depth change information by applying a spatial low pass filter to the absolute value;
    Hologram processing method comprising a.
KR1020100047542A 2010-05-20 2010-05-20 Apparatus and Method for Processing by Using Depth Transformation KR101090787B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020100047542A KR101090787B1 (en) 2010-05-20 2010-05-20 Apparatus and Method for Processing by Using Depth Transformation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020100047542A KR101090787B1 (en) 2010-05-20 2010-05-20 Apparatus and Method for Processing by Using Depth Transformation

Publications (2)

Publication Number Publication Date
KR20110127981A KR20110127981A (en) 2011-11-28
KR101090787B1 true KR101090787B1 (en) 2011-12-08

Family

ID=45396402

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020100047542A KR101090787B1 (en) 2010-05-20 2010-05-20 Apparatus and Method for Processing by Using Depth Transformation

Country Status (1)

Country Link
KR (1) KR101090787B1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101906936B1 (en) * 2012-01-19 2018-10-11 삼성전자주식회사 Apparatus and method of generating light field hologram
EP2629156A1 (en) 2012-01-27 2013-08-21 Samsung Electronics Co., Ltd Image processing apparatus and method
KR101421984B1 (en) * 2012-10-16 2014-07-28 목포해양대학교 산학협력단 A Fast Generation Method of Digital Hologram Using Depth Difference Temporal Filtering
KR102083584B1 (en) 2013-04-15 2020-03-02 삼성전자주식회사 Apparatus and method for generating hologram pattern

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007164862A (en) 2005-12-12 2007-06-28 Fuji Xerox Co Ltd Hologram recording method and hologram recording device
KR100973031B1 (en) 2009-04-06 2010-07-30 광운대학교 산학협력단 Method for generating 3d video computer generated hologram using look-up table and temporal redundancy, and apparatus thereof

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007164862A (en) 2005-12-12 2007-06-28 Fuji Xerox Co Ltd Hologram recording method and hologram recording device
KR100973031B1 (en) 2009-04-06 2010-07-30 광운대학교 산학협력단 Method for generating 3d video computer generated hologram using look-up table and temporal redundancy, and apparatus thereof

Also Published As

Publication number Publication date
KR20110127981A (en) 2011-11-28

Similar Documents

Publication Publication Date Title
Kalantari et al. Learning-based view synthesis for light field cameras
Tsang et al. Novel method for converting digital Fresnel hologram to phase-only hologram based on bidirectional error diffusion
US8860712B2 (en) System and method for processing video images
US9171372B2 (en) Depth estimation based on global motion
Uzan et al. Speckle denoising in digital holography by nonlocal means filtering
Kim et al. Fast computation of hologram patterns of a 3D object using run-length encoding and novel look-up table methods
US8791941B2 (en) Systems and methods for 2-D to 3-D image conversion using mask to model, or model to mask, conversion
Dufaux et al. Emerging technologies for 3D video: creation, coding, transmission and rendering
Picart et al. General theoretical formulation of image formation in digital Fresnel holography
Matsushima et al. Digitized holography: modern holography for 3D imaging of virtual and real objects
JP6214562B2 (en) Adaptive multidimensional data decomposition
Abookasis et al. Computer-generated holograms of three-dimensional objects synthesized from their multiple angular viewpoints
US9047681B2 (en) Depth image conversion apparatus and method
Casas et al. 4D video textures for interactive character appearance
JP5156837B2 (en) System and method for depth map extraction using region-based filtering
JP4896230B2 (en) System and method of object model fitting and registration for transforming from 2D to 3D
Javidi et al. Three-dimensional image fusion by use of multiwavelength digital holography
Yang et al. Application of the correlation coefficient method for determination of the focal plane to digital particle holography
JP5879528B2 (en) Image generating apparatus and image generating method
US20120127267A1 (en) Depth estimation based on global motion
US20120032948A1 (en) System and method for processing video images for camera recreation
JP6309210B2 (en) Depth image generation method and apparatus, depth image processing method and apparatus
US20100073364A1 (en) Conversion method and apparatus with depth map generation
KR100793076B1 (en) Edge-adaptive stereo/multi-view image matching apparatus and its method
Malik et al. A novel algorithm for estimation of depth map using image focus for 3D shape recovery in the presence of noise

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20140912

Year of fee payment: 4

FPAY Annual fee payment

Payment date: 20151012

Year of fee payment: 5

FPAY Annual fee payment

Payment date: 20160927

Year of fee payment: 6

LAPS Lapse due to unpaid annual fee