KR20110127981A - Apparatus and method for processing by using depth transformation - Google Patents

Apparatus and method for processing by using depth transformation Download PDF

Info

Publication number
KR20110127981A
KR20110127981A KR1020100047542A KR20100047542A KR20110127981A KR 20110127981 A KR20110127981 A KR 20110127981A KR 1020100047542 A KR1020100047542 A KR 1020100047542A KR 20100047542 A KR20100047542 A KR 20100047542A KR 20110127981 A KR20110127981 A KR 20110127981A
Authority
KR
South Korea
Prior art keywords
depth
data
input
information
depth data
Prior art date
Application number
KR1020100047542A
Other languages
Korean (ko)
Other versions
KR101090787B1 (en
Inventor
김만배
Original Assignee
강원대학교산학협력단
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 강원대학교산학협력단 filed Critical 강원대학교산학협력단
Priority to KR1020100047542A priority Critical patent/KR101090787B1/en
Publication of KR20110127981A publication Critical patent/KR20110127981A/en
Application granted granted Critical
Publication of KR101090787B1 publication Critical patent/KR101090787B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific

Abstract

The hologram processing method generates depth change information by calculating the high frequency component of the input data by calculating the high frequency component of the input data by changing the depth of the discontinuous pixel according to the boundary change of the input depth data, and follows the trajectory of the depth change information. Calculate average envelope information including change information about the depth of non-contiguous pixels of input depth data, and convert the depth map representing boundary information according to the depth change of input depth data based on the high frequency component as average envelope information. The final depth data is calculated by calculating the information, adding the input depth data and the depth map transformation information, and generating computer generated hologram (CGH) output data using the final depth data.

Description

Apparatus and Method for Processing by Using Depth Transformation

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a hologram processing method, and more particularly, to an apparatus and method for hologram processing using depth map transformation for processing input depth data by depth map transformation to generate enhanced hologram data.

Three-dimensional image and video playback technologies are actively being researched, and next-generation displays are expected to be developed as new immersive visual media that raises the level of visual information.

Three-dimensional image reproduction technologies include stereoscopy, holography, and intergral imaging.

Among these, the holography method is a method in which a viewer observes a virtual image of a virtual image while looking at the holography at a certain distance from the front of the holography when the light source is illuminated on the holography.

The principle of the hologram is to divide the beam from the laser into two, so that one ray is directly on the screen and the other is on the target.

In this case, a light beam that directly shines on the screen is called a reference wave, and a light beam that shines on an object is called an object wave.

The object wave is the light reflected from each surface of the object, so the phase difference is different depending on the distance from the object surface to the screen.

At this time, the interference pattern generated by the unmodified reference wave interferes with the object wave and is stored on the screen. Films in which such interference fringes are stored are called holograms.

The hologram processing receives the depth data, generates a hologram pattern, and outputs the hologram data using the hologram reconstruction tool hologram.

Recognition of hologram data is based on attributes of depth data input to hologram processing.

However, until now, in order to improve the recognition of the hologram data, the research has focused on the method of outputting the hologram data by hologram processing the depth data rather than focusing on the attributes of the input depth data.

That is, there is no conventional method for outputting enhanced hologram data by processing an attribute of input depth data.

In order to solve such a problem, an object of the present invention is to provide a hologram processing apparatus and method using a depth map transform to process the input depth data by the depth map transform to generate improved hologram data.

According to an aspect of the present invention, there is provided a hologram processing apparatus including an unsharp masking processor configured to calculate a high frequency component of an input data by changing a depth of a discontinuous pixel according to a boundary change of an input depth data. ; Depth change information is generated by calculating an absolute value of the high frequency component, and includes average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information. An average envelope processing unit for calculating; A depth map converter for calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component based on the average envelope information; A final depth data calculator configured to calculate final depth data by adding the input depth data and the depth map transformation information; And a CGH generator configured to generate computer generated hologram (CGH) output data using the final depth data.

According to an aspect of the present invention, there is provided a hologram processing method comprising: calculating a high frequency component of the input data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data; Generating depth change information by calculating an absolute value of the high frequency component; Calculating average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information; Calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component as the average envelope information; And calculating final depth data by adding the input depth data and the depth map transformation information, and generating computer generated hologram (CGH) output data using the final depth data.

By the above-described configuration, the present invention has the effect of generating the improved hologram data by processing the input depth data by the depth map transformation.

1 is a diagram illustrating a hologram processing apparatus using a depth map transformation according to an exemplary embodiment of the present invention.
2 is a block diagram illustrating a hologram processing process according to an embodiment of the present invention.
3 is a diagram illustrating Gaussian filtered depth data in an unsharp masking processor according to an exemplary embodiment of the present invention.
4 is a diagram illustrating average envelope information in an average envelope processor according to an exemplary embodiment of the present invention.
5 is a diagram illustrating depth map transformation information in a depth map transformation unit according to an embodiment of the present invention.
6A illustrates final depth data to which DELTA D / De is applied in the final depth data calculator according to an exemplary embodiment of the present invention.
6B illustrates final depth data to which DELTA D is applied in the final depth data calculator according to an exemplary embodiment of the present invention.
7 is a diagram illustrating a hologram processing method using a depth map transformation according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to "include" a certain component, it means that it can further include other components, without excluding other components unless specifically stated otherwise.

1 is a diagram illustrating a hologram processing apparatus using a depth map transformation according to an embodiment of the present invention, and FIG. 2 is a block diagram illustrating a hologram processing process according to an embodiment of the present invention.

The hologram processing apparatus 100 according to the embodiment of the present invention includes a three-dimensional information extractor 110, an unsharp masking processor 120, an average envelope processor 130, and a depth map converter. 140, a final depth data calculator 150, a computer generated hologram (CGH) generator 160, and a CGH pattern restorer 170.

The 3D information extractor 110 extracts the input depth data of the target object by extracting the color image and the depth image.

The unsharp masking processor 120 applies a Gaussian low frequency filter (G) to the input depth data Depth to remove the high frequency components of the input depth data and calculates the low frequency components. Here, the input depth data according to the embodiment of the present invention may be described as an original object image and a depth map.

The unsharp masking processing unit 120 subtracts the low frequency component of the input depth data from the input depth data to calculate ΔD, which is a high frequency component.

A process of obtaining DELTA D, which is the output data of the unsharp masking processing unit 120, is represented by Equation 1 below.

Figure pat00001

Where D is input depth data,

Figure pat00002
Denotes data obtained by applying a Gaussian low frequency filter (G) to the input depth data.

As shown in FIG. 3, when the input depth data is given, the unsharp masking processor 120 changes the left and right depths of the discontinuous pixels according to the boundary change of the input depth data.

In more detail, when the depth value of a pixel of a scan line is 100, 100, 100, 150, 150, 150, the edge of the depth map is in the middle of 100 and 150.

Accordingly, when the unsharp masking processing unit 120 converts the depth map, the unsharp masking processing unit 120 makes a difference value of 100, 90, 80, 170, 190, 150, etc. in the depth value of the pixel of the scan line. Will be given.

The average envelope processing unit 130 calculates an absolute value at ΔD output from the unsharp masking processing unit 120 (

Figure pat00003
), As shown in FIG. 4,
Figure pat00004
The average envelope information along the trajectory of
Figure pat00005
Calculate Here, the average envelope information includes change information about a depth of a discontinuous pixel of the input depth data.

Average envelope information (output data of the average envelope processing unit 130 (

Figure pat00006
) Is expressed as in [Equation 2].

Figure pat00007

Here, G denotes a spatial low pass filter with variance σ.

As illustrated in FIG. 5, the depth map converter 140 may use the average envelope information calculated by the average envelope processor 130 as ΔD, which is output data of the unsharp masking processor 120.

Figure pat00008
), The depth map transformation is performed to calculate the depth map transformation information (Ds). Here, the depth map transformation information includes boundary information according to a change in depth of the input depth data.

A process of obtaining the depth map conversion information Ds, which is the output data of the depth map converter 140, is represented by Equation 3 below.

Figure pat00009

Here, D max uses 1.4 as the scan sector and is a parameter that scales the boundary change of the input depth data.

The depth map converter 140 prevents the abrupt change in D from the boundary where the depth data is changed by using D / D rather than using only D to calculate the depth map conversion information Ds. do.

The final depth data calculator 150 calculates final depth data by adding depth map transformation information Ds of the depth map converter 140 to the input depth data D (D ′ = Ds + D).

6A illustrates a case where D / De is used to obtain depth map transformation information Ds, and FIG. 5B illustrates a case where DELTA D is used to obtain depth map transformation information Ds.

As shown in FIG. 6B, it can be seen that D 'suddenly changes at the boundary at which the input depth data changes.

Such abrupt changes in D 'are not good for computer generated holograms (CGHs) and reconstructed images.

Since the method of generating and restoring the fringe pattern is obvious to those skilled in the art, detailed descriptions thereof will be omitted within the scope of not obscuring the features of the present invention.

The CGH generation method receives normalized depth data, generates an intermediate parameter to create a hologram using the normalized depth data (z), and uses the input depth data (Depth) and an intermediate parameter to create a hologram as the CGH output data. Create a fringe pattern.

The normalized depth data z is calculated using Equation 4 below using the input depth data Depth.

Figure pat00010

Here, D [i] [j] represents input depth data, and i and j represent integer values.

The intermediate parameter R for making a hologram is calculated using Equation 5 using normalized depth data.

Figure pat00011

Here, P represents 0.0000104 in pixel pitch and x, y represents image size.

The fringe pattern is calculated as shown in Equation 6 using the input depth data D and the intermediate parameter R that makes the hologram.

Figure pat00012

Where W and H represent a width and a length that are the size of the input depth data, and k is a wave number.

Figure pat00013
Respectively. λ represents 9926043.4154818337 (red). Red, blue, and yellow use different wavelength values, and red produces the best hologram.

The CGH generator 160 calculates normalized depth data z 'based on the input depth data D and the depth map transformation information Ds.

Since D '= D + Ds, the normalized depth data z' according to an embodiment of the present invention uses the input depth data D [i] [j] and the depth map transformation information Ds. Is calculated as shown in Equation 7].

Figure pat00014

The CGH generating unit 160 calculates the intermediate parameter R 'for making a hologram using the normalized depth data z' and the above-described Equation 5 above.

The intermediate parameter R 'for making a hologram is calculated using Equation 8 using normalized depth data z'.

Figure pat00015

Since Ds << 255, this can be assumed to be R '= R.

The CGH generating unit 160 generates a fringe pattern using the CGH output data by using the intermediate parameter R 'for forming the hologram and the above-described Equation 6.

The fringe pattern is calculated as shown in Equation 9 by using the input depth data D [i] [j], the depth map conversion information Ds, and the intermediate parameter R 'for creating a hologram.

Figure pat00016

As shown in Equation 9, since the Ds value is 0 in the flat region, there is no effect. However, if the Ds value is not 0, it has a negative or positive value and thus affects the fringe pattern.

The CGH pattern restoration unit 170 reproduces the improved hologram data by restoring the fringe pattern output from the CGH generation unit 160 using the holvision technique.

7 is a diagram illustrating a hologram processing method using a depth map transformation according to an embodiment of the present invention.

The 3D information extractor 110 extracts input depth data of the target object by extracting the color image and the depth image (S100).

The unsharp masking processor 120 calculates a low frequency component of the input depth data by applying a Gaussian low frequency filter to the input depth data, and calculates a high frequency component ΔD of the input depth data by subtracting the low frequency component from the input depth data. (S102).

The average envelope processing unit 130 calculates the absolute value of the high frequency component to determine the depth change information (

Figure pat00017
) Is calculated along with the trajectory of the depth change information, and the average envelope information De including the change information about the depth of the discontinuous pixel of the input depth data is calculated (S104).

The depth map converter 140 calculates depth map conversion information Ds representing boundary information according to a change in depth of the input depth data by dividing the high frequency component into average envelope information (S106).

The final depth data calculator 150 calculates final depth data D ′ by adding input depth data and depth map transformation information (S108).

The CGH generating unit 160 generates computer generated hologram (CGH) output data using the final depth data (S110).

The embodiments of the present invention described above are not implemented only by the apparatus and / or method, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention, a recording medium on which the program is recorded And such an embodiment can be easily implemented by those skilled in the art from the description of the embodiments described above.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

Claims (6)

An Unsharp Masking processor configured to calculate a high frequency component of the input data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data;
Depth change information is generated by calculating an absolute value of the high frequency component, and includes average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information. An average envelope processing unit for calculating;
A depth map converter for calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component based on the average envelope information;
A final depth data calculator configured to calculate final depth data by adding the input depth data and the depth map transformation information; And
CGH generator for generating Computer Generated Hologram (CGH) output data using the final depth data
Hologram processing apparatus comprising a. The method of claim 1,
The unsharp masking processing unit,
And a high frequency component of the input depth data is calculated by applying a Gaussian low frequency filter to the input depth data and subtracting the low frequency component from the input depth data. The method of claim 1,
The depth map converter,
And dividing the high frequency component into the average envelope information and calculating the depth map transformation information using a parameter for scaling a boundary change of the input depth data. Calculating a high frequency component of the input data by changing a depth of a discontinuous pixel according to a boundary change of the input depth data;
Generating depth change information by calculating an absolute value of the high frequency component;
Calculating average envelope information including change information about a depth of a discontinuous pixel of the input depth data while following the trajectory of the depth change information;
Calculating depth map transformation information representing boundary information according to a change in depth of the input depth data based on the high frequency component as the average envelope information; And
Calculating final depth data by adding the input depth data and the depth map conversion information and generating computer generated hologram (CGH) output data using the final depth data.
Hologram processing method comprising a. The method of claim 4, wherein
The step of calculating the high frequency component,
Calculating a high frequency component of the input depth data by applying a Gaussian low frequency filter to the input depth data and subtracting the low frequency component from the input depth data.
Hologram processing method comprising a. The method of claim 4, wherein
Generating the depth change information,
Generating the depth change information by applying a spatial low pass filter to the absolute value;
Hologram processing method comprising a.
KR1020100047542A 2010-05-20 2010-05-20 Apparatus and Method for Processing by Using Depth Transformation KR101090787B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020100047542A KR101090787B1 (en) 2010-05-20 2010-05-20 Apparatus and Method for Processing by Using Depth Transformation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020100047542A KR101090787B1 (en) 2010-05-20 2010-05-20 Apparatus and Method for Processing by Using Depth Transformation

Publications (2)

Publication Number Publication Date
KR20110127981A true KR20110127981A (en) 2011-11-28
KR101090787B1 KR101090787B1 (en) 2011-12-08

Family

ID=45396402

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020100047542A KR101090787B1 (en) 2010-05-20 2010-05-20 Apparatus and Method for Processing by Using Depth Transformation

Country Status (1)

Country Link
KR (1) KR101090787B1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130085142A (en) * 2012-01-19 2013-07-29 삼성전자주식회사 Apparatus and method of generating light field hologram
KR101421984B1 (en) * 2012-10-16 2014-07-28 목포해양대학교 산학협력단 A Fast Generation Method of Digital Hologram Using Depth Difference Temporal Filtering
US9361689B2 (en) 2012-01-27 2016-06-07 Samsung Electronics Co., Ltd. Image processing apparatus and method
US9727023B2 (en) 2013-04-15 2017-08-08 Samsung Electronics Co., Ltd. Apparatus and method for generating hologram pattern

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4696890B2 (en) 2005-12-12 2011-06-08 富士ゼロックス株式会社 Hologram recording method and hologram recording apparatus
KR100973031B1 (en) 2009-04-06 2010-07-30 광운대학교 산학협력단 Method for generating 3d video computer generated hologram using look-up table and temporal redundancy, and apparatus thereof

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130085142A (en) * 2012-01-19 2013-07-29 삼성전자주식회사 Apparatus and method of generating light field hologram
US9361689B2 (en) 2012-01-27 2016-06-07 Samsung Electronics Co., Ltd. Image processing apparatus and method
KR101421984B1 (en) * 2012-10-16 2014-07-28 목포해양대학교 산학협력단 A Fast Generation Method of Digital Hologram Using Depth Difference Temporal Filtering
US9727023B2 (en) 2013-04-15 2017-08-08 Samsung Electronics Co., Ltd. Apparatus and method for generating hologram pattern

Also Published As

Publication number Publication date
KR101090787B1 (en) 2011-12-08

Similar Documents

Publication Publication Date Title
US20140300941A1 (en) Method and apparatus for generating hologram based on multi-view image
KR20110116671A (en) Apparatus and method for generating mesh, and apparatus and method for processing image
KR20140096532A (en) Apparatus and method for generating digital hologram
KR101090787B1 (en) Apparatus and Method for Processing by Using Depth Transformation
US20230205133A1 (en) Real-time Photorealistic 3D Holography With Deep Neural Networks
WO2021216747A1 (en) Real-Time Photorealistic 3D Holography with Deep Neural Networks
KR20190078211A (en) Hologram generation apparatus and method thereof
Symeonidou et al. Speckle noise reduction for computer generated holograms of objects with diffuse surfaces
KR102277098B1 (en) A volume hologram generation method using point cloud and mesh
KR101411568B1 (en) A Hologram Generating Method using Virtual View-point Depth Image Synthesis
KR101828814B1 (en) Depth image conversion apparatus and method thereof
JP2001524696A (en) Computer assisted holography method and apparatus
JP5831930B2 (en) Hologram generation apparatus and hologram generation method
KR20140123694A (en) Apparatus and method for generating hologram pattern
Tsang et al. Review on theory and applications of wavefront recording plane framework in generation and processing of digital holograms
KR102252947B1 (en) Image to Hologram Conversion Method and System using a Quantized Depth-Map
Tsang et al. Enhancement on the generation of sampled phase-only holograms
JP2014206710A (en) Data generation device of computer hologram
WO2023015621A1 (en) Crosstalk-free holographic 3d display method based on diffraction fuzzy imaging principle
KR20140056073A (en) Method and system for creating dynamic floating window for stereoscopic contents
US20230089872A1 (en) Information processing device, information processing method, and information processing program
KR102502586B1 (en) Method and Apparatus for Generation of distortion-free scaled hologram using light field data conversion
KR102144473B1 (en) APPARATUS AND METHOD FOR PRODUCING 3-Dimension HOLOGRAM IMAGE
US20200192286A1 (en) Hologram image representation method and hologram image representation device
JP5254297B2 (en) Image processing device

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20140912

Year of fee payment: 4

FPAY Annual fee payment

Payment date: 20151012

Year of fee payment: 5

FPAY Annual fee payment

Payment date: 20160927

Year of fee payment: 6

LAPS Lapse due to unpaid annual fee