KR101733346B1 - Orthoscopic real image reconstruction in integral imaging method by using elemental image modification - Google Patents
Orthoscopic real image reconstruction in integral imaging method by using elemental image modification Download PDFInfo
- Publication number
- KR101733346B1 KR101733346B1 KR1020160029788A KR20160029788A KR101733346B1 KR 101733346 B1 KR101733346 B1 KR 101733346B1 KR 1020160029788 A KR1020160029788 A KR 1020160029788A KR 20160029788 A KR20160029788 A KR 20160029788A KR 101733346 B1 KR101733346 B1 KR 101733346B1
- Authority
- KR
- South Korea
- Prior art keywords
- image
- depth
- conversion
- point
- rpc
- Prior art date
Links
- 238000003384 imaging method Methods 0.000 title claims description 8
- 238000012986 modification Methods 0.000 title 1
- 230000004048 modification Effects 0.000 title 1
- 238000000034 method Methods 0.000 claims abstract description 18
- 230000003068 static effect Effects 0.000 claims abstract description 17
- 230000009466 transformation Effects 0.000 claims abstract description 15
- 238000006243 chemical reaction Methods 0.000 claims description 37
- 230000003287 optical effect Effects 0.000 claims description 2
- 238000009877 rendering Methods 0.000 claims description 2
- 238000011426 transformation method Methods 0.000 abstract description 6
- 230000001131 transforming effect Effects 0.000 abstract description 6
- 230000003247 decreasing effect Effects 0.000 abstract description 3
- 230000000694 effects Effects 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 12
- 150000001875 compounds Chemical class 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 239000002054 inoculum Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/20—Linear translation of whole images or parts thereof, e.g. panning
-
- G06T3/0006—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2625—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect
- H04N5/2627—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect for providing spin image effect, 3D stop motion effect or temporal freeze effect
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The present invention relates to a method and apparatus for acquiring an elementary image from image information of a three-dimensional object through an integrated image unit, reproducing the obtained political image by rotationally transforming the acquired elementary image, As a result,
In the direct image system of the present invention, the element image transformation method for realizing the static room image realizes the static room image by applying the rotation transformation to the depth-transformed image without decreasing the resolution of the element image in the integrated image, There is a remarkable effect of providing a real image to an observer by realizing a 3D image reproduction image.
Description
The present invention relates to an elementary image transformation method for realizing a static room image in a direct imaging system, and more particularly, to a method for transforming a static room image by applying a rotation transformation to a depth-transformed image without reducing the resolution of the elementary image in the integrated image The present invention relates to a method of transforming an element image for realizing a real room image in a direct image system providing a real image to an observer by realizing a 3D image reproduction image using a direct image.
As a conventional art, there is disclosed a 3D image display depth conversion method of an integrated image system disclosed in Japanese Patent Application Laid-Open No. 10-2015-0120029, which includes an image acquisition step of acquiring an element image by making a three-dimensional object look through a lens array, An image reconstruction step of reconstructing the three-dimensional image on the space through the lens array, and reconstructing the three-dimensional stereoscopic image of the optically acquired three-dimensional object; A three dimensional image display depth conversion method, wherein the lens array installed in the image reproduction step is configured to have a smaller size than the lens array installed in the image acquisition step, The size of the elemental image acquired through the lens array of step < RTI ID = 0.0 > And an element image transformation step of transforming the depth of the element image into a three-dimensional image display depth transformation method of the integrated image system.
As another prior art, there is provided a method for reproducing a political image in a 3D image system and a method for converting a global depth of a reproduced image in a 3D image system of Patent Registration No. 10-0781941, Arranging a concave lens on the side of the concave lens; Acquiring a basic image with a camera at a focal length position of the lens from a basic image arrangement of an object formed through a concave lens array; And reconstructing the acquired basic images through a block lens array located on the observer side without performing a separate conversion process and providing the reconstructed images as observation reproduced images.
However, the conventional method as described above has a disadvantage in that only the depth conversion is applied and the input image and the output image are not the same in a state in which the resolution is not reduced.
Therefore, through the element image transformation method for realizing the real image in the direct image system of the present invention, the real image is implemented by applying the rotation transformation to the depth-converted image without decreasing the resolution of the element image in the integrated image, Dimensional image reconstruction image using a real image is provided as a real image to provide a real image to an observer.
The present invention relates to a method and apparatus for acquiring an elementary image from image information of a three-dimensional object through an integrated image unit, reproducing the obtained political image by rotationally transforming the acquired elementary image, .
In the direct image system of the present invention, the element image transformation method for realizing the static room image realizes the static room image by applying the rotation transformation to the depth-transformed image without reducing the resolution of the element image in the integrated image, There is a remarkable effect of providing a real image to an observer by realizing a 3D image reproduction image.
FIG. 1 is a block diagram of a direct image concept
Fig. 2 is a conceptual diagram showing the geometrical relationship between an object, a lens array,
Fig. 3 is a conceptual diagram showing the imaging characteristic of the to-be-
Fig. 4 is a conceptual diagram of a political room image to which the depth conversion and the rotation change of the present invention are applied
FIG. 5 is a conceptual diagram of the depth conversion through elemental image acquisition and reproduction of the present invention
FIG. 6 is a diagram showing a configuration to which the method of the present invention is applied
FIG. 7 is an enlarged view of an original element image, a depth conversion element image, and an element image obtained by rotation conversion after depth conversion according to the present invention
8 is a view showing the difference between the doze room image according to the observation position and the room image of the present invention
The present invention relates to a method and apparatus for acquiring an elementary image from image information of a three-dimensional object through an integrated image unit, reproducing the obtained political image by rotationally transforming the acquired elementary image, .
The integrated image unit may include an image input unit for acquiring an image of a three-dimensional object, an image conversion unit for converting an element image of the image acquired through the image input unit into a static image from the doze image, And an image output unit for reproducing the image.
In addition, the image transform unit rotates the individual element image by 180 degrees based on the reference point of transformation (RPC) of the individual element image in the acquired element image, performs depth conversion, And corrects the vertical, horizontal, and vertical positions of the reproduction image by rotating based on the center, thereby converting the inversion image into the static image.
In addition, the elementary image is moved to be symmetric with respect to the RPC when rotated by 180 ° through the rotation transformation.
The present invention will be described in detail with reference to the accompanying drawings.
2 is a conceptual diagram showing the geometrical relationship between an object, a lens array, and a doze room image, FIG. 3 is a conceptual view illustrating an imaging characteristic of a doze room image, and FIG. FIG. 5 is a conceptual diagram of the depth conversion through the element image acquisition and reproduction according to the present invention. FIG. 6 is a block diagram in which the method of the present invention is applied. FIG. 8 is a diagram showing the difference between the doze room image according to the observation position and the static room image of the present invention.
More specifically, the present invention relates to a method for acquiring an image of a three-dimensional object through an integrated video unit, depth-converting an elementary image of the image at the time of acquisition, And to provide a political room image.
The integrated image unit includes an image input unit for acquiring an image for a three-dimensional object, an image conversion unit for converting an element image of the image acquired through the image input unit into a static image from a still image, And a video output unit for reproduction.
The image input unit uses a camera equipped with a lens array to acquire depth information on a three-dimensional object through image capturing.
The image transform unit rotates the discrete element image by 180 degrees based on the reference point of transformation (RPC) of the discrete element image on the acquired element image, performs depth conversion, and then transforms the center of the entire element image And corrects the vertical, horizontal, and vertical positions of the reproduction image, thereby converting the inversion image into the static image.
The RPC is a point on an element image plane corresponding to an RPOS (Reference Point of Object Space) which is a center point of a reference depth plane considering a reproduction image in an integrated image.
The image output unit uses a display unit provided with a lens array to reproduce a still image with the same depth through the acquired element image of the three-dimensional object and the depth information.
And acquires an element image which is information on a three-dimensional object in the image input unit.
The image input unit stores depth information from the installed lens array to the three-dimensional object when the elemental image is acquired, and the image output unit applies depth information on the three-dimensional object to the elemental image when the image is reproduced, And the three-dimensional image input through the image input unit is displayed in the real world as the integrated reproduction space.
1, when the image converting unit is not installed, the image input unit acquires information of a three-dimensional object image formed on a lens array to store an element image, and outputs the element image through an image output unit The 3D image, which is an integrated image, is displayed through a lens array installed on the front side of the image output unit.
However, in the integrated image unit having no image conversion unit as described above, a pseudoscopic real image occurs when an element image to which depth information is applied is output.
Wherein the inlaid image is a compound word of a still image and a true image, the inlaid image is a reproduction image having a depth-inverted characteristic, and the real image is an image reproduced by an observer in front of the lens array. On the other hand, the reconstructed image refers to an image produced by direct, phase, or higher order diffraction waves by wavefront reproduction.
2, the depth information from the lens array to the object when the information of the three-dimensional object is acquired through the image input unit is maintained at the time of reproduction through the image output unit, The reproduced image is seen as an image with the depth reversed from the viewpoint of the viewer.
The imaging characteristic of the dozen true image is as shown in Fig.
3 (a), which is an image of a three-dimensional object, is input through the image input unit and is output to the image output unit. The image shown in FIG. 3 (b) As shown in Fig. 3 (c), the displayed image is reproduced so that the observer at each position can see the inlaid image.
3 (b), the region A located on the rear side of the object is a portion having no image information obtained from the image input unit. The region A is obtained by acquiring three-dimensional information, The area (A) located on the back side is seen as an empty space for the observer.
As shown in FIG. 3 (c), the dozen actual images show the inferred images of the images expected by the observer in response to the observation positions.
The inoculum image output through the image output unit is shown at the positions of
At the
As described above, the still image is reproduced through the image output unit when the element image is inversely compared with the political image that the depth information of the three-dimensional object should actually be viewed.
FIG. 4 is a conceptual diagram of a technique of depth-transforming an elementary image of the image, converting the depth of the element image of the image, converting the depth of the element image, and converting the element image into a political image.
4 (b), 4 (c) and 4 (d) represent the positions of the individual element images on the two-dimensional plane. 4 (d) through rotation conversion.
The image transformer rotates the individual element image by 180 degrees based on the RPC in order to convert the element image into the static image.
The element image shown in FIG. 4C is a depth-transformed element image. Although the real image can be reproduced by reproducing the depth-converted element image, Is displayed to the observer with the inverted doze-room image.
In this case, the three-dimensional image showing the same information as the original object can be reproduced by rotating the entire element image by 180 DEG with respect to the center point of the whole element image, The image is shown to the observer as a political room image as shown in Fig. 4 (d).
In the mathematical analysis for depth conversion of the element image, the geometric relationship between the point object, the RPOS, and the element image at the time of acquiring the three-dimensional information is as shown in FIG. 5 (a).
(One)
In the equations (1) and (5), the lower end of the lens array is defined as the origin.
In Figures 5 (a) and 5 (1)
In Equation (1), P is the diameter of the individual element lenses constituting the lens array, and is equal to the optical center point distance between the adjacent element lenses.
In Equation (1), g is the distance between the lens array and the element image plane.
In Equation (1)
5 (a) and 5 (b), the reference depth plane (RDP) and the central depth plane (CDP) are in a conjugate relationship. The center point on the RDP and the center point on the CDP RPIS (Reference point of Imaging Space,
Therefore, the two surfaces and the two conjugate points do not change their values even after the depth conversion.
As shown in FIG. 5A, the depth conversion is performed based on a reference point of conversion (RPC) corresponding to an individual element image.
The RPC is the rendering point of the RPOS, and the coordinates of the RPC are given as follows.
(2)
In Equation (2)
In Equation (2)
The one-dimensional approach to the 180 ° rotation of the discrete element image for the rotation transformation is to shift the elemental image to the RPC by the magnitude of Δx expressed in FIG. 5 (a).
Here, the distance Δx between the element image and the RPC is Δx =
(3)
Converted points shown in Fig. 5 (b) can be calculated using Equation (3)
(4)
5 (a) and 5 (b), the x-coordinate of the three-dimensional object is the same as the x-coordinate of the RPOS, and the x-
The z-axis coordinates of the reproduction point of the depth-transformed elementary image can be derived in consideration of the geometric relationship and are expressed by Equation (5).
(5)
On the other hand, the derivation results of the original elemental image and RPIS are given by Eqs. (6) and (7).
(6)
(7)
5 (c) and 5 (d) illustrate an elemental image of 1 × 3 samples. FIG. 5 (c) shows an original element image, FIG.
As described above, the depth transformation can be induced through the transformation relation of the element image.
Also, as shown in FIG. 4, after the depth conversion, the final rotation transformation rotates based on the center point of the whole element image array, thereby completing the conversion process.
6 is a diagram illustrating an example of a structure for depth conversion in the step of acquiring a room image. The structure is composed of a dice and a 10x10 lens array as a three-dimensional object. The distance between the lens array and the object is approximately 630mm, And the depth of the object is 31.5mm.
An enlarged image of a part of the element image and the element image through the embodiment of FIG. 6 is shown in FIG.
7 (b) is a partially magnified image of an elementary image to which only depth conversion is applied, and FIG. 7 (c) is a partially enlarged image of an original element image which is not converted by the image converting unit, And then rotated 180 ° to obtain an enlarged image of the element image rotated and converted.
In addition, the image of the room is accurately displayed according to the observation position of the observer.
As shown in FIG. 8, the reproduction result is reproduced differently from the set room image and the set room image, and the set room image is matched to the user's position and the image is correctly output. However, three-dimensional objects can not be seen by the observer.
8 (b) is divided into Left2, Left1, Center, Right1 and Right2, and the observer at each position views the real image, FIG. 8 (d) shows a result obtained by performing depth conversion on an elementary image and then performing rotation conversion on the elementary image to match the positions of the respective regions. The correct room image is output.
As shown in FIG. 8 (c), it can be seen that the depth of the reproduction image is reversed and the real image of the object image reproduced in correspondence with the perspective and observation positions is inverted and outputted.
FIG. 8 (d) shows that the depth information and the parallax information are correctly reproduced according to the observation position in the reproduced image after the element image is subjected to depth conversion and rotation conversion.
In FIG. 8D, Depth measure is displayed, and it is proved that the 3D image is reproduced in real image through the depth of the Depth measure.
Therefore, in the direct image system of the present invention, the element image transformation method for realizing the static room image realizes the static room image by applying the rotation transformation to the depth-transformed image without decreasing the resolution of the element image in the integrated image, There is a remarkable effect of providing a real image to an observer by realizing a three-dimensional image reproduction image.
Claims (3)
The integrated image unit includes an image input unit for acquiring an image for a three-dimensional object, an image conversion unit for converting an element image of the image acquired through the image input unit into a static image from a still image, A method for converting an elementary image into a real image in a direct image system,
The image transform unit rotates the discrete element image by 180 degrees based on the reference point of transformation (RPC) of the discrete element image on the acquired element image, performs depth conversion, and then transforms the center of the entire element image And corrects the vertical, horizontal, and vertical positions of the reproduction image so as to convert the inverted image into the static image.
In the analysis for the depth conversion of the element image, the geometric relationship of the point object, the RPOS, and the element image at the time of acquiring the three-dimensional information is expressed by the following equation (1)
(One)
{Define the lower end of the lens array as the origin.
(
P is the diameter of the individual element lenses constituting the lens array, and is equal to the optical center point distance between the adjacent element lenses.
g is the distance between the lens array and the element image plane.
The reference depth plane (RDP) and the central depth plane (CDP), which are the reference depth planes, are in a conjugate relationship, and the RPOS, which is the center point on the RDP, and the reference point of imaging space
The two surfaces and the two points of the conjugate relation are not changed even after the depth conversion,
The depth conversion is based on a reference point of conversion (RPC) corresponding to an individual element image,
The RPC is the rendering point of the RPOS, and the coordinates of the RPC are given by the following equation (2)
(2)
{
The one-dimensional approach to 180 ° rotation of the discrete element image for the rotation transformation is to move the elemental image to the RPC by the magnitude of Δx,
The distance? X between the element image and the RPC is? X =
(3)
A Converted Point can be calculated using Equation (3)
(4)
The x-coordinate of the three-dimensional object is the same as the x-coordinate of the RPOS, and the x-coordinate value of the RPOS is
The z-axis coordinates of the reproduction point of the depth-transformed elementary image can be derived in consideration of a geometric relationship, and the following equations (5) and
(5)
An element image conversion method for realizing a room image in a direct image system characterized by the same
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020160029788A KR101733346B1 (en) | 2016-03-11 | 2016-03-11 | Orthoscopic real image reconstruction in integral imaging method by using elemental image modification |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020160029788A KR101733346B1 (en) | 2016-03-11 | 2016-03-11 | Orthoscopic real image reconstruction in integral imaging method by using elemental image modification |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| KR101733346B1 true KR101733346B1 (en) | 2017-05-24 |
Family
ID=59051199
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020160029788A KR101733346B1 (en) | 2016-03-11 | 2016-03-11 | Orthoscopic real image reconstruction in integral imaging method by using elemental image modification |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR101733346B1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11392377B2 (en) | 2020-02-20 | 2022-07-19 | Samsung Electronics Co., Ltd. | System-on-chip, data processing method thereof, and neural network device |
| US11887269B2 (en) | 2020-11-11 | 2024-01-30 | Samsung Electronics Co., Ltd. | Computing method and apparatus with image generation |
-
2016
- 2016-03-11 KR KR1020160029788A patent/KR101733346B1/en active IP Right Grant
Non-Patent Citations (1)
| Title |
|---|
| 장재영, 조명진, 집적영상에서 요소영상의 좌표변환을 이용한 정치실영상 구현, 한국정보통신학회논문지 19(7), 2015.7, 1646-1652 (7 pages)* |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11392377B2 (en) | 2020-02-20 | 2022-07-19 | Samsung Electronics Co., Ltd. | System-on-chip, data processing method thereof, and neural network device |
| US11887269B2 (en) | 2020-11-11 | 2024-01-30 | Samsung Electronics Co., Ltd. | Computing method and apparatus with image generation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Zakharchenko et al. | Quality metric for spherical panoramic video | |
| Li et al. | Simplified integral imaging pickup method for real objects using a depth camera | |
| US20110080496A1 (en) | Apparatus Method and System for Imaging | |
| JP2009518877A (en) | Method and system for acquiring and displaying a three-dimensional light field | |
| KR101600681B1 (en) | Depth convertion method of 3D images interal imaging system | |
| KR100897307B1 (en) | Method for reproducing hologram of 3D image picked-up by integral imaging scheme and Apparatus thereof | |
| US20200137376A1 (en) | Method for generating a light-field 3d display unit image and a generating device | |
| JP5852093B2 (en) | Video processing apparatus, video processing method, and program | |
| Graziosi et al. | Compression for full-parallax light field displays | |
| CN113238472A (en) | High-resolution light field display method and device based on frequency domain displacement | |
| KR101411568B1 (en) | A Hologram Generating Method using Virtual View-point Depth Image Synthesis | |
| KR101733346B1 (en) | Orthoscopic real image reconstruction in integral imaging method by using elemental image modification | |
| KR101524827B1 (en) | Integral imaging camera and hologram synthesis technique using the integral imaging camera | |
| KR101293576B1 (en) | System of depth control in three-dimensional integral imaging display | |
| Shin et al. | Computational technique of volumetric object reconstruction in integral imaging by use of real and virtual image fields | |
| KR100937768B1 (en) | Apparatus and method for reconstructing 3D image | |
| CN104463958A (en) | Three-dimensional super-resolution method based on disparity map fusing | |
| KR100927234B1 (en) | Method, apparatus for creating depth information and computer readable record-medium on which program for executing method thereof | |
| KR101608753B1 (en) | Method and apparatus for generating three dimensional contents using focal plane sweeping | |
| KR101657373B1 (en) | Multiple depth extraction method in integral imaging display | |
| Wang et al. | Elemental image array generation based on object front reference point of optical axis of camera array for integral imaging | |
| KR20090091909A (en) | Apparatus for volumetric image computational reconstruction by combined use of a round-type mapping model and an interpolation method | |
| 김종현 | Real-time 3D visualization methods based on dual-dimensional imaging | |
| Wu | Depth measurement in integral images. | |
| Petrov et al. | Improved stereoscopic imaging with converged camera configuration |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| E701 | Decision to grant or registration of patent right | ||
| GRNT | Written decision to grant |