KR101912242B1 - 3d display apparatus and method for image processing thereof - Google Patents
3d display apparatus and method for image processing thereof Download PDFInfo
- Publication number
- KR101912242B1 KR101912242B1 KR1020120130308A KR20120130308A KR101912242B1 KR 101912242 B1 KR101912242 B1 KR 101912242B1 KR 1020120130308 A KR1020120130308 A KR 1020120130308A KR 20120130308 A KR20120130308 A KR 20120130308A KR 101912242 B1 KR101912242 B1 KR 101912242B1
- Authority
- KR
- South Korea
- Prior art keywords
- point
- image
- viewpoint
- arrangement pattern
- view
- Prior art date
Links
Images
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
A 3D display device is disclosed. The 3D display device includes an image input unit for receiving image and depth information, a multi-viewpoint image having depth information smaller than a predetermined depth value, and a multi-viewpoint image having depth information of a depth value or more, A multi-view image generating unit for generating an image, a multi-view image rendering unit for arranging multi-view foreground images in a first arrangement pattern, And a display unit.
Description
The present invention relates to a 3D display apparatus and an image processing method thereof, and more particularly, to a 3D display apparatus and an image processing method for reducing a dead zone caused by a viewing position of a user.
Development effort for 3D display devices is accelerating for more realistic viewing. Accordingly, 3D video signals, which have been mainly used in the theater, can be viewed at home using a general display device such as a TV.
On the other hand, a 3D (Dimensions) display apparatus can be divided into a spectacular or non-spectacular system, depending on whether or not the 3D image viewing glasses are used.
As an example of a spectacled system, there is a shutter glass type display apparatus. The shutter glass system is a system in which the left and right shutter glasses of the 3D glasses worn by the user are alternately opened and closed by interlocking with the left and right eye images so that the user can feel the stereoscopic feeling.
The no-vision system is also called an autostereoscopy system. The non-eyeglass type 3D display device displays images corresponding to images at different viewpoints on the left and right eyes of a viewer using a Parallax Barrier technique or a lenticular lens while displaying optically separated multi-view images. So that the user can feel a three-dimensional feeling.
1 is a view for explaining a display operation of a multi-view image of a general spectacles 3D display device.
Referring to FIG. 1, a multi-view image from an optically separated view point to a 9 view point is rendered in such a manner that one view image is positioned at one view point and nine view points are positioned at nine view points, Play point video. If the viewer is located between one point and nine points, 3D images can be viewed without glasses, and motion parallax can be felt according to the viewing position change. However, a typical 3D display device displays images sequentially from one point to nine points, and thus a dead zone may occur depending on the viewing position.
The dead zone means a position where the viewer's viewing position is switched from point N to point-in-time. Since this point simultaneously sees images at two separate points in time, serious crosstalk occurs and the 3D image can not be viewed. As shown in FIG. 1, a dead zone corresponds to a position where the 9 view image and the 1 view image are simultaneously viewed.
FIG. 2 is a diagram showing an arrangement pattern of multi-view images of a general spectacle-free 3D display device.
Referring to FIG. 2, since the multi-view images are sequentially arranged at the respective optical viewpoints as described in FIG. 1, it is possible to identify a dead zone in which a difference in a sharp image viewpoint occurs between the 9 viewpoint and the 1 viewpoint.
Thus, there is a problem that a dead zone occurs in the conventional non-spectacle 3D display device, and the 3D image can not be normally viewed due to crosstalk in the dead zone.
It is an object of the present invention to provide a 3D display device capable of viewing 3D images comfortably at any position by a multi-view image processing method that reduces dead zones, In the method,
According to an aspect of the present invention, there is provided a 3D display apparatus including an image input unit for inputting image and depth information, depth information less than a preset depth value using the input image and depth information, A multi-view image generating unit for generating a multi-view image having a multi-viewpoint foreground image and depth information of the depth value or more, a multi-view image generating unit for arranging the multi-view foreground images in a first arrangement pattern, And a display unit for outputting the rendered multi-view image.
Herein, the viewpoints of the multi-view foreground image and the multi-viewpoint viewpoint are the N viewpoints, and the first placement pattern is a view from the first viewpoint to the K viewpoint when the N is an odd number (2K-1, K is a natural number) (2K, K is a natural number), the first to (K + 1) -th to (K + 1) -th to Wherein the second arrangement pattern is the same as the first arrangement pattern and is shifted by a predetermined point in time, so that the phase difference is shifted from the first point to the second point, Lt; RTI ID = 0.0 > a < / RTI >
In this case, the viewpoints of the multi-viewpoint foreground image and the multi-viewpoint rearview image are a total of 9 viewpoints, and the first placement pattern is a viewpoint of the first, second, third, fourth, fifth, And the second arrangement pattern may be an arrangement pattern in which the second, third, fourth, fifth, fourth, third, second, first, and second viewpoint images are repeatedly arranged.
On the other hand, the viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are a total of N viewpoints, and the first placement pattern sequentially arranges odd viewpoints from the first viewpoint to the Nth viewpoint, And the second arrangement pattern is the same as the first arrangement pattern and is shifted by a predetermined time point so as to have a phase difference, .
In this case, the viewpoints of the multi-viewpoint foreground image and the multi-viewpoint rearview image are nine times in total, and the first placement pattern is a viewpoint of the first, third, fifth, seventh, And the second arrangement pattern may be an arrangement pattern in which the third, fifth, seventh, ninth, eighth, sixth, fourth, second, and one viewpoint image are repeatedly arranged.
On the other hand, the viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are a total of N viewpoints, and the first placement pattern sequentially arranges odd viewpoints from the first viewpoint to the Nth viewpoint, And the second arrangement pattern is arranged such that when N is an odd number, the first point is arranged first, and the second point is arranged from the second point to the Nth point Numbered viewpoints from the Nth viewpoint to the second viewpoint are arranged in the reverse order, and when N is an even number, Numbered viewpoints may be sequentially arranged, and then a pattern in which the odd-numbered viewpoints from the Nth viewpoint to the first viewpoint are arranged in the reverse order may be repeated.
In this case, the viewpoints of the multi-viewpoint foreground image and the multi-viewpoint rearview image are nine times in total, and the first placement pattern is a viewpoint of the first, third, fifth, seventh, And the second arrangement pattern may be an arrangement pattern in which first, second, fourth, sixth, eighth, ninth, seventh, fifth, and third viewpoint images are repeatedly arranged.
The image processing method of the 3D display apparatus according to the present embodiment includes the steps of receiving image and depth information, using a depth image, and a multi-view image having depth information less than a preset depth value, Creating a multi-viewpoint image having depth information greater than a depth value, arranging the multi-viewpoint images in a first placement pattern, placing the multi-viewpoint image in a second placement pattern and rendering, And outputting the multi-view image.
Herein, the viewpoints of the multi-view foreground image and the multi-viewpoint viewpoint are the N viewpoints, and the first placement pattern is a view from the first viewpoint to the K viewpoint when the N is an odd number (2K-1, K is a natural number) (2K, K is a natural number), the first to (K + 1) -th to (K + 1) -th to Wherein the second arrangement pattern is the same as the first arrangement pattern and is shifted by a predetermined point in time, so that the phase difference is shifted from the first point to the second point, As shown in FIG.
In this case, the viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are a total of N viewpoints, and the first placement pattern sequentially arranges odd viewpoints from the first viewpoint to the Nth viewpoint, Wherein the second arrangement pattern is a layout pattern which is the same as the first arrangement pattern and is shifted by a predetermined point so as to have a phase difference, have.
On the other hand, the viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are a total of N viewpoints, and the first placement pattern sequentially arranges odd viewpoints from the first viewpoint to the Nth viewpoint, And the second arrangement pattern is a layout pattern in which, when N is an odd number, the first point of time is arranged first, and the second point of time from the second point of time to the Nth point of time Numbered viewpoints from the Nth viewpoint to the second viewpoint are arranged in the reverse order, and when N is an even number, Numbered viewpoints may be sequentially arranged, and then a pattern in which the odd-numbered viewpoints from the Nth viewpoint to the first viewpoint are arranged in the reverse order may be repeated.
A computer readable recording medium including a program for executing an image processing method of a 3D display device according to the present embodiment includes a step of receiving an image and depth information, Point image having depth information of depth values greater than or equal to the depth value, arranging the multi-view foreground images in a first arrangement pattern, arranging the multi-viewpoint image in a first arrangement pattern, 2 arrangement pattern, and outputting the rendered multi-view image.
1 is a view for explaining a display operation of a multi-view image of a general spectacles 3D display device,
2 is a view for explaining a rendering operation of a multi-view image of a general non-eyeglass 3D display device,
3 is a block diagram showing a configuration of a 3D display device according to an embodiment of the present invention,
4 is a view for explaining an operation of a multi-view image generating unit according to an embodiment of the present invention;
5 and 6 are diagrams for explaining an arrangement pattern of multi-view images according to the first embodiment of the present invention,
7 and 8 are views for explaining an arrangement pattern of multi-view images according to a second embodiment of the present invention,
9 and 10 are views for explaining an arrangement pattern of multi-view images according to the third embodiment of the present invention,
11 is a view for explaining the operation of the multi-view image rendering unit according to an embodiment of the present invention,
12 is a flowchart for explaining an image processing method of the 3D display device of the present invention.
Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.
FIG. 3 shows a configuration of a 3D display device according to an embodiment of the present invention. The 3D display device is a device for displaying the content in a 3D manner so that the user can feel a three-dimensional feeling. Various types of devices such as a TV, a monitor, a PC, a mobile phone, a laptop computer, a tablet PC, an electronic photo frame, an electronic book, a PDA, and the like can be implemented as a 3D display device. Meanwhile, the 3D display device of the present invention is implemented by a non-spectacles 3D display method.
3, the
The
Here, the input image is one of a single view image, a stereo image, and a multi-view image. A stereoscopic image is a three-dimensional video image expressed by only a left eye image and a right eye image, and is a stereoscopic image photographed by a stereo photographing apparatus. Generally, a stereo photographing apparatus is used for photographing a stereoscopic image with a photographing apparatus having two lenses. A multiview image refers to a three-dimensional video image that geometrically corrects images photographed through one or more image capturing devices and provides various views in various directions to the user through spatial synthesis.
Meanwhile, the
Here, the depth information is a depth value assigned to each pixel of the image. For example, 8-bit depth information may have a value ranging from 0 to 255. [ Depth information can generally be obtained through a passive method of obtaining only the two-dimensional characteristics of an image, such as stereo matching, and an active method using a device such as a depth camera. On the other hand, the depth information may be a depth map.
Generally, the closer the distance is, the smaller the value, and the farther the distance is, the larger the value. Of course, the opposite case also exists, which depends on the definition, but for the sake of convenience of description, only the case where the value becomes smaller as the distance is closer will be described in this specification.
The multi-view
In the input image, the foreground image and the posterior image can be separated using the depth information of the image. Hereinafter, a method of separating the foreground image and the background image will be described.
For example, if the depth information of 8 bits is used, the depth value of each pixel is 0 to 255. In this case, the depth value serving as a reference for distinguishing between the foreground and the background can be set to 128. Here, if the depth information of the pixel is less than 128, it can be separated into the foreground image, and if it is 128 or more, it can be separated into the rear image. That is, the foreground image is a set of pixels having depth values less than 128, and the background image is a set of pixels having a depth value of 128 or more.
Here, the predetermined depth value is 128, which is the middle value of the depth value that the depth information can have. As described above, it is common to set the predetermined depth value for separating the foreground image and the background image to a medium value, but this can be changed.
The method of separating the foreground image and the background image will be further described with reference to FIG. 4. Hereinafter, a method of generating the foreground image and the back-view image using the separated foreground image and the background image will be described Explain it.
Of course, if the n-view image corresponding to the n-view point determined in the
Therefore, it is necessary to generate a virtual n-view image using a single view image or an image at a view point less than the N view.
The virtual multi-view image generation method uses the depth information of each viewpoint and the images at the surrounding viewpoint.
For example, when a two-view image is used, a plurality of new viewpoints may be created between two viewpoint images, and a one-view image and a two-view image may be sent to a three-dimensional space using the input depth information, .
This image processing technique is called 3D warping. Generally, a multi-view image generated using a two-view image rather than a single view image is less distorted.
As described above, the multi-view
The multi-view
The arrangement pattern according to each embodiment will be described in order to reduce the dead zone.
The first arrangement pattern and the second arrangement pattern according to the first embodiment are as follows.
Here, the viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are assumed to be N view points in total. The first arrangement pattern and the second arrangement pattern according to the first embodiment are different from the embodiments in which the total N time points are an odd number and an even number, respectively.
In the case where N is an odd number (2K-1, K is a natural number), the first arrangement pattern is arranged sequentially from the first point to the Kth point and then arranged in reverse order from the K-1 point to the first point Can be defined as a repeating arrangement pattern. The second arrangement pattern corresponding to the first arrangement pattern can be defined as a layout pattern that is shifted by a predetermined point and has a phase difference.
For example, in the case of a total of 9 viewpoints, the first layout pattern according to the first embodiment is a layout pattern in which first, second, third, fourth, fifth, fourth, The second placement pattern is defined as a placement pattern in which second, third, fourth, fifth, fourth, third, second, first, and second viewpoint images are repeatedly arranged.
On the other hand, when N is an even number (2K, K is a natural number), arrangements are sequentially performed from the first time point to the (K + 1) th time point, . ≪ / RTI > The second arrangement pattern corresponding to the first arrangement pattern can be defined as a layout pattern that is shifted by a predetermined point and has a phase difference.
For example, in the case of a total of 8 viewpoints, the first layout pattern according to the first embodiment is a layout pattern in which the first, second, third, fourth, fifth, fourth, The placement pattern is defined as a placement pattern in which second, third, fourth, fifth, fourth, third, second, and one viewpoint views are repeatedly arranged.
The arrangement pattern according to the first embodiment as described above will be described in detail with reference to Figs. 5 and 6. Fig.
The first arrangement pattern and the second arrangement pattern according to the second embodiment are as follows.
Here, the viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are assumed to be a total of N viewpoints as in the first embodiment. However, unlike the first embodiment, the first arrangement pattern and the second arrangement pattern according to the second embodiment are the same in the case where the total N time points are an odd number and an even number, so the description will be made without distinguishing between them.
The first arrangement pattern can be defined as a layout pattern in which the odd-numbered viewpoints from the first point to the N-th point are sequentially arranged and then the even-numbered views from the Nth point to the first point are arranged in reverse order have. The second arrangement pattern may be defined as an arrangement pattern that is the same as the first arrangement pattern and shifted by a predetermined point so as to have a phase difference.
For example, in the case of nine views in total, the first layout pattern according to the second embodiment is defined as a layout pattern in which first, third, fifth, seventh, ninth, eighth, do. The second arrangement pattern is defined as an arrangement pattern in which the third, fifth, seventh, ninth, eighth, sixth, fourth, second, and one viewpoint rearview images are repeatedly arranged.
On the other hand, in the case of a total of 8 viewpoints, the first layout pattern according to the second embodiment is defined as a layout pattern in which the first, third, fifth, seventh, eighth, sixth, fourth and second viewpoint foreground images are repeatedly arranged. The second placement pattern is defined as a placement pattern in which the third, fifth, seventh, eighth, sixth, fourth, second, and one viewpoint rearview images are repeatedly arranged.
The arrangement pattern according to the second embodiment as described above will be described in detail with reference to Figs. 7 and 8. Fig.
The first arrangement pattern and the second arrangement pattern according to the third embodiment are as follows.
Here, the viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are assumed to be a total of N viewpoints as in the first and second embodiments. However, unlike the first and second embodiments, the first arrangement pattern and the second arrangement pattern according to the third embodiment are designed in completely different arrangement patterns.
In the first arrangement pattern according to the third embodiment, odd-numbered viewpoints from the first point to the Nth point are sequentially arranged, and then a pattern for arranging the even-numbered points from the Nth point to the first point in reverse order is repeated It can be defined as a batch pattern. In the second arrangement pattern, when N is an odd number, the first time point is arranged first, the even time points from the second time point to the Nth time point are sequentially arranged, and then, from the Nth point to the second point An even number of viewpoints from an Nth viewpoint to an Nth viewpoint are sequentially arranged when N is an even number, and then an odd-numbered viewpoint from an Nth viewpoint to a first viewpoint is sequentially arranged, A pattern that arranges the viewpoints in reverse order is defined as a repeated placement pattern .
For example, in the case of nine views in total, the first layout pattern according to the third embodiment is defined as a layout pattern in which first, third, fifth, seventh, ninth, eighth, do. The second placement pattern is defined as a placement pattern in which first, second, fourth, sixth, 8th, 9th, 7th, 5th, and 3rd viewpoint images are repeatedly arranged.
On the other hand, in a total of 8 viewpoints, the first layout pattern according to the third embodiment is defined as a layout pattern in which the first, third, fifth, seventh, eighth, sixth, fourth and second viewpoint foreground images are repeatedly arranged. The second placement pattern is defined as a placement pattern in which the second, fourth, sixth, eighth, seventh, fifth, third, and first viewpoint images are repeatedly arranged.
The arrangement pattern according to the third embodiment as described above will be described in detail with reference to Figs. 9 and 10. Fig.
By designing to have the arrangement pattern as described above, there is no sudden change in the viewpoint of the video regardless of the position of the viewer, so that the dead zone disappears.
On the other hand, even when the multi-view video image in which the foreground image and the background image are not separated is arranged and rendered as in the first arrangement pattern of the first, second, and third embodiments, rapid change in the viewpoint of the image can be reduced, have.
However, in the multi-view image in which the foreground image and the background image are not separated from each other, the Stereo interval in which the viewpoints are sequentially arranged and the Pseudo Stereo interval in which the viewpoints are arranged in the reverse order occurs, And an impact due to the transition of the section may also occur.
Therefore, according to the present invention, by using a pattern in which the foreground image and the background image are arranged with a predetermined phase difference from each other, the shock caused by the transition between the regular period and the period is mitigated and the user can feel the awkward region It is possible to further reduce the effect.
The
The
4 is a view for explaining the operation of the multi-view
The whole image includes the foreground image and the posterior image. As described in FIG. 1, the foreground image is a set of pixels having depth information less than a predetermined depth value, and the background image is a set of pixels having depth information of a predetermined depth value or more.
For the sake of convenience of explanation, it is assumed that the depth information is 8 bits and can have a value of 0 to 255. [
The depth information of the pixel values representing the
4, the multi-view
5 to 10, a description will be made of a pattern for arranging multi-view images in the multi-view
5 and 6 are views for explaining an arrangement pattern of multi-view images according to the first embodiment of the present invention.
The first arrangement pattern according to the first embodiment, that is, the arrangement pattern of the multi-viewpoint image, sequentially arranges the first arrangement pattern from the first point of time to the Kth point of view, and thereafter from the K-1 point to the first point of time The patterns arranged in the reverse order can be defined as the repeated placement pattern. The arrangement pattern of the second arrangement pattern, that is, the arrangement pattern of the rear-point image, is the same as the first arrangement pattern, and can be defined as a layout pattern shifted by a predetermined point to have a phase difference. Here, the predetermined time is preferably one time, but may be changed according to the setting of the user.
Referring to FIG. 5, a dot foreground image and a multi-view image may be arranged at the optical viewpoint as shown in Table 1 below.
As shown in FIG. 5, at the
6 shows an operation of optically separating and displaying the multi-view image rendered by the
7 and 8 are views for explaining an arrangement pattern of multi-view images according to the second embodiment of the present invention.
The first arrangement pattern according to the second embodiment, that is, the arrangement pattern of the multi-view foreground images, sequentially arranges the odd-numbered viewpoints from the first viewpoint to the Nth viewpoint, and then arranges the odd-numbered viewpoints from the Nth viewpoint to the first viewpoint In a reverse order, can be defined as a repeated arrangement pattern. The arrangement pattern of the second arrangement pattern, that is, the arrangement pattern of the rear-point image, is the same as the first arrangement pattern, and can be defined as a layout pattern shifted by a predetermined point to have a phase difference. Here, the predetermined time is preferably one time, but may be changed according to the setting of the user.
Referring to FIG. 7, a point front image and a rear point rear image may be arranged at an optical point as shown in Table 2 below.
As shown in FIG. 7, at the
FIG. 8 shows an operation of optically separating and displaying the multi-view image rendered by the
9 and 10 are views for explaining an arrangement pattern of multi-view images according to a third embodiment of the present invention.
The first arrangement pattern according to the third embodiment, that is, the arrangement pattern of the multi-view foreground images, sequentially arranges the odd-numbered viewpoints from the first viewpoint to the Nth viewpoint, and then arranges the odd-numbered viewpoints from the Nth viewpoint to the first viewpoint In a reverse order, can be defined as a repeated arrangement pattern. In the second arrangement pattern, when N is an odd number, the first time point is arranged first, the even time points from the second time point to the Nth time point are sequentially arranged, and then, from the Nth point to the second point An even number of viewpoints from an Nth viewpoint to an Nth viewpoint are sequentially arranged when N is an even number, and then an odd-numbered viewpoint from an Nth viewpoint to a first viewpoint is sequentially arranged, A pattern for arranging the viewpoints in reverse order can be defined as a repeated placement pattern.
Referring to FIG. 9, a point front image and a rear point rear image may be arranged at an optical point as shown in Table 3 below.
As shown in FIG. 9, at the
10 shows an operation in which the
11 is a view for explaining the operation of the multi-view
11, the
Here, the arrangement of the pixels for each area is the one to which the arrangement pattern according to the third embodiment is applied, the number arranged in each pixel means the number of the viewpoint, f means foreground, and b means foreground.
As described above, the multi-view
12 is a flowchart for explaining an image processing method of the
Referring to FIG. 12, the
The
The method of generating the multi-view foreground image and the multi-view image is described with reference to FIG. 1, and a duplicate description thereof will be omitted.
Then, the
Here, the viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image may be total N time points.
According to the first embodiment of the present invention, when the number N is an odd number (2K-1, K is a natural number), the first arrangement pattern is sequentially arranged from the first point to the Kth point, (2K, K is a natural number) are sequentially arranged from the first time point to the (K + 1) th time point, and after that, from the k-th point to the second point-in-time in reverse order. The second arrangement pattern may be defined as an arrangement pattern that is the same as the first arrangement pattern and shifted by a predetermined point so as to have a phase difference.
Meanwhile, according to the second embodiment of the present invention, the first arrangement pattern is obtained by sequentially arranging the odd-numbered viewpoints from the first viewpoint to the Nth viewpoint, and thereafter arranging the odd-numbered viewpoints from the Nth viewpoint to the first viewpoint in reverse order The arrangement pattern can be defined as a repeated arrangement pattern. The second arrangement pattern may be defined as an arrangement pattern that is the same as the first arrangement pattern and shifted by a predetermined point so as to have a phase difference.
Meanwhile, according to the third embodiment of the present invention, the first arrangement pattern is obtained by sequentially arranging the odd-numbered viewpoints from the first viewpoint to the Nth viewpoint, and thereafter arranging the odd-numbered viewpoints from the Nth viewpoint to the first viewpoint in reverse order The arrangement pattern can be defined as a repeated arrangement pattern. In the second arrangement pattern, when N is an odd number, the first time point is arranged first, the even time points from the second time point to the Nth time point are sequentially arranged, and then, from the Nth point to the second point An even number of viewpoints from an Nth viewpoint to an Nth viewpoint are sequentially arranged when N is an even number, and then an odd-numbered viewpoint from an Nth viewpoint to a first viewpoint is sequentially arranged, A pattern for arranging the viewpoints in reverse order can be defined as a repeated placement pattern.
When the rendering is completed, the
Meanwhile, the image processing method of the
As described above, the image processing method of the
In addition, the image processing method of the
Meanwhile, the methods according to various embodiments may be programmed and stored in various storage media. As such, the methods according to various embodiments described above can be implemented in various types of electronic devices that execute the storage medium.
Further, the image processing method as described above can be implemented as a program including an executable algorithm that can be executed in a computer, and the program can be stored in a non-transitory computer readable medium have.
A non-transitory readable medium is a medium that stores data for a short period of time, such as a register, cache, memory, etc., but semi-permanently stores data and is readable by the apparatus. In particular, the various applications or programs described above may be stored on non-volatile readable media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM,
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes and modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.
100: 3D display device 110: Image input unit
120: Multi-view image generating unit 130: Multi-view image rendering unit
140:
Claims (12)
A video input unit receiving video and depth information;
A multi-view image generator for generating multi-view foreground images having depth information less than a predetermined depth value and multi-view image having depth information of the depth value or more using the input image and depth information;
A multi-view image rendering unit for arranging the multi-view foreground images in a first arrangement pattern, and arranging and rendering the multi-viewpoint images in a second arrangement pattern; And
And a display unit for outputting the rendered multi-view image.
The viewpoints of the multi-viewpoint foreground image and the multi-viewpoint viewpoint are the N viewpoints,
Wherein the first arrangement pattern comprises:
When N is an odd number (2K-1, K is a natural number), arrangements are sequentially performed from the first time point to the K time point, and thereafter, a pattern in which the patterns are arranged in the reverse order from the K- (2K, K is a natural number), the arrangement pattern is sequentially arranged from the first point to the (K + 1) th point and then arranged in the reverse order from the kth point to the second point in time. Lt;
Wherein the second arrangement pattern is the same arrangement pattern as the first arrangement pattern and is shifted by a predetermined point so as to have a phase difference.
The viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are nine times in total,
Wherein the first arrangement pattern comprises:
1, 2, 3, 4, 5, 4, 3, 2, and 1 viewpoint images are repeatedly arranged,
Wherein the second arrangement pattern comprises:
Wherein the first, second, third, fourth, fifth, fourth, third, second, first, and second viewpoint images are repeatedly arranged.
The viewpoints of the multi-viewpoint foreground image and the multi-viewpoint viewpoint are the N viewpoints,
Wherein the first arrangement pattern comprises:
An arrangement pattern in which odd-numbered time points from the first point to the N-th point are sequentially arranged, and an even-numbered point in time from the N-th point to the first point are arranged in reverse order,
Wherein the second arrangement pattern is the same arrangement pattern as the first arrangement pattern and is shifted by a predetermined point so as to have a phase difference.
The viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are nine times in total,
Wherein the first arrangement pattern comprises:
The first, third, fifth, seventh, ninth, eighth, sixth, fourth, and second viewpoint foreground images are repeatedly arranged,
Wherein the second arrangement pattern comprises:
And the third, fifth, seventh, ninth, 8th, 6th, 4th, 2th, 1nd viewpoint images are repeatedly arranged.
The viewpoints of the multi-viewpoint foreground image and the multi-viewpoint viewpoint are the N viewpoints,
Wherein the first arrangement pattern comprises:
An arrangement pattern in which odd-numbered time points from the first point to the N-th point are sequentially arranged, and an even-numbered point in time from the N-th point to the first point are arranged in reverse order,
Wherein the second arrangement pattern comprises:
When N is an odd number, the first point is arranged first, the even point is sequentially arranged from the second point to the N point, and then the odd point from the N point to the second point is arranged in reverse order In the case where N is an even number, a pattern in which even-numbered views from the first point to the N-th point are sequentially arranged and odd-numbered points from the Nth point to the first point are arranged in reverse order Wherein the display device is a repeated arrangement pattern.
The viewpoints of the multi-view foreground image and the multi-viewpoint multi-view image are nine times in total,
Wherein the first arrangement pattern comprises:
The first, third, fifth, seventh, ninth, eighth, sixth, fourth, and second viewpoint foreground images are repeatedly arranged,
Wherein the second arrangement pattern comprises:
Wherein the first, second, fourth, sixth, eighth, 9th, 7th, 5th, and 3th viewpoint images are repeatedly arranged.
Receiving image and depth information;
Generating a multi-viewpoint foreground image having depth information less than a predetermined depth value and a multi-viewpoint image having depth information of the depth value or more using the input image and depth information;
Arranging the multi-view foreground images in a first layout pattern, and arranging and rendering the multi-view image in a second layout pattern; And
And outputting the rendered multi-view image.
The viewpoints of the multi-viewpoint foreground image and the multi-viewpoint viewpoint are the N viewpoints,
Wherein the first arrangement pattern comprises:
When N is an odd number (2K-1, K is a natural number), arrangements are sequentially performed from the first time point to the K time point, and thereafter, a pattern in which the patterns are arranged in the reverse order from the K- (2K, K is a natural number), the arrangement pattern is sequentially arranged from the first point to the (K + 1) th point and then arranged in the reverse order from the kth point to the second point in time. Lt;
Wherein the second arrangement pattern is the same as the first arrangement pattern and is shifted by a predetermined point so as to have a phase difference.
The viewpoints of the multi-viewpoint foreground image and the multi-viewpoint viewpoint are the N viewpoints,
Wherein the first arrangement pattern comprises:
An arrangement pattern in which odd-numbered time points from the first point to the N-th point are sequentially arranged, and an even-numbered point in time from the N-th point to the first point are arranged in reverse order,
Wherein the second arrangement pattern is the same as the first arrangement pattern and is shifted by a predetermined point so as to have a phase difference.
The viewpoints of the multi-viewpoint foreground image and the multi-viewpoint viewpoint are the N viewpoints,
Wherein the first arrangement pattern comprises:
An arrangement pattern in which odd-numbered time points from the first point to the N-th point are sequentially arranged, and an even-numbered point in time from the N-th point to the first point are arranged in reverse order,
Wherein the second arrangement pattern comprises:
When N is an odd number, the first point is arranged first, the even point is sequentially arranged from the second point to the N point, and then the odd point from the N point to the second point is arranged in reverse order In the case where N is an even number, a pattern in which even-numbered views from the first point to the N-th point are sequentially arranged and odd-numbered points from the Nth point to the first point are arranged in reverse order Wherein the image is a repeated arrangement pattern.
The image processing method includes:
Receiving image and depth information;
Generating a multi-viewpoint foreground image having depth information less than a predetermined depth value and a multi-viewpoint image having depth information of the depth value or more using the input image and depth information;
Arranging the multi-view foreground images in a first layout pattern, and arranging and rendering the multi-view image in a second layout pattern; And
And outputting the rendered multi-view image.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP13161798.7A EP2648414B1 (en) | 2012-04-03 | 2013-03-28 | 3d display apparatus and method for processing image using the same |
| JP2013076652A JP6208455B2 (en) | 2012-04-03 | 2013-04-02 | 3D display device and video processing method thereof |
| US13/856,071 US8884952B2 (en) | 2012-04-03 | 2013-04-03 | 3D display apparatus and method for processing image using the same |
| CN201310114560.5A CN103369337B (en) | 2012-04-03 | 2013-04-03 | 3D display apparatus and method for processing image using same |
| US13/898,031 US8780111B2 (en) | 2012-11-16 | 2013-05-20 | 3D display apparatus and method for processing image using the same |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261619491P | 2012-04-03 | 2012-04-03 | |
| US61/619,491 | 2012-04-03 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| KR20130112679A KR20130112679A (en) | 2013-10-14 |
| KR101912242B1 true KR101912242B1 (en) | 2018-10-29 |
Family
ID=49633627
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020120130308A KR101912242B1 (en) | 2012-04-03 | 2012-11-16 | 3d display apparatus and method for image processing thereof |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR101912242B1 (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103945204B (en) * | 2014-04-01 | 2016-03-23 | 青岛海信电器股份有限公司 | A kind of image-signal processing method and device |
| KR101957243B1 (en) | 2014-07-09 | 2019-03-12 | 삼성전자주식회사 | Multi view image display apparatus and multi view image display method thereof |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120020548A1 (en) | 2010-07-20 | 2012-01-26 | Meng-Chao Kao | Method for Generating Images of Multi-Views |
| JP2012022085A (en) | 2010-07-13 | 2012-02-02 | Nikon Corp | Display device and control method |
-
2012
- 2012-11-16 KR KR1020120130308A patent/KR101912242B1/en active IP Right Grant
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2012022085A (en) | 2010-07-13 | 2012-02-02 | Nikon Corp | Display device and control method |
| US20120020548A1 (en) | 2010-07-20 | 2012-01-26 | Meng-Chao Kao | Method for Generating Images of Multi-Views |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20130112679A (en) | 2013-10-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6208455B2 (en) | 3D display device and video processing method thereof | |
| JP5431726B2 (en) | Combined exchange of images and related data | |
| US9083963B2 (en) | Method and device for the creation of pseudo-holographic images | |
| US8731279B2 (en) | Method and device for generating multi-viewpoint image | |
| CN106604018B (en) | 3D display device and control method thereof | |
| JPWO2012176431A1 (en) | Multi-viewpoint image generation apparatus and multi-viewpoint image generation method | |
| KR102143473B1 (en) | Multi view image display apparatus and multi view image display method thereof | |
| CN102404592A (en) | Image processing device and method, and stereoscopic image display device | |
| KR101992767B1 (en) | Method and apparatus for scalable multiplexing in three-dimension display | |
| US10939092B2 (en) | Multiview image display apparatus and multiview image display method thereof | |
| KR100980298B1 (en) | A method for trasnforming modeled 2d image to 3d image | |
| US9479766B2 (en) | Modifying images for a 3-dimensional display mode | |
| KR101912242B1 (en) | 3d display apparatus and method for image processing thereof | |
| KR101228916B1 (en) | Apparatus and method for displaying stereoscopic 3 dimensional image in multi vision | |
| KR20170036476A (en) | Multi view image display apparatus and contorl method thereof | |
| CN101908233A (en) | Method and system for producing plural viewpoint picture for three-dimensional image reconstruction | |
| KR101754976B1 (en) | Contents convert method for layered hologram and apparatu | |
| JP2016535516A (en) | Multi-view video processing apparatus and video processing method thereof | |
| US20240121373A1 (en) | Image display method and 3d display system | |
| US20130127843A1 (en) | Display apparatus and display method thereof | |
| Grasnick | Universal 4D multiplexing of layered disparity image sequences for pixel and voxel based display devices | |
| Park et al. | Comparison of perceived resolution between a parallax barrier and a lenticular array | |
| CN106231281A (en) | A kind of display converting method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A201 | Request for examination | ||
| E701 | Decision to grant or registration of patent right | ||
| GRNT | Written decision to grant |