KR101679122B1 - Method, device and system for packing and unpacking color frame and original depth frame - Google Patents

Abstract

The present invention discloses a method, apparatus and system for packaging and unpackaging a color frame and an original depth frame. Here, the color frame and the original depth frame correspond to each other, the packaged frame can be displayed on the screen, and the method of packaging the color frame and original depth frame can be achieved by resizing the size of the original depth frame to obtain a resized depth frame step; And combining the color frame and the resized depth frame to obtain a packaged frame, the center of the color frame being displayed in a central area of the screen. In addition, a method of unpackaging a packaged frame may include separating the color frame and the resized depth frame from the packaged frame; And restoring the resized depth frame to obtain an original depth frame.

Description

[0001] METHOD, DEVICE AND SYSTEM FOR PACKING AND UNPACKING COLOR FRAME AND ORIGINAL DEPTH FRAME [0002]

The present invention relates to a method, apparatus and system for packing and unpacking a color frame and an original depth frame.

Along with the advancement of science and technology, the development of current electronic products all take priority to improve the performance and quality of products. Here, in addition to providing a clear and comfortable display screen to the user in the installation of the display device, each manufacturer continuously releases a variety of 3D (three-dimensional) display devices capable of providing multi-view 3D images, It gives a new visual impression simulating reality.

At this stage, the 3D image generation system generates a depth frame corresponding to the color frame by using the original 2D image data, i.e., a color frame, And transmits the depth frame to the user's 3D display device. Here, in order to reduce the amount of data to be transmitted and to improve the image transmission efficiency, generally, a color frame and a depth frame are firstly packaged to obtain a packed frame, and then a packaged frame To the user's 3D display device. After receiving the packaged frame from the 3D display device, unpackaging can be performed to restore and create the color frame and the depth frame. Then, two or more multi-view images which can be used in all non-eye-safe 3D display devices are obtained by Depth-Image-based Rendering (DIBR), or left eye image and right eye image of a spectacle- Can be obtained.

However, at present, the home TV generally has a 2D display device as its main feature and does not have a function of processing a multi-view image or a right eye / left eye image. Therefore, when a 3D image signal is received in a general 2D display device, The right eye image is reduced by half, resulting in a combined result, or a result of a single view, a left-right arrangement of single depths. Currently, in the development stage of the 3D image, the method of dividing the left eye and the right eye by half in the general 2D display device by the above-mentioned joining method or arrangement method, or the color frame and the depth according to the single view single- When broadcasting a frame, a 2D image (color frame) actually seen by a human eye is not only unnatural but also inconvenient.

It is an object of the present invention to provide a packaging frame that can be displayed directly on a 2D screen as well as packaging color frames and original depth frames that 2D images actually seen by the human eye do not cause a very natural and uncomfortable feeling A method, apparatus and system for obtaining a packaged frame. In addition, the present invention provides a method, apparatus, and system for unpackaging a packaged frame that is distinct from existing technology.

In order to achieve the above object, there is provided a method of packaging a color frame according to the present invention and an original depth frame corresponding to the color frame to obtain a packaged frame which can be displayed on a screen, To obtain a depth-of-field frame; And combining the color frame and the resized depth frame to obtain a packaged frame, wherein the center of the color frame is displayed in a central area of the screen.

In order to achieve the above object, there is provided an apparatus for packaging a color frame and an original depth frame corresponding to the color frame according to the present invention to obtain a packaged frame capable of displaying on a screen, the apparatus comprising: A size processing unit for obtaining a depth frame; And a combination processing unit for combining the color frame and the resized depth frame to obtain a packaged frame. Here, the center of the color frame is displayed in the central area of the screen.

In order to achieve the above object, there is provided a system for packaging a color frame according to the present invention and an original depth frame corresponding to the color frame to obtain a packaged frame displayable on a screen, A storage unit; And resizing the size of the original depth frame to obtain a resized depth frame, and combining the color frame and the resized depth frame to obtain a packaged frame. Here, the center of the color frame is displayed in the central area of the screen.

To achieve the above object, a packaged frame may be displayed on a screen and includes a color frame and a resized depth frame, wherein the color frame and the resized depth frame correspond to each other, and the center of the color frame corresponds to the center CLAIMS What is claimed is: 1. A method of unpackaging a packaged frame according to the present invention, the method comprising: separating a color frame and a resized depth frame from a packaged frame; And restoring the resized depth frame to obtain an original depth frame.

To achieve the above object, a packaged frame may be displayed on a screen and includes a color frame and a resized depth frame, wherein the color frame and the resized depth frame correspond to each other, and the center of the color frame corresponds to the center An apparatus for unpackaging a packaged frame according to the present invention, the apparatus comprising: a separation processing unit for separating a packaged frame to obtain a color frame and a resized depth frame; And a reconstruction processing unit for reconstructing the resized depth frame to obtain the original depth frame.

To achieve the above object, a packaged frame may be displayed on a screen and includes a color frame and a resized depth frame, wherein the color frame and the resized depth frame correspond to each other, and the center of the color frame corresponds to the center A system for unpackaging a packaged frame displayed in a region, the system comprising: a storage unit for storing a packaged frame; And a processing unit for separating the packaged frame to obtain a color frame and a resized depth frame, and restoring the resized depth frame to obtain an original depth frame.

As described above, in a method, an apparatus and a system for packaging a color frame and an original depth frame according to the present invention to obtain a packaged frame, a color frame and a resized depth frame are combined to form a packaged Frame. Thus, after the packaged frame is restored by the restoration program to obtain the original color frame or the original depth-of-view frame, the 3D display device can accurately generate an unsharp multi-view stereoscopic image or a spectacled double-view stereoscopic image by depth- It is preferable that the center point of the color frame and the center point of the screen overlap each other and more preferably the center point of the color frame and the center point of the screen are superimposed on each other Not only can the packaged frame be displayed directly on the 2D screen, but also the 2D image (i.e., the color frame) actually observed by the human eye will not cause a very natural and uncomfortable feeling. In addition, in a method, apparatus and system for packaging color frames and original depth frames disclosed by the present invention, the steps of resizing the size of the original depth frame to obtain a resized depth frame and combining the color frame and the resized depth frame So that it can be used in combination with other image compression systems to improve the compression efficiency and lower the bandwidth related requirements required for the 3D stereoscopic image signal, It is advantageous.

In addition, in a method, apparatus and system for packaging a packaged frame according to the present invention, the color frame and the resized depth frame are separated from the packaged frame and the resized depth frame is recovered to obtain the original depth frame . Accordingly, the method, apparatus, and system for unpackaging a packaged frame of the present invention are distinguished from existing techniques.

1A is a flow chart of a method of packaging a color frame and original depth frame of a preferred embodiment of the present invention.
1B is a functional block diagram of an apparatus for packaging color frames and original depth-of-field frames of a preferred embodiment of the present invention.
FIGS. 2A to 2D are explanatory diagrams of processing steps of an original depth frame of the first embodiment. FIG.
FIGS. 3A and 3B are explanatory diagrams of processing of the original color frame of the first embodiment.
4A is an explanatory diagram of the packaged frame of the first embodiment.
Fig. 4B is a relative illustration of a color frame and a screen when displaying the packaged frame of the first embodiment on a 2D display device. Fig.
4C is a pictorial illustration of another packaged frame obtained by a method and apparatus for packaging color frames and original depth frames.
4D is an explanatory diagram of the central area of the screen in the embodiment of the present invention.
FIGS. 5A to 5D are explanatory diagrams of processing of an original depth frame of the second embodiment.
FIGS. 6A and 6B are explanatory diagrams of processing of the original color frame of the second embodiment.
7A is an explanatory diagram of the packaged frame of the second embodiment.
Fig. 7B is a relative descriptive diagram of a color frame and a screen when displaying the packaged frame of the second embodiment on a 2D display device. Fig.
7C is an image explanatory diagram of another packaged frame obtained by a method and apparatus for packaging color frames and original depth-of-view frames.
Figure 8 is a functional block diagram of an apparatus for packaging color frames and original depth-of-field of another aspect of a preferred embodiment of the present invention.
9A to 9D are explanatory diagrams of processing steps of the original depth frame in the third embodiment.
FIGS. 10A and 10B are explanatory diagrams of the process of the original color frame of the third embodiment. FIG.
11A is an explanatory diagram of a packaged frame of the third embodiment.
11B is a relative descriptive diagram of a color frame and a screen when displaying the packaged frame of the third embodiment on a 2D display device.
11C is a pictorial illustration of another packaged frame obtained by a method and apparatus for packaging color frames and original depth frames.
12 is a functional block diagram of a system for packaging color frames and original depth-of-field frames of a preferred embodiment of the present invention.
13A is a flow chart of a method of unpackaging a packaged frame of a preferred embodiment of the present invention.
13B is a functional block diagram of an apparatus for unpackaging a packaged frame of a preferred embodiment of the present invention.
Figs. 14 to 16B are explanatory diagrams of the process of unpackaging the packaged frame of the fourth embodiment. Fig.
17A is a relative descriptive diagram of a color frame and a screen when displaying the packaged frame of the fourth embodiment on a 2D display device.
17B is an explanatory diagram of a central area of the screen in the embodiment of the present invention.
Figs. 18 to 20B are explanatory diagrams of the process of unpackaging the packaged frame of the fifth embodiment. Fig.
Fig. 21 is a relative descriptive diagram of a color frame and a screen when displaying the packaged frame of the fifth embodiment on a 2D display device. Fig.
Figs. 22 to 24B are explanatory diagrams of the process of unpackaging the packaged frame of the sixth embodiment. Fig.
Fig. 25 is a relative descriptive diagram of a color frame and a screen when the packaged frame of the sixth embodiment is displayed on a 2D display device. Fig.
26 is a functional block diagram of the unpackaged system of a packaged frame of a preferred embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A method, apparatus and system for packaging a color frame and an original depth-of-field of a preferred embodiment according to the present invention will be described with reference to the following related drawings. Here, the same components are denoted by the same reference numerals.

Described below is a method, apparatus, and system for packaging a color frame and an original depth-of-field to obtain a packaged frame.

1A and 1B, wherein FIG. 1A is a flow chart of a method for packaging a color frame and original depth frame of a preferred embodiment of the present invention to obtain a packaged frame, and FIG. 1B is a flowchart of a preferred embodiment of the present invention (Hereinafter referred to as " device 1 ") for packaging an exemplary color frame and original depth-of-field to obtain a packaged frame. The packaged frame obtained by the present invention can be displayed directly on the screen. At this time, the screen is a screen of a 2D display device, and the resolution of the 2D display device may be 1920 x 1080 pixels, but is not limited thereto.

As shown in FIG. 1A, a method for packaging a color frame and an original depth-of-field to obtain a packaged frame includes steps S01 and S02. 1B, the apparatus 1 includes a size-processing unit 11 and a combination processing unit 12. The size- Further, the apparatus 1 further includes a division processing unit 13 and a flipping processing unit 14. [ The details of the method and apparatus 1 for packaging color frames and original depth frames to obtain a packaged frame will now be described with reference to FIGS. 2A to 4B.

FIGS. 2A to 2D are explanatory diagrams of processing steps of an original depth frame of the first embodiment. FIG. Here, FIG. 2A is an original depth frame, FIG. 2B is a middle depth frame, FIG. 2C is a resized depth frame, and FIG. 2D is a two-part resized depth frame after division and flipping. 3A and 3B, FIGS. 3A and 3B are explanatory diagrams of processing of the original color frame of the first embodiment. Here, FIG. 3A is an original color frame, and FIG. 3B is a color frame after the resizing in FIG. 3A.

In this embodiment, the color frame is obtained by the size of the original color frame that is resized. Here, the original color frame has a preset frame size, and the size may be 1920 x 1080 pixels, but is not limited thereto, which is the same as the image resolution of the current high definition 2D display device. At this time, the sizes of the original depth frame and the original color frame are the same, all of which have a preset frame size. Of course, in other embodiments, the preset frame sizes may be different values. In addition, the column direction D1 and the row direction D2 are displayed in the sign, where the column direction D1 is the horizontal direction of the displayed frame image and the row direction D2 is the vertical direction of the displayed frame image. In addition, a particular point to be noted is that monochrome images are displayed in Figs. 3A and 3B, but in fact, Figs. 3A and 3B are displayed as color images in the color display device.

Here, the original depth frame and the original color frame correspond to each other. At this time, 'correspondence' indicates that the original depth frame is obtained by the depth value of all objects of the original color frame, in addition to the size and resolution of both. In addition, the original color frame and original depth frame can be synthesized into a 3D image that can be reproduced in a 3D display device by Depth-Image-Based Rendering (DIBR). Since the original depth frame and the original color frame correspond to each other, the original depth frame also corresponds to the color frame.

First, in a method for packaging a color frame and an original depth frame to obtain a packaged frame, as shown in FIG. 1A, step S01 resizes the size of the original depth frame to produce a resized depth frame 2a is adjusted to Fig. 2c). Here, since the original depth frame of FIG. 2A is a grayscale frame, the subpixel values of each pixel all have the same value (with the same gray scale value). The quantity of each pixel may be two or more. At this time, each pixel has, for example, three sub-pixels R, G and B, respectively.

In step S01, before obtaining the resized depth frame of Fig. 2C, the size of the original depth frame of Fig. 2A is resized first in this embodiment to obtain the intermediate depth frame of Fig. 2B, The subpixel rearrangement is performed to obtain the resized depth frame of FIG. 2C. Here, resizing the size of the original depth frame to obtain the intermediate depth frame can be achieved by lowering the size ratio of the original depth frame or lowering the resolution of the original depth frame. In this embodiment, the intermediate depth frame of Fig. 2B is obtained by proportionally scaling down the original depth frame of Fig. 2A by the size processing unit 11. Fig. At this time, the size of the intermediate depth frame is reduced to 3/4 of the original depth frame in the row direction D2. Therefore, the size of the medium depth frame is 1920 x 810 (810 = 1080 x 3/4).

Subsequently, the subpixel rearrangement proceeds. According to the subpixel rearrangement, two subpixel values of three pixels of the middle depth frame are obtained, and the subpixel values are stored correspondingly in three subpixels of one pixel of the resized depth frame. At this time, since the original depth frame is a gray scale frame, the three subpixel values of each pixel are all the same. Therefore, each pixel can take a value of any subpixel in it and make it a representative value. Here, according to the subpixel rearrangement, the subpixel values of the three pixels of the intermediate depth frame are respectively stored in the three subpixels of one pixel of the resized depth frame. In other words, the subpixel value of the first pixel of the intermediate depth frame is stored in the first subpixel of the first pixel of the resized depth frame, and the subpixel value of the second pixel of the intermediate depth frame is stored in the subpixel of the resized depth frame And stores the subpixel value of the third pixel of the intermediate depth frame in the third subpixel of the first pixel of the resized depth frame. This is analogous to the above. At this time, the resized depth frame of FIG. 2C can be obtained by reducing the size of the intermediate depth frame of FIG. 2B along the row direction D2 by 1/3, and the resolution thereof is 1920 × 270 (270 = 810 × 1 / 3).

Therefore, the size of the resized depth frame in Fig. 2C of this embodiment is 1/4 (3/4 x 1/3) of the original depth frame in the row direction D2. Using the technique of subpixel rearrangement, the gray scale values of the pixels in three rows of the intermediate depth frame can be stored in three subpixels of one pixel of the resized depth frame, so that compared to the original depth frame, Can have a high coding efficiency and a high data rate, and can improve the transmission efficiency when applied to transmission.

The subpixel rearrangement can reduce the frame, and may also be referred to as a 'subpixel packing rearrangement'.

In addition, the size of the original color frame can be resized to obtain the color frame by lowering the size ratio of the original color frame or lowering the resolution of the original color frame. In this embodiment, the color frame of Fig. 3B is obtained by reducing the original color frame of Fig. 3A by the size processing unit 11. Fig. At this time, the size of the color frame in Fig. 3B is reduced by 3/4 of the original color frame in proportion to the row direction D2. In other words, the color frame of Fig. 3B is obtained by reducing the size of the original color frame of Fig. 3A in the present embodiment to the existing 3/4 in equal proportion in the row direction D2. Therefore, the resolution of the color frame is 1920 x 810 (810 = 1080 x 3/4). However, in other embodiments, the size reduction may be reduced according to other different proportions, or the size may be reduced along the column direction D1, or may be reduced in size along the row direction D2 and the column direction D1 However, the present invention is not limited to this.

After obtaining the color frame and the resized depth frame, proceed to step S02. According to step S02, the color frame and the resized depth frame are combined to obtain a packaged frame. However, in step S02 of combining the color frame and the resized depth frame by the combination processing unit 12, the resizing depth frame of Fig. 2C is divided by the dividing processing unit 13 in the horizontal direction And divided into two parts (divided in the column direction D1). Next, the two portions (the size of each portion is 1920 x 135) of FIG. 2D are obtained by flipping the two portions by the flipping processing unit 14, and the two portions of the resized depth frame after flipping The packaged frame of Fig. 4A is obtained by combining the portions above and below the color frame by the combination processing unit 12, respectively. Here, the flip means that the flip is turned 180 degrees and turned upside down. The sizes of the two portions of the resized depth frame after division in this embodiment are the same.

As shown in FIG. 4B, FIG. 4B is a relative descriptive view of the color frame and screen when displaying the packaged frame of the first embodiment on a 2D display device.

After the packaged frame is restored by the restoration program to obtain the original color frame or the original depth frame, the 3D display device displays the non-eyeglass multi-view stereoscopic image or the spectacular double image by the Depth-Image-based Rendering (DIBR) 4b, the packaged frame can be displayed directly on the screen of the 2D display device, and the center point of the color frame (i.e., the intersection of the color frame diagonals) And the center point of the screen (that is, the intersection of the screen diagonal lines) are overlapped (all the center points O). Thus, the packaged frame can be displayed directly on the 2D screen, and a color frame (i.e., a 2D image) that is actually observed by the human eye, as shown in Fig. 4A, also feels very natural and relatively uncomfortable . Of course, in addition to the overlapping of the center points in order to avoid feeling uncomfortable when viewing the 2D screen with the human eye, according to the test results, even when the center of the color frame is displayed in the central area of the screen, can do. Here, the center region includes a range formed by a center point of the screen and a certain number of pixels extending out of the center. The central region may be circular or quadrilateral. For example, referring to FIG. 4D, FIG. 4D is an illustration of a central area of the screen when displaying a packaged frame on a 2D display device in an embodiment of the present invention. In FIG. 4D, the central area CA of the screen includes its screen center O and extends outward to cover, for example, 1/3 of the screen size. When the center of the color frame is placed in the area, the viewer does not feel uncomfortable.

In addition, it should be noted again that in the first embodiment, the size of the packaged frame of FIG. 4A is the same as the preset frame size of the original color frame of FIG. 3A, all 1920 × 1080 (1080 = 135 + 810 + 135). According to the existing technique, since both the original color frame and the original depth-of-field array use a single view and a single-depth left-right arrangement method, the image resolution after the arrangement is doubled, resulting in a burden on the transmission bandwidth. However, the method of obtaining the packaged frame by packaging the color frame and original depth frame, and the size of the packaged frame after packaging by the device (1) are identical to the original color frame (or original depth frame), all 1920 x 1080 to be. In addition, the method and apparatus for packaging the color frame and original depth frame to obtain a packaged frame can achieve relatively good compression efficiency by being used in combination with any image compression method, and when applied to transmission, The frame does not incur the burden of the transmission bandwidth and does not lead to overload of the user's 3D display device due to an excessive amount of computation due to unpackaging.

5A to 5D, FIGS. 5A to 5D are explanatory diagrams for explaining the process of the original depth frame of the second embodiment. 5A is an original depth frame, FIG. 5B is an intermediate depth frame, FIG. 5C is a resized depth frame, and FIG. 5D is a two-part resized depth frame after division and flipping. 6A and 6B, FIGS. 6A and 6B are explanatory diagrams of processing of the original color frame of the second embodiment. Here, FIG. 6A is an original color frame, and FIG. 6B is a color frame after the resizing in FIG. 6A.

5A to 5D are the same as FIGS. 2A to 2D, but the frame resizing progresses in the column direction D1 while maintaining the height 1080 of the frame. Here, the size of the resized depth frame in Fig. 5C is 1/4 (480 x 1080) of the original depth frame in Fig. 5A in the column direction D1, and the average division along the vertical direction and the resized depth frame after flipping (240 x 1080, Fig. 5D) are combined on the left and right sides of the color frame (1440 x 1080) reduced by 3/4 in the horizontal direction of Fig. 6B by the combination processing unit 12, Lt; RTI ID = 0.0 > 7B < / RTI > is displayed on the screen.

In other embodiments, the size can be reduced simultaneously in the row direction D2 and column direction D1. In addition, the reduction size of the depth frame and the color frame may be other different proportions. In addition, if the size of the color frame is reduced to a times the original color frame in one direction and the size of the intermediate depth frame is reduced to b times the original depth frame in the same direction, it suffices to satisfy a + b / 3 = In the present invention, values of a and b are not particularly limited. In the first embodiment described above, the reduction ratio of the intermediate depth frame along the row direction D2 and the reduction ratio of the color frame along the row direction D2 are the same, that is, a = b = 3/4. In the second embodiment, the reduction ratio of the intermediate depth frame along the column direction D1 and the reduction ratio of the color frame along the column direction D1 are the same, that is, a = b = 3/4.

It should be noted that the color frame of the above embodiment is obtained by resizing the size of the original color frame. However, in other embodiments, packaged frames of different sizes can be obtained by directly combining the two parts of the color frame and the resized depth frame. The size processing unit 11, the combination processing unit 12, the division processing unit 13 and the flipping processing unit 14 described above can implement the functions by a software program, For example, an MCU. Alternatively, the functions of the size processing unit 11, the combination processing unit 12, the division processing unit 13, and the flipping processing unit 14 can be implemented by applying the hardware or firmware, The present invention is not limited thereto.

4C or 7C, this is a method of packaging a color frame and an original depth-of-field, and an image explanatory view of another packaged frame obtained by the apparatus 1. Fig. The sizes are 1920 x 1080 respectively.

As can be seen from FIG. 4C or FIG. 7C, the portrait image in the color frame actually visible by the human eye is not only very natural but also does not cause an uncomfortable feeling.

8, there is shown a functional block diagram of a device 1a (hereinafter referred to as 'device 1a') for packaging color frames and original depth frames of another embodiment of the preferred embodiment of the present invention, .

The main distinction from the device 1 of Fig. 1B is that the device 1a comprises a pivoting processing unit 14a, but does not include a flipping processing unit 14. [

Referring again to FIGS. 1A and 8 and also to FIGS. 9A-11A, the details of a third embodiment of a method and apparatus for packaging colored frames and original depth frames to obtain a packaged frame is described . 9A to 9D are explanatory diagrams of processing steps of the original depth frame in the third embodiment. Here, FIG. 9A is an original depth frame, FIG. 9B is an intermediate depth frame, FIG. 9C is a resized depth frame, and FIG. 9D is a two-part resized depth frame after division and rotation. 10A and 10B are explanatory diagrams of the process of the original color frame of the third embodiment. Here, FIG. 10A is an original color frame, and FIG. 10B is a color frame after the resizing in FIG. 10A. In the third embodiment, the same original depth frame and original color frame as in the first embodiment will be described. Therefore, FIGS. 9A and 2A are the same, and FIGS. 10A and 3A are the same.

In step S01, the size of the original depth frame is resized to obtain a resized depth frame (Figs. 9A to 9C). In step S01, before obtaining the resized depth frame of FIG. 9C, the embodiment first resizes the size of the original depth frame of FIG. 9A to obtain the intermediate depth frame of FIG. 9B, By proceeding with the rearrangement, the resized depth frame of FIG. 9C is obtained. At this time, the original depth frame of FIG. 9A is proportionally reduced by the size processing unit 11 to obtain the intermediate depth frame of FIG. 9B. Here, the size of the original depth frame in Fig. 9A in the row direction (D2) is reduced to 2/3 of the original size, and the size in the column direction (D1) is reduced to 9/16, . Therefore, the resolution of the intermediate depth frame is 1080 x 720 (1080 = 1920 x 9/16, 720 = 1080 x 2/3). In addition, since the subpixel rearrangement has been described in detail above, redundant description will be omitted. Thus, in this embodiment, the resolution of the intermediate depth frame of FIG. 9B is reduced to 1/3 of the original size in the row direction D2 through subpixel rearrangement so that the resolution is 1080 x 240 (240 = 720 x 1/3) The resized depth frame of FIG. 9C can be obtained. Therefore, the size of the resized depth frame in Fig. 9C is 2/9 (1/3 x 1/3) of the original depth frame in the row direction D2, and the column direction D1 is 9/16 of the original depth frame to be.

In addition to this, in the present embodiment, the original color frame of Fig. 10A is reduced by the size processing unit 11 to obtain the color frame of Fig. 10B. In this case, the size of the color frame in Fig. 10B is a size reduced by 7/8 of the original color frame in Fig. 10A in proportion to the column direction D1. Therefore, the resolution of the color frame is 1680 x 1080 (1680 = 1920 x 7/8).

After obtaining the color frame and the resized depth frame, proceed to step S02. According to step S02, the color frame and the resized depth frame are combined to obtain a packaged frame. However, in the step S02 of combining the color frame and the resized depth frame by the combination processing unit 12, the embodiment first divides the resized depth frame of Fig. 9C by the division processing unit 13 in the horizontal direction (In this case, divided in the column direction D1), and then the two parts are rotated by the rotation processing unit 14a so that the two parts of FIG. 9d 120 x 1080). Then, the packaged frame of FIG. 11A is obtained by combining the two portions of the rotated resized depth frame with the left and right sides of the color frame by the combination processing unit 12, respectively. At this time, the rotation is to rotate clockwise by 90 degrees. Thus, as can be seen from the packaged frame of Fig. 11A, the size of the packaged frame of this embodiment is the same as the preset frame size of the original color frame, and is still 1920 x 1080 (1920 = 120 + 1680 + 120).

In addition, referring to FIG. 11B, FIG. 11B is a relative descriptive view of the color frame and screen when displaying the packaged frame of the third embodiment on a 2D display device.

After the packaged frame is restored by the restoration program to obtain the original color frame or the original depth frame, the 3D display device displays the non-eyeglass multi-view stereoscopic image or the spectacular double image by the Depth-Image-based Rendering (DIBR) 11B, the packaged frame can be displayed directly on the screen of the 2D display device, and the center point of the color frame (i.e., the intersection of the color frame diagonal lines) And the center point of the screen (that is, the intersection of the screen diagonal lines) are overlapped (all the center points O). Thus, the packaged frame can be displayed directly on the 2D screen, and a color frame (i.e., a 2D image) actually observed by a human eye, as shown in Figure 11A, also feels very natural and relatively uncomfortable . Of course, in order to achieve the same effect as in the above embodiment, the center of the color frame may be displayed in the central area of the screen, but is not limited to the center point overlap.

In addition, it should be noted again that in the third embodiment, the size of the packaged frame of Fig. 11A is the same as the preset frame size of the original color frame of Fig. 10A, all 1920 x 1080 (1080 = 135 + 810 + 135). Thus, the method of packaging color frames and original depth frames as in the first embodiment, and the packaged frames after being packaged by the device 1a, can be used in combination with any image compression method to achieve a relatively good compression efficiency When applied to transmission, the packaged frame does not incur the burden of the transmission bandwidth and also does not cause the user to overload the 3D display device due to an excessive amount of computation due to unpackaging.

In addition, in the third embodiment, the original depth frame of Fig. 9A is resized in the column direction D1 and the height thereof is made the same (the width is adjusted from 1920 to 1080). If the reduction ratio of the original color frame to the column direction D1 is c and the height of the original color frame is not adjusted and the reduction ratio of the original depth frame to the row direction D2 is d, then c + (original height / Original width) x (d / 3) = 1. The present invention is not particularly limited with respect to the values of c and d which are proportional to the reduction ratio. In the third embodiment, c = 7/8 and d = 2/3.

In addition, referring to Fig. 11C, Fig. 11C shows a method of packaging a color frame and an original depth frame, and an image explanatory view of another packaged frame obtained by the apparatus 1a.

The size of Fig. 11C is still 1920 x 1080. As can be seen from Fig. 11C, the portrait image in the color frame actually observed by the human eye does not cause a very natural and uncomfortable feeling.

12, FIG. 12 is a functional block diagram of a system 2 (hereinafter referred to as 'system 2') for packaging color frames and original depth frames of the preferred embodiment of the present invention.

The system 2 includes a storage unit 21 for storing a color frame and an original depth frame and a processing unit 22 electrically connected to the storage unit 21. [ Of course, the storage unit 21 may store the resized depth frame and its two parts, the intermediate depth frame, the packaged frame or the original color frame. Here, the storage unit 21 may be a non-transitory computer readable storage medium and may be, for example, a memory, a memory card, a CD, a video tape, a computer tape, Or a combination thereof. Here, the memory may be, but is not limited to, a ROM, a RAM, a flash memory or a field-programmable gate array (FPGA) or other type of memory.

The processing unit 22 may include core control components of the system 2 and may include, for example, at least one central processing unit (CPU) and memory or other control hardware, software or firmware have. Here, the processing unit 22 causes the size of the original depth frame to be resized to obtain the intermediate depth frame, and the subpixel rearrangement is performed on the intermediate depth frame to obtain the resized depth frame. In addition, in one embodiment, the processing unit 22 further divides the resized depth frame into two portions and combines the two portions of the resized depth frame with the upper and lower sides of the color frame, respectively, to obtain the packaged frame . At this time, the processing unit 22 further flips each of the two portions of the resized depth frame before combining the two portions of the resized depth frame with the upper and lower portions of the color frame, respectively.

In addition, in another embodiment, the processing unit 22 further divides the resized depth frame into two parts, combining the two portions of the resized depth frame with the left and right sides of the color frame, respectively, to obtain the packaged frame do. At this time, the processing unit 22 further rotates each of the two portions of the resized depth frame before combining the two portions of the resized depth frame to the left and right sides of the color frame, respectively. In addition, the processing unit 22 obtains a color frame by further resizing the size of the original color frame.

In addition, the center of the color frame is displayed in the center area of the screen, preferably the center point of the color frame and the center point of the screen overlap. Here, the screen is a 2D screen. In addition, other technical features of the original depth frame, the intermediate depth frame, the resized depth frame, the color frame, the original color frame, and the packaged frame have been described above in detail, and redundant description will be omitted.

Next, a method, apparatus and system for unpackaging a packaged frame will be described.

13A is a flowchart of a method of unpackaging a packaged frame of a preferred embodiment of the present invention, and FIG. 13B is a flowchart of a method of unpackaging a packaged frame 3 of a preferred embodiment of the present invention (Hereinafter referred to as " device 3 ").

As shown in Fig. 13A, the unpackaged method of the packaged frame of this embodiment includes steps P01 and P02. 13B, the apparatus 3 further includes a separation processing unit 31 and a restoration processing unit 32, and further includes a rotation processing unit 33 and a combination processing unit 34 . At this time, the separation processing unit 31, the restoration processing unit 32, the rotation processing unit 33, and the combination processing unit 34 may implement the function by the software program and be executed by the processing apparatus, The functions of the size processing unit 31, the combination processing unit 32, the division processing unit 33 and the flipping processing unit 34 described above can be implemented by applying hardware or firmware. .

14 to 16B, the details of the unpackaging method and apparatus 3 of the packaged frame will be described. Here, Figs. 14 to 16B are explanatory diagrams of the unpackaging process of the packaged frame of the fourth embodiment. 15A is an explanatory view of two portions of the resized depth frame, FIG. 15B is an explanatory view of the resized depth frame, and FIG. 15C is an explanatory view of the medium depth frame; and FIG. Fig. 15D is an explanatory diagram of an original depth frame, Fig. 16A is an explanatory diagram of a color frame, and Fig. 16B is an explanatory diagram of an original color frame. In addition, a black and white image is displayed in FIGS. 14, 16A and 16B, but in fact, FIGS. 14, 16A and 16B are displayed as color images in the color display device.

In this embodiment, the packaged frame of Fig. 14 is the same as Fig. 4A, and the size is 1920 x 1080. This can be displayed directly on the 2D screen since it is equal to the image resolution of the current high definition 2D display device. The packaged frame includes a color frame and a resized depth frame. The color frame of this embodiment is located in the middle portion of the frame packaged in the color 2D image, and the resized depth frame is located on both sides of the color frame.

In step P01 of the packaged frame unpackaging method, as shown in FIG. 13A, the color frame and the resized depth frame are separated from the packaged frame (the two parts of the resized depth frame of FIG. 14 to FIG. Separating the color frame of Fig. 16A). This embodiment separates the two parts (horizontal division) of the resized depth frame from the top and bottom sides of the frame packaged by the separation processing unit 31 to obtain two parts of the resized depth frame of Fig. . At this time, the two portions of the depth frame resized in the column direction (D1) are separated.

After obtaining the two portions of the resized depth frame, it is combined into a resized depth frame by the combination processing unit 34 (i.e., Fig. 15A to Fig. 15B). However, before combining with the resized depth frame, the two parts of the resized depth frame are each first flipped by the rotation processing unit 33, Combine the two parts into a resized depth frame. At this time, flipping means turning the two portions of the resized depth frame 180 degrees each turn upside down. The sizes of the two parts of the resized depth frame of this embodiment are the same, all 1920 x 135. Thus, the size of the combined resized depth frame is 1920 x 270, and the size of the color frame is 1920 x 810 (810 = 1080-135-135).

Subsequently, the process proceeds to step P02. In step P02, the resized depth frame is restored to obtain the original depth frame (restored in FIG. 15B to FIG. 15D). However, before obtaining the original depth frame in Fig. 15D, in the present embodiment, the subpixel rearrangement is first performed on the resized depth frame in Fig. 15B to obtain the intermediate depth frame in Fig. 15C and the size of the intermediate depth frame is resized Thereby obtaining the original depth-of-field shown in Fig. 15D. At this time, the subpixel rearrangement acquires the first subpixel value and the second pixel value of the pixels of the resized depth frame, stores the first subpixel value in all the subpixels of the first pixel of the intermediate depth frame, 2 < / RTI > subpixel values in all subpixels of the second pixel of the medium depth frame. In other words, if there are three subpixels in one pixel, the subpixel rearrangement stores the first subpixel value of the first pixel of the resized depth frame in all subpixels of the first pixel of the middle depthframe Stores the second subpixel value of the first pixel of the resized depth frame in all subpixels of the second pixel of the intermediate depth frame and stores the third subpixel value of the first pixel of the resized depthframe back to the midpoint depth frame Lt; RTI ID = 0.0 > of the third < / RTI > This is analogous to the above.

Therefore, in this embodiment, the size of the resized depth frame of Fig. 15B is resized to three times the original size in the row direction D2, so that the size of the middle depth frame of Fig. 15C corresponds to the size of the depth frame resized in the row direction D2 3 times (data amount is also tripled). Therefore, the resolution of the intermediate depth frame in Fig. 15C is 1920 x 810 (810 = 270 x 3).

Then, the reconstruction processing unit 32 restores the intermediate depth frame to the original depth frame (restored in Fig. 15C to Fig. 15D). Here, restoring the intermediate depth frame to the original depth frame can be achieved by proportionally increasing the size of the intermediate depth frame or increasing the resolution of the intermediate depth frame. In this embodiment, the intermediate depth frame of Fig. 15C is enlarged in proportion to the row direction D2 to obtain the original depth frame of Fig. 15D. At this time, the size of the original depth frame is increased by 4/3 times the middle depth frame in proportion to the row direction D2. Therefore, as shown in Fig. 15D, the size of the original depth frame is 1920 x 1080 (1080 = 810 x 4/3). Here, the original depth frame is a gray scale frame (the subpixel values of each pixel of the gray scale frame are all the same).

In addition to this, the unpackaging method further includes restoring the color frame to obtain the original color frame (Fig. 16A to Fig. 16B). At this time, the restoration processing unit 32 restores the color frame and enlarges the size (1920 x 810) of the color frame in the row direction D2 in proportion to the original size 4/3, thereby obtaining the original color frame. Therefore, the size of the original color frame in Fig. 16B is 1920 x 1080 (1080 = 810 x 4/3). Here, the original color frame of this embodiment has a preset frame size, and the size of the packaged frame and the preset frame size are the same and are all 1920 x 1080. In addition, the original depth frame and the original color frame correspond to each other. At this time, 'correspondence' indicates that the original depth frame is obtained by the depth value of all objects of the original color frame, in addition to the size and resolution of both. In addition, the original color frame and original depth frame can be synthesized into a 3D image that can be reproduced on a 3D display device by depth image based rendering (DIBR). Since the original depth frame and the original color frame correspond to each other, the original depth frame also corresponds to the color frame.

17A, Fig. 17A is a relative descriptive diagram of a color frame and a screen when displaying the packaged frame of the fourth embodiment on a 2D display device. Fig.

17A, the packaged frame of the fourth embodiment can be displayed directly on the 2D screen, and the center point of the color frame (i.e., the intersection of the color frame diagonal) and the center point of the screen (i.e., the intersection of the screen diagonal) (All center O). Therefore, as described above, the color frame (i.e., 2D image) actually observed by the human eye does not cause a very natural and uncomfortable feeling. Of course, in addition to the overlapping of the center points in order to avoid feeling uncomfortable when viewing the 2D screen with the human eye, according to the test results, even when the center of the color frame is displayed in the central area of the screen, can do. Here, the center region includes a range formed by a center point of the screen and a certain number of pixels extending out of the center. The central region may be circular or quadrilateral. For example, referring to Fig. 17B, Fig. 17B is an explanatory diagram of the central area of the screen when displaying the packaged frame on the 2D display device in the embodiment of the present invention. In Fig. 17B, the central area CA of the screen includes the screen center point O and extends outward to cover, for example, 1/3 of the screen size. When the center of the color frame is placed in the area, the viewer does not feel uncomfortable.

In addition to the above, a fifth embodiment of a method and apparatus for unpackaging a packaged frame will be described in detail with reference to Figs. 13A and 13B and Figs. 18 to 20B. Here, Figs. 18 to 20B are explanatory diagrams of the process of unpackaging the packaged frame of the fifth embodiment. 19A is an explanatory diagram of two portions of the resized depth frame, FIG. 19B is an explanatory diagram of the resized depth frame, and FIG. 19C Fig. 19D is an explanatory diagram of an intermediate depth frame, Fig. 19D is an explanatory diagram of an original depth frame, Fig. 20A is an explanatory diagram of a color frame, and Fig. 20B is an explanatory diagram of an original color frame.

First, in step P01, the color frame and the resized depth frame are separated from the still packaged frame (FIG. 18 to FIG. 19A and FIG. 20A are separated). This embodiment is still separated by the separation processing unit 31 and separates the two portions (vertical division) of the resized depth frame from the left and right sides of the packaged frame to produce two portions of the resized depth frame of Fig. Thereby obtaining a color frame of the color image 20a. At this time, the two portions of the resized depth frame are separated in the row direction D2, and the sizes of the two portions of the resized depth frame are the same, that is, 240 x 1080 in all.

After obtaining the two portions of the resized depth frame, they are combined into a resized depth frame by the combination processing unit 34 (i.e., Fig. 19A to Fig. 19B). However, before combining with the resized depth frame, first, the positions of the two portions of the resized depth frame are exchanged to the left and right, and then the two portions of the resized depth frame are combined by the combination processing unit 34 into the resized depth frame . The sizes of the two parts of the resized depth frame are equal, i.e. 240 x 1080 all. Thus, the size of the resized depth frame is 480 x 1080, and the size of the color frame is 1440 x 1080 (1440 = 1920-240-240).

Subsequently, the process proceeds to step P02. In step P02, the resized depth frame is restored to obtain the original depth frame (restored from Fig. 19B to Fig. 19D). However, before restoring the resized depth frame, in this embodiment, the subpixel rearrangement is first performed on the resized depth frame in Fig. 19B to obtain the intermediate depth frame in Fig. 19C, and the size of the intermediate depth frame is resized After that, the original depth-of-field shown in Fig. 19D is obtained. Here, the subpixel rearrangement obtains a first subpixel value and a second pixel value of a pixel of the resized depth frame, stores the first subpixel value in all subpixels of the first pixel of the intermediate depth frame, 2 < / RTI > subpixel values in all subpixels of the second pixel of the medium depth frame. In other words, if there are three subpixels in one pixel, the subpixel rearrangement stores the first subpixel value of the first pixel of the resized depth frame in all subpixels of the first pixel of the middle depthframe Stores the second subpixel value of the first pixel of the resized depth frame in all subpixels of the second pixel of the midpoint depth frame and then stores the third subpixel value of the first pixel of the resized depth frame in the middle depth frame Lt; RTI ID = 0.0 > of the third < / RTI > This is analogous to the above.

In the present embodiment, the size of the resized depth frame shown in FIG. 19B is changed by three times in the column direction D1 (horizontal direction), so that the size of the medium depth frame in FIG. 19C is changed in the column direction D1 (Three times the amount of data) of the resized depth frame. Therefore, the resolution of the medium depth frame in Fig. 19C is 1440 x 1080 (1440 = 480 x 3).

Then, the reconstruction processing unit 32 restores the intermediate depth frame to the original depth frame (restored in Fig. 19C to Fig. 19D). In this embodiment, the intermediate depth frame of FIG. 19C is enlarged in proportion to the column direction D1 to obtain the original depth frame of FIG. 19D. At this time, the size of the original depth frame is proportionally increased according to the column direction D1. Here, it is increased by 4/3 times in the column direction D1. Therefore, as shown in Fig. 19D, the size of the original depth frame is 1920 x 1080 (1920 = 1440 x 4/3).

In addition, the unpackaging method further includes restoring the color frame to obtain the original color frame (restored in Fig. 20A to Fig. 20B). At this time, the restoration processing unit 32 restores the color frame and enlarges the size (1440 x 1080) of the color frame in the column direction D1 in proportion to the original size by 4/3 to obtain the original color frame . Therefore, the size of the original color frame in Fig. 20B is 1920 x 1080. The preset frame size of the original color frame of this embodiment and the size of the packaged frame are the same and all are 1920 x 1080. In addition, the original depth frame of this embodiment also corresponds to the color frame.

In addition, if the size of the color frame is a times the original color frame in one direction and the size of the intermediate depth frame is b times the original depth frame, only a + b / 3 = 1 is satisfied , and the values of a and b are not particularly limited. In the fourth embodiment described above, the restoration proportion a according to the row direction D2 of the intermediate depth frame is equal to the restoration proportion b corresponding to the row direction D2 of the color frame, that is, a = b = 3/4. In the fifth embodiment, the restoration proportion a according to the column direction D1 of the intermediate depth frame and the restoration proportion b corresponding to the column direction D1 of the color frame are the same, that is, a = b = 3/4.

In addition, referring to FIG. 21, FIG. 21 is a relative descriptive diagram of a color frame and a screen when the packaged frame of the fifth embodiment is displayed on a 2D display device.

As shown in Fig. 21, the packaged frame of the fifth embodiment can be displayed directly on the 2D screen, and the center point of the color frame (i.e., the intersection of the color frame diagonal) and the center point of the screen (All center O). Therefore, a color frame (i.e., a 2D image) actually observed by the human eye does not cause a very natural and uncomfortable feeling. Of course, in order to achieve the same effect as in the above-described embodiment, the center of the color frame may be displayed in the central area of the screen, and the center point is not limited to the overlapping manner.

In addition to the above, a sixth embodiment of a method and apparatus for unpackaging a packaged frame will be described in detail with reference to Figs. 13A and 13B and Figs. 22 to 24B. Here, Figs. 22 to 24B are explanatory diagrams of the unpackaging process of the packaged frame of the sixth embodiment. 23A and 23B are explanatory diagrams of two portions of the resized depth frame, FIG. 23B is an explanatory view of the resized depth frame, and FIG. 23C FIG. 23D is an explanatory diagram of an original depth frame, FIG. 24A is an explanatory diagram of a color frame, and FIG. 24B is an explanatory diagram of an original color frame.

The processing procedure of the sixth embodiment is substantially the same as that of the fifth embodiment. In the sixth embodiment, similarly, two parts of the depth frame resized from the left and right sides of the frame packaged by the separation processing unit 31 Vertical division) to obtain the two portions of the resized depth frame of Figure 23A and the color frame of Figure 24A. However, the difference from the fifth embodiment is that the sizes of the two portions of the resized depth frame of Fig. 23A are all 120 x 1080. In addition, before combining them into the resized depth frame by the combination processing unit 34, the two parts of the resized depth frame are first rotated by the rotation processing unit 33, And combines the two portions of the depth frame resized by the resizing module 34 into a resized depth frame. At this time, the rotation means that the two portions of the resized depth frame are rotated 90 degrees counterclockwise, respectively. The sizes of the two parts of the resized depth frame of this embodiment are the same, all 120 × 1080. Thus, the size of the resized depth frame is 1080 x 240 and the size of the color frame is 1680 x 1080 (1680 = 1920-120-120).

In addition, the intermediate depth frame of FIG. 23C can be obtained by performing the subpixel rearrangement on the resized depth frame of FIG. 23B, and the original depthframe of FIG. 23D can be obtained by resizing the size of the intermediate depth frame. In the present embodiment, the subpixel rearrangement is performed by changing the size of the resized depth frame in Fig. 23B to the original threefold (the size in the column direction D1 does not change) in the row direction D2, Is three times the size of the resized depth frame in the row direction D2. Therefore, the resolution of the intermediate depth frame in Fig. 23C is 1080 x 720 (720 = 240 x 3).

In addition, the restoration processing unit 32 restores the intermediate depth frame to the original depth frame (restored from Fig. 23C to Fig. 23D). 23D is obtained by enlarging the intermediate depth frame of Fig. 23C in proportion to the column direction D1 and the row direction D2, respectively, thereby obtaining the original depth-of-field frame of Fig. 23D. At this time, it is increased to 3/2 times in the row direction D2 and increased to 16/9 times in the column direction D1. Therefore, as shown in Fig. 23D, the size of the original depth frame is 1920 x 1080 (1920 = 1080 x 16/9, 1080 = 720 x 3/2). Again, it should be noted that in other embodiments the enlargement proportions may be other different proportions, or they may be proportionally enlarged along the column direction D1 or may be proportionally enlarged along the row direction D2, Not limited.

In addition, the color frame of Fig. 24A is restored to obtain the original color frame of Fig. 24B. At this time, the original color frame is obtained by enlarging the size of the color frame (1680 x 1080) in the column direction (D1) by 8/7 times the original size. Therefore, the size of the original color frame in Fig. 24B is 1920 x 1080. The preset frame size of the original color frame of this embodiment is also the same as the packaged frame, that is, 1920 x 1080 in all.

In addition, referring to FIG. 25, FIG. 25 is a relative descriptive diagram of a color frame and a screen when the packaged frame of the sixth embodiment is displayed on a 2D display device.

25, the packaged frame of the sixth embodiment can be displayed directly on the 2D screen, and the center point of the color frame (i.e., the intersection of the color frame diagonal) and the center point of the screen (i.e., the intersection of the screen diagonal) (All center O). Therefore, a color frame (i.e., a 2D image) actually observed by the human eye does not cause a very natural and uncomfortable feeling. Of course, in order to achieve the same effect as in the above-described embodiment, the center of the color frame may be displayed in the central area of the screen, and the center point is not limited to the overlapping manner.

In addition, it should be noted that since the sizes of the packaged frames and the preset frame sizes of the original color frames in the fourth, fifth, and sixth embodiments are all 1920 x 1080, When the packaged frame of the fourth, fifth, and sixth embodiments is applied to transmission, the packaged frame does not incur the burden of the transmission bandwidth, and the cost of the user's 3D display device Do not cause overload.

26, Fig. 26 is a functional block diagram of the unpackaged system 4 (hereinafter referred to as 'system 4') of the packaged frame of the preferred embodiment of the present invention. Here, the packaged frame may be displayed on a 2D screen, and includes a color frame and a resized depth frame, the color frame and the resized depth frame correspond to each other, and the center of the color frame is displayed in the central area of the screen.

The system 4 includes a storage unit 41 for storing a packaged frame and a processing unit 42 electrically connected to the storage unit 41. [ Of course, the storage unit 41 may also store an original color frame, an original depth frame, a color frame, a resized depth frame and its two parts, a medium depth frame. Here, the storage unit 41 may be a non-temporary computer-readable storage medium, and may be, for example, a memory, a memory card, a CD, a video tape, a computer tape, or a combination thereof. Here, the memory may be, but is not limited to, a ROM, a RAM, a flash memory or a field programmable gate array or other type of memory.

The processing unit 42 may include core control components of the system 4 and may include, for example, at least one central processing unit and memory or other control hardware, software or firmware. Here, the processing unit 42 obtains the color frame and the resized depth frame by separating the packaged frame, and restores the resized depth frame to obtain the original depth frame. In one embodiment, the processing unit 42 separates the two portions of the resized depth frame from the top and bottom of the packaged frame, flips each of the two portions of the resized depth frame, Parts are combined to obtain a resized depth frame. In addition, in another embodiment, the processing unit 42 separates the two portions of the resized depth frame from the left and right sides of the packaged frame, rotates each of the two portions of the resized depth frame, The two parts of the depth frame are combined to obtain a resized depth frame. In addition, the processing unit 42 further performs subpixel rearrangement on the resized depth frame to obtain the intermediate depth frame. Here, the processing unit 42 obtains the first and second pixel values of the pixels of the resized depth frame, stores the first subpixel value in all the subpixels of the first pixel of the intermediate depth frame, And stores the second subpixel value in all subpixels of the second pixel of the intermediate depth frame. In addition, the processing unit 42 further restores the intermediate depth frame to the original depth frame. In addition, the processing unit 42 further restores the color frame to obtain the original color frame.

In addition, other technical features of the original depth frame, the medium depth frame, the resized depth frame, the color frame, the original color frame, and the packaged frame in the system 4 have been described above in detail, and redundant description will be omitted.

As described above, in a method, an apparatus and a system for packaging a color frame and an original depth-of-field frame according to the present invention to obtain a packaged frame, the color frame and the resized depth frame are combined so that the center is displayed in the central area of the screen To obtain a packaged frame. Thus, after the packaged frame is restored by the restoration program to obtain the original color frame or the original depth-of-view frame, the 3D display device can accurately generate an unsharp multi-view stereoscopic image or a spectacled double-view stereoscopic image by depth- It is preferable that the center point of the color frame and the center point of the screen overlap each other and more preferably the center point of the color frame and the center point of the screen are superimposed on each other Not only can the packaged frame be displayed directly on the 2D screen, but also the 2D image (i.e., the color frame) actually observed by the human eye will not cause a very natural and uncomfortable feeling. In addition, in a method, apparatus and system for packaging color frames and original depth frames published by the present invention, resizing the original depth frame size to obtain a resized depth frame and combining the color frame and the resized depth frame So that it can be used in combination with other image compression systems to improve the compression efficiency and reduce the bandwidth related requirements required for the 3D stereoscopic image signal, It is advantageous.

In addition, in a method, apparatus and system for packaging a packaged frame according to the present invention, the color frame and the resized depth frame are separated from the packaged frame and the resized depth frame is recovered to obtain the original depth frame . Accordingly, the method, apparatus and system for unpackaging a packaged frame of the present invention are distinguished from existing techniques.

The foregoing is merely illustrative and does not limit the present invention. It is intended that all such equivalent modifications and variations are included within the spirit and scope of the present invention as defined by the appended claims.

Claims (54)

CLAIMS What is claimed is: 1. A method of obtaining a packed frame capable of displaying on a screen by packing a color frame and an original depth frame corresponding to the color frame,
Resizing the size of the original color frame to obtain the color frame by downscaling the size of the original color frame;
Resizing the size of the original depth frame to obtain a resized depth frame;
Dividing the resized depth frame into two parts; And combining the two portions on the upper and lower sides of the color frame respectively or on the left and right sides of the color frame respectively to obtain the packaged frame,
Wherein the center of the color frame is displayed in an intermediate area of the screen, the original color frame has a preset frame size, and the size of the packaged frame is the same as the preset frame size. A method of packaging a depth frame to obtain a packaged frame. The method of claim 1, wherein a center point of the color frame and a center point of the screen are overlapped. A method of packaging a color frame and an original depth frame to obtain a packaged frame. 2. The method of claim 1, further comprising: resizing the original depth frame size to obtain a medium depth frame; And
Further comprising performing sub-pixel rearrangement on the intermediate depth frame to obtain the resized depth frame. The method of packaging a color frame and original depth frame to obtain a packaged frame . 4. The method of claim 3, wherein the size of the resized depth frame is 1/3 of the medium depth frame in the row direction, and a method of packaging the original depth frame to obtain a packaged frame. 4. The apparatus of claim 3, wherein the resized depth frame comprises a plurality of pixels, each pixel having three subpixels, the subpixels correspondingly storing subpixel values of three pixels of the intermediate depth frame, Wherein the color frame and the original depth frame are packaged to obtain a packaged frame. delete The method as claimed in claim 1, wherein combining the two portions on the upper side and the lower side of the color frame or on the left side and the right side of the color frame, respectively,
And flipping the two portions with respect to the resized depth frame to obtain a packaged frame by packaging the color depth and original depth frame. delete delete An apparatus for packaging a color frame and an original depth frame corresponding to the color frame to obtain a packaged frame displayable on a screen,
A size processing unit for resizing the size of the original color frame to obtain the color frame by resizing the size of the original depth frame and obtaining a resized depth frame by downsizing the size of the original color frame; And
A division processing unit for dividing the resized depth frame into two parts;
And a combination processing unit for combining the two parts on the upper side and the lower side of the color frame respectively or combining the left side and the right side of the color frame to obtain the packaged frame,
Wherein the center of the color frame is displayed in a central area of the screen and the original color frame has a preset frame size and the size of the packaged frame and the preset frame size are the same. A device for packaging a frame to obtain a packaged frame. 11. The apparatus of claim 10, wherein a center point of the color frame and a center point of the screen are superimposed, and wherein the color frame and the original depth frame are packaged to obtain a packaged frame. 11. The apparatus of claim 10, wherein the size processing unit resizes the size of the original depth frame to obtain an intermediate depth frame, and proceeds to subpixel rearrangement for the intermediate depth frame to obtain the resized depth frame Wherein the color frame and the original depth frame are packaged to obtain a packaged frame. 13. The apparatus of claim 12, wherein the size of the resized depth frame is 1/3 of the medium depth frame in the row direction, and the original depth-of-field is packaged to obtain a packaged frame. 13. The apparatus of claim 12, wherein the resized depth frame comprises a plurality of pixels, each pixel having three subpixels, the subpixels correspondingly storing subpixel values of three pixels of the intermediate depth frame, And packaging the original depth-of-field to obtain a packaged frame. delete 11. The method of claim 10, wherein prior to combining the two portions of the resized depth frame with the top and bottom portions of the color frame, respectively, or respectively combining the left and right sides of the color frame, Further comprising: a flip processing unit for flipping each of the color frame and the original depth frame to obtain a packaged frame. delete delete A system for packaging a color frame and an original depth frame corresponding to the color frame to obtain a packaged frame displayable on a screen,
A storage unit for storing the color frame and the original depth frame; And
Resizing the size of the original depth frame to obtain a resized depth frame and resizing the size of the original color frame to obtain the color frame, dividing the resized depth frame into two parts, And a processing unit for combining the upper side and the lower side of the frame respectively or each of the left side and the right side of the color frame to obtain the packaged frame,
The size of the original color frame is resized to obtain the color frame by a method of downscaling the size of the original color frame, the center of the color frame is displayed in a central area of the screen, Wherein the size of the packaged frame is equal to the predetermined frame size, and wherein the color frame and the original depth frame are packaged to obtain a packaged frame. 20. The system of claim 19, wherein a center point of the color frame overlaps a center point of the screen. 20. The method of claim 19, wherein the processing unit resizes the size of the original depth frame to obtain an intermediate depth frame and proceeds to subpixel rearrangement for the intermediate depth frame to obtain the resized depth frame A system for packaging a feature color frame and original depth frame to obtain a packaged frame. 22. The system of claim 21, wherein the size of the resized depth frame is 1/3 of the mid depth frame in the row direction. 22. The apparatus of claim 21, wherein the resized depth frame comprises a plurality of pixels, each pixel having three subpixels, the subpixels correspondingly storing subpixel values of three pixels of the intermediate depth frame, Wherein the color frame and the original depth frame are packaged to obtain a packaged frame. delete delete delete delete The packaged frame may be displayed on a screen and includes a color frame and a resized depth frame, wherein the color frame and the resized depth frame correspond to each other, and the center of the color frame is displayed in a central area of the screen A method of unpacking a packaged frame, the method comprising:
Separating the color frame and the resized depth frame from the packaged frame; And
And restoring the resized depth frame to obtain an original depth frame,
Wherein separating the color frame and the resized depth frame from the packaged frame comprises:
Separating the two portions of the resized depth frame from the top and bottom of the packaged frame or from the left and right sides of the packaged frame and combining the two portions of the resized depth frame into the resized depth frame Gt; a < / RTI > packaged frame. 29. The method of claim 28, wherein a center point of the color frame overlaps a center point of the screen. delete 29. The method of claim 28, wherein separating the color frame and the resized depth frame from the packaged frame prior to combining the two portions of the resized depth frame into the resized depth frame comprises: ≪ / RTI > further comprising flipping each of the two portions of the frame. 29. The method of claim 28, further comprising restoring the color frame to obtain an original color frame. 29. The method of claim 28, wherein restoring the resized depth frame to obtain the original depth frame comprises:
Proceeding to subpixel rearrangement for the resized depth frame to obtain an intermediate depth frame; And
Further comprising resizing the size of the mid-depth frame to obtain the original depth-of-view frame. 34. The method of claim 33, wherein the size of the medium depth frame is three times the resized depth frame in the row direction. 34. The method of claim 33, wherein in obtaining the mid-depth frame, obtaining a first sub-pixel value and a second sub-pixel value of a pixel of the resized depth frame, Storing the first subpixel value in all subpixels of the first pixel and storing the second subpixel value in all subpixels of the second pixel of the intermediate depthframe. 34. The method of claim 33, wherein the size of the original depth frame is 4/3 times the medium depth frame in the row direction. The packaged frame may be displayed on a screen and includes a color frame and a resized depth frame, wherein the color frame and the resized depth frame correspond to each other, and the center of the color frame is displayed in a central area of the screen An apparatus for unpackaging a packaged frame,
A separation processing unit for separating the packaged frame to obtain the color frame and the resized depth frame; And
And a restoration processing unit for restoring the resized depth frame to obtain an original depth frame,
Wherein the separation processing unit separates the two portions of the resized depth frame from the upper and lower sides of the packaged frame or from the left and right sides thereof. 38. The apparatus of claim 37, wherein a center point of the color frame overlaps a center point of the screen. delete 38. The apparatus of claim 37, further comprising a pivoting processing unit for flipping the two portions of the resized depth frame, respectively. 38. The apparatus of claim 37, wherein the reconstruction processing unit further restores the color frame to obtain an original color frame. 38. The apparatus of claim 37, wherein the reconstruction processing unit proceeds with subpixel rearrangement for the resized depth frame to obtain an intermediate depth frame. 43. The apparatus of claim 42, wherein the size of the medium depth frame is three times the size of the resized depth frame in the row direction. 43. The apparatus of claim 42, wherein the reconstruction processing unit further obtains a first subpixel value and a second subpixel value of a pixel of the resized depth frame, And stores the second subpixel value in all subpixels of the second pixel of the intermediate depth frame. ≪ RTI ID = 0.0 > 31. < / RTI > 43. The apparatus of claim 42, wherein the size of the original depth frame is 4/3 times the medium depth frame in the row direction. The packaged frame may be displayed on a screen and includes a color frame and a resized depth frame, wherein the color frame and the resized depth frame correspond to each other, and the center of the color frame is displayed in a central area of the screen A system for unpackaging a packaged frame,
A storage unit for storing the packaged frame; And
And a processing unit for separating the packaged frame to obtain the color frame and the resized depth frame, and restoring the resized depth frame to obtain an original depth frame,
Wherein the processing unit separates the two portions of the resized depth frame from the top and bottom sides of the packaged frame or from the left and right sides. 47. The system of claim 46, wherein a center point of the color frame overlaps a center point of the screen. delete 47. The system of claim 46, wherein the processing unit flips the two portions of the resized depth frame, respectively. 47. The system of claim 46, wherein the processing unit obtains the original color frame by restoring the color frame. 47. The system of claim 46, wherein the processing unit obtains a medium depth frame by proceeding with a subpixel rearrangement for the resized depth frame. 52. The system of claim 51, wherein the size of the medium depth frame is three times the size of the resized depth frame in the row direction. 52. The apparatus of claim 51, wherein the processing unit obtains a first subpixel value and a second subpixel value of a pixel of the resized depth frame and stores the first subpixel value in all of the first pixels of the mid- And stores the second subpixel value in all subpixels of the second pixel of the intermediate depth frame. ≪ Desc / Clms Page number 21 > 52. The system of claim 51, wherein the size of the original depth frame is 4/3 times the medium depth frame in the row direction.

Images