TWI530155B - Method, device for packing multi-view frame and non-transitory storage medium for storing packed frame - Google Patents

Description

Method, device and non-transitory storage medium for packaging multi-view frame

The present invention relates to a method, apparatus, and non-transitory storage medium for packaging a multi-view frame to obtain a package frame.

Due to the advancement of technology, the development of today's electronic products is not a priority to improve the performance and quality of products. Among them, in addition to providing a clearer and more comfortable display screen for the display device, various manufacturers have continuously introduced a variety of three-dimensional (3D) display devices, which can provide multi-view (multi-view). 3D images to provide the user with another visual reality.

At this stage, a 3D image generation system is simultaneously photographed by, for example, an array camera (generally two) to obtain two or more multi-view images for use in any naked-eye 3D display device, or glasses. One of the 3D display device has a left eye image and a right eye image.

However, at present, the popular home TV in the receiving end is mainly a 2D display device, and has no function of processing multi-view images or left and right eye images, and the currently common dual-view image arrangement formats include SbS (side by side) and TaB ( Top and bottom), although the two image arrangement formats are simple and intuitive, if displayed in a general 2D display device, a left eye image and a right eye image are displayed and spliced together. At present, during the development of 3D video, when the above-mentioned splicing method is broadcast and the left eye image and the right eye image of the left and right eye images are half-spliced directly on the general 2D display device, the 2D image actually seen by the human eye is not only Quite unnatural, it can also create an uncomfortable feeling.

The object of the present invention is to provide a multi-view frame to obtain a package frame method, a device and a non-transitory storage medium for storing a package frame, and the obtained package frame can be displayed on the 2D display screen, and the human eye Enjoy comfortable viewing of 2D images without feeling uncomfortable.

In order to achieve the above object, a method for packaging a multi-view frame to obtain a package frame according to the present invention, the multi-view frame includes a first view frame and a second view frame corresponding to the first view frame At least a portion of the package frame may be displayed on a display screen, the method comprising: dividing the first view frame to obtain a plurality of first view segmentation frames; and combining the first view segmentation frame and the second view A frame is obtained to obtain a package frame, wherein a center of the second view frame is displayed in a central area of the display screen.

In order to achieve the above object, according to the present invention, a device for packaging a multi-view frame to obtain a package frame, the multi-view frame includes a first view frame and a second view frame corresponding to the first view frame. At least a portion of the package frame can be displayed on a display screen, the device including a split processing unit and a combined processing unit. The segmentation processing unit divides the first view frame to obtain a plurality of first view segmentation frames. The combination processing unit combines the first view split frame and the second view frame to obtain a package frame, wherein a center of the second view frame is displayed in a central area of the display screen.

In order to achieve the above object, a non-transitory storage medium according to the present invention is accessible to a data processing system, and the non-transitory storage medium stores a program for packaging a multi-view frame to obtain a method for packaging a frame. The view frame includes a first view frame and a second view frame corresponding to the first view frame. At least a portion of the wrap frame can be displayed on a display screen, and the method of the method includes dividing the first view. a frame to obtain two first perspective segmentation frames; and combining the two first perspective segmentation frames on the left and right sides of the second perspective frame to obtain a package frame; or dividing the two first perspective segments The frames are respectively combined on the upper side and the lower side of the second view frame to obtain a package frame, wherein the center of the second view frame is displayed in a central area of the display screen.

According to the above description, the package multi-view frame of the present invention is used to obtain the package frame. The non-transitory storage medium of the method, the device and the storage package frame is obtained by dividing the first view frame to obtain a plurality of first view segmentation frames, and combining the first view segmentation frames and the second A view frame to get a package frame centered on the center of the display screen. Thereby, not only the image frame can be correctly restored by the restoration process, for example, a naked-eye multi-view stereo image or a glasses-type dual-view stereo image, and more importantly, the center of the second view frame is displayed in the center of the display screen. The area, preferably, overlaps with the center point of the display screen, and preferably overlaps completely, so that at least a part of the packaging frame can be displayed not only on the 2D display screen, but also the actual 2D image is quite comfortable to be seen by the human eye. Naturally, there will be no feeling of discomfort.

1‧‧‧Package of multi-view frames to obtain packaging frames

11‧‧‧Segment processing unit

12‧‧‧Combination processing unit

13‧‧‧Reverse processing unit

14‧‧‧Retry processing unit

2‧‧‧ Non-transitory storage media

3‧‧‧Data Processing System

B, BL, BR, L, R, U, UL, UR‧‧‧

CA‧‧‧Central Area

C, D, M, N, P, Q‧‧‧ size

D1‧‧‧ direction

D2‧‧‧ direction

Z‧‧‧ Center Point

S01~S02‧‧‧Steps

FIG. 1A is a schematic flow chart of a method for packaging a multi-view frame to obtain a package frame according to a preferred embodiment of the present invention.

FIG. 1B is a functional block diagram of a device for packaging a multi-view frame to obtain a package frame according to a preferred embodiment of the present invention.

2A to 2D are schematic diagrams showing a process of packaging a multi-view frame to obtain a package frame in the first embodiment.

3A and 3B are schematic diagrams of a first view original frame and a second view original frame of the first embodiment, respectively.

4A is a schematic diagram of a pixel of a first view original frame or a second view original frame, respectively.

FIG. 4B is a schematic diagram of the pixel after re-adjusting FIG. 4A.

FIG. 5A is a schematic diagram showing the relative view of the second view frame and the display screen when the package frame of the first embodiment is displayed on the 2D display device.

FIG. 5B is a schematic diagram showing a central area of a screen according to an embodiment of the present invention.

Fig. 6A is a schematic diagram of a first view frame of a second embodiment.

Figure 6B is a schematic diagram of a second view frame of one of the second embodiments.

6C is a schematic diagram of two first perspective segmentation frames of the second embodiment.

Fig. 6D is a schematic view of the packaging frame of the first embodiment.

7A and 7B are a first view original frame and a second view original of the second embodiment, respectively. A schematic diagram of the frame.

FIG. 8A is a schematic diagram of a pixel of a first view original frame or a second view original frame, respectively.

Fig. 8B is a schematic diagram of the pixel after re-adjusting Fig. 8A.

FIG. 9 is a schematic diagram showing the relative view of the second view frame and the display screen when the package frame of the second embodiment is displayed on the 2D display device.

Fig. 10A is a schematic diagram of a first view frame of a third embodiment.

FIG. 10B is a schematic diagram showing the relative positions of the first view splitting frame and the second view frame in the third embodiment. FIG.

Fig. 10C is a schematic view of the packaging frame of the third embodiment.

Figure 11A is a schematic diagram of a first view frame of a fourth embodiment.

11B is a schematic diagram showing the relative positions of the first view split frame and the second view frame in the fourth embodiment.

Figure 11C is a schematic view of a package frame of a fourth embodiment of the fourth embodiment.

FIG. 12 is a schematic diagram of a non-transitory storage medium cooperating with a data processing system according to a preferred embodiment of the present invention.

The method and apparatus for packaging a multi-view frame and the non-transitory storage medium for storing a package frame according to a preferred embodiment of the present invention will be described with reference to the accompanying drawings, wherein the same elements will be described with the same reference numerals.

1A and FIG. 1B, FIG. 1A is a schematic flow chart of a method for packaging a multi-view frame to obtain a package frame according to a preferred embodiment of the present invention, and FIG. 1B is a preferred embodiment of the present invention. A functional block diagram of a device 1 (hereinafter referred to as device 1) for packaging a multi-view frame to obtain a package frame. The package frame includes a first view frame and a second view frame. Additionally, at least a portion of the package frame obtained by applying the present invention can be displayed in a display screen. Here, the display screen is a display screen of a 2D display device.

As shown in FIG. 1A, the method of packaging the multi-view frame to obtain the package frame includes step S01 and step S02. As shown in FIG. 1B, the apparatus 1 includes a division processing unit 11 and a combination processing unit 12. Furthermore, the device 1 of the embodiment may further include an inversion processing unit 13 And a reprocessing unit 14. The functions of the segmentation processing unit 11, the combination processing unit 12, the inversion processing unit 13, and the re-processing unit 14 can be implemented by a software program and executed by a processor (for example, an MCU). Alternatively, the functions of the above-described division processing unit 11, combination processing unit 12, inversion processing unit 13, and re-processing unit 14 may be implemented by using a hardware or a firmware, and the present invention is not limited thereto.

Hereinafter, please refer to FIG. 2A to FIG. 5B to explain the details of the method and apparatus 1 for packaging a multi-view frame to obtain a package frame.

Referring to FIG. 2A to FIG. 2D, FIG. 2A to FIG. 2D are schematic diagrams showing a process of packaging a multi-view frame to obtain a package frame according to the first embodiment. 2A is a schematic diagram of a first view frame of one of the first embodiments, FIG. 2B is a schematic view of a second view frame of one of the first embodiments, and FIG. 2C is a view of two first views of the first embodiment. A schematic view of the frame, and FIG. 2D is a schematic view of the packaging frame of the first embodiment. In the figure, a column direction D1 and a row direction D2 are displayed, the column direction D1 is the horizontal direction of the displayed image, and the row direction D2 is the vertical direction of the displayed image. In addition, the frame shown in FIGS. 2A and 2B has a dimension in the horizontal direction of M and a dimension in the vertical direction of N. M is, for example but not limited to, 960 pixels, and N is, for example but not limited to, 1080 pixels.

First, as shown in FIG. 1A, the step S01 of the method for packaging the multi-view frame to obtain the package frame is: dividing the first view frame to obtain a plurality of first view segmentation frames (ie, dividing FIG. 2A into FIG. 2C) ). In this embodiment, step S01 divides the first view frame by the segmentation processing unit 11 to obtain two first view split frames. Here, the first view frame is divided equally in the row direction D2 (vertical direction) to obtain two first view split frames of the same size, so the sizes of the two first view split frames are respectively (M/ 2) × N.

Next, step S02 is performed: combining the first view split frame and the second view frame to obtain a package frame, wherein a center of the second view frame is displayed in a central area of the display screen. In other words, the two first view segmentation maps of FIG. 2C and the second view frame of FIG. 2B are combined to obtain the package frame of FIG. 2D. However, before the step S02 of combining the first view split frame and the second view frame to obtain the package frame by the combination processing unit 12, the embodiment needs to invert the two by the inversion processing unit 13 The first perspective splits the frame. Here, the two first view segmentation frames of FIG. 2C are respectively reversed left and right (ie, left and right mirrors) to obtain a reversal. The two first viewing angles are divided into frames (not shown), and then the combination processing unit 12 combines the left-view inverted first viewing angle segment into the left side of the second viewing frame, and inverts the right side. The first first view segmentation frame is combined on the right side of the second view frame to obtain the package frame of FIG. 2D. Therefore, the size of the package frame of FIG. 2D is 2M×N (2M=M/2+M+M/2), and is, for example, 1920×1080. Wherein, when the first view split frame is inverted and then combined on the left side and the right side of the second view frame, the overall image of the package frame can be made to conform to the natural image.

In addition, please refer to FIG. 3A to FIG. 4B , wherein FIG. 3A and FIG. 3B are schematic diagrams of the first view original frame and the second view original frame of the first embodiment, respectively. In addition, FIG. 4A is a schematic diagram of a pixel of a first view original frame or a second view original frame, and FIG. 4B is a schematic diagram of a pixel after re-adjusting FIG. 4A.

In the above-mentioned first embodiment, the method of packaging the multi-view frame to obtain the package frame may further include: re-adjusting the size of the first view original frame to obtain the first view frame; and re-adjusting The size of the original frame is two views to obtain a second view frame. In other words, in this embodiment, the re-processing unit 14 first re-adjusts the size of the first view original frame of FIG. 3A and re-adjusts the size of the second view original frame of FIG. 3B to obtain the first view of FIG. 2A. After the frame and the second view frame of FIG. 2B, the above steps S01 and S02 are performed to obtain a package frame.

Since the first view original frame or the second view original frame is formed by a plurality of pixels arranged in a two-dimensional array, for example, as shown in FIG. 4A, the first view is the original frame or the second frame. The original frame of the view has 6 rows × 4 columns, respectively, for a total of 24 pixels, and there is a pixel value (not shown) in each pixel position. Of course, FIG. 4A only illustrates the principle and process of re-adjusting the first view original frame or the second view original frame. In fact, the size of the first view original frame or the second view original frame may be, for example but not limited to, 1920 × 1080 pixels, or other number of pixels.

The re-processing unit 14 takes out the pixel values of the odd-numbered positions of the n-th pixel of the original picture frame of the first view and the pixel values of the even-numbered positions of the (n+1)th line of pixels, and draws the nth line. The pixel value of the odd-numbered position of the prime and the pixel value of the even-numbered position of the (n+1)-th row pixel correspond to the odd-numbered position of the (n+1)/2-line pixel of the first view frame. Within the prime and the pixels of the even position of the (n+1)/2th pixel, to obtain the first view frame, where n is a positive odd number. In addition, the re-processing unit 14 also extracts the pixel values of the odd-numbered positions of the n-th pixel of the original picture frame of the second view and the (n+1)th The pixel value of the even position of the line pixel, and the pixel value of the odd position of the nth pixel and the pixel value of the even position of the (n+1)th pixel are stored in the second view frame. The pixel of the (n+1)/2th pixel is in the pixel of the odd position and the pixel of the (n+1)/2th pixel of the even position is obtained to obtain the second angle frame.

Here, as shown in FIG. 4A, when N is equal to 1, the re-processing unit 14 extracts the pixel value of the odd-numbered position (O) of the first line of the first-view original frame and the second-line pixel. The pixel value of the even position (X), and the pixel value (O) of the odd position of the first line of pixels is stored in the pixel of the odd position of the first line of the first view frame, And storing the pixel value (X) of the even-numbered position of the second row of pixels into the pixel of the even-numbered position of the first row of the first view frame; when N is equal to 3, the re-processing unit 14 The pixel value of the odd-numbered position (O) of the third row of the first-view original frame and the pixel value of the even-numbered position (X) of the fourth-line pixel are taken out, and the odd number of the third-line pixel is obtained. The pixel value of the position (O) corresponds to the pixel stored in the odd-numbered position of the second line of the first view frame, and the pixel value (X) corresponding to the even-numbered position of the fourth line of pixels is stored. In the pixels of the even-numbered positions of the pixels in the second row of the first view frame, and so on, FIG. 4B can be obtained. In addition, the process of taking out the pixel values of the original frame of the second viewing angle and storing them in the corresponding pixels of the second viewing frame is the same as the above, and will not be described again. Here, the process of re-tuning can be called down-sampling, which can reduce the number of pixels sampled, thereby reducing the size of the frame.

However, the above manner of taking out and storing is only an example. In other embodiments, the reprocessing unit 14 may have different access modes. For example, the re-processing unit 14 may also separately extract the pixel values of the even-numbered positions of the n-th pixel of the first view original frame and the pixel values of the odd-numbered positions of the (n+1)-th pixel. And storing the pixel value of the even position of the nth pixel and the pixel value of the odd position of the (n+1)th pixel into the (n+1)/2th line of the first view frame. Within the pixels of the even position of the prime and the pixels of the odd position of the (n+1)/2th pixel, the first view frame is obtained, where n is a positive odd number. In addition, the re-processing unit 14 may also separately extract the pixel values of the even-numbered positions of the n-th pixel of the second view original frame and the pixel values of the odd-numbered positions of the (n+1)th pixel, and The pixel value of the even position of the nth pixel and the pixel value of the odd position of the (n+1)th pixel are corresponding to the (n+1)/2th pixel of the second view frame. The pixels in the even position and the pixels in the odd position of the (n+1)/2th pixel are obtained to obtain the second view frame.

Therefore, by re-processing the down-sampling processing of the processing unit 14, The size of the original view frame of FIG. 3A is re-adjusted to obtain the first view frame of FIG. 2A, and the size of the second view original frame of FIG. 3B is re-adjusted to obtain the second view frame of FIG. 2B. The first view original frame or the second view original frame of the embodiment has the same size as the package frame, and is 2M×N. In addition, the size of the first view frame (M×N) is one-half of the first view original frame (2M×N), and the size of the second view frame (M×N) is also the second view. One-half of the original frame (2M x N). In addition, the first view original frame of the embodiment corresponds to the second view original frame. Here, the "correspondence" means that the first view original frame and the second view original frame may be, for example, a left-eye image and a right-eye image, respectively, except that the size or resolution of the two are the same. When the left eye image enters the left eye of the person and the right eye image enters the right eye of the person, a parallax phenomenon can be formed on the human eye to make the image have a three-dimensional effect. Since the first view original frame corresponds to the second view original frame, the re-adjusted first view frame also corresponds to the second view frame.

Please refer to FIG. 5A , which is a schematic diagram of the second view frame and the display screen when the package frame of the first embodiment is displayed on the 2D display device. In this embodiment, the size of the package frame (2M×N) is equal to the size of the display screen, such as, but not limited to, 1920×1080 pixels, which is the image resolution of the current high-definition 2D display device.

If the packaging frame of FIG. 2D is restored by the reduction process, in addition to the naked eye multi-view stereo image or the glasses-type dual-view stereo image, at the same time, as shown in FIG. 5A, the package frame can be directly displayed on the display of the 2D display device. In the screen, the center point of the second view frame (ie, the intersection of the diagonals of the second view frame) overlaps with the center point of the display screen (ie, the intersection of the diagonal lines of the display screen) (both center points Z) . Therefore, the package frame can be displayed not only on the 2D display screen, but also as shown in FIG. 3A, the second view frame (ie, 2D image) seen by the human eye is quite comfortable and natural, and there is no Comfortable feeling.

Of course, in order to achieve the human eye to view the 2D display screen, there is no uncomfortable feeling. Except for the above-mentioned center point overlap, it is found through test results that when the center of the second view frame is displayed in the central area of the display screen, Provide a certain effect. Here, the so-called central area includes a range in which the center point of the screen is displayed and the number of pixels extending outward is formed. The central area may for example be circular or quadrilateral. For example, please refer to FIG. 5B, which is a schematic diagram showing a central area of the screen when the package frame of the first embodiment is displayed on the 2D display device. In Figure 5B The central area CA of the display screen is a range including, for example, one third of the screen center point Z and extending outward to reach the screen size. When the center of the second view frame falls on the area, the viewer is not It will create an uncomfortable feeling.

It is to be noted that, in this embodiment, since the most common dual-view film arrangement formats are SbS (side by side) and TaB (top and bottom), the image resolution after the arrangement is The left eye image or the right eye image is twice as large as the transmission bandwidth, but the method of packaging the frame obtained by the above-mentioned package multi-view frame and the size and the first viewing angle of the package frame after packaging 1 The original frame (or the second view original frame) is the same. Therefore, the method for packaging the multi-view frame to obtain the package frame and the device 1 can cooperate with any video compression method to have better compression efficiency. When applied for transmission, the package frame does not cause a burden on the transmission bandwidth, nor does it The user's 3D display device cannot be loaded because the amount of decompression calculation is too large.

In addition, referring to FIG. 6A to FIG. 7B, FIG. 6A to FIG. 6D are schematic diagrams showing a process of packaging a multi-view frame to obtain a package frame according to the second embodiment. 6A is a schematic diagram of a first view frame of a second embodiment, FIG. 6B is a schematic view of a second view frame of a second embodiment, and FIG. 6C is a second view split of the second embodiment. FIG. 6D is a schematic diagram of a package frame of the first embodiment, and FIGS. 7A and 7B are schematic diagrams of a first view original frame and a second view original frame of the second embodiment, respectively. The frame shown in Figs. 6A and 6B has a horizontal dimension of P and a vertical dimension of Q. Wherein P is, for example but not limited to, 1920, and Q is, for example but not limited to, 540. In addition, although FIGS. 6A to 6D are displayed as black and white images, actually, FIGS. 6A to 6D can be displayed as color images on the color display device.

The processing procedure of FIGS. 6A to 6D is the same as that of FIGS. 2A to 2D, but the width (P) of the frame is kept constant, and the division of the frame is performed in the column direction D1 (horizontal direction). The first view frame of FIG. 6A is equally divided in the horizontal direction, and two first view split frames (P×Q/2) are obtained. In the same manner, before the step S02 of combining the two first view split frame and the second view frame, the embodiment still needs to invert the two first view split frames of FIG. 6C by the inversion processing unit 13 . . Here, the two first-view segmentation frames of FIG. 6C are vertically inverted (ie, mirrored up and down) to obtain two inverted first-view segmentation frames (not shown), and then Combining the first view split frame after the upper side is inverted by the combination processing unit 12 to the second The upper side of the view frame is combined with the first view split frame after the lower side is inverted to the lower side of the second view frame, and the package frame of FIG. 6D is obtained. Therefore, the size of the package frame of FIG. 6D is P×2Q (2Q=Q/2+Q+Q/2), and is, for example, 1920×1080. Similarly, when the two first view segmentation frames of FIG. 6C are vertically inverted and then combined with the lower side and the lower side of the second view frame, the overall image of the package frame can be made more natural. .

In addition, in the second embodiment, the method of packaging the multi-view frame to obtain the package frame requires re-adjusting the size of the original view frame of the first view of FIG. 7A and re-adjusting the size of the original view frame of the second view of FIG. 7B. After obtaining the first view frame of FIG. 6A and the second view frame of FIG. 6B, the packaging step described above is performed to obtain a package frame.

Therefore, still exemplified in FIG. 8A which is the same as FIG. 4A, as shown in FIG. 8A and FIG. 8B, the re-processing unit 14 extracts the pixel values of the odd-numbered positions (O) of the nth column of FIG. 8A and the (n) +1) the pixel value of the even position (X) of the column pixel, and the pixel value of the odd position of the nth column pixel and the pixel value of the even position of the (n+1)th column pixel are correspondingly stored. In the pixel of the odd-numbered position of the (n+1)/2th pixel of FIG. 8B and the even-numbered pixel of the (n+1)/2th pixel of the pixel, where n is a positive odd number. Similarly, the re-processing unit 14 also extracts the pixel values of the odd-numbered positions (O) of the nth column of pixels of FIG. 8A and the pixel values of the even-numbered positions (X) of the (n+1)th column of pixels, and Corresponding to the pixel values of the odd-numbered positions of the nth column of pixels and the pixel values of the even-numbered positions of the (n+1)-th column pixel are stored in the odd-numbered positions of the (n+1)/2th column of the pixel of FIG. 8B. Within the pixel and the pixel of the even position of the (n+1)/2th column.

Similarly, the above-mentioned manner of taking out and storing is still only an example. In other embodiments, the re-processing unit 14 may also separately extract the even-numbered positions of the nth column of the first view of the first view of FIG. 8A. The prime value and the pixel value of the odd position of the (n+1)th column pixel, and the pixel value of the even position of the nth column pixel and the pixel of the odd position of the (n+1)th column pixel The value corresponds to the pixel stored in the even position of the (n+1)/2th pixel of the first view frame and the odd position of the (n+1)/2th pixel. a first view frame, where n is a positive odd number. In addition, the re-processing unit 14 may also separately extract the pixel values of the even-numbered positions of the n-th column of the second view original frame and the pixel values of the odd-numbered positions of the (n+1)-th column pixel, and The pixel value of the even position of the nth column of pixels and the pixel value of the odd position of the (n+1)th column pixel correspond to the (n+1)/2th column pixel of the second view frame. Pixels in the even position of the pixel and the odd position of the (n+1)/2th column pixel Inside to get the second perspective frame.

Therefore, by re-tuning the reprocessing process of the processing unit 14, the size of the first view original frame of FIG. 7A can be re-adjusted to obtain the first view frame of FIG. 6A, and the second view of FIG. 7B is taken. The size of the frame is re-adjusted to obtain the second view frame of Figure 6B. The size of the first view original frame or the second view original frame of the embodiment is the same as the package frame, and both are P×2Q. In addition, the size of the first view frame (P×Q) is one-half of the first view original frame (P×2Q), and the size of the second view frame (P×Q) is also the second view. One-half of the original frame (P × 2Q).

Please refer to FIG. 9 , which is a schematic diagram of the second view frame and the display screen when the package frame of the second embodiment is displayed on the 2D display device. In this embodiment, the size of the package frame (P x 2Q) is equal to the size of the display screen, such as but not limited to 1920 x 1080 pixels.

As shown in FIG. 9, the package frame can be directly displayed on the display screen of the 2D display device, and the center point of the second view frame overlaps with the center point of the display screen (both center points Z). Therefore, the package frame can be displayed not only on the 2D display screen, but also through the actual viewing of the human eye, the second view frame (ie, 2D image) seen is quite comfortable and natural, and does not have an uncomfortable feeling. Of course, as in the foregoing embodiment, in order to achieve the same effect, the center of the second view frame may be displayed on the central area of the display screen, not limited by the center point overlap.

In addition, referring to FIG. 10A to FIG. 10C , FIG. 10A to FIG. 10C are schematic diagrams showing a process of packaging a multi-view frame to obtain a package frame according to the third embodiment. 10A is a schematic diagram of a first view frame of a third embodiment, FIG. 10B is a schematic diagram showing a relative position of a first view split frame and a second view frame of the third embodiment, and FIG. 10C is a third implementation. A schematic diagram of a packaging frame. Here, since the image contents of the first view frame and the second view frame are relatively close, the second view frame is not separately displayed. Further, the apparatus for processing the third embodiment does not include the re-processing unit 14 of the apparatus 1. Here, the size of the first view frame or the second view frame is C×D. C is for example but not limited to 1920, and D is for example but not limited to 1080.

The main difference from the first embodiment is that the first view frame of the third embodiment is divided into eight first view split frames, as shown in FIG. 10A, which are U, B, L, R, respectively. The first perspective segmentation frame of 8 parts such as UL, UR, BL, BR, etc. The size of the split frame can be shown in the figure.

Therefore, the eight first view segmentation frames are combined with the second view frame in accordance with the displayed position of FIG. 10B, and the package frame of FIG. 10C can be obtained. However, before the combination processing unit 12 combines the first view angles of the eight portions and the second view frame, the first embodiment needs to invert the first part of each part of FIG. 10A by the inversion processing unit 13 as before. The perspective splits the frame. Here, the U, B, UL, UR, BL, BR, and the like are reversed up and down, and the L and R portions are reversed left and right to obtain the inverted 8 first view segmentation frames ( The figure is not shown. Thereafter, the combination processing unit 12 combines the inverted first partial view frame and the second view frame in accordance with the position of FIG. 10B to obtain the package frame of FIG. 10C. Therefore, as shown in Fig. 10C, the size of the package frame is 3C/2 x 4D/3.

In addition, referring to FIG. 11A to FIG. 11C, FIG. 11A to FIG. 11C are schematic diagrams showing a process of packaging a multi-view frame to obtain a package frame according to the fourth embodiment. 11A is a schematic diagram of a first view frame of a fourth embodiment, FIG. 11B is a schematic view showing a relative position of a first view split frame and a second view frame of the fourth embodiment, and FIG. 11C is a fourth embodiment. A schematic diagram of a packaging frame of a fourth embodiment of the example. The second view frame is not separately displayed as in the fourth embodiment. Further, the processing of the apparatus of the fourth embodiment does not include the re-processing unit 14 of the apparatus 1.

The main difference from the third embodiment is that the first view frame of the fourth embodiment is divided into eight first view split frames, but the split manner is different, as shown in FIG. 11A, which are respectively U. The first view angles of the eight parts of B, L, R, UL, UR, BL, and BR are divided into frames, and the sizes of the first view divided frames are different from those of the third embodiment. The size of the first view split frame of each part can be referred to as shown in the figure.

Therefore, the eight first view segmentation frames are combined with the second view frame in accordance with the displayed position of FIG. 11B, and the package frame of FIG. 11C can be obtained. However, before the combination processing unit 12 combines the first view angle of the 8 parts and the second view frame, the first embodiment of the present embodiment needs to reverse the first part of each part of FIG. 11A by the inversion processing unit 13 . The perspective splits the frame. Here, the U, B, UL, UR, BL, BR and other parts are inverted up and down, and the L and R parts are reversed left and right to obtain the inverted 8 first view segmentation frames. (not shown), after which the combined processing unit 12 will in turn 8 inverted portions according to the position of Fig. 11B. The first perspective segmentation frame is combined with the second perspective frame to obtain the package frame of FIG. 11C. As shown in Fig. 11C, the size of the package frame is 4/3C x 3/2D.

It is to be noted that the frame division manner of the above four embodiments and the number and size of the divided first perspective segmentation frames are merely examples and are not intended to limit the present invention.

In addition, if the packaging frame of FIG. 10C or FIG. 11C is restored by the restoration process to obtain the first viewing angle frame and the second viewing angle frame, the 3D display device can be provided to correctly generate the naked-eye multi-view stereoscopic image or the glasses-type dual viewing angle. Stereoscopic image. In addition, the package frame of FIG. 10C or FIG. 11C may have two display modes in the display screen of the 2D display device, one display mode is as shown in FIG. 10B or FIG. 11B, and the size of the second view frame is the same as that of the display screen. Both are C×D, and the display screen only displays the second view frame, so that the center of the second view frame is displayed in the central area of the display screen, and preferably the center point of the second view frame and the center of the display screen. Points overlap. Another display mode is that since the size of the display screen is C×D, but the size of the package frame is 3C/2×4D/3 of FIG. 10C, or 4C/3×3D/2 of FIG. 11C, the 2D display The device automatically maps the size of the package frame to C×D and is the same size as the display screen to display the entire image of FIG. 10C or FIG. 11C (not shown). At this time, the center of the second view frame Displayed in the central area of the display screen, and preferably the center point of the second view frame overlaps the center point of the display screen.

Therefore, the package frames of the third embodiment and the fourth embodiment are at least partially displayed not only in the 2D display screen, but also as shown in FIGS. 10C and 11C, through the actual human eye proof, the 2D images seen are equivalent. Comfortable and natural, there will be no uncomfortable feeling.

In addition, if the format of the dual-view film input into the above packaging device is SbS or TaB of the prior art, the packaging device may perform a pre-processing step and automatically separate the SbS or TaB. After the first view frame and the second view frame are packaged by the above packaging method, the package frame of the center of the second view frame displayed in the central area of the display screen can be obtained. In addition, it is particularly noted that although all of the above-described viewing angle frames are displayed as black and white images, in reality, they can be displayed as color images on a color display device.

Next, please refer to FIG. 12, which is a schematic diagram of a non-transitory storage medium 2 cooperating with a data processing system 3 according to a preferred embodiment of the present invention.

The non-transitory storage medium 2 is accessible to the data processing system 3. The non-transitory computer readable storage medium 2 is a non-transitory computer readable storage medium, and may include, for example, a memory, a memory card, a CD, a video tape, and a computer tape. , or any combination thereof. The memory may include a read only memory (ROM), a random access memory (RAM), a flash memory, or a Field-Programmable Gate Array (FPGA), or other Form of memory. In addition, the non-transitory storage medium 2 can be located on a stand-alone device (such as a personal computer, a tablet), a network device (such as a server), or a cloud device (such as a cloud server). In addition, the data processing system 3 can implement its functions in a software program manner, or can implement its functions in a hardware or firmware manner, and is not particularly limited.

The non-transitory storage medium 2 stores a package frame. At least a portion of the package frame is displayed on a 2D display screen, and includes a first view frame and a second view frame corresponding to the first view frame, and the center of the second view frame is displayed on the display The central area of the screen. Preferably, the center point of the second view frame overlaps with the center point of the display screen. The size of the package frame may be greater than or equal to the size of the display screen. In addition, the first view frame may be divided into a plurality of first view split frames, and the first view split frame and the second view frame are combined into a package frame.

The package frame, the first view frame, the second view frame, the first view split frame, and the size of the first view original frame are re-adjusted to obtain the first view frame and the first adjustment For the technical features of the second view frame and the size of the original view frame, reference may be made to the above embodiments, and details are not described herein. In addition, the first view split frame, the first view original frame, and the second view original frame may also be stored in the non-transitory storage medium 2 .

In summary, in the non-transitory storage medium for packaging the multi-view frame to obtain the package frame, the method and device for storing the package frame, the first view frame is divided to obtain a plurality of The first view splits the frame, and combines the first view split frame and the second view frame to obtain a package frame centered on a central area of the display screen. Thereby, not only the image frame can be correctly restored by the restoration process, for example, a naked-eye multi-view stereo image or a glasses-type dual-view stereo image, and more importantly, the center of the second view frame is displayed in the center of the display screen. The area, preferably, overlaps with the center point of the display screen, and the better system completely overlaps. At least a part of the packaging frame can be displayed not only on the 2D display screen, but also by the actual viewing of the human eye, the 2D image seen is quite comfortable and natural, and does not have an uncomfortable feeling.

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

S01~S02‧‧‧Steps

Claims (33)

A method for packaging a multi-view frame to obtain a package frame, the multi-view frame comprising a first view frame and a second view frame corresponding to the first view frame, the at least one of the package frames A portion may be displayed on a display screen, the method comprising: dividing the first view frame to obtain two first view split frames; and combining the two first view split frames to the second view The left side and the right side of the frame to obtain the packaging frame; or the two first viewing angle dividing frames are respectively combined on the upper side and the lower side of the second viewing frame to obtain the packaging frame, wherein the The center of the second view frame is displayed in the central area of the display screen. The method of claim 1, wherein a center point of the second view frame overlaps a center point of the display screen. The method of claim 1, wherein the size of the package frame is greater than or equal to the size of the display screen. The method of claim 1, wherein the step of combining the first view split frame and the second view frame further comprises: inverting the first view split frames. The method of claim 1, further comprising: resizing a first view original frame to obtain the first view frame; and resizing a second view original frame to The second view frame is obtained. The method of claim 5, wherein the step of re-adjusting the size of the first view original frame to obtain the first view frame comprises: respectively extracting the first view original frame a pixel value of an odd position of the nth pixel and a pixel value of an even position of the (n+1)th pixel; and a pixel value of the odd position of the nth pixel and the number (n) +1) The pixel value of the even position of the line pixel corresponds to the pixel stored in the odd position of the (n+1)/2th pixel of the first view frame and the (n+1)/2 In the pixels of the even position of the line pixel, where n is a positive odd number. The method of claim 5, wherein the step of re-adjusting the size of the first view original frame to obtain the first view frame comprises: respectively extracting the first view original frame The pixel value of the odd position of the nth column of pixels and the (n+1) a pixel value of an even position of the column pixel; and corresponding to a pixel value of the odd position of the nth column pixel and a pixel value of the even position of the (n+1)th column pixel And stored in the pixel of the odd position of the (n+1)/2th pixel of the first view frame and the pixel of the even position of the (n+1)/2th pixel, wherein n It is an odd number. The method of claim 5, wherein the step of re-adjusting the size of the second view original frame to obtain the second view frame comprises: respectively extracting the second view original frame a pixel value of an odd position of the nth pixel and a pixel value of an even position of the (n+1)th pixel; and a pixel value of the odd position of the nth pixel and the number (n) +1) The pixel value of the even position of the line pixel corresponds to the pixel stored in the odd position of the (n+1)/2th pixel of the second view frame and the (n+1)/2th line Inside the pixel of the even position of the pixel, where n is a positive odd number. The method of claim 5, wherein the step of re-adjusting the size of the second view original frame to obtain the second view frame comprises: respectively extracting the second view original frame a pixel value of an odd-numbered position of the nth column of pixels and a pixel value of an even-numbered position of the (n+1)-th column pixel; and a pixel value of the odd-numbered position of the nth column of pixels and the number (n) +1) The pixel value of the even position of the column pixel corresponds to the pixel stored in the odd position of the (n+1)/2th pixel of the second view frame and the (n+1)/2 Within the pixels of the even position of the column, where n is a positive odd number. The method of claim 5, wherein the first view original frame or the second view original frame has the same size as the package frame. The method of claim 5, wherein the size of the first view frame is one-half of the original frame of the first view, and the size of the second view frame is the original view of the second view. One-half of the box. A device for packaging a multi-view frame to obtain a package frame, the multi-view frame comprising a first view frame and a second view frame corresponding to the first view frame, the package frame being at least A portion may be displayed on a display screen, the device comprising: a segmentation processing unit that divides the first view frame to obtain two first view segmentation frames; and a combined processing unit that respectively combines the two a first perspective segmentation frame in the second perspective The left side and the right side of the frame to obtain the packaging frame; or the two first viewing angle dividing frames are respectively combined on the upper side and the lower side of the second viewing frame to obtain the packaging frame, wherein the The center of the two-view frame is displayed in the central area of the display screen. The device of claim 12, wherein a center point of the second view frame overlaps a center point of the display screen. The device of claim 12, wherein the size of the package frame is greater than or equal to the size of the display screen. The device of claim 12, further comprising: an inversion processing unit, the inversion processing unit before combining the first view segmentation frame and the second view frame by the combination processing unit Reverse the first perspective segmentation frames. The device of claim 12, further comprising: a re-processing unit, re-adjusting a size of a first view original frame to obtain the first view frame, and re-adjusting a second view original image The size of the box to get the second perspective frame. The apparatus of claim 16, wherein the reprocessing unit extracts a pixel value of an odd position of the nth pixel of the original picture frame of the first view and an (n+1)th line pixel a pixel value of the even position, and correspondingly storing the pixel value of the odd position of the nth pixel and the pixel value of the even position of the (n+1)th pixel into the first view frame In the pixel of the odd-numbered position of the (n+1)/2-line pixel and the even-numbered pixel of the (n+1)/2th pixel, where n is a positive odd number. The device of claim 16, wherein the reprocessing unit extracts a pixel value and an (n+1)th column pixel of an odd position of the nth column of the first view original frame. a pixel value of the even-numbered position, and storing the pixel value of the odd-numbered position of the n-th pixel and the pixel value of the even-numbered position of the (n+1)th pixel into the first view frame In the pixel of the odd-numbered position of the (n+1)/2th pixel and the even-numbered pixel of the (n+1)/2th pixel, where n is a positive odd number. The apparatus of claim 16, wherein the reprocessing unit extracts a pixel value of the odd-numbered positions of the n-th pixel of the original picture frame of the second viewing angle and the (n+1)th line pixel The pixel value of the even position, and the pixel value of the odd position of the nth pixel and the (n+1)th The pixel value of the even position of the line pixel corresponds to the pixel stored in the odd position of the (n+1)/2th pixel of the second view frame and the (n+1)/2 line pixel. Within the pixels of the even position, where n is a positive odd number. The apparatus of claim 16, wherein the reprocessing unit extracts a pixel value of the odd-numbered positions of the nth column of the second view original frame and the (n+1)-th column pixel a pixel value of the even position, and correspondingly storing the pixel value of the odd position of the nth column pixel and the pixel value of the even position of the (n+1)th column pixel into the second perspective frame In the pixel of the odd-numbered position of the (n+1)/2th pixel and the even-numbered pixel of the (n+1)/2th pixel, where n is a positive odd number. The device of claim 16, wherein the first view original frame or the second view original frame has the same size as the package frame. The device of claim 16, wherein the size of the first view frame is one-half of the original frame of the first view, and the size of the second view frame is the original view of the second view. One-half of the box. A non-transitory storage medium is accessible to a data processing system, and the non-transitory storage medium stores a program for packaging a multi-view frame to obtain a method for packaging a frame, the multi-view frame including a first view a frame and a second view frame corresponding to the first view frame, at least a portion of the package frame may be displayed on a display screen, the method of the method comprising: dividing the first view frame to obtain Two first viewing angles are divided into frames; and the two first viewing angle divided frames are respectively combined on the left and right sides of the second viewing frame to obtain the packaging frame; or the two first viewing angles are divided The frames are respectively combined on the upper side and the lower side of the second view frame to obtain the package frame, wherein the center of the second view frame is displayed in a central area of the display screen. The non-transitory storage medium of claim 23, wherein a center point of the second view frame overlaps a center point of the display screen. The non-transitory storage medium of claim 23, wherein the size of the packaging frame is greater than or equal to the size of the display screen. The non-transitory storage medium of claim 23, wherein the first perspective points are When the cut frame is combined with the second view frame, the first view split frames are reversed. The non-transitory storage medium of claim 23, wherein the size of the first view original frame is re-adjusted to obtain the first view frame, and the size of the second view original frame is re-adjusted. To get the second perspective frame. The non-transitory storage medium of claim 27, wherein the size of the first view original frame is re-adjusted to obtain the first view frame, and the first view original frame is respectively taken out The pixel value of the odd-numbered position of the n-line pixel and the pixel value of the even-numbered position of the (n+1)-th row pixel, and the pixel value of the odd-numbered position of the n-th pixel and the first (n+) 1) The pixel value of the even position of the line pixel corresponds to the pixel stored in the odd position of the (n+1)/2th pixel of the first view frame and the (n+1)/2th line. In the pixels of the even position of the pixel, n is a positive odd number. The non-transitory storage medium of claim 27, wherein the size of the first view original frame is re-adjusted to obtain the first view frame, and the first view original frame is respectively taken out a pixel value of an odd-numbered position of the n-th pixel and a pixel value of an even-numbered position of the (n+1)-th column pixel, and a pixel value of the odd-numbered position of the n-th pixel and the first (n+) 1) The pixel value of the even position of the column pixel corresponds to the pixel stored in the odd position of the (n+1)/2th pixel of the first view frame and the (n+1)/2th column. In the pixels of the even position of the pixel, n is a positive odd number. The non-transitory storage medium of claim 27, wherein the size of the second view original frame is re-adjusted to obtain the second view frame, and the second view original frame is respectively taken out The pixel value of the odd-numbered position of the n-line pixel and the pixel value of the even-numbered position of the (n+1)-th row pixel, and the pixel value of the odd-numbered position of the n-th pixel and the first (n+) 1) The pixel value of the even position of the line pixel corresponds to the pixel stored in the odd position of the (n+1)/2th pixel of the second view frame and the (n+1)/2th line. In the pixels of the even position of the pixel, n is a positive odd number. The non-transitory storage medium of claim 27, wherein the size of the second view original frame is re-adjusted to obtain the second view frame, and the second view original frame is respectively taken out a pixel value of an odd-numbered position of the n-th pixel and a pixel value of an even-numbered position of the (n+1)-th column pixel, and a pixel value of the odd-numbered position of the n-th pixel and the first (n+) 1) The pixel value of the even position of the column pixel corresponds to the pixel stored in the odd position of the (n+1)/2th pixel of the second view frame and the (n+1)/2th column In the pixels of the even position of the pixel, n is a positive odd number. The non-transitory storage medium of claim 27, wherein the first view original frame or the second view original frame has the same size as the package frame. The non-transitory storage medium of claim 27, wherein the size of the first view frame is one-half of the original view frame, and the size of the second view frame is the first Two perspectives of the original frame.