KR101603414B1 - Method and apparatus for encoding of 2demensional video using depth image - Google Patents

Abstract

A video encoding apparatus using depth information and a method thereof are disclosed. According to an exemplary embodiment of the present invention, a method of coding an image using depth information includes: determining a motion search range in an entire motion search area for motion vector calculation of the current CU based on object information of a current coding unit (CU) step; And determining an optimal motion vector of the current CU based on motion information within the motion search range.

Description

Technical Field [0001] The present invention relates to a video encoding apparatus and a video encoding apparatus using depth information,

The present invention relates to video encoding using depth information, and more particularly, to a method and apparatus for efficiently encoding an image by deriving object information using depth information.

Depth information images are widely used in 3D video encoding and have depths in new input devices such as Kinect cameras on Xbox game machines, Intel SENZ3D webcams, iSense 3D scanners on IPad, Google Tango smartphones, Information cameras can be used in many different 3D and 2D application applications.

On the other hand, 2D / 3D application applications are popularized with more 2D / 3D application services due to popularization and diffusion of depth information cameras, so that multimedia camera systems can be used for various information including depth camera. Do.

US Patent Publication No. 20140085416 entitled " Method and apparatus for compressing texture image in 3d video coding " Korean Patent Publication No. 2012-0137305 (entitled " Method for dividing a block and apparatus using such a method) Korean Patent Publication No. 2014-0048784 entitled " Method and Apparatus for Deriving Motion Information by Sharing Limited Depth Information Value "

An object of the present invention is to provide an image encoding method and apparatus capable of efficient encoding without deterioration in performance by using depth information in two-dimensional video encoding.

According to an exemplary embodiment of the present invention, a method of coding an image using depth information includes: determining a motion search range in an entire motion search area for motion vector calculation of the current CU based on object information of a current coding unit (CU) step; And determining an optimal motion vector of the current CU based on motion information within the motion search range.

According to another embodiment of the present invention, there is provided a method of encoding an image using depth information, comprising: identifying an entire motion search area for motion vector calculation of a current coding unit (CU); Determining whether or not to search for a motion at the current motion search position according to the depth information of the current CU extracted from the depth image; And determining an optimal motion vector of the current CU considering a determined motion search.

The apparatus for coding an image using depth information according to an embodiment determines a motion search range in an entire motion search area for motion vector calculation of the current CU based on object information of a current coding unit (CU) A motion search range determination unit; And a motion vector determination unit for determining an optimal motion vector of the current CU based on motion information within the motion search range.

 The apparatus for encoding an image using depth information according to another embodiment confirms the entire motion search area for motion vector calculation of a current coding unit (CU) and stores the depth information of the current CU extracted from the depth image A motion search determination unit for determining whether or not to search for a motion in the current motion search position; And a motion vector determination unit for determining an optimal motion vector of the current CU based on motion information within the motion search range.

According to an embodiment of the present invention, a 2D general image is encoded using a depth information image acquired from a depth information camera, thereby efficiently encoding 2D images.

1 is an exemplary view of a depth information map of a general image and a general image.
Figure 2 is an illustration of a Kinect input device.
Figure 3 shows a webcam product.
Figure 4 shows an iSense 3D scanner device.
Figure 5 shows a Google Tango smartphone.
6 is a diagram for explaining an HEVC encoding apparatus.
7 is a diagram for explaining an example of image encoding using a HEVC encoder in a smartphone.
8 is a view for explaining an example of an HEVC including a depth image in a smartphone.
Fig. 9 shows examples of dividing into a plurality of units of an image.
10 shows an example of a method for obtaining motion information of a current block from a reference block according to the related art.
Fig. 11 shows an example of a method of obtaining a motion vector according to the prior art.
Figure 12 shows examples of depth images.
13 is a flowchart illustrating a motion vector determination method according to an embodiment of the present invention.
14 is a flowchart illustrating a motion vector determination method according to another embodiment of the present invention.
15 is a diagram for explaining an example of a motion search method according to an embodiment of the present invention.
16 is a view for explaining an example of a motion search method using depth information according to an embodiment of the present invention.
17 is a diagram for explaining a configuration of an image encoding apparatus according to an embodiment of the present invention.
18 is a diagram showing examples of depth value distribution of CU.

The following merely illustrates the principles of the invention. Thus, those skilled in the art will be able to devise various apparatuses which, although not explicitly described or shown herein, embody the principles of the invention and are included in the concept and scope of the invention. Furthermore, all of the conditional terms and embodiments listed herein are, in principle, intended only for the purpose of enabling understanding of the concepts of the present invention, and are not intended to be limiting in any way to the specifically listed embodiments and conditions .

For example, it should be understood that the block diagrams herein represent conceptual aspects of exemplary circuits embodying the principles of the invention. Similarly, all flowcharts, state transition diagrams, pseudo code, and the like are representative of various processes that may be substantially represented on a computer-readable medium and executed by a computer or processor, whether or not the computer or processor is explicitly shown .

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is an exemplary view of a depth information map of a general image and a general image. Figure 2 is an illustration of a Kinect input device.

Referring to FIG. 1, FIG. 1 (A) shows an image actually photographed through a camera, and FIG. 1 (B) shows a depth image of a real image, that is, a depth information image (or a depth information map). Depth Information means information indicating the distance between a camera and an actual object.

This depth information image is mainly used to generate three-dimensional virtual viewpoint images. As a result of this study, a joint standardization group of ISO / IEC Moving Picture Experts Group (MPEG) and ITU-T VCEG (Video Coding Experts Group) 3D video standardization is currently underway in JCT-3V (Joint Collaborative Team on 3D Video Coding Extension Development).

The 3D video standard includes standards for advanced data formats and related technologies that can support stereoscopic images as well as stereoscopic images using general images and their depth information images.

In November 2010, Microsoft released Kinect sensor as a new input device for XBOX-360 game devices. It is a device that recognizes human motion and connects it to a computer system. As shown in Figure 2, But also includes a 3D Depth sensor. In addition, the Kincet can generate RGB images and depth information maps (Depth Map) up to 640x480 with the image device and provide them to the connected computer. In 2014, Intel announced a 720p CREATIVE SENZ3D webcam with a 320x240 depth sensor for laptops. Apple released iSense as a 3D scanner for iPad with RGB camera and Depth sensor, and Google launched Tango Smart Phone.

Figure 3 shows a webcam product.

Referring to FIG. 3, a CREATIVE SENZ3D webcam is shown, wherein FIG. 3A shows a SENZ3D webcam product and FIG. 3B shows a SENZ3D webcam prototype.

Figure 4 shows an iSense 3D scanner device, and Figure 5 shows a Google Tango smartphone.

4 (A) shows an iSense product, and (B) shows an example of a scanning process through iSense. FIG. 5A shows a Google Tango smartphone product, and FIG. 5B shows a Google Tango smartphone prototype.

The advent of visual devices such as Kinect, iSense 3D Scanner, Intel SENZ3D webcam, and Google Tango smartphone has made it possible to popularize a variety of applications such as high-end 2D and 3D games and video services, An information camera or a video device with a sensor is being popularized.

As such, the future video system is not only a service for two-dimensional general video, but also a type in which a two-dimensional and three-dimensional application video service is basically provided by combining a general video camera with a depth camera, or an input assistance in a handheld system It is expected to develop in the form of devices.

A video system in which a general camera and a depth camera are fundamentally combined is a new method of using depth information in a two-dimensional video codec as well as using depth information in a three-dimensional video codec.

Also, in a camera system including a depth information camera, general image encoding can be performed using the existing video codec as it is. AVC, MVC, SVC, HEVC, SHVC, 3D-AVC, MPEG-2, MPEG-4, H.261, H.262, H.263, H.264 / AVC, , 3D-HEVC, VC-1, VC-2, VC-3, and the like, and can be encoded with various other codecs.

6 is a diagram for explaining an HEVC encoding apparatus.

As an example of a method of encoding an actual image and its depth information map, the Moving Picture Experts Group (MPEG) and the Video Coding Experts Group (VCEG), which have the highest coding efficiency among the video coding standards developed so far, Encoding can be performed using one HEVC (High Efficiency Video Coding). An example of a coding structure of HEVC is shown in Fig. As shown in FIG. 6, the HEVC includes various new algorithms such as coding unit and structure, inter prediction, intra prediction, interpolation, filtering, and transform. 6 is a block diagram showing an example of the configuration of the image encoding apparatus, and shows the configuration of an encoding apparatus according to the HEVC codec.

At this time, SAO (Sample Adaptive Offset) may be provided between the filter unit of FIG. 6 and the reference image buffer. The SAO may add a proper offset value to the pixel value to compensate for coding errors.

Since the HEVC performs inter prediction coding, i.e., inter prediction coding, the currently encoded image needs to be decoded and stored for use as a reference image. Accordingly, the quantized coefficients are inversely quantized in the inverse quantization unit and inversely transformed in the inverse transformation unit. The inverse quantized and inverse transformed coefficients are added to the prediction block through the adder 175 and a reconstruction block is generated. The reconstruction block that has passed through the filter section is stored in the reference image buffer.

7 is a diagram for explaining an example of image encoding using a HEVC encoder in a smartphone. 8 is a view for explaining an example of an HEVC including a depth image in a smartphone.

Referring to FIG. 7, a general form in a smartphone to which an HEVC encoder is applied may be a form in which an image photographed through a smartphone is encoded using an HEVC encoder, and a service is provided with a coded image.

However, if an image is captured through a smart phone including a Depth camera, the texture and the depth are independently generated as shown in FIG. 8, and the optimization is performed using the correlation with the general image using the depth information Through the HEVC encoder through the reduction of the complexity can get better images.

US Patent Publication No. 20140085416 of Patent Document 1 discloses a structure for merging blocks by checking information about an object of a current block from a depth map. However, It is impossible to start the motion vector of the CU at all.

Korean Patent Laid-Open Publication No. 2012-0137305 and Patent Laid-Open Publication No. 2014-0048784 disclose a method of extracting a motion vector when the contents using the depth information can not be disclosed or when the division structure of the CU is predicted It is not clear how to reduce the computational complexity.

Fig. 9 shows examples of dividing into a plurality of units of an image.

The high-efficiency video coding scheme performs coding by dividing an image into LCU (LCU: Largest Coding Unit) units, which is a basic unit of a coding unit (CU) when performing coding.

Here, the CU plays a role similar to a macro block (MB), which is a basic block in H.264 / AVC, which is a conventional video codec, but unlike an MB having a fixed size of 16x16, You can set the size to. In addition, the divided LCU for encoding can be divided into several CUs having a smaller size than the LCU for efficient encoding of the image.

Referring to FIG. 9, a 64x64 LCU may be divided into a plurality of CUs in various manners.

9A shows an example in which a 64x64 LCU having a division depth value of 0 is divided into 32x32 CUs having a division depth of 1. FIG.

FIG. 9B shows an example of dividing one of CUs having a size of 32x32 by a division depth 2, and FIG. 9C shows an example of dividing two of 32x32 CUs into a division depth 2.

FIG. 9D shows an example including CUs divided by the division depth 3.

Thus, the LCU or CU partition structure candidates may exist in various ways.

The LCU division structure is division information of the encoding unit. In the step of determining the optimal LCU partition structure after creating the various LCU partition structures as described above and storing them in the candidate LCU partition structure, one of the LCU partition structure candidates is selected as the optimal LCU partition structure in units of LCU . By using this method, encoding is performed on the basis of an LCU divided structure adaptive to the characteristics of an image in units of LCU, thereby effectively encoding in terms of encoding efficiency and image quality.

In the conventional two-dimensional video codec, algorithms are designed without reflecting the use of depth information at all. However, since the actual image and its depth information image have a large correlation, it is possible to utilize the depth information to encode the two-dimensional image, Can be considered.

The basic principle of the present invention is to use the depth information in the motion estimation method to efficiently use the depth information obtained from the depth information camera for encoding in the 2D video codec.

For example, when the objects of the general image are classified by using the depth information image, the coding complexity of the general image can be greatly reduced.

In the block-based encoding codec, a plurality of objects may exist in the block. Different encoding methods are applied to the objects based on the depth information image. .

10 shows an example of a method for obtaining motion information of a current block from a reference block according to the related art.

Referring to FIG. 10, a motion vector (MV), which is motion information, is obtained by finding a distance between a current block to be currently predicted and a block closest to the reference video, as shown in FIG. 10A .

Referring to FIG. 10B, MVP (Motion Vector Predictor), which is motion information, can be determined through neighboring blocks A, B, C and D of the current block, and MVD (Motion Vector Difference) MVP. ≪ / RTI >

At this time, the obtained MVD can be used for the video encoding process.

Fig. 11 shows an example of a method of obtaining a motion vector according to the prior art.

FIG. 11 illustrates a method of obtaining MVs in coding motion information of inter-picture prediction for a current coding unit (CU) in the HEVC coding process.

11 (A) is a flowchart for obtaining MV in the HEVC, and FIG. 11 (B) illustrates a motion search method.

Referring to FIG. 11, a location where a block closest to a current CU exists is firstly located at positions in a motion search area from a reference frame using a diamond search method, and a search is performed using a two- It is possible to obtain an optimal MV by finely comparing with neighboring positions.

11 (B), the optimal search position of the current CU is set to 1, and the optimum position of 4 is found by the diamond search method. By using the 5-point search method using the 2-point search method, MV can be obtained.

In case of motion search method in HEVC, all the MVs from the corresponding position are obtained uniformly for the position in the motion search area by the search algorithm, and the optimal MV is selected therefrom. In this method, since the correlation between the block for obtaining MV and the positions in the search area is not known, a method of obtaining MVs for all positions is used. Also, it increases the coding complexity by increasing the unnecessary calculation for the positions where there is no correlation between the CU for MV and the search area.

This process of obtaining the MV does not consider the object information for the neighboring blocks. This is because, in the case of two-dimensional images, if there is no depth camera, the object information in the image must be extracted through the two-dimensional image analysis. Therefore, there is no method using the object information in the existing two-dimensional video coding method.

For the same reason, in the case of HEVC, there is no coding method using object information even in the method of obtaining MV in intra-picture motion prediction. However, if the object information can be considered using the Depth camera, it is possible to know the correlation between the CU and the search area in the motion prediction, and if the search area can be set, the coding complexity is effectively reduced.

Therefore, when the depth information is used for motion search, the same object area as the corresponding CU is determined, and if the motion search range is limited for the corresponding area, the coding complexity can be efficiently reduced.

Figure 12 shows examples of depth images.

12A is a depth image of the 84th image frame obtained from the depth camera, and FIG. 12B is a depth image of the 83rd image frame obtained from the depth camera, for example.

12 (A) is a current image. When the current CU has a single object, in searching for a motion from the reference frame as shown in FIG. 12 (B), the same object The area can be judged.

In the case of the same object area as the current CU, there is a high probability of having an optimal MV, otherwise, there is a high probability of not having an optimal MV. Accordingly, when the same object region of the current CU is determined, the motion search is not performed for the region of the motion search region that is not the same object region as the current CU, thereby reducing the amount of calculation required for motion search.

The method proposed in the present invention is to encode motion information by determining the same object region using depth information in the search range determination in motion prediction for a block.

13 is a flowchart illustrating a motion vector determination method according to an embodiment of the present invention.

Referring to FIG. 13, in step 1310, the image encoding apparatus determines a motion search range in the entire motion search area for motion vector calculation of the current CU based on object information of a current coding unit (CU).

For example, the entire motion search area for motion vector calculation of the current CU may be the "search area" shown in Fig. 12B.

At this time, the motion search range may be the same object region as the object constituting the current CU. Thus, for example, the motion search range may be the "search O" portion excluding the "search X" portion in FIG. 12B.

The step of determining a motion search range 1310 may include a step of checking depth information of a current coding unit (CU) from the depth image.

The motion search range determination step 1310 determines object information of the current CU based on the depth information, determines whether the current CU is composed of a single object based on object information of the CU, And excluding an area that is not the same as a single object of the CU among the entire motion search area when the object is composed of the motion search area.

At this time, the object information may be the label value of the object information image labeled by the labeling algorithm or the depth value distribution information obtained from the depth image. For example, the labeling algorithm may be a Watersherd labeling algorithm.

At this time, the depth value distribution can be obtained as shown in FIG. 18, for example.

For example, if the difference between the maximum value and the minimum value included in the depth value distribution information of the current CU is less than the preset value, it can be determined that the current CU is composed of a single object.

The step of determining a motion search range may include determining whether the current CU is composed of a single object based on a maximum value and a minimum value included in the current CU size and the depth value distribution information of the current CU . For example, step 1310 may include steps 1610 and 1620 of FIG.

In operation 1320, the image encoding apparatus determines an optimal motion vector of the current CU based on motion information within a motion search range.

At this time, a method for determining the optimal motion vector of the current CU may be the method described in FIGS. 10 to 11 for the "search O" portion except for the "search X" portion in FIG. 12 (B).

14 is a flowchart illustrating a motion vector determination method according to another embodiment of the present invention.

Referring to FIG. 14, in step 1410, the image encoding apparatus identifies an entire motion search area for motion vector calculation of a current coding unit (CU).

In step 1420, it is determined whether or not to search for a motion in the current motion search position according to the depth information of the current CU extracted from the depth image.

In operation 1420, it is determined whether the current CU is a single object based on a maximum value and a minimum value included in the current CU size and the depth value distribution information of the current CU. have.

If the difference between the maximum value and the minimum value of the four corner depth values of the current CU is less than a preset reference value in step 1420, the image encoding apparatus determines that the current CU And if the depth value of the current motion search location differs from the stored value, it is determined that the current location is searched if the depth value of the current motion search location is equal to the stored value, It can be determined not to search the location.

If the current CU size is smaller than the predetermined value and the four corner depth values of the current CU are all the same, the image encoding apparatus determines whether the four corner depth values of the current CU are equal to each other And if the depth value of the current motion search location differs from the stored value, the current location is not searched for, and if the depth value of the current motion search location is different from the stored value, You can decide.

The optimum motion vector of the current CU is determined in consideration of whether or not the motion search is determined in step 1430.

15 is a diagram for explaining an example of a motion search method according to an embodiment of the present invention.

In step 1510, the image encoding apparatus starts searching from the motion search area. In step 1520, it is determined whether the current CU is configured as a single object area. If the CU is configured as a single object area, step 1530 is performed. Otherwise, The conventional motion search method according to the conventional art can be applied to calculate a motion vector.

If the object at the reference frame position and the object at the current CU are in the same object region or in the same object at step 1530, the motion vector is calculated at the corresponding position at step 1550. If not, Information indicating that the motion vector is not obtained at the current position may be stored and the motion search process may be terminated.

16 is a view for explaining an example of a motion search method using depth information according to an embodiment of the present invention.

The method shown in FIG. 16 shows an example of determining whether the same object is present and whether or not to search for a motion at the current position.

In step 1610, the image encoding apparatus checks whether the current size of the CU is 64x64 or 32x32. If the size of the current CU is 32x32 or larger, step 1620 is performed. Otherwise, step 1640 is performed.

It is determined in step 1620 whether the difference between the maximum value and the minimum value of the depth values of the four corners of the current CU is less than 5 from the depth value distribution information. If the difference between the maximum value and the minimum value is less than 5, step 1630 is performed. Otherwise, step 1680 is performed.

In step 1630, the image encoding apparatus stores the upper left depth value among the four corners of the current CU, and performs step 1670.

In step 1640, the image encoding apparatus checks whether the size of the current CU is 16x16. If the size of the current CU is 16x16, step 1650 is performed. Otherwise, step 1680 is performed.

If it is determined in step 1650 that the depth values of the four corners of the current CU are all the same, step 1660 is performed. Otherwise, step 1680 is performed.

In step 1660, the image encoding apparatus stores one of the four corners of the current CU and performs step 1670. FIG.

In step 1670, the image encoding apparatus checks whether the depth value of the current motion search location is equal to the previous value stored in step 1630 or 1660.

If the current motion search position, i.e., the depth value at the current motion search point is the same as the previously stored value, the motion information of the current position is searched in step 1680, and if not, the motion information of the current position is searched in step 1690 And the motion search process can be terminated.

17 is a diagram for explaining a configuration of an image encoding apparatus according to an embodiment of the present invention.

Referring to FIG. 17, the image encoding apparatus 1700 may perform the method of FIGS.

The image encoding apparatus 1700 may include a motion search range determination unit 1710, a motion search determination unit 1720, and a motion vector determination unit 1730.

For example, the image encoding apparatus 1700 may include a motion search range determination unit 1710 and a motion search determination unit 1720. In addition, the image encoding apparatus 1700 may include a motion search determination unit 1720 and a motion vector determination unit 1730.

The motion search range determining unit 1710 determines the motion search range in the entire motion search area for calculating the motion vector of the current CU based on the object information of the current coding unit (CU).

At this time, the motion search range may be the same object region as the object constituting the current CU.

The motion search range determination unit 1710 may exclude, from the motion search range, an area that is not the same as the single object of the CU among the entire motion search areas, if the current CU is a single object.

The motion search range determination unit 1710 may determine whether the current CU is composed of a single object based on the maximum value and the minimum value included in the current CU size and the depth value distribution information of the current CU.

The motion search determination unit 1720 determines an entire motion search area for calculating a motion vector of a current coding unit (CU), and determines whether the current motion search location is a current motion search location based on the depth information of the current CU Or not.

If the difference between the maximum value and the minimum value of the four corner depth values of the current CU is equal to or less than a preset reference value, the motion search determination unit 1720 determines which of four corner depth values of the current CU Save one.

The motion search determination unit 1720 stores any one of the four corner depth values of the current CU if the current CU size is smaller than the predetermined value and the four corner depth values of the current CU are all the same value.

If the depth value of the current motion search location differs from the stored value, the motion search determination unit 1720 searches for the current location, if the depth value of the current motion search location is equal to the stored value. It can be determined that it is not.

The motion vector determination unit 1730 determines an optimal motion vector of the current CU based on the motion information in the motion search range.

18 is a diagram showing examples of depth value distribution of CU.

As an example of a method of determining whether a CU or a block is composed of the same single object in the image encoding method according to the embodiment, a depth value of a CU or four corner positions of a block may be used.

Referring to FIG. 18, the image encoding apparatus can determine that the CU depth value distribution such as (A) is selected with a small change in the depth value.

On the other hand, the image encoding apparatus can determine that the CU depth value distribution as shown in FIG. 18 (B) is not formed as a single object because the depth value changes greatly.

Referring to FIG. 18B, it can be seen that the depth value of the middle portion and the corner portion in the CU change is very large. In this case, it can be seen that the difference between the maximum value and the minimum value is large among the depth values of the four corners . Therefore, it is possible to perform CU segmentation because the probability that such a CU is composed of a single object is low.

The image encoding apparatus can determine that the CU is a single object if the difference between the maximum value and the minimum value of the four corner depth values of the CU is less than a preset reference value.

In this case, for example, in FIG. 18A, the normalized depth value of M1 is 9, the normalized depth values of M2 and M3 are 7, and the normalized depth value of M4 may be 7.

Also, in FIG. 18 (B), the normalized depth value of M1 is 9, the normalized depth value of M2 and M4 is 7, and the normalized depth value of M3 may be 1.

18A, the difference between the maximum value and the minimum value of the depth value of the four corners of the CU is 2, and the difference between the maximum value and the minimum value of the depth value of the four corners of the CU is 8 in FIG. 18B.

Therefore, when the preset reference value is 5, it can be determined that FIG. 18A is composed of a single object, and FIG. 18B is not composed of a single object.

Table 1 shows experimental results of applying the embodiment shown in FIG. 16 to HEVC.

Experimental results show that the coding complexity is reduced without degradation of image quality with the same quality in subjective image quality.

In the embodiments of the present invention, the object range or the application range may vary depending on the block size or the division depth of the CU.

In this case, the variable (i.e., size or depth information) for determining the application range may be set to use a predetermined value by the encoder or the decoder, use a predetermined value according to the profile or level, Is described in the bit stream, the decoder may obtain the value from the bit stream and use it. When the application range is changed according to the CU division depth, it is as shown in [Table 2]. The method A may be a method which applies only to a depth of a predetermined depth value or more, the method B may be a method which applies only to a predetermined depth value or less, and the method C may have a method of applying only a predetermined depth value.

[Table 2]

Table 2 shows an example of a method of determining the application range to which the methods of the present invention are applied when the given CU division depth is 2. (O: applied to the depth, X: not applied to the depth.)

In the case where the methods of the present invention are not applied to all the depths, an arbitrary indicator may be used to indicate in the bitstream, and a value one greater than the maximum value of the CU depth may be used as the CU depth value indicating the coverage, .

In addition, each of the above-described methods can be applied to the color difference block differently depending on the size of the luminance block, and can be applied to the luminance signal image and the color difference image.

[Table 3] shows an example in which different methods are applied depending on the size of the luminance block and the color difference block.

[Table 3]

Among the modified methods of Table 3, Method 1 is the case where the size of the luminance block is 8 (8x8, 8x4, 2x8, etc.) and the size of the color difference block is 4 (4x4, 4x2, 2x4) The method of constructing a merge list according to an embodiment of the present invention can be applied to a luminance signal and a color difference signal.

Among the above-mentioned modified methods, in the method wave 2, when the luminance block size is 16 (16x16, 8x16, 4x16, etc.) and the color difference block size is 4 (4x4, 4x2, 2x4) The merge list construction method according to the embodiment of the present invention may be applied to the luminance signal and not to the color difference signal.

In another modified method, the merge list construction method according to the embodiment of the present invention is applied only to the luminance signal, and may not be applied to the color difference signal. Conversely, the merge list construction method according to the embodiment of the present invention is applied only to the color difference signal, and may not be applied to the luminance signal.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (17)

Determining a motion search range in an entire motion search area for motion vector calculation of the current CU based on object information of a current coding unit (CU); And
Based on a maximum value and a minimum value included in the current CU size and the depth value distribution information of the current CU based on the motion information in the motion search range, Object
The depth information including the depth information. The method according to claim 1,
Wherein the motion search range is the same object area as the object constituting the current CU
Image coding method using depth information. Determining a motion search range in an entire motion search area for motion vector calculation of the current CU based on object information of a current coding unit (CU); And
And determining an optimal motion vector of the current CU based on motion information in the motion search range,
Wherein the step of determining the motion search range comprises:
Checking depth information of a current coding unit (CU) from a depth image;
Determining object information of the current CU based on the depth information;
Determining whether the current CU is a single object based on object information of the CU; And
If the current CU is a single object, excluding a region of the entire motion search region that is not the same as a single object of the CU from the motion search range
Image coding method using depth information. 4. The method according to any one of claims 1 to 3,
Wherein the object information is a label value of an object information image labeled by a labeling algorithm or a depth value distribution information obtained from the depth image,
Image coding method using depth information. 5. The method of claim 4,
If the difference between the maximum value and the minimum value included in the depth value distribution information of the current CU is less than a preset value, it is determined that the current CU is a single object
Image coding method using depth information. delete delete Identifying an entire motion search area for motion vector calculation of a current coding unit (CU);
Determining whether or not to search for a motion at the current motion search position according to the depth information of the current CU extracted from the depth image; And
And determining an optimal motion vector of the current CU in consideration of the determined motion search,
Wherein the step of determining whether to search for a motion at the current motion search position comprises:
Determining whether the current CU is a single object based on a maximum value and a minimum value included in the current CU size and the depth value distribution information of the current CU;
Image coding method using depth information. Identifying an entire motion search area for motion vector calculation of a current coding unit (CU);
Determining whether or not to search for a motion at the current motion search position according to the depth information of the current CU extracted from the depth image; And
And determining an optimal motion vector of the current CU in consideration of the determined motion search,
Wherein the step of determining whether to search for a motion at the current motion search position comprises:
Storing one of the four corner depth values of the current CU if the size of the current CU is greater than or equal to a predetermined value and the difference between the maximum and minimum values of the four corner depths of the current CU is less than a preset reference value; And
Determining that the current position is searched if the depth value of the current motion search position is equal to the stored value and determining that the current position is not searched if the depth value of the current motion search position is different from the stored value
The depth information including the depth information. Identifying an entire motion search area for motion vector calculation of a current coding unit (CU);
Determining whether or not to search for a motion at the current motion search position according to the depth information of the current CU extracted from the depth image; And
And determining an optimal motion vector of the current CU in consideration of the determined motion search,
Wherein the step of determining whether to search for a motion at the current motion search position comprises:
Storing one of the four corner depth values of the current CU if the size of the current CU is less than a preset value and the four corner depth values of the current CU are all the same value; And
Determining that the current position is searched if the depth value of the current motion search position is equal to the stored value and determining that the current position is not searched if the depth value of the current motion search position is different from the stored value
The depth information including the depth information. A motion search range determining unit that determines a motion search range in the entire motion search area for motion vector calculation of the current CU based on object information of a current coding unit (CU); And
Determining an optimal motion vector of the current CU based on the motion information in the motion search range, and if the current CU is a single object, The motion vector decision unit
The depth information including the depth information. 12. The method of claim 11,
Wherein the motion search range is the same object area as the object constituting the current CU
Image encoding apparatus using depth information. delete 12. The method of claim 11,
Wherein the motion search range determination unit
Determines whether the current CU is a single object based on a maximum value and a minimum value included in the current CU size and the depth value distribution information of the current CU
Image encoding apparatus using depth information. delete A motion search area for determining a motion search area in a current motion search position in accordance with depth information of the current CU extracted from a depth image, Determination part; And
And a motion vector determination unit for determining an optimal motion vector of the current CU,
Wherein the motion search range determination unit determines the motion search range of the current CU based on the current depth of the current CU when the current CU size is equal to or greater than a preset value and the difference between the maximum value and the minimum value of the four corner depth values of the current CU is less than a preset reference value And stores any one of the four corner depth values of the current CU if the current CU size is less than a predetermined value and all the four corner depth values of the current CU are the same value
Image encoding apparatus using depth information. 17. The method of claim 16,
Wherein the motion search range determination unit
If the depth value of the current motion search location is equal to the stored value, it is determined to search for the current location, and if the depth value of the current motion search location is different from the stored value,
Image encoding apparatus using depth information.

Images