KR101827607B1 - Method and apparatus for video transmitting using a plurality of channels and method and apparatus for video processing - Google Patents

Abstract

A method and apparatus for transmitting moving pictures are provided. A moving picture moving method and an apparatus are capable of generating a plurality of different images in accordance with a predetermined rule by using an input image included in an input video and encode a plurality of images, A plurality of moving images each including images may be generated, and a plurality of moving images may be transmitted through a plurality of different transmission channels.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video transmission method and apparatus using a plurality of channels,

TECHNICAL FIELD [0002] The present invention relates to a moving picture transmission and reception technique, and more particularly, to a moving picture transmission and reception technique using multi-technique coding.

In order to improve the image quality of a moving picture received by a receiver, there is a method of transmitting a moving picture signal through multiple networks. For example, scalable video coding (SVC) may be used to transmit video signals. The SVC secures an additional network for the base layer and an enhancement layer. In the video transmission method using the SVC, if the receiver only receives the enhancement layer and does not receive the base layer, the receiver may not be able to restore the video.

Korean Unexamined Patent Publication No. 10-2012-0094273 discloses a streaming service using an SVC server that provides 3-screen or more n-screen services using SVC (Scalable Video Coding) technology. And a terminal playback system. In order to provide an optimal service in various network environments and terminals with various specifications, the present invention is applied to a variety of network environments and various types of terminals in order to provide a variety of spatial contents such as HD, SD, H.264, A bit stream may be configured to have a frame rate so that a receiving terminal can receive and reproduce a bit stream, and video reproduction by streaming using SVC technology is possible.

One embodiment can provide an apparatus and method for transmitting moving pictures.

One embodiment can provide an apparatus and method for processing moving images.

According to one aspect of the present invention, there is provided a moving picture moving method, comprising: generating a plurality of different images according to a preset rule using an input image included in an input video; encoding the plurality of images; Generating a plurality of moving images each including the plurality of images, and transmitting the plurality of moving images through a plurality of different transmission channels, respectively.

The generating of the plurality of moving images may include encoding using the plurality of images and the additional information for the plurality of images.

The additional information may be used for restoring the input moving image by using two or more moving images among the plurality of moving images.

Wherein the additional information includes information on the predetermined rule, timing information on the plurality of moving pictures, timing information on an image included in the plurality of moving pictures, time code of an image included in the plurality of moving pictures, ), Caption information, and synchronization information of the plurality of moving images.

The plurality of different transport channels may be different terrestrial broadcast channels.

The plurality of different transport channels may be different mobile networks supported by the terminal.

The plurality of different transport channels may include at least one of a terrestrial broadcast network and an Internet network.

The step of generating the plurality of images may include generating the plurality of images by spatially sampling the input image.

The predetermined rule is expressed by the following equation (1)

[Equation 1]

Wherein the size of the plurality of images is a size in which the width of the input image is reduced to 1 / a, the size of the input image is reduced to 1 / b, x and y are coordinates of pixels in the image, , y) is the input image, Dij (x, y) is the plurality of images, i is an integer greater than or equal to 0 and less than a, and j is an integer greater than or equal to 0 and less than b.

According to another aspect, a moving picture transmitting apparatus generates a plurality of different images according to a predetermined rule using an input image included in an input video, encodes the plurality of images a processing unit for generating a plurality of moving images each including the plurality of images; And a communication unit for transmitting the plurality of moving pictures through a plurality of different transmission channels, respectively.

According to yet another aspect, a moving picture processing method includes receiving a plurality of moving pictures through a plurality of different transmission channels, respectively; Generating a plurality of images corresponding to each other among the plurality of moving images by decoding each of the plurality of moving images; And generating an output image using the plurality of images.

The step of generating the output image may include generating the output image using the additional information included in each of the plurality of moving images.

Wherein generating an output image using the plurality of images comprises: generating a first reconstructed image using a first one of the plurality of images; Generating a second reconstructed image using a second one of the plurality of images; And generating the output image using the first restored image and the second restored image.

Wherein generating the output image using the first reconstructed image and the second reconstructed image comprises generating a second reconstructed image including a first pixel value in the first reconstructed image and a second pixel in the second reconstructed image corresponding to the first pixel, And generating the output image by averaging the values of the pixels.

The moving image processing method may further include generating an output moving image based on the output image.

The step of generating the plurality of images may include scaling the image within the plurality of moving images to correspond to the size of the input image.

The plurality of images may be scaled images.

The generating the output image using the plurality of images may include generating an iterative expression for a constraint generated based on the received number of the plurality of moving images; Generating the output image by repeating the iteration a predetermined number of times or by repeating until the image quality of the generated output image reaches a preset reference.

According to another aspect of the present invention, a moving picture processing apparatus includes: a communication unit for receiving a plurality of moving pictures through a plurality of different transmission channels; And a processor for generating a plurality of images corresponding to each other among the plurality of moving images by decoding each of the plurality of moving images, and generating an output image using the plurality of images.

An apparatus and method for transmitting moving pictures are provided.

An apparatus and method for processing a moving picture are provided.

FIG. 1 illustrates a moving image transmission method using multi-technique encoding according to an example.
2 is a block diagram of a moving picture transmission apparatus according to an embodiment.
3 is a flowchart of a moving picture moving method according to an embodiment.
FIG. 4 shows a rule for generating a plurality of images according to an example.
Figure 5 is one of a plurality of generated images according to an example.
6 shows an input image and a plurality of images according to an example.
7 is a configuration diagram of a motion picture processing apparatus according to an embodiment.
8 is a flowchart of a moving picture processing method according to an embodiment.
9 is a flowchart of an output image generating method according to an example.
10 is an output image generated using the first restored image and the second restored image in another example.
FIG. 11 shows images generated according to the number of received moving images according to an example.
12 is a flowchart of an output image generating method according to another example.
FIG. 13 shows an image generated according to the number of repetitions according to an example.

In the following, embodiments will be described in detail with reference to the accompanying drawings. However, the scope of the patent application is not limited or limited by these embodiments. Like reference symbols in the drawings denote like elements.

Various modifications may be made to the embodiments described below. It is to be understood that the embodiments described below are not intended to limit the embodiments, but include all modifications, equivalents, and alternatives to them.

The terms used in the examples are used only to illustrate specific embodiments and are not intended to limit the embodiments. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this embodiment belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

In the following description of the present invention with reference to the accompanying drawings, the same components are denoted by the same reference numerals regardless of the reference numerals, and redundant explanations thereof will be omitted. In the following description of the embodiments, a detailed description of related arts will be omitted if it is determined that the gist of the embodiments may be unnecessarily blurred.

FIG. 1 illustrates a moving image transmission method using multi-technique encoding according to an example.

In order to improve the image quality of a moving picture received by a receiver, there is a method of transmitting a moving picture signal through multiple networks.

For example, scalable video coding (SVC) may be used to transmit video signals. The SVC secures an additional network for the base layer and an enhancement layer. In the video transmission method using the SVC, if the receiver only receives the enhancement layer and does not receive the base layer, the receiver may not be able to restore the video.

As another example, multiple description coding (MDC) may be used to transmit the moving picture signal. The MDC may divide the moving picture signal into multiple descriptions and may transmit the divided multiple techniques over each network or channel. The receiver can recover the moving picture signal by combining the received multiple techniques into one signal.

The scalability of the moving picture quality can be provided by using the MDC to transmit the moving picture signal. If an MDC is used to transmit the moving picture signal, the receiver can provide the moving picture even if some of the techniques of the multiple techniques are not received.

According to one aspect, the moving picture transmission apparatus can perform multi-technology coding of an input video 100 through the multi-technology coder 110. [ The multi-technology coder 110 may generate multiple techniques 120-122. The encoder 130 may encode the multiple techniques 120. The encoded multiple techniques may be transmitted on each network or channel 131.

The moving picture processing apparatus may receive one or more multiple techniques using various networks or channels 131. [ The moving picture processing apparatus may decode the received multiple techniques using decoders 140. [ The decoder 140 may generate the decoded multiple techniques 150 through 152. [ The moving picture processing apparatus can restore the moving picture using the multi-technology decoder 160. [

A method of transmitting a moving image and a method of processing a moving image by a device receiving the moving image will be described in detail below with reference to FIG. 2 to FIG.

2 is a block diagram of a moving picture transmission apparatus according to an embodiment.

The moving picture transmission apparatus 200 (hereinafter, the moving picture transmission apparatus 200 is outlined as the apparatus 200) may include a communication unit 210, a processing unit 220, and a storage unit 230.

According to one aspect, the moving picture transmission apparatus 200 may be a server.

According to another aspect, the moving picture transmission apparatus 200 may be a terminal. The terminal may be a mobile terminal including a camera capable of capturing a moving image.

The communication unit 210 can exchange data with an external device. For example, the communication unit 210 can receive moving pictures from an external device. As another example, the communication unit 210 may transmit data or signals to an external device via a network.

The processing unit 220 may process the data received by the communication unit 210 and the data stored in the storage unit 230. For example, the processing unit 220 may be a hardware processor.

The storage unit 230 may store data received by the communication unit 210 and data processed by the processing unit 220. [

The communication unit 210, the processing unit 220, and the storage unit 230 will be described in detail below with reference to FIG. 3 to FIG.

3 is a flowchart of a moving picture moving method according to an embodiment.

In step 310, the communication unit 210 may receive an input moving image or an input image. For example, the communication unit 210 may receive an input moving image from a moving image editing apparatus that generates an input moving image.

The input moving image may include input images. The input image may be a frame of the moving image.

In step 320, the processing unit 220 may generate a plurality of images according to a preset rule using an input image. A plurality of images all represent input images, but they may be different from each other. The plurality of images may be a plurality of multiple techniques described above with reference to FIG.

According to an aspect, the processing unit 220 may generate a plurality of different images by sampling differently an input image in a spatial manner. For example, the processing unit 220 may generate a plurality of images that are different from one another to be sampled. A method of generating a plurality of different images by differently sampling the pixels to be sampled will be described in detail below with reference to Figs. 4 to 6.

According to one aspect, a predetermined rule can be expressed by the following equation (1).

The input image is I (x, y) and (x, y) represents the coordinates of the pixel in the image. The plurality of images generated by Equation (1) are Dij (x, y). The size of the plurality of images may be the size in which the horizontal size of the input image is reduced to 1 / a and the vertical size is reduced to 1 / b. In this case, the number of generated images may be a * b. i is an integer of 0 or more and less than a, and j may be an integer of 0 or more and an integer of less than b. For example, i is a real number equal to or greater than 0 and smaller than the image width of each image of the plurality of images, j is a real number equal to or greater than 0 and smaller than the image heigt of each image of the plurality of images have.

i and j may represent a sampling grid in the input image. By differentiating the sampling grid, a plurality of different images can be generated. With respect to the sampling grid, it will be described in detail with reference to Fig.

The plurality of images can be represented by D ₀₀ (x, y), D ₀₁ (x, y), D ₁₀ (x, y), and D ₁₁ (x, y) according to the values of i and j. For example, if a and b are each 2, a plurality of images that are generated are the _{D 00 (x, y),} D 01 (x, y), D 10 (x, y) and D ₁₁ (x, y) Lt; / RTI >

The processing unit 220 may generate a plurality of images for each input image using a plurality of input images of the input moving image. For example, if a and b are 2 respectively, then four images may be generated for the t-1 th input image and four images for the t th input image.

According to one aspect, the processing unit 220 may encode a plurality of images using additional information on the plurality of images and the plurality of images. The receiver receiving the two or more moving images among the plurality of moving images can restore the input moving image using the additional information. For example, the additional information may include information on a predetermined rule, timing information on a plurality of videos, timing information of an image included in a plurality of videos, time code of an image included in a plurality of videos, , Subtitle information, and synchronization information of a plurality of moving pictures.

In step 330, the processing unit 220 may generate a plurality of videos each including a plurality of images by encoding a plurality of images.

According to an aspect, each moving image of the plurality of moving images may include the same number of images as the input moving image. For example, the images included in the first moving picture may be images generated by the same rule. The t-1 th image and the t th image may all correspond to D ₀₀ (x, y) in [Equation 1]. As another example, all the images included in the second moving picture may correspond to D ₀₁ (x, y) in [Equation 1].

In step 340, the communication unit 210 may transmit a plurality of moving pictures through a plurality of transmission networks or transmission channels, respectively.

For example, the communication unit 210 may transmit a plurality of moving pictures through different terrestrial broadcast channels. At least one of the different terrestrial broadcast channels may be a virtual channel. The communication unit 210 may transmit the first moving image through the physical channel and the second moving image through the virtual channel.

As another example, the communication unit 210 may transmit a plurality of moving pictures through different terrestrial broadcast networks. Different terrestrial broadcast networks may be different transceivers. For example, the communication unit 210 may transmit the first moving picture through the Namsan head office and the second moving picture through the Kwanak mountain counter.

As another example, the communication unit 210 may transmit a plurality of moving pictures in a peer-to-peer (P2P) manner. The communication unit 210 may transmit a plurality of different moving pictures to the peers.

As another example, the communication unit 210 may transmit a plurality of moving pictures through different mobile networks. If the device 200 is a mobile terminal, the different mobile networks may be networks supported by the mobile terminal. For example, mobile networks may include a cellular network and a Wi-fi network.

As another example, the communication unit 210 may transmit a plurality of moving pictures via a terrestrial broadcast network and a cable broadcast network.

As another example, the communication unit 210 may transmit a plurality of moving pictures through a terrestrial broadcast network and an IPTV (Broadcasting Internet Service) broadcast network.

As another example, the communication unit 210 may transmit a plurality of moving pictures through at least one of a terrestrial broadcast network and an Internet network. The communication unit 210 may transmit a part of the plurality of moving images through the streaming method.

As another example, the communication unit 210 may transmit a plurality of moving pictures through a terrestrial broadcast network and an IPTV (Broadcasting Internet Service) broadcast network.

As another example, the communication unit 210 may transmit a plurality of moving pictures via a digital multimedia broadcasting (DMB) and an Internet network.

The receiver can receive a plurality of moving pictures through various networks. The receiver can improve the image quality of a moving image to be reproduced using a plurality of moving images.

FIG. 4 shows a rule for generating a plurality of images according to an example.

The input image 400 has a horizontal size of A and a vertical size of B. The size may correspond to the number of included pixels of the input image 400.

When the input image 400 is reduced to the size of the horizontal A / a and the size of the vertical B / b, the pixel of the generated image may correspond to the a * b pixels of the input image 400. For example, the color value of the pixel of the generated image may be a representative value of the color values of the a * b pixels of the input image 400. [

According to an aspect, the input image 400 may include a first pixel 401 to a sixteenth pixel 416. For example, the coordinates of the first pixel 401 may be (0,0) and the coordinates of the sixth pixel 406 may be (2,2). The coordinates for the pixel may be changed depending on how to set the coordinates.

For example, when a and b are 2 respectively, the above-mentioned equation (1) can be modified as shown in the following equation (2).

D ₀₀ (x, y), D ₀₁ (x, y), D ₁₀ (x, y), and D ₁₁ (x, y) can be generated according to the following equation (2).

D ₀₀ (x, y) may correspond to the first sampling grid 420 including the first pixel 401, the second pixel 402, the fifth pixel 405, and the sixth pixel 406. The color value of D ₀₀ (0,0) may be the average value of the color values of I (0,0), I (0,1), I (1,0) and I (1,1). The color value of D ₀₀ (0,1) may be the average value of the color values of I (0,2), I (0,3), I (1,2) and I (1,3).

D ₀₁ (x, y) may correspond to the second sampling grid 430 including the second pixel 402, the third pixel 403, the sixth pixel 406, and the seventh pixel 407. The color value of D ₀₁ (0,0) may be the average value of the color values of I (0,1), I (0,2), I (1,1) and I (1,2).

D ₁₀ (x, y) may correspond to a third sampling grid 440 including a fifth pixel 405, a sixth pixel 406, a ninth pixel 409, and a tenth pixel 410. The color value of D ₁₀ (0,0) may be the average value of the color values of I (1,0), I (1,1), I (2,0) and I (2,1).

D ₁₁ (x, y) may correspond to the fourth sampling grid 450 including the sixth pixel 406, the seventh pixel 407, the tenth pixel 410, and the eleventh pixel 411. The color value of D ₁₁ (0,0) may be the average value of the color values of I (1,1), I (1,2), I (2,1) and I (2,2).

The number of sampling grids may be a * b. A sampling image corresponding to each sampling grid may be generated.

Figure 5 is one of a plurality of generated images according to an example.

In the above equation (1), when a and b are 2, the size of the sampling image 500 may be (A / 2) x (B / 2). The coordinates of the pixel 510 of the sampling image 500 may be (0, 0).

For example, when the sampling image 500 is D ₀₀ (x, y), the color value of the pixel 510 is the first pixel 401, the second pixel 402, the fifth pixel 405, And the sixth pixel 406 may be an average value of the color values.

As another example, when the sampling image 500 is D ₀₁ (x, y), the color value of the pixel 510 is the second pixel 402, the third pixel 403, the sixth pixel 406, And may be an average value of the color values of the pixel 407. [

As another example, when the sampling image 500 is D ₁₀ (x, y), the color value of the pixel 510 is the fifth pixel 405, the sixth pixel 406, the ninth pixel 409, 10 < / RTI >

As another example, when the sampling image 500 is D ₁₁ (x, y), the color value of the pixel 510 is the sixth pixel 406, the seventh pixel 407, the tenth pixel 410, And the average value of the color values of the 11 pixels 411. [

6 shows an input image and a plurality of images according to an example.

The processing unit 220 may generate the plurality of images 620 to 650 using the input image 610. [

For example, the first image 620 may be an image corresponding to the first sampling grid.

As another example, the second image 630 may be an image corresponding to the second sampling grid. The second sampling grid may be a grid shifted by one in the x-axis relative to the first sampling grid. When the second image 630 is generated, some of the pixels included in the second sampling grid may not be valid. For example, a pixel of the input image 610 may not correspond to a portion of the second sampling grid. If a pixel of the input image 610 does not correspond to a portion of the second sampling grid, the average value of valid pixels included in the second sampling grid can be calculated. The color value of the pixels in the rightmost column of the second image 630 may be an average value of the color values of the pixels in the rightmost column of the input image 610. [

As another example, the third image 640 may be an image corresponding to the third sampling grid. The third sampling grid may be a grid shifted by one in the y-axis relative to the first sampling grid. The color value of the pixels in the bottom row of the third image 640 may be the average value of the color values of the pixels in the bottom row of the input image 610. [

As another example, the fourth image 650 may be an image corresponding to the fourth sampling grid. The fourth sampling grid may be a grid shifted by one in the x-axis and one in the y-axis relative to the first sampling grid. The color value of the pixels in the rightmost column of the fourth image 650 may be the average value of the color values of the pixels in the rightmost column of the input image 610. [ The color value of the pixels in the bottom row of the fourth image 650 may be an average value of the color values of the pixels in the bottom row of the input image 610. [

The first image 620 to the fourth image 640 are similar to each other, but may be different images because the sampling grids are different from each other.

7 is a configuration diagram of a motion picture processing apparatus according to an embodiment.

The moving picture processing apparatus 700 (hereinafter, the moving picture processing apparatus 700 is outlined with respect to the apparatus 700) may include a communication unit 710, a processing unit 720, and a storage unit 730.

According to an aspect, the device 700 may be a terminal. For example, device 700 may be either a mobile terminal, a television, and a computer.

The communication unit 710 can exchange data with an external device. For example, the communication unit 710 can receive a moving image signal from an external device. As another example, the communication unit 710 may receive data or signals through the network.

The processing unit 720 may process the data received by the communication unit 710 and the data stored in the storage unit 730. For example, the processing unit 720 may be a hardware processor.

The storage unit 730 may store the data received by the communication unit 710 and the data processed by the processing unit 720.

The communication unit 710, the processing unit 720, and the storage unit 730 will be described in detail below with reference to FIGS. 8 to 13. FIG.

8 is a flowchart of a moving picture processing method according to an embodiment.

In step 810, the communication unit 710 can receive a plurality of moving pictures through a plurality of different transport channels or transmission networks, respectively.

For the plurality of different transport channels or transport networks, the description of step 340 described above can be substituted, and therefore will be omitted hereafter. For example, the communication unit 710 can receive a plurality of moving pictures through a plurality of channels or networks used by the communication unit 210 described above.

In step 820, the processing unit 720 may generate a plurality of images corresponding to each other among the plurality of moving images by decoding each of the plurality of moving images. The plurality of images may be images generated by sampling the input image described above.

For example, the processing unit 720 can identify a plurality of images corresponding to each other among the plurality of moving images using the additional information included in the received moving image.

In step 830, the processing unit 720 may generate an output image using a plurality of images. The output image may correspond to the input image described above.

A method of generating an output image will be described in detail with reference to Figs. 9 to 13 below.

In step 840, the processing unit 720 may generate an output video based on the output image. The output video may be a video including an output image. The output moving picture can be reproduced in the device 700. [

9 is a flowchart of an output image generating method according to an example.

The above-described step 830 may include the following steps 910 to 930.

In step 910, the processing unit 720 may generate a first reconstructed image using the first of the plurality of images.

According to an aspect, the processing unit 720 may scale the size of the first image to correspond to the size of the input image. The processing unit 720 may set the value of the pixel of the first image to the values of the pixels of the first reconstructed image. For example, in the case of scaling the size of (A / a) x (B / b) by the size of AxB, the processing unit 720 may convert the value of the first pixel of the first image into a first restoration And may be set to values of a * b pixels of the image.

In step 920, the processing unit 720 may generate a second reconstructed image using the second one of the plurality of images. The method of generating the second reconstructed image may be the same as the method of generating the first reconstructed image.

Although the method of generating the first restored image and the second restored image through steps 910 and 920 has been described, more restored images may be generated depending on the number of received moving images.

In step 930, the processing unit 720 may generate an output image using the first restored image and the second restored image.

According to one aspect, the processing unit 720 may generate an output image by averaging the values of the first pixel in the first reconstructed image and the value of the second pixel in the second reconstructed image corresponding to the first pixel.

A method of generating an output image by averaging the values of the first pixel and the second pixel will be described below with reference to Fig.

10 is an output image generated using the first restored image and the second restored image in another example.

For example, the first reconstructed image 1010 may be I ₀₀ (x, y) if the first image corresponds to D ₀₀ (x, y). The pixel value of D ₀₀ (0,0) may be the same as the pixel value of I ₀₀ (0,0), I ₀₀ (0,1), I ₀₀ (1,0) and I ₀₀ (1,1) . I ₀₀ (0,0), I ₀₀ (0,1), I ₀₀ (1,0), and I ₀₀ (1,1) may correspond to the first sampling grid 1011.

As another example, the second reconstructed image 1020 may be I ₀₁ (x, y) if the second image corresponds to D ₀₁ (x, y). The pixel values of D ₀₁ (0, 0) may be the same as the pixel values of I ₀₁ (0,1), I ₀₁ (0,2), I ₀₁ (1,1) and I ₀₁ . I ₀₁ (0,1), I ₀₁ (0,2), I ₀₁ (1,1) and I ₀₁ (1,2) may correspond to the second sampling grid 1021.

Output image I _out (x, y) in the pixel value of I _out (1, 1) 1032 I _out (1, 1) (1032) ₀₀ I (1, 1) of the first image (1032 corresponding to ) And I ₀₁ (1,1) 1022, respectively.

FIG. 11 shows images generated according to the number of received moving images according to an example.

The first output image 1110 is a case where the device 700 has received one moving image and the second output image 1120 is a case where the device 700 has received the moving image The third output image 1130 is a case where the device 700 receives three moving images and the fourth output image 1140 is a case where the device 700 receives four moving images .

As the number of moving images received by the device 700 increases, the quality of the output image generated increases.

12 is a flowchart of an output image generating method according to another example.

According to another aspect, the above-described step 830 may include the following steps 1210 and 1220. [

In step 1210, the processing unit 720 may generate an iteration formula for constraints that occur based on the number of received moving images.

The constraint may be a condition that a plurality of images and output images must satisfy, respectively, when an output image is generated using a plurality of images.

For example, it may be assumed that the device 700 has received two moving pictures. Two images (D ₀₀ (x, y) and D ₁₁ (x, y)) corresponding to each other through two moving images can be obtained. The initial value of the output image I _out (x, y) may be set to I ⁰ _out (x, y). The initial value may be set to a predetermined constant or an average pixel value of D ₀₀ (x, y) and D ₁₁ (x, y).

The generated iterative equation may be expressed by the following equations (3) and (4).

(3) may be an iterative formula for D ₀₀ (x, y) and I _out (x, y).

(4) can be an iterative formula for D ₁₁ (x, y) and I _out (x, y).

I ^{i + 1} _out (x, y) can be calculated using Equation (5) below.

The formulas (3) to (5) are generated when it is assumed that D ₀₀ (x, y) and D ₁₁ (x, y) are received, and the generated iterative expression is not limited thereto.

For example, the iterative expression may be generated differently from [Equation 3] to [Equation 5] depending on how the plurality of images are generated.

In step 1220, the processing unit 720 may generate an output image by repeating the iteration formula a predetermined number of times, or by repeating the process until the image quality of the output image to be generated reaches a preset reference.

For example, the processing unit 720 may evaluate the image quality of the generated output image, and if the estimated image quality does not reach the preset reference, the output image may be regenerated using the iteration formula.

According to one aspect, the processing unit 720 can increase the number of times of processing of Equations (3) to (5). For example, the processing unit 720 may increase i from 0 to 1.

If the image is a color image, Equations (3) to (5) can be calculated for each color channel of the pixel.

FIG. 13 shows an image generated according to the number of repetitions according to an example.

The first output image 1310 may be an initial output image I ⁰ _out (x, y) set to a constant value.

The second output image 1320 may be an output image I ¹ _out (x, y) obtained by repeating [3] to [5] once.

The third output image 1330 may be an output image I ² _out (x, y) obtained by repeating [3] to [5] twice. It can be seen that the quality of the output image is significantly improved even if [Equation 3] to [Equation 5] are repeated twice.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

200: Video transmission device
700: Video processing device

Claims (18)

Generating a plurality of different images according to a preset rule using an input image included in an input video;
Generating a plurality of moving images each including the plurality of images by encoding the plurality of images; And
Transmitting the plurality of moving pictures through a plurality of different transport channels, respectively
Lt; / RTI >
The predetermined rule is expressed by the following equation (1)
[Equation 1]

Wherein the size of the plurality of images is a size in which the horizontal size of the input image is reduced to 1 / a, the vertical size is reduced to 1 /
Wherein x and y are the coordinates of a pixel in the image, I (x, y) is the input image, D _ij (x, y) is the plurality of images, i is greater than or equal to 0, Wherein j is an integer greater than or equal to 0 and less than b,
How to transfer videos.
The method according to claim 1,
Wherein the generating of the plurality of moving images comprises:
Encoding using the plurality of images and the additional information for the plurality of images
/ RTI >
How to transfer videos.
3. The method of claim 2,
Wherein the additional information is used for restoring the input moving image using two or more moving images among the plurality of moving images,
How to transfer videos.
3. The method of claim 2,
Wherein the additional information includes information on the predetermined rule, timing information on the plurality of moving pictures, timing information on an image included in the plurality of moving pictures, time code of an image included in the plurality of moving pictures, ), Subtitle information, and synchronization information of the plurality of moving pictures.
How to transfer videos.
The method according to claim 1,
Wherein the plurality of different transport channels comprise:
Different terrestrial broadcast channels or different mobile networks supported by the terminal,
How to transfer videos.
delete The method according to claim 1,
Wherein the plurality of different transport channels comprise:
A terrestrial broadcast network, and an internet network.
How to transfer videos.
The method of claim 1, wherein
Wherein the generating the plurality of images comprises:
Generating the plurality of images by spatially sampling the input image,
How to transfer videos.
delete A plurality of different images are generated in accordance with a preset rule using an input image included in an input video and the plurality of images are encapsulated by each of the plurality of images, A plurality of moving images; And
A communication unit for transmitting the plurality of moving pictures through a plurality of different transmission channels,
Lt; / RTI >
The predetermined rule is expressed by the following equation (1)
[Equation 1]

Wherein the size of the plurality of images is a size in which the horizontal size of the input image is reduced to 1 / a, the vertical size is reduced to 1 /
Wherein x and y are the coordinates of a pixel in the image, I (x, y) is the input image, D _ij (x, y) is the plurality of images, i is greater than or equal to 0, Wherein j is an integer greater than or equal to 0 and less than b,
Video transmission device.
Receiving a plurality of moving pictures through a plurality of different transport channels, respectively;
Generating a plurality of images corresponding to each other among the plurality of moving images by decoding each of the plurality of moving images; And
Generating an output image using the plurality of images
Lt; / RTI >
Wherein generating an output image using the plurality of images comprises:
Generating a first reconstructed image using a first one of the plurality of images;
Generating a second reconstructed image using a second one of the plurality of images; And
Generating the output image by averaging values of a first pixel in the first reconstructed image and a value of a second pixel in the second reconstructed image corresponding to the first pixel,
/ RTI >
How to process video.
12. The method of claim 11,
Wherein generating the output image comprises:
Generating the output image using additional information included in each of the plurality of moving images
≪ / RTI >
How to process video.
delete delete 12. The method of claim 11,
Generating an output moving image based on the output image
≪ / RTI >
How to process video.
12. The method of claim 11,
Wherein the generating the plurality of images comprises:
Scaling the image within the plurality of moving images to correspond to the size of the input image
Lt; / RTI >
Wherein the plurality of images are scaled images,
How to process video.
12. The method of claim 11,
Wherein generating an output image using the plurality of images comprises:
Generating an iteration formula for a constraint generated based on the received number of the plurality of moving images; And
Generating the output image by repeating the iteration a predetermined number of times or by repeating until the image quality of the generated output image reaches a preset reference
≪ / RTI >
How to process video.
A communication unit for receiving a plurality of moving pictures through a plurality of different transmission channels; And
A processing unit for generating a plurality of images corresponding to each other among the plurality of moving images by decoding each of the plurality of moving images and generating an output image using the plurality of images,
Lt; / RTI >
Wherein the processing unit generates a first reconstructed image using a first one of the plurality of images and a second reconstructed image using a second one of the plurality of images, Generating the output image by averaging values of a first pixel and a second pixel in the second reconstructed image corresponding to the first pixel,
Video processing device.

Images