KR20140095936A

KR20140095936A - Method and system for providing compatible realistic broadcasting

Info

Publication number: KR20140095936A
Application number: KR1020130018190A
Authority: KR
Inventors: 이광순; 이응돈; 정원식; 허남호
Original assignee: 한국전자통신연구원
Priority date: 2013-01-25
Filing date: 2013-02-20
Publication date: 2014-08-04

Abstract

A method for providing realistic broadcasting including an ultra high definition (UHD) video comprises the steps of: creating a first encoding stream from a high definition (HD) video; creating a second encoding stream from at least one of the UHD video or a video restored from the first encoding stream; creating a third encoding stream from at least one of the UHD video or a video restored from the second encoding stream; creating a first transfer stream by applying at least one among packetizing, synchronizing, and multiplexing to the first encoding stream and the second encoding stream; creating a second transfer stream by applying at least one of packetizing and synchronizing to the third encoding stream; transmitting the first transfer stream through a first transmission channel; and transmitting the second transfer stream through a second transmission channel with capacity smaller than that of the first transmission channel.

Description

[0001] METHOD AND SYSTEM FOR PROVIDING REALISTIC BROADCASTING [0002]

[0001] The present invention relates to a system and method for providing a real broadcast image, and more particularly, to a system and method for providing a real broadcast image by appropriately distributing an encoded stream corresponding to a UHD (Ultra High Definition) image and transmitting the same through a first transport channel and a second transport channel (HD) image and a UHD image at the same time. Here, the sensory broadcast image may include a UHD image, a 3D image, and a panoramic image.

A system and method for providing a realistic broadcast image is a technique for transmitting an encoded stream corresponding to an HD image through a base layer and transmitting an encoded stream corresponding to the UHD image through an enhancement layer, Are distributed and transmitted to the base layer and the enhancement layer.

Embodiments of the present invention provide a method, apparatus, and system for simultaneously providing an HD image and a UHD image by appropriately distributing an encoded stream corresponding to a UHD image and transmitting the same through a first transport channel and a second transport channel.

In addition, embodiments of the present invention provide a method, an apparatus, and a system for using an HD image obtained by reducing the resolution of a UHD image in a process of appropriately distributing an encoded stream corresponding to the UHD image.

Embodiments of the present invention also provide a method, an apparatus, and a system for simultaneously providing an HD image and a UHD image by receiving an encoding stream corresponding to a properly allocated UHD image through a first transmission channel and a second transmission channel do.

Also, a method, an apparatus, and a system for providing an HD image and a 3D image or a panorama image at the same time by appropriately allocating an encoding stream corresponding to a 3D image or a panorama image and transmitting the same through a first transmission channel and a second transmission channel are provided do.

Embodiments of the present invention also provide a method of simultaneously providing an HD image and a 3D image or a panorama image by receiving an encoded stream corresponding to a properly distributed 3D image or a panorama image through a first transmission channel and a second transmission channel , A device and a system.

A method of providing a real-time broadcasting image including a UHD (Ultra High Definition) image according to an embodiment of the present invention includes: generating a first encoded stream from an HD (High Definition) image; Generating a second encoded stream from at least one of a UHD image or an image reconstructed from the first encoded stream; Generating a third encoded stream from at least one of the UHD image or the reconstructed image from the second encoded stream; Generating a first transport stream by applying at least one of packetization, synchronization, and multiplexing to the first encoded stream and the second encoded stream; Applying at least one of packetization or synchronization to the third encoded stream to generate a second transport stream; Transmitting the first transport stream over a first transport channel; And transmitting the second transport stream over a second transport channel having a smaller capacity than the first transport channel.

Wherein the generating the first encoded stream comprises: obtaining the HD image by reducing a resolution of the UHD image; And encoding the HD video to generate the first encoded stream.

The step of generating the second encoded stream may include decoding the image corresponding to the first encoded stream to generate a decoded image. Acquiring a reconstructed UHD image distinguished from the UHD image by enlarging a resolution of the decoded image and converting a scanning method when necessary; And generating the second encoded stream by reference encoding the reconstructed UHD image and the UHD image using an inter-picture prediction method.

Wherein the generating the third encoded stream comprises: decoding the image corresponding to the second encoded stream to generate a decoded image; And generating the third encoded stream by reference encoding the decoded image and the UHD image.

Wherein the generating the second encoded stream comprises: obtaining the HD image by reducing a resolution of the UHD image; Decoding the image corresponding to the first encoded stream to generate a decoded image; And generating the second encoded stream by reference encoding the decoded image and the HD image.

Wherein the generating the third encoded stream comprises: decoding the image corresponding to the second encoded stream to generate a decoded image; Acquiring a reconstructed UHD image distinguished from the UHD image by enlarging a resolution of the decoded image and converting a scanning method when necessary; And generating the third encoded stream by reference encoding the reconstructed UHD image and the UHD image.

The method of providing a real broadcast image including the UHD (Ultra High Definition) image may further include an error correction encoding process on each of the first transport stream and the second transport stream.

A method for providing a real broadcast image including an UHD (Ultra High Definition) image includes: receiving the first transport stream through the first transport channel; Receiving the second transport stream over the second transport channel; Separating the first transport stream to produce the first encoded stream and the second encoded stream; Generating the third encoded stream from the second transport stream; Generating the HD image from the first encoded stream; Generating at least one of a Semi-UHD image or another HD image distinguished from the HD image from the first encoded stream and the second encoded stream; And generating the UHD image from the first encoded stream, the second encoded stream, and the third encoded stream.

Wherein receiving the first transport stream comprises channel decoding a signal received over the first transport channel to generate the first transport stream, wherein receiving the second transport stream comprises receiving the second transport stream, And channel decoding the received signal through the transport channel to generate the second transport stream.

A method of providing a real-time broadcasting image including a UHD (Ultra High Definition) image according to an embodiment of the present invention includes: generating a first encoded stream from an HD (High Definition) image; Generating a second encoded stream from at least one of a UHD image or an HD image reconstructed from the first encoded stream; Separating the second encoded stream to produce a third encoded stream and a fourth encoded stream; Generating a first transport stream by applying at least one of packetization, synchronization, and multiplexing to the first encoded stream and the third encoded stream; Applying at least one of packetization or synchronization to the fourth encoded stream to generate a second transport stream; Transmitting the first transport stream over a first transport channel; And transmitting the second transport stream over a second transport channel having a smaller capacity than the first transport channel.

Wherein the step of generating the first transport stream further comprises performing an error correction encoding process on the first transport stream and the step of generating the second transport stream includes an error correction encoding process of the second transport stream .

A method for providing a real broadcast image including an UHD (Ultra High Definition) image includes: receiving the first transport stream through the first transport channel; Receiving a second transport stream over the second transport channel; Separating the first transport stream to produce the first encoded stream and the third encoded stream; Generating the fourth encoded stream from the second transport stream; Merging the third encoded stream and the fourth encoded stream to produce the second encoded stream; Generating the HD image from the first encoded stream; And generating the UHD image from the first encoded stream and the second encoded stream.

A method of providing a sensory broadcast image including a 3D image and a panoramic image according to an exemplary embodiment of the present invention may include providing a sensory broadcast image corresponding to each of the plurality of images from a plurality of images included in at least one of a 3D image and a panoramic image Generating an encoded stream; Generating a first transport stream by applying at least one of packetization, synchronization, and multiplexing to a first encoded stream group extracted according to a preset reference from the plurality of encoded streams; Generating a second transport stream by applying at least one of packetization or synchronization to a second encoded stream group extracted to distinguish the first encoded stream group from the plurality of encoded streams; Transmitting the first transport stream over a first transport channel; And transmitting the second transport stream over a second transport channel having a smaller capacity than the first transport channel.

A method of providing a real-time broadcasting image including a 3D image and a panorama image includes: receiving the first transport stream through the first transport channel; Receiving the second transport stream over the second transport channel; Obtaining the plurality of encoded streams from the first transport stream and the second transport stream; Generating the image corresponding to each of the plurality of encoded streams; And generating at least one of the 3D image and the panorama image by merging the plurality of images.

A system for providing a real broadcast image including a UHD (Ultra High Definition) image according to an embodiment of the present invention includes: a first image encoder for generating a first encoded stream from an HD (High Definition) image; A second image encoder for generating a second encoded stream from at least one of a UHD image or an image reconstructed from the first encoded stream; A third image encoder for generating a third encoded stream from at least one of the UHD image or the reconstructed image from the second encoded stream; At least one of packetization, synchronization, and multiplexing is applied to the first encoded stream and the second encoded stream to generate a first transport stream, and at least one of packetization or synchronization is applied to the third encoded stream A multiplexer for generating a second transport stream; And a transmitter for transmitting the first transport stream on a first transport channel and transmitting the second transport stream on a second transport channel having a capacity smaller than the first transport channel.

A system for providing a real broadcast image including a UHD (Ultra High Definition) image according to the present invention receives the first transport stream through the first transport channel and receives the second transport stream through the second transport channel ; A demultiplexer for separating the first transport stream to generate the first encoded stream and the second encoded stream, and generating the third encoded stream from the second transport stream; A first video decoder for generating the HD video from the first encoded stream; A second image decoder for generating at least one of a Semi-UHD image from the first encoded stream and another HD image distinguished from the HD image from the second encoded stream; And a third image decoder for generating the UHD image from the first encoded stream, the second encoded stream, and the third encoded stream.

A system for providing a real broadcast image including a UHD (Ultra High Definition) image according to an embodiment of the present invention includes: a first image encoder for generating a first encoded stream from an HD (High Definition) image; A second image encoder for generating a second encoded stream from at least one of a UHD image or an image reconstructed from the first encoded stream; A stream separator for separating the second encoded stream to generate a third encoded stream and a fourth encoded stream; At least one of packetization, synchronization, and multiplexing is applied to the first encoded stream and the third encoded stream to generate a first transport stream, and at least one of packetization or synchronization is applied to the fourth encoded stream A multiplexer for generating a second transport stream; And a transmitter for transmitting the first transport stream on a first transport channel and transmitting the second transport stream on a second transport channel having a capacity smaller than the first transport channel.

A system for providing a sensory broadcast image including a 3D image and a panoramic image according to an exemplary embodiment of the present invention includes a controller for generating a sensed broadcast image corresponding to each of the plurality of images from each of a plurality of images included in at least one of a 3D image and a panorama image A plurality of video encoders for generating an encoded stream; Generating a first transport stream by applying at least one of packetization, synchronization, and multiplexing to a first encoded stream group extracted according to a preset reference from the plurality of encoded streams, A multiplexer for applying a packetization or a synchronization to a second encoded stream group extracted to be distinguished from a first encoded stream group to generate a second transport stream; And a transmitter for transmitting the first transport stream on a first transport channel and transmitting the second transport stream on a second transport channel having a capacity smaller than the first transport channel.

Embodiments of the present invention can provide a method, apparatus, and system for simultaneously providing an HD image and a UHD image by appropriately distributing an encoded stream corresponding to a UHD image and transmitting the same through a first transport channel and a second transport channel have.

In addition, embodiments of the present invention can provide a method, an apparatus, and a system for using an HD image obtained by reducing the resolution of a UHD image in a process of appropriately distributing an encoding stream corresponding to a UHD image.

Embodiments of the present invention also provide a method, an apparatus, and a system for simultaneously providing an HD image and a UHD image by receiving an encoding stream corresponding to a properly allocated UHD image through a first transmission channel and a second transmission channel can do.

Also, a method, an apparatus, and a system for providing an HD image and a 3D image or a panorama image at the same time by appropriately allocating an encoding stream corresponding to a 3D image or a panorama image and transmitting the same through a first transmission channel and a second transmission channel are provided can do.

Embodiments of the present invention also provide a method of simultaneously providing an HD image and a 3D image or a panorama image by receiving an encoded stream corresponding to a properly distributed 3D image or a panorama image through a first transmission channel and a second transmission channel , Devices and systems.

FIG. 1 is a block diagram illustrating a system for providing a sensory broadcast image according to an exemplary embodiment of the present invention. Referring to FIG.
2 is a diagram illustrating a first transmission system for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
FIG. 3 is a diagram illustrating a channel assignment and a program configuration in an ATSC-ADT DTV when a first transmission system for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention is used.
4 is a diagram illustrating an operation of a video encoder when using a first transmission system for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.
5 is a diagram illustrating a second transmission system for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.
FIG. 6 is a diagram illustrating a third transmission system for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.
7 is a diagram illustrating a first receiving system for receiving a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
8 is a diagram illustrating a second receiving system for receiving a real-time broadcast image including a UHD image according to an embodiment of the present invention.
9 is a diagram illustrating a third receiving system for receiving a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
10 is a diagram illustrating a transmission system for transmitting a real-time broadcast image including a 3D image and a panorama image according to an embodiment of the present invention.
11 is a diagram illustrating a channel assignment and a program configuration in an ATSC-ADT DTV when a transmission system for transmitting real-time broadcast images including a 3D image according to an embodiment of the present invention is used.
12 is a view illustrating a receiving system for receiving a real-time broadcasting image including a 3D image and a panorama image according to an embodiment of the present invention.
FIG. 13 is a flowchart illustrating a first transmission method for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.
FIG. 14 is a flowchart illustrating a first receiving method for receiving a real-time broadcast image including a UHD image according to an embodiment of the present invention.
15 is a block diagram illustrating a first transmission system for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
16 is a block diagram illustrating a first receiving system for receiving a real-time broadcast image including a UHD image according to an embodiment of the present invention.
FIG. 17 is a flowchart illustrating a second transmission method of transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
18 is a flowchart illustrating a second receiving method for receiving a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
19 is a block diagram illustrating a second transmission system for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
20 is a block diagram illustrating a second receiving system for receiving a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
FIG. 21 is a flowchart illustrating a third transmission method for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.
22 is a flowchart illustrating a third receiving method for receiving a real-time broadcast image including a UHD image according to an embodiment of the present invention.
23 is a block diagram illustrating a third transmission system for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.
FIG. 24 is a flowchart illustrating a transmission method for transmitting a sensory broadcast image including a 3D image and a panoramic image according to an embodiment of the present invention.
FIG. 25 is a flowchart illustrating a receiving method for receiving a real-time broadcasting image including a 3D image and a panorama image according to an embodiment of the present invention.
FIG. 26 is a block diagram illustrating a transmission system for transmitting a real-time broadcasting image including a 3D image and a panorama image according to an embodiment of the present invention.

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited to or limited by the embodiments. In addition, the same reference numerals shown in the drawings denote the same members.

FIG. 1 is a block diagram illustrating a system for providing a sensory broadcast image according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 1, a system for providing a real broadcast image includes a transmission system and a reception system.

Here, the transmission system includes a plurality of image encoders 120 for generating an encoded stream from a UHD (Ultra High Definition) image 110, and at least one of packetizing, synchronizing, and multiplexing the plurality of encoded streams A multiplexer 130 for generating a stream, and a transmission unit 140 for appropriately distributing a plurality of transport streams and transmitting them through different channels. In this case, the plurality of video encoders 120 may include a first video encoder 121, a second video encoder 122 and a third video encoder 123, and the first video encoder 121 may include a UHD And a down scaling unit for obtaining a high definition (HD) image by reducing the resolution of the image 110, thereby generating a first encoded stream from the HD image. On the other hand, the second image encoder 122 or the third image encoder 123 decodes the image corresponding to the first encoded stream, enlarges the resolution of the decoded image, converts the scanning method when necessary, and acquires the UHD image And performing an up-scaling unit to perform a reference encoding from the UHD image through an inter-picture prediction method to generate a second encoded stream or a third encoded stream. In addition, the transmission unit 140 may include an error correction encoder and a modulator that perform error correction coding processing on each of a plurality of transport streams. A detailed description thereof will be given below.

The receiving system includes a receiving unit 150 that can be connected to the transmitting system through a transmission channel and receives a plurality of transport streams through different channels, a demultiplexer 160 that generates an encoded stream corresponding to each of the plurality of transport streams, And a plurality of video decoders 170 for generating an image corresponding to each of the plurality of encoded streams. The plurality of video decoders 170 may include a first video decoder 171, a second video decoder 172 and a third video decoder 173 and may include a second video decoder 172 or a third video decoder 173, The image decoder 173 includes an up scaling unit for enlarging the resolution of the image corresponding to the first encoded stream and converting the scanning method when necessary to obtain the UHD image, thereby performing reference decoding or decoding to obtain a second encoded stream or 3 encoded streams, respectively. In addition, the receiver 150 may include a demodulator and an error correction decoder for demodulating and channel decoding each of a plurality of transport streams received through different channels.

2 is a diagram illustrating a first transmission system for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 2, the first transmission system includes a plurality of video encoders 220 for generating an encoded stream from the UHD image 210, at least one of packetization, synchronization, and multiplexing for each of the plurality of encoded streams A multiplexer 230 for generating a transport stream, and a transmission unit 240 for appropriately distributing a plurality of transport streams and transmitting them through different channels. The plurality of video encoders 220 may include a first video encoder 221, a second video encoder 223 and a third video encoder 224, and the first video encoder 221 may include a UHD video And a down scaling unit 211 that obtains an HD image by reducing the resolution of the HD image 210, thereby generating a first encoded stream from the obtained HD image. On the other hand, the second image encoder 223 decodes the image corresponding to the first encoded stream, enlarges the resolution of the decoded image, and converts the scanned method when necessary to generate a reconstructed UHD image The UHD image 210 and the up scaling unit 222 to generate a second encoded stream by reference encoding the reconstructed UHD image 210 and the UHD image 210 through the inter picture prediction method . Here, the conversion of the scanning method means that the image of the interlaced scanning is converted into the image of the progressive scanning, and the scanning method of the decoded image and the UHD image must match the reference encoding This is because the encoding efficiency is excellent. In this case, reference coding using the inter picture prediction method can be performed to reduce the amount of bits to be encoded. In HEVC, since a large amount of bits are generated in encoding I picture, in order to reduce the complexity of the image encoder, I picture alone. A detailed description thereof will be given below. Also, the third video encoder 224 may generate a third encoded stream by decoding the video corresponding to the second encoded stream and referring to the decoded video and UHD video 210.

That is, the first encoded stream may correspond to the HD image, the first encoded stream and the second encoded stream may be Semi-UHD corresponding, and the first encoded stream, the second encoded stream, and the third encoded stream may correspond to the UHD image Lt; / RTI > In addition, the first encoding stream, the second encoding stream, and the third encoding stream may be generated in different forms according to the implementation method, and may be an elementary stream (ES), a packetized elementary stream (PES), and a transport stream (TS) .

The multiplexer 230 may apply the packetization, synchronization, or multiplexing to at least one of the first encoding stream 231 and the second encoding stream 232 to generate a first transport stream, and the third encoding stream 233 may be applied to at least one of packetization and synchronization to generate a second transport stream.

The transmitting unit 240 may transmit the first transport stream through the first transport channel 250 and may transmit the second transport stream to the second transport channel 260 having a smaller capacity than the first transport channel 250 Lt; / RTI > The transmission unit 240 also includes a first error correction encoder 241 for performing error correction coding processing on the first transport stream and a second error correction encoder 242 for performing error correction coding processing on the second transport stream And may include a modulator 243. Here, the first transmission channel 250 and the second transmission channel 260 may correspond to a base layer and an enhancement layer, respectively, in case of hierarchical modulation, and may be different transmission channels in case of a hybrid network. For example, in the case of a hybrid network, the first transmission channel 250 may be a broadcasting network and the second transmission channel 260 may be an IP network. As a result, the first encoded stream 231 and the second encoded stream 232 can be transmitted over a first transmission channel 250 having a relatively large transmission capacity, and the third encoded stream 233 can be transmitted through a first transmission And may be transmitted over a second transmission channel 260 having a transmission capacity smaller than the channel 250.

FIG. 3 is a diagram illustrating a channel assignment and a program configuration in an ATSC-ADT DTV when a first transmission system for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention is used.

Referring to FIG. 3, an ATSC-ADT (augmented data transmission) digital TV (DTV) can have a transmission channel 310 of 6 MHz, a basic channel 320 of 19.4 Mbps and a base channel 320 of 8 Mbps The ADT addition channel 330 may be included.

The ATSC-ADT DTV may transmit the UHD TV program 360 through the transport channel 310. In this case, the basic channel 320 may be configured with a semi-UHD TV program 350 compressed with an HDTV program 340, MPEG-2 video and HEVC (base) compressed by MPEG-2 Video, 320 and the HEVC (enhanced) of the ADT attachment channel 330 may be compressed and combined to form a UHD program 360. [0033] FIG.

Here, the MPEG-2 Video may correspond to the first video encoder, the HEVC (base) may correspond to the second video encoder, and the HEVC (enhanced) may correspond to the third video encoder.

4 is a diagram illustrating an operation of a video encoder when using a first transmission system for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 4, the first image encoder 410 of the first transmission system can operate independently as an encoder for encoding existing HD images. For example, the first image encoder 410 may be an MPEG-2 encoder. At this time, the I picture 411 is an intra picture, and the P picture 412 and the B picture 413 can be encoded by reference coding.

The second image encoder 430 may use the up-scaled image 420 decoded by the first image encoder 410 and UHD image size for reference coding in order to increase the encoding efficiency. For example, the second image encoder 430 may perform reference coding with respect to pictures having a large bit rate. More specifically, the I picture 421 of the image 420, which is decoded and up-scaled in the first image encoder 410, may be referenced to the P picture 431 in the second image encoder 430 The P picture of the image 420 decoded and up-scaled by the first image encoder 410 may be coded as a B picture 432 by the second image encoder 430 and may be coded by the first image encoder 410, The B picture 422 of the up-scaled video 420 may be coded by the B picture 433 in the second video encoder 430. [

The third image encoder 440 may use the decoded image of the second image encoder 430 for reference coding. For example, the third video encoder 440 may perform an operation similar to the quality scalability mode of the scalable video encoder.

5 is a diagram illustrating a second transmission system for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 5, the first transmission system includes a plurality of video encoders 520 for generating an encoded stream from the UHD image 510, at least one of packetization, synchronization, and multiplexing for each of the plurality of encoded streams A multiplexer 530 for generating a transport stream, and a transmission unit 540 for appropriately distributing the plurality of transport streams and transmitting them through different channels. The plurality of video encoders 520 may include a first video encoder 521, a second video encoder 522 and a third video encoder 524 and the first video encoder 521 may include a UHD video And a down scaling unit 511 for reducing the resolution of the HD image 510 and converting the scanning method if necessary to obtain an HD image, thereby generating a first encoded stream from the obtained HD image. Here, the conversion of the scanning method may mean conversion of the progressive scanning method into the interlaced scanning method. The second image encoder 522 encodes the HD image obtained from the down scaling unit 511, decodes the image corresponding to the first encoded stream, encodes the decoded image and the obtained HD image, 2 < / RTI > encoded stream. On the other hand, the third image encoder 524 decodes the image corresponding to the second encoded stream, enlarges the resolution of the decoded image, converts the scanned image if necessary, and outputs the reconstructed UHD image 510 distinguished from the UHD image 510 The UHD image 510 and the up scaling unit 523 for obtaining a third encoded stream by referring to the reconstructed UHD image and the UHD image 510 distinguished from the UHD image 510.

That is, the first encoded stream may correspond to an HD image, the first encoded stream and the second encoded stream may correspond to an image with improved image quality, and the first encoded stream and the second encoded stream, The stream may correspond to a UHD image.

The multiplexer 530 may apply the packetization, synchronization, or multiplexing to at least one of the first encoding stream 531 and the second encoding stream 532 to generate a first transport stream, and the third encoding stream 533 may be applied to at least one of packetization and synchronization to generate a second transport stream.

The transmitting unit 540 may transmit the first transport stream through the first transport channel 550 and may transmit the second transport stream to the second transport channel 560 having a smaller capacity than the first transport channel 550 Lt; / RTI > The transmitting unit 540 includes a first error correction encoder 541 for performing error correction coding processing on the first transport stream and a second error correction encoder 542 for performing error correction coding processing on the second transport stream And may include a modulator 543. Here, the first transmission channel 550 and the second transmission channel 560 may correspond to a base layer and an enhancement layer, respectively, in case of hierarchical modulation, and may be different transmission channels in case of a hybrid network. For example, in the case of a hybrid network, the first transport channel 550 may be a broadcast network and the second transport channel 560 may be an IP network. As a result, the first encoded stream 531 and the second encoded stream 532 may be transmitted over a first transmission channel 550 having a relatively large transmission capacity, and the third encoded stream 533 may be transmitted through a first transmission And may be transmitted via a second transmission channel 560 having a transmission capacity smaller than the channel 550. [

FIG. 6 is a diagram illustrating a third transmission system for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 6, the first transmission system includes a plurality of video encoders 620 for generating an encoded stream from the UHD image 610, at least one of packetization, synchronization, and multiplexing for each of the plurality of encoded streams A multiplexer 630 for generating a transport stream, a stream demultiplexer 624, and a transmitter 640 for appropriately distributing the plurality of transport streams and transmitting them through different channels. The plurality of video encoders 620 may include a first video encoder 621 and a second video encoder 623. The first video encoder 621 may reduce the resolution of the UHD video 610 And a down scaling unit 611 for converting the scanning method when necessary to acquire an HD image, thereby generating a first encoded stream from the obtained HD image. On the other hand, the second image encoder 623 decodes the image corresponding to the first encoded stream, enlarges the resolution of the decoded image, and converts the scanned image to a restored UHD image distinguished from the UHD image 610 The second encoding stream can be generated by reference encoding the restored UHD image and the UHD image 610 distinguished from the UHD image 610 by including the up scaling unit 622 for acquiring the UHD image.

In addition, the stream separator 624 may separate the second encoded stream to generate the third encoded stream and the fourth encoded stream. At this time, the method of separating can use at least one of Tile unit, NAL unit, PES packet or TS unit supported by HEVC.

That is, the first encoded stream may correspond to the HD image, and the first encoded stream and the second encoded stream may correspond to the UHD image.

The multiplexer 630 may apply the packetization, synchronization, or multiplexing to at least one of the first encoding stream 631 and the third encoding stream 632 to generate a first transport stream, and the fourth encoding stream 633 may be applied to at least one of packetization and synchronization to generate a second transport stream.

The transmitting unit 640 may transmit the first transport stream through the first transport channel 650 and may transmit the second transport stream to the second transport channel 660 having a smaller capacity than the first transport channel 650 Lt; / RTI > The transmitting unit 640 includes a first error correction encoder 641 for performing error correction coding processing on the first transport stream and a second error correction encoder 642 for performing error correction coding processing on the second transport stream And may include a modulator 643. Here, the first transmission channel 650 and the second transmission channel 660 may correspond to a base layer and an enhancement layer, respectively, in case of hierarchical modulation, and may be different transmission channels in case of a hybrid network. For example, in the case of a hybrid network, the first transmission channel 650 may be a broadcasting network, and the second transmission channel 660 may be an IP network. As a result, the first encoded stream 631 and the third encoded stream 632 can be transmitted over a first transmission channel 650 with a relatively large transmission capacity, and the fourth encoded stream 633 can be transmitted over a first transmission And may be transmitted over a second transmission channel 660 having a transmission capacity smaller than the channel 650. [

7 is a diagram illustrating a first receiving system for receiving a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

7, the first receiving system includes a receiving unit 710 for receiving a plurality of transport streams through different channels, a demultiplexer 740 for generating an encoded stream corresponding to each of the plurality of transport streams, And a plurality of video decoders 750 for generating an image corresponding to each of the encoded streams.

The receiver 710 can receive the first transport stream on the first transport channel 720 and the second transport stream on the second transport channel 730 having a smaller capacity than the first transport channel 720 . The receiving unit 710 may include a demodulator 711 for channel decoding the received signal and may include a first error correction decoder 712 for performing an error correction decoding process on the first transport stream, And a second error correction decoder 713 that performs error correction decoding processing.

Demultiplexer 740 may separate the first transport stream to obtain a first encoded stream 741 and a second encoded stream 742 and may obtain a third encoded stream 743 from the second transport stream have.

The plurality of video decoders 750 may include a first video decoder 751, a second video decoder 753 and a third video decoder 754, and the first video decoder 751 may include a first video decoder 751, And generate the corresponding HD video 760 from the encoded stream. On the other hand, the second video decoder 753 includes an up scaling unit 752 that decodes an image corresponding to the first encoded stream, enlarges the resolution of the decoded image, and converts the scanned image if necessary to obtain a UHD image Thereby generating a Semi-HD image 770 by reference decoding the obtained UHD image and the second encoded stream. In addition, the third video decoder 754 may generate the UHD video 780 by reference decoding the Semi-HD video 770 and the third encoded stream. In this case, when the first receiving system is ATSC-DTV, the first video encoder 751 and the first error correction decoder 712 may be an MPEG-2 video decoder and a TCM decoder, and the second video decoder 753 ), The third video decoder 754 and the second error correction decoder 713 may be an MPEG-4 AVC decoder, an HEVC video decoder, and an LDPC decoder.

8 is a diagram illustrating a second receiving system for receiving a real-time broadcast image including a UHD image according to an embodiment of the present invention.

8, the second receiving system includes a receiving unit 810 for receiving a plurality of transport streams through different channels, a demultiplexer 840 for generating an encoded stream corresponding to each of the plurality of transport streams, And a plurality of video decoders 850 that generate an image corresponding to each of the encoded streams.

The receiver 810 can receive the first transport stream on the first transport channel 820 and the second transport stream on the second transport channel 830 having a smaller capacity than the first transport channel 820 . The receiving unit 810 may include a demodulator 811 for channel decoding the received signal and may include a first error correction decoder 812 for performing an error correction decoding process on the first transport stream, And a second error correction decoder 813 for performing error correction decoding processing.

Demultiplexer 840 may separate the first transport stream to produce a first encoded stream 841 and a second encoded stream 842 and may generate a third encoded stream 843 from the second transport stream have.

The plurality of video decoders 850 may include a first video decoder 851, a second video decoder 852 and a third video decoder 854 and the first video decoder 851 may include a first And generate the corresponding HD video 860 from the encoded stream. On the other hand, the second video decoder 853 can decode the video corresponding to the first encoded stream and reference decode the decoded video and the second encoded stream to generate the HD video 870 with improved picture quality. The third video decoder 854 includes an up scaling unit 853 for decoding an image corresponding to the second encoded stream, enlarging the resolution of the decoded image, and converting the scanning method, if necessary, to obtain a UHD image So that the UHD image 880 can be generated by reference decoding the obtained UHD image and the third encoded stream.

9 is a diagram illustrating a third receiving system for receiving a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

9, the third receiving system includes a receiving unit 910 for receiving a plurality of transport streams through different channels, a demultiplexer 940 for generating an encoded stream corresponding to each of the plurality of transport streams, And a plurality of video decoders 950 for generating an image corresponding to each of the plurality of encoded streams.

The receiver 910 can receive the first transport stream on the first transport channel 920 and the second transport stream on the second transport channel 930 having a smaller capacity than the first transport channel 920 . The receiving unit 910 may include a demodulator 911 for channel decoding the received signal and may include a first error correction decoder 912 for performing an error correction decoding process on the first transport stream, And a second error correction decoder 913 for performing error correction decoding processing.

Demultiplexer 940 can separate the first transport stream to obtain a first encoded stream 941 and a third encoded stream 942 and obtain a fourth encoded stream 943 from the second transport stream have.

In addition, the stream merger 944 may merge the third encoded stream 942 and the fourth encoded stream 943 to generate a second encoded stream.

The plurality of video decoders 950 may include a first video decoder 951 and a second video decoder 952. The first video decoder 951 may receive the corresponding HD video Lt; RTI ID = 0.0 > 960 < / RTI > On the other hand, the second video decoder 952 includes an up scaling unit 952 that decodes an image corresponding to the first encoded stream, enlarges the resolution of the decoded image, It is possible to generate a UHD image 970 of good quality by reference decoding the image and the second encoded stream.

10 is a diagram illustrating a transmission system for transmitting a real-time broadcast image including a 3D image and a panorama image according to an embodiment of the present invention.

Referring to FIG. 10, the transmission system includes a plurality of encoders 1020 for obtaining encoded streams from a plurality of images 1010 constituting a 3D image and a panorama image, a plurality of encoders 1020 for packetizing, A multiplexer 1030 for generating a transport stream by applying at least one of the transport streams, and a transmission unit 240 for appropriately distributing the plurality of transport streams and transmitting them through different channels. Here, in the case of a panorama image, the plurality of images 1010 may be respective images obtained by dividing the panorama image into a predetermined size, and may be a left image, a right image, and a depth image when the image is a 3D image.

The plurality of video encoders 1020 may include a first video encoder 1021, a second video encoder 1022, a third video encoder 1023, and a fourth video encoder 1024. At this time, the first image encoder 1021 can generate the first encoded stream from the first image 1011, and the second image encoder 1022 can generate the second encoded stream from the second image 1012 . Meanwhile, the third video encoder 1023 may decode and reconstruct an image corresponding to the second encoded stream, and may generate a third encoded stream by reference encoding the reconstructed image and the third image 1013. Here, the reference coding can be selectively applied when the input is a 3D image. Also, the fourth video encoder 1024 may generate a fourth encoded stream from the fourth video 1014.

The multiplexer 1030 may generate the first transport stream by applying at least one of packetization, synchronization, and multiplexing to the first encoded stream group 1031, 1032 extracted according to a preset reference. In addition, the second transport stream can be generated by applying at least one of packetization and synchronization to the extracted second encoded stream group 1033, 1034 to be distinguished from the first encoded stream group 1031, 1032.

The transmitting unit 1040 may transmit the first transport stream through the first transport channel 1050 and may transmit the second transport stream to the second transport channel 1060 having a smaller capacity than the first transport channel 1050 Lt; / RTI > The transmitting unit 1040 includes a first error correction encoder 1041 for performing error correction coding processing on the first transport stream and a second error correction encoder 1042 for performing error correction coding processing on the second transport stream And may include a modulator 1043. Here, the first transmission channel 1050 and the second transmission channel 1060 may correspond to a base layer and an enhancement layer, respectively, in case of hierarchical modulation, and may be different transmission channels in case of a hybrid network. For example, in the case of a hybrid network, the first transmission channel 1050 may be a broadcasting network, and the second transmission channel 1060 may be an IP network. As a result, the first encoded stream group 1031, 1032 can be transmitted over a first transmission channel 1050 having a relatively large transmission capacity, and the second encoded stream group 1033, 1034 can be transmitted over a first transmission channel Lt; RTI ID = 0.0 > 1050). &Lt; / RTI >

11 is a diagram illustrating a channel assignment and a program configuration in an ATSC-ADT DTV when a transmission system for transmitting real-time broadcast images including a 3D image according to an embodiment of the present invention is used.

11, an ATSC-ADT DTV may have a transmission channel 1110 of 6 MHz and a basic channel 1120 of 19.4 Mbps and an ADT addition channel 1130 of 8 Mbps may be included in the transmission channel 1110 have.

The ATSC-ADT DTV can transmit the 3D program via the transmission channel 1110. [ At this time, the 3D program may include a first HDTV program 1140 and a multi-view 3D program 1190 that are compressed to 12 Mbps MPEG-2 Video, and the 3D program 1190 may be compressed by the HEVC 1170 A binocular 3D program 1180 excluding a depth image may be included. In addition, binocular 3D program 1180 may include a left image compressed with 6 Mbps H.264 (1150) and a right image compressed with HEVC (1160).

12 is a view illustrating a receiving system for receiving a real-time broadcasting image including a 3D image and a panorama image according to an embodiment of the present invention.

12, the receiving system includes a receiving unit 1210 for receiving a plurality of transport streams through different channels, a demultiplexer 1240 for generating an encoded stream corresponding to each of the plurality of transport streams, And a plurality of video decoders 1250 for generating an image corresponding to each of the plurality of video decoders 1250. [

The receiving unit 1210 may receive the first transport stream through the first transport channel 1220 and may transmit the second transport stream to the second transport channel 1230 having a smaller capacity than the first transport channel 1220 . The receiving unit 1210 may include a demodulator 1211 for channel decoding the received signal, and may include a first error correction decoder 1212 for performing error correction decoding processing on the first transport stream, And a second error correction decoder 1213 for performing error correction decoding processing.

Demultiplexer 1240 may separate the first transport stream to obtain a first encoded stream 1241 and a second encoded stream 1242 and may derive from the second transport stream the third encoded stream 1243 and the fourth encoded Stream 1244 can be obtained.

The plurality of video decoders 1250 may include a first video decoder 1251, a second video decoder 1252, a third video decoder 1253 and a fourth video decoder 1254, The video decoder 1251, the second video decoder 1252, the third video decoder 1253 and the fourth video decoder 1254 may generate corresponding video images 1261, 1262, 1263, and 1264, respectively.

In addition, the plurality of images 1260 obtained from the plurality of image decoders 1250 may be merged and generated as at least one of a 3D image and a panorama image.

FIG. 13 is a flowchart illustrating a first transmission method for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 13, a method according to an embodiment of the present invention generates a first encoded stream from an HD (High Definition) image (1310). In this case, the process of generating the first encoded stream may include a process of obtaining an HD image by reducing the resolution of the UHD image, and a process of encoding the HD image to generate a first encoded stream.

Also, the method according to an embodiment of the present invention generates a second encoded stream from at least one of the UHD image and the reconstructed image from the first encoded stream (operation 1320). At this time, in the process of generating the second encoded stream, a process of generating a decoded image by decoding an image corresponding to the first encoded stream, enlarging the resolution of the decoded image, converting the scanning method when necessary, and obtaining a reconstructed UHD image And a step of generating a second encoded stream by reference encoding the restored UHD image and the UHD image through an inter-picture prediction method.

Also, the method according to an embodiment of the present invention generates a third encoded stream from at least one of the UHD image and the reconstructed image from the second encoded stream (1330). In this case, the process of generating the third encoded stream includes a process of generating a decoded image by decoding an image corresponding to the second encoded stream, and a process of reference encoding the decoded image and the UHD image to generate a third encoded stream .

In addition, the method according to an exemplary embodiment of the present invention applies at least one of packetization, synchronization, and multiplexing to the first encoded stream and the second encoded stream to generate a first transport stream (1340).

In addition, the method according to an exemplary embodiment of the present invention applies at least one of packetization and synchronization to the third encoded stream to generate a second transport stream (1350).

In addition, the method according to an embodiment of the present invention can perform error correction coding on each of the first transport stream and the second transport stream.

Also, a method according to an embodiment of the present invention transmits a first transport stream on a first transport channel and a second transport stream on a second transport channel having a capacity smaller than the first transport channel (1360).

FIG. 14 is a flowchart illustrating a first receiving method for receiving a real-time broadcast image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 14, a method according to an embodiment of the present invention receives a first transport stream through a first transport channel (1410). In this case, the process of receiving the first transport stream may include a process of channel decoding a signal received through the first transport channel to generate a first transport stream.

Also, a method according to an embodiment of the present invention receives a second transport stream through a second transport channel (1420). In this case, the process of receiving the second transport stream may include a process of channel decoding the signal received through the second transport channel to generate a second transport stream.

In addition, the method according to an embodiment of the present invention separates the first transport stream to generate a first encoded stream and a second encoded stream (1430).

In addition, the method according to an embodiment of the present invention generates a third encoded stream from the second transport stream (1440).

In addition, a method according to an embodiment of the present invention generates an HD image from a first encoded stream, generates a Semi-UHD image from a first encoded stream and a second encoded stream, and generates a first encoded stream, And a UHD image from the third encoded stream (1450).

15 is a block diagram illustrating a first transmission system for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

15, the first transmission system includes a first image encoder 1510, a second image encoder 1520, a third image encoder 1530, a multiplexer 1540, and a transmission unit 1550.

The first image encoder 1510 generates a first encoded stream from an HD (High Definition) image.

The second image encoder 1520 generates a second encoded stream from at least one of the UHD image or the image reconstructed from the first encoded stream.

The third image encoder 1530 generates the third encoded stream from at least one of the UHD image or the image reconstructed from the second encoded stream.

The multiplexer 1540 applies at least one of packetization, synchronization, or multiplexing to the first encoding stream and the second encoding stream to generate a first transport stream, and at least one of packetization or synchronization to the third encoding stream To generate a second transport stream.

The transmitting unit 1550 transmits the first transport stream through the first transport channel and transmits the second transport stream through the second transport channel having the capacity smaller than the first transport channel.

16 is a block diagram illustrating a first receiving system for receiving a real-time broadcast image including a UHD image according to an embodiment of the present invention.

16, the first receiving system includes a receiving unit 1610, a demultiplexer 1620, a first video decoder 1630, a second video decoder 1640, and a third video decoder 1650.

Receiver 1610 receives the first transport stream on the first transport channel and the second transport stream on the second transport channel.

Demultiplexer 1620 separates the first transport stream to produce a first encoded stream and a second encoded stream, and generates a third encoded stream from the second transport stream.

The first video decoder 1630 generates an HD video corresponding to the first encoded stream from the first encoded stream.

The second video decoder 1640 generates a Semi-UHD image from the first encoded stream and the second encoded stream.

The third video decoder 1650 generates a UHD image from the first encoded stream, the second encoded stream, and the third encoded stream.

FIG. 17 is a flowchart illustrating a second transmission method of transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 17, a method according to an embodiment of the present invention generates a first encoded stream from an HD (High Definition) image (1710). In this case, the process of generating the first encoded stream may include a process of obtaining an HD image by reducing the resolution of the UHD image, and a process of encoding the HD image to generate a first encoded stream.

Also, a method according to an embodiment of the present invention generates a second encoded stream from at least one of the UHD image and the reconstructed image from the first encoded stream (1720). At this time, the process of generating the second encoded stream includes a process of obtaining an HD image by reducing the resolution of the UHD image, a process of decoding a video corresponding to the first encoded stream to generate a decoded image, And generating a second encoded stream by reference encoding.

In addition, the method according to an embodiment of the present invention generates a third encoded stream from the UHD image (1730). At this time, in the process of generating the third encoded stream, a process of generating a decoded image by decoding an image corresponding to the second encoded stream, a resolution of the decoded image is enlarged, A process of acquiring the reconstructed UHD image, and a process of reference encoding the reconstructed UHD image and the UHD image to generate the third encoded stream.

In addition, the method according to an embodiment of the present invention applies at least one of packetization, synchronization, and multiplexing to the first encoded stream and the second encoded stream to generate a first transport stream (1740).

In addition, the method according to an exemplary embodiment of the present invention applies at least one of packetization and synchronization to the third encoded stream to generate a second transport stream (1750).

Also, a method according to an embodiment of the present invention transmits a first transport stream on a first transport channel and a second transport stream on a second transport channel having a capacity smaller than the first transport channel (1760).

18 is a flowchart illustrating a second receiving method for receiving a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 18, a method according to an embodiment of the present invention receives a first transport stream through a first transport channel (1810). In this case, the process of receiving the first transport stream may include a process of channel decoding a signal received through the first transport channel to generate a first transport stream.

In addition, a method according to an embodiment of the present invention receives a second transport stream through a second transport channel (1820). In this case, the process of receiving the second transport stream may include a process of channel decoding the signal received through the second transport channel to generate a second transport stream.

In addition, the method according to an embodiment of the present invention separates the first transport stream to generate a first encoded stream and a second encoded stream (1830).

In addition, the method according to an embodiment of the present invention generates a third encoded stream from the second transport stream (1840).

A method according to an embodiment of the present invention also includes generating an HD image corresponding to a first encoded stream from a first encoded stream, generating a Semi-UHD image from a first encoded stream and a second encoded stream, The UHD image is generated 1850 from the encoded stream, the second encoded stream, and the third encoded stream.

19 is a block diagram illustrating a second transmission system for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 19, the second transmission system includes a first image encoder 1910, a second image encoder 1920, a third image encoder 1930, a multiplexer 1940, and a transmitter 1950.

The first image encoder 1910 generates a first encoded stream from an HD (High Definition) image.

The second image encoder 1920 generates a second encoded stream from at least one of the UHD image or the reconstructed image from the first encoded stream.

The third image encoder 1930 generates a third encoded stream from at least one of the UHD image or the reconstructed image from the second encoded stream.

The multiplexer 1940 applies at least one of packetization, synchronization, or multiplexing to the first encoded stream and the second encoded stream to generate a first transport stream, and at least one of packetization or synchronization to the third encoded stream To generate a second transport stream.

The transmitting unit 1950 transmits the first transport stream on the first transport channel and the second transport stream on the second transport channel having the capacity smaller than the first transport channel.

20 is a block diagram illustrating a second receiving system for receiving a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 20, the second receiving system includes a receiving unit 2010, a demultiplexer 2020, a first video decoder 2030, a second video decoder 2040, and a third video decoder 2050.

The receiving unit 2010 receives the first transport stream through the first transport channel and receives the second transport stream through the second transport channel.

Demultiplexer 2020 separates the first transport stream to generate a first encoded stream and a second encoded stream, and generates a third encoded stream from the second transport stream.

The first video decoder 2030 generates an HD video corresponding to the first encoded stream from the first encoded stream.

The second video decoder 2040 generates another HD video corresponding to the second encoded stream from the first encoded stream and the second encoded stream.

The third video decoder 2050 generates a UHD image corresponding to the third encoded stream from the first encoded stream, the second encoded stream, and the third encoded stream.

FIG. 21 is a flowchart illustrating a third transmission method for transmitting a real-time broadcasting image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 21, a method according to an embodiment of the present invention generates a first encoded stream from an HD (High Definition) image (2110). In this case, the process of generating the first encoded stream may include a process of obtaining an HD image by reducing the resolution of the UHD image, and a process of encoding the HD image to generate a first encoded stream.

Also, the method according to an embodiment of the present invention generates a second encoded stream from at least one of the UHD image and the reconstructed image from the first encoded stream (step 2120). In addition, the process of generating the second encoded stream may include a process of decoding an image corresponding to the first encoded stream to generate a decoded image, a process of expanding the resolution of the decoded image, And a process of generating a second encoded stream by reference encoding the restored UHD image and the UHD image through an inter-picture prediction method.

In addition, the method according to an embodiment of the present invention separates the second encoded stream to generate a third encoded stream and a fourth encoded stream (2130).

In addition, the method according to an exemplary embodiment of the present invention applies at least one of packetization, synchronization, and multiplexing to the first encoded stream and the third encoded stream to generate a first transport stream (2140). In this case, the process of generating the first transport stream may include a process of performing error correction coding on the first transport stream.

In addition, the method according to an exemplary embodiment of the present invention applies at least one of packetization and synchronization to the fourth encoded stream to generate a second transport stream (2150). In this case, the process of generating the second transport stream may include a process of performing error correction encoding on the second transport stream.

Also, a method according to an exemplary embodiment of the present invention transmits a first transport stream on a first transport channel and a second transport stream on a second transport channel having a capacity smaller than the first transport channel 2160).

22 is a flowchart illustrating a third receiving method for receiving a real-time broadcast image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 22, a method according to an embodiment of the present invention receives a first transport stream through a first transport channel (2210).

Also, a method according to an embodiment of the present invention receives a second transport stream through a second transport channel (2220).

In addition, the method according to an embodiment of the present invention separates the first transport stream to generate a first encoded stream and a third encoded stream (2230).

In addition, the method according to an embodiment of the present invention generates a fourth encoded stream from the second transport stream (2240).

In addition, the method according to an embodiment of the present invention merges the third encoded stream and the fourth encoded stream to generate a second encoded stream (2250).

Further, a method according to an embodiment of the present invention generates an HD image from the first encoded stream, and generates a UHD image from the first encoded stream and the second encoded stream (2260).

23 is a block diagram illustrating a third transmission system for transmitting a real-time broadcast image including a UHD image according to an embodiment of the present invention.

Referring to FIG. 23, the third transmission system includes a first image encoder 2310, a second image encoder 2320, a stream separator 2330, a multiplexer 2340, and a transmitter 2350.

The first image encoder 2310 generates a first encoded stream from an HD (High Definition) image.

The second image encoder 2320 generates a second encoded stream from at least one of the UHD image or the reconstructed image from the first encoded stream.

The stream separator 2330 separates the second encoded stream to generate a third encoded stream and a fourth encoded stream.

The multiplexer 2340 applies at least one of packetization, synchronization, or multiplexing to the first encoding stream and the third encoding stream to generate a first transport stream, and at least one of packetization or synchronization to the fourth encoding stream To generate a second transport stream.

The transmitting unit 2350 transmits the first transport stream through the first transport channel and transmits the second transport stream through the second transport channel having the capacity smaller than the first transport channel.

FIG. 24 is a flowchart illustrating a transmission method for transmitting a sensory broadcast image including a 3D image and a panoramic image according to an embodiment of the present invention.

Referring to FIG. 24, a method according to an embodiment of the present invention generates an encoded stream corresponding to each of a plurality of images from a plurality of images included in at least one of a 3D image and a panorama image (Operation 2410) .

Also, a method according to an embodiment of the present invention generates at least one of a first encoding stream group extracted according to a preset reference from a plurality of encoded streams, at least one of packetization, synchronization, and multiplexing (2420).

Also, a method according to an embodiment of the present invention applies at least one of packetization or synchronization to a second encoded stream group extracted to distinguish from a first encoded stream group from a plurality of encoded streams, (2430).

Also, a method according to an embodiment of the present invention transmits a first transport stream on a first transport channel and a second transport stream on a second transport channel having a capacity smaller than the first transport channel (2440).

FIG. 25 is a flowchart illustrating a receiving method for receiving a real-time broadcasting image including a 3D image and a panorama image according to an embodiment of the present invention.

Referring to FIG. 25, a method according to an embodiment of the present invention receives a first transport stream through a first transport channel (step 2510).

Also, a method according to an embodiment of the present invention receives a second transport stream through a second transport channel (step 2520).

Further, the method according to an embodiment of the present invention acquires a plurality of encoded streams from the first transport stream and the second transport stream (2530).

Further, a method according to an embodiment of the present invention generates an image corresponding to each of a plurality of encoded streams (2540).

In addition, a method according to an embodiment of the present invention merges a plurality of images to generate at least one of a 3D image and a panorama image (2550).

FIG. 26 is a block diagram illustrating a transmission system for transmitting a real-time broadcasting image including a 3D image and a panorama image according to an embodiment of the present invention.

Referring to FIG. 26, a transmission system according to an embodiment of the present invention includes a plurality of video encoders 2610, a multiplexer 2620, and a transmitter 2630.

The plurality of image encoders 2610 generates an encoded stream corresponding to each of the plurality of images from each of the plurality of images included in at least one of the 3D image or the panorama image.

The multiplexer 2620 applies at least one of packetization, synchronization, and multiplexing to the first encoded stream group extracted according to the preset reference from the plurality of encoded streams to generate the first transport stream, To the second encoded stream group extracted to distinguish the first encoded stream group from the first encoded stream group.

The transmitting unit 2630 transmits the first transport stream on the first transport channel and the second transport stream on the second transport channel having the capacity smaller than the first transport channel.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented within a computer system, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA) A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be in the form of any type of machine, component, physical device, virtual equipment, computer storage media, or device , Or may be permanently or temporarily embodied in a transmitted signal wave. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims

A method for providing a real-time broadcasting image including an UHD (Ultra High Definition) image,
Generating a first encoded stream from a High Definition (HD) image;
Generating a second encoded stream from at least one of a UHD image or an image reconstructed from the first encoded stream;
Generating a third encoded stream from at least one of the UHD image or the reconstructed image from the second encoded stream;
Generating a first transport stream by applying at least one of packetization, synchronization, and multiplexing to the first encoded stream and the second encoded stream;
Applying at least one of packetization or synchronization to the third encoded stream to generate a second transport stream;
Transmitting the first transport stream over a first transport channel; And
Transmitting the second transport stream through a second transport channel having a transmission capacity smaller than that of the first transport channel
And outputting the sensed broadcast image.

The method according to claim 1,
The step of generating the first encoded stream
Acquiring the HD image by reducing the resolution of the UHD image; And
Encoding the HD video to generate the first encoded stream
And outputting the sensed broadcast image.

The method according to claim 1,
Wherein generating the second encoded stream comprises:
Decoding the image corresponding to the first encoded stream to generate a decoded image;
Acquiring a reconstructed UHD image distinguished from the UHD image by enlarging a resolution of the decoded image and converting a scanning method when necessary; And
Encoding the reconstructed UHD image and the UHD image through an inter-picture prediction method to generate the second encoded stream
And outputting the sensed broadcast image.

The method according to claim 1,
The step of generating the third encoded stream
Decoding the image corresponding to the second encoded stream to generate a decoded image; And
And generating the third encoded stream by reference encoding the decoded image and the UHD image
And outputting the sensed broadcast image.

The method according to claim 1,
Wherein generating the second encoded stream comprises:
Acquiring the HD image by reducing the resolution of the UHD image;
Decoding the image corresponding to the first encoded stream to generate a decoded image; And
Encoding the decoded image and the HD image to generate the second encoded stream
The method comprising the steps of:

The method according to claim 1,
The step of generating the third encoded stream
Decoding the image corresponding to the second encoded stream to generate a decoded image;
Acquiring a reconstructed UHD image distinguished from the UHD image by enlarging a resolution of the decoded image and converting a scanning method when necessary; And
Encoding the reconstructed UHD image and the UHD image to generate the third encoded stream
The method comprising the steps of:

The method according to claim 1,
Performing error correction coding on each of the first transport stream and the second transport stream;
The method comprising the steps of:

The method according to claim 1,
Receiving the first transport stream over the first transport channel;
Receiving the second transport stream over the second transport channel;
Separating the first transport stream to produce the first encoded stream and the second encoded stream;
Generating the third encoded stream from the second transport stream;
Generating the HD image from the first encoded stream;
Generating at least one of a Semi-UHD image or another HD image distinguished from the HD image from the first encoded stream and the second encoded stream; And
Generating the UHD image from the first encoded stream, the second encoded stream, and the third encoded stream
The method comprising the steps of:

9. The method of claim 8,
The step of receiving the first transport stream
Generating a first transport stream by channel decoding a signal received through the first transport channel;
Lt; / RTI >
The step of receiving the second transport stream
Generating a second transport stream by channel decoding a signal received via the second transport channel;
And outputting the sensed broadcast image.

A method for providing a real-time broadcasting image including an UHD (Ultra High Definition) image,
Generating a first encoded stream from a High Definition (HD) image;
Generating a second encoded stream from at least one of a UHD image or an image reconstructed from the first encoded stream;
Separating the second encoded stream to produce a third encoded stream and a fourth encoded stream;
Generating a first transport stream by applying at least one of packetization, synchronization, and multiplexing to the first encoded stream and the third encoded stream;
Applying at least one of packetization or synchronization to the fourth encoded stream to generate a second transport stream;
Transmitting the first transport stream over a first transport channel; And
Transmitting the second transport stream through a second transport channel having a transmission capacity smaller than that of the first transport channel
And outputting the sensed broadcast image.

11. The method of claim 10,
The step of generating the first encoded stream
Acquiring the HD image by reducing the resolution of the UHD image; And
Encoding the HD video to generate the first encoded stream
And outputting the sensed broadcast image.

11. The method of claim 10,
Wherein generating the second encoded stream comprises:
Decoding the image corresponding to the first encoded stream to generate a decoded image;
Acquiring a reconstructed UHD image distinguished from the UHD image by enlarging a resolution of the decoded image and converting a scanning method when necessary; And
Encoding the reconstructed UHD image and the UHD image through an inter-picture prediction method to generate the second encoded stream
And outputting the sensed broadcast image.

11. The method of claim 10,
The step of generating the first transport stream
A step of performing error correcting coding processing on the first transport stream
Further comprising:
The step of generating the second transport stream
And performing error correction coding on the second transport stream
The method comprising the steps of:

11. The method of claim 10,
Receiving the first transport stream over the first transport channel;
Receiving a second transport stream over the second transport channel;
Separating the first transport stream to produce the first encoded stream and the third encoded stream;
Generating the fourth encoded stream from the second transport stream;
Merging the third encoded stream and the fourth encoded stream to produce the second encoded stream;
Generating the HD image from the first encoded stream; And
Generating the UHD image from the first encoded stream and the second encoded stream
The method comprising the steps of:

A method of providing a realistic broadcast image including a 3D image and a panoramic image,
Generating an encoded stream corresponding to each of the plurality of images from each of a plurality of images included in at least one of a 3D image and a panoramic image;
Generating a first transport stream by applying at least one of packetization, synchronization, and multiplexing to a first encoded stream group extracted according to a preset reference from the plurality of encoded streams;
Generating a second transport stream by applying at least one of packetization or synchronization to a second encoded stream group extracted to distinguish the first encoded stream group from the plurality of encoded streams;
Transmitting the first transport stream over a first transport channel; And
Transmitting the second transport stream through a second transport channel having a transmission capacity smaller than that of the first transport channel
And outputting the sensed broadcast image.

16. The method of claim 15,
Receiving the first transport stream over the first transport channel;
Receiving the second transport stream over the second transport channel;
Obtaining the plurality of encoded streams from the first transport stream and the second transport stream;
Generating the image corresponding to each of the plurality of encoded streams; And
Generating at least one of the 3D image and the panorama image by merging the plurality of images;
The method comprising the steps of:

1. A system for providing a real-time broadcasting image including a UHD (Ultra High Definition) image,
A first image encoder for generating a first encoded stream from a High Definition (HD) image;
A second image encoder for generating a second encoded stream from at least one of a UHD image or an image reconstructed from the first encoded stream;
A third image encoder for generating a third encoded stream from at least one of the UHD image or the reconstructed image from the second encoded stream;
At least one of packetization, synchronization, and multiplexing is applied to the first encoded stream and the second encoded stream to generate a first transport stream, and at least one of packetization or synchronization is applied to the third encoded stream A multiplexer for generating a second transport stream; And
A transmission unit for transmitting the first transport stream through a first transport channel and the second transport stream through a second transport channel having a capacity smaller than the first transport channel,
And outputting the sensed broadcast image.

18. The method of claim 17,
A receiver for receiving the first transport stream over the first transport channel and for receiving the second transport stream over the second transport channel;
A demultiplexer for separating the first transport stream to generate the first encoded stream and the second encoded stream, and generating the third encoded stream from the second transport stream;
A first video decoder for generating the HD video from the first encoded stream;
A second image decoder for generating at least one of a Semi-UHD image from the first encoded stream and another HD image distinguished from the HD image from the second encoded stream; And
A third video decoder for generating the UHD image from the first encoded stream, the second encoded stream and the third encoded stream,
And outputting the sensed broadcast image.

1. A system for providing a real-time broadcasting image including a UHD (Ultra High Definition) image,
A first image encoder for generating a first encoded stream from a High Definition (HD) image;
A second image encoder for generating a second encoded stream from at least one of a UHD image or an image reconstructed from the first encoded stream;
A stream separator for separating the second encoded stream to generate a third encoded stream and a fourth encoded stream;
At least one of packetization, synchronization, and multiplexing is applied to the first encoded stream and the third encoded stream to generate a first transport stream, and at least one of packetization or synchronization is applied to the fourth encoded stream A multiplexer for generating a second transport stream; And
A transmission unit for transmitting the first transport stream through a first transport channel and the second transport stream through a second transport channel having a capacity smaller than the first transport channel,
And outputting the sensed broadcast image.

A system for providing real-time broadcasting images including 3D images and panoramic images,
A plurality of video encoders for generating an encoded stream corresponding to each of the plurality of images from each of a plurality of images included in at least one of a 3D image and a panoramic image;
Generating a first transport stream by applying at least one of packetization, synchronization, and multiplexing to a first encoded stream group extracted according to a preset reference from the plurality of encoded streams, A multiplexer for applying a packetization or a synchronization to a second encoded stream group extracted to be distinguished from a first encoded stream group to generate a second transport stream; And
A transmission unit for transmitting the first transport stream through a first transport channel and the second transport stream through a second transport channel having a capacity smaller than the first transport channel,
And outputting the sensed broadcast image.