KR101941781B1 - Method and Apparatus for Receiving 8K Broadcasting based on MMT - Google Patents

Abstract

A method and an apparatus for receiving an 8K broadcasting based on MPEG media transport (MMT) are provided. According to an embodiment of the present invention, the apparatus for receiving a broadcasting based on MMT receives media including a video hierarchically encoded by being divided into each region, reconfigures the video by integrating the video for each layer after dividing into each region in the received media, and reproduces media including the reconfigured video. Accordingly, divided four 4K regions are received to be integrated as one 8K content in a 8K broadcasting service dividing the 8K content into the four 4K regions to transfer the four 4K regions based on the MMT through heterogeneous networks.

Description

TECHNICAL FIELD [0001] The present invention relates to a method and apparatus for receiving 8K broadcasting based on MMT,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a broadcast service technology, and more particularly, to a method of receiving, processing, and reproducing an 8K broadcast stream transmitted through a heterogeneous network based on an MMT (MPEG Media Transport).

As digital broadcasts stabilize and display performance improves, users are demanding better quality and larger size video services.

UHDTV is a next-generation broadcast that can meet the needs of viewers by providing high-definition video and 22.2 multichannel audio for realistic content. In August 2016, NHK, the public broadcaster in Japan, launched the world's first regular UHDTV service through satellite, and competition among the countries is fierce to preempt UHDTV technology such as contents, transmission, display device, and set-top.

8K video, which is 16 times larger than 2K (1920x1080) and 4 times larger than 4K (3840x2160), is very large and requires high-efficiency video coding and transmission technology for UHDTV content.

8K content is compressed in HEVC (High Efficiency Video Coding) according to a frame rate of 60 fps, a color depth of 10 bits, and a sampling rate of 4: 2: 0 in Japan which started the world's only 8K test broadcast.

Through the bit rate according to the 4K standard shown in FIG. 1, it can be seen that a higher bit rate is required for the 8K service. Japan's 8K UHDTV is actually transmitted over satellites at a bit rate of 80-90Mbps.

In reality, it is impossible to transmit over 80 Mbps over terrestrial channels. Although it can be technically more than 40 Mbps using the transmission technology of ATSC 3.0 (Advanced Television Systems Committee) and DVB-T2 (Digital Video Broadcasting-Terrestrial), it is possible that a bit rate of 30 Mbps is actually a stable terrestrial broadcast service Lt; RTI ID = 0.0 > limited < / RTI >

Therefore, a new system for 8K broadcasting is required in the current terrestrial broadcasting environment. Especially, in Korea, terrestrial 8K trial broadcasting is under way, but the current terrestrial broadcast environment transmits real 8K (7680 * 4320, 4: 2: 0, 120fps, 10bit: color depth) There are various problems such as a lack of bandwidth.

Furthermore, the fact that codecs (encoders, decoders) for 8K video are not commercialized, and that they are very expensive even if they are commercialized, should be considered in 8K broadcasting.

In addition, a specific design method of a receiver for receiving, processing, and reproducing an 8K broadcast stream is also needed.

SUMMARY OF THE INVENTION It is an object of the present invention to solve the above-mentioned problem, and it is an object of the present invention to provide an apparatus and a method for decoding an 8K content, which divides an 8K content into four 4K areas, The present invention provides a broadcast receiving apparatus and method for receiving four divided 4K regions in a service and merging the received 4K regions into one 8K content.

According to an aspect of the present invention, there is provided an MMT-based broadcast receiving apparatus including: a receiver for receiving a media including hierarchically encoded video divided into regions; A Media Consumption Entity (MCE) that separates video from the media received by the receiver into areas and reconstructs them by layer; And a player for playing the media including the reconstructed video in the MCE.

The MCE includes a parser for classifying signal messages and media in broadcast packets received at the receiver and dividing the videos in the media into regions; A manager that receives a signal message from the parser and extracts media information necessary for media playback; A reconfigurable unit that reconstructs the regions classified by the parser by hierarchical integration; And a media processor for referring to the media information extracted by the manager, processing the media to be reproducible, and transmitting the processed media to the player.

In addition, the media processor may include buffer managers for each region to divide video for each region into a plurality of hierarchical layers, and to create each region by combining buffered hierarchical videos; And a presentation manager for managing the video areas transferred from the buffer managers to be reproducible, and performing media synchronization of video and audio and delivering them to the player.

The buffer managers can discard the buffered layer-by-layer video before the intra-picture is received for the first time after the start of broadcast reception.

Also, the buffer managers can discard without merging if the frame indices of the buffered layered videos are not the same.

And, the buffer managers can discard videos of enhancement layers whose frame index is faster than that of the base layer.

Also, the presentation manager can discard the video regions if the resolution and time information of the reference region and the resolution and time information of the other regions among the video regions transmitted from the buffer managers do not match.

And, the reference area may be a region of video received with the audio.

In addition, one of the buffer managers may buffer the audio contained in the media.

The receiver comprises a first receiver for receiving packets encoded with audio, some layers of video and signal messages in the MMTP (MMT Protocol); And a second receiver for receiving packets encoded with video of the remaining layers by HTTP.

In the header of the broadcast packet, information indicating whether the payload data is video data or not may be stored in the header of the broadcast packet, and information on the layer and information on the area.

And, the content may be 8K video, and the divided areas may be 4K video size.

According to another aspect of the present invention, there is provided an MMT-based broadcast receiving method comprising: receiving a media including hierarchically encoded video divided into regions; Dividing the video in the received media into regions and reconstructing the video by layer; And reproducing the media including the reconstructed video.

According to another aspect of the present invention, there is provided an MMT-based broadcast transmission system including: a content server for dividing a video into a plurality of regions and encoding each of the divided regions into a plurality of layers; A first server for transmitting media including some layers of the encoded layers to a broadcast receiving apparatus; And a second server for transmitting the media including the remaining layers among the encoded layers to the broadcast receiving apparatus, wherein the broadcast receiving apparatus separates the video from the received media into regions, reconstructs the reconstructed information for each layer, ≪ / RTI >

According to another aspect of the present invention, there is provided an MMT-based broadcast transmission system including: dividing a video into a plurality of regions and encoding each of the divided regions into a plurality of layers; Transmitting media including some layers of the encoded layers to a broadcast receiving apparatus; And transmitting the media including the remaining layers among the encoded layers to the broadcast receiving apparatus, wherein the broadcast receiving apparatus separates the video from the received media into regions, reconstructs the reconstructed video by layers, Lt; / RTI >

As described above, according to the embodiments of the present invention, in an 8K broadcast service for dividing 8K contents into 4K areas through a heterogeneous network in order to solve the insufficient bit rate, 4K regions can be received and merged into one 8K content. Thus, 8K broadcasting service becomes possible even if there is no codec (encoder, decoder) for 8K video which is not commercialized or is highly expensive even if it is commercialized.

In particular, according to embodiments of the present invention, information of regions constituting the same layer is provided as group information, and the receiving end can smoothly restore original contents by merging regions.

Furthermore, according to embodiments of the present invention, packets including data of the same layers in each area can be scheduled in order of area-number, thereby reducing delay in broadcasting service due to area division.

1 is a table comparing UHSTV standards between Korea and Japan,
2 is a block diagram illustrating the concept of SHVC encoding,
Figure 3 shows a method of encapsulating SHVC-encoded video,
Figure 4 illustrates an 8K broadcast service architecture over a heterogeneous network;
5 shows 8K content divided into four regions,
FIG. 6 is a diagram illustrating a UHDTV service scenario,
7 is a diagram illustrating a relationship between CI and HTML5 documents and CI documents generated by CI components,
8 is a diagram illustrating an MP table,
9 is a diagram illustrating the syntax of the Group_descriptor ()
10 is a diagram showing a structure of a packet_id,
11 is a view showing details of information constituting the packet_id,
12 is a table showing a value of 'packet_id' and a description thereof,
13 is a diagram illustrating a method of scheduling an MMTP packet according to area information,
Fig. 14 is a detailed block diagram of the receiver shown in Fig. 4,
15 is a detailed block diagram of the media processor shown in Fig.

Hereinafter, the present invention will be described in detail with reference to the drawings.

In an embodiment of the present invention, an 8K broadcasting system using a digital broadcasting network and a packet switching network is presented. The proposed system divides 8K contents into four 4K areas and delivers them through heterogeneous networks.

In addition, the embodiment of the present invention proposes a scheme for allowing four 4K divided areas transmitted through a heterogeneous network to be merged into one 8K content at the receiving end.

MMT (MPEG Media Transport) is the next generation technology for media delivery through digital broadcasting network and packet exchange network. It has three functional areas: MPU (Media Processing Unit) format, Signal Messages and Delivery Protocol .

The MPU format based on ISOBMFF (ISO based media file format) defines the logical structure of the media content and the format of the data unit for encapsulating the encoded data. A signal message defines a number of signaling messages for managing the delivery and use of media data. The delivery protocol defines the Application-Layer Transport Protocol and the payload format. The MMT supports streaming mode optimized for transmitting packetized ISOBMFF files and signaling messages to enable broadcast services.

The broadcast receiving apparatus according to the embodiment of the present invention is applicable to various devices such as a smart phone, a tablet PC, a laptop PC, a notebook computer, and a television.

In the embodiment of the present invention, each 4K region divided from 8K is encoded into SHVC of the concept shown in Fig. SHVC is the Scalability Extensions of HEVC, a video compression standard that supports resolutions up to 8K, which provides twice the data compression rate compared to AVC (Advanced Video Coding). This provides spatial, temporal and quality scalability.

The SHVC encoder creates several layers, specifically a base layer and one or more enhancement layers. A single-encoded video stream by an SHVC with spatial scalability can be used in a variety of devices with various resolutions (e.g., HD, FHD and UHD) without additional processing.

For reliable service in media streaming, several solutions are needed as described below.

The first is the scheduling of signaling messages. Since a signal message is necessary for a broadcast service because it contains important information such as location of a service, synchronization information between media streams, and decoding configuration, the MMT may require the signaling message to be transmitted at certain time intervals (e.g., 1 second) periodically.

However, this causes problems with low latency and transmission overhead. This can solve the problem by periodically transmitting a signal message in consideration of the video picture type. The video picture type includes inter-pictures (e.g., P and B pictures) that can be decoded on their own and are represented in terms of one or more adjacent pictures and intra-pictures (e.g., IDR, BLA and CRA) ). Even if the signal message is frequently transmitted, the broadcast message can not be provided if the MPU of the intra-picture is not received at the receiver. Therefore, it is preferable that the signal message is transmitted immediately before the MPU of the inter-picture.

The second solution is an encapsulation method for random access. Because the broadcasters do not know when the user will access the service, there is a need for an encapsulation method that allows the user to view the selected content at low latency.

An encapsulation method for randomly concatenating SHVC encoded video streams, the MPU has metadata including an encoded raw-formatted stream and a set of parameters. The parameter set includes VPS (Video Parameter set), SPS (Sequence Parameter set) and PPS (Picture Parameter Set).

The stream of the encoded low format is loaded into the mdat box and the metadata is loaded into the Configuration box (eg hvc1, lhv1) in the track box (trak). This parameter set contains decoding information. Each layer that is scalably encoded has a set of parameters for its layer. However, they must be rearranged in the order in which they are requested when a set of parameters is input to a decoder having a low formatted stream.

Figure 3 is a diagram illustrating that each layer of SHVC-encoded video with three layers is encapsulated into a set of re-ordered parameters. When this process runs on the receiver, it takes time and results are delayed. To reduce the delay, the reordered parameters are added before the video stream in the low format encoded in the MPU when encapsulated in the transmitting end, as shown in FIG.

The third solution is a synchronization method for a scalable video stream transmitted over a heterogeneous network. As shown in FIG. 3, the SHVC-encoded video stream has three layers L0, L1 and L2. Each layer is encapsulated in the MPU along with its own information. The MPUs for L0 and L1 are transmitted over the broadcast network together with the audio and signal messages, and the MPU for L2 is transmitted over the HTTP network. MPUs delivered over different heterogeneous networks must be merged into a single piece of content using a synchronization method.

In the MMT, a composition layer provides information on the time relationship between media contents and the dependency relation between media data (e.g., scalable video layer, audio data, etc.). This information is called CI (Composition Information). MXD (MMT eXtension Document) is an XML-formatted document with a list of segments in the enhancement layer.

The CI document and MXD are delivered as signal messages. The receiving end parses the signaling message to obtain the physical address of the CI document and the MXD. You can then obtain the MXD by requesting it to the web server with that address. Appropriate segments among the segments listed in the MXD are selected through a selection algorithm for media synchronization. The receiving end may request the selected segment to the web server, and may refer to the CI to merge the media segments.

4 is a diagram illustrating an 8K broadcast service architecture over a heterogeneous network.

For the 8K broadcasting service, the content server (content provider) 100 first acquires the 8K content and extracts it by media type (video and audio).

The extracted 8K video stream is divided into four areas (Area1, Area2, Area3, Area4) as shown in Fig. The divided 4K videos are treated as independent assertions, which are media data with unique identifiers. Then, each 4K stream is encoded into SHVC to generate three layers L0, L1 and L2. Thus, the original 8K video is composed of 12 (= 4 * 3) layers, that is, 12 assets. The audio stream is encoded by AAC.

MMT signal / MMTP generator 210 receives 1) an encoded stream of audio, L0 and L1, 2) encapsulates each stream into MPUs, 3) generates a signal message containing the service and each piece of media information And 4) generates two MMTP streams. The main stream has audio, L0 and signal messages, and the second stream has packets for L1.

The signal generator 220 generates a broadcast signal from an MMTP stream received from the MMT signal / MMTP generator 210 according to a broadcasting standard such as ATSC 3.0, DVB-T2, and the like.

The HTTP service generator 310 generates an MXD for the L2, and stores the document and the L2 stream in the HTTP streaming server 320. The HTTP streaming server 320 provides the streaming service for the L2 through the broadband network at the request of the receiving end.

The 8K broadcast system shown in FIG. 4 performs the above-described signal message scheduling method, the encapsulation method for random access, and the synchronization method.

The user can watch the content according to the performance of the decoder that decodes the broadcast signal received from the receiver 400 to generate content and the display 500 that displays the generated content. For example, a 2K-resolution TV must receive L0 data of each area through a broadcast network.

In addition, a user having an 8K-resolution TV connected to a broadcasting network and a broadband network can view 8K contents. The L2 data for the four areas are transmitted through the broadband network, and the remaining data is transmitted through the broadcast network.

6 is a diagram illustrating a UHDTV service scenario according to a change in network environment. As shown in FIG. 6, the 8K content starts at "t2" when data of all layers is received over the heterogeneous network. On the other hand, if the L2 data of an arbitrary area is not received or is broken due to the fluctuating bit rate at tn, the content is changed to a lower resolution.

In the 8K broadcasting system, the transmitting end must inform the receiving end that each divided area belongs to one piece of content. This is because one piece of content is transmitted in several parts.

In addition, since a plurality of divided areas must be merged into one content, a service delay may occur. Therefore, a content synchronization method is needed to reduce the delay.

To this end, the MMT signal / MMTP generator 210 generates an MPU by encapsulating regionally / hierarchically divided video and audio, generates CI and HTML5, generates a signal message, and then generates an MMTP stream.

The CI document is defined by an XML schema and includes several elements that refer to the elements defined in the HTML5 document with IDs as shown in Fig.

The 'view' element provides time information about the changes in the view and its regions, and the 'MediaSync' element provides time information about the representation of the media data. In addition, a 'group' element is added that provides information about the assets that should be displayed together. Here, each 'div' contains a set of assets in the same layer (L0, L1 and L2).

The signal message carries the multimedia structure, MMTP configuration information, and MMT payload format information transmitted from the MMTP stream.

Five types of signal messages, such as PA (Packet Access) message, MPI (Media Presentation Information) message, MPT (MMT Package Table) message, CRI (Clock Relation Information) message and DCI Is defined in the MMT standard.

Each signal message has one or more tables. One of them, the MP table, contains information about the package that contains a list of all assets. Because all the layered video streams that are divided are considered as assets, there must be information about the relationship between the assets.

The group includes the assets of the respective regions constituting the same layer. Since the number of regions is four, there are four assets in one group and three in the hierarchy, so there are three groups in one package.

In the embodiment of the present invention, 'Group_descriptor ()' is added to the MP table of the MPI message as shown in FIG. 8 to provide the above information. The value of 'num_of_groups' means the number of groups included in this package.

Information on each group is obtained by 'Group_descriptor ()', and the syntax of Group_descriptor () is shown in FIG.

MPU and signal messages are loaded into MMT packets for transmission over heterogeneous networks. The MMT signal / MMTP generator 210 sets the value of each field of the MMTP header according to the media type and schedules the order in which each packet is transmitted.

The receiving end can know what type of data is included in the MMTP payload according to the 'type' value of the MMTP header. To do this, it is possible to first find the packets of the signal message packet, parse each signal table, and obtain the 'packet_id' value for each asset.

Although the MPU can be obtained through 'packet_id', the receiving end can not know whether the MPU is for video or audio. Also, in the case of video, it is not known what layer and area it is.

If the receiver can obtain this information before fully parsing the MMTP header, it can reduce the time it takes to decode the video stream. Accordingly, in the embodiment of the present invention, a rule for generating the 'packet_id' field value of the MMTP header is presented in order to quickly classify a packet received at the receiving end.

FIG. 10 shows the structure of the packet_id, and FIG. 11 shows details of the information constituting the packet_id. As shown, the length of the packet_id is 2 bytes.

The first bit is a video indicator (v_i) indicating whether the packet containing the packet_id field is video. If v_i is set to '0', it indicates that the packet contains data other than video. If v_i is set to '1', it means that the packet contains video data.

The remainder of the packet_id is divided into three parts: layer information (layer_info), area information (area info.), and id information (id info.).

The layer information includes information about the layer to which the video belongs. The video data transmitted through the broadcast network is L0 or L1. As shown in FIG. 11, if the layer information is set to '0', the video packet is a video packet for L0, and if the layer information is set to '1', the video packet is a video packet for L1.

'Area information' means a region of video data, that is, a position on the screen (see FIG. 5). As shown in FIG. 11, when the area information is set to '00', the video packet is a video packet for Area 1, and when the area information is set to '01', the video packet is a video packet for Area 2, If the information is set to '10', the video packet is a video packet for Area 3, and if the area information is set to '11', the video packet is a video packet for Area 4.

In FIG. 12, the value of 'packet_id' and the description thereof are shown in the table.

Another way to reduce broadcast service delay is scheduling. If the area data is not received or the order between the area data is not received, a delay occurs. Accordingly, in the embodiment of the present invention, the receiving end can not decode the data of the area-2 if the data of the area-1 does not arrive, and can decode the data of the area-3 if the data of the area- I have no policy. Area data must arrive in area-number order.

To this end, the MMT signal / MMTP generator 210 schedules the MMTP packet according to the area information as shown in FIG. 13, when the MPU is generated as an MMTP packet, the MMT signal / MMTP generator 210 generates a packet including data of the same layers in each area as shown in the right side of FIG. 13 Lt; RTI ID = 0.0 > area-number < / RTI >

Hereinafter, the detailed structure and operation of the receiver 400 shown in FIG. 4 will be described in detail with reference to FIG. FIG. 14 is a detailed block diagram of a receiver 400. FIG.

The receiver 400 includes a packet receiver 410, a media consumption entity (MCE) 420, and a player 430, as shown in FIG.

The packet receiver 410 includes a MMTP receiver 411 and an HTTP receiver 412. The MMTP receiver 411 and the HTTP receiver 412 receive the broadcast stream from the 8K broadcast transmission system.

The MMTP receiver 411 receives MMTP packets encoded with audio, L0, L1, and a signal message from the MMTP server 200.

The HTTP receiver 412 receives L2 encoded HTTP packets from the HTTP server 300. The HTTP receiver 412 divides the received video data into areas and transmits the separated video data to the MCE 420.

The MMTP server 200 refers to the MMT signal / MMTP generator 210 and the signal generator 220 shown in FIG. 4 and the HTTP server 300 refers to the HTTP service generator 310 and the HTTP streaming server 300 shown in FIG. (320).

The MCE 420 is configured to process the packets received through the MMTP receiver 411 and the HTTP receiver 412 so that they can be used for media playback. The MCE 420 includes an MMTP parser 421 An MPU Re-constructor 422, a Signaling Message Manager 423, and a Media Processor 424. The MPU re-

The MMTP parser 421 classifies the payload of the MMTP packet into media and signal messages by analyzing the header of the MMTP packet received through the MMTP receiver 411. The MMTP parser 421 transfers the media to the MPU reconfigurer 422, To the signal message manager 423.

In the case of video, the MMTP parser 421 divides the data into the areas (Area 1, Area 2, Area 3, Area 4) and transmits them to the MPU reconstructor 422. The MPU reconstructor 422 reconstructs / restores the MPUs by integrating the input video data classified into the areas and by layer.

The signal message manager 423 extracts media information required for media playback from the signal message and transmits the extracted media information to the media processor 424 and transmits information such as HTML5 and CI to the UI manager 433 of the player 430. [

15 is a diagram showing the detailed structure of the media processor 424 shown in FIG. The media processor 424 includes buffer managers 424-1, 424-2, 424-3, and 424-4 and a presentation manager 424-5, as shown in FIG. 15 .

The buffer manager -1 424-1 includes an audio buffer and video buffers (E # 1 Layer Buffer, E # 2 Layer A Video Aggregator and a Broadband Manager that integrate buffered layered video into video buffers to generate Area 1 (Area 1).

The video integrator does not integrate buffered layered video data into the video buffers in the following cases:

First, after the start of broadcast reception, layered video data buffered in the video buffers before the intra-picture is received for the first time can not be decoded.

Second, if the frame indices of the hierarchical videos buffered in the video buffers are not the same, they are discarded without being integrated. More specifically, enhancement layers whose frame index is faster than the base layer are discarded.

The broadband manager determines whether to use video in the L2 layer based on the network conditions and the resolution of the display (500). When the use is determined, the broadband manager requests the HTTP server 300 to buffer the video data for the area 1 (Area 1) of the received video data of the L2 layer in the video buffer (E # 2) of the L2 layer.

The buffer manager -2 424-2 includes video buffers in which video for region 2 is buffered by hierarchical layers, video for generating region 2 (Area2) by integrating video for each layer buffered in video buffers, Integrators and broadband administrators.

The buffer manager-3 424-3 includes video buffers in which video for area 3 (Area 3) is buffered by being hierarchically layered, videos for generating video in areas 3 (Area 3) by integrating video for each layer buffered in video buffers Integrators and broadband administrators.

The buffer manager-4 424-4 includes video buffers in which video for region 4 is buffered by hierarchical layers, video for generating regions 4 (Area 4) by integrating video for each layer buffered in video buffers, Integrators and broadband administrators.

The buffer managers -2, 3, and 4 (424-2, 3, 4) are different from the buffer manager-1 424-1 in that there is no audio buffer and the video buffers, the video integrator and the broadband manager The function is the same as the buffer manager-1 424-1.

The presentation manager 424-5 is responsible for group management for the video areas (Area1, Area2, Area3, Area4) delivered from the buffer managers 424-1, 424-2, 424-3, Performs media synchronization of the audio transmitted from the buffer manager -1 424-1, and transmits it to the player 430. [

The group management is a procedure for checking whether the DCI resolution / time information (timestamp) of the region 1, which is the reference region received with the audio, and the DCI resolution / time information of the regions 2, If they do not match, discard video areas.

Media synchronization is a procedure for synchronizing audio and video based on audio time information.

Referring again to FIG.

The audio decoder 432 of the player 430 decodes the audio delivered from the presentation manager 424-5 of the media processor 424 and delivers it to the display 500 which displays it via the speaker .

The video decoder 431 decodes the video areas (Area1, Area2, Area3, Area4) transmitted from the presentation manager 424-5, respectively. The decoded areas are synthesized into one screen based on the area information and displayed on the display 500.

It goes without saying that the technical idea of the present invention can also be applied to a computer-readable recording medium having a computer program for performing the functions of the apparatus and method according to the present embodiment. In addition, the technical idea according to various embodiments of the present invention may be embodied in computer-readable code form recorded on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can be read by a computer and can store data. For example, the computer-readable recording medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical disk, a hard disk drive, or the like. In addition, the computer readable code or program stored in the computer readable recording medium may be transmitted through a network connected between the computers.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

100: Content server (content provider)
200: MMTP server
210: MMT signal / MMTP generator 210
220: Signal generator
300: HTTP server
310: HTTP Service Generator
320: HTTP streaming server
400: receiver
410: Packet Receiver
411: MMTP Receiver (MMTP Receiver)
412: HTTP Receiver
420: Media Consumption Entity (MCE)
421: MMTP Parser (MMTP Parser)
422: MPU Re-constructor
423: Signaling Message Manager
424: Media Processor
430: Player (Player)
431: Video decoder
432: Audio decoder
433: UI Manager
500: Display

Claims (15)

A receiver for receiving the media including the hierarchically encoded video segmented by region;
A Media Consumption Entity (MCE) that separates video from the media received by the receiver into areas and reconstructs them by layer; And
And a player for playing the media including the reconstructed video in the MCE,
The MCE,
A parser for classifying signal messages and media in broadcast packets received by the receiver and dividing the videos in the media into zones;
A manager that receives a signal message from the parser and extracts media information necessary for media playback;
A reconfigurable unit that reconstructs the regions classified by the parser by hierarchical integration; And
And a media processor for referring to the media information extracted by the manager and processing the media to be reproducible and delivering the media to the player,
The media processor,
Buffer managers for each region to buffer the video for each region and to create each region by combining buffered video for each layer; And
Managing the video areas transferred from the buffer managers to be reproducible, and performing media synchronization of video and audio, and delivering them to a player,
The buffer managers,
If the frame indices of the buffered layered videos are not the same, discard them without consolidation,
And discards videos of enhancement layers whose frame indexes are faster than that of the base layer.
delete delete The method according to claim 1,
The buffer managers,
Wherein the MMT-based broadcast receiving apparatus discards the buffered layer-by-layer video before the intra-picture is first received after the start of broadcast reception.
delete delete A receiver for receiving the media including the hierarchically encoded video segmented by region;
A Media Consumption Entity (MCE) that separates video from the media received by the receiver into areas and reconstructs them by layer; And
And a player for playing the media including the reconstructed video in the MCE,
The MCE,
A parser for classifying signal messages and media in broadcast packets received by the receiver and dividing the videos in the media into zones;
A manager that receives a signal message from the parser and extracts media information necessary for media playback;
A reconfigurable unit that reconstructs the regions classified by the parser by hierarchical integration; And
And a media processor for referring to the media information extracted by the manager and processing the media to be reproducible and delivering the media to the player,
The media processor,
Buffer managers for each region to buffer the video for each region and to create each region by combining buffered video for each layer; And
Managing the video areas transferred from the buffer managers to be reproducible, and performing media synchronization of video and audio, and delivering them to a player,
The presentation manager,
Wherein the video regions are discarded if the resolution and time information of the reference region and the resolution and time information of the other regions do not match among the video regions transmitted from the buffer managers.
The method of claim 7,
The reference area,
Wherein the audio signal is an area of video received together with audio.
The method of claim 8,
One of the buffer managers,
And buffering the audio included in the media.
The method according to claim 1,
The receiver,
A first receiver for receiving packets encoded with audio, some layers of video and signal messages in an MMTP (MMT Protocol); And
And a second receiver for receiving packets encoded with video of the remaining layers by HTTP.
The method according to claim 1,
Wherein the header of the broadcast packet includes information indicating whether the payload data is video data, a packet ID including information on the layer in the case of video data, and a packet ID including information on the area. .
The method according to claim 1,
The content is 8K video,
And the divided areas are 4K video sizes.
The method comprising: receiving media comprising video segmented by region and encoded hierarchically;
Dividing the video in the received media into regions and reconstructing the video by layer; And
And reproducing the media including the reconstructed video,
In the reconstruction step,
Classifying signal messages and media in broadcast packets received in the receiving step and dividing the videos in the media into areas;
A demultiplexer for extracting media information necessary for media reproduction using a signal message classified in the demarcation step;
A step of reconstructing the regions classified in the classification step by integrating them by hierarchy; And
And processing the media to be reproducible by referring to the media information extracted in the extracting step,
In the processing step,
The video management apparatus manages the video regions transmitted from the buffer managers to be reproducible by combining the video signals of the respective regions by using buffer managers for each region, Perform media synchronization of video and audio,
And discards videos of enhancement layers that are discarded without being integrated if the frame indexes of the buffered hierarchical videos are not identical, and whose frame index is faster than that of the base layer.
A content server for dividing a video into a plurality of regions and encoding each of the divided regions into a plurality of layers;
A first server for transmitting media including some layers of the encoded layers to a broadcast receiving apparatus;
And a second server for transmitting the media including the remaining layers of the encoded layers to the broadcast receiving apparatus,
The broadcast receiving apparatus includes:
Classifies signal messages and media in received broadcast packets, divides video in media by area, extracts media information necessary for media playback using a signal message, integrates and reorganizes divided areas by layer, A buffer for dividing a video for each region into a plurality of hierarchical levels using buffer managers for each region, integrating the buffered hierarchical videos to generate each region, managing video regions transferred from the buffer managers to be reproducible, And media synchronization of audio,
And discards videos of enhancement layers that are discarded without being integrated if the frame indexes of the buffered hierarchical videos are not the same, and whose frame index is faster than that of the base layer.
Dividing a video into a plurality of regions, and encoding each of the divided regions into a plurality of layers;
Transmitting media including some layers of the encoded layers to a broadcast receiving apparatus;
And transmitting the medium including the remaining layers of the encoded layers to the broadcast receiving apparatus,
The broadcast receiving apparatus includes:
Classifies signal messages and media in received broadcast packets, divides video in media by area, extracts media information necessary for media playback using a signal message, integrates and reorganizes divided areas by layer, A buffer for dividing a video for each region into a plurality of hierarchical levels using buffer managers for each region, integrating the buffered hierarchical videos to generate each region, managing video regions transferred from the buffer managers to be reproducible, And media synchronization of audio,
And discards videos of enhancement layers that are discarded without being integrated if the frame indexes of the buffered hierarchical videos are not the same, and of which the frame index is faster than that of the base layer.

Images