KR20170077907A - Apparatus and method for transmitting/receiving data in communication system - Google Patents

Apparatus and method for transmitting/receiving data in communication system Download PDF

Info

Publication number
KR20170077907A
KR20170077907A KR1020150187454A KR20150187454A KR20170077907A KR 20170077907 A KR20170077907 A KR 20170077907A KR 1020150187454 A KR1020150187454 A KR 1020150187454A KR 20150187454 A KR20150187454 A KR 20150187454A KR 20170077907 A KR20170077907 A KR 20170077907A
Authority
KR
South Korea
Prior art keywords
image
content
metadata
sub
video
Prior art date
Application number
KR1020150187454A
Other languages
Korean (ko)
Inventor
박상욱
박노삼
고은진
장종현
Original Assignee
한국전자통신연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국전자통신연구원 filed Critical 한국전자통신연구원
Priority to KR1020150187454A priority Critical patent/KR20170077907A/en
Publication of KR20170077907A publication Critical patent/KR20170077907A/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2351—Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving encryption of additional data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/25—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding with scene description coding, e.g. binary format for scenes [BIFS] compression
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H04N21/4353—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving decryption of additional data

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention relates to an apparatus and method for transmitting and receiving data by encoding and decoding data including video data and meta data for the video data in a broadcasting system, An analyzer for identifying an identifier and a position of the cameras with respect to the content image; A generating unit for generating sub-image information for the sub-image regions and additional information of the content image, as metadata, after detecting sub-image regions in the content image; An encoding unit encoding the content video and the metadata; And a transmission unit for transmitting the transport packet including the encoded content image and metadata.

Description

[0001] Apparatus and method for transmitting and receiving data in a communication system [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a communication system, and more particularly, to an apparatus and method for transmitting and receiving data by encoding and decoding data including metadata of video data and video data in a broadcasting system.

In recent years, the number of users of digital broadcasting services, which provide video contents through the emergence of various multimedia devices including smart phones and the activation of IPTV and personal broadcasting, is increasing. For example, users who use video contents such as sports broadcast broadcasts receive the contents of the game in real time and receive service in a particularly important period. However, in the current Best Effort internet environment, quality is not guaranteed for the loss of playback video, and various encoding / decoding methods have been proposed to solve this problem.

In the conventional encoding / decoding scheme, a variety of prediction modes are added in order to reduce the size of transmission data while maintaining the image quality at the time of decoding, and the size of a block for processing the reproduced image is expanded, There have been proposed methods for generating a stream by reducing the error value through motion compensation and automating real-time filtering for each image characteristic. However, the existing proposed coding / decoding scheme requires an additional time and resources due to increased complexity to satisfy the above-mentioned performance, and is an average scheme for applying to all general images.

Accordingly, a data transmission / reception scheme for encoding and decoding video contents by efficiently utilizing resources of a broadcasting system while minimizing an increase in the amount of computation of a transmission apparatus, for example, a broadcasting apparatus and a receiving apparatus, Is required.

Accordingly, it is an object of the present invention to provide an apparatus and a method for transmitting and receiving data in a communication system.

It is another object of the present invention to provide an apparatus and method for transmitting and receiving data by encoding and decoding data including video data and metadata for the video data in a broadcasting system in a communication system.

It is another object of the present invention to provide a communication system in which a broadcasting system encodes metadata including video data corresponding to video analysis of video data and data including the video data to stably provide data to a user And an apparatus and method for transmitting and receiving data.

It is another object of the present invention to provide a video communication system and a video communication method in which when a video system decodes image data in a communication system, the association between the received video data and the received metadata is stored, The present invention provides a data transmitting and receiving apparatus and method for recovering a reproduced image according to a loss, creating a substitute image by correlating a correlation with a stored bitstream, or providing storytelling information through metadata.

According to an aspect of the present invention, there is provided an apparatus for transmitting data in a communication system, the apparatus comprising: a content analyzing unit for analyzing a captured content image from a plurality of cameras, An analysis unit; A generating unit for generating sub-image information for the sub-image regions and additional information of the content image, as metadata, after detecting sub-image regions in the content image; An encoding unit encoding the content video and the metadata; And a transmission unit for transmitting the transport packet including the encoded content image and metadata.

According to another aspect of the present invention, there is provided an apparatus for receiving data in a communication system, the apparatus comprising: a content video packet for a content video; and metadata packets for each sub video region for the content video, A receiving unit for receiving the transmitted packet; A decoding unit decoding the content video included in the content video packet and the meta data included in the meta data packets; A storage unit for storing a content image corresponding to the metadata and the metadata; And a reconstruction unit for reconstructing the lost content image through a bitstream of the stored metadata and the content image, corresponding to the loss of the content image.

According to another aspect of the present invention, there is provided a method of receiving data in a communication system, the method comprising: receiving a content video packet for a content video and metadata packets for sub video regions for the content video, Receiving a transport packet; Decoding the content video included in the content video packet and the meta data included in the meta data packets; Storing the metadata and the content image corresponding to the metadata; And restoring the lost content image through a bitstream of the stored metadata and the content image, corresponding to loss of the content image.

In a communication system, a broadcasting system encodes and decodes video data and metadata including the metadata of the video data. In particular, metadata and metadata corresponding to video analysis of the video data and data And provides the data to the user stably even in the case of network transmission loss. Further, at the time of decoding the image data in the image system, the association relation with the received metadata together with the received image data is stored, , It is possible to restore the reproduced image according to the loss by analyzing the metadata or to create a substitute image by correlating the stored bit stream and provide storytelling information through the metadata, Can be provided.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 schematically illustrates the structure of a broadcast system in a communication system according to an embodiment of the present invention; FIG.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a broadcast system and a playback apparatus.
3 and 4 are views for explaining an example of metadata about a content image in a broadcasting system of a communication system according to an embodiment of the present invention.
5 is a diagram schematically illustrating the structure of transmission packets in a broadcasting system of a communication system according to an embodiment of the present invention.
6 is a view schematically showing an example of storage of a content image and metadata in a broadcasting system of a communication system according to an embodiment of the present invention.
7 is a view schematically illustrating a process of reproducing a content image in a broadcasting system of a communication system according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, only parts necessary for understanding the operation according to the present invention will be described, and the description of other parts will be omitted so as not to disturb the gist of the present invention.

The present invention proposes an apparatus and method for transmitting and receiving data in a communication system, for example, a broadcasting system. Here, in the embodiment of the present invention, in the broadcasting system, the image data corresponding to the image content photographed through the plurality of cameras and the data including the metadata for the image data are encoded and decoded to be more stable And a data transmitting and receiving apparatus for providing a high quality service, for example, a broadcasting and image service.

Further, in the embodiment of the present invention, in the communication system, the broadcasting system generates and processes the video data, that is, the generation of the video data packet and the metadata of the video data, that is, the generation of the metadata packet, The image data and the data including the meta data are encoded and decoded to be transmitted and received. Herein, in the embodiment of the present invention, a transmitting apparatus of a broadcasting system, for example, a broadcasting apparatus analyzes images photographed by a multi-camera, sets a sub video region of interest to users, And generates additional information on the photographed image as metadata and then transmits the metadata and the image data of the photographed image in combination with the recording information of the user of the photographed image, For example, a playback apparatus reproduces a content video of the received video data, and if it can not normally receive data necessary for decoding due to a transmission delay in the network of the broadcasting system during playback of the content video, Analyze metadata about the data, or visual content needed for playback. And to then retrieve the associated bit stream previously stored with the metadata prediction, decoding the received video data and reproduces the video content of the video data.

According to an embodiment of the present invention, in the communication system, the broadcasting system encodes and decodes the video data and the data including the metadata of the video data, in particular, the metadata corresponding to the video data analysis of the video data, The present invention relates to a method and apparatus for encoding data including data and providing data to a user stably even in a transmission loss in a network and at the time of decoding video data in a video system, After analyzing the metadata even in the transmission error situation in the network, the metadata is analyzed, and the reproduced content image corresponding to the transmission loss in the network is restored. Alternatively, the correlation content is correlated with the stored bitstream, Providing storytelling information through data Writing, and provide a high quality of service to users.

In addition, in the embodiment of the present invention, the broadcasting apparatus in the broadcasting system analyzes the content image at the time of encoding the video data, for example, at the time of encoding the broadcasting content, And transmits the transport packet including the layered and coded content image. The transport packet includes a transport stream, a transport stream, and a transport stream, A reproducing apparatus in a broadcasting system restores a lost transmission packet according to a network status of a broadcasting system and decodes the video data to reproduce the content video.

Here, in the conventional image encoding / decoding transmission system in the broadcasting system, a large butterfly effect occurs as an intra frame (hereinafter referred to as " I frame ") is lost and is transmitted after the I frame When the motion of a prediction frame (P frame) is compensated, the decoding performance of the P frame is significantly lowered due to the error due to the loss of the previous I frame, that is, the P The frame can not be normally decoded and the quality of the reproduced content image is deteriorated. That is, the decoding performance may be degraded for the I frame due to the loss of the I frame. However, in the embodiment of the present invention, for loss of the I frame, the metadata generated and transmitted by the broadcasting apparatus of the broadcasting system After confirming the conversion to the P frame based on the metadata after the playback apparatus receives the frame, and normally reproduces the content image using the frame of the reference image for motion compensation of the P frame, With respect to the P frame to be transmitted next to the I frame, the decoding performance is improved by using the previous I frame whose loss has been minimized through normal reproduction using the reference image as described above, so that the content image is normally reproduced .

Particularly, in the embodiment of the present invention, a bit stream and meta data of a representative content image corresponding to the reference image are stored, a bit stream and meta data corresponding to a loss of an I frame are retrieved during decoding of the video data, The content image for the I frame is restored and normally reproduced, that is, the lost content image is restored and normally reproduced, thereby providing the user with a content image of improved quality of service. In addition, in the embodiment of the present invention, in order to retransmit according to the network status of the broadcasting system, the broadcasting apparatus of the broadcasting system layer-encodes and transmits the content image, and the layer- When the reproduction apparatus decodes and reproduces a content image in accordance with the stored content, the error occurring at the time of restoring the P frame is retransmitted and rearranged to the previous I frame with the minimum loss as described above, Whereby a high-quality content image can be stably reproduced to the user. Hereinafter, the broadcasting system of the communication system according to the embodiment of the present invention will be described in more detail with reference to FIG.

1 is a diagram schematically showing a structure of a broadcasting system in a communication system according to an embodiment of the present invention.

Referring to FIG. 1, the broadcasting system includes a plurality of cameras 102, 104, and 106 for capturing an image and generating a content image, image data including a content image generated by the plurality of cameras 102, 104, and 106, And a broadcasting apparatus 110 for encoding the video data and the meta data and transmitting the transmission packet to the reproducing apparatus through the network 130 of the broadcasting system. Here, the broadcasting apparatus 110 may generate the transmission packet as the video data and the metadata as described above, and then transmit the transmission packet to the reproduction apparatus through the network 130 of the broadcasting system, Thereby providing a broadcast service to the user.

In addition, the broadcasting system may include additional information on the content image generated by the plurality of cameras 102, 104 and 106, for example, real-time information on the content image corresponding to the specific broadcasting service, that is, broadcasting relay information, And an image description device (112) for generating additional information on a content image including the content image and providing the additional information to the broadcasting device (110), wherein the broadcasting device (110) .

The broadcasting system receives broadcasting data transmitted by the broadcasting device 110 through the wired network device 132 in the network 130 and reproduces the content video of the video data included in the broadcasting data And receives broadcast data transmitted from the broadcast apparatus 110 through the broadcast network 140 and the broadcast network 140 in the network 130 and stores the received broadcast data in the broadcast data And a reproduction apparatus 2 (155) for reproducing a content image of the image data. Here, the playback apparatus 1 (150) may transmit a transport packet transmitted from the broadcast apparatus 110 through a wired network apparatus 132 in the network 130, for example, a public-wave broadcast, a cable broadcast, May be included in the receiver's multimedia system. The playback apparatus 1 155 may be included in the wireless broadcast system through wireless communication by the wireless network device 134 and the broadcast antenna 140 in the network 130, for example, 3G, LTE, DMB, For example, a smart phone.

Here, the broadcasting apparatus 110 of the broadcasting system is a transmitting apparatus that transmits data, and the reproducing apparatuses 150 and 155 of the broadcasting system become data receiving apparatuses that receive data transmitted from the transmitting apparatus, The broadcasting apparatus 110 and the reproducing apparatus 150 or 155 may store metadata of video data or a bitstream related to the metadata and may also request a bitstream related to the metadata and the metadata Device. Hereinafter, a broadcasting apparatus and a reproducing apparatus in a broadcasting system according to an embodiment of the present invention will be described in more detail with reference to FIG.

2 is a diagram schematically showing the structure of a broadcasting apparatus and a reproducing apparatus in a broadcasting system of a communication system according to an embodiment of the present invention.

Referring to FIG. 2, the broadcasting apparatus encodes meta data of a content image photographed by cameras and image data including the content image, and particularly generates metadata by analyzing a content image, Data and the image data, generates a transmission packet including the encoded image data and the metadata, and transmits the transmission packet to the reproduction apparatus. Then, the playback apparatus decodes the content video in the transport packet received from the broadcast apparatus, provides the content video, and provides the broadcast service to the user accordingly.

More specifically, the broadcasting apparatus includes a camera input unit 202 for receiving a content image from cameras, a camera ID input unit 202 for analyzing the content image input through the camera input unit 202, An input image analyzing unit 204 for confirming a position and an initial image of the contents, an image description input unit 208 for receiving additional information from the image description apparatus 112 of the broadcasting system, And a metadata generation unit 210 for generating metadata including sub-image information such as a range and an attribute for the sub-image region after a sub-image region is detected.

Here, the metadata generation unit 210 generates sub-image information such as a range and an attribute for a sub-image area in the content image and additional information about the content image as metadata, As described above, real-time information on a content video corresponding to a specific broadcast service, that is, broadcast relay information and broadcast caption information. The metadata generation unit 210 generates the metadata in the form of an extensible markup language (XML) document.

The broadcasting apparatus further includes an input image layering unit 206 for layering the sub video region detected from the content image, an image encoding unit 212 for encoding the layered content image, i.e., the image data and the metadata, And a content transmitter 214 for generating a transport packet including the encoded video data and metadata and transmitting the generated transport packet to the playback apparatus through the network of the broadcast system.

The reproducing apparatus 250 may further include a content receiving unit 256 receiving the transmission packet transmitted from the broadcasting apparatus, a video decoding unit 262 decoding the video data and the meta data included in the transmission packet, A metadata analysis unit 260 for analyzing the metadata provided by the broadcasting apparatus, and a received image storage unit 266 for storing the content image corresponding to the metadata. Here, the reproducing apparatus provides the decoded contents image by the image decoding unit 262 and provides the decoded contents image to the user, that is, provides the broadcasting service.

The playback apparatus includes a metadata request unit 254 for requesting retransmission of a content image lost during decoding in the video decryption unit 262, in particular, metadata corresponding to a content video image corresponding to a loss, And an image synchronization unit 258 for synchronizing a time difference between the metadata and the corresponding content image. In addition, a content image in which an error occurs according to a transmission loss in the network of the broadcasting system, A loss recovery unit 252 for recovering a content image stored in the storage unit 166 through a bit stream or the like, and a metadata output unit 264 for providing the user with additional information on the content image to be reproduced. Hereinafter, the metadata in the broadcasting system according to the embodiment of the present invention will be described in more detail with reference to FIG. 3 and FIG.

3 and 4 are views for explaining an example of metadata of a content image in a broadcasting system of a communication system according to an embodiment of the present invention.

3, the broadcasting apparatus receives the additional information 300 for the content image from the video description apparatus of the broadcasting system in a predetermined pattern, and transmits the additional information 300, Is included in the XML document type metadata 350 as described above.

For example, the video description device of the broadcasting system generates a broadcasting service provided in the broadcasting system, i.e., additional information 300 for the video contents in real time, and provides the broadcasting information to the broadcasting device, The converted metadata 350 is transmitted to the playback device together with the content video and is provided to the user in real time do. Here, the additional information 300 may include specific detailed description information on the content image, for example, pitching information in the baseball relay image, batting information, position information, And the like. In addition, the metadata 350 is generated in the form of an XML document as described above.

4, the broadcasting apparatus detects a plurality of sub video regions 410, 420, 430, 440, 450, and 460 in the content video in consideration of the degree of interest of users receiving a broadcasting service from the broadcasting system, Sub-image information such as ranges and attributes for the image areas 410, 420, 430, 440, 450, and 460 are generated as respective metadata 415, 425, 435, and 445. Here, when the input image analyzing unit 204 analyzes the content image and confirms the camera identifier and the initial position image of the content image, the broadcasting apparatus analyzes the content image, 420, 430, 450, and 460 corresponding to each camera with respect to each of the sub video regions 410, 420, 430, 450, 460, and then generates sub-image information such as a range and attributes for the sub video regions 410, In addition, each of the metadata 415, 425, 435, and 445 is generated as an XML document.

For example, to be more specific, the broadcasting apparatus detects a sub video region 1 410 existing in a predetermined position in the content video, and then detects a video object in the sub video region 1 410 And generates sub-image information in the sub-image region 1 410 as metadata 1 (415). For example, when the content image is a baseball relay image, the broadcast apparatus extracts the attribute of < strikes > from the yellow circle in the video object 1 of the sub image region 1 410, The red circle in the object 2 extracts the attribute of < outs > and the sub image information in the sub image region 1 410, i.e., the image objects 1 and 2 of the sub image region 1 410 And generates the sub-image information including the extracted attribute, e.g., Status, as metadata 1 (415). In the video object 3 of the sub video region 1 410, the electronic name is <away> team, the latter name is <home> team, the electronic number is <score away>, and the latter number is <score home <First>, <second> and <third> of <runner> are extracted through the <inning top / bottom> through the square of the diamond shape, Sub video information including the attributes extracted from the video object 3 of the sub video zone 1 410 as described above is divided into meta data 1 415 ).

In addition, after identifying each of the cameras that have photographed the content image, the broadcasting apparatus detects the sub-regions photographed by the cameras in the content image, that is, After detecting the sub video region 2 420, the sub video region 3 430, the sub video region 440, the sub video region 5 450 and the sub video region 660 corresponding to the detection The sub image information for one sub image area 2 420, the sub image area 3 430, the sub image area 4 440, the sub image area 5 450 and the sub image area 660 is converted into metadata 2 (425), metadata 3 (435), and metadata 4 (445). For example, if the content video is a baseball relay video, the broadcasting apparatus detects a pitcher video region in the content video in the sub video region 2 420, Detects a cooperative video region, detects a catcher video region in the content video in the sub video region 440, detects a main video region in the content video in the sub video region 450, And detects a typing image area in the content image by area 6 (460).

In addition, the broadcasting apparatus extracts attributes of video objects in the respective sub video regions 420, 430, 440, 450 and 460, and sub-video information in the respective sub video regions 420, 430, 430, 450 and 460 is converted into metadata 425, . For example, the broadcasting apparatus analyzes the positions, numbers, and directions of colors and images in the video objects of the sub video region 2 420 to extract attributes corresponding to the pitcher image regions, for example, uniform color, The number extracted from the video objects of the sub video region 2 420, and the attributes extracted from the video objects of the sub video region 2 420, as described above, To the metadata 2 (425). In addition, the broadcasting apparatus extracts the attributes such as the position and motion of the ball in the video objects of the sub-image region 3 (430), for example, extracts the attributes by analyzing the positional change and the locus with respect to the previous frame Sub-image information in the sub-image region 3 430, that is, sub-image information including the attributes extracted from the image objects of the sub-image region 3 430 as described above, 435). In addition, the broadcasting apparatus extracts the attributes such as the position and movement of the catcher from the video objects of the sub video region 4 (440), for example, extracts the attributes by analyzing the position, motion, color, Sub video information including the attributes extracted from the video objects of the sub video region 4 440 as described above is input to the metadata 4 (440) (445). Hereinafter, with reference to FIG. 5, transmission packets transmitted and received between the broadcasting apparatus and the reproducing apparatus in the broadcasting system of the communication system according to the embodiment of the present invention will be described in more detail.

5 is a diagram schematically showing a structure of a transmission packet in a broadcasting system of a communication system according to an embodiment of the present invention.

5, between the broadcasting apparatus and the reproducing apparatus in the broadcasting system, the video data including the content video and the metadata about the content video are included in the transmission packet, Lt; / RTI &gt;

More specifically, the broadcasting apparatus includes a payload including audio, video, and a program map for the content video, such as audio payload fields 504 and 516, A content video packet 500 including a video payload field 508, a program map field 512, and transport header fields 502, 506, 510, and 514, . The broadcasting apparatus packetizes the metadata of the content image and transmits the packet to the playback apparatus, that is, a transmission header field 522, a metadata field 524 indicating that the packet is a metadata packet, To the playback apparatus, a metadata packet 520 including a payload field 526 including specific information of the metadata.

In addition, as described above, the broadcasting apparatus generates sub-image information of the sub-image regions as metadata after detecting sub-image regions in the content image, and sub-image information of the sub-image regions is included And transmits the packetized metadata to the playback apparatus. For example, the broadcasting apparatus packetizes the meta data corresponding to the sub video region 1 in the content video, and transmits the meta data corresponding to the sub video region 1, that is, the transmission header field 532, To the playback apparatus, a sub-image area metadata packet 530 including a region 1 field 534, which is a region 1, and a payload field 536, which includes specific information of the metadata. Then, the broadcasting apparatus packetizes and transmits the metadata corresponding to the sub video region 2 in the content video, that is, the transmission header field 542, indicating that it is a packet of the metadata corresponding to the sub video region 2 To the playback apparatus, a sub-image area metadata packet 540 including a region 2 field 544 to which the metadata is to be recorded and a payload field 546 including specific information of the metadata. In addition, in order to search for metadata such as motion compensation of a P frame or the like and lost I frames at the time of loss of the frame of the content image, for example, I frame, In other words, a transmission header field 552, a background field 554 indicating that the packet is a packet of metadata corresponding to the background, and a payload field including specific information of the metadata, And transmits a background metadata packet 550 including a field 556 to the playback apparatus.

The broadcast apparatus and the playback apparatus may transmit the transport packet including the content video and the metadata of the content video, that is, the content video packet 500, the metadata packet 520, (530, 540), and a background metadata packet (550). In particular, in response to transmission loss in the network of the broadcasting system, the playback apparatus does not normally reproduce the content video from the transport packet, Or for reproduction of an alternative content image. Hereinafter, the storage of the content video and metadata in the broadcasting system of the communication system according to the embodiment of the present invention will be described in more detail with reference to FIG.

6 is a diagram schematically illustrating an example of storing a content image and metadata in a broadcasting system of a communication system according to an embodiment of the present invention.

6, the broadcasting apparatus and the reproducing apparatus of the broadcasting system store the bitstream of the content image and the metadata of the content image, and store the bitstream of the stored content image and the metadata of the content image For example, when a transmission loss occurs in the network of the broadcasting system as described above, it is possible to reconstruct a playback content image according to a transmission loss in the network, to infer a correlation with a stored bitstream, , Or metadata to provide storytelling information to provide a higher quality of service to the user. Here, the broadcast apparatus and the playback apparatus of the broadcasting system may include a representative transport packet 600 including a bitstream of the stored content image and metadata of the content image, and a bitstream of the representative content image of the lost content image and metadata ).

In other words, when the loss of the video data is confirmed due to a transmission loss in the network of the broadcasting system while the video data is being decoded from the transmission packet received from the broadcasting apparatus, It is necessary to confirm the representative transmission packet 600, that is, to confirm the bitstream and metadata of the representative content image with respect to the lost content image, and then transmit the sub-image corresponding to each camera included in the meta data Extracts a bitstream of the content image corresponding to the sub-image information from the bitstream of the representative content image, generates a replacement content image for the lost content image through the bitstream, do.

Here, the broadcasting apparatus and the reproducing apparatus store the representative transmission packet 600 including the bitstream and the metadata of the synchronized representative content image after time synchronization between the bitstream and the meta data of the representative content image . At this time, the representative transmission packet 600 includes a camera identifier field 602 indicating each camera for the representative content image, metadata of sub video regions detected in the representative content image, that is, sub- The sub image information 1 field 604 of the sub image area 1, the sub image information 2 field 606 of the sub image area 2, the sub image information 3 field 608 of the sub image area 3, A video information 4 field 610, a sub video information 5 field 612 of the sub video area 5, and a bit stream field 614 for the representative content video. Hereinafter, the content video reproduction operation in the broadcasting system of the communication system according to the embodiment of the present invention will be described in more detail with reference to FIG.

7 is a diagram schematically illustrating a process of reproducing a content image in a broadcasting system of a communication system according to an embodiment of the present invention.

Referring to FIG. 7, in step 702, the playback apparatus of the broadcast system receives a transport packet from the broadcast apparatus. In step 704, the playback apparatus identifies information included in the header field of the transport packet, Of the previous content frame is a new I frame.

If it is determined in step 704 that the current frame is an I frame, in step 714, a content image restoration is performed for each block using the I frame decoding method of the playback apparatus. If it is determined in step 704 that the frame is a P frame, in step 706, a content image restoration is performed for each block using a P frame decoding method of the playback apparatus.

In step 708 and step 716, an error rate of a transmission packet is compared with a predetermined threshold according to a transmission loss in the network of the broadcasting system. In step 718, The camera identifier of the current content video is checked between the camera identifiers of the previous content video.

If it is determined in step 718 that the camera identifiers are the same, in step 728, the current content image is similar to the previous content image, and may be a P frame capable of motion compensation. However, The metadata of the packet is confirmed, and the I frame of the lost content image is restored to the P frame. If it is determined in step 718 that the camera identifiers are different, in step 720, it is confirmed that the I frame of the new content image is received, and the sub-image information of the stored metadata is confirmed, A bitstream corresponding to the identified sub-image information is searched in the bitstream, and an alternative content image is generated for the frame block portions of the lost content image.

In step 708, the motion compensation information according to the loss of the motion compensation information is compared with a predetermined threshold value in accordance with the restoration of the content image for each block using the P frame decoding method. In step 710, To be transmitted through the network of the broadcasting system.

Since the network of the broadcasting system can easily establish and change a wired / wireless transmission network, it is possible to transmit and store the layered content image of the playback apparatus, that is, as a result of the check in step 710, In step 712, a retransmission of the bitstream and the meta data for the content video in which the loss occurs is requested through the network of the broadcasting system. At this time, only the bit stream of the content image is requested and received, and not the motion compensation information, it is restored to the I frame and the content image is more accurately restored than the replacement with the reference image.

If it is determined in step 710 that transmission is not possible, for example, connection to the premium network through which the layered content image of the playback apparatus is transmitted is not possible, the operation proceeds to step 720.

If it is determined in step 724 that the restored content image corresponds to the broadcast service, the restored content image is restored to the user in step 724. If the restored content image corresponds to the broadcast service requested by the user in step 724, If it is determined in step 724 that the restored content image does not correspond to the broadcast service, the sub image information of the metadata about the content image is further reproduced and provided to the user in step 724 .

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention. Therefore, the scope of the present invention should not be limited by the described embodiments, but should be determined by the scope of the appended claims, as well as the appended claims.

Claims (17)

An apparatus for transmitting data in a communication system,
An analyzing unit analyzing a content image photographed by cameras and confirming an identifier and a position of the cameras with respect to the content image;
A generating unit for generating sub-image information for the sub-image regions and additional information of the content image, as metadata, after detecting sub-image regions in the content image;
An encoding unit encoding the content video and the metadata; And
And a transmission unit configured to transmit the transport packet including the encoded content image and the metadata.
The method according to claim 1,
Wherein the generation unit detects the sub image areas for each camera in the content image and then generates the sub image information including the range and attributes for the sub image areas as the metadata .
3. The method of claim 2,
Wherein the generation unit detects the sub image areas for each of the cameras in accordance with an identifier and an initial image of the cameras for the content image.
3. The method of claim 2,
Wherein the generation unit extracts attributes of the video objects in the sub video regions, and then generates the sub video information including the extracted attributes as the metadata.
The method according to claim 1,
Wherein the generator generates sub-image information corresponding to each of the sub-image areas as metadata for each of the sub-image areas.
6. The method of claim 5,
Wherein the transmission unit transmits the content video packet for the content video and the metadata packets for the metadata for each sub video area in the transport packet.
The method according to claim 1,
Further comprising a layering unit for layering the sub image areas with respect to the content image;
Wherein the encoding unit encodes the content image layered with the sub video regions.
The method according to claim 1,
Wherein the generating unit generates the metadata in an extensible markup language (XML) document format.
An apparatus for receiving data in a communication system,
A receiving unit for receiving a transport packet including a content video packet for a content video and metadata packets for each sub video region for the content video;
A decoding unit decoding the content video included in the content video packet and the meta data included in the meta data packets;
A storage unit for storing a content image corresponding to the metadata and the metadata; And
And a decompression unit for decompressing the lost content image through the bitstream of the stored metadata and the content image in accordance with the loss of the content image.
10. The method of claim 9,
Wherein the decompression unit verifies the bitstream and the metadata of the representative image content for the lost content image in the bitstream of the stored metadata and the content image.
11. The method of claim 10,
Wherein the restoration unit searches the bitstream of the content image corresponding to the identified sub-image information in the bitstream of the representative content image after checking the sub-image information of the sub-image regions included in the checked metadata, Data receiving apparatus.
12. The method of claim 11,
Wherein the restoration unit generates an alternative content image for the lost content image through the searched bitstream.
10. The method of claim 9,
Further comprising: a request unit for requesting retransmission of the metadata for the lost content image;
Wherein the restoration unit restores the lost content image through the retransmitted meta data.
10. The method of claim 9,
Wherein the storage unit stores the metadata and the time information of the content corresponding to the metadata in synchronization with each other.
A method for receiving data in a communication system,
Receiving a transport packet including a content video packet for a content video and metadata packets for each sub video region for the content video;
Decoding the content video included in the content video packet and the meta data included in the meta data packets;
Storing the metadata and the content image corresponding to the metadata; And
And reconstructing the lost content image through a bitstream of the stored metadata and the content image corresponding to the loss of the content image.
16. The method of claim 15,
Wherein,
Identifying a bitstream and metadata of the representative image content for the lost content image in the bitstream of the stored metadata and the content image;
Searching for a bitstream of the content image corresponding to the identified sub-image information in the bitstream of the representative content image after confirming the sub-image information of the sub-image regions included in the checked metadata; And
And generating an alternative content image for the lost content image through the retrieved bitstream. 16. The method of claim 15,
Requesting retransmission of the metadata for the lost content image;
Wherein the restoring step restores the lost content image through the retransmitted meta data.
KR1020150187454A 2015-12-28 2015-12-28 Apparatus and method for transmitting/receiving data in communication system KR20170077907A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150187454A KR20170077907A (en) 2015-12-28 2015-12-28 Apparatus and method for transmitting/receiving data in communication system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150187454A KR20170077907A (en) 2015-12-28 2015-12-28 Apparatus and method for transmitting/receiving data in communication system

Publications (1)

Publication Number Publication Date
KR20170077907A true KR20170077907A (en) 2017-07-07

Family

ID=59353694

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150187454A KR20170077907A (en) 2015-12-28 2015-12-28 Apparatus and method for transmitting/receiving data in communication system

Country Status (1)

Country Link
KR (1) KR20170077907A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210067065A (en) 2019-11-29 2021-06-08 (주)진명아이앤씨 Transmitting system for image data and meta data using single packet

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210067065A (en) 2019-11-29 2021-06-08 (주)진명아이앤씨 Transmitting system for image data and meta data using single packet

Similar Documents

Publication Publication Date Title
CN107113460B (en) Session description information for over-the-air broadcast media data
US10841350B2 (en) Reception device, reception method, transmission device, and transmission method
KR101691050B1 (en) Method for delivery of digital linear tv programming using scalable video coding
JP6193993B2 (en) Digital service signal processing method and apparatus
US20100238792A1 (en) Information acquisition system, transmit apparatus, data obtaining apparatus, transmission method, and data obtaining method
CN104081785A (en) Streaming of multimedia data from multiple sources
KR102332387B1 (en) Reception device, reception method, transmission device, and transmission method
JP2012505569A (en) Multi-view media data
US11871087B2 (en) Receiver, reception method, transmitter, and transmission method
JP6294503B2 (en) Broadcast signal transmitting apparatus, broadcast signal receiving apparatus, broadcast signal transmitting method, and broadcast signal receiving method
CN105744382A (en) Video switching for streaming video data
KR100606785B1 (en) Synchronization method of video and iamge data in system for providing remote multimedia service through network
US20080198922A1 (en) Systems and Methods For Video Quality Measurement Using Auxiliary Information of Codec
CN112565224B (en) Video processing method and device
CN103081488A (en) Signaling video samples for trick mode video representations
KR20170138994A (en) Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method, and broadcast signal reception method
US20160134672A1 (en) Delivering partially received segments of streamed media data
KR102518817B1 (en) Broadcast signal transmission apparatus, broadcast signal reception apparatus, broadcast signal transmission method, and broadcast signal reception method
CN105430510A (en) Video on demand method, gateway, smart terminal and video on demand system
US11552720B2 (en) Reception apparatus, transmission apparatus, and data processing method
KR101420099B1 (en) Method and apparatus for reproducing broadcasting content and method and apparatus for providing broadcasting content
US20180220172A1 (en) Broadcast signal transmitting device, broadcast signal receiving device, broadcast signal transmitting method and broadcast signal receiving method
KR102384709B1 (en) Reception apparatus, reception method, transmission apparatus, and transmission method
KR20170077907A (en) Apparatus and method for transmitting/receiving data in communication system
CA3071560C (en) Transmission apparatus, transmission method, reception apparatus, and reception method