KR20170009106A - Content Delivery Method and Apparatus Using a Plurality of Communication Network - Google Patents

Abstract

The present invention relates to a method and apparatus for transmitting content data separated through a plurality of communication networks. More particularly, the present invention relates to a method and apparatus for separating content data into image data and sound data, packetizing each data, and transmitting the packet data to a content reproduction apparatus through different communication networks, allowing the content reproduction apparatus to check whether received sound packets and image packets compose the same contents. If the packets compose the same contents, the sound packets are combined with the image packets. So, it is possible to provide more realistic live broadcasting in an effective moving picture content streaming service, for example, sports broadcasting, by efficiently using a plurality of communication networks.

Description

TECHNICAL FIELD The present invention relates to a content delivery method and apparatus using a plurality of communication networks,

The present invention relates to a method and an apparatus for transmitting content through a plurality of communication networks, and more particularly, to a method and apparatus for transmitting content through a plurality of communication networks, The present invention relates to a method and an apparatus for verifying whether a voice packet and a video packet received by a device constitute the same content and combining the voice packet and the video packet by constructing the same content.

The contents described in this section merely provide background information on the present embodiment and do not constitute the prior art.

Recently, various video services have appeared in the Internet environment, and demand for high definition live broadcasting is increasing. In addition, in recent years, attempts have been made to provide various video services according to a streaming service method.

A streaming service means transmitting content such as video or audio from a server to a terminal over a network such as the Internet. The transmitted data is called streaming if it is treated as though water is flowing. The server divides the video into packets so that it can be sent to the network, and the terminal collects the packets and restores them to their original form and plays back the packets. At this time, playback and packet reception occur at the same time, a series of related packets is called a stream, and a set of packets is called streaming data.

In addition, MPEG-2 TS (Transport System) has been used for media transmission in various industrial fields such as terrestrial and satellite digital broadcasting, DMB, and IPTV since standardization. Recently, media storage in digital video camera or Blu- And its use is expanding. However, the recent network environment is rapidly changing, and new requirements such as multimedia transmission technology in various heterogeneous network environments are required. Accordingly, a new technology standard for providing various contents and services in various sophisticated network environments is required, and thus MMT (MPEG Media Transport) technology is being developed.

 However, in the current content service such as the above-mentioned live polarized broadcasting, a single MMT file is created by multiplexing the audio data to the video data, There is a problem that a break phenomenon occurs.

Also, since the wireless terminal transmits / receives all data through only one of a wireless communication network (e.g., 3G or LTE network) or a Wi-Fi network according to the user's setting or the surrounding communication environment, it is difficult to efficiently transmit / receive data .

Korean Patent No. 10-0441500, Disclosure Date Aug. 13, 2002 (Name: Multi-party video conference method in video conference system)

The present invention separates content data and transmits the content data through a plurality of communication networks, so that even if a transmission delay occurs in a specific communication network, any one of video data or voice data transmitted through another communication network is delivered without delay, And thus, a method for efficiently transmitting and receiving data is proposed.

In particular, video data is divided into voice data and video data and packetized. Data having a relatively small amount of data is transmitted through a Wi-Fi network. Data having a relatively large amount of data is transmitted through an LTE network, And a method and an apparatus for a terminal device which receives voice data and video data through a communication network, respectively, to output the content by combining the voice data and the video data.

However, the object of the present invention is not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood from the following description.

According to another aspect of the present invention, there is provided a content transmission server including a first communication interface for transmitting / receiving data to / from a content reproduction apparatus via a first communication network, and a second communication interface for transmitting / receiving data with the content reproduction apparatus through the second communication network. 2 communication interface and the content data into video data and audio data and packetizes them to transmit one of the voice packet and the video packet to the content reproduction apparatus via the first communication network and transmit the other packet to the second And a control module for controlling the communication module to transmit the content to the content reproduction apparatus via a communication network.

In this case, the video packet and the voice packet to be packetized by the control module are MMT (MPEG Media Transport) packets, and the video data and audio data are transmitted to the MFU (Media A MFU, or an MPU (Media Processing Unit) including at least one MFU, and the MFU or MPU may include an asset ID and time information corresponding to image data or voice data, The control module may receive the MMT packet in which the content data is mixed with the video data and the audio data, and may separate the video data and the audio data from the MMT packet based on the asset ID.

The control module may adjust a data rate of the video packet and the voice packet transmitted through the first communication network and the second communication network according to the types of the first communication network and the second communication network, 1 communication network or a second communication network is a wireless communication network, the size of a packet transmitted through the wireless communication network can be reduced by a preset capacity.

According to an aspect of the present invention, there is provided a content reproduction apparatus including a first communication interface for transmitting / receiving data to / from a content transmission server through a first communication network, and a second communication interface for transmitting / When receiving the video packet and the voice packet from the communication module including the communication interface and the content transmission server through different communication networks, the video data and the voice data included in the voice packet are data constituting the same contents And a control module for combining and reproducing the video data and the audio data in the case of data constituting the same contents.

In this case, the voice packet and the video packet are MMT (MPEG Media Transport) packets, and the video data and audio data are divided into a media fragment unit (MFU), which is the minimum decoding unit included in the payload of the MMT packet, And the MFU or MPU may include an asset ID and time information corresponding to the image data or voice data, and the control module may transmit the asset ID It is possible to confirm whether the video data and the audio data constitute the same contents based on the time information and to combine the data through time synchronization between the video data based on the time information and the audio data.

According to another aspect of the present invention, there is provided a method of transmitting data, the method including separating content data into video data and audio data, and separating the separated video data and audio data into packetized And transmitting the packetized video packet or the voice packet to the content reproduction apparatus through the first communication network and transmitting the other packet to the content reproduction apparatus through the second communication network.

In this case, the video packet and the audio packet are MMT (MPEG Media Transport) packets, and the video data and audio data are divided into an MFU (Media Fragment Unit) which is the minimum decoding unit included in the payload of the MMT packet, And an MFU (Media Processing Unit) including an MFU of the MFU or MPU. The MFU or MPU may include an asset ID and time information corresponding to image data or voice data.

The separating may include receiving an MMT packet in which the content data is mixed with video data and audio data, and separating video data and audio data from the input MMT packet based on the asset ID .

The transmitting step may adjust the data rate of the video packet and the voice packet transmitted through the first communication network and the second communication network according to the type of the first communication network and the second communication network.

According to another aspect of the present invention, there is provided a method of transmitting data, the method including receiving a video packet and a voice packet through different communication networks, Confirming whether data and audio data are data constituting the same contents, and reproducing the combined video data and audio data when composing the same contents.

In this case, the video packet and the audio packet are MMT (MPEG Media Transport) packets, and the video data and audio data are divided into an MFU (Media Fragment Unit) which is the minimum decoding unit included in the payload of the MMT packet, And an MPU (Media Processing Unit) including an MFU of the MFU or the MPU, wherein the MFU or MPU includes an asset ID and time information corresponding to image data or voice data.

Also, the step of verifying whether the same content includes the video data and the audio data is based on the asset ID, and the step of verifying whether the video data and the audio data constitute the same content is performed. Data can be combined through time synchronization between the video data based on the information and the audio data.

Further, the data transfer method may be provided in a computer-readable recording medium in which a program for executing the data is recorded, and may be provided in a computer program stored in a computer-readable recording medium so as to be implemented to execute the program.

In the present invention, video data and audio data included in moving picture contents are separated and transmitted through different communication networks, and a content reproduction apparatus that receives the transmitted data performs time synchronization to collect separately transmitted video data and audio data So that it is possible to efficiently provide streaming service of moving picture contents by efficiently using a plurality of communication networks.

Particularly, according to the present invention, video data and audio data included in moving picture contents are separately transmitted through different communication networks, so that even if a transmission delay occurs in a specific communication network, any one of video data or voice data can be transmitted without delay And it is possible to provide continuous service without stopping the service through the transmitted image data or voice data.

In addition, various effects other than the above-described effects can be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

FIG. 1 is a block diagram of a system for transmitting content data separated through a plurality of communication networks according to an embodiment of the present invention. Referring to FIG.
2 is a block diagram showing a configuration of a content transmission server according to the present invention.
3 is an exemplary diagram illustrating an MMT packet structure according to an embodiment of the present invention.
FIG. 4 is a diagram for explaining an embodiment of a process of separating content data and packetizing content data according to the present invention.
5 is a flowchart illustrating a method of separating content data from a content transmission server according to an embodiment of the present invention and transmitting the separated content data to a content reproduction apparatus via different communication networks.
6 is a block diagram showing a configuration of a content reproduction apparatus according to the present invention.
FIG. 7 is an exemplary diagram for explaining an embodiment of a process of time-synchronizing and combining separated data by a content reproduction apparatus according to the present invention.
8 is a flowchart illustrating a method of receiving and combining separated data by a content reproduction apparatus according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS For a more complete understanding of the nature and advantages of the present invention, reference should be made to the following detailed description taken in conjunction with the accompanying drawings, in which:

In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

The terms and words used in the following description and drawings are not to be construed in an ordinary sense or a dictionary, and the inventor can properly define his or her invention as a concept of a term to be described in the best way It should be construed as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible.

Also, terms including ordinal numbers such as first, second, etc. are used to describe various elements, and are used only for the purpose of distinguishing one element from another, Not used. For example, without departing from the scope of the present invention, the second component may be referred to as a first component, and similarly, the first component may also be referred to as a second component.

Also, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. It is also to be understood that the terms such as " comprising "or" having ", as used herein, are intended to specify the presence of stated features, integers, It should be understood that the foregoing does not preclude the presence or addition of other features, numbers, steps, operations, elements, parts, or combinations thereof.

Also, the terms "part," "module," and the like, which are described in the specification, refer to a unit for processing at least one function or operation, and may be implemented by hardware or software or a combination of hardware and software. Also, the terms " a or ", "one "," the ", and the like are synonyms in the context of describing the invention (particularly in the context of the following claims) May be used in a sense including both singular and plural, unless the context clearly dictates otherwise.

In addition to the above-described terms, certain terms used in the following description are provided to facilitate understanding of the present invention, and the use of such specific terms may be changed to other forms without departing from the technical idea of the present invention.

In addition, embodiments within the scope of the present invention include computer readable media having or carrying computer executable instructions or data structures stored in computer readable media. Such computer-readable media can be any available media that is accessible by a general purpose or special purpose computer system. By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or in the form of computer- But is not limited to, a physical storage medium such as any other medium that can be used to store or communicate certain program code means of the general purpose or special purpose computer system, .

In the following description and claims, it is assumed that the technical background for implementing a method of separating content data according to the present invention and transmitting through a plurality of communication networks is an MMT (MPEG Media Transport).

However, this is only an example for convenience of understanding of the present invention, and the present invention is not necessarily limited to the MMT technology.

A method for transmitting separated content data in a system according to an embodiment of the present invention through a plurality of communication networks will now be described in detail with reference to the drawings.

FIG. 1 is a block diagram of a system for transmitting content data separated through a plurality of communication networks according to an embodiment of the present invention. Referring to FIG.

1, a system for transmitting content data separated through a plurality of communication networks according to an embodiment of the present invention includes a content reproduction apparatus 300, a content transmission server 200, and a broadcast photographing apparatus 400 And a broadcast relay system 500. The broadcast relay system 500 and the content reproduction apparatus 300 are linked through a plurality of communication networks 100a to 100b.

Hereinafter, each component will be schematically described with reference to FIG.

The communication networks 100a to 100b transmit data for data transmission and reception between the content reproduction apparatus 300 and the broadcasting relay system 500. The communication networks 100a to 100b may transmit data through Ethernet, xDSL (ADSL, VDSL ), HFC (Hybrid Fiber Coaxial Cable), FTTC (Fiber to the Curb), FTTH (Fiber To The Home) Wibro, WiMAX, High Speed Downlink Packet Access (HSDPA), Long Term Evolution (LTE), and Long Term Evolution Advanced (LTE-A).

In addition, the communication networks 100a to 100b include a plurality of access networks (not shown) and a core network (not shown), and may include an external network, for example, an Internet network (not shown). The connection network (not shown) is an access network that performs wired / wireless communication with the content reproduction apparatus 300 or the broadcast relay system 500. The access network includes a base station (BS), a base transceiver station (BTS) , And a base station controller such as a base station controller (BSC) and a radio network controller (RNC). Also, as described above, the digital signal processing unit and the radio signal processing unit integrally implemented in the base station are divided into digital units (hereinafter, referred to as DUs and radio units (RUs) A plurality of RUs (not shown) may be provided in each of a plurality of areas, and a plurality of RUs (not shown) may be connected to a centralized DU (not shown).

A core network (not shown) constituting a mobile network together with an access network (not shown) performs a role of connecting an access network (not shown) and an external network (not shown), for example, an Internet network (not shown).

As described above, the core network (not shown) is a network system that performs main functions for mobile communication services such as mobility control and switching between access networks (not shown), and includes a circuit switching or a packet exchange and manages and controls the packet flow in the mobile network. The core network (not shown) manages inter-frequency mobility and plays a role for interworking with traffic in an access network (not shown) and a core network (not shown) and other networks such as the Internet It is possible. Such a core network (not shown) may further include an SGW (Serving Gate Way), a PGW (PDN GateWay), an MSC (Mobile Switching Center), a HLR (Home Location Register), a MME (Mobile Mobility Entity) .

The Internet network (not shown) refers to a public network, that is, a public network, in which information is exchanged according to the TCP / IP protocol. The Internet network is connected to the terminal apparatus 300, Information to the content streaming server 200 via a core network (not shown) and an access network (not shown). However, the present invention is not limited thereto, and the content streaming server 200 may be implemented integrally with a core network (not shown).

In addition to the above-described communication methods, other widely known or later-developed communication methods may be included.

In particular, in the present invention, data is transmitted between a content reproduction apparatus 300 and a broadcast relay system 500 using a plurality of communication networks 100a to 100b. In FIG. 1, for convenience of description, two communication networks 100a to 100b However, the number of communication networks 100a to 100b is not limited to two, and further communication networks 100a to 100b may be utilized.

It is also assumed that the plurality of communication networks 100a to 100b according to the embodiment of the present invention are different kinds of communication networks. 1, if the first communication network 100a is a wireless communication network such as 3G, LTE or LTE-A, the second communication network 100b may be a Wi-Fi communication network or vice versa.

The broadcast relay system 500 according to the present invention may include a broadcast photographing apparatus 400 and a content transmission server 200.

In this case, the broadcast photographing apparatus 400 is a device for photographing broadcast contents and transmitting the broadcast contents to the contents transmission server 200. For example, the broadcast photographing apparatus 400 photographs broadcast contents such as a sports game, And transmit it to the content transmission server 200 in units of units.

Meanwhile, the content transmission server 200 links the content data received from the broadcast photographing apparatus 400 with the content reproduction apparatus 300 through the communication networks 100a to 100b, separates the content data into video data and audio data And transmits the packetized video packet and the voice packet to the content reproduction apparatus 300.

In particular, in an embodiment of the present invention, the content transmission server 200 may include an asset ID and time information in a video packet and a voice packet, The content data in which the data and the audio data are mixed can be separated into the video data and the audio data and can be packetized, and any one of the separated packetized voice packet and video packet can be transmitted to the content reproduction apparatus 100a via the first communication network 100a, (300), it is possible to transmit another packet to the content reproduction apparatus (300) through the second communication network (100b).

For example, when the first communication network 100a is a wireless communication network and the second communication network 100b is a Wi-Fi communication network, a video packet having a relatively large data amount is transmitted to the content reproduction apparatus 300 through the first communication network 100a And a voice packet having a relatively small amount of data can be transmitted to the content reproduction apparatus 300 through the second communication network 100b.

However, the above embodiment is only for the purpose of helping understanding of the present invention. The voice packet is transmitted through the wireless communication network according to the environment of the communication network 100a to 100b or the relative amount of the voice packet and the video packet, and the video packet is transmitted through the Wi- Can be transmitted. That is, if the data amount of the voice packet is larger than the video packet data amount or the communication environment of the Wi-Fi communication network is better than the wireless communication network in the area where the user is located, the video packet is transmitted to the content reproduction apparatus 300 via the Wi- The voice packet can be transmitted to the content reproduction apparatus 300 through the wireless communication network.

In addition, the communication network to which the voice packet and the video packet are transmitted may be determined according to the selection of the user using the content reproduction apparatus 300, not depending on the communication environment and the data amount.

The content transmission server 200 transmits the video packet and the voice packet transmitted through the first communication network 100a and the second communication network 100b according to the types of the first communication network 100a and the second communication network 100b, The data rate can be adjusted.

For example, when the first communication network 100a is a wireless communication network, considering that a GTP (wireless network data communication tunneling protocol) header will be attached, the packet size is reduced by a preset capacity before the maximum packet size, If the second communication network 100b is a Wi-Fi communication network, the GTP tunneling can be performed.

Lastly, the content reproduction apparatus 300 refers to a user apparatus that can transmit / receive various data to / from the broadcast relay system 500 through the communication networks 100a to 100b according to a user's operation.

The content reproducing apparatus 300 may perform voice or data communication through the communication networks 100a to 100b, may include a memory for storing programs and protocols for transmitting and receiving data and processing, And the like. In addition, the content reproduction apparatus 300 of the present invention can be implemented in various forms. For example, the content reproduction apparatus 300 described herein may be a mobile terminal such as a smart phone, a tablet PC, a PDA (personal digital assistant), a portable multimedia player (PMP) A fixed terminal such as a smart TV, a laptop computer, a desktop computer, or the like may be used.

In addition, the content reproducing apparatus 300 of the present invention can not enumerate all of the variations of the portable apparatus according to the convergence trend of the digital apparatus. However, the units of the same level as the above- And any device capable of transmitting and receiving data according to the present invention can be used as the content reproducing apparatus 300 according to the embodiment of the present invention.

Particularly, when the content reproduction apparatus 300 according to the present invention receives the video packet and the voice packet through the different communication networks from the content transmission server 200, the content reproduction apparatus 300 receives the video packet and the voice packet, And in the case of data constituting the same contents, the video data and the audio data can be combined and reproduced.

At this time, the video packet and the voice packet received from the content transmission server 200 may include the asset ID and the time information. The video packet and the voice packet, which are received based on the asset ID, The data can be combined through time synchronization between the video data and the audio data based on the time information, and the time information can be RTC (Real Time Clock) information.

The method of transmitting the separated content data in the system according to the embodiment of the present invention through a plurality of communication networks has been described above.

The content providing server 200 according to the embodiment of the present invention has the same hardware configuration as a typical Web server or a network server. However, the software includes a program module implemented through a language such as C, C ++, Java, Visual Basic, Visual C, or the like.

On the other hand, the memory mounted on each device of the present invention stores information in the device. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in other embodiments, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may comprise, for example, a hard disk device, an optical disk device, or any other mass storage device.

In addition, the term '~ module' used in the embodiment of the present invention means a software component, and '~ module' performs certain roles. By way of example, '~ module' may include components such as software components, object-oriented software components, class components and task components, and processes, functions, attributes, procedures, Routines, segments of program code, drivers, data, databases, data structures, tables, arrays, and variables. In addition, the functions provided in the components and 'modules' may be combined into a smaller number of components and '~ modules' or further separated into additional components and 'modules'.

Although the present specification and drawings describe exemplary device configurations, the functional operations and subject matter implementations described herein may be embodied in other types of digital electronic circuitry, or alternatively, of the structures disclosed herein and their structural equivalents May be embodied in computer software, firmware, or hardware, including, or in combination with, one or more of the foregoing. Implementations of the subject matter described herein may be embodied in one or more computer program products, i. E. One for computer program instructions encoded on a program storage medium of the type for < RTI ID = 0.0 & And can be implemented as a module as described above. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that affects the machine readable propagation type signal, or a combination of one or more of the foregoing.

Next, the configuration and operation method of the content transmission server 200 according to the present invention will be described.

2 is a block diagram illustrating a main configuration of the content transmission server 200. FIG 3 is a diagram illustrating an MMT packet structure transmitted from the content transmission server 200 to the content reproduction apparatus 300 through the communication networks 100a to 100b 4 is a diagram illustrating a process in which the content transmission server 200 according to the embodiment of the present invention separates video data and audio data from MMT packets received from the broadcast photographing apparatus 400, 5 is a flowchart illustrating an operation method of the content transmission server 200 for achieving the object of the present invention.

2, the content transmission server 200 according to the present invention may include a storage module 210, a communication module 230, and a control module 250.

The storage module 210 may store content data received from the broadcast photographing apparatus 400. [

The communication module 230 transmits and receives data to and from the content reproduction apparatus 200 through a plurality of communication networks 100a to 100b and receives content data from the broadcasting photographing apparatus 400. The communication module 230 includes a first communication interface 231, A second communication interface 233, and a third communication interface 235.

Here, the first communication interface 231 connects one of the voice packet and the video packet, which are interlocked with the first communication network 100a and separated from the control module 250, to the content reproduction apparatus 300 through the first communication network 100a And the second communication interface 233 transmits remaining packets that are not transmitted through the first communication network 100a to the content reproduction apparatus 300 in cooperation with the second communication network 100b. The third communication interface 235 may be connected to the broadcast photographing apparatus 400 through a wired / wireless communication network to receive the content photographed by the broadcast photographing apparatus 400 from the broadcast photographing apparatus 400.

The control module 250 separates the content data stored in the storage module 210 or received from the broadcast photographing apparatus 400 into video data and audio data and packetizes them into video packets and video packets, 1 to the content reproduction apparatus 300 via the second communication network and transmits the other packets to the content reproduction apparatus 300 through the second communication network.

For example, when the first communication network is a wireless communication network and the second communication network is a Wi-Fi communication network, a packet having a relatively large data amount can be transmitted through a wireless communication network and a packet having a relatively small data amount can be transmitted through a Wi- It can also be an inverse. Depending on the data volume of the video packet and the voice packet, the communication environment of the wireless communication network and the Wi-Fi network based on the user's location and the current situation, which communication network to transmit each packet separated into the voice packet and the video packet, In some cases, it may be determined by the user's choice.

In this case, the voice packet and the video packet may be MMT packets, and the MMT packet may be composed of an MFU (Media Fragment Unit) and an MPU (Media Processing Unit) .

The MFU and the MPU may include the asset ID and the time information corresponding to the image data or the voice data. The control module 250 determines whether the content data received from the broadcast photographing apparatus 400 based on the asset ID An MMT packet in which data and voice data are mixed can be separated into voice data and video data and packetized into a voice packet and an image packet.

Also, the control module 250 can adjust the data rates of video packets and voice packets transmitted through the first communication network and the second communication network, depending on the types of the communication networks 100a to 100b. That is, when the first communication network is a wireless communication network such as LTE or 3G, the size of a packet transmitted through a wireless communication network may be reduced by a preset capacity in consideration of attaching a GTP header, 2 network is a Wi-Fi network, it is not necessary to consider GTP tunneling, so that it can be transmitted in the maximum packet size.

3 is a diagram illustrating a structure of an MMT packet in which a content transmission server 200 according to an embodiment of the present invention separates content data into video data and audio data and packetizes them.

The MMT package 650 is the largest logically structured MMT entity among the data models defined in the MMT functional area as described above, and refers to one independent content such as a movie. The content transmission server 200 providing the streaming data service can generate the MMT package and provide it to the content reproduction apparatus 300. The MMT package 650 includes a logically structured collection . The MMT package 650 may include one or more assets 660, presentation information 651, transport properties 653, and descriptive information, e.g., package information.

Presentation information 651 includes information on a relationship between a plurality of assets 660, that is, spatial and temporal relationships, and one content is stored in a plurality of MMT packages 660. [ And may further include information for indicating a relationship between a plurality of MMT packages. The presentation information 651 may be a combination of a hypertext markup language (HTML) and a composition information document as examples of the presentation information 651.

The Asset Delivery Characteristics (ADC) 653 represents quality of service (QoS) requirements and statistics for delivery of the asset 660. A plurality of assets 660 may be associated with one transport property 653. The transport characteristics (transmission characteristics) 653 at this time can be used to set the parameters of the MMT payload and the MMT protocol by the entity encapsulating the package for effective delivery of the asset 660. [ The transport property 653 may also include transport characteristic information needed to determine the delivery condition of the MMT asset 660 or the MMT packet and may include transport characteristic information such as traffic description parameter and QoS And may include a QoS descriptor. This transfer characteristic information can be expressed in the form of parameters irrespective of the network environment.

Asset 660 refers to the largest logical data unit, meaning an element of the package that encapsulates encoded media data such as audio, video or web page data with timed or non-timed nature. This asset 660 means a data entity that contains data with the same delivery characteristics. For example, if the MMT package 650 is the largest entity among the data models defined in the MMT functional area, then the asset 660 may include audio data, video data, script data The MMT package 650 is a data unit constituting the MMT package 650. These assets 660 logically group MPUs sharing the same Asset ID.

Since the MPUs share the same asset ID, it is possible to confirm whether the voice packet and the video packet received by the content reproduction apparatus 300 are data constituting the same content, And the voice data is divided into the video packet and the voice packet.

In addition, the MMT packet of the present invention may be substantially configured to include an MMT packet header and an MMT payload.

Referring to FIG. 4, the broadcast photographing apparatus 400 photographs broadcast contents such as sports broadcasts and transmits the photographed data to the contents transmission server 200 in the form of MMT packets. At this time, The MMT payload 501 of the MMT packet transmitted from the device 400 may be mixed with a voice MPU that contains voice data and a video MPU that contains video data and each MPU has an asset ID 503 And time information 505. [0050]

When the content transmission server 200 receives the MMT packet including the MMT payload 501 from the broadcast photographing apparatus 400, the content transmission server 200 extracts, from the input MMT packet, The packet may be packetized into a video packet 507 including the MMT payload to be transmitted to the first communication network and a voice packet 509 including the MMT payload to be transmitted to the second communication network.

5, the content transmission server 200 separates the content data received from the broadcast photographing apparatus 400 or the content data stored in the content transmission server 200 into video data and audio data, (S101). The content transmission server 200 transmits the video packet through one of the first communication network and the second communication network and transmits the voice packet to the remaining communication network. For convenience of explanation, the video packet is transmitted through the first communication network And the voice packet is transmitted through the second communication network.

The content transmission apparatus 200 performs a task of adjusting a data rate before transmitting the video packet and the voice packet to the content reproduction apparatus 300. If the first communication network or the second communication network is a wireless communication network, The packet size is reduced in advance by a preset capacity, and if it is a Wi-Fi network, there is no GTP tunneling, so that it can be transmitted in a maximum packet size (S103 to S105).

Then, in accordance with the thus adjusted data rate, the video packet is transmitted to the content reproduction apparatus 300 through the first communication network 100a and the voice packet is transmitted to the content reproduction apparatus 300 through the second communication network 100b (S107 to S109).

The configuration and operation method of the content transmission server 200 according to the present invention have been described above.

Next, the configuration and operation method of the content reproduction apparatus 300 according to the present invention will be described.

FIG. 6 is a block diagram showing a main configuration of a content reproduction apparatus 300 according to the present invention. FIG. 7 is a flowchart illustrating a method of combining a voice packet and a video packet received by the content reproduction apparatus 300 according to the present invention. FIG. 8 is a flowchart illustrating an operation method of the content reproduction apparatus 300 for achieving the object of the present invention.

6, the content reproduction apparatus 300 includes an input module 310, a storage module 330, a communication module 350, a control module 370, Module 390 as shown in FIG.

The input module 310 receives various information such as numbers and character information, sets various functions, and transmits a signal to the control module 370 in connection with the function control of the content reproduction apparatus 300. The input module 310 may include at least one of a keypad and a touchpad that generates an input signal according to a user's touch or operation. At this time, the input module 310 may be configured in the form of a touch panel (or a touch screen) together with the output module 390 to simultaneously perform input and display functions. The input module 310 may be any type of input device that can be developed in addition to an input device such as a keyboard, a keypad, a mouse, a joystick, and the like. In particular, the input module 310 according to the present invention senses input information input from a user and transfers the input information to the control module 370.

In particular, the input module 310 according to the present invention may request the user to receive the content from the broadcast relay system 600 and transmit the request to the control module 370.

The storage module 330 is a device for storing data, and includes a main storage device and an auxiliary storage device, and stores an application program necessary for functional operation of the content reproduction device 300. The storage module 330 may include a program area and a data area. Here, when the content reproducing apparatus 300 activates each function according to a user's request, the content reproducing apparatus 300 executes corresponding application programs under the control of the control module 370 to provide each function.

The communication module 350 is for transmitting and receiving data to and from the content transmission server 200 through the communication networks 100a to 100b.

The communication module 350 includes RF transmitting means for up-converting and amplifying the frequency of the transmitted signal, RF receiving means for low-noise amplifying the received signal and down-converting the frequency, Data processing means, and the like. The communication module 350 may include at least one of a wireless communication module (not shown) and a wired communication module (not shown). When the content reproduction apparatus 300 uses wireless communication, the wireless communication module transmits either one of a wireless network communication module, a wireless LAN communication module, and a wireless fan communication module And can transmit and receive data to and from the contents transmission server 200 by using the contents.

The first communication interface 351 may be connected to the first communication network 100a and may be connected to the first communication interface 351. The first communication interface 351 may include a first communication interface 351 and a second communication interface 353, And the second communication interface 353 is connected to the second communication network 100b to transmit and receive data to and from the content transmission server 200. [

The control module 370 checks whether the video packet received through the communication network 100a through 100b and the video data and the voice data included in the voice packet are data constituting the same contents by the communication module 350, The video data and the audio data are combined and reproduced through the output module 390.

In this case, the video packet and the audio packet are MMT packets, and the MFU and the MPU included in the video packet and the audio packet include the asset ID and the time information corresponding to the video data or audio data, It can be confirmed whether the video data and the audio data are data constituting the same contents. The data can be combined through time synchronization between the video data and the audio data using the time information.

Referring to FIG. 7, the control module 370 performs time synchronization between video data and voice data using time information. The video packet 701 received by the communication module 350 and the voice packet 707 ) Each include a video MPU and a voice MPU, and each MPU includes asset IDs 703 and 709 and time information 705 and 711. [

The control module 370 confirms whether the received video packet 701 and the voice packet 707 are data constituting the same contents through the asset IDs 703 and 709 included in each MPU, If the data is data, time synchronization can be performed by mapping to the presentation time line based on the time information 705, 711 included in each MPU.

For example, voice MPU 1 included in voice packet 707 in FIG. 7 includes voice data for a time from t1 to t3 and is mapped at time t1, so that time synchronization is performed with video MPU 1 and video MPU 2 The audio MPU 2 can be mapped at time t3 including audio data from t3 to a specific time, and time synchronization with the video MPU 3 can be performed.

The control module 370 completes one content by combining the video data and the audio data through the time synchronization and reproduces the completed content through the output module 390. [

The output module 390 displays information on a series of operation states, operation results, and the like that occur during the performance of the function of the content reproduction apparatus 300. The output module 390 can display menus of the content reproduction apparatus 300 and user data input by the user. The output module 390 may be a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), a light emitting diode (LED), an organic light emitting diode (OLED) An organic light emitting diode (OLED), an organic light emitting diode (OLED), a retina display, a flexible display, and a three-dimensional display. In this case, when the output module 390 is configured as a touch screen, the output module 390 may perform some or all of the functions of the input module 310. [

Particularly, in the present invention, the output module 390 receives and reproduces the content data combined by the control module 370.

8, the content reproduction apparatus 300 receives an image packet through the first communication network 100a and receives a voice packet through the second communication network 100b (S201 to S203). In this case, the first communication network 100a and the second communication network 100b may be a wireless communication network or a Wi-Fi network, and they may be composed of different types of communication networks.

Upon receiving the video packet and the voice packet, the content reproduction apparatus 300 determines whether the data included in the video packet and the voice packet constitute the same content (S205). If the same content is not formed A voice packet or a video packet is received through the first communication network 100a or the second communication network 100b until data constituting the same content is received.

In this case, the criterion for determining whether or not the same content is constituted may be the asset ID. The Asset ID may be included in the MPU or the MFU included in the video packet or the voice packet together with the time information. The Asset ID may be checked to determine whether the received video packet and the voice packet include data constituting the same content It can be judged.

If the received video packet and the voice packet constitute the same content, time synchronization between the video data and the voice data can be performed based on the time information included in the video packet and the voice packet (S207). Upon completion of the time synchronization, the content reproduction apparatus 300 combines the video data and the audio data to reproduce the content through the output module as one complete content (S209). The time information includes RTC information .

The configuration and operation method of the content reproduction apparatus 300 according to the present invention have been described above.

The method for providing moving picture contents according to an embodiment of the present invention may be provided in the form of a computer readable medium suitable for storing computer program instructions and data.

At this time, the program recorded on the recording medium can be read and installed in the computer and executed, thereby executing the above-described functions.

In order to allow a computer to read a program recorded on a recording medium and to execute functions implemented by the program, the above-mentioned program may be stored in a computer-readable medium such as C, C ++, JAVA, machine language, and the like.

The code may include a function code related to a function or the like that defines the functions described above and may include an execution procedure related control code necessary for the processor of the computer to execute the functions described above according to a predetermined procedure. In addition, such code may further include memory reference related code as to what additional information or media needed to cause the processor of the computer to execute the aforementioned functions should be referenced at any location (address) of the internal or external memory of the computer . In addition, when a processor of a computer needs to communicate with any other computer or server that is remote to execute the above-described functions, the code may be stored in a memory of the computer using a communication module of the computer, It may further include a communication-related code such as how to communicate with another computer or a server, and what information or media should be transmitted or received during communication.

Such computer-readable media suitable for storing computer program instructions and data include, for example, magnetic media such as hard disks, floppy disks and magnetic tape, compact disk read only memory (CD-ROM) Optical media such as a DVD (Digital Video Disk), a magneto-optical medium such as a floppy disk, and a ROM (Read Only Memory), a RAM , Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits.

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. The functional program for implementing the present invention and the related code and code segment may be implemented by programmers in the technical field of the present invention in consideration of the system environment of the computer that reads the recording medium and executes the program, Or may be easily modified or modified by the user.

Each step according to embodiments of the present invention may be implemented by a computer-executable instruction and executed by a computing system. As used herein, a "computing system" is defined as one or more software modules, one or more hardware modules, or a combination thereof that operate in conjunction with performing an operation on electronic data. For example, the definition of a computer system includes a software module such as a personal computer's operating system and a hardware component of a personal computer. The physical layout of the module is not important. The computer system may include one or more computers connected through a network.

Likewise, a computing system may be implemented in a single physical device in which an internal module, such as a memory and a processor, operates in conjunction with performing an operation on the electronic data.

As described above, the present specification contains details of a number of specific implementations, but they should not be construed as being limitations on the scope of any invention or claimability, but rather on the particular embodiment of a particular invention But should be understood as an explanation of the features. Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments, either individually or in any suitable subcombination. Further, although the features may operate in a particular combination and may be initially described as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, Or a variant of a subcombination.

Likewise, although the operations are depicted in the drawings in a particular order, it should be understood that such operations must be performed in that particular order or sequential order shown to achieve the desired result, or that all illustrated operations should be performed. In certain cases, multitasking and parallel processing may be advantageous. Also, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products It should be understood.

Certain embodiments of the subject matter described herein have been described. Other embodiments are within the scope of the following claims. For example, the operations recited in the claims may be performed in a different order and still achieve desirable results. By way of example, the process illustrated in the accompanying drawings does not necessarily require that particular illustrated or sequential order to obtain the desired results. In certain implementations, multitasking and parallel processing may be advantageous.

The description sets forth the best modes of the present invention and provides examples for the purpose of illustrating the invention and enabling a person skilled in the art to make and use the invention. The written description is not intended to limit the invention to the specific terminology presented. Thus, while the present invention has been described in detail with reference to the above examples, those skilled in the art will recognize that modifications, changes, and modifications can be made thereto without departing from the scope of the present invention.

Therefore, the scope of the present invention should not be limited by the described embodiments but should be defined by the claims.

The present invention relates to a method and apparatus for transmitting content data separated through a plurality of communication networks, and more particularly, to a method and apparatus for separating content data into video data and audio data, And a method and apparatus for confirming whether a voice packet and a video packet received by the content reproduction apparatus constitute the same content and constructing the same content to provide the content by combining the voice packet and the video packet

According to the present invention, a moving picture content is divided into video data and audio data, transmitted through a plurality of communication networks, and the content reproduction apparatus that receives the transmitted data performs time synchronization and collects data to efficiently use multiple communication networks The present invention can contribute to the development of the moving picture contents providing service industry by providing an effective moving picture content streaming service, for example, a more live-feeling live-broadcast broadcasting in sports broadcasting.

In addition, since the present invention is not only possible to be marketed or operated, but also can be practically and practically carried out, it is industrially applicable.

100: plurality of communication networks 200: content transmission server
300: content reproduction apparatus 400: broadcast photographing apparatus
500: Broadcasting relay system

Claims (18)

A communication module including a first communication interface for transmitting and receiving data to and from a content reproduction apparatus via a first communication network and a second communication interface for transmitting and receiving data to and from the content reproduction apparatus via a second communication network; And
The content data is separated into video data and audio data and packetized to transmit one of a voice packet and a video packet to the content reproduction apparatus via the first communication network and to transmit the other packet to the content reproduction apparatus through the second communication network, A control module for controlling the communication module to transmit the data to the communication module;
And a content server. The method of claim 1, wherein the video packet and the voice packet packetized by the control module
It is an MMT (MPEG Media Transport) packet,
Wherein the video data and the audio data are constituted by a Media Fragment Unit (MFU) which is a minimum decoding unit included in the payload of the MMT packet or an MPU (Media Processing Unit) including at least one MFU Content delivery server. The MFU or MPU according to claim 2,
And an asset ID and time information corresponding to the video data or the audio data. 4. The apparatus of claim 3, wherein the control module
Receiving the MMT packet in which the content data is mixed with video data and audio data and separating the video data and the audio data from the MMT packet based on the asset ID
A content delivery server characterized by. 2. The apparatus of claim 1, wherein the control module
And adjusts a data rate of the video packet and the voice packet transmitted through the first communication network and the second communication network according to the type of the first communication network and the second communication network. 6. The apparatus of claim 5, wherein the control module
Wherein when the first communication network or the second communication network is a wireless communication network, a size of a packet transmitted through the wireless communication network is reduced by a preset capacity. A communication module including a first communication interface for transmitting and receiving data to and from a content transmission server via a first communication network and a second communication interface for transmitting and receiving data to and from the content transmission server through a second communication network; And
When the video packet and the voice packet are received from the contents transmission server through different communication networks, it is checked whether the video packet and the voice data included in the voice packet are data constituting the same contents, A control module for combining and reproducing the video data and the audio data,
And a content reproduction apparatus for reproducing the content. 8. The method of claim 7, wherein the voice and video packets
It is an MMT (MPEG Media Transport) packet,
Wherein the video data and the audio data are constituted by a Media Fragment Unit (MFU) which is a minimum decoding unit included in the payload of the MMT packet or an MPU (Media Processing Unit) including at least one MFU Content playback apparatus. The MFU or MPU according to claim 8,
An asset ID and time information corresponding to video data or audio data,
The control module
Wherein the video data and the audio data are combined based on time information between the video data and the audio data based on the time information, . Separating the content data into video data and audio data;
Packetizing the separated video data and audio data, respectively;
Transmitting one of the packetized video packet or the voice packet to the content reproduction apparatus through the first communication network and transmitting the other packet to the content reproduction apparatus through the second communication network
And transmitting the data. 11. The method of claim 10,
It is an MMT (MPEG Media Transport) packet,
The video data and audio data are composed of an MPU (Media Processing Unit) including a Media Fragment Unit (MFU), which is a minimum decoding unit included in the payload of the MMT packet, or at least one MFU,
The MFU or MPU,
And an asset ID and time information corresponding to the video data or the audio data. 12. The method of claim 11,
Receiving an MMT packet in which the content data is mixed with video data and audio data; And
Separating video data and audio data from the input MMT packet based on the asset ID
And transmitting the data. 11. The method of claim 10, wherein the transmitting comprises:
And adjusting the data rate of the video packet and the voice packet transmitted through the first communication network and the second communication network according to the type of the first communication network and the second communication network. Receiving a video packet and a voice packet through a different communication network;
Confirming whether the video data and the audio data included in the video packet and the voice packet are data constituting the same content; And
In the case of composing the same contents, the step of combining and reproducing the video data and the audio data
And transmitting the data. 15. The method of claim 14, wherein the video packet and the voice packet are
It is an MMT (MPEG Media Transport) packet,
The video data and audio data are composed of an MPU (Media Processing Unit) including a Media Fragment Unit (MFU), which is a minimum decoding unit included in the payload of the MMT packet, or at least one MFU,
The MFU or MPU,
And an asset ID and time information corresponding to the video data or the audio data. 16. The method of claim 15,
And the video data and the audio data are identical with each other based on the asset ID.
The step of combining the video data and the audio data
Wherein data is combined through time synchronization between the video data and the audio data based on the time information. A computer-readable recording medium on which a program for executing the method according to any one of claims 10 to 16 is recorded. A computer program embodied on computer readable recording medium which is embodied to execute the method recited in any one of claims 10 to 16.

Images