KR102210407B1 - Content Delivery Method and Apparatus Using a Plurality of Communication Network - Google Patents

Abstract

The present invention relates to a method and apparatus for transmitting separated content data through a plurality of communication networks, and more particularly, to separate content data into video data and audio data, packetize each, and transmit them to a content playback device through different communication networks. And, it checks whether the audio packet and the video packet received by the content reproducing device constitute the same content, and if the same content is formed, the audio packet and the video packet are combined, so that effective video content streaming using multiple communication networks It is possible to provide a more realistic live polarization broadcast in service, for example, sports broadcast.

Description

Content Delivery Method and Apparatus Using a Plurality of Communication Network}

The present invention relates to a method and apparatus for transmitting content through a plurality of communication networks, and more particularly, to divide the content into video data and audio data, packetize each, and transmit the content to a content playback device through different communication networks, and play the content. The present invention relates to a method and apparatus for determining whether an audio packet and a video packet received by an apparatus constitute the same content, and combining the audio packet and a video packet when the same content is configured to provide content.

The content described in this section merely provides background information on the present embodiment and does not constitute the prior art.

With the appearance of various video services in the recent Internet environment, the demand for high-definition live broadcasting is gradually increasing. In addition, in recent years, attempts have been made to provide various video services according to a streaming service method.

Streaming service means transmitting content such as video or audio from a server to a terminal through a network such as the Internet. Streaming is called because the transmitted data is treated as if water flows. The server divides the video into packets so that it can be sent to the network, and the terminal collects the packets again, restores them to their original form, and plays them. At this time, playback and packet reception occur simultaneously, and a series of related packets is called a stream, and a set of packets is called streaming data.

In addition, MPEG-2 TS (Transport System) has been mainly used for media transmission in various industries such as terrestrial and satellite digital broadcasting, DMB, and IPTV since standardization. Recently, media storage in digital video cameras or Blu-ray equipment has been The field of use is expanding, such as being used for. However, the recent network environment is rapidly changing, and new requirements such as multimedia transmission technology in various heterogeneous network environments are required. Accordingly, a new technology standard for providing various contents and services in various types of advanced network environments is required, and accordingly, MPEG Media Transport (MMT) technology is being developed.

However, the current content service such as the above-described live polarization broadcasting creates and transmits a single MMT file by muxing audio data to video data.This method is used when a transmission delay occurs in a specific communication network, the broadcasting service is stopped or There was a problem that a disconnection phenomenon occurs.

In addition, the current wireless terminal transmits and receives all data through only one of a wireless communication network (e.g., 3G or LTE network) or a Wi-Fi network according to the user's setting or the surrounding communication environment, so there is a problem that efficient data transmission and reception is difficult. .

Korean Patent Registration No. 10-0441500, Publication Date August 13, 2002 (Name: Multi-party video conference method in video conference system)

In the present invention, by separating content data and transmitting it through a plurality of communication networks, even if a transmission delay occurs in a specific communication network, any one of video data or audio data transmitted through another communication network is transmitted without delay, and continuous service without service interruption. It is possible to provide and accordingly propose a method of transmitting and receiving data efficiently.

In particular, audio data and video data are separated from video content and packetized, and data with a relatively small amount of data is transmitted through the Wi-Fi network, and data with a relatively large amount of data is transmitted through the LTE network. An object of the present invention is to provide a method and an apparatus for outputting contents by combining the audio data and the image data by a terminal device that receives audio data and video data through a communication network.

However, the object of the present invention is not limited to the above object, and other objects that are not mentioned will be clearly understood from the following description.

The content transmission server of the present invention for achieving the above-described object includes a first communication interface for transmitting and receiving data with a content playing device through a first communication network, and a first communication interface for transmitting and receiving data with the content playing device through the second communication network. 2 A communication module including a communication interface and content data are separated into video data and audio data, and are packetized, and one of the audio packet and the video packet is transmitted to the content playback device through the first communication network, and the other packet is transmitted to the second packet. It may include a control module for controlling the communication module to be transmitted to the content playback device through a communication network.

At this time, the video packet and the audio packet packetized by the control module are MMT (MPEG Media Transport) packets, and the video data and audio data are MFU, which is a minimum decoding unit included in the payload of the MMT packet. Fragment Unit), or a Media Processing Unit (MPU) including at least one MFU, and the MFU or MPU may include asset ID and time information corresponding to video data or audio data, and the The control module may receive an MMT packet in which video data and audio data are mixed as the content data, and separate video data and audio data from the received MMT packet based on the asset ID.

In addition, the control module may adjust a data rate of the video packet and the audio packet transmitted through the first communication network and the second communication network according to the type of the first communication network and the second communication network. When the first communication network or the second communication network is a wireless communication network, the size of a packet transmitted through the wireless communication network may be reduced by a preset capacity and transmitted.

The content reproducing apparatus of the present invention for achieving the above-described object includes a first communication interface for transmitting and receiving data with a content delivery server through a first communication network, and a second communication interface for transmitting and receiving data with the content delivery server through a second communication network. When a video packet and an audio packet are received from the communication module including a communication interface and the content transmission server through different communication networks, respectively, whether the video data and audio data included in the video packet and the audio packet are data constituting the same content. When the data constitutes the same content, it may include a control module that combines and reproduces the image data and the audio data.

At this time, the audio packet and the video packet are MMT (MPEG Media Transport) packets, and the video data and audio data are MFU (Media Fragment Unit), which is a minimum decoding unit included in the payload of the MMT packet, or at least one It may be composed of an MPU (Media Processing Unit) comprising an MFU of, and the MFU or MPU may include an asset ID and time information corresponding to image data or audio data, and the control module may include the asset ID. Based on this, it is possible to check whether the image data and the audio data are data constituting the same content, and combine the data through time synchronization between the image data and the audio data based on the time information.

A data transmission method according to a preferred embodiment of the present invention for achieving the above object includes the steps of separating content data into video data and audio data by a content delivery server, and packetizing the separated video data and audio data, respectively. And transmitting either the packetized video packet or the audio packet to the content playback device through a first communication network, and transmitting another packet to the content playback device through a second communication network.

At this time, the video packet and the audio packet are MMT (MPEG Media Transport) packets, and the video data and audio data are MFU (Media Fragment Unit), which is a minimum decoding unit included in the payload of the MMT packet, or at least one It may be composed of a Media Processing Unit (MPU) including an MFU of, and the MFU or MPU may include an asset ID and time information corresponding to image data or audio data.

In addition, the step of distinguishing includes receiving an MMT packet in which video data and audio data are mixed for the content data, and separating video data and audio data from the received MMT packet based on the asset ID. I can.

Meanwhile, the transmitting may be performed by adjusting data rates of the video packet and the audio packet transmitted through the first communication network and the second communication network according to the types of the first communication network and the second communication network.

In order to achieve the above object, a data transmission method according to a preferred embodiment of the present invention includes the steps of receiving, by a content reproducing apparatus, a video packet and an audio packet through different communication networks, and the video included in the video packet and the audio packet. The step of checking whether the data and the audio data are data constituting the same content, and when constituting the same content, combining the image data and the audio data and reproducing it.

At this time, the video packet and the audio packet are MMT (MPEG Media Transport) packets, and the video data and audio data are MFU (Media Fragment Unit), which is a minimum decoding unit included in the payload of the MMT packet, or at least one It is composed of a Media Processing Unit (MPU) including an MFU of, and the MFU or MPU may be characterized in that it includes an asset ID and time information corresponding to image data or audio data.

In addition, the step of checking whether the content is the same is characterized in that it is determined whether the video data and the audio data are data constituting the same content based on the asset ID, and the combining of the video data and the audio data is performed at the time Data may be combined through time synchronization between the image data and the audio data based on information.

In addition, the data transmission method may be provided as a computer-readable recording medium in which a program for executing it is recorded, and implemented to execute the data transmission method may be provided as a computer program stored in a computer-readable recording medium.

In the present invention, the video data and audio data included in the video content are separated and transmitted through different communication networks, and the content reproducing device receiving the transmitted data performs time synchronization to collect the separately transmitted video data and audio data. Thus, the video content can be played back, and an effective streaming service of video content can be provided by efficiently using a plurality of communication networks.

In particular, the present invention transmits video data and audio data included in video content separately through different communication networks, so that even if a transmission delay occurs in a specific communication network, either video data or audio data is transmitted without delay. It is possible to provide continuous service without service interruption through transmitted video data or audio data.

In addition, various effects other than the above-described effects may be directly or implicitly disclosed in the detailed description according to an embodiment of the present invention to be described later.

1 is a diagram showing the configuration of a system for transmitting separated content data through a plurality of communication networks according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a content delivery server according to the present invention.
3 is an exemplary diagram for explaining the structure of an MMT packet according to an embodiment of the present invention.
4 is an exemplary diagram for explaining an embodiment of a process in which a content delivery server separates and packetizes content data according to the present invention.
5 is a flowchart illustrating a method of separating content data by a content delivery server according to the present invention and transmitting it to a content playback device through different communication networks.
6 is a block diagram showing the configuration of a content reproducing apparatus according to the present invention.
7 is an exemplary diagram for explaining an embodiment of a process of synchronizing and combining separated data by a content reproducing apparatus according to the present invention.
8 is a flowchart illustrating a method of receiving and combining separated data by a content reproducing apparatus according to the present invention.

In order to clarify the features and advantages of the problem solving means of the present invention, the present invention will be described in more detail with reference to specific embodiments of the present invention shown in the accompanying drawings.

However, in the following description and the accompanying drawings, detailed descriptions of known functions or configurations that may obscure the subject matter of the present invention will be omitted. In addition, it should be noted that the same components are indicated by the same reference numerals as possible throughout the drawings.

The terms or words used in the following description and drawings should not be construed as being limited to their usual or dictionary meanings, and the inventor may appropriately define the concept of terms for describing his or her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical idea of the present invention based on the principle that there is. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are only the most preferred embodiments of the present invention, and do not represent all the technical ideas of the present invention, and thus various alternatives that can be substituted for them at the time of application It should be understood that there may be equivalents and variations.

In addition, terms including ordinal numbers such as first and second are used to describe various elements, and are only used for the purpose of distinguishing one element from other elements, and to limit the elements. Not used. For example, without departing from the scope of the present invention, a second component may be referred to as a first component, and similarly, a first component may be referred to as a second component.

In addition, terms used in the present specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In addition, terms such as "comprises" or "have" described herein are intended to designate the presence of features, numbers, steps, actions, components, parts, or a combination thereof described in the specification. It is to be understood that the above other features, or the possibility of the presence or addition of numbers, steps, actions, components, parts, or combinations thereof, are not preliminarily excluded.

In addition, terms such as "unit", "group", and "module" described in the specification mean a unit that processes at least one function or operation, which may be implemented by hardware or software or a combination of hardware and software. In addition, "a or an", "one", "the" and similar related words are different from this specification in the context of describing the present invention (especially in the context of the following claims). Unless otherwise indicated or clearly contradicted by context, it may be used in a sense encompassing both the singular and the plural.

In addition to the above terms, specific terms used in the following description are provided to aid understanding of the present invention, and the use of these specific terms may be changed in other forms without departing from the technical spirit of the present invention.

In addition, embodiments within the scope of the present invention include computer-readable media having or transferring computer-executable instructions or data structures stored in the computer-readable media. Such computer-readable media may be any available media accessible by a general purpose or special purpose computer system. By way of example, such computer readable media may be in the form of RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage, or computer executable instructions, computer readable instructions, or data structures. It may include, but is not limited to, physical storage media such as any other media that may be used to store or deliver certain program code means, and may be accessed by a general purpose or special purpose computer system. .

In the following description and claims, it is assumed that the technical background for implementing a method of separating content data according to the present invention and transmitting it through a plurality of communication networks is MMT (MPEG Media Transport).

However, this is only an example for convenience, to aid understanding of the present invention, and the present invention is not necessarily limited to the MMT technology.

Now, a method of transmitting separated content data in a system according to an embodiment of the present invention through a plurality of communication networks will be described in detail with reference to the drawings.

1 is a diagram showing the configuration of a system for transmitting separated content data through a plurality of communication networks according to an embodiment of the present invention.

1, a system for transmitting separated content data through a plurality of communication networks according to an embodiment of the present invention includes a content playback device 300, a content transmission server 200, and a broadcast photographing device 400. It may be configured to include a broadcast relay system 500, and the broadcast relay system 500 and the content playback device 300 interlock through a plurality of communication networks 100a to 100b.

Then, each component will be schematically described with reference to FIG. 1.

First, the communication networks 100a to 100b serve to transmit data for data transmission and reception between the content playback device 300 and the broadcast relay system 500, and according to the system implementation method, Ethernet, xDSL (ADSL, VDSL) ), HFC (Hybrid Fiber Coaxial Cable), FTTC (Fiber to The Curb), FTTH (Fiber To The Home), and other wired communication methods, WLAN (Wireless LAN), WiFi (Wi-Fi), WiBro ( Wireless communication methods such as Wibro), Wimax, High Speed Downlink Packet Access (HSDPA), Long Term Evolution (LTE), and Long Term Evolution Advanced (LTE-A) may be used.

In addition, these communication networks 100a to 100b include, for example, a plurality of access networks (not shown) and core networks (not shown), and may be configured to include an external network, for example, an Internet network (not shown). Here, the access network (not shown) is an access network for performing wired/wireless communication with the content playback device 300 or the broadcast relay system 500, for example, BS (Base Station), BTS (Base Transceiver Station), NodeB, eNodeB It may be implemented with a plurality of base stations such as, for example, a base station controller such as a base station controller (BSC) and a radio network controller (RNC). In addition, as described above, the digital signal processing unit and the wireless signal processing unit, which were integrally implemented in the base station, are divided into digital units (hereinafter referred to as DUs) and wireless units (hereinafter referred to as RUs), A plurality of RUs (not shown) may be installed in each of a plurality of areas, and a plurality of RUs (not shown) may be connected to a centralized DU (not shown).

In addition, a core network (not shown) constituting a mobile network together with an access network (not shown) serves to connect an access network (not shown) and an external network, for example, an Internet network (not shown).

As described above, such a core network (not shown) is a network system that performs major functions for mobile communication services such as mobility control and switching between access networks (not shown), and circuit switching or packet switching switching), and manages and controls the packet flow in the mobile network. In addition, the core network (not shown) manages the mobility between frequencies, and plays a role for interworking with traffic in the access network (not shown) and the core network (not shown) and other networks, such as the Internet network (not shown). May be. These core networks (not shown) further include Serving GateWay (SGW), PDN GateWay (PGW), Mobile Switching Center (MSC), Home Location Register (HLR), Mobile Mobility Entity (MME) and Home Subscriber Server (HSS). It may be configured to include.

In addition, the Internet network (not shown) refers to a common open communication network, that is, a public network in which information is exchanged according to the TCP/IP protocol, and is connected to the terminal device 300 and provided from the terminal device 300. Information may be provided to the content streaming server 200 through a core network (not shown) and an access network (not shown). However, it is not limited thereto, and the content streaming server 200 may be implemented integrally with a core network (not shown).

In addition, in addition to the above-described communication method, all types of communication methods that are widely known or will be developed in the future may be included.

In particular, the present invention transfers data between the content playback device 300 and the broadcast relay system 500 using a plurality of communication networks 100a to 100b. In FIG. 1, two communication networks 100a to 100b ) Is assumed to be used, but the plurality of communication networks 100a to 100b is not limited to two, and more communication networks 100a to 100b may be used.

In addition, it is assumed that the plurality of communication networks 100a to 100b according to an embodiment of the present invention are different types of communication networks. That is, if the first communication network 100a in FIG. 1 is a wireless communication network such as 3G, LTE, or LTE-A, the second communication network 100b may be a Wi-Fi communication network, or vice versa.

The broadcast relay system 500 according to the present invention may include a broadcast photographing device 400 and a content delivery server 200.

At this time, the broadcast photographing device 400 is a device for photographing broadcast content and transmitting it to the content transmission server 200, for example, photographing broadcast content such as a sports event, and packetizing the photographed video data. It may be divided into units and transmitted to the content delivery server 200.

On the other hand, the content transmission server 200 interlocks the content data received from the broadcast photographing device 400 with the content playback device 300 through the communication networks 100a to 100b, and separates the content data into video data and audio data. This is a device for transmitting each packetized video packet and audio packet to the content reproducing apparatus 300.

In particular, in an embodiment of the present invention, the content delivery server 200 may include asset ID and time information in the video packet and the audio packet, and the image received from the broadcasting photographing device 400 based on the asset ID Content data in which data and audio data are mixed can be separated into video data and audio data and packetized, and any one of the separated and packetized audio packets and video packets is transmitted through the first communication network 100a. If transmitted to 300, another packet may be transmitted to the content playback device 300 through the second communication network 100b.

For example, when the first communication network 100a is a wireless communication network and the second communication network 100b is a Wi-Fi communication network, an image packet with a relatively large amount of data is transmitted to the content playback device 300 through the first communication network 100a. In addition, a voice packet having a relatively small amount of data may be transmitted to the content reproducing apparatus 300 through the second communication network 100b.

However, the above embodiments are only for helping understanding of the present invention. Voice packets are transmitted through a wireless communication network and video packets are transmitted through a Wi-Fi network according to the environment of the communication network (100a to 100b) or the relative amount of data between the audio and video packets. Can be transmitted. That is, if the amount of data in the voice packet is greater than the amount of data in the video packet or the communication environment of the Wi-Fi communication network is better than the wireless communication network in the area where the user is located, the video packet is transmitted to the content playback device 300 through the Wi-Fi communication network, The voice packet may be transmitted to the content reproducing apparatus 300 through a wireless communication network.

In addition, the transmission of the voice packet and the video packet through a communication network may not be determined according to the communication environment and the amount of data, but may be determined according to the user's selection of the content playback device 300.

In addition, the content transmission server 200 includes the video packet and the audio packet transmitted through the first communication network 100a and the second communication network 100b according to the type of the first communication network 100a and the second communication network 100b. You can adjust the data rate.

For example, if the first communication network 100a is a wireless communication network, in consideration of attaching a GTP (wireless network data communication tunneling protocol) header, the packet size is reduced by a preset capacity from the maximum packet size and transmitted to the wireless communication network. The load can be reduced, and when the second communication network 100b is a Wi-Fi communication network, since there is no GTP tunneling, transmission can be performed with a maximum packet size.

Finally, the content playback device 300 refers to a device of a user capable of transmitting and receiving various data to and from the broadcast relay system 500 through the communication networks 100a to 100b according to a user's manipulation.

The content playback device 300 may perform voice or data communication through the communication networks 100a to 100b, a memory storing programs and protocols for transmission and reception of data, and operations and control by executing various programs. It may be provided with a microprocessor for. In addition, the content reproducing apparatus 300 of the present invention may be implemented in various forms. For example, the content playback device 300 described in the present specification is a mobile terminal such as a smart phone, a tablet PC, a personal digital assistant (PDA), a portable multimedia player (PMP), and an MP3 player. Of course, a fixed terminal such as a smart TV, a laptop computer, and a desktop computer may be used.

In addition, in the content reproducing apparatus 300 of the present invention, the transformation of the portable device is very diverse according to the convergence trend of the digital device, so it is not possible to enumerate all of them, but a unit equivalent to the above-mentioned units is the present invention. Any device that can be used as the content playback device 300 according to the present invention and can transmit and receive data according to the present invention can be used as the content playback device 300 according to an embodiment of the present invention.

In particular, when the content reproducing apparatus 300 according to the present invention receives a video packet and an audio packet from the content transmission server 200 through different communication networks, whether the received video packet and the audio packet are data constituting the same content. When the data constitutes the same content, video data and audio data may be combined and reproduced.

At this time, the video packet and the audio packet received from the content delivery server 200 may include asset ID and time information, and the video packet and audio packet received based on the asset ID are data constituting the same content. Recognition may be confirmed, and data may be combined through time synchronization between image data and audio data based on the time information, and the time information may be Real Time Clock (RTC) information.

In the above, a method of transmitting separated content data in a system according to an embodiment of the present invention through a plurality of communication networks has been described.

In terms of hardware, the content providing server 200 according to an embodiment of the present invention has the same configuration as a conventional web server or network server. However, in terms of software, a program module implemented through a language such as C, C++, Java, Visual Basic, and Visual C is included.

Meanwhile, a memory mounted in each device of the present invention stores information within the device. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in another implementation, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or some other mass storage device.

In addition, the term'~module' used in an embodiment of the present invention refers to a software component, and'~module' performs certain roles. As an example,'~module' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, procedures, and sub It includes routines, segments of program code, drivers, data, databases, data structures, tables, arrays, and variables. In addition, the components and functions provided in the'~modules' may be combined into a smaller number of components and'~modules' or further separated into additional components and'~modules'.

Although the present specification and drawings describe exemplary device configurations, the functional operations and implementations of the subject described in this specification may be implemented with other types of digital electronic circuits, or the structures disclosed herein and structural equivalents thereof. It may be implemented with computer software, firmware, or hardware, or may be implemented by a combination of one or more of them. Implementations of the subject matter described in this specification are one or more computer program products, that is, one relating to computer program instructions encoded on a tangible program storage medium for execution by or for controlling the operation of a device according to the invention It can be implemented as the above module. The computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of materials that affect a machine-readable radio wave signal, or a combination of one or more of them.

Next, among the configurations of the system, a configuration and operation method of the content delivery server 200 according to the present invention will be described.

FIG. 2 is a block diagram showing the main configuration of the content delivery server 200, and FIG. 3 shows an MMT packet structure transmitted from the content delivery server 200 to the content playback device 300 through communication networks 100a-100b. 4 is a diagram illustrating a process of separating image data and audio data from an MMT packet received from the broadcast photographing device 400 by the content delivery server 200 according to an embodiment of the present invention. 5 is a flowchart illustrating a method of operating the content delivery server 200 for achieving the object of the present invention.

First, referring to FIG. 2, the content delivery server 200 according to the present invention may include a storage module 210, a communication module 230, and a control module 250.

The storage module 210 may serve to store content data received from the broadcast photographing device 400.

The communication module 230 is for transmitting and receiving data to and from the content playback device 200 through a plurality of communication networks 100a to 100b, and for receiving content data from the broadcast photographing device 400, the first communication interface 231, A second communication interface 233 and a third communication interface 235 may be included.

Here, the first communication interface 231 interlocks with the first communication network 100a to transmit one of the voice packet and the video packet separated by the control module 250 to the content playback device 300 through the first communication network 100a. The second communication interface 233 interlocks with the second communication network 100b to transmit the remaining packets that have not been transmitted through the first communication network 100a to the content reproducing apparatus 300. In addition, the third communication interface 235 may be connected to the broadcast photographing device 400 through a wired or wireless communication network to receive content captured by the broadcast photographing device 400 from the broadcast photographing device 400.

The control module 250 divides the content data stored in the storage module 210 or received from the broadcast photographing device 400 into video data and audio data, and packetizes each of the content data, thereby providing one of an audio packet and a video packet. It controls to transmit to the content playback device 300 through one communication network, and to transmit another packet to the content playback device 300 through a second communication network.

For example, when the first communication network is a wireless communication network and the second communication network is a Wi-Fi communication network, a packet having a relatively large amount of data can be transmitted through the wireless communication network, and a packet having a relatively small amount of data can be transmitted through the Wi-Fi network. It could be the reverse. The communication network through which each packet separated into a voice packet and a video packet is transmitted may vary depending on the amount of data in the video packet and the voice packet, the user's location or the communication environment of the wireless communication network and the Wi-Fi network based on the current situation. In some cases, it may be determined by the user's choice.

In this case, the voice packet and the video packet may be an MMT packet, and the MMT packet may be composed of a Media Fragment Unit (MFU) and a Media Processing Unit (MPU), and a detailed description of the MMT packet structure is shown in FIG. I will do it through.

The MFU and MPU may include asset ID and time information corresponding to image data or audio data, and the control module 250 includes content data received from the broadcast photographing device 400 based on the asset ID. An MMT packet in which data and voice data are mixed may be separated into voice data and video data, and packetized into voice packets and video packets.

In addition, the control module 250 may adjust the data rates of video packets and audio packets transmitted through the first communication network and the second communication network according to the type of communication networks 100a to 100b. That is, when the first communication network is a wireless communication network such as LTE or 3G, the size of the packet transmitted through the wireless communication network is reduced by a preset capacity in consideration of attaching the GTP header, and the load in the wireless communication network can be reduced. 2 If the communication network is a Wi-Fi network, it is not necessary to consider GTP tunneling, so it can be transmitted with the maximum packet size.

3 is a diagram illustrating a structure of an MMT packet in which the content delivery server 200 divides content data into video data and audio data and packetizes it according to an embodiment of the present invention.

As described above, the MMT package 650 is the largest logically structured MMT entity among the data models defined in the MMT functional area, and refers to one independent content such as a movie. The content delivery server 200 providing the streaming data service may generate such an MMT package and provide it to the content playback device 300. The MMT package 650 has a logically structured collection consisting of a collection of several objects. Can be. The MMT package 650 may include one or more assets 660, presentation information 651, transport characteristics 653, and descriptive information, such as package information.

Among them, the presentation information 651 includes information on a relationship between a plurality of assets 660, that is, a spatial and temporal relationship, and one content is a plurality of MMT packages In case of consisting of, information for indicating a relationship between a plurality of MMT packages may be further included. As for the presentation information 651, a combination of a hypertext markup language (HTML) and a composition information document may be regarded as an example of the presentation information 651.

A transport characteristic (ADC; Asset Delivery Characteristics, 653) represents a QoS (Quality of Service) request and statistics for the delivery of the asset 660. A plurality of assets 660 may be associated with one transport characteristic 653. At this time, the transport characteristic (transmission characteristic) 653 may be used to set the parameters of the MMT payload and the MMT protocol by the entity encapsulating the package for effective delivery of the asset 660. In addition, the transport characteristic 653 may include delivery characteristic information necessary to determine the delivery condition of the MMT asset 660 or the MMT packet, for example, a traffic description parameter and QoS. May include a QoS descriptor. This transmission characteristic information may be expressed in the form of a parameter independent of the communication network environment.

The asset 660 refers to an element of a package that encapsulates encoded media data such as audio, video, or web page data having a timed or non-timed property, and means the largest logical data unit. Such an asset 660 refers to a data entity that includes data with the same transfer characteristics. For example, if the MMT package 650 is the largest entity among the data models defined in the MMT functional area and means one independent content such as a movie, the asset 660 is audio data, video data, and script data. Refers to a data unit constituting the MMT package 650, such as. The asset 660 logically groups MPUs sharing the same asset ID.

Since the MPUs share the same asset ID, it is possible to check whether the audio packet and the video packet received by the content playback device 300 are data constituting the same content, and video data received from the broadcast photographing device 400 The MMT packet in which the and voice data are mixed can be divided into a video packet and an audio packet.

In addition, the MMT packet of the present invention may substantially include an MMT packet header and an MMT payload.

Referring to FIG. 4, the broadcast photographing device 400 photographs broadcast content such as sports relay and transmits the photographed data to the content transmission server 200 in the form of an MMT packet. In this case, broadcast photographing In the MMT payload 501 of the MMT packet transmitted from the device 400, a voice MPU containing voice data and a video MPU containing video data may be mixed, and each MPU has an asset ID 503 ) And time information 505 may be included.

When the content transmission server 200 receives an MMT packet including the MMT payload 501 from the broadcast photographing device 400, the content transmission server 200 transmits an image from the received MMT packet based on the asset ID. Data and voice data may be separated and packetized into a video packet 507 including an MMT payload to be transmitted to a first communication network and a voice packet 509 including an MMT payload to be transmitted to a second communication network.

Looking in detail through FIG. 5, the content delivery server 200 separates the content data input from the broadcast photographing device 400 or stored in the content delivery server 200 into video data and audio data, and separates each of a video packet and an audio packet. Packetized (S101). In addition, the content transmission server 200 transmits the video packet through one of the first communication network and the second communication network, and transmits the audio packet to the remaining communication network. For convenience of explanation, the video packet is transmitted through the first communication network. And, it is assumed that the voice packet is transmitted through the second communication network.

The content transmission device 200 adjusts the data rate before transmitting the video packet and the audio packet to the content reproducing device 300. If the first communication network or the second communication network is a wireless communication network, a GTP header is added. Considering this, the packet size is reduced in advance by the preset capacity and transmitted, and in the case of a Wi-Fi network, since there is no GTP tunneling, the maximum packet size can be transmitted (S103 to S105).

Then, the video packet is transmitted to the content playback device 300 through the first communication network 100a, and the voice packet is transmitted to the content playback device 300 through the second communication network 100b according to the adjusted data rate. It becomes (S107 to S109).

In the above, among the configurations of the system, the configuration and operation method of the content delivery server 200 according to the present invention have been described.

Next, among the configurations of the system, a configuration and operation method of the content reproducing apparatus 300 according to the present invention will be described.

6 is a block diagram showing the main configuration of the content reproducing apparatus 300 according to the present invention, and FIG. 7 is an implementation of a method of combining the audio packet and the video packet received by the content reproducing apparatus 300 according to the present invention. It is an exemplary diagram showing an example, and FIG. 8 is a flowchart showing an operation method of the content reproducing apparatus 300 for achieving the object of the present invention.

Referring to FIG. 6, looking at the main configuration of the content playback device 300, the content playback device 300 includes an input module 310, a storage module 330, a communication module 350, a control module 370, and an output. It may be composed of a module 390.

The input module 310 receives various information such as number and character information, and transmits a signal input to the control module 370 in connection with setting various functions and controlling the functions of the content reproducing apparatus 300. In addition, the input module 310 may be configured to include at least one of a keypad and a touch pad that generate an input signal according to a user's touch or manipulation. In this case, the input module 310 is configured in the form of a single touch panel (or touch screen) together with the output module 390 to simultaneously perform input and display functions. In addition, the input module 310 may use all types of input means that may be developed in the future, in addition to input devices such as a keyboard, keypad, mouse, and joystick. Particularly, the input module 310 according to the present invention detects input information input from a user and transmits it to the control module 370.

In particular, the input module 310 according to the present invention may receive a request from a user to receive content from the broadcast relay system 600 and transmit the request to the control module 370.

The storage module 330 is a device for storing data, and includes a main memory device and an auxiliary memory device, and stores an application program required for a functional operation of the content reproducing device 300. The storage module 330 may largely include a program area and a data area. Here, when activating each function in response to a user's request, the content reproducing apparatus 300 provides each function by executing the corresponding application programs under the control of the control module 370.

The communication module 350 is for transmitting and receiving data to and from the content delivery server 200 through the communication networks 100a to 100b.

In addition, the communication module 350 includes an RF transmission unit for up-converting and amplifying a frequency of a transmitted signal, an RF receiving unit for low-noise amplifying and down-converting a received signal, and a communication protocol according to a specific communication method. And data processing means. The communication module 350 may include at least one of a wireless communication module (not shown) and a wired communication module (not shown). In addition, the wireless communication module is a configuration for transmitting and receiving data according to a wireless communication method, and when the content playback device 300 uses wireless communication, any one of a wireless network communication module, a wireless LAN communication module, and a wireless fan communication module is used. By using, data may be transmitted and received with the content delivery server 200.

In particular, in the present invention, the communication module 350 may be composed of a first communication interface 351 and a second communication interface 353, and the first communication interface 351 is connected to the first communication network 100a to provide content. Data is transmitted and received with the transmission server 200, and the second communication interface 353 is connected to the second communication network 100b to transmit and receive data with the content transmission server 200.

The control module 370 configures the same content by checking whether the video data and audio data included in the video packet and the audio packet received through the communication network 100a ~ 100b by the communication module 350 are data constituting the same content. In the case of data, the video data and audio data are combined and controlled to be reproduced through the output module 390.

In this case, the video packet and the audio packet are MMT packets, and the MFU and MPU included in the video and audio packets include asset ID and time information corresponding to the video data or audio data, and based on the asset ID. It is possible to check whether the video data and the audio data are data constituting the same content, and the data can be combined through time synchronization between the video data and the audio data by using the time information.

7 illustrates an embodiment in which the control module 370 synchronizes time between video data and audio data by using time information, the video packet 701 and the audio packet 707 received by the communication module 350 ) Contains video MPU and audio MPU, respectively, and each MPU contains asset ID (703,709) and time information (705,711).

The control module 370 checks whether the received video packet 701 and the audio packet 707 are data constituting the same content through asset IDs 703 and 709 included in each MPU, and configures the same content. If it is data, time synchronization may be performed by mapping to the presentation timeline based on time information 705 and 711 included in each MPU.

For example, in FIG. 7, voice MPU 1 included in the voice packet 707 includes voice data for a time from t1 to t3 and is mapped to time t1, and time synchronization with video MPU 1 and video MPU 2 is achieved. And, since the voice MPU 2 can be mapped to time t3 including voice data from t3 to a specific time thereafter, time synchronization with the video MPU 3 can be achieved.

The control module 370 completes one content by combining image data and audio data through such time synchronization, and reproduces the completed content through the output module 390.

The output module 390 displays information on a series of operation states and operation results that occur while performing a function of the content reproducing apparatus 300. In addition, the output module 390 may display a menu of the content reproducing apparatus 300 and user data input by a user. Here, the output module 390 is a liquid crystal display (LCD), an ultra-thin liquid crystal display (TFT-LCD, Thin Film Transistor LCD), a light emitting diode (LED), an organic light emitting diode (OLED). Organic LED), an active organic light emitting diode (AMOLED, Active Matrix OLED), a retina display, a flexible display, and a three-dimensional display. In this case, when the output module 390 is configured in the form of a touch screen, the output module 390 may perform some or all of the functions of the input module 310.

In particular, in the present invention, the output module 390 receives and reproduces the content data combined with the control module 370.

Looking at the operation process of the content reproducing apparatus 300 in detail through FIG. 8, the content reproducing apparatus 300 receives an image packet through a first communication network 100a and a voice packet through a second communication network 100b. It can be done (S201 to S203). In this case, the first communication network 100a and the second communication network 100b may be a wireless communication network or a Wi-Fi network, and are configured with different types of communication networks.

The content reproducing apparatus 300 that has received the video packet and the audio packet determines whether the data included in the video packet and the audio packet are data constituting the same content (S205). If the same content is not configured Until data constituting the same content is received, an audio packet or a video packet is received through the first communication network 100a or the second communication network 100b.

In this case, the criterion for determining whether to configure the same content may be an asset ID. The asset ID may be included with time information in the MPU or MFU included in the video packet or the audio packet, and it is determined whether the received video packet and the audio packet contain data constituting the same content by checking the asset ID. I can judge.

If the received video packet and the audio packet constitute the same content, time synchronization between the video data and the audio data may be performed based on time information included in the video packet and the audio packet (S207). When the time synchronization is completed, based on this, the content playback device 300 combines the video data and the audio data to play the content through the output module as one completed content (S209), and the time information is RTC information. I can.

The configuration and operation method of the content playback apparatus 300 according to the present invention have been described above.

The video content providing method according to an embodiment of the present invention as described above may be provided in the form of a computer-readable medium suitable for storing computer program commands and data.

At this time, the program recorded on the recording medium can be read, installed, and executed by a computer to execute the above-described functions.

Here, in order for the computer to read the program recorded on the recording medium and execute the functions implemented as the program, the above-described program is C, C++, which can be read by the computer's processor (CPU) through the computer's device interface. It may include code coded in a computer language such as JAVA and machine language.

This code may include a functional code related to a function defining the above-described functions, and may include a control code related to an execution procedure necessary for the processor of the computer to execute the above-described functions according to a predetermined procedure. In addition, these codes may further include additional information necessary for the processor of the computer to execute the above-described functions, or code related to a memory reference to which location (address address) of the internal or external memory of the computer should be referenced. . In addition, when the computer's processor needs to communicate with any other computer or server in a remote in order to execute the above-described functions, the code is used by the computer's processor using the computer's communication module. It may further include a communication-related code for how to communicate with other computers or servers, and what information or media should be transmitted and received during communication.

Such computer-readable media suitable for storing computer program commands and data include, for example, magnetic media such as hard disks, floppy disks, and magnetic tapes, and compact disk read only memory (CD-ROM). , Optical Media such as DVD (Digital Video Disk), Magneto-Optical Media such as Floptical Disk, and ROM (Read Only Memory), RAM (RAM) , Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). The processor and memory can be supplemented by special purpose logic circuits or incorporated into it.

In addition, the computer-readable recording medium is distributed over a computer system connected through a network, so that computer-readable codes can be stored and executed in a distributed manner. In addition, a functional program for implementing the present invention, and related codes and code segments, etc., are programmers in the technical field to which the present invention pertains in consideration of the system environment of a computer that reads the recording medium and executes the program. May be easily inferred or modified by

Each step according to the embodiments of the present invention may be implemented as instructions executable by a computer and executed by a computing system. Here, "computing system" is defined as one or more software modules, one or more hardware modules, or a combination thereof that operate together with the performance of an operation on electronic data. For example, the definition of a computer system includes a software module such as an operating system of a personal computer and a hardware component of a personal computer. The physical layout of the module is not important. The computer system may include one or more computers connected through a network.

Similarly, the computing system may be implemented as a single physical device in which internal modules such as a memory and a processor operate together with the execution of operations on electronic data.

As explained above, the specification includes details of a number of specific implementations, but these should not be construed as limiting to the scope of any invention or claimable, but rather, which may be specific to a particular embodiment of a particular invention. It should be understood as a description of features. Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination. Furthermore, although features operate in a particular combination and may be initially described as so claimed, one or more features from a claimed combination may in some cases be excluded from the combination, and the claimed combination may be a subcombination. Or sub-combination variations.

Likewise, although operations are depicted in the drawings in a specific order, it should not be understood that such operations must be performed in that particular order or sequential order shown, or that all illustrated operations must be performed in order to obtain a desired result. In certain cases, multitasking and parallel processing can be advantageous. In addition, separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the program components and systems described are generally integrated together into a single software product or packaged in multiple software products. You should understand that you can.

Specific embodiments of the subject matter described herein have been described. Other embodiments are within the scope of the following claims. For example, the operations recited in the claims may be performed in a different order while still achieving desirable results. As an example, the process depicted in the accompanying drawings does not necessarily require that particular depicted order or sequential order to obtain desirable results. In certain implementations, multitasking and parallel processing can be advantageous.

The present description presents the best mode of the present invention, and provides examples for describing the present invention and for enabling those skilled in the art to make and use the present invention. The thus written specification does not limit the present invention to the specific terms presented. Accordingly, although the present invention has been described in detail with reference to the above-described examples, those of ordinary skill in the art can make modifications, changes, and modifications to these examples without departing from the scope of the present invention.

Therefore, the scope of the present invention should not be determined by the described embodiments, but should be determined by the claims.

The present invention relates to a method and apparatus for transmitting separated content data through a plurality of communication networks, and more particularly, to separate content data into video data and audio data, packetize each, and transmit them to a content playback device through different communication networks. And, the present invention relates to a method and apparatus for providing content by combining the audio packet and the video packet by checking whether the audio packet and the video packet received by the content reproducing apparatus constitute the same content, and when the same content is formed.

According to the present invention, video content is separated into video data and audio data and transmitted through a plurality of communication networks, and the content playback device receiving the transmitted data performs time synchronization and collects the data, thereby efficiently using multiple communication networks. Accordingly, it is possible to contribute to the development of the video content providing service industry by providing an effective video content streaming service, for example, a more realistic live polarization broadcast in sports broadcast.

In addition, the present invention is not only sufficiently commercially available or commercially possible, but also has industrial applicability because it can be implemented clearly in reality.

100: a plurality of communication networks 200: content delivery server
300: content playback device 400: broadcast photographing device
500: broadcast relay system

Claims (18)

A communication module including a first communication interface for transmitting/receiving data to and from the content player through a first communication network and a second communication interface for transmitting and receiving data with the content player through a second communication network; And
The content data is divided into video data and audio data and is packetized, and one of an audio packet and a video packet is transmitted to the content playback device through the first communication network, and the content playback device through the second communication network. Includes; a control module for controlling the communication module to be transmitted to,
The video packet and the audio packet are MMT (MPEG Media Transport) packets,
And receiving the content data as an MMT packet in which video data and audio data are mixed, and packetizing video data and audio data by separating from the received MMT packet based on an asset ID. The method of claim 1,
The video data and the audio data are composed of a Media Fragment Unit (MFU), which is a minimum decoding unit included in the payload of the MMT packet, or a Media Processing Unit (MPU) including at least one MFU. Content delivery server. The method of claim 2, wherein the MFU or MPU,
A content delivery server comprising asset ID and time information corresponding to video data or audio data. delete The method of claim 1, wherein the control module
And adjusting a data rate of the video packet and the audio packet transmitted through the first communication network and the second communication network according to the type of the first communication network and the second communication network. The method of claim 5, wherein the control module
When the first communication network or the second communication network is a wireless communication network, a size of a packet transmitted through the wireless communication network is reduced by a preset capacity and transmitted. A communication module including a first communication interface for transmitting and receiving data to and from the content delivery server through a first communication network and a second communication interface for transmitting and receiving data with the content delivery server through a second communication network; And
When a video packet and an audio packet are received from the content transmission server through different communication networks, it is checked whether the video data and audio data included in the video packet and the audio packet are data constituting the same content, and the same content is configured. In the case of data, a control module that combines and reproduces the image data and the audio data; and
The audio packet and video packet are MMT (MPEG Media Transport) packets,
Wherein the control module checks and combines the video data and the audio data, which are packetized by separating based on an asset ID, as data constituting the same content based on the asset ID. The method of claim 7,
The video data and the audio data are composed of a Media Fragment Unit (MFU), which is a minimum decoding unit included in the payload of the MMT packet, or a Media Processing Unit (MPU) including at least one MFU. Content playback device. The method of claim 8, wherein the MFU or MPU,
Includes asset ID and time information corresponding to video data or audio data,
The control module
And combining data through time synchronization between the video data and the audio data based on the time information. Receiving, by the content delivery server, the content data as an MPEG Media Transport (MMT) packet in which video data and audio data are mixed;
Separating and packetizing the video data and audio data based on the asset ID of the received MMT packet;
Transmitting either the packetized video packet or the audio packet to a content playback device through a first communication network, and transmitting another packet to the content playback device through a second communication network
Data transmission method comprising a. The method of claim 10,
The image data and audio data are composed of a media fragment unit (MFU), which is a minimum decoding unit included in the payload of the MMT packet, or a media processing unit (MPU) including at least one MFU,
The MFU or MPU,
A data transmission method comprising asset ID and time information corresponding to video data or audio data. delete The method of claim 10, wherein the transmitting step
And transmitting by adjusting data rates of the video packet and the audio packet transmitted through the first communication network and the second communication network according to the type of the first communication network and the second communication network. Receiving, by a content reproducing apparatus, a video packet and an audio packet in the form of an MPEG Media Transport (MMT) packet through different communication networks;
Determining, based on the asset ID, whether the video data and audio data included in the video packet and the audio packet that are separated and packetized based on the asset ID are data constituting the same content; And
In the case of configuring the same content, combining and playing the video data and audio data
Data transmission method comprising a. The method of claim 14,
The image data and audio data are composed of a media fragment unit (MFU), which is a minimum decoding unit included in the payload of the MMT packet, or a media processing unit (MPU) including at least one MFU,
The MFU or MPU,
A data transmission method comprising asset ID and time information corresponding to video data or audio data. The method of claim 15,
Combining the image data and audio data
And combining data through time synchronization between the video data and the audio data based on the time information. A computer-readable recording medium on which a program for executing the method according to any one of claims 10, 11, 13 to 16 is recorded. A computer program implemented to execute the method according to any one of claims 10, 11, 13 to 16 and stored in a computer-readable recording medium.

Images