EP3314906A1 - Procédé et appareil d'émission et de réception de signaux dans un système multimédia - Google Patents

Procédé et appareil d'émission et de réception de signaux dans un système multimédia

Info

Publication number
EP3314906A1
EP3314906A1 EP16814701.5A EP16814701A EP3314906A1 EP 3314906 A1 EP3314906 A1 EP 3314906A1 EP 16814701 A EP16814701 A EP 16814701A EP 3314906 A1 EP3314906 A1 EP 3314906A1
Authority
EP
European Patent Office
Prior art keywords
event
mmt
information
message
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP16814701.5A
Other languages
German (de)
English (en)
Other versions
EP3314906A4 (fr
Inventor
Hyun-Koo Yang
Byoung-Dai Lee
Young-Sun Ryu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Industry Academic Cooperation Foundation of Kyonggi University
Original Assignee
Samsung Electronics Co Ltd
Industry Academic Cooperation Foundation of Kyonggi University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd, Industry Academic Cooperation Foundation of Kyonggi University filed Critical Samsung Electronics Co Ltd
Priority claimed from PCT/KR2016/006678 external-priority patent/WO2016208988A1/fr
Publication of EP3314906A1 publication Critical patent/EP3314906A1/fr
Publication of EP3314906A4 publication Critical patent/EP3314906A4/fr
Pending legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4345—Extraction or processing of SI, e.g. extracting service information from an MPEG stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/64322—IP
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/654—Transmission by server directed to the client
    • H04N21/6543—Transmission by server directed to the client for forcing some client operations, e.g. recording
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6581—Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8166—Monomedia components thereof involving executable data, e.g. software
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Definitions

  • the present disclosure relates to a method and apparatus for transmitting and receiving a signal in a multimedia system. More particularly, the present disclosure relates to a method and apparatus for transmitting and receiving event information related to an event in a multimedia system.
  • a multimedia service denotes a service such as a conversation service such as videophone, a streaming service such as a video on demand (VOD) service, a multicast and broadcast service, and/or the like.
  • a conversation service such as videophone
  • a streaming service such as a video on demand (VOD) service
  • VOD video on demand
  • a real-time multimedia service may be classified into a conversation service, an interactive service, and a streaming service based on a type of a service.
  • the real-time multimedia service may be classified into unicast, multicast, and broadcast based on the number of users which join the real-time multimedia service.
  • a moving picture experts group-2 transport stream (MPEG-2 TS) is a technology used for transporting multimedia contents, and a typical transport technology for transporting bit streams that a plurality of broadcast programs (a plurality of coded video bit streams) are multiplexed in a transport environment that an error exists.
  • a moving picture experts group (MPEG) media transport technology as one of multimedia transport technologies for supporting a multimedia service based on an MPEG technology has been proposed.
  • a MPEG media transport (MMT) technology is a new technology of an MPEG for providing various types of multimedia services through various terminals such as a television (TV), a mobile device, and/or the like in various types of network environments.
  • the MMT technology may be applied for effectively transporting complex contents through a heterogeneous network.
  • the complex contents denote a collection of contents which have a multimedia element by a video, audio, application, and/or the like.
  • the heterogeneous network may be a network including a broadcast network, a mobile communication network, and the like.
  • a terminal may receive data or file required to run the application program service using the broadcast network or the communication network, and recognize and select the application program service and data related to the application program service.
  • an aspect of the present disclosure is to provide an apparatus and method for transmitting and receiving a signal in a multimedia system.
  • Another aspect of the present disclosure is to propose an apparatus and method for transmitting and receiving event information related to an event in a multimedia system.
  • Another aspect of the present disclosure is to provide an apparatus and method for providing event information related to an event with a multimedia service in a multimedia system.
  • a method of operating a transmitting apparatus in a multimedia system includes transmitting a data unit of a multimedia service including event information related to an event, wherein the event includes notification to an application, the notification indicating that an action is to be taken.
  • a method of operating a transmitting apparatus in a multimedia system includes transmitting first information indicating presence of a data unit of a multimedia service including event information related to an event, wherein the event includes notification to an application, the notification indicating that an action is to be taken.
  • a method of operating a receiving apparatus in a multimedia system includes receiving a data unit of a multimedia service including event information related to an event, wherein the event includes notification to an application, the notification indicating that an action is to be taken.
  • a method of operating a receiving apparatus in a multimedia system includes receiving first information indicating presence of a data unit of a multimedia service including event information related to an event, wherein the event includes notification to an application, the notification indicating that an action is to be taken.
  • a transmitting apparatus in a multimedia system includes a transmitter configured to transmit a data packet of a multimedia service including event information related to an event, wherein the event includes notification to an application, the notification indicating that an action is to be taken.
  • a transmitting apparatus in a multimedia system includes a transmitter configured to transmit first information indicating presence of a data unit of a multimedia service including event information related to an event, wherein the event includes notification to an application, the notification indicating that an action is to be taken.
  • a receiving apparatus in a multimedia system includes a receiver configured to receive a data unit of a multimedia service including event information related to an event, wherein the event includes notification to an application, the notification indicating that an action is to be taken.
  • a receiving apparatus in a multimedia system includes a receiver configured to receive first information indicating presence of a data unit of a multimedia service including event information related to an event, wherein the event includes notification to an application, the notification indicating that an action is to be taken.
  • FIG. 1 schematically illustrates a layer structure of an MPEG media transport (MMT) system according to an embodiment of the present disclosure
  • FIG. 2 schematically illustrates configuration of an MMT payload in an MMT system according to an embodiment of the present disclosure
  • FIG. 3 schematically illustrates a logical structure of an MMT package in an MMT system according to an embodiment of the present disclosure
  • FIG. 4 schematically illustrates an operating process of a terminal for running an application program service in an MMT system according to an embodiment of the present disclosure
  • FIG. 5 schematically illustrates an inner structure of an apparatus for receiving information related to an application program service in an MMT system according to an embodiment of the present disclosure
  • FIG. 6 schematically illustrates a process for processing event information based on an MMT signaling message in an MMT system according to an embodiment of the present disclosure
  • FIG. 7 schematically illustrates a process for processing event information based on a media processing unit (MPU) in an MMT system according to an embodiment of the present disclosure
  • FIG. 8 schematically illustrates an inner structure of a transmitting apparatus in an MMT system according to an embodiment of the present disclosure.
  • FIG. 9 schematically illustrates an inner structure of a receiving apparatus in an MMT system according to an embodiment of the present disclosure.
  • first a first component
  • second a second component
  • first component a first component
  • second component a second component
  • an electronic device may include communication functionality.
  • an electronic device may be a smart phone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook PC, a personal digital assistant (PDA), a portable multimedia player (PMP), an moving picture experts group phase 1 or phase 2 (MPEG-1 or MPEG-2) audio layer 3 (MP3) player, a mobile medical device, a camera, a wearable device (e.g., a head-mounted device (HMD), electronic clothes, electronic braces, an electronic necklace, an electronic accessory, an electronic tattoo, or a smart watch), and/or the like.
  • PDA personal digital assistant
  • PMP portable multimedia player
  • MPEG-1 or MPEG-2 moving picture experts group phase 1 or phase 2
  • MP3 audio layer 3
  • an electronic device may be a smart home appliance with communication functionality.
  • a smart home appliance may be, for example, a television, a digital versatile disc (DVD) player, an audio, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washer, a dryer, an air purifier, a set-top box, a TV box (e.g., Samsung HomeSync TM , Apple TV TM , or Google TV TM ), a gaming console, an electronic dictionary, an electronic key, a camcorder, an electronic picture frame, and/or the like.
  • DVD digital versatile disc
  • an electronic device may be a medical device (e.g., magnetic resonance angiography (MRA) device, a magnetic resonance imaging (MRI) device, computed tomography (CT) device, an imaging device, or an ultrasonic device), a navigation device, a global positioning system (GPS) receiver, an event data recorder (EDR), a flight data recorder (FDR), an automotive infotainment device, a naval electronic device (e.g., naval navigation device, gyroscope, or compass), an avionic electronic device, a security device, an industrial or consumer robot, and/or the like.
  • MRA magnetic resonance angiography
  • MRI magnetic resonance imaging
  • CT computed tomography
  • imaging device an imaging device
  • ultrasonic device ultrasonic device
  • GPS global positioning system
  • EDR event data recorder
  • FDR flight data recorder
  • automotive infotainment device e.g., a navigation device, a global positioning system (GPS) receiver, an event data recorder (
  • an electronic device may be furniture, part of a building/structure, an electronic board, electronic signature receiving device, a projector, various measuring devices (e.g., water, electricity, gas or electro-magnetic wave measuring devices), and/or the like that include communication functionality.
  • various measuring devices e.g., water, electricity, gas or electro-magnetic wave measuring devices
  • an electronic device may be any combination of the foregoing devices.
  • an electronic device according to various embodiments of the present disclosure is not limited to the foregoing devices.
  • a terminal may be an electronic device.
  • a transmitting apparatus may be a service provider or a terminal.
  • a receiving apparatus may be a terminal or a service provider.
  • a transmitting and receiving apparatus may be a terminal or a service provider.
  • terminal may be interchangeable with the term mobile station (MS), wireless terminal, mobile device, user equipment (UE), and/or the like.
  • An embodiment of the present disclosure proposes an apparatus and method for transmitting and receiving a signal in a multimedia system.
  • An embodiment of the present disclosure proposes an apparatus and method for transmitting and receiving event information related to an event in a multimedia system.
  • An embodiment of the present disclosure proposes an apparatus and method for providing event information related to an event with a multimedia service in a multimedia system.
  • An apparatus and method proposed in an embodiment of the present disclosure may be applied to various communication systems such as a long term evolution (LTE) mobile communication system, an LTE-advanced (LTE-A) mobile communication system, a licensed-assisted access (LAA)-LTE mobile communication system, a high speed downlink packet access (HSDPA) mobile communication system, a high speed uplink packet access (HSUPA) mobile communication system, a high rate packet data (HRPD) mobile communication system proposed in a 3 rd generation partnership project 2 (3GPP2), a wideband code division multiple access (WCDMA) mobile communication system proposed in the 3GPP2, a code division multiple access (CDMA) mobile communication system proposed in the 3GPP2, an institute of electrical and electronics engineers (IEEE) 802.16m communication system, an IEEE 802.16e communication system, an evolved packet system (EPS), and a mobile internet protocol (Mobile IP) system, a digital video broadcast system such as a mobile broadcast service such as a digital multimedia broadcasting (DMB) service, a
  • a method and apparatus proposed in an embodiment of the present disclosure may be applied to an advanced television systems committee (ATSC) system which is based on an MMT scheme.
  • ATSC advanced television systems committee
  • a multimedia system is based on an MMT scheme.
  • An MMT protocol defines an application layer protocol for delivering a delivery frame including an MMT payload format (PF) through an internet protocol (IP) network.
  • An MMT payload includes an MMT payload format, and is designed thereby effectively being delivered.
  • An MMTP defines encapsulation formats, delivery protocols, and signaling message formats for effectively delivering MPEG media data through heterogeneous IP networks.
  • An MMT technology defines a data model such as a package, an asset, and the like.
  • the package denotes independent contents such as one movie
  • the asset denotes a logical entity classifying elements such as an image, a voice, data, and/or the like included in contents.
  • one package may include a plurality of assets.
  • asset may be interchangeable with the term MMT asset
  • package may be interchangeable with the term MMT package.
  • a layer structure of an MMT system according to an embodiment of the present disclosure will be described with reference to FIG. 1.
  • FIG. 1 schematically illustrates a layer structure of an MMT system according to an embodiment of the present disclosure.
  • a layer structure of an MMT system configures a multimedia data packet, and includes a media coding layer 110 which transfers the multimedia data packet, an encapsulation function layer 120, a delivery function layer 130, a transport protocol layer 140, an IP layer 150, and an control function layer 100.
  • the term encapsulation function layer may be interchangeable with the term Layer E
  • the term delivery function layer may be interchangeable with the term Layer D
  • the term control function layer may be interchangeable with the term Layer C.
  • the media coding layer 110 and the encapsulation function layer 120 operate as a multimedia data generator which generates multimedia contents and/or multimedia data according to a multimedia service.
  • the delivery function layer 130 operates as a multimedia data configuring unit which configures a multimedia data packet based on multimedia data input from a multimedia data generator.
  • the delivery function layer 130 which corresponds to the multimedia data configuring unit configures header information by identifying at least one multimedia data provided from the multimedia data generator, and configures a multimedia data packet by combining the header information and the at least one multimedia data.
  • Multimedia data compressed in the media coding layer 110 is packaged as a format similar to a file format through the encapsulation function layer 120. That is, the encapsulation function layer 120 generates a data segment as a unit for an MMT service based on coded media data or stored media data provided from the media coding layer 110, and generates access units for the MMT service using the data segment.
  • an access unit denotes the smallest media data entity to which timing information is attributed.
  • the encapsulation function layer 120 generates a packet format for generation, storage, and transport of complex contents by combining and/or dividing the access units.
  • the delivery function layer 130 converts a data unit(s) output from the encapsulation function layer 120 into an MMT payload format, and adds an MMT transport packet header to the MMT payload format to configure an MMT transport packet or configures a real-time protocol (RTP) packet using an RTP as an existing transport protocol.
  • RTP real-time protocol
  • a packet, i.e., an MMT transport packet or an RTP packet, configured in the delivery function layer 130 is generated as an IP packet in the IP layer 150 after passing the transport protocol layer 140 which supports a protocol such as a user datagram protocol (UDP) or a transport control protocol (TCP), and the generated IP packet is transported.
  • the transport protocol layer 140 and the IP layer 150 may operate as a data transporter.
  • control function layer 100 which may optionally exist generates control information or signaling information necessary for transport of data and transmits the control information or signaling information with the data, or transmits the control information or signaling information using an individual signaling means.
  • the MMT payload format generated in the delivery function layer 130 defines a logical structure of a media unit(s) to be delivered by an MMT protocol or an RTP.
  • An MMT payload is specified by a payload format for delivering an encapsulated data unit or other information according to MMT layer protocols or other existing application transport protocols.
  • the MMT payload provides information on streaming and information on file transfer.
  • a data unit may be an MMT media fragment unit (MFU) or an MMT media processing unit (MPU).
  • MFU MMT media fragment unit
  • MPU MMT media processing unit
  • a data unit may be an MMT asset and an MMT package.
  • a layer structure of an MMT system according to an embodiment of the present disclosure has been described with reference to FIG. 1, and configuration of an MMT payload in an MMT system according to an embodiment of the present disclosure will be described with reference to FIG. 2.
  • FIG. 2 schematically illustrates configuration of an MMT payload in an MMT system according to an embodiment of the present disclosure.
  • an MMT payload 200 may include at least one of at least one MMT MFU 210, at least one MMT MPU 220, at least one MMT asset 230, and an MMT package.
  • the MMT MFU 210 is independent from any media CODEC, and denotes a generic container including coded media data which is independently decodable by a media decoder.
  • the MMT MFU 210 denotes a fragment of the MMT MPU 220, and is a minimum unit which is independently decodable. For example, if a coding operation is performed using one frame as an access unit, the MMT MFU 210 may be one video frame, or one slice included in one frame.
  • the MMT MPU 220 is a container including one or more MMT MFUs and additional information delivery and processing, and may include various number of MMT MFUs generated from different access units.
  • the MMT MPU 220 denotes a coded media data unit which is completely and independently decodable by an MMT compliant entity, and may have a specific size according to an application environment. For example, in video, the MMT MPU 220 may have a size of 1 group of picture (GOP).
  • the MMT MPU 220 may include a plurality of picture frames included in 1 GOP, and the MMT MFU (210) may include each picture frame. For example, 1 GOP may be video of 1 second.
  • the MMT asset 230 is a data entity which is composed of one or more MMT MPUs, and is the largest data unit to which the same MMT composition information (MMT-CI) or MMT transport characteristics (MMT-TC) is applied.
  • the MMT asset 230 includes only one type of data including packaged or multiplexed data.
  • each MMT asset 230 may be one of at least part of an elementary stream of audio, a MPEG user interface (MPEG-U) widget package, at least part of an MPEG-2 transport stream, at least part of an MPEG-4 (MP4) file, and all or least part of an MMT package.
  • MPEG-U MPEG user interface
  • an elementary stream may be interchangeable with the term ES
  • the term transport stream may be interchangeable with the term TS
  • the term MMT-CI may be interchangeable with the term CI
  • the term MMT-TC may be interchangeable with the term transport characteristics (TC).
  • an elementary stream is defined by a specific media CODEC, and may be logically one or more MMT assets.
  • the MMT asset 230 which supports a layered CODEC and a multi-view CODEC may overlap with other MMT assets.
  • the MMT-CI denotes information which defines spatial and temporal relationship of MMT assets, and the MMT-TC defines a quality of service (QoS) required for delivering MMT assets.
  • QoS quality of service
  • the MMT-TC may be expressed as asset delivery characteristics (ADC) for a specific delivery environment.
  • the MMT package 240 is defined as a collection of coded media data and related information which is processed by an MMT compliant entity.
  • FIG. 3 schematically illustrates a logical structure of an MMT package in an MMT system according to an embodiment of the present disclosure.
  • an MMT package 300 includes one or more MMT assets 320 and one or more ADCs 330 indicating MMT-CI 310 and MMT-TC.
  • the MMT package 300 includes description information such as an identifier (ID) and location information of the MMT assets 320, and the MMT assets 320 within the MMT package 300 may be multiplexed or concatenated.
  • ID an identifier
  • location information of the MMT assets 320 may be multiplexed or concatenated.
  • Processing for the MMT package 300 may be performed on an MPU basis.
  • the one or more MMT assets 320 is a collection of one or more MPUs which has the same MMT asset ID, and TC related to each of the one or more MMT assets 320 is expressed by the one or more ADCs 330.
  • the one or more ADCs 330 may be used for configuring parameters of an MMT payload and header information of an MMT packet by an entity which packetizes the MMT package 300.
  • an MMT signaling function area defines a message format related to media consumption and media delivery.
  • messages related to media consumption provide information required for consuming transported media data, and these are defined as the following.
  • a package access (PA) message which is used for a use similar to a program map table (PMY) of an MPEG-2 TS includes all information required for presenting a transported package.
  • the PA message is a message which needs to be firstly transmitted for receiving and consuming an MMT package, and individual information may be updated through an additional message.
  • a media presentation information (MPI) message which provides expression information is used for transmitting various expression information such as CI defined in an international organization for standardization (ISO)/international electronical committee (IEC) 23008-11, media presentation description (MPD) defined ISO/IEC 23009-1, and/or the like.
  • ISO international organization for standardization
  • IEC international electronical committee
  • MPD media presentation description
  • An MMT package table (MPT) message provides information on a transported MMT package.
  • the MPT message provides an ID of the MMT package, MMT asset information included in the MMT package, and the like.
  • MPT may be interchangeable with the term MMT package (MP) table.
  • a clock relation information (CRI) message provides mapping information between a network time protocol (NTP) time stamp and a system timing clock (STC) of an MPEG-2 for synchronization between an MMT asset and an MPEG-2 ES.
  • NTP network time protocol
  • STC system timing clock
  • a device capability information (DCI) message provides terminal performance information required for media consumption.
  • an innovative technology which enables the next generation broadcast and multimedia service such as a high-definition immersive broadcast technology such as a ultra high-definition television (UHDTV), a 3-dimenstion TV (3DTV), a multi-view TV, and the like, an N-screen service technology for organically using various types of fixed and portable multimedia devices, and the like, as well as broadcast-communication convergence, and a development of transport network, has been proposed.
  • a high-definition immersive broadcast technology such as a ultra high-definition television (UHDTV), a 3-dimenstion TV (3DTV), a multi-view TV, and the like
  • UHDTV ultra high-definition television
  • 3DTV 3-dimenstion TV
  • multi-view TV multi-view TV
  • An application program service which provide various additional information by interworking with a broadcast program or independently provides various additional information based on a hybrid transport technology which enables a convergence-type multimedia service by causing that a broadcast network and a communication network organically interwork is regarded as an essential success factor of the next generation broadcast service, as well as provision of image contents in which reality and realism are maximized.
  • application program service may be interchangeable with the term application.
  • a typical one of an application program service includes a viewer-participation service, for example, a text message, a quiz, a poll, a survey, a popularity vote, and the like, electronic commerce such as ticket reservation, auction, an electronic coupon, mobile download, and the like, an application program service which may be provided independently from a broadcast program such as weather, sports, and games, a portal service, targeted advertisements, and the like.
  • a viewer-participation service for example, a text message, a quiz, a poll, a survey, a popularity vote, and the like
  • electronic commerce such as ticket reservation, auction, an electronic coupon, mobile download, and the like
  • an application program service which may be provided independently from a broadcast program such as weather, sports, and games
  • a portal service targeted advertisements, and the like.
  • signaling information is required for receiving data or file required to run the application program service using a broadcast network or a communication network, and recognizing and selecting the application program service and related data.
  • the signaling information related to the application program service may be classified to two types. That is, the signaling information may be classified into signaling information which provides the overall attribute for an individual service such as an application program service list, an application program service name, transport information, and the like, and event information which controls an operation of an application program service.
  • An application program service which interworks with a broadcast program may provide more various and rich broadcast service by transporting event information with the broadcast program.
  • an event includes notification, for example, timed notification to an application program service, the timed notification indicating that an action is to be taken.
  • FIG. 4 schematically illustrates an operating process of a terminal for running an application program service in an MMT system according to an embodiment of the present disclosure.
  • an operating process of a terminal shown in FIG. 4 is an operating process of a terminal for running an application program service for providing a targeted advertisement at specific time.
  • a terminal receives audio streams and video streams of a requested broadcast program (shown as "Show X" in FIG. 4) from a service provider and presents the audio streams and video streams at operation 405.
  • the terminal acquires signaling information on an application program service related to the broadcast program through an application information stream as a channel which provides signaling related to an application program service, and receives data required for running the application program service using a broadcast network or a communication network, if any, at operation 410.
  • signaling information and data for an application program service may be referred to as application information.
  • the terminal receives event information transmitted through an event stream as a channel which provides an event while presenting the broadcast program, and performs an operation according to the received event information at operation 415.
  • the terminal receives event information related to running of an application program service Y which provides additional information of an advertised product at a specific part of the Show X, for example, at time when an advertisement starts.
  • the terminal runs the application program service Y, i.e., an advertisement service, based on the event information at operation 420.
  • the terminal terminates the application program service Y at operation 425.
  • An MMT system defines various signaling messages related to media consumption and media delivery.
  • signaling messages which have been proposed up to now provide configuration information for a package and information required for receiving each asset included in the package.
  • An MPT used in an MPT message defines configuration information for each asset included in a package and location information required for receiving each asset. Additional information other than basic information such as the configuration information for each asset and the location information required for receiving each asset is provided using a descriptor, and an MPT message defines a container format which may store various descriptors.
  • MPEG CI which may be used in an MPI table may include location information on a logical screen of a terminal and time information related to presentation of each asset included in a package.
  • the main object of the MPEG CI is to provide control information an asset which is transported based on an MMT scheme, and may be difficult to be applied to an application program service which is transported through a transport protocol other than an MMT protocol.
  • an embodiment of the present disclosure proposes a scheme for transmitting information related to an application program service and event information for controlling an operation of the application program service based on an MMT scheme, and this will be described below.
  • FIG. 5 schematically illustrates an inner structure of an apparatus for receiving information related to an application program service in an MMT system according to an embodiment of the present disclosure.
  • the apparatus for receiving the information related to the application program service may a terminal.
  • the apparatus includes a data receiver 505, a controller 500, a signaling information database (DB) 560, and a service display 570.
  • DB signaling information database
  • the data receiver 505 may include at least one of an MMT data receiver 510, a real-time object delivery over unidirectional transport (ROUTE) data receiver 515, a hypertext transfer protocol (HTTP) data receiver 520, and an XXX data receiver 525 in order to receive a packet transported through a communication network or broadcast network based on at least one of transport protocols such as an MMT protocol, a ROUTE protocol, and an HTTP, and outputs a received packet to a file data receiver 530, a media data receiver 540, or a signaling data receiver 550 based on a type of the received packet.
  • the XXX data receiver 525 denotes a data receiver for receiving a packet transported based on a transport protocol other than the MMT protocol, the ROUTE protocol, and the HTTP.
  • the file data receiver 530 acquires data included in the packet by processing the packet output from the data receiver 505, and outputs the data to a file processor 535.
  • the file data receiver 530 receives an MMTP packet transported in a generic file delivery (GFD) mode defined in an MMT scheme, configures an MMTP payload based on the MMTP packet, and outputs the MMTP payload to the file processor 535.
  • the file data receiver 530 receives a packet transported through one of various file transport protocols, extracts desired data from the received packet, and outputs the extracted data to the file processor 535.
  • the file processor 535 configures files based on the data output from the file data receiver 530.
  • Each of the media data receiver 540 and the media processor 545 processes media data.
  • the media processor 545 may process media data transported in an MPU mode of an MMTP.
  • the media data receiver 540 generates an MPU by configuring an MMTP payload based on an MMTP packet output from the MMT data receiver 510 within the data receiver 505, and the media processor 545 presents the MPU through the service display 570.
  • the file processor 535 In a case that media data is transported through a file, the file processor 535 outputs a media file to the media processor 545, and the media processor 545 presents the media file through the service display 570.
  • the media processor 545 may process the media data transported based on a ROUTE protocol. At this time, the media processor 545 generates a DASH segment by processing a ROUTE packet output from the ROUTE data receiver 515, and presents the DASH segment through the service display 570.
  • DASH dynamic adaptive streaming over HTTP
  • the media data receiver 540 may output a media file to the media processor 545 after generating all of the media file following ISO base media file format (ISOBMFF) like an MPU or a DASH segment, or output a part of a media file to the media processor 545 before generating all of the media file in order to decrease time required for channel change.
  • ISO base media file format ISO base media file format
  • a packet output from the data receiver 505 includes signaling information
  • the packet is output to the signaling data receiver 550 thereby being used for the signaling data receiver 550 to reconfigure signaling information.
  • the signaling information is output to the signaling processor 555, and an additional operation is performed according to the signaling information. For example, if the signaling information is transported based on an MMTP, the signaling data receiver 550 receives an MMTP packet including signaling information from the MMT data receiver 510, and reconfigures an MMTP payload based on the received MMTP packet, and the signaling processor 555 parses the signaling information included in the MMTP payload to store necessary information at the signaling information DB 560.
  • the signaling processor 555 inputs a file including signaling information output from the file processor 535, and parses the signaling information from the file to store necessary information at the signaling information DB 560.
  • the signaling processor 555 interacts with other configuration elements based on the parsed signaling information to perform an additional operation. For example, upon receiving signaling information related to an application program service, the signaling processor 555 outputs information which is required for receiving data required for running the application program service to the file data receiver 530 thereby the file data receiver 530 receives the data required for running the application program service.
  • event information related to control for an application program service may be transmitted through a dedicated signaling channel or media data. That is, the event information related to the control for the application program service may be included in the media data.
  • the event information related to the control for the application program service may be transmitted through a signaling message or an MPU including media data. That is, in the MMT scheme, the event information related to the control for the application program service may be included in the MPU.
  • signaling information may be transmitted through an MPD or a DASH segment including media data. That is, in the DASH scheme, the signaling information may be included in an MPD or a DASH segment.
  • the media data receiver 540 extracts the event information and outputs the event information to the signaling processor 555 thereby the event information is output to the application program manager 565 and the event information is used for controlling an operation of an application program service.
  • the application program manager 565 stores and manages the overall information for an application program service, manages an operation of each application program service, and displays information on each application program service through the service display 570. For this, the application program manager 565 interacts with the signaling processor 555 and the file processor 535 to receive data and signaling information required for providing the application program service.
  • Information related to an application program service includes main attributes for an application program service such as a name, a transport scheme, a life cycle, and the like of the application program service.
  • an application information table (AIT) message as a signaling message transmitted through an MMT signaling session may be used for transmitting information related to an application program service.
  • AIT application information table
  • AI table an application information table
  • Table 1 shows an example of an AIT message and a format of an AI table included in the AIT message.
  • a message_id field indicates an ID of the AIT message
  • a version field indicates a version of the AIT message
  • a length field indicates a length of the AIT message.
  • the length field indicates a length from the next location next after the length field to end of the AIT message, and may be expressed as, for example, a length in bytes.
  • a message_payload field indicates a payload of the AIT message
  • an AI_table() field includes an AIT
  • the AIT message may further include an ID for identifying a service to which the AIT message is applied.
  • the AIT message may further include a 1-bit flag indicating whether a uniform resource identifier (URI) for identifying the AIT message exists at an extension part. For example, if the 1-bit flag is on, a field indicating the URI may be further included in the AIT message.
  • URI uniform resource identifier
  • Information on all application program services included in an MMT package may be transmitted through one AI table or a plurality of AI tables.
  • an AI table including the information on all application program services may be referred to as complete AI table, and an AI table including a part of the information on all application program services may be referred to as subset AI table.
  • Each subset AI table is included in an independent AIT message.
  • Table 2 indicates an example of a format of an AI table.
  • a table_id field indicates a table_id
  • the table_id denotes an ID of an AI table.
  • a complete AI table and a subset AI table may have different table_ids.
  • a value of the table_id field is sequentially allocated, so a subset AI table number of a subset AI table may be calculated based on the table_id field.
  • the subset AI table number may be calculated as "table_id - table_id of a base subset AI table”.
  • the base subset AI table denotes a subset AI table of which a subset AI table number is 0.
  • subset AI table numbers from 1 to 14 indicate subset AI tables, not the base subset AI table, and a subset AI table number 15 indicates a complete AI table.
  • a version field indicates a version of an AI table. If an AI table of a new version is received, an AI table is changed from an AI table of an existing version to the AI table of the new version.
  • the version field may be analyzed identically to a version field included in an MPI table among existing MMT signaling tables (if the table_id field indicates a complete AI table, and if a value of a table_id field included in a subset-0 AI table is the same as the value of the table_id field (when a value of an AI_table_mode field is 1), or if all subset AI tables with lower-subset AI table numbers have the same version value of the value of the table_id field (when a value of an AI_table_mode field is 0), or if processing of the subset AI tables is independent (when a value of an AI_table_mode field is 2)).
  • an AI_table_mode field indicates an AI_table_mode indicating a processing scheme of a fragmented AI table in a case that an AI table is fragmented, and is used similar to a PI_mode field included in an MPI table among existing MMT signaling tables. A detailed description of the PI_mode field will be omitted herein.
  • subset-0 AI table has a newer version
  • all subset AI tables with higher subset AI table number up to 14 previously stored within an MMT receiving entity are treated as outdated except for a case that an AI_table_mode is independent mode.
  • the MMT receiving entity includes a terminal. If the subset AI table number is not 0 and a value of the AI_table_mode is 1, contents of the subset AI table with a version different from a version of a subset-0 AI table stored in the MMT receiving entity will be ignored.
  • subset AI table number is not 0 and a value of the AI_table_mode is field 0, contents of a subset AI table with a version different from versions of subset AI tables with lower-subset AI table numbers stored in the MMT receiving entity will be ignored. It will be modulo-256 incremented per version change.
  • a length field indicates a length of an AI table, and indicates a length from the location after the length field to end of the AI table.
  • the length field may indicate a length in bytes.
  • a sequential_order_processing_mode if a subset AI table number of the AI table is not 0, the MMT receiving entity will receive all subset AI tables with lower subset AI table number that have the same version as the AI table before processing the AI table. For example, the MMT receiving entity may not process a subset-3 AI table if the MMT receiving entity does not receive a subset-2 AI table with the same version.
  • an order_irrelevant_processing_mode if a subset AI table number of the AI table is not 0, the MMT receiving entity needs to immediately process the AI table after receiving the AI table as long as a subset-0 AI table stored in the MMT receiving entity has the same version as the AI table.
  • versions of each of subset AI tables are managed individually. In the independent_processing_mode, a fragmented AI table is applied.
  • an AI_table_descriptor_bytes field indicates a descriptor of the AI table
  • an AI_count field indicates the number of application program services included in the AI table
  • an application_attributes() field indicates an attribute of each application program service.
  • the AI table may include various attributes related to an application program service, and the various attributes are included in the application_attributes() field.
  • the various attributes may include a name of an application program service, transport information and a priority of data related to the application program service, and the like.
  • Table 4 shows an example of an application_attributes().
  • information related to an application program service may be transmitted through an MPT message as a signaling message related to an MMT package.
  • An MPT message includes a descriptor indicating whether an application program service exists within an MMT package.
  • a terminal needs to receive an MPT message for presenting a broadcast message transported based on an MMT scheme, and may more quickly detect whether there is the application program service since the descriptor indicating whether the application program service exists is included in the MPT message.
  • the terminal may acquire detailed information related to the application program service by receiving the described AIT message.
  • the MPT message may further include information which needs to be firstly provided to the terminal among information included in an AIT, if any, in addition to notification of whether the application program service exists.
  • the information which needs to be firstly provided may be information useful for performance improvement, quality of experience (QoE) improvement of the terminal, and/or the like.
  • Table 5 shows an example of a format of an application_service_descriptor as a descriptor which may be included in an MPT message.
  • a descriptor_tag field indicates a tag for identifying an inband_event_descriptor field
  • a descriptor_length field indicates a length of the inband_event_descriptor field
  • an application_service_descriptor field indicates whether an application program service exists within a package. For example, if a value of the application_service_descriptor field is 0, it means that the application program service does not exist within the package. If the value of the application_service_descriptor field is 1, it means that the application program service exists within the package. Information related to the application program service is transmitted through an AIT message.
  • Event information may be transmitted based on two schemes according to whether time at which an event occurs may be known in advance.
  • time at which an event occurs may be known in advance such as recorded broadcast, a static event transmitting scheme is used.
  • a dynamic event transmitting scheme is used.
  • the event information is notified to an application program service.
  • event information may be transmitted through an MMT signaling message transmitted through an MMT signaling channel, i.e., an application event information (AEI) message.
  • AEI application event information
  • the AEI message may be applied to both a static event transmitting scheme and a dynamic event transmitting scheme.
  • event information may be included in media data in which an event occurs, for example, an MPU.
  • Tables 6 and 7 shows an example of a format of an MMT signaling message including event information, for example, an AEI message and an application event (AE) table included in the AEI message.
  • event information for example, an AEI message and an application event (AE) table included in the AEI message.
  • AE application event
  • a message_id field indicates an ID of the AEI message
  • a version field indicates a version of the AEI message
  • a length field indicates a length of the AEI message.
  • the length field indicates a length from the location after the length field to end of the AEI message.
  • the length field may indicate a length in bytes.
  • An AE_table() field includes an AE table.
  • the AEI message may further include an ID for identifying a service to which the AEI message is applied at an extension part.
  • the AEI message may further include a 1-bit flag indicating whether a URI for identifying the AEI message at the extension part. If the 1-bit flag is on, a field indicating the URI may be further included in the AEI message.
  • a table_id field indicates an ID of an AE table.
  • a version field indicates a version of the AE table
  • a length field indicates a length of the AE table.
  • the length field indicates a length from the next location after the length field to end of the AE table. For example, the length field may indicate a length in bytes.
  • a number_of_app_events field indicates the number of events included in the AE table, and an AE_descriptor() field includes information of each event.
  • Event information is stored at an AE_descriptor() field, and may include various information related to the event such as an ID of an application program service related to the event, time and duration to which the event is applied, an event operation, and the like.
  • Table 8 shows an example of an AE_descriptor().
  • a descriptor_tag field indicates a tag for identifying an AE_descriptor()
  • a descriptor_length field indicates a length of the AE_descriptor()
  • an application_identifier() field indicates a unique ID of an application to which an event will be applied.
  • Table 9 shows an example of a format of an application_identifier() field.
  • a scheme_id_uri_length field indicates a length of a scheme_id_uri.
  • the scheme_id_uri_length field may indicate a length in bytes.
  • a scheme_id_uri field defines meaning and grammar of a value transmitted through an event_data field
  • an event_value_length field indicates a length of the event_data field.
  • the event_value_length field may indicate a length in bytes.
  • an event_value field indicates an event value. A range and meaning of the event value are determined by the scheme_id_uri.
  • an event_id field indicates a unique ID of an event
  • an event_presentation_time field indicates media presentation time to which an event will be applied
  • an event_duration field indicates media presentation time during which an event is available
  • an event_data indicates event contents.
  • event information may be transmitted through media data.
  • media data is included in an MPU, and the MPU follows an ISOBMFF structure.
  • Event information may be included in an evti box included in the MPU, and an example of a format of the evti box is shown in Table 10.
  • Quantity Zero or more
  • ⁇ heme_id_uri field defines meaning and grammar of a value transmitted through an event_data field, and an event_value field includes an event value.
  • a range and meaning of the event value is determined by a scheme_id_uri.
  • an event_id field indicates a unique ID of an event
  • an event_presentation_time_delta field indicates difference between time at which an MPU is presented and time at which media to which the event will be applied, i.e., the MPU, is presented. That is, the event_presentation_time_delta field indicates start time of the event.
  • An event_duration field indicates presentation time of media during which an event is available, i.e., a duration of the event, and an event_data field indicates event contents, i.e., an action initiated by the event.
  • an application_identifier field indicates an ID of an application program service to which the event will be applied.
  • event information is transmitted through an MPU included in an asset
  • MMT signaling information may be used for informing that the event information is included in the MPU included in the asset.
  • an MP table transmitting MMT package information includes an inband_event_descriptor as a descriptor used at an asset-level.
  • a terminal may detect that event information is included in an MPU included in an asset by receiving an inband_event_descriptor through an MP table. Upon detecting that the event information is included in the MPU included in the asset, the terminal receives the MPU and acquires event information from an evti box included in the MPU.
  • Table 11 shows an example of a format of an inband_event_descriptor.
  • a descriptor_tag field indicates a tag for identifying an inband_event_descriptor
  • a descriptor_length field indicates a length of the inband_event_descriptor
  • a scheme_id_uri_length field indicates a length of a scheme_id_uri
  • a scheme_id_uri field defines meaning and grammar of a value transmitted through an event_data field.
  • the scheme_id_uri_length field may indicate a length in bytes.
  • an event_value_length field indicates a length of an event_data field
  • an event_value field includes an event value.
  • the event_value_length field may indicate a length in bytes.
  • a range and meaning of the event value is determined by a scheme_id_uri.
  • FIG. 6 schematically illustrates a process for processing event information based on an MMT signaling message in an MMT system according to an embodiment of the present disclosure.
  • a terminal detects that a service is selected at operation 605.
  • the terminal monitors reception of an MMT signaling message related to the service, and parses a received MMT signaling message related to the service upon receiving the MMT signaling message at operation 610.
  • the terminal determines whether the MMT signaling message includes an AIT message at operation 615.
  • the terminal presents a video/audio stream of the selected service at operation 620.
  • the terminal receives data related to an application program service based on an AI table included in the AIT message at operation 625.
  • the terminal may determine time that the terminal starts receiving data related to an application program service, whether the terminal immediately runs the application program service, and the like based on attributes of an application program included in the AI table and an input parameter at operation 625.
  • the terminal monitors reception of an AEI message as a signaling message including event information, and acquires information on event applied time from an AE table included in a received AEI message upon receiving the AEI message.
  • the terminal determines whether it reaches the event applied time at operation 630.
  • the terminal performs a control operation for the application program service based on an event at operation 635.
  • the control operation for the application program service may include an operation for initiating the application program service, an operation for terminating the application program service, and/or the like.
  • the terminal proceeds to operation 620.
  • FIG. 6 illustrates a process for processing event information based on an MMT signaling message in an MMT system according to an embodiment of the present disclosure
  • various changes could be made to FIG. 6.
  • various operations in FIG. 6 could overlap, occur in parallel, occur in a different order, or occur multiple times.
  • a process for processing event information based on an MMT signaling message in an MMT system according to an embodiment of the present disclosure has been described with reference to FIG. 6, and a process for processing event information based on an MPU in an MMT system according to an embodiment of the present disclosure will be described with reference to FIG. 7.
  • FIG. 7 schematically illustrates a process for processing event information based on an MPU in an MMT system according to an embodiment of the present disclosure.
  • a terminal detects that a service is selected at operation 705.
  • the terminal monitors reception of an MMT signaling message related to the service, and parses a received MMT signaling message related to the service upon receiving the MMT signaling message at operation 710.
  • the terminal determines whether the MMT signaling message includes an AIT message at operation 715.
  • the terminal presents a video/audio stream of the selected service at operation 720.
  • the terminal receives data related to an application program service based on an AI table included in the AIT message at operation 725.
  • the terminal may determine time that the terminal starts receiving data related to an application program service, whether the terminal immediately runs the application program service, and the like based on attributes of an application program included in the AI table and an input parameter at operation 725.
  • the terminal which receives the MMT signaling message at operation 710 determines whether event information is included in an MPU based on the MMT signaling message at operation 740. That is, the terminal determines whether the event information is included in the MPU included in an asset by analyzing an asset-level descriptor included in an MP table included in the MMT signaling message.
  • the terminal extracts and stores event information from an MPU included in the asset whenever receiving the MPU included in the asset at operation 745.
  • the terminal periodically determines whether it reaches event applied time while presenting the service at operation 730. For example, information on the event applied time may be acquired from an AE table within an AEI message. If it reaches the event applied time, the terminal performs a control operation for an application program service by applying a related event at operation 735.
  • FIG. 7 illustrates a process for processing event information based on an MPU in an MMT system according to an embodiment of the present disclosure
  • various changes could be made to FIG. 7.
  • various operations in FIG. 7 could overlap, occur in parallel, occur in a different order, or occur multiple times.
  • a signaling table and descriptors are encapsulated as an mmt_atsc3_message() which may be configured as Table 12, and the mmt_atsc3_message() may be transmitted in a signaling message mode of an MMTP.
  • a message_id field indicates an ID of the mmt_atsc3_message().
  • the message_id field may be implemented with a 16-bit field.
  • a version field indicates a version of the mmt_atsc3_message().
  • the version field may be implemented with an 8-bit field.
  • a length field indicates a length of the mmt_atsc3_message().
  • the length field may indicate a length in bytes, and may be implemented with a 32-bit field.
  • the length of the mmt_atsc3_message() may be the number of bytes from the next byte after the length field to the last byte of the mmt_atsc3_message().
  • a service_id field indicates an ID for identifying a service to which information transmitted through a payload included in the mmt_atsc3_message() is applied.
  • the service_id field may be implemented with a 16-bit field.
  • the service_id field is set to a value equal to an atsc:serviceId attribute of a USD to be described.
  • an atsc3_message_content_type field indicates a type of information transmitted through a payload included in the mmt_atsc3_message().
  • the atsc3_message_content_type field may be implemented with a 16-bit field.
  • the atsc3_message_content_type field may indicate a value as shown in Table 13.
  • Atsc3_message_content_type Meaning 0x0000 Reserved 0x0001 UserServiceDescription 0x0002 MPD 0x0003 Application Information Table 0x0004 Application Event Information 0x0005 Video Stream Properties Descriptor 0x0006 ATSC Staggercast Descriptor() 0x007 ⁇ 0xFFFF Reserved for future use
  • an atsc3_message_content_version field indicates a version of information transmitted through a message payload included in the mmt_atsc3_message().
  • the atsc3_message_content_version field may be expressed with an 8-bit field.
  • the message payload may be differentiated based on combination of the service_id and the atsc3_message_content_type.
  • an atsc3_message_content_compression field indicates a compression scheme which is applied to an atsc3_message_content_byte field included in the message payload included in the mmt_atsc3_message().
  • the atsc3_message_content_compression field may be implemented with an 8-bit field.
  • a URI_length field indicates a length of a URI used for identifying the message payload.
  • the URI_length field may be implemented with an 8-bit field. In a case that the URI is not used, a value of the URI_length field may be set to 0.
  • a URI_byte field indicates each byte of the URI used for identifying the message payload.
  • the URI_byte field may be implemented with an 8-bit field.
  • the URI_byte field is expressed as a universal coded character set + transformation format (UTF)-8 character, and does not include a terminating null character.
  • an atsc3_message_content_byte field indicates each byte of information transmitted through the message payload.
  • the atsc3_message_content_byte field may be implemented with an 8-bit field.
  • an mmt_atsc3_message() shown in Table 11 may transmit signaling information of all formats including an extensible markup language (XML) format, a binary format, and the like through a message payload, and a format of each signaling information may be identified using the atsc3_message_content_type.
  • XML extensible markup language
  • the inband_event_descriptor may have a format as shown in Table 14.
  • a descriptor_tag field indicates a tag for identifying the inband_event_descriptor
  • a descriptor_length field indicates a length of the inband_event_descriptor
  • a number_of_assets field indicates the number of assets described in the inband_event_descriptor.
  • an asset_id_length field indicates a length of an asset ID
  • an asset_id_byte field indicates each byte of the asset ID.
  • the asset_id_length field may indicate a length in bytes.
  • a scheme_id_uri_length field indicates a length of a scheme_id_uri
  • a scheme_id_uri field defines meaning and grammar of a value transmitted through an event_data field.
  • the scheme_id_uri_length field may indicate a length in bytes.
  • an event_value_length field indicates a length of the event_data field, and the event_data field includes an event value.
  • a range and meaning of the event value are determined by the scheme_id_uri, and the event_value_length field may indicate a length in bytes.
  • event information is transmitted through an MPU included in an asset, and MMT signaling information may be used for informing that the event information is included in the MPU included in the asset.
  • MMT signaling information may be used for informing that the event information is included in the MPU included in the asset.
  • an mmt_atsc3_message() includes an inband_event_descriptor as a descriptor used at an asset-level in a payload.
  • a terminal may acquire the inband_event_descriptor through the mmt_atsc3_message(), receives an MPU included in an asset upon detecting that event information is included in the MPU included in the asset, and may acquire the event information from an evti box included in the MPU.
  • FIG. 8 schematically illustrates an inner structure of a transmitting apparatus in an MMT system according to an embodiment of the present disclosure.
  • a transmitting apparatus 800 may be an MMT transmitting entity, and the MMT transmitting entity may be a service provider, and/or the like.
  • the transmitting apparatus 800 includes a transmitter 811, a controller 813, a receiver 815, a storage unit 817, and an output unit 819.
  • the controller 813 controls the overall operation of the transmitting apparatus 800. More particularly, the controller 813 controls an operation related to an operation of transmitting and receiving event information in an MMT system according to an embodiment of the present disclosure.
  • the operation related to the operation of transmitting and receiving the event information in the MMT system according to an embodiment of the present disclosure has been described with reference to FIGS. 1 to 7 and Tables 1 to 14, and a detailed description thereof will be omitted herein.
  • the transmitter 811 transmits various signals and various messages to other entities, for example, an MMT receiving entity and the like included in the MMT system under a control of the controller 813.
  • the MMT receiving entity may be a terminal, and/or the like.
  • the various signals and various messages transmitted in the transmitter 811 have been described with reference to FIGS. 1 to 7 and Tables 1 to 14, and a detailed description thereof will be omitted herein.
  • the receiver 815 receives various signals and various messages from other entities, for example, an MMT receiving entity and the like included in the MMT system under a control of the controller 813.
  • the various signals and various messages received in the receiver 815 have been described with reference to FIGS. 1 to 7 and Tables 1 to 14, and a detailed description thereof will be omitted herein.
  • the storage unit 817 stores various programs, various data, and the like related to the operation related to the operation of transmitting and receiving the event information performed in the MMT system according to an embodiment of the present disclosure under a control of the controller 813.
  • the storage unit 817 stores various signals and various messages which are received by the receiver 815 from the other entities.
  • the output unit 819 outputs various signals and various messages related to the operation related to the operation of transmitting and receiving the event information performed in the MMT system according to an embodiment of the present disclosure under a control of the controller 813.
  • the various signals and various messages output by the output unit 819 have been described with reference to FIGS. 1 to 7 and Tables 1 to 14, and a detailed description thereof will be omitted herein.
  • transmitter 811, the controller 813, the receiver 815, the storage unit 817, and the output unit 819 are described in the transmitting apparatus 800 as separate units, it is to be understood that this is merely for convenience of description. In other words, two or more of the transmitter 811, the controller 813, the receiver 815, the storage unit 817, and the output unit 819 may be incorporated into a single unit.
  • the transmitting apparatus 800 may be implemented with one processor.
  • FIG. 8 An inner structure of a transmitting apparatus in an MMT system according to an embodiment of the present disclosure has been described with reference to FIG. 8, and an inner structure of a receiving apparatus in an MMT system according to an embodiment of the present disclosure will be described with reference to FIG. 9.
  • FIG. 9 schematically illustrates an inner structure of a receiving apparatus in an MMT system according to an embodiment of the present disclosure.
  • a receiving apparatus 900 may be an MMT receiving entity, and the MMT receiving entity may be a terminal, and/or the like.
  • the receiving apparatus 900 includes a transmitter 911, a controller 913, a receiver 915, a storage unit 917, and an output unit 919.
  • the controller 913 controls the overall operation of the receiving apparatus 900. More particularly, the controller 913 controls an operation related to an operation of transmitting and receiving event information in an MMT system according to an embodiment of the present disclosure.
  • the operation related to the operation of transmitting and receiving the event information in the MMT system according to an embodiment of the present disclosure has been described with reference to FIGS. 1 to 7 and Tables 1 to 14, and a detailed description thereof will be omitted herein.
  • the transmitter 911 transmits various signals and various messages to other entities, for example, an MMT transmitting entity and the like included in the MMT system under a control of the controller 913.
  • the MMT transmitting entity may be a service provider, and/or the like.
  • the various signals and various messages transmitted in the transmitter 911 have been described with reference to FIGS. 1 to 7 and Tables 1 to 14, and a detailed description thereof will be omitted herein.
  • the receiver 915 receives various signals and various messages from other entities, for example, an MMT transmitting entity and the like included in the MMT system under a control of the controller 913.
  • the various signals and various messages received in the receiver 915 have been described with reference to FIGS. 1 to 7 and Tables 1 to 14, and a detailed description thereof will be omitted herein.
  • the storage unit 917 stores various programs, various data, and the like related to the operation related to the operation of transmitting and receiving the event information performed in the MMT system according to an embodiment of the present disclosure under a control of the controller 913.
  • the storage unit 917 stores various signals and various messages which are received by the receiver 915 from the other entities.
  • the output unit 919 outputs various signals and various messages related to the operation related to the operation of transmitting and receiving the event information performed in the MMT system according to an embodiment of the present disclosure under a control of the controller 913.
  • the various signals and various messages output by the output unit 919 have been described with reference to FIGS. 1 to 7 and Tables 1 to 14, and a detailed description thereof will be omitted herein.
  • transmitter 911, the controller 913, the receiver 915, the storage unit 917, and the output unit 919 are described in the receiving apparatus 900 as separate units, it is to be understood that this is merely for convenience of description. In other words, two or more of the transmitter 911, the controller 913, the receiver 915, the storage unit 917, and the output unit 919 may be incorporated into a single unit.
  • the receiving apparatus 900 may be implemented with one processor.
  • an embodiment of the present disclosure enables to transmit and receive a signal in a multimedia system.
  • An embodiment of the present disclosure enables to transmit and receive event information related to an event in a multimedia system.
  • An embodiment of the present disclosure enables to provide event information related to an event with a multimedia service in a multimedia system.
  • Non-transitory computer readable recording medium is any data storage device that can store data, which can be thereafter read by a computer system.
  • Examples of the non-transitory computer readable recording medium include read only memory (ROM), random access memory (RAM), compact disk ROMs (CD-ROMs), magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet).
  • ROM read only memory
  • RAM random access memory
  • CD-ROMs compact disk ROMs
  • magnetic tapes such as data transmission through the Internet
  • floppy disks such as data transmission through the Internet
  • carrier waves such as data transmission through the Internet
  • carrier waves such as data transmission through the Internet
  • the non-transitory computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
  • functional programs, code, and code segments for accomplishing the present disclosure can be easily construed by programmers skilled in the art to which the present disclosure pertains.
  • a method and apparatus may be implemented by hardware, software and/or a combination thereof.
  • the software may be stored in a non-volatile storage, for example, an erasable or re-writable ROM, a memory, for example, a RAM, a memory chip, a memory device, or a memory integrated circuit (IC), or an optically or magnetically recordable non-transitory machine-readable (e.g., computer-readable), storage medium (e.g., a CD, a DVD, a magnetic disk, a magnetic tape, and/or the like).
  • a method and apparatus according to an embodiment of the present disclosure may be implemented by a computer or a mobile terminal that includes a controller and a memory, and the memory may be an example of a non-transitory machine-readable (e.g., computer-readable), storage medium suitable to store a program or programs including instructions for implementing various embodiments of the present disclosure.
  • the present disclosure may include a program including code for implementing the apparatus and method as defined by the appended claims, and a non-transitory machine-readable (e.g., computer-readable), storage medium storing the program.
  • the program may be electronically transferred via any media, such as communication signals, which are transmitted through wired and/or wireless connections, and the present disclosure may include their equivalents.
  • An apparatus may receive the program from a program providing device which is connected to the apparatus via a wire or a wireless and store the program.
  • the program providing device may include a memory for storing instructions which instruct to perform a content protect method which has been already installed, information necessary for the content protect method, and the like, a communication unit for performing a wired or a wireless communication with a graphic processing device, and a controller for transmitting a related program to a transmitting/receiving device based on a request of the graphic processing device or automatically transmitting the related program to the transmitting/receiving device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

L'invention concerne un procédé permettant de faire fonctionner un appareil de transmission dans un système multimédia. Le procédé consiste à transmettre une unité de données d'un service multimédia comprenant des informations d'événement relatives à un événement, l'événement comprenant une notification à une application, la notification indiquant qu'une action doit être entreprise.
EP16814701.5A 2015-06-23 2016-06-23 Procédé et appareil d'émission et de réception de signaux dans un système multimédia Pending EP3314906A4 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
KR20150089353 2015-06-23
KR1020150158360A KR102473346B1 (ko) 2015-06-23 2015-11-11 디지털 방송 서비스 방법 및 장치
PCT/KR2016/006678 WO2016208988A1 (fr) 2015-06-23 2016-06-23 Procédé et appareil d'émission et de réception de signaux dans un système multimédia

Publications (2)

Publication Number Publication Date
EP3314906A1 true EP3314906A1 (fr) 2018-05-02
EP3314906A4 EP3314906A4 (fr) 2018-07-11

Family

ID=57810628

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16814701.5A Pending EP3314906A4 (fr) 2015-06-23 2016-06-23 Procédé et appareil d'émission et de réception de signaux dans un système multimédia

Country Status (4)

Country Link
EP (1) EP3314906A4 (fr)
JP (1) JP6728246B2 (fr)
KR (2) KR102473346B1 (fr)
CN (2) CN107787586B (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113961156A (zh) * 2020-07-20 2022-01-21 北京字节跳动网络技术有限公司 多屏显示方法、装置、系统、电子设备及计算机介质

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102546152B1 (ko) * 2017-02-15 2023-06-22 한국전자통신연구원 고정/이동방송 융합형 3DTV에서 화질 개선을 위한 부가 데이터(Video Enhancement Information, VEI) 시그널링 방법 및 장치
CN109818926B (zh) * 2018-12-25 2020-10-09 西安长远电子工程有限责任公司 一种无需预先规划的通信方法
KR102176098B1 (ko) * 2019-01-28 2020-11-10 김영언 음원 인식 방법 및 장치
CN113114655A (zh) * 2021-04-07 2021-07-13 深圳市瑞驰信息技术有限公司 一种基于tcp/ip的二进制数据交互协议设计方法

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070049042A (ko) * 2005-11-07 2007-05-10 삼성전자주식회사 휴대 방송 시스템에서 서비스 가이드 컨텐츠 및 통지이벤트 정보의 전송 방법 및 절차
US20080064326A1 (en) * 2006-08-24 2008-03-13 Stephen Joseph Foster Systems and Methods for Casting Captions Associated With A Media Stream To A User
JP5671297B2 (ja) * 2009-11-16 2015-02-18 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ Ｉｍｓネットワークを介してマルチメディア・サービスを最適化するための方法及びシステム
US9226045B2 (en) * 2010-08-05 2015-12-29 Qualcomm Incorporated Signaling attributes for network-streamed video data
EP2667622B1 (fr) * 2011-01-19 2019-05-01 Samsung Electronics Co., Ltd Appareil et procédé permettant de configurer un message de commande dans un système de diffusion
KR20120084233A (ko) * 2011-01-19 2012-07-27 삼성전자주식회사 엠엠티 제어 계층을 이용한 위젯/어플리케이션 명령어 전송 방법
KR20120119790A (ko) * 2011-04-22 2012-10-31 삼성전자주식회사 미디어 데이터 전송 방법 및 장치와 미디어 데이터 수신 방법 및 장치
EP2712187A4 (fr) * 2011-05-20 2014-10-15 Japan Broadcasting Corp Système de liaison diffusion/communication, serveur de gestion d'application, récepteur, procédé de réception dans un récepteur, et procédé de gestion d'application dans un serveur de gestion d'application
CN102217322B (zh) * 2011-05-27 2013-10-09 华为技术有限公司 媒体发送方法、媒体接收方法和客户端及系统
KR101946861B1 (ko) * 2011-09-21 2019-02-13 삼성전자주식회사 멀티미디어 방송 서비스의 미디어 데이터 동기화 방법 및 장치
MX2014006328A (es) * 2011-12-02 2014-06-23 Sony Corp Dispositivo para procesamiento de informacion, metodo para procesamiento de informacion, y programa.
KR20130085987A (ko) * 2012-01-20 2013-07-30 한국전자통신연구원 이종망 네트워크에서 미디어 프래그먼트 유닛으로 나누어진 액세스 유닛을 가지는 미디어 데이터를 전송하는 방법
JP6064249B2 (ja) * 2012-07-09 2017-01-25 ホアウェイ・テクノロジーズ・カンパニー・リミテッド 動的適応ストリーミングオーバーハイパーテキスト転送プロトコルクライアント挙動フレームワークおよびセッション管理の実装
TW201414295A (zh) * 2012-09-20 2014-04-01 Sony Corp 收訊裝置、收訊方法、播送裝置、播送方法、程式、及連動應用程式控制系統
JP2015015706A (ja) * 2013-07-03 2015-01-22 パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ データ送信方法、データ再生方法、データ送信装置およびデータ再生装置
JP6616064B2 (ja) * 2013-07-25 2019-12-04 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 送信方法および受信方法
WO2015029401A1 (fr) * 2013-08-29 2015-03-05 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ Procédé de transmission, procédé de réception, dispositif de transmission et dispositif de réception
US9930086B2 (en) * 2013-10-28 2018-03-27 Samsung Electronics Co., Ltd. Content presentation for MPEG media transport

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113961156A (zh) * 2020-07-20 2022-01-21 北京字节跳动网络技术有限公司 多屏显示方法、装置、系统、电子设备及计算机介质

Also Published As

Publication number Publication date
CN107787586B (zh) 2020-12-25
CN112738645B (zh) 2023-05-30
CN107787586A (zh) 2018-03-09
CN112738645A (zh) 2021-04-30
KR102598237B1 (ko) 2023-11-10
KR102473346B1 (ko) 2022-12-05
KR20170000312A (ko) 2017-01-02
KR20220165693A (ko) 2022-12-15
EP3314906A4 (fr) 2018-07-11
JP6728246B2 (ja) 2020-07-22
JP2018524904A (ja) 2018-08-30

Similar Documents

Publication Publication Date Title
WO2018052253A1 (fr) Dispositif de transmission et procédé de transmission associé
EP3314906A1 (fr) Procédé et appareil d'émission et de réception de signaux dans un système multimédia
WO2013089437A1 (fr) Dispositif et procédé pour recevoir un contenu multimédia
WO2012093767A2 (fr) Procédé de fourniture d'un service de commande à distance et appareil d'affichage d'image associé
WO2012033319A2 (fr) Appareil et procédé pour fournir un contenu en flux continu
WO2014025207A1 (fr) Procédé et appareil pour traiter un signal de diffusion contenant un service de radiodiffusion interactive
WO2014209057A1 (fr) Procédé et dispositif pour émettre et recevoir un service de diffusion dans un système de diffusion hybride sur la base d'une connexion d'un réseau de diffusion terrestre et d'un réseau à protocole internet
WO2016208988A1 (fr) Procédé et appareil d'émission et de réception de signaux dans un système multimédia
WO2013157890A1 (fr) Procédé et appareil de traitement de données pour prise en charge de réalité augmentée
WO2016111560A1 (fr) Appareil de transmission et appareil de réception, et procédé de traitement de signaux associé
WO2017039272A1 (fr) Appareil et procédé pour transmettre et recevoir un signal dans un système multimédia
WO2016111563A1 (fr) Procédé et appareil d'émission et de réception d'informations de média dans un système de communications
WO2012070789A2 (fr) Système, procédé et appareil de fourniture/réception de service d'une pluralité de fournisseurs de contenu et de clients
WO2018169101A1 (fr) Dispositif de réception de signaux de diffusion, et procédé de réception de signaux de diffusion
WO2012053764A2 (fr) Procédé permettant de déplacer un pointeur dans un appareil d'affichage vidéo et appareil d'affichage vidéo associé
WO2011074844A2 (fr) Procédé de traitement de service non temps réel et récepteur de diffusion
WO2011062386A2 (fr) Procédé pour transmettre et recevoir un signal de diffusion et récepteur de diffusion utilisant le procédé
WO2018038579A1 (fr) Appareil et procédé destinés à la fourniture d'un service de sécurité dans un système de communication
WO2017119746A1 (fr) Appareil et procédé de transmission et de réception de fichier dans un système de communication sans fil prenant en charge un service de stockage en nuage
WO2017061793A1 (fr) Dispositif numérique et procédé de traitement des données par celui-ci
WO2016010319A2 (fr) Système de service de diffusion en continu en nuage, procédé de compression de données permettant d'éviter l'engorgement d'une mémoire et dispositif associé
WO2012070742A1 (fr) Procédé d'installation d'applications, et dispositif d'affichage d'images utilisant celui-ci
WO2017209574A1 (fr) Procédé et dispositif de fourniture d'un contenu multimédia
WO2017003248A1 (fr) Appareil et procédé pour émettre et recevoir un signal dans un système multimédia
WO2021066445A1 (fr) Procédé, appareil et support d'enregistrement lisible par ordinateur de transmission ou de réception de données de vpcc

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180122

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20180613

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/658 20110101ALI20180607BHEP

Ipc: H04N 21/4722 20110101ALI20180607BHEP

Ipc: H04N 21/434 20110101ALI20180607BHEP

Ipc: H04N 21/81 20110101AFI20180607BHEP

Ipc: H04N 21/235 20110101ALI20180607BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20210423

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS