JP2016171358A - Information processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device capable of reliably obtaining information necessary to demultiplex a multiplexed stream which is further multiplexed according to a multiplexing scheme after data is multiplexed according to another multiplexing scheme.SOLUTION: An information processing device 1 is a device that receives and reproduces a multiplexed stream, and comprises a broadcast reception unit 20, a demux unit 10, a communication unit 30, an audio decoder 40, a speaker 60, a video decoder 50, and a display unit 70. The demux unit comprises a controller 12 that obtains control information from PMT including control information (signaling message) input into a TS demux unit 11 and outputs it to a MMT demux unit 13, and can reliably obtain information necessary to demultiplex the multiplexed stream.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an apparatus for separating a multiplexed stream.

  In recent years, digital broadcasting systems that are widely used generally transmit content based on MPEG-2 TS. More specifically, in the digital broadcasting system, media such as a video stream and an audio stream constituting the content are divided and packetized and transmitted as a multiplexed stream. Then, in a receiving apparatus such as a television set that has received such a multiplexed stream, the multiplexed stream is separated (demultiplexed) to acquire and reproduce the media.

  This will be described with reference to FIG. FIG. 14 is a diagram for explaining separation of multiplexed streams in MPEG-2 TS. As shown in FIG. 1, the conventional receiving apparatus includes a TS demax unit, a video decoder, and an audio decoder. The TS demultiplexer separates TS packets, which are packets multiplexed by MPEG-2 TS, the video decoder decodes the video stream, and the audio decoder decodes the audio stream.

  As shown in the drawing, the received multiplexed stream is sent to the TS demux unit. Here, in this multiplexed stream, as shown in the lower side of the figure, (1) a TS packet that functions as a PAT (Program Association Table), (2) a TS packet that functions as a PMT (Program Map Table), (3) TS packets constituting a video stream and (4) TS packets constituting an audio stream are included.

  A packet identifier (PID) indicating the type of data (media) included in the TS packet is added to each TS packet. Thereby, TS packets including PMT can be identified from TS packets including PAT, and TS packets configuring a video stream and TS packets configuring an audio stream can be respectively identified from TS packets including PMT. Therefore, the TS demux unit can output the video stream (Video ES) separated from the multiplexed stream to the video decoder, and can output the audio stream (Audio ES) separated from the multiplexed stream to the audio decoder.

  In recent years, in order to facilitate the realization of a hybrid transmission service using broadcasting and communication, MPEG uses MMT (ISO / ISO), which is a next-generation transmission format that assumes that IP (Internet Protocol) is used as a common interface. (IEC 23008-1: MPEG Media Transport) protocol is being standardized. The hybrid transmission is also described in Patent Document 1 below.

Japanese Patent Laid-Open No. 10-173612 (released on June 26, 1998)

  Here, the MMT defines MPU (Media Processing Unit) as data to be transmitted, control information (signaling message) indicating the type of media, acquisition source, and the like. A plurality of MMT payloads obtained by packetizing such data are multiplexed and transmitted as an MMTP packet sequence. Since this MMTP packet has a multiplexing method different from that of the TS packet, it cannot be separated by the TS demux unit as shown in FIG. Therefore, a receiving apparatus that complies with the MMT protocol needs to include an MMT demax unit for separating MMTP packets in addition to the TS demax unit. Further, as described above, since the media type and the acquisition destination are described in the control information, the control information needs to be received by the MMT demux unit when the MMTP packet is separated.

  However, there has conventionally been a problem that there is no mechanism for reliably acquiring control information. This will be described with reference to FIG. FIG. 15 is a diagram for explaining a problem that occurs in a receiving apparatus including a TS demax unit and an MMT demax unit.

  As shown in the lower part of the figure, the multiplexed stream received by the TS demax part includes a PAT TS packet and a PMT TS packet, and includes three MMT stream TS packets. . Since the TS packet of the MMT stream is added with a packet identifier indicating that the MMT stream is included in the TS packet, the TS demax unit outputs the MMT stream separated from the TS packet to the MMT demax unit. . Note that the MMT stream is multiplexed as an MMTP packet.

  Here, since the packet identifier of the MMT stream has the same value as described above, the MMT demux unit cannot determine whether the output media is an audio stream or a video stream. For this reason, it is impossible to determine to which decoder the media separated from the MMT stream should be output. In addition, in MMT, it is possible to reproduce an MMT stream acquired via a communication network such as the Internet together with a stream acquired from a broadcast path. However, if there is no control information, the acquisition destination of the stream to be reproduced together is specified. It is not possible. Such a problem is not limited to the MMT, and may be caused in common when a multiplexed stream is multiplexed by another multiplexing scheme and then multiplexed by another multiplexing scheme. Is a point.

  The present invention has been made in view of the above problems, and an object of the present invention is to multiplex a multiplexed stream that has been multiplexed by a certain multiplexing method and then further multiplexed by another multiplexing method. It is to provide an information processing apparatus or the like that makes it possible to reliably acquire information necessary for processing a stream.

  In order to solve the above-described problem, an information processing apparatus according to an aspect of the present invention uses a first multiplexing scheme in accordance with attribute information received together with a multiplexed stream. First separation means for separating a second multiplexed stream multiplexed by a second multiplexing scheme different from the first multiplexing scheme from the multiplexed first multiplexed stream; and the second multiplexing Second separation means for separating the media data from the stream, and control information included in the attribute information is acquired, and the control information is used for separation of the second multiplexed stream by the second separation means. And a control means for controlling.

  In order to solve the above problem, an information processing apparatus according to an aspect of the present invention provides a first multiplexing scheme according to attribute information received together with a multiplexed stream from a multiplexed stream received via a network. A first separation means for separating a second multiplexed stream multiplexed by a second multiplexing scheme different from the first multiplexing scheme, from the first multiplexed stream multiplexed by the first multiplexing stream; and the multiplexed stream Control means for acquiring acquisition destination information indicating an acquisition destination from a different network from the attribute information, the second multiplexed stream separated by the first separation means, and acquisition indicated by the acquisition destination information The second multiplexed stream acquired from the above is divided so that the media data included in each of the second multiplexed streams is reproduced as one content. It is characterized in that it comprises a second separation means for the.

  In order to solve the above problem, an information processing apparatus according to an aspect of the present invention receives a plurality of packages via a network and acquires control information necessary for receiving a multiplexed stream included in the package. And a session control means for controlling the start and end of reception of the multiplexed stream, and a separating means for separating media data from the multiplexed stream, wherein the control information includes the multiplexed stream from a plurality of packages. It is characterized in that it includes reference information indicating whether or not it is referenced.

  According to one aspect of the present invention, it is possible to reliably acquire control information necessary for processing a multiplexed stream or acquisition destination information necessary for processing a multiplexed stream.

It is a block diagram which shows the principal part structure of the information processing apparatus which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the protocol stack which shows the protocol used with the said information processing apparatus. It is a figure which shows an example of the data structure of descriptor () for referring control information. It is a figure which shows an example of the data structure of MPT containing control information. It is a figure which shows an example of the data structure of MMT_general_location_info () which shows the acquisition destination of a medium. It is a figure which shows an example of MPT which shows the MMTP packet and the media type of this MMTP packet. It is a flowchart which shows an example of the separation process which the said information processing apparatus performs. It is a block diagram which shows the principal part structure of the information processing apparatus which concerns on Embodiment 2 of this invention. It is a block diagram which shows the principal part structure of the information processing apparatus which concerns on Embodiment 3 of this invention. It is a figure explaining the example which refers a hint using descriptor (). It is a block diagram which shows the principal part structure of the information processing apparatus which concerns on Embodiment 4 of this invention. It is a flowchart which shows an example of the reproduction | regeneration processing which the said information processing apparatus performs. It is a block diagram which shows the principal part structure of the information processing apparatus which concerns on Embodiment 5 of this invention. It is a figure which shows a prior art and is a figure explaining isolation | separation of the multiplexed stream in MPEG-2 TS. It is a figure explaining the problem which arises in the receiver provided with the TS demax part and the MMT demax part. It is a block diagram which shows the principal part structure of the information processing apparatus which concerns on Embodiment 6 of this invention. It is a figure which shows an example of the relationship of the control information (session information) which comprises a service, a package, an MMT stream, an asset, control information (MPT), etc. It is a figure which shows an example of the data structure of session information. It is a figure which shows an example of a session description. It is a figure which shows an example of the session control sequence which concerns on service switching. It is a figure which shows an example of the session control sequence which concerns on service switching. It is a flowchart which shows an example of the session control process which an information processing apparatus performs.

Embodiment 1
Hereinafter, embodiments of the present invention will be described in detail. First, the configuration of the information processing apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram illustrating a main configuration of the information processing apparatus 1. The information processing apparatus 1 is an apparatus that receives and reproduces a multiplexed stream, and as illustrated, a broadcast receiving unit 20, a demax unit 10, a communication unit 30, an audio decoder 40, a speaker 60, a video decoder 50, and a display unit. 70.

  The broadcast receiving unit 20 receives information transmitted through a broadcast route. For example, broadcast content or the like is received via the broadcast receiving unit 20. Since the broadcast content is transmitted as a multiplexed stream, the broadcast receiving unit 20 outputs the multiplexed stream to the demux unit 10 for separation.

  The demultiplexing unit 10 separates (demultiplexes) the multiplexed streams multiplexed (multiplexed) by a predetermined multiplexing method. More specifically, the demax unit 10 includes a TS demax unit (first separation unit) 11, an MMT demax unit (second separation unit) 13, and a controller (control unit) 12. Multiplexed streams multiplexed by a plurality of different multiplexing schemes can be separated.

  The TS demux unit 11 uses a TS packet (first multiplexed stream) multiplexed by MPEG-2 TS (first multiplexing method) according to a PMT (Program Map Table: attribute information) received together with the multiplexed stream. The MMTP packet (second multiplexed stream) multiplexed by MMTP (MPEG Media Transport Protocol: second multiplexing method) is separated. Further, the TS demax unit 11 separates a video stream or audio stream packet (A / V Elementary Stream: media data) from the TS packet according to the PMT, and the audio decoder 40 or the video decoder according to the type of the separated media. Output to 50. Since the TS demax unit 11 cannot separate media (Media Processing Unit: MPU: media data) from the MMTP packet (demultiplex the MMTP packet), the MMTP packet is output to the MMT demax unit 13. Further, the TS demax unit 11 outputs the PMT to the controller 12. Although details will be described later, the separation is performed by referring to the packet identifier (PID) of each packet constituting the received multiplexed stream.

  The controller 12 acquires control information (signaling message) included in the PMT and outputs it to the MMT demux unit 13. Although details will be described later, the control information is information necessary for separation of the MMTP packet, and by outputting this control information to the MMT demax unit 13, the MMT demax unit 13 is surely subjected to the separation process based on the control information. It becomes possible to do.

  The MMT demax unit 13 separates the media from the MMTP packet and outputs the media to the audio decoder 40 or the video decoder 50 according to the type of the separated media. Further, the MMT demux unit 13 can also obtain an MMTP packet via the communication unit 30. Thereby, the broadcast content received via the broadcast receiving unit 20 and the communication content received via the communication unit 30 can be combined and reproduced.

  The communication unit 30 is used for the information processing apparatus 1 to communicate with an external apparatus via a communication network, and is used for acquiring content (multiplexed stream) on a communication path.

  The audio decoder 40 decodes the audio media output from the TS demax unit 11 or the MMT demax unit 13 and outputs the decoded media to the speaker 60 which is a device that outputs audio. Thereby, the sound corresponding to the media is output from the speaker 60.

  The video decoder 50 decodes the media of the image output from the TS demax unit 11 or the MMT demax unit 13 and outputs it to the display unit 70 which is a device for displaying an image. As a result, an image corresponding to the medium is displayed from the display unit 70. Note that the speaker 60 and the display unit 70 may be external devices attached to the information processing apparatus 1.

〔Protocol stack〕
Here, the protocol stack assumed in this embodiment will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of a protocol stack indicating protocols used in the information processing apparatus 1. Note that descriptions of parts that are not related to the present invention are omitted.

  As shown in the figure, the physical layer (PHY), which is the lowest layer, is divided into two parts, broadcasting and communication. A layer serving as a base for broadcasting is TS (MPEG-2 TS), and a layer serving as a base for communication is IP. In broadcasting, similarly to the conventional MPEG-2 TS, PSI (Program Specific Information) / SI (Service Information) and audio / video ES (Elementary Stream) are transmitted, and MMT-related data is also transmitted. Only data related to MMT may be transmitted.

  In the figure, a portion defined by MMT is surrounded by a broken line. As shown, the MMT can be used for both broadcasting and communication. In the MMT, control information (signaling message) and media (MPU) are encapsulated in an MMT payload (MMT Payload), and a plurality of MMT payloads are multiplexed to form an MMTP packet sequence.

[Operation example]
Here, with reference to FIG. 1 again, an operation example of the information processing apparatus 1 will be described. First, the broadcast receiving unit 20 receives a TS packet and outputs it to the TS demax unit 11. Here, it is assumed that TS packets of PAT (Program Association Table), PMT, MMT stream (including video), and MMT stream (including audio) are received in this order. The PMT includes control information (signaling message), which is indicated by the letter “S” in the figure.

  Next, the TS demux unit 11 refers to the PAT and PMT included in the received TS packet, and the packet identifier of each TS packet, and separates the TS packet. Specifically, the correspondence between the packet identifier (PID) and the attribute of the data included in the packet is described in the PMT, and separation is performed according to this. In this example, the PMT separated from the received TS packet is output to the controller 12, and two MMT streams are output to the MMT demax unit 13. When a TS packet of a video stream or an audio stream that is not multiplexed by MMT (similar to the prior art) is received, the media (audio stream or video stream) is separated from the TS packet, and the media type is separated. In response to this, the data is output to the audio decoder 40 or the video decoder 50.

  Note that the information transmitted to the controller 12 may be information that allows the controller 12 to acquire control information (signaling message), and is not limited to the PMT. For example, instead of transmitting the PMT itself, the descriptor () associated with the MMT stream in the PMT may be notified. Further, descriptor () may include control information directly, or may include information (location) indicating an acquisition destination of control information. When the information indicating the acquisition destination is included, the controller 12 acquires control information using this information.

  Then, the controller 12 outputs the control information extracted from the PMT or descriptor () or the control information acquired from the outside based on the location included in the descriptor () to the MMT demux unit 13 in an arbitrary format. By inputting this control information, the MMT demax unit 13 can separate the MMT stream packet (MMTP packet) received from the TS demax unit 11. For example, the media separated from the MMTP packet that is found to be a video stream MMTP packet from the control information is transmitted to the video decoder 50, and the media separated from the packet that is found to be an audio stream packet is sent to the audio decoder 40. You can decide to send.

  As described above, in the information processing apparatus 1, the TS demax unit 11 separates TS packets based on the PMT, and the MMT demax unit 13 separates MMTP packets based on the control information acquired from the PMT. As described above, the information processing apparatus 1 uses the PMT including the control information or the information for acquiring the control information, and inputs the control information to the MMT demax unit 13, so that each medium included in the MMTP packet group It can be properly separated.

[Example of descriptor ()]
Next, an example of the above-described descriptor () will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of the data structure of descriptor (). In the illustrated MMT_descriptor (), information (descriptor_tag) indicating the type of descriptor (MMT_descriptor ()), length information of the descriptor (descriptor_length), and information indicating whether or not an MPT (MMT Package Table) exists (mpt_present_flag) )It is included. The MPT includes the control information (signaling message) described above.

  4 is followed by the data structure MPT () shown in FIG. 4 when the value of mpt_present_flag is “1”, and the data structure MMT_general_location_info () shown in FIG. 5 when it is “0”. ) (Where location_type is 0x05). MMT_general_location_info () describes a URL indicating the acquisition destination of control information.

[MPT example]
Next, an example of MPT will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of the data structure of MPT. As shown in the figure, the MPT includes “mime_type” that is information indicating the media type (type), and includes “MMT_general_location_info ()” for specifying the acquisition destination (location) of the media. Yes. Note that “MMT_general_location_info ()” may associate a plurality of acquisition destinations with one medium, such as an acquisition destination via a broadcast path and an acquisition destination via a communication path.

[Example of MMT_general_location_info ()]
Next, an example of MMT_general_location_info () will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of a data structure of MMT_general_location_info (). As shown in the drawing, MMT_general_location_info () can describe acquisition sources corresponding to a plurality of protocols. Specifically, in addition to the acquisition destination (location_type == 0x00) indicated by the packet ID of the MMT stream, the acquisition destination (location_type == 0x01) via a UDP / IP communication network, an MPEG-2 TS-based broadcast network And the acquisition destination (location_type == 0x05) via a communication network such as HHTP can be described.

[Example of specifying acquisition destination by packet ID]
An example of specifying the acquisition source by the packet ID will be described with reference to FIG. FIG. 6 is a diagram illustrating an example of an MMTP packet and an MPT indicating a media type of the MMTP packet. As shown in FIG. 5A, each MMTP packet is assigned a packet ID, and this packet ID is a value corresponding to the media type. That is, the same type of media is included in packets having the same ID.

  As shown in (b) of the figure, in the MPT, IDs of a plurality of assets constituting the package are set, and the media type (type) of each asset and the acquisition destination (location) are described. ing. Specifically, asset (asset) # 1 describes that the acquisition destination of media type “avc1” (video stream) is “packet_id = 1”. According to this description, it is possible to specify that when acquiring “avc1” (video stream), it is only necessary to demultiplex a packet having a packet ID of 1 among the MMTP packets in FIG. Similarly, for asset # 2, it can be specified that the acquisition destination of the media type “mp4a” (audio stream) is “packet_id = 2”, that is, an MMTP packet with a packet ID of 2.

  Note that the packet ID is used as the location as in this example when the location_type value of MMT_general_location_info () is 0x00, and the location described in the MPT corresponds to the location_type value. For example, when the value of location_type is 0x05, a URL for acquiring the type of media such as “http://www.example.com/audio.mp4” is described as location.

  As described above, the media type of the MMTP packet can be specified by referring to the MPT. Therefore, the MMTP packet can be appropriately separated by inputting control information including MPT to the MMT demux unit 13. That is, the MMTP packet of the audio stream can be output to the audio decoder 40, and the MMTP packet of the video stream can be output to the video decoder 50.

[Flow of separation process]
Finally, the flow of separation processing (information processing apparatus control method) executed by the information processing apparatus 1 will be described with reference to FIG. FIG. 7 is a flowchart illustrating an example of the separation process. First, the TS demax unit 11 extracts a PAT from a TS packet with PID = 0 among a plurality of received TS packets, and extracts a PMT based on the PID value of the PMT defined in the PAT (S1). Next, the TS demax unit 11 outputs the extracted PMT to the controller 12 (S2). Subsequently, the TS demux unit 11 compares the PID for each media type defined in the extracted PMT with the PID of each TS packet, and determines whether or not the TS packet is an MMT stream (TS packet including an MMTP packet). (S3, first separation step).

  In the case of an MMT stream (YES in S3), the TS demax unit 11 outputs the MMTP packet separated from the TS packet to the MMT demax unit 13 (S4).

  Next, the controller 12 acquires control information (signaling message) from the output PMT and outputs it to the MMT demux unit 13 (S5, control step). As described above, the control information may be included in the PMT, or may be acquired from an acquisition destination described in the PMT. Then, the MMT demax unit 13 that has received the control information separates the MMTP packet output in S4 based on this control information (S6, second separation step).

  If the TS packet is continuously received (YES in S7), the process returns to S3. If not (NO in S7), the separation process is terminated.

  If the stream is not an MMT stream in S3 (NO in S3), the TS demax unit 11 separates the TS packet according to the media type (S8). Specifically, in the case of an audio stream, the audio stream separated from the TS packet is output to the audio decoder 40. Similarly, in the case of a video stream, the video stream separated from the TS packet is output to the video decoder 50.

[Embodiment 2]
The following will describe another embodiment of the present invention with reference to FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  First, the configuration of the information processing apparatus 100 according to the present embodiment will be described with reference to FIG. FIG. 8 is a block diagram illustrating a main configuration of the information processing apparatus 100. Since the configuration other than the demax unit 110 is the same as that of the information processing apparatus 1, illustrations other than the demax unit 110 and the surrounding configuration are omitted.

  As illustrated, the demax unit 110 of the information processing apparatus 100 includes a TS demax unit (first separation unit) 111, a controller (control unit) 112, a remax unit (remultiplexing unit) 114, and an MMT demax unit. (Second separation means) 113.

  The TS demax unit 111 separates received TS packets in the same manner as the TS demax unit 11 of the above embodiment. Specifically, the audio stream separated from the TS packet whose media type specified from the PMT is an audio stream is output to the audio decoder 40. TS packets whose media type is a video stream are processed in the same way. Further, the MMTP packet including the MMT stream is separated from the TS packet whose media type is the MMT stream, and is output to the remax unit 114. Further, the TS demax unit 111 outputs the PMT to the controller 112.

  The controller 112 outputs the control information (signaling message) acquired from the PMT to the remax unit 114 as an MMTP packet. That is, the controller 112 is different from the controller 12 of the above-described embodiment in that the data format to be output is an MMTP packet and the output destination is the remax unit 114. Note that the packetization information necessary for converting the control information into an MMTP packet may be described in the PMT as in the control information, or the acquisition destination of the packetization information may be described in the PMT. If the acquisition destination of the control information is described in the PMT, the control information acquired from the acquisition destination is converted into an MMTP packet and output to the remax unit 114.

  The remax unit 114 multiplexes the MMTP packet including the control information output from the controller 112 and the MMTP packet output from the TS demax unit 111 and outputs the multiplexed result to the MMT demax unit 113. Multiplexing is in the order in which the MMTP packet including the control information is received by the MMT demax unit 113 prior to the MMTP packet (MMTP packet received from the TS demax unit 111) analyzed using this control information. It is desirable to do so.

  The MMT demux unit 113 acquires control information from the multiplexed MMTP packet and separates each MMTP packet using this control information. Note that the MMTP packet may be input to the MMT demax unit 113 from other than the remax unit 114. For example, an MMTP packet acquired through a communication path via a communication unit 30 (not shown) is input, and output to the video decoder 50 or the audio decoder 40 together with or instead of the stream of the MMTP packet input from the remax unit 114. May be played.

  As described above, even when the control information is an MMTP packet and is supplied to the MMT demux unit 113 while being multiplexed with other MMTP packets, each MMTP packet is smoothly transmitted based on the control information as in the above embodiment. Can be separated.

[Embodiment 3]
The following will describe still another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  First, the configuration of the information processing apparatus 200 according to the present embodiment will be described with reference to FIG. FIG. 9 is a block diagram illustrating a main configuration of the information processing apparatus 200. Since the configuration other than the demax unit 210 is the same as that of the information processing apparatus 1, illustrations other than the demax unit 210 and the surrounding configuration are omitted.

  As illustrated, the demax unit 210 of the information processing apparatus 200 includes a TS demax unit (first separation unit) 111, a controller (control unit) 212, a remax unit (arrangement unit) 214, and an MMT demax unit (first unit). 2 separation means) 113.

  In addition, the packet received by the TS demax unit 111 includes an MMTP packet (packet with “S” in the drawing) including control information (separation information). Since this packet is an MMTP packet, it is output to the remax unit 214 together with other MMTP packets. TS packets including this control information are inserted at predetermined intervals, and assigned packet identifiers different from media packets such as audio streams. Note that the packet identifier of the TS packet including the control information may be the same as or different from the packet identifier of the TS packet of the MMT stream including video and audio.

  A packet output from the TS demax unit 111 to the controller 212 includes a hint (information indicated by “H” in the figure) related to transmission of control information (signaling message). Specifically, the hint is information indicating an insertion interval of TS packets including control information in units of msec, for example. The hint may be described in the PMT, or the acquisition source from the outside may be described by descriptor (). Such a hint is also useful information regarding separation of MMTP packets, and can be said to be a kind of control information.

  The controller 212 calculates a buffer amount necessary for packet rearrangement processing from the maximum insertion interval indicated by the hint acquired from the PMT, and notifies the remax unit 214 of the buffer amount. Note that the packet rearrangement process means that, among the MMTP packets received from the TS demax unit 111, those that contain control information are received by the MMT demax unit 113 earlier than those that are separated after referring to the control information. As described above, this is a process of changing the order of MMTP packets.

  The remax unit 214 stores the MMTP packets received from the TS demax unit 111 in the buffer of the amount notified from the controller 212, performs the above reordering process, re-multiplexes, and outputs the result to the MMT demax unit 113. Thereby, the MMT demax unit 113 can separate subsequent MMTP packets after referring to the control information included in the previously received MMTP packet. Therefore, it is possible to prevent the occurrence of an event such as discarding the MMTP packet by receiving the MMTP packet including video and audio in a state where the control information is not received. The above hint can be said to be information necessary for processing a multiplexed stream.

[Refer to hint using descriptor ()]
Next, an example of referring to a hint using descriptor () will be described with reference to FIG. FIG. 10 is a diagram for explaining an example of referring to a hint using descriptor (). The MMT_descriptor () described in (a) of the figure includes information (signaling_message_hint_present_flag) indicating the presence / absence of a hint related to transmission of control information (signaling message). When the value of signaling_message_hint_present_flag is “1”, the data structure signaling_message_hint () shown in FIG.

  And (b) of the same figure shows an example of the data structure of signaling_message_hint (). This signaling_message_hint () includes max_signaling_message_interval that is information indicating the maximum interval of control information, and max_mpt_interval that is information indicating the maximum interval of MPT. Therefore, the maximum insertion interval of the MMTP packet including the control information can be obtained by referring to the descriptor () in (a) of the figure and referring to signaling_message_hint () in (b) of the figure.

[Embodiment 4]
The following will describe still another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  First, the configuration of the information processing apparatus 300 according to the present embodiment will be described with reference to FIG. FIG. 11 is a block diagram illustrating a main configuration of the information processing apparatus 300. Since the configuration other than the demax unit 310 is the same as that of the information processing apparatus 1, illustrations other than the demax unit 310 and the surrounding configuration are omitted.

  As illustrated, the demax unit 310 of the information processing apparatus 300 includes a TS demax unit (first separation unit) 11, a controller (control unit) 12, and an MMT demax unit (second separation unit) 313. . The control information (signaling message) of the present embodiment includes acquisition destination information for acquiring a part of the media constituting the content received by the TS demax unit 11 from another network. Here, since it is assumed that the TS demax unit 11 receives broadcast content via the broadcast network, the other network may be a communication network such as the Internet. Then, the MMT demax unit 313 acquires media (additional stream) from another network with reference to this acquisition destination information, and replaces and decodes a part of the media received by the TS demax unit 11. Thereby, the content which combined the media acquired from the some network can be shown to a user.

  For example, in the illustrated example, Ma and Mv that are MMTP packets are output from the TS demax unit 11 to the MMT demax unit 313. For example, Mv is a video stream of a movie, and Ma is an audio stream of English sound of the movie. In addition, control information (signaling message) is output from the controller 12 to the MMT demax unit 313. In this control information, acquisition destination information indicating the acquisition destination of the media is described, and the MMT demux unit 313 refers to this information to acquire Ma ′ that is an MMTP packet from a network such as the Internet. Ma ′ is, for example, an audio stream of Japanese audio of the above movie. Then, the MMT demax unit 313 outputs Ma ′ instead of Ma to the audio decoder 40. Thereby, Mv and Ma ′ are reproduced at the same time, and the above-mentioned movie can be viewed with Japanese voice. The acquisition destination information may be described as MMT_general_location_info () as shown in FIG. 5, for example.

  Whether or not to acquire media from another network may be determined according to the user's selection by making an inquiry to the user when detecting that there is media that can be acquired based on the control information. . Further, the configuration in which the MMT demax unit 313 acquires media from another network can be applied to any configuration including a TS demax unit and an MMT demax unit. For example, in the example of FIG. 8, the acquisition destination information may be notified from the controller 112 to the MMT demax unit 113, and the MMT demax unit 113 may acquire the media from the acquisition destination indicated by the acquisition destination information and send it to the decoder. Similarly, in the example of FIG. 9, the acquisition destination information may be notified from the controller 212 to the MMT demax unit 113, and the MMT demax unit 113 may acquire media from the acquisition destination indicated by the acquisition destination information and send it to the decoder.

[Flow of playback processing]
Next, the flow of reproduction processing executed by the information processing apparatus 300 will be described with reference to FIG. FIG. 12 is a flowchart illustrating an example of the reproduction process. As for the separation process, the process of FIG. 7 is performed.

  The controller 12 acquires control information from the PMT and outputs it to the MMT demax 313 unit (S10). As described above, the control information (signaling message) may be included in the PMT, or may be acquired from an acquisition destination described in the PMT.

  Then, the MMT demux unit 313 that has received the control information determines whether to acquire media from the outside (network other than the broadcast) based on the control information (S11). Here, if there is a medium that can be acquired from a network other than the broadcast, it may be determined that the medium is acquired, or the user may be allowed to select whether or not acquisition is possible.

  If it is determined that the medium is not acquired (NO in S11), the process proceeds to S14. If it is determined that the medium is acquired (YES in S11), the process proceeds to S12. In S12, the MMT demax unit 313 receives the medium that has been determined to be acquired, and determines the playback mode of the received medium (S13). For example, when a medium that is an alternative to the medium received from the TS demax unit 11 is received, the playback mode is determined to be replaced with the medium received from the TS demax unit 11.

  Then, the MMT demax unit 313 separates each MMTP packet according to its type (S14). Specifically, the MMTP packet to be reproduced is demultiplexed, and each medium obtained thereby is output to the audio decoder 40 or the video decoder 50 according to the type. Thereby, playback is performed in the playback mode determined in S13 (S15), and then the playback process ends.

[Embodiment 5]
The following will describe still another embodiment of the present invention with reference to FIG. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  The configuration of the information processing apparatus 400 according to the present embodiment will be described with reference to FIG. FIG. 13 is a block diagram illustrating a main configuration of the information processing apparatus 400. Since the configuration other than the demax unit 410 is the same as that of the information processing apparatus 1, illustrations other than the demax unit 410 and the surrounding configuration are omitted.

  As illustrated, the demax unit 410 of the information processing apparatus 400 includes a TS demax unit (first separation unit) 11, a controller (control unit) 12, and an MMT demax unit (second separation unit) 413. . The control information (signaling message) output from the controller 12 to the MMT demax unit 413 includes acquisition destination information as in the information processing apparatus 300. Then, the MMT demax unit 413 acquires media (additional stream) with reference to the acquisition destination information, and decodes it together with the media received by the TS demax unit 11. Thereby, the content which combined the media acquired from the some network can be provided to a user.

  For example, in the illustrated example, Ma and Mv that are MMTP packets are output from the TS demax unit 11 to the MMT demax unit 313. For example, Mv is a video stream of a movie and Ma is an audio stream of the movie. In addition, control information (signaling message) is output from the controller 12 to the MMT demax unit 413. In this control information, acquisition destination information is described, and the MMT demax unit 413 acquires Mv ′ that is an MMTP packet from a network such as the Internet with reference to the acquisition destination information. Mv ′ is, for example, a video stream that is an enhancement layer image of the movie. Then, the MMT demax unit 413 outputs both Mv and Mv ′ to the video decoder 50. As a result, a high frame rate / high resolution video in which Mv and Mv ′ are combined is reproduced.

  Note that the reproduction processing in the information processing apparatus 400 is the same as the example in FIG. That is, the information processing apparatus 400 determines a playback mode in which the two media are played back together in S13 of FIG. 12, demultiplexes the two media played back together in S14, and plays back these media together in S15.

  Further, the reproduction processing in the information processing apparatus 400 can be applied to any configuration including a TS demax unit and an MMT demax unit. For example, in the example of FIG. 8, the acquisition destination information may be notified from the controller 112 to the MMT demax unit 113, and the MMT demax unit 113 may acquire the media from the acquisition destination indicated by the acquisition destination information and send it to the decoder. Similarly, in the example of FIG. 9, the acquisition destination information may be notified from the controller 212 to the MMT demax unit 113, and the MMT demax unit 113 may acquire media from the acquisition destination indicated by the acquisition destination information and send it to the decoder.

[Modification]
In each of the embodiments described above, the information processing apparatus in the case where the first multiplexing method is MPEG-2 TS and the second multiplexing method is MMT has been described as an example. The present invention can be applied to any information processing apparatus that receives a multiplexed stream multiplexed by a method.

  In addition, when the first multiplexing method is MMT and the second multiplexing method is MPEG-2 TS, data related to PSI / SI may be stored in MMT control information (signaling message), or TS packet The converted version may be stored in the MMT payload. Video streams and audio streams may be TS packets that are stored in the MMT payload.

[Embodiment 6]
The following will describe still another embodiment of the present invention with reference to FIGS. For convenience of explanation, members having the same functions as those described in the embodiment are given the same reference numerals, and descriptions thereof are omitted.

  The configuration of the information processing apparatus 500 of this embodiment will be described with reference to FIG. FIG. 16 is a block diagram illustrating a main configuration of the information processing apparatus 500.

  As illustrated, the information processing apparatus 500 includes a session control unit 80. The session control unit 80 acquires control information (session information) necessary for receiving the MMT stream constituting the service from the broadcast receiving unit 20 or the communication unit 30, and controls the start / end of the session and the like.

  A configuration of a service received by the information processing apparatus 500 will be described with reference to FIG. FIG. 17 is a diagram illustrating an example of the relationship between services received by the information processing apparatus 500 and control information (session information), packages, MMT streams, assets, control information (MPT), and the like that configure each service.

  The service A is composed of control information a1 and a package a2. The package a2 includes an MMT stream a21 including an asset a211, an asset a212, and control information a213, and an MMT stream a22 including an asset a221. In the control information a1, information (session information) necessary for receiving the MMT stream a21 and the MMT stream a22 is described in a predetermined format. The control information a213 describes the aforementioned MPT (MMT Package Table). The MPT describes the package identifier of the package.

  The service B includes control information b1 and a package b2. The package b2 includes an MMT stream b21 including an asset b211, an asset b212, and control information b213, and the MMT stream a22. The MMT stream a22 is an MMT stream that is referenced from both the package a2 and the package b2. In the control information b1, information (session information) necessary for receiving the MMT stream b21 and the MMT stream a22 is described in a predetermined format. The control information b213 describes the aforementioned MPT (MMT Package Table). The MPT describes the package identifier of the package.

  Similarly, the service C includes control information c1 and a package c2.

  Next, the data structure of the session information will be described with reference to FIGS.

  FIG. 18 is a diagram illustrating an example of a data structure of session information. As shown in FIG. 18A, the session information includes the number of sessions, a session identifier, a main subflag, the number of referenced packages, a package identifier, and a session description. The meaning of each data is as shown in FIG.

  FIG. 19 is a diagram illustrating an example of a session description using SDP (Session Description Protocol). FIG. 19A is a description example of a multicast session, and shows that an MMT stream is multicast distributed from the unicast address 192.16.24.202 to the port 3456 of the multicast group address 224.2.0.1 by the MMT protocol. On the other hand, FIG. 19B is a description example of a unicast session, and shows that an MMT stream is unicasted from the unicast address 192.16.24.202 by the MMT protocol.

  For example, the control information a1 of the service A is described as follows.

Number of sessions: 2
Session identifier: a21
Main sub flag: 1
Number of referenced packages: 1
Package identifier: a2
Session description: description by SDP in FIG. 19A Session identifier: a22
Main sub flag: 0
Number of referenced packages: 2
Package identifier: a2
Package identifier: b2
Session description: Description by SDP in FIG.

  Further, the control information b1 of the service B is described as follows.

Number of sessions: 2
Session identifier: b21
Main sub flag: 1
Number of referenced packages: 1
Package identifier: b2
Session description: SDP description in FIG. 19A (however, the multicast group address or port is different from the description in FIG. 19A)
Session identifier: a22
Main sub flag: 0
Number of referenced packages: 2
Package identifier: b2
Package identifier: a2
Session description: Description by SDP in FIG.

  Next, a session control sequence at the time of service switching will be described with reference to FIGS. In the following description, it is assumed that the main MMT stream (main IP data flow) of each service is distributed by multicast and the sub MMT stream (sub IP data flow) is unicast.

  FIG. 20 is a diagram illustrating an example of a session control sequence when switching from service A to service B.

  When the service A is selected, the session control unit 80 acquires the session information of the service A (control information a1 in FIG. 17) from the broadcast receiving unit 20 or the communication unit 30 (1). When acquiring session information from the communication part 30, it is good also as a structure acquired from a predetermined multicast group, and it is good also as a structure acquired by accessing predetermined HTTP-URL.

  Subsequently, the session control unit 80 starts a main MMT stream session based on the session information (control information a1) (2). Specifically, referring to the corresponding session description, joins the multicast group using IGMP (Internet Group Management Protocol) (transmits a Membership Query packet including the multicast group address 224.2.0.1 in FIG. 19A as a parameter) By doing so, the MMT stream a21 can be received. It can be determined whether the main MMT stream is based on the value of the main sub flag included in the session information. Or it is good also as a structure which determines the 1st session of session information as a main MMT stream, without using a main subflag.

  Next, when the sub MMT stream of service A is selected, the session control unit 80 starts a session of the sub MMT stream based on the session information (control information a1) (3). Specifically, the MMT stream a22 can be received by referring to the corresponding session description and issuing a SETUP request or a PLAY request to the server using RTSP (Real Time Streaming Protocol).

  As a result, the information processing apparatus 500 plays a combination of the asset included in the MMT stream a21 and the asset included in the MMT stream a22, or converts a part of the asset included in the MMT stream a21 into an asset included in the MMT stream a22. It can be replaced and played.

  Next, when switching to the service B is performed, the session control unit 80 ends the session of the main MMT stream of the service A (4). Specifically, the reception of the MMT stream a21 is terminated by referring to the corresponding session description and leaving the multicast group (transmitting a Leave Group packet including the multicast group address 224.2.0.1 as a parameter) using IGMP. be able to. Note that the sub MMT stream a22 of the service A is also referred to by another service (package b2), and thus the session termination process is not performed at this point.

  Subsequently, the session control unit 80 acquires the session information of the service B (control information b1 in FIG. 17) from the broadcast reception unit 20 or the communication unit 30 (5), and based on the session information (control information b1), the main MMT A stream session is started (6).

  Here, since the sub MMT stream a22 of service B has already started a session when service A is selected, when the sub MMT stream of service B is selected, playback is performed without performing session start processing. Can do.

  FIG. 21 is a diagram illustrating an example of a session control sequence when switching from service A to service C.

  Process (1) to process (6) are the same as in FIG. After the process (6), since it is understood that the MMT stream a22 of the service A is not referred to from the service C (package c2), the session is ended (7). Specifically, the reception of the MMT stream a22 can be terminated by referring to the corresponding session description and issuing a TEARDOWN request to the server using RTSP.

  Next, when a sub MMT stream of service C is selected, the session control unit 80 starts a sub MMT stream session based on the session information (control information c1) (8).

  Here, a flow of session control processing (information processing apparatus control method) executed by the information processing apparatus 500 will be described with reference to FIG. FIG. 22 is a flowchart illustrating an example of the session control process.

  First, the user selects (switches) a service (S20). Next, if there is a main MMT stream for which a session is being established, the session is terminated (S21). Next, it is determined whether there is a sub-MMT stream for which a session is being established (S22). If No in S22, the session information of the service selected in S20 is acquired and analyzed (S24). In the case of Yes in S22, it is determined whether or not the sub MMT stream is referenced from another service by referring to the number of referenced packages described in the session information (S23). In the case of No in S23, the sub MMT stream session is terminated (S231). If Yes in S23, the process proceeds to S24.

  Subsequently, a session of the main MMT stream of the service selected in S20 is started (S25). When the sub MMT stream is in session establishment, it is determined whether or not the sub MMT stream is referenced from the service selected in S20 with reference to the package identifier described in the session information (S26). If No in S26, the sub MMT stream session is terminated (S261). In the case of Yes in S26, it is determined whether or not the MMT stream in session establishment satisfies the bandwidth constraint condition (S27). In the case of No in S27, the session is terminated from the sub MMT stream in which the session is being established, starting from the one with the smaller number of referenced packages (S271).

  As described above, in the service switching, by delaying the session termination process of the MMT stream referred to by a plurality of services, it is possible to suppress the reproduction delay associated with the session re-establishment. Furthermore, when there are a plurality of MMT streams for which a session is being established, the session can be efficiently terminated with reference to the referenced information.

[Examples of implementation using integrated circuits and software]
The control blocks (especially each part constituting the demax unit) of the information processing apparatuses 1, 100, 200, 300, 400, and 500 may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like. Alternatively, it may be realized by software using a CPU (Central Processing Unit).

  In the latter case, the information processing apparatuses 1, 100, 200, 300, 400, and 500 can read a program instruction that is software that realizes each function, and the above-described program and various data can be read by a computer (or CPU). ROM (Read Only Memory) or a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
The information processing apparatus (1, 100, 200, 300, 400) according to aspect 1 of the present invention receives the multiplexed stream received via the network according to the attribute information (PMT) received together with the multiplexed stream. First separation means for separating a second multiplexed stream multiplexed by a second multiplexing scheme different from the first multiplexing scheme from the first multiplexed stream multiplexed by the multiplexing scheme of (2) TS demax sections 11 and 111), second demultiplexing means (MMT demax sections 13, 113, 313, and 413) for separating media data from the second multiplexed stream, and control information (signaling message) included in the attribute information. ) And control means (controller 12) for controlling the control information to be used for separation of the second multiplexed stream by the second separation means. And 112 and 212), and a.

  According to the above configuration, the control information included in the attribute information is acquired, and control is performed so that the control information is used for separation of the second multiplexed stream by the second separation unit. Can be made available.

  Further, the information processing apparatus (100, 200) according to aspect 2 of the present invention includes remultiplexing means (remax units 114, 214) that performs multiplexing according to the second multiplexing method in aspect 1, The control means outputs the control information to the remultiplexing means, and the remultiplexing means multiplexes the control information output by the control means by the second multiplexing method, and A configuration in which the second multiplexed stream separated by the separation means is output to the second separation means may be employed.

  According to said structure, control information is multiplexed by a 2nd multiplexing system, and it outputs to a 2nd separation means with the 2nd multiplexed stream which the 1st separation means isolate | separated. For this reason, the second demultiplexing unit can acquire control information from the output data, and demultiplex the second multiplexed stream using the acquired control information. The data processed by the second separation means can be unified with the data multiplexed by the second multiplexing method.

  The information processing apparatus (200) according to aspect 3 of the present invention is the information processing apparatus (200) according to aspect 1 or 2, wherein the multiplexed stream received by the first separation unit is separated for separating the second multiplexed stream. Information is inserted at predetermined intervals in a state of being multiplexed by the second multiplexing method, and the control information indicates the insertion interval of the separation information in the multiplexed stream received by the first separation means. The multiplexed separation information and the second multiplexed stream are controlled so that the second multiplexed stream separated by the first separation means follows the multiplexed separation information including Arrangement means (remax unit 214) arranged using information may be provided, and the control means may output the control information to the arrangement means.

  According to the above configuration, the multiplexed separated information and the second multiplexed stream are controlled so that the multiplexed multiplexed information is followed by the second multiplexed stream separated by the first separating means. Arrange using information. Therefore, the second demultiplexing unit can acquire the control information and demultiplex the second multiplexed stream using the acquired control information.

  Further, the information processing apparatus (1, 100, 200, 300, 400) according to aspect 4 of the present invention is the information processing apparatus according to any one of the aspects 1 to 3, wherein the control information is the second separated by the first separation unit. Including acquisition destination information indicating an acquisition destination from a network different from the network of the additional stream multiplexed by the second multiplexing method, which is reproduced instead of the multiplexed stream or together with the second multiplexed stream. The control means outputs the control information to the second separation means, the second separation means obtains the additional stream from the acquisition destination indicated by the acquisition destination information, and the first separation means separates the information. The additional stream and the first separation means are separated so that the additional stream is reproduced instead of or together with the second multiplexed stream. It may be configured to perform the separation of the second multiplexed stream.

  According to the above configuration, the additional stream is acquired from the acquisition destination indicated by the acquisition destination information in the network different from the multiplexed stream separated by the first separation means. The additional stream and the second multiplexed stream separated by the first separation means are reproduced so that the additional stream is reproduced instead of the second multiplexed stream separated by the first separation means or together with the second multiplexed stream. Perform separation. Therefore, streams acquired from different networks can be combined and reproduced.

  Further, the information processing apparatus (1, 100, 200, 300, 400) according to the aspect 5 of the present invention receives the multiplexed stream received via the network according to the attribute information received together with the multiplexed stream. First separation means for separating a second multiplexed stream multiplexed by a second multiplexing scheme different from the first multiplexing scheme from a first multiplexed stream multiplexed by the multiplexing scheme And a second multiplex separated by the first separation means and a control means for obtaining from the attribute information acquisition source information indicating an acquisition destination of a multiplexed stream from a network different from the network. And the second multiplexed stream acquired from the acquisition destination indicated by the acquisition destination information, the media data contained in each of the second multiplexed streams is 1 And a, a second separating means for separating to be reproduced as the content.

  According to said structure, the acquisition destination information contained in attribute information is acquired, and a 2nd multiplexed stream is acquired from the acquisition destination which this acquisition destination information shows. Then, the media data included in each of the acquired second multiplexed stream and the second multiplexed stream separated by the first separation unit is separated so as to be reproduced as one content. Therefore, the acquisition destination information can be used reliably, and streams acquired from different networks can be combined and reproduced.

  In addition, the control method of the information processing device according to aspect 6 of the present invention includes multiplexing the multiplexed stream received via the network using the first multiplexing method according to the attribute information received together with the multiplexed stream. A first separation step of separating a second multiplexed stream multiplexed by a second multiplexing scheme different from the first multiplexing scheme from the first multiplexed stream; and control information included in the attribute information And a control step for controlling the control information to be used for separation of media data from the second multiplexed stream; a second separation step for separating media data from the second multiplexed stream; It is characterized by including. According to this structure, there exists an effect similar to the information processing apparatus of the said aspect 1.

  And the control method of the information processing apparatus concerning aspect 7 of this invention multiplexed the multiplexed stream received via the network with the 1st multiplexing system according to the attribute information received with this multiplexed stream. The first separation step of separating the second multiplexed stream multiplexed by the second multiplexing scheme different from the first multiplexing scheme from the first multiplexed stream, and the network of the multiplexed stream Acquired from the acquisition step indicated by the acquisition destination information, the control step of acquiring acquisition destination information indicating acquisition destinations from different networks from the attribute information, the second multiplexed stream separated in the first separation step, and the acquisition destination information The second multiplexed stream is divided so that the media data included in each of the second multiplexed streams is reproduced as one content. It is characterized in that it comprises a second separation step of the. According to this structure, there exists an effect similar to the information processing apparatus of the said aspect 5.

  The information processing apparatus (500) according to the eighth aspect of the present invention is an information processing apparatus that receives and reproduces a plurality of packages (services) via a network, and that includes a multiplexed stream (MMT stream) included in the package. Session control means for obtaining control information (session information) necessary for reception and controlling reception start and end of the multiplexed stream, and separation means for separating media data from the multiplexed stream, the control information Includes reference information indicating whether or not the multiplexed stream is referenced from a plurality of packages.

  According to the above configuration, in the service switching, it is possible to suppress the reproduction delay associated with the session re-establishment by delaying the session termination process of the MMT stream referred to by a plurality of services. Furthermore, when there are a plurality of MMT streams for which a session is being established, the session can be efficiently terminated with reference to the referenced information.

  Further, the information processing apparatus according to each aspect of the present invention may be realized by a computer. In this case, the information processing apparatus is operated by the computer by causing the computer to operate as each unit included in the information processing apparatus. A control program for the information processing apparatus to be realized and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  The present invention can be used in an apparatus that receives a multiplexed stream.

1, 100, 200, 300, 400, 500 Information processing device 11, 111 TS demax unit (first separation means)
12, 112, 212 Controller (control means)
13, 113, 313, 413 MMT demax section (second separating means)
114 Remax part (remultiplexing means)
214 Remax part (arrangement means)
80 Session control unit (session control means)

Claims (6)

A multiplexed stream received via the network is different from the first multiplexed system from the first multiplexed stream multiplexed by the first multiplexing system according to the attribute information received together with the multiplexed stream. First separation means for separating a second multiplexed stream multiplexed by the second multiplexing method;
Second separation means for separating media data from the second multiplexed stream;
And control means for acquiring control information included in the attribute information and controlling the control information so as to be used for separation of the second multiplexed stream by the second separation means. Information processing apparatus. Re-multiplexing means for performing multiplexing by the second multiplexing method;
The control means outputs the control information to the remultiplexing means,
The re-multiplexing means multiplexes the control information output from the control means by the second multiplexing method, and outputs the multiplexed information to the second demultiplexing means together with the second multiplexed stream separated by the first demultiplexing means. The information processing apparatus according to claim 1, wherein: In the multiplexed stream received by the first demultiplexing means, demultiplexing information for demultiplexing the second multiplexed stream is inserted at predetermined intervals in a state of being multiplexed by the second multiplexing method. And
The control information includes information indicating an insertion interval of the separation information in the multiplexed stream received by the first separation means,
The multiplexed separation information and the second multiplexed stream are arranged using the control information so that the second multiplexed stream separated by the first separation means follows the multiplexed separation information. Arranging means for
The information processing apparatus according to claim 1, wherein the control unit outputs the control information to the arrangement unit. The control information is the network of the additional stream multiplexed by the second multiplexing method that is reproduced instead of or together with the second multiplexed stream separated by the first separation means. Includes acquisition source information that indicates the acquisition source from a different network,
The control means outputs the control information to the second separation means,
The second demultiplexing unit acquires the additional stream from the acquisition destination indicated by the acquisition destination information, and the additional stream instead of or together with the second multiplexed stream separated by the first demultiplexing unit. 4. The information processing apparatus according to claim 1, wherein the additional stream and the second multiplexed stream separated by the first separation unit are separated such that the additional stream is reproduced. A multiplexed stream received via the network is different from the first multiplexed system from the first multiplexed stream multiplexed by the first multiplexing system according to the attribute information received together with the multiplexed stream. First separation means for separating a second multiplexed stream multiplexed by the second multiplexing method;
Control means for acquiring acquisition source information indicating an acquisition source from a network different from the network of the multiplexed stream from the attribute information;
The second multiplexed stream separated by the first separation means and the second multiplexed stream acquired from the acquisition destination indicated by the acquisition destination information are media data included in each of the second multiplexed streams. An information processing apparatus comprising: a second separation unit that separates the content so as to be reproduced as one content. In an information processing apparatus that receives and reproduces a plurality of packages via a network,
Session control means for acquiring control information necessary for reception of the multiplexed stream included in the package and controlling reception start and end of the multiplexed stream;
Separating means for separating media data from the multiplexed stream,
The information processing apparatus, wherein the control information includes reference information indicating whether or not the multiplexed stream is referenced from a plurality of packages.