WO2016208418A1

WO2016208418A1 - Transmission device, transmission method and program

Info

Publication number: WO2016208418A1
Application number: PCT/JP2016/067324
Authority: WO
Inventors: 愼治根岸; 和博石谷; 道人石井; 岳人渡辺; 義明大石; 康行茶木
Original assignee: ソニー株式会社
Priority date: 2015-06-26
Filing date: 2016-06-10
Publication date: 2016-12-29
Also published as: JP6684433B2; JP2017017383A

Abstract

The present technology relates to a transmission device, a transmission method and a program which make it possible to quickly and assuredly play back data, in a device which receives a data stream which has been multiplexed by individually packetizing data to be played back and control information to be used in the playback of the data. The transmission device is provided with: a multiplexing unit which generates a data stream by individually multiplexing a data packet which includes playback data, which is the data to be played back, and a control information packet which includes control information to be used in the playback of the playback data; and a transmission unit which transmits the data stream. The multiplexing unit multiplexes a control information packet, which includes control information corresponding to a prescribed processing unit of the playback data, before a data packet which includes the processing unit. The present technology is applicable to a broadcast signal transmission device, for example.

Description

Transmission device, transmission method, and program

The present technology relates to a transmission apparatus, a transmission method, and a program, and in particular, in an apparatus for receiving a data stream obtained by individually packetizing and multiplexing data to be reproduced and control information used for data reproduction. The present invention relates to a transmission device, a transmission method, and a program that can be reproduced quickly or reliably.

Conventionally, as a data structure of digital broadcasting, for example, MPEG-2 TS (Transport Stream) defined in ISO 13818-1 is used. In MPEG-2 TS, time information including a decoding time and a presentation time for each unit such as a video signal picture and an audio signal frame is encoded in the header of the video signal or audio signal packet. For this reason, the time information and the head of the data corresponding to the time information are close to each other on the data stream, and it is easy to associate them.

On the other hand, for example, in ARIB-STD-B60, which is a standard using MMT (MPEG Media Transport) defined in Part 1 of the MPEG-H standard, video signals and audio signals and time information corresponding thereto are disclosed in Patent Document 1. Are individually packetized by the method using the MMT message described in 1. A packet including data of a video signal or an audio signal (hereinafter referred to as a data packet) and a packet including control information such as time information (hereinafter referred to as a control information packet) are individually multiplexed into a data stream. And transmitted.

Japanese Patent No. 5672407

By the way, when the control information packet is multiplexed and transmitted after the corresponding data packet, the receiving device that receives the data stream does not receive the control information packet after receiving the data packet until the control information packet is received. The data time and the presentation time are unknown, and the data included in the data packet cannot be reproduced.

In addition, even if the receiving apparatus cannot receive the control information packet due to a transmission error or the like, it may not be able to detect a failure in receiving the control information packet or delay the detection, and may not be able to take appropriate measures. .

Therefore, the present technology enables data to be reproduced quickly or reliably in an apparatus that receives data streams in which data to be reproduced and control information used for data reproduction are individually packetized and multiplexed. is there.

A transmission apparatus according to an aspect of the present technology individually multiplexes a data packet that is a packet including reproduction data that is data to be reproduced, and a control information packet that is a packet including control information used to reproduce the reproduction data. And a transmission unit for transmitting the data stream, wherein the multiplexing unit is one first processing unit among predetermined processing units of the reproduction data. The first control information packet including the control information corresponding to is multiplexed before the first data packet including the first processing unit.

The multiplexing unit multiplexes the first control information packet between the second data packet including the second processing unit immediately before the first processing unit and the first data packet. Can be made.

The multiplexing unit includes the first control information at a position closest to the first data packet before the first data packet among positions where the control information packet can be multiplexed in the data stream. Packets can be multiplexed.

The multiplexing unit includes the first processing at a position closest to the first data packet after the first data packet among positions where the control information packet can be multiplexed in the data stream. The second control information packet including the control information corresponding to the unit can be further multiplexed.

The first data packet can include the beginning of the first processing unit.

The control information may include timing information used for controlling the timing for reproducing the processing unit.

The timing information may include at least one of information indicating a time at which decoding of the processing unit is started and information indicating a time at which the processing unit is presented.

The data packet and the control information packet can be MMTP (MMT protocol) packet, and the processing unit can be MPU (media processing unit).

A transmission method according to an aspect of the present technology individually multiplexes a data packet that is a packet including reproduction data that is data to be reproduced, and a control information packet that is a packet including control information used to reproduce the reproduction data. And a multiplexing step of multiplexing the control information packet including the control information corresponding to a predetermined processing unit of the reproduction data before the data packet including the processing unit. And a transmission control step for controlling transmission of the data stream.

A program according to an aspect of the present technology individually multiplexes a data packet that is a packet including reproduction data that is data to be reproduced, and a control information packet that is a packet including control information used to reproduce the reproduction data. And a multiplexing step of multiplexing the control information packet including the control information corresponding to a predetermined processing unit of the reproduction data before the data packet including the processing unit. And a transmission control step for controlling transmission of the data stream.

In one aspect of the present technology, a data packet that is a packet including reproduction data that is data to be reproduced and a control information packet that is a packet including control information used for reproducing the reproduction data are individually multiplexed. A data stream is generated, and the control information packet including the control information corresponding to a predetermined processing unit of the reproduction data is multiplexed before the data packet including the processing unit. Is sent.

According to one aspect of the present technology, in an apparatus that receives a data stream in which data to be reproduced and control information used for data reproduction are individually packetized and multiplexed, the data can be reproduced quickly or reliably. it can.

In addition, the effect described in this specification is an illustration to the last, and the effect of this technique is not limited to the effect described in this specification, and there may be an additional effect.

It is a block diagram which shows one Embodiment of the transmitter which applied this technique. It is a figure which shows the example of the data structure of MMTP-Packet. It is a figure which shows the example of the data structure of a control information packet. It is a figure for demonstrating the case where a control information packet is multiplexed after a data packet. It is a figure which shows the example of the position which multiplexes a control information packet. It is a flowchart for demonstrating 1st Embodiment of the multiplexing process performed by the transmitter. It is a figure which shows the example of the position of the control information packet multiplexed by 1st Embodiment of a multiplexing process. It is a flowchart for demonstrating 2nd Embodiment of the multiplexing process performed by the transmitter. It is a figure which shows the example of the position of the control information packet multiplexed by 2nd Embodiment of a multiplexing process. It is a block diagram which shows the structural example of a computer.

Hereinafter, modes for carrying out the present technology (hereinafter referred to as embodiments) will be described. The description will be given in the following order.
1. Embodiment 2. FIG. Modified example

<1. Embodiment>
{Configuration example of transmitting apparatus 101}
FIG. 1 is a block diagram illustrating an embodiment of a transmission apparatus 101 to which the present technology is applied.

The transmission device 101 is a device that transmits data such as a video signal and an audio signal by, for example, a media transport method using MMT. Hereinafter, a case where the transmission apparatus 101 transmits a video signal and an audio signal will be described.

The transmission apparatus 101 includes a synchronization control unit 111, an encoder 112, a buffer 113, a data packet generation unit 114, a control information packet generation unit 115, a multiplexing unit 116, and a transmission unit 117.

The synchronization control unit 111 controls the operation of the encoder 112. In addition, the synchronization control unit 111 generates time information used for reproducing the data encoded by the encoder 112 and supplies the time information to the control information packet generation unit 115.

The time information generated by the synchronization control unit 111 includes, for example, a decoding time and a presentation time.

The decoding time indicates, for example, the time at which data decoding is started in the receiving device that receives the data stream transmitted from the transmitting device 101. For example, the decoding time indicates the time at which decoding of each picture of the video signal and each frame of the audio signal is started. Note that the receiving device does not necessarily start decoding from the decoding time, and can start decoding before the decoding time.

The presentation time indicates the time at which data presentation is started in the receiving device. For example, the presentation time indicates a time at which an image corresponding to each picture of the video signal is displayed or audio corresponding to each frame of the audio signal is output.

Note that the decoding time and the presentation time may be expressed by, for example, absolute time, or may be expressed by a relative time with respect to a predetermined reference time.

Encoder 112 encodes an externally input video signal and audio signal. The encoder 112 stores the encoded video signal and audio signal in the buffer 113.

The data packet generator 114 generates an MMTP (MMT protocol) packet (hereinafter referred to as a data packet) obtained by packetizing the video signal and the audio signal stored in the buffer 113. The data packet generation unit 114 supplies the generated data packet to the multiplexing unit 116.

The control information packet generation unit 115 generates an MMTP packet (hereinafter referred to as a control information packet) obtained by packetizing control information used for reproducing a video signal or an audio signal included in a data packet. The control information included in the control information packet includes time information generated by the synchronization control unit 111. The control information packet generation unit 115 supplies the generated control information packet to the multiplexing unit 116.

The multiplexing unit 116 generates a data stream (hereinafter referred to as a multiplexed stream) by multiplexing the data packet and the control information packet individually, and supplies the data stream to the transmission unit 117.

The transmission unit 117 transmits the multiplexed stream generated by the multiplexing unit 116.

{Example of data structure of MMTP Packet}
FIG. 2 shows an example of the data structure of the MMTP packet constituting the data packet and the control information packet.

MMTP Packet includes MMTP Packet Header and MMTP Payload.

MMTP Packet Header includes packet_id and RAP_flag.

Packet_id is an identifier for identifying the type of data included in the MMTP Payload data byte of the MMTP Payload. For example, a different packet_id is assigned to each video signal and each audio signal multiplexed in the multiplexed stream. Different packet_ids are assigned to the data packet and the control information packet.

RAP_flag is a flag for identifying whether or not a random access point is included in the data included in the MMTP Payload data byte of the MMTP Payload. The random access point is a position where random access is possible, and for example, a picture that can be randomly accessed in a video signal corresponds.

MMTP Payload includes MMTP Payload Header and MMTP Payload data byte.

MMTP Payload Header includes mpu_sequence_number only for data packets. mpu_sequence_number is a sequence number assigned to a processing unit called MPU (Media Processing Unit) to which data included in MMTP Payload data byte belongs. mpu_sequence_number is assigned individually for each data with different packet_id. For example, when the video signal 1 of packet_id = ID1 and the video signal 2 of packet_id = ID2 are multiplexed in the multiplexed stream, mpu_sequence_number is assigned in order from the first MPU of the video signal 1, and similarly, Mpu_sequence_number is assigned in order from the top MPU. Therefore, the MPU of each video signal and audio signal can be identified by the combination of packet_id and mpu_sequence_number.

MPU is set between random access points in the case of video signals, for example. For example, a picture from a certain random access point to a picture immediately before the next random access point is assigned to one MPU. More specifically, for example, one GOP (Group-of-Pictures) is allocated to one MPU.

MMTP Payload data byte is an area containing actual data. For example, MMTP Payload data byte includes a video signal and an audio signal in the case of a data packet, and includes control information in the case of a control information packet.

In addition to storing one MPU in one data packet, it is also possible to store one MPU divided into a plurality of data packets. In the latter case, for example, a plurality of pictures included in one MPU are divided into a plurality of data packets and stored.

For the sake of simplicity, the case where each MPU is stored in one data packet will be described below.

{Example of data structure of control information packet}
FIG. 3 shows an example of the data structure of the control information packet.

MMTP Payload data byte of the control information packet stores various data tables as required. One of the data tables stored in MMTP Payload data byte is MPT (MMT Package Table). The MPT includes a packet_id of data (video signal or audio signal) that is a target of control information included in the control information packet, an MPU time stamp descriptor, an MPU extended time stamp descriptor, and the like.

The MPU time stamp descriptor and the MPU extended time stamp descriptor include the time information of the MPU that is the target of the control information included in the control information packet. For example, in the case of a video signal, the MPU time stamp descriptor and the MPU extended time stamp descriptor include the decoding time and presentation time of each picture included in the MPU that is the target of control information included in the control information packet. Further, the MPU time stamp descriptor and the MPU extended time stamp descriptor each include the mpu_sequence_number of the MPU that is the target of the control information included in the control information packet.

Note that the time information of one MPU may be stored in one control information packet, or the time information of one MPU may be divided and stored in a plurality of control information packets. In the latter case, for example, the time information of each picture included in one MPU is divided into a plurality of data packets and stored.

For the sake of simplicity, a case will be described below where time information of each MPU is stored in one control information packet.

{Example of position where control information packet is multiplexed}
FIG. 4 schematically shows a case where the control information packet PCa1 corresponding to the data packet PDa is multiplexed after the data packet PDa. Note that mpu_sequence_number of the MPU to which the data (video signal or audio signal) included in the data packet PDa belongs, and mpu_sequence_number of the time information (MPU time stamp descriptor and MPU extended time stamp descriptor) in the control information packet PCa1 are: Both are N. The control information packet PCa1 includes time information corresponding to the data included in the data packet PDa.

Note that, hereinafter, the mpu_sequence_number of the MPU to which the data included in the data packet belongs may be simply referred to as the mpu_sequence_number of the data packet. Hereinafter, the mpu_sequence_number of the time information of the control information packet may be simply referred to as the mpu_seauence_number of the control information packet.

Here, the reception device is in a state where the decoding time and the presentation time of the data included in the data packet PDa are unknown after receiving the data packet PDa until receiving the control information packet PCa1. Therefore, the receiving device cannot start reproducing the data included in the data packet PDa until receiving the control information packet PCa1.

For example, even if the control information packet PCa1 is lost due to a transmission error or the like, the receiving apparatus receives a control information packet whose mpu_sequence_number is later than N (for example, the control information packet PCa2 in the figure), and Until the inconsistency of mpu_sequence_number is detected, it is impossible to detect that the reception of the control information packet PCa1 has failed. As a result, there is a possibility that reproduction of data included in the data packet PDa is delayed or reproduction fails.

Therefore, as shown in FIG. 5, the multiplexing unit 116 of the transmitting apparatus 101 multiplexes the control information packet PCb corresponding to the data packet PDb before the data packet PDb. Thereby, the receiving apparatus can reproduce | regenerate the data contained in data packet PDb rapidly or reliably.

Specifically, when receiving the data packet PDb, the receiving apparatus has already received the control information packet PCb, so that a period in which the decoding time and the presentation time of the data included in the data packet PDb are unknown does not occur. Therefore, the receiving apparatus can quickly start reproducing the data included in the data packet PDb.

For example, even if the control information packet PCb is lost due to a transmission error or the like, the receiving device can detect that the reception of the control information packet PCa1 has failed when the data packet PDb is received. Then, for example, the receiving apparatus executes processing when the time information corresponding to the data included in the data packet PDb cannot be obtained immediately, and the data included in the data packet PDb is quickly and reliably processed by an appropriate method. Can be played.

Note that whether or not the control information packet PCb and the data packet PDb correspond to each other is determined based on the packet_id and mpu_sequence_number. Specifically, the MPT packet_id of the control information packet PCb matches the packet_id of the MMTP Packet Header of the data packet PDb, and the MPU timestamp descriptor and MPU extended timestamp descriptor of the control information packet PCb and the data packet PDb If mpu_sequence_number of MMTP Payload Header of the two matches, both are packets corresponding to each other. That is, time information of data included in MMTPMMPayload data byte of the data packet PDb is included in the control information packet PCb. On the other hand, when at least one of packet_id and mpu_sequence_number does not match, both are not corresponding packets. That is, time information of data included in MMTPMMPayload data byte of the data packet PDb is not included in the control information packet PCb.

{First Embodiment of Multiplexing Process}
Here, the first embodiment of the multiplexing process executed by the transmission apparatus 101 will be described with reference to the flowchart of FIG.

In step S1, the multiplexing unit 116 selects a data packet to be multiplexed next. That is, the multiplexing unit 116 selects a data packet to be multiplexed next in the multiplexed stream from the data packets supplied from the data packet generation unit 114.

In step S2, the multiplexing unit 116 multiplexes the selected data packet. That is, the multiplexing unit 116 supplies the selected data packet to the transmission unit 117. The transmission unit 117 transmits the supplied data packet. As a result, the selected data packet is multiplexed into the multiplexed stream.

In step S3, the multiplexing unit 116 determines whether or not the multiplexed data packet includes the head of the MPU. For example, when the mpu_sequence_number of the multiplexed data packet is different from the mpu_sequence_number of the previously multiplexed data packet, the multiplexing unit 116 determines that the multiplexed data packet includes the head of the MPU. The process proceeds to step S4.

In step S4, the multiplexing unit 116 switches the control information packet to be multiplexed to a packet corresponding to the data packet including the next MPU. Specifically, the multiplexing unit 116, among the control information packets supplied from the control information packet generation unit 115, has the same packet_id as the multiplexed data packet and the mpu_sequence_number next to the mpu_sequence_number of the multiplexed data packet. Retrieves the control information packet set in MPT. Thereby, a control information packet corresponding to the data packet including the MPU next to the MPU included in the multiplexed data packet is detected.

Then, the multiplexing unit 116 switches the control information packet supplied to the transmission unit 117 to the detected control information packet at a predetermined timing. Thereby, the control information packet multiplexed and transmitted from the transmission unit 117 to the multiplexed stream corresponds to the data packet including the next MPU from the control information packet corresponding to the data packet multiplexed in the process of step S2. Switch to control information packet.

Note that this switching may be performed at least before the next data packet is multiplexed. For example, the multiplexing unit 116 does not multiplex the control information packet corresponding to the multiplexed data packet between the multiplexed data packet and the next data packet to be multiplexed, and includes data including the next MPU. Only the control information packet corresponding to the packet may be multiplexed. Alternatively, for example, the multiplexing unit 116 multiplexes one or more control information packets corresponding to the multiplexed data packet between the multiplexed data packet and the data packet to be multiplexed next, and then Control information packets corresponding to data packets including MPUs may be multiplexed.

Thereafter, the process returns to step S1, and the processes after step S1 are executed.

On the other hand, in step S3, when the mpu_sequence_number of the multiplexed data packet is the same as the mpu_sequence_number of the previously multiplexed data packet, the multiplexing unit 116 does not include the head of the MPU. Is determined. Thereafter, the process of step S4 is not performed, the process returns to step S1, and the processes after step S1 are executed. That is, in this case, control information packets to be multiplexed are not switched.

FIG. 7 shows an example of the multiplexing position of the control information packet and the data packet by the multiplexing process of FIG. FIG. 7 shows an example in which control information packets indicated by hatching are periodically multiplexed into a multiplexed stream.

The data packet PDc1 and the control information packets PCc1a and PCc1b multiplexed before the data packet PDc1 are mutually corresponding packets. That is, the data packet PDc1 includes an MPU whose mpu_sequence_number is N, and the control information packets PCc1a and PCc1b include time information corresponding to an MPU whose mpu_sequence_number is N.

Then, after the data packet PDc1 is multiplexed and before the next data packet PDc2 including the MPU whose mpu_sequence_number is N + 1 is multiplexed, the control information packet to be multiplexed is changed from the packet corresponding to the data packet PDc1 to the data packet PDc2. It is switched to the packet corresponding to. Specifically, after the data packet PDc1 is multiplexed, one control information packet (control information packet PCc1c) corresponding to the data packet PDc1 is multiplexed. Thereafter, the control information packets PCc2a and PCc2b corresponding to the data packet PDc2 are multiplexed before the data packet PDc2 is multiplexed. The control information packets PCc2a and PCc2b are packets including time information corresponding to the MPU whose mpu_sequence_number is N + 1.

Thereby, when the receiving apparatus receives the data packet PDc2, since the control information packets PCc2a and PCc2b have already been received, a period in which the decoding time and the presentation time of the data included in the data packet PDc2 are unknown does not occur. Therefore, the receiving device can quickly start reproducing the data included in the data packet PDc2.

Further, for example, even if the control information packets PCc1a to PCc1c are lost due to a transmission error or the like, the receiving apparatus corresponds to the data packet PDc1 before receiving the data packet PDc2 when the control information packet PCc2a is received. It is possible to detect that reception of the control information packet has failed. Then, for example, the receiving apparatus performs processing when the time information corresponding to the data included in the data packet PDc1 cannot be obtained immediately, and the data included in the data packet PDc1 is quickly and reliably processed by an appropriate method. It becomes possible to play.

Further, by multiplexing the control information packet PCc1c after the data packet PDc1, the control information packet corresponding to the data packet PDc1 can be received even if the receiving apparatus starts reception between the control information packet PCc1b and the data packet PDc1. It becomes possible to receive. As a result, the receiving apparatus can reliably start reproducing the data included in the data packet PDc1.

In this example, one control information packet corresponding to the data packet PDc1 is multiplexed between the data packet PDc1 and the data packet PDc2. However, two or more can be multiplexed. However, it is an indispensable condition to multiplex one or more control information packets corresponding to the data packet PDc2 before the data packet PDc2. Also, by multiplexing only one control information packet corresponding to the data packet PDc1 at a position closest to the data packet PDc1 after the data packet PDc1 among positions where the control information packet can be multiplexed, the receiving apparatus can When the reception of the control information packet corresponding to the data packet PDc1 fails, the reception error can be detected more quickly.

Further, as described above, it is possible not to multiplex any control information packet corresponding to the data packet PDc1 between the data packet PDc1 and the data packet PDc2. In this case, immediately after the data stream is multiplexed in step S2 in step S4 of the flowchart of FIG. 6, the control information packet to be multiplexed becomes a data packet including the MPU next to the MPU included in the multiplexed data packet. Switch to the corresponding control information packet.

{Second Embodiment of Multiplexing}
Next, a second embodiment of the multiplexing process executed by the transmission apparatus 101 will be described with reference to the flowchart of FIG.

In step S101, the data packet to be multiplexed next is selected in the same manner as in step S1 of FIG.

In step S102, the multiplexing unit 116 determines whether or not the selected data packet includes the head of the MPU by the same process as in step S3 of FIG. If it is determined that the selected data packet includes the head of the MPU, the process proceeds to step S103.

In step S103, the multiplexing unit 116 determines whether or not the control information packet corresponding to the selected data packet has already been multiplexed. If it is determined that the control information packet corresponding to the selected data packet has not yet been multiplexed, the process proceeds to step S104.

In step S104, the multiplexing unit 116 inserts a control information packet corresponding to the selected data packet. Specifically, the multiplexing unit 116 searches the control information packet supplied from the control information packet generating unit 115 for a control information packet in which the same packet_id and mpu_sequence_number as the selected data packet are set to MPT. . Then, the multiplexing unit 116 supplies the detected control information packet to the transmission unit 117. The transmission unit 117 transmits the supplied control information packet. Thereby, the control information packet corresponding to the selected data packet is multiplexed and transmitted in the multiplexed stream.

Thereafter, the process proceeds to step S105.

On the other hand, if it is determined in step S103 that the control information packet corresponding to the selected data packet has already been multiplexed, the process of step S104 is skipped, and the process proceeds to step S105.

If it is determined in step S102 that the selected data packet does not include the head of the MPU, the processes in steps S103 and S104 are skipped, and the process proceeds to step S105.

In step S105, the selected data packet is multiplexed in the same manner as in step S2 of FIG.

Thereafter, the process returns to step S101, and the processes after step S101 are executed.

FIG. 9 shows an example of the multiplexing position of the control information packet and the data packet by the multiplexing process of FIG.

If it is determined in step S103 that the control information packet corresponding to the data packet PDd is not yet multiplexed, the control information packet corresponding to the data packet PDd is immediately before the data packet PDd as shown in FIG. PCd is multiplexed.

As a result, when receiving the data packet PDd, the receiving apparatus has already received the control information packet PCd corresponding to the data packet PDd, and therefore there is a period in which the decoding time and the presentation time of the data included in the data packet PDd are unknown. Does not occur. Therefore, the receiving apparatus can quickly start reproducing the data included in the data packet PDd.

In addition, as shown in FIG. 7 described above, when the position where the control information packet can be multiplexed is determined in advance, the multiplexing unit 116 can determine the most data packet before the data packet PDd among the positions where multiplexing is possible. The control information packet PCd may be multiplexed at a position close to PDd.

For example, when the transmission apparatus 101 multiplexes data of a plurality of programs, a plurality of video signals, or a plurality of audio signals, in the process of step S101, for each program, each video signal, or each audio signal Packets to be multiplexed may be selected. In this case, another program, another video signal, or another audio signal packet may be inserted between the control information packet PCd and the data packet PDd in FIG.

Furthermore, the determination process in step S102 can be omitted.

<2. Modification>
As described above, it is assumed that data of one MPU is divided and stored in a plurality of data packets. In this case, for example, the multiplexing unit 116 may multiplex at least one control information packet including time information of the MPU before a data packet including the head of the MPU among a plurality of data packets. .

Further, when data of one MPU is divided and stored in a plurality of data packets, in the example of FIG. 7 described above, the data packet PDc1 corresponds to a data packet including the end of the MPU whose mpu_sequence_number is N. The packet PDc2 corresponds to a data packet including the head of the MPU whose mpu_sequence_number is N + 1. That is, a control information packet including time information corresponding to the next MPU is multiplexed between a data packet including the end of the previous MPU and a data packet including the top of the next MPU. Switch to.

Furthermore, as described above, it is assumed that time information of one MPU is divided and stored in a plurality of control information packets. In this case, the multiplexing unit 116 may multiplex a plurality of control information packets one by one before a data packet including the head of the MPU.

Also, for example, the present technology can be applied to a case where data packets and control information packets are further packetized by the Internet protocol or the like and then multiplexed.

Furthermore, the present technology can also be applied to a case where data to be reproduced (hereinafter referred to as reproduction data) other than the video signal and audio signal described above is packetized and multiplexed. As such reproduction data, for example, caption data can be considered.

Further, the present technology can be applied to a case where time information including only one of the decoding time and the presentation time or time information other than the decoding time and the presentation time is packetized and multiplexed separately from the reproduction data. it can.

Furthermore, the present technology can also be applied to a case where timing information used for controlling timing for reproducing reproduction data other than the decoding time and presentation time is packetized and multiplexed separately from the reproduction data. For example, as such timing information, a reproduction time that is a time at which reproduction data that is not decoded on the transmission side starts reproduction on the reception side is assumed.

Further, the present technology can also be applied to a case where control information necessary for reproduction of reproduction data other than time information is packetized and multiplexed separately from reproduction data.

Furthermore, the present technology can be applied to all systems and apparatuses that transmit data streams in which playback data that is data to be played back and control information used for playback of playback data are individually packetized and multiplexed.

{Example of computer configuration}
The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software is installed in the computer. Here, the computer includes, for example, a general-purpose personal computer capable of executing various functions by installing various programs by installing a computer incorporated in dedicated hardware.

FIG. 10 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processing by a program.

In the computer, a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, and a RAM (Random Access Memory) 303 are connected to each other by a bus 304.

An input / output interface 305 is further connected to the bus 304. An input unit 306, an output unit 307, a storage unit 308, a communication unit 309, and a drive 310 are connected to the input / output interface 305.

The input unit 306 includes a keyboard, a mouse, a microphone, and the like. The output unit 307 includes a display, a speaker, and the like. The storage unit 308 includes a hard disk, a nonvolatile memory, and the like. The communication unit 309 includes a network interface and the like. The drive 310 drives a removable medium 311 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

In the computer configured as described above, the CPU 301 loads the program stored in the storage unit 308 to the RAM 303 via the input / output interface 305 and the bus 304 and executes the program, for example. Is performed.

The program executed by the computer (CPU 301) can be provided by being recorded on the removable medium 311 as a package medium or the like, for example. The program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

In the computer, the program can be installed in the storage unit 308 via the input / output interface 305 by attaching the removable medium 311 to the drive 310. Further, the program can be received by the communication unit 309 via a wired or wireless transmission medium and installed in the storage unit 308. In addition, the program can be installed in advance in the ROM 302 or the storage unit 308.

The program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.

In this specification, the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Accordingly, a plurality of devices housed in separate housings and connected via a network and a single device housing a plurality of modules in one housing are all systems. .

Furthermore, embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

For example, the present technology can take a cloud computing configuration in which one function is shared by a plurality of devices via a network and is jointly processed.

Further, each step described in the above flowchart can be executed by one device or can be shared by a plurality of devices.

Further, when a plurality of processes are included in one step, the plurality of processes included in the one step can be executed by being shared by a plurality of apparatuses in addition to being executed by one apparatus.

Further, the effects described in the present specification are merely examples and are not limited, and other effects may be obtained.

Also, for example, the present technology can take the following configurations.

(1)
Multiplexing for generating a data stream by individually multiplexing a data packet that is a packet including reproduction data that is data to be reproduced and a control information packet that is a packet including control information used for reproducing the reproduction data And
A transmission unit for transmitting the data stream,
The multiplexing unit includes a first control information packet including the control information corresponding to a first processing unit of one of predetermined processing units of the reproduction data, and a first processing unit including the first processing unit. Transmitter that multiplexes before any data packet.
(2)
The multiplexing unit multiplexes the first control information packet between a second data packet including a second processing unit immediately before the first processing unit and the first data packet. The transmission device according to (1).
(3)
The multiplexing unit includes the first control information packet at a position closest to the first data packet before the first data packet among positions where the control information packet can be multiplexed in the data stream. The transmitter according to (1) or (2).
(4)
The multiplexing unit is configured to place the first processing unit at a position closest to the first data packet after the first data packet among positions where the control information packet can be multiplexed in the data stream. The transmission apparatus according to any one of (1) to (3), wherein the second control information packet including the control information corresponding to is further multiplexed.
(5)
The transmission device according to any one of (1) to (4), wherein the first data packet includes a head of the first processing unit.
(6)
The transmission apparatus according to any one of (1) to (5), wherein the control information includes timing information used for controlling timing for reproducing the processing unit.
(7)
The transmission device according to (6), wherein the timing information includes at least one of information indicating a time at which decoding of the processing unit is started and information indicating a time at which the processing unit is presented.
(8)
The data packet and the control information packet are MMTP (MMT Protocol) Packets,
The transmission device according to any one of (1) to (7), wherein the processing unit is an MPU (Media Processing Unit).
(9)
A data stream is generated by individually multiplexing a data packet which is a packet including reproduction data which is data to be reproduced and a control information packet which is a packet including control information used for reproducing the reproduction data. A multiplexing step of multiplexing the control information packet including the control information corresponding to a predetermined processing unit of the reproduction data before the data packet including the processing unit;
A transmission control step for controlling transmission of the data stream.
(10)
A data stream is generated by individually multiplexing a data packet which is a packet including reproduction data which is data to be reproduced and a control information packet which is a packet including control information used for reproducing the reproduction data. A multiplexing step of multiplexing the control information packet including the control information corresponding to a predetermined processing unit of the reproduction data before the data packet including the processing unit;
A program for causing a computer to execute processing including: a transmission control step for controlling transmission of the data stream.

101 transmission device, 114 data packet generation unit, 115 control information packet generation unit, 116 multiplexing unit, 117 transmission unit

Claims

Multiplexing for generating a data stream by individually multiplexing a data packet that is a packet including reproduction data that is data to be reproduced and a control information packet that is a packet including control information used for reproducing the reproduction data And
A transmission unit for transmitting the data stream,
The multiplexing unit includes a first control information packet including the control information corresponding to a first processing unit of one of predetermined processing units of the reproduction data, and a first processing unit including the first processing unit. Transmitter that multiplexes before any data packet.
The multiplexing unit multiplexes the first control information packet between a second data packet including a second processing unit immediately before the first processing unit and the first data packet. The transmission device according to claim 1.
The multiplexing unit includes the first control information packet at a position closest to the first data packet before the first data packet among positions where the control information packet can be multiplexed in the data stream. The transmitter according to claim 1.
The multiplexing unit is configured to place the first processing unit at a position closest to the first data packet after the first data packet among positions where the control information packet can be multiplexed in the data stream. The transmission apparatus according to claim 1, further multiplexing a second control information packet including the control information corresponding to.
The transmission device according to claim 1, wherein the first data packet includes a head of the first processing unit.
The transmission apparatus according to claim 1, wherein the control information includes timing information used for controlling timing for reproducing the processing unit.
The transmission apparatus according to claim 6, wherein the timing information includes at least one of information indicating a time at which decoding of the processing unit is started and information indicating a time at which the processing unit is presented.
The data packet and the control information packet are MMTP (MMT Protocol) Packets,
The transmission apparatus according to claim 1, wherein the processing unit is an MPU (Media Processing Unit).
A data stream is generated by individually multiplexing a data packet which is a packet including reproduction data which is data to be reproduced and a control information packet which is a packet including control information used for reproducing the reproduction data. A multiplexing step of multiplexing the control information packet including the control information corresponding to a predetermined processing unit of the reproduction data before the data packet including the processing unit;
A transmission control step for controlling transmission of the data stream.
A data stream is generated by individually multiplexing a data packet which is a packet including reproduction data which is data to be reproduced and a control information packet which is a packet including control information used for reproducing the reproduction data. A multiplexing step of multiplexing the control information packet including the control information corresponding to a predetermined processing unit of the reproduction data before the data packet including the processing unit;
A program for causing a computer to execute processing including: a transmission control step for controlling transmission of the data stream.