JP6416698B2 - Transmission device and reception device, and program - Google Patents

Description

  The present invention relates to a transmission device, a reception device, and a program thereof. In particular, the present invention relates to a transmitter, a receiver, and a program for television broadcasting.

  Data such as subtitle text in television broadcasting includes text itself and timing information for presenting the text on the viewer side. Text data in which such presentation timing is designated is called timed text or timed text data. One of the methods for expressing text accompanied by such designation regarding presentation timing is TTML (Timed Text Markup Language). By using TTML, it is possible to specify and describe the display timing and display layout attributes (display position, etc.) regarding text display. The use of TTML for transmitting information such as subtitle text and other superimposes in digital television broadcasting is also under consideration. Note that the caption text is used, for example, to display the content of the audio utterance in the broadcast content in the same language as the audio utterance or in a different language.

  Non-Patent Document 1 describes the rules for TTML. Chapter 8 describes styling (including character fonts). Chapter 9 describes the layout. Chapter 10 describes the timing.

"Timed Text Markup Language 1 (TTML1) (Second Edition) W3C Recommendation 24 September 2013", [online], September 24, 2013, World Wide Web Consortium (W3C), [May 2014 (March 2014) Search on the 25th], Internet <URL: http://www.w3.org/TR/ttaf1-dfxp/>

  Non-Patent Document 1 describes the data format because it defines the rules regarding the TTML data itself, but does not describe the procedure for transmitting the data. In the prior art, when timed text such as subtitles of video content is described in TTML and transmitted, timed text for the entire content (for example, 1 hour of video content is converted to 1 hour of video). Corresponding timed text) was transmitted in advance.

  However, such a method according to the prior art has a problem that the amount of timed text data that must be stored on the receiving device side becomes enormous, and resources such as necessary memory increase. In addition, in order to transmit timed text for the entire content in advance, for example, there is a problem that timed text must be transmitted with sufficient time before the program starts. In the case of broadcasting, the receiving device may be turned on from the middle of a program. Even in such a case, it is technically difficult to transmit timed text without delay.

  The present invention has been made on the basis of the above-mentioned problem recognition, and provides a transmission device and a reception device, and a program thereof, capable of transmitting timed text at an appropriate timing in broadcasting or the like. It is.

  Further, a further object of the present invention is to provide a transmission device and a reception device for reliably displaying subtitle data or character superimposition data combining images, sounds, web fonts, and the like in the transmission of the timed text described above, and To provide those programs.

  [1] In order to solve the above-described problem, a transmission device according to an aspect of the present invention divides timed text data in which presentation timing is specified into a plurality of presentation timing groups, and the timed text data after division. Is stored in one media processing unit in the MMT transmission method, and includes at least the text asset generated by the text setting unit and a text setting unit that generates a text asset including a plurality of media processing units for each presentation timing group It comprises a multiplexing unit that multiplexes content data to generate distribution data, and a transmission unit that transmits distribution data obtained by multiplexing by the multiplexing unit.

  [2] Further, according to one aspect of the present invention, in the transmission device, the text setting unit includes the divided timed text data, and a resource file referred to from the divided timed text data. Are stored in different media fragment units within the same media processing unit, thereby generating the text asset.

  [3] Further, according to an aspect of the present invention, in the transmission device, the text setting unit may store data representing a total number of media fragment units in a certain media processing unit, and a predetermined media fragment in the media processing unit. The text asset is generated by storing in a unit.

  [4] Further, according to one aspect of the present invention, in the transmission device described above, the text setting unit includes, for each media fragment unit in a certain media processing unit, a data type and a data size of a file stored in the media fragment unit. Is stored in a predetermined media fragment unit in the media processing unit to generate the text asset.

[5] A receiving apparatus according to an aspect of the present invention includes a receiving unit that receives a signal including distribution data from the outside, and a series of media processing units in an MMT transmission scheme from the distribution data received by the receiving unit. A separation unit that separates the text assets,
A text processing unit that sequentially extracts the media processing units from the text assets separated by the separation unit and extracts timed text data included in the media processing unit; and the timed processing extracted by the text processing unit. A presentation control unit configured to obtain presentation timing information from the text data and to control to present the text included in the timed text data at a timing according to the presentation timing information.

  [6] Further, according to one aspect of the present invention, in the reception device, the text asset includes a media processing unit for each presentation timing group obtained as a result of being divided into a plurality of presentation timing groups, The media processing unit stores each of the divided timed text data and the resource file referenced from the divided timed text data in another media fragment unit in the media processing unit. The text processing unit extracts the timed text data and the resource file in the media processing unit, and the presentation control unit extracts the timed text extracted by the text processing unit. Generates a layout for presentation on the basis of the resource file, presented at a timing according to the information of the presentation timing, characterized in that.

  [7] In addition, according to an aspect of the present invention, in the reception device, the resource file extracted by the text processing unit is temporarily accumulated during processing of a media processing unit to which the resource file belongs. And a temporary resource storage unit for deleting the resource file temporarily stored after the processing of the media processing unit is completed.

  [8] Further, according to an aspect of the present invention, in the reception device, when the text processing unit fails to extract at least one of the resource files, the presentation control unit includes the timed text, A presentation layout is generated based on the resource file that has not failed to be extracted.

  [9] Further, according to one aspect of the present invention, in the reception device, the predetermined media fragment unit in the media processing unit in the text asset stores data representing the total number of media fragment units in the media processing unit. When the text processing unit processes the media processing unit, the text processing unit is based on the total number of media fragment units in the media processing unit and the number of received media fragment units in the media processing unit. And determining whether or not reception of all media fragment units in the media processing unit has been completed, and the presentation control unit determines whether the text processing unit Based on the result, it generates a layout for presentation when the reception of all media fragments units within the media processing unit has been completed, characterized in that.

  [10] Further, according to one aspect of the present invention, in the reception device, the predetermined media fragment unit in the media processing unit in the text asset is a media fragment unit for each media fragment unit in the media processing unit. Data representing the data type and data size of a file to be stored is stored, and when the text processing unit acquires the predetermined media fragment unit in the media processing unit, each of the media processing unit Refer to the data representing the data type and data size of the file stored in the media fragment unit What performs processing for securing computational resources needed to process the files included in all media fragments units included in the media processing unit, characterized in that.

  [11] In addition, according to one aspect of the present invention, timed text data in which presentation timing is specified is divided into a plurality of presentation timing groups, and the divided timed text data is one media processing in the MMT transmission method. Text setting means for generating a text asset comprising a plurality of media processing units for each presentation timing group stored in the unit, and content data including at least the text asset generated by the text setting means is multiplexed to generate distribution data This is a program that causes a computer to function as multiplexing means.

  [12] Further, according to one aspect of the present invention, separation means for separating a text asset as a series of media processing units in the MMT transmission method from distribution data received by the reception means, and the text asset separated by the separation means The media processing units are sequentially extracted from the text processing means for extracting the timed text data included in the media processing unit, and the presentation timing information is acquired from the timed text data extracted by the text processing means. A program that causes a computer to function as a presentation control unit that controls to present text included in the timed text data at a timing according to the presentation timing information.

According to the present invention, it is possible to divide timed text associated with content such as video into groups of presentation timings and transmit them at an appropriate timing. That is, it is not necessary to transmit timed text corresponding to the entire content in advance.
Further, it is possible to reliably transmit and present a resource file or the like referenced from timed text.

It is a block diagram which shows schematic function structure of each of the transmitter and receiver by embodiment of this invention. It is the schematic which shows the data structure (structure of an asset) for transmitting timed texts, such as a caption, transmitted to the receiver from the transmitter by the same embodiment. It is the schematic which shows the data structure of the caption sample header in each MFU in the caption transmission asset transmitted from the transmitter to the receiver according to the embodiment. It is the schematic which shows the value of a data type and its meaning in the caption sample header by the embodiment.

Next, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a schematic functional configuration of each of the transmission device and the reception device in the present embodiment. In the television broadcasting system, there are actually a large number of receiving devices 2, but only one receiving device is shown in FIG.
As shown in the figure, the transmission device 1 includes a transmission unit 11, a multiplexing unit 12, a video / audio setting unit 14, and a text setting unit 15. The receiving device 2 includes a receiving unit 21, a separating unit 22, a video / audio processing unit 24, a text processing unit 25, a resource temporary storage unit 26, a text presentation control unit 27, and a composite display / output unit. 28.
Note that the transmission device 1 and the reception device 2 transmit and receive television broadcast signals, respectively. For transmission / reception of TV broadcast signals, each device has functions for processing not only text assets but also video, audio, and control information. Here, only functions directly related to the present invention will be described. Explanation of other functions is omitted.

First, the function of each unit in the transmission apparatus 1 will be described.
The transmission unit 11 modulates the distribution data obtained by multiplexing by the multiplexing unit 12 and transmits it as a broadcast signal. The transmission unit 11 transmits a broadcast signal using radio waves (terrestrial waves or broadcast satellite waves) or television cables.
The multiplexing unit 12 multiplexes content data including at least the text asset generated by the text setting unit 15 to generate distribution data. The multiplexing unit 12 performs multiplexing using an MMT (MPEG Media Transport) transmission method. Specifically, the multiplexing unit 12 multiplexes the video asset and audio asset generated by the video / audio setting unit 14 together with the text asset to generate distribution data. Here, the text asset is a subtitle asset or a character super asset.
The video / audio setting unit 14 acquires and encodes the supplied video signal and audio signal, and generates the content data of the video asset and the audio asset, respectively. Video and audio are stream type data, which are collectively referred to as stream type content data.

  The text setting unit 15 divides the timed text data for which the presentation timing is specified into a plurality of presentation timing groups, and stores the divided timed text data in one media processing unit in the MMT transmission method. Generate text assets consisting of multiple media processing units per group.

Here, the text asset is a caption asset or a character super asset. The timed text data includes information on the timing of presentation (year / month / day, hour / minute / second, etc.) on the receiver side. A presentation timing group is a set of one or more presentation timings. When a presentation timing group includes a plurality of presentation timings, they are a group of adjacent timings.
The internal data structure of the text asset will be described in detail later with reference to the drawings.

  The text setting unit 15 also transfers each of the divided timed text data and the resource file referenced from the divided timed text data to another media fragment unit in the same media processing unit. Generate text assets by storing each.

  The text setting unit 15 also stores data representing the total number of media fragment units in a certain media processing unit in a predetermined media fragment unit in the media processing unit to generate a text asset. Specifically, the text setting unit 15 stores data representing the total number in the header portion of the first media fragment unit in the media processing unit.

The text setting unit 15 also transmits, for each media fragment unit in a certain media processing unit, data representing the data type and data size of a file stored in the media fragment unit to a predetermined media fragment unit in the media processing unit. Store in and generate text assets. Specifically, the text setting unit 15 stores information on the data type and data size (number of bytes) of the file stored in each subsequent media fragment unit in the header portion of the first media fragment unit in the media processing unit. To do. This information can be hint information for processing data of all media fragment units on the receiving device side that receives the text asset. That is, the receiving device can prepare computing resources (memory and computer processing resources on the receiver side) for processing the resource file based on the hint information.
The text setting unit 15 may omit storing hint information.

  The broadcast signal transmitted from the transmitter 1 is transmitted to a number of receivers 2 by radio waves (terrestrial waves and broadcast satellite waves) or by cables.

Next, functions of each unit in the receiving device 2 will be described.
The receiving unit 21 receives a broadcast signal from the outside. This broadcast signal includes distribution data transmitted by the transmission device 1. The receiving unit 21 demodulates the received broadcast signal.
The separation unit 22 separates the text asset that is a series of media processing units in the MMT transmission method from the distribution data received by the reception unit 21. In addition, the separation unit 22 separates video assets, audio assets, and the like from the distribution data.
The video / audio processing unit 24 decodes the video asset and the audio asset separated by the separation unit 22 to generate a video signal and an audio signal. At the same time, the video / audio processing unit 24 extracts information related to video and audio presentation timing from the video asset and the audio asset, respectively.

The text processing unit 25 sequentially extracts media processing units from the text assets separated by the separation unit 22, and extracts timed text data included in the media processing unit.
The text presentation control unit 27 acquires presentation timing information from the timed text data extracted by the text processing unit 25 and controls to present the text included in the timed text data at the designated presentation timing. . The text presentation control unit 27 arranges the text according to the instructed layout. As will be described later, the text asset may include an image resource file, an audio resource file, and a font file, and the text presentation control unit 27 also lays out these resources in an integrated manner.
In the display screen on the receiver side, the subtitle plane and the character superplane are different planes. Therefore, the text presentation control unit 27 presents the text acquired as the caption asset in the caption plane, and presents the text acquired as the character super asset in the character superplane. That is, the text presentation control unit 27 controls these two planes independently of each other.
The composite display / output unit 28 combines the subtitle plane and the character superplane output from the text presentation control unit 27 with the video plane output from the video / audio processing unit 24 to display a screen, The voice delivered from the voice processing unit 24 is output.

Note that the text asset is composed of media processing units for each presentation timing group obtained as a result of being divided into a plurality of presentation timing groups. Further, the media processing unit stores each of the divided timed text data and the resource file referenced from the divided timed text data in another media fragment unit in the media processing unit. It consists of
The text processing unit 25 extracts timed text data and one or more resource files in the media processing unit. Note that the text processing unit 25 temporarily stores the extracted resource file in the resource temporary storage unit 26.
The temporary resource storage unit 26 temporarily stores the extracted resource file. That is, the resource temporary storage unit 26 functions as a so-called cache memory. In the present embodiment, the resource file is referred to only within the range of one media processing unit. Therefore, when the processing of a certain media processing unit is completed and the process proceeds to reception and processing of the next new media processing unit, the contents of the resource temporary storage unit 26 are once erased. In other words, the contents of the temporary resource storage unit 26 can be cleared each time when the process proceeds from one media processing unit to the next media processing unit. In other words, since the present embodiment employs a method of transmitting timed text by dividing it into a plurality of media processing units (each corresponding to a presentation timing group), the capacity of the memory for storing resource files is minimized. That's it.
That is, the resource temporary storage unit 26 temporarily stores the resource file extracted by the text processing unit 25 during the processing of the media processing unit to which the resource file belongs, and ends the processing of the media processing unit. Later, the resource file temporarily accumulated is deleted.
Then, the text presentation control unit 27 generates a presentation layout based on the timed text extracted by the text processing unit 25 and the resource file, and performs control so as to present it at a timing according to the presentation timing information.

When the text processing unit 25 fails to extract at least one of the resource files, the text presentation control unit 27 generates a layout for presentation based on the timed text and the resource file that has not failed to be extracted. To do.
That is, the unit of the media fragment unit in transmission and the unit of a logical file (timed text data file and resource file such as image, sound, font, etc.) are matched. As a result, even if reception of some media fragment units fails, subtitles and superimposing characters are presented without affecting other media fragment units (that is, other logical files). Will be able to.

The predetermined media fragment unit in the media processing unit in the text asset stores data representing the total number of media fragment units in the media processing unit.
When the text processing unit 25 processes the media processing unit, the text processing unit 25 determines the media processing based on the total number of media fragment units in the media processing unit and the number of received media fragment units in the media processing unit. It is determined whether reception of all media fragment units in the unit is completed. In addition, by assigning a serial number of the media fragment unit in the media processing unit and storing it in the media fragment unit, the text processing unit 25 allows the received media fragment unit to be what number in the media processing unit. You can know if it is.
Based on the result of determination by the text processing unit 25, the text presentation control unit 27 can start generating a presentation layout when reception of all media fragment units in the media processing unit has been completed. .

The predetermined media fragment unit in the media processing unit in the text asset stores data representing the data type and data size of the file stored in the media fragment unit for each media fragment unit in the media processing unit. Is.
When the text processing unit 25 acquires a predetermined media fragment unit in the media processing unit, the text processing unit 25 refers to data representing the data type and data size of the file stored in the media fragment unit for each media fragment unit in the media processing unit. As a result, processing for securing calculation resources (memory and CPU) necessary for processing files included in all media fragment units included in the media processing unit is performed.
Specifically, the text processing unit receives the media fragment unit by storing the data type and data length information of each subsequent media fragment unit in the header portion of the first media fragment unit in the media processing unit. At this stage, it is possible to secure the computing resources in advance.

Next, data to be transmitted will be described.
FIG. 2 is a schematic diagram showing a data configuration (asset configuration) for transmitting timed text such as subtitles. In the present embodiment, the transmission device 1 multiplexes and transmits a television broadcast signal composed of video, audio, text, and the like using an MMT (MPEG Multimedia Transport) method. In the figure, an example of a caption asset is shown, but the same applies to a character super (superimpose by character) asset. Video assets, audio assets, subtitle assets, character super assets, etc. constitute one package. The location of each asset in a package is indicated in an MP table (MMT package table; not shown).

  As illustrated, the caption asset is configured as a time series of a plurality of MPUs (Media Processing Unit, Media Processing Unit, Media Processing Unit). Each MPU can be divided into a plurality of MFUs (Media Fragment Units, Media Fragment Units, Media Fragment Units) and transmitted. Here, although the method of dividing into MFUs is generally arbitrary, in this embodiment, these logical files such as a TTML document, an image file, an audio file, a font file, and the like referred to from the TTML document are used. The unit of is matched with the unit of MFU. The top MFU in each MPU is a TTML document file. That is, one MPU is one TTML document file (first MFU) and resources (image file, audio file, moving image file, font file, etc.) referenced from the TTML document, and each file is stored in the MFU. Equivalent). However, the number of these resources referenced from the TTML document is 0 or more (may be 0). The TTML document includes presentation timing information based on TTML rules. A plurality of adjacent presentation timings may be included in one TTML document. Note that even when a plurality of presentation timings are included in one TTML document, the MPU uses representative timing information of these timings, for example, the first presentation timing among the plurality of presentation timings as the MUP time. Can have as a stamp. As described above, each MPU included in a caption transmission asset encapsulates caption data based on a TTML document having one or more presentation timings and related data.

  In the present embodiment, each MFU has a caption sample header. The caption sample header of the first MFU in each MPU (which is the MFU of the TTML document) can store not only information related to the MFU but also information related to other MFUs in the MPU. . The caption sample header will be described with reference to FIG.

  FIG. 3 is a schematic diagram illustrating a data configuration of a caption sample header in each MFU in a caption transmission asset transmitted by the transmission device 1. The header of each MFU in the character super has the same data structure. This figure shows the data structure, the number of bits of each data item included in the data structure, and the data notation. In the figure, the data structure is expressed in a formal language having a block structure. Note that “uimsbf” in the data notation represents “unsigned integer, most significant bit first”, that is, an unsigned integer and the most significant bit is first. “Bslbf” represents “bit string, left bit first”, that is, a bit string and the left bit is the head.

Each field in the caption sample header will be described below.
(1) subtitle_tag (caption identification tag): This is a label for identifying a subtitle or a character super stream.
(2) subtitle_sequence_number (caption sequence number): Indicates the sequence number of the entire caption data to be sent in the caption asset. A common number is stored in the same MPU. Further, it is incremented by 1 between consecutive MPUs.
(3) subsample_number (caption data number): The number of subtitle data (subsample) in the MPU is expressed in ascending order. The number of the caption data sent by the first MFU in the MPU is “0”. Incremented by 1 between consecutive MFUs in the same MPU.
(4) last_subsample_number (last caption data number): indicates the last subsample_number of caption data sent by the MPU.
(5) data_type (data type): indicates the data type of subtitle data (subsample) sent by this MFU. The type of data type and its value will be described later.

(6) length_extension_flag (data length extension flag): This flag indicates whether or not to extend the number of bits of the data length field that appears below. When the number of bits is expanded to 32 bits (representable from 0 to 4,294,967,295), the value is “1”, and the number of bits is not expanded to 16 bits (from 0 to 65, 535 can be expressed), the value is “0”.
(7) subsamples_info_flag (subtitle data hint information flag): Flag information indicating whether or not to describe hint information regarding all subtitle data (subsample) transmitted by the MPU. The value when the hint information is included is “1”, and the value when it is not included is “0”.

(8) data_size (data size): indicates the size (number of bytes) of caption data to be sent by the MFU.
(9) subsample_i_content_type (i-th caption data type): indicates the data type of the i-th caption data (MFU). The type of data type and its value will be described later.
(10) subsample_i_data_size (i-th subtitle data size): indicates the size of the i-th subtitle data (MFU).
(11) data_byte (data byte): Data byte of caption data of the MFU.

Note that the caption data number of the MFU is “0” (that is, the first MFU), and the last caption data number of (4) is greater than 0 (that is, the MFU of the resource file referenced from the TTML document is (1) or more) and the caption data hint information flag in (7) is “1” and only in that case, the (9) i-th caption data type and (10) i-th caption data There is a loop of size pairs.
The data length extension flag (6) is effective for both the data size (8) and the i-th caption data size (10).

FIG. 4 is a schematic diagram showing values and meanings of the data type (the sixth line of the data structure in FIG. 3) and the i-th caption data type (the 19th line of the data structure in FIG. 3) in the caption sample header described above. It is. The data type is a bit string expression.
When the value of the data type is “0000”, the MFU stores an ARIB-TTML document file. ARIB-TTML is one of the TTML standards.
When the value of the data type is “0001”, the MFU stores an image file in PNG (Portable Network Graphics) format.
When the value of the data type is “0010”, the MFU stores an image file in the SVG (Scalable Vector Graphics) format.
When the value of the data type is “0011”, the MFU stores an audio file in PCM (AIFF-C) format. PCM represents pulse code modulation. AIFF is an abbreviation for Audio Interchange File Format.
When the value of the data type is “0100”, the MFU stores an audio file in MP3 (MPEG-1 Audio Layer-3) format.
When the value of the data type is “0101”, the MFU stores an audio file in the MPEG-4 AAC (Advanced Audio Coding) format. MPEG is an abbreviation for Moving Picture Experts Group.
When the value of the data type is “0110”, the MFU stores a font file in the SVG (Scalable Vector Graphics) format. SVG is a type of vector font.
When the value of the data type is “0111”, the MFU stores a font file in the WOFF (Web Open Font Format) format.
Data type values from “1000” to “1111” are reserved for future use.

  Note that at least some of the functions of the transmission device and the reception device in the above-described embodiment may be realized by a computer. In that case, the program for realizing these functions may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read into a computer system and executed. Here, the “computer system” includes an OS and hardware such as peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible disk, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, a “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory inside a computer system serving as a server or a client in that case may be included, and a program that holds a program for a certain period of time. The program may be a program for realizing a part of the above-described functions, or may be a program that can realize the above-described functions in combination with a program already recorded in a computer system.

  According to the configuration of the present embodiment described above, it is possible to reliably display subtitles or character superimposes that combine images, sounds, web fonts, and the like in transmission using MMT.

  Further, according to the configuration of the present embodiment, the MFU is configured in consideration of the media, that is, the unit of the logical file (TTML file or resource file) and the MFU unit are transmitted in the same manner. Thus, it is possible to suppress error propagation when transmission quality degradation such as packet loss occurs. For example, even if the MFU of the image file portion is lost, fault tolerance such as the ability to display the subtitle text at a minimum can be obtained.

  Further, according to the configuration of the present embodiment, subsample_number (the serial number of the MFU (receiving MFU) in the MPU) and last_subsample_number (information on the total number of MFUs in the MPU) are placed in the header of each MFU. As a result, it is possible to determine whether or not the MFU is the last MFU in the MPU, and thereby it is possible to reliably present subtitles at the timing when all the data is prepared. Without this hint information, it is not possible to know whether or not the MPU data is prepared, and timely presentation cannot be performed.

  In addition, according to the configuration of the present embodiment, the receiver secures memory in advance by putting information (data type and data size) related to the subtitle information entering the subsequent MFU into the subtitle sample header attached to the first MFU. You can be ready to do.

Although the embodiment has been described above, the present invention can also be implemented in the following modified example.
For example, the present invention may be applied to other than television broadcasting. The configuration similar to that of the above-described embodiment can be applied not only to television broadcasting but also to a service (for example, a content distribution service using the Internet) that distributes stream-type content and timed text using the MMT transmission method. it can.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes designs and the like that do not depart from the gist of the present invention.

  The present invention can be used, for example, for a system (transmitting device or receiving device) for television broadcasting. Further, the present invention is not limited to television broadcasting, and can be used for a system for delivering stream-type content accompanied by timed text.

DESCRIPTION OF SYMBOLS 1 Transmitting device 2 Receiving device 11 Transmitting unit 12 Multiplexing unit 14 Video / audio setting unit 15 Text setting unit 21 Reception unit 22 Separating unit 24 Video / audio processing unit 25 Text processing unit 26 Resource temporary storage unit 27 Text presentation control unit 28 Composite display / output section

Claims (4)

A text setting unit that stores timed text data in which presentation timing is specified in one media processing unit in the MMT transmission method for each presentation timing group, and generates a text asset including the plurality of media processing units;
A multiplexing unit that multiplexes content data including at least the text asset generated by the text setting unit to generate distribution data;
A transmission unit for sending distribution data obtained by multiplexing by the multiplexing unit;
A transmission device comprising:
The presentation timing group may include a plurality of the presentation timings,
The text setting unit assigns each of the timed text data corresponding to the presentation timing group and the resource file referenced from the timed text data to another media fragment unit in the same media processing unit. Generating the text asset by storing each;
A transmission apparatus characterized by the above. A receiving unit for receiving a signal including distribution data from outside;
A separation unit for separating a text asset as a series of media processing units in the MMT transmission method from the distribution data received by the reception unit;
A text processing unit that sequentially extracts the media processing units from the text assets separated by the separation unit, and extracts timed text data included in the media processing unit;
A presentation control unit that obtains presentation timing information from the timed text data extracted by the text processing unit, and controls to present text included in the timed text data at a timing according to the presentation timing information. When,
A receiving device comprising:
Before Symbol text asset consists of a media processing unit of each presentation timing group,
The presentation timing group may include a plurality of the presentation timings,
The media processing unit sends each of the timed text data corresponding to the presentation timing group and a resource file referenced from the timed text data to another media fragment unit in the media processing unit. It consists of storing,
The text processing unit extracts the timed text data and the resource file in the media processing unit,
The presentation control unit generates a layout for presentation based on the timed text data extracted by the text processing unit and the resource file, and presents it at a timing according to the presentation timing information.
A receiving apparatus. Text setting means for storing timed text data in which presentation timing is specified in one media processing unit in the MMT transmission method for each presentation timing group and generating a text asset composed of a plurality of the media processing units;
Multiplexing means for generating distribution data by multiplexing content data including at least the text asset generated by the text setting means;
As a program that allows a computer to function as
The presentation timing group may include a plurality of the presentation timings,
The text setting means assigns each of the timed text data corresponding to the presentation timing group and the resource file referenced from the timed text data to another media fragment unit in the same media processing unit. Generating the text asset by storing each;
program. Separating means for separating a text asset as a series of media processing units in the MMT transmission method from distribution data received by the receiving means;
Text processing means for sequentially extracting the media processing units from the text assets separated by the separation means, and extracting timed text data included in the media processing units;
Presentation control means for obtaining presentation timing information from the timed text data extracted by the text processing means, and for controlling to present text included in the timed text data at a timing according to the presentation timing information. ,
As a program that allows a computer to function as
Before Symbol text asset consists of a media processing unit of each presentation timing group,
The presentation timing group may include a plurality of the presentation timings,
The media processing unit sends each of the timed text data corresponding to the presentation timing group and a resource file referenced from the timed text data to another media fragment unit in the media processing unit. It consists of storing,
The text processing means extracts the timed text data and the resource file in the media processing unit,
The presentation control means generates a layout for presentation based on the timed text data extracted by the text processing means and the resource file, and presents it at a timing according to the presentation timing information.
program.

Images