JP2013229689A - Reproduction device, distribution device, data structure, reproduction method, distribution method, control program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To specify reproduction timing of non-timed media.SOLUTION: A receiver 2 comprises: a reproduction control unit 26 that determines whether non-timed media can be reproduced by referring to reproduction information indicating a reproduction condition of the non-timed media acquired together with a content 15; and a program execution unit 27 that reproduces the non-timed media determined to be reproducible by the reproduction control unit 26 during reproduction of timed media.

Description

  The present invention relates to a playback apparatus for playing back content including time-dependent media played at a specific playback time and time-independent media that are played back with the time-dependent media and whose playback time is not specified.

  In recent years, various contents such as video, audio, and text have been distributed, and standardization of a transmission format for distributing such contents has also been promoted. In particular, standardization of MMT (MPEG Media Transport) promoted by the Moving Picture Experts Group (MPEG) has attracted attention.

  In this MPEG MMT, standardization is progressing with the aim of enabling delivery of a plurality of components having different properties such as video, audio, and text through different routes. That is, MPEG MMT enables multi-component hybrid distribution.

  The contents of MPEG MMT are stored as a package (MMT Package). In addition to multiple components (MMT Asset) such as video, audio, text, and applications, the layout of each component, such as the display position and size, whether it can be combined, etc. It includes at least data relating to composition information (Composition Information: CI) indicating reproduction conditions and transmission characteristic information (Transport Characteristics: TC) such as necessary bandwidth and allowable delay of each component for determining an optimum distribution route.

  Such a component can be divided into packets and transmitted over a single network. This will be described with reference to FIG. FIG. 18 is a diagram illustrating a content transmission mode. In the figure, one transmission packet is described as one block.

In the illustrated example, a plurality of transmission packets (A _1,1 , A _2,1 ,...) _Follow the transmission packet CI _{1 of} configuration information and the transmission packet TC ₁ of transmission characteristic information. The transmission packets after A _1,1 (A _{i, j} : i = 1, 2,..., J = 1, 2,...) Include media units constituting the asset.

These media units are transmitted to the receiver via a network that is determined based on the TC _1. That is, when a plurality of networks are determined by TC ₁ , (hybrid) transmission by a plurality of (heterogeneous) networks is performed. For _{example, A 1,1,} A _1,2, the ... asset delivered a communication network such as the _{Internet, A 2,1,} A _2,2, may be distributed in a broadcast network ... assets. The hybrid transmission is also described in Patent Document 1 below. The receiver reproduces the basis of these media units CI _1.

  By the way, the above-mentioned component (MMT Asset) is roughly classified into time-dependent media (timed media) played at a specified time and time-independent media (non-timed media) for which a specific playback time is not specified. .

  Since this time-independent medium is a medium for which a specific reproduction time is not specified, the user can basically reproduce it at an arbitrary timing. However, there is a case where it is desired to set conditions for the reproduction timing of the time-independent medium. is assumed.

  For example, when the time-dependent medium is a moving image and the time-independent medium is application software, it is also assumed that it is desirable to limit the reproduction timing (use timing) of the application software during reproduction of a predetermined scene of the moving image. Is done.

Japanese Patent Laid-Open No. 10-173612 (released on June 26, 1998)

  However, conventionally, there has been a problem that no condition is set for the reproduction timing of the time-independent medium, and the reproduction timing of the time-independent medium cannot be limited. This is not limited to MPEG MMT content, but is a common problem that arises when handling content that includes time-independent media for playback.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a data structure that can specify the playback timing of time-independent media, a playback device that plays back content based on the data structure, Another object of the present invention is to provide a distribution device that distributes contents based on the data structure.

  In order to solve the above problems, a playback apparatus according to the present invention plays back content including time-dependent media for which playback time is specified and time-independent media whose playback timing is not limited to a specific time. A specifying means for specifying the reproducible period of the time-independent medium with reference to specific information for identifying the reproducible period of the time-independent medium acquired together with the content, and the specifying means And a media playback means for playing back the time-independent media during the playable period specified by.

  In addition, in order to solve the above-described problem, the playback method of the present invention plays back content including time-dependent media whose playback time is specified and time-independent media whose playback timing is not limited to a specific time. A playback method by a playback device, wherein the specifying step is to specify the playable period of the time-independent medium with reference to the specific information for specifying the playable period of the time-independent medium acquired together with the content. And a media playback step of playing back the time-independent media in the playable period specified in the specifying step.

  According to said structure, with reference to the specific information for specifying the reproducible period of the time-independent media acquired with the content, the reproducible period of the time-independent media is specified, and time is specified in the specified reproducible period. Play independent media. Therefore, it is possible to limit the playback timing of the time-independent media to a predetermined playable period specified from the specific information.

  Note that the time-dependent media may be any media that can be played back at a specified specific playback time, and may be, for example, moving images, audio, text (subtitles synchronized with audio, etc.), and the like. The time-independent media may be any media as long as it is reproduced together with the time-dependent media and constitutes one content with the time-dependent media. For example, it may be a text (such as a comment on the entire content) displayed superimposed on the moving image of the time-dependent media being reproduced, a still image, an application program executed when reproducing the time-dependent media, or the like.

  Further, the specific information is information in which time-dependent media and time-independent media that can be reproduced simultaneously are associated with each other, and the specifying means includes the time-dependent media associated with the time-independent media in the specific information. It is preferable to specify the playback period as a playable period of the time-independent medium.

  According to the above configuration, the specific information is information in which time-dependent media and time-independent media that can be reproduced simultaneously are associated with each other. Then, the playback period of the time-dependent medium associated with the time-independent medium in the specifying information is specified as the playable period of the time-independent medium.

  Therefore, the reproduction timing of the time-independent medium can be limited to the reproduction period of the predetermined time-dependent medium specified from the specific information. This also makes it possible to play back time-independent media only in combination with specific time-dependent media.

  The specific information includes information indicating a start time and an end time of the reproducible period, and the specifying unit sets a period from the start time to the end time as a reproducible period of the time-independent medium. It is preferable to specify.

  According to the above configuration, the specific information includes information indicating the start time of the playable period, and specifies a period after the start time as the playable period of the time-independent medium. Therefore, the playback timing of the time-independent medium can be limited to the time after the start time indicated by the specific information.

  In addition, the playback device includes a plurality of media units to be time stamped. The plurality of media units include a time-dependent media unit that is played back at a time indicated by the time stamp, and a playback timing. When playing mixed media including a time-independent media unit that is not limited to the time indicated by the time stamp, the media playback means is configured such that the time-dependent media unit is a time stamp assigned to the time-dependent media unit. The time-independent media unit is preferably reproduced without being limited to the time indicated by the time stamp given to the time-independent media unit.

  According to the above configuration, among the media units constituting the mixed media, the time-dependent media unit is played back at the time indicated by the time stamp, and the time-independent media unit is played back without being limited to the time indicated by the time stamp.

  Therefore, each media unit can be played back at an appropriate timing according to the media units constituting the mixed media.

  The specific information includes information indicating a time-dependent medium that does not permit reproduction of the time-independent medium during a reproduction period, and the identification unit reproduces the time-dependent medium that does not permit reproduction of the time-independent medium. It is preferable that a period other than the period is specified as the playable period of the time-independent medium.

  According to the above configuration, the specific information includes information indicating time-dependent media that do not permit playback of time-independent media during the playback period. Then, a period other than the playback period of the time-dependent media that does not permit playback of the time-independent media is specified as the playable period of the time-independent media.

  Therefore, the reproduction timing of the time-independent medium can be limited to a period other than the reproduction period of the time-dependent medium indicated in the specific information. In addition, this makes it possible to prevent the time-independent medium from being played back in combination with a specific time-dependent medium (for example, a combination not desired by the content creator).

  In addition, in order to solve the above-described problem, the distribution device of the present invention distributes content including time-dependent media for which a reproduction time is designated and time-independent media whose reproduction timing is not limited to a specific time. Distributing the content by specifying the reproducible period of the time-independent media with reference to the specific information for identifying the reproducible period of the time-independent media acquired together with the content. A distribution control unit that determines a distribution time in a period from a start time to a start time of the reproducible period; and a distribution unit that distributes the time-independent medium at the distribution time determined by the distribution control unit. It is characterized by that.

  In order to solve the above-described problem, the distribution method of the present invention distributes content including time-dependent media whose playback time is specified and time-independent media whose playback timing is not limited to a specific time. A distribution method by a distribution device, which refers to specific information for identifying a playable period of the time-independent medium acquired together with the content, specifies a playable period of the time-independent medium, and A distribution control step for determining a distribution time in a period from a content distribution start time to a start time of the playable period, and a distribution step for distributing the time-independent medium at the distribution time determined in the distribution control step. It is characterized by including.

  According to said structure, with reference to the specific information for specifying the reproducible period of the time-independent media acquired with the content, the reproducible period of the time-independent media is specified, and from the delivery start time of the content, The distribution time is determined by the period up to the start time of the reproducible period. Then, the time-independent medium is distributed at the determined distribution time.

  In this way, by giving a range to the delivery time of the time-independent media, compared to the conventional delivery device that determines the delivery time regardless of whether it is time-dependent media or time-independent media, It is possible to efficiently distribute the entire content while ensuring reproduction from the start of the reproducible period. For example, time-independent media can be distributed at a timing with a margin in the transmission band of the network used for distribution.

  In addition, the distribution device includes a plurality of media units to be time stamped. The plurality of media units include a time-dependent media unit that is played at the time indicated by the time stamp, When delivering a mixed media including a time-independent media unit whose timing is not limited to the time indicated by the time stamp, the delivery control means sets the delivery time of the time-dependent media unit to the time-dependent media unit. It is preferable to set based on the time indicated by the given time stamp, and set the delivery time of the time-independent media unit regardless of the time indicated by the time stamp given to the time-independent media unit.

  According to the above configuration, among the media units constituting the mixed media, the time-dependent media unit delivery time is set based on the time indicated by the time stamp, and the time-independent media unit delivery time is the time indicated by the time stamp. Set regardless of the setting.

  Therefore, it is possible to efficiently distribute the entire mixed media by adjusting the distribution time of the time-independent media unit while ensuring reproduction from the time indicated by the time stamp of the time-dependent media unit.

  In order to solve the above-described problem, the data structure of the present invention is associated with content including time-dependent media whose playback time is specified and time-independent media whose playback timing is not limited to a specific time. And a data structure of information referred to when the content is reproduced or distributed, wherein the reproduction device that reproduces the content or the distribution device that distributes the content can reproduce the time-independent medium. Specific information for specifying the reproducible period of the time-independent medium is described.

  According to the above data structure, the specific information for specifying the playable period of the time-independent medium is described so that the playback apparatus or the distribution apparatus can specify the playable period of the time-independent medium. ing.

  Accordingly, it is possible to allow the playback device or the distribution device to specify the playback period of the time-independent media, and to limit the playback of the time-independent media within the period, and to perform distribution in consideration of the period can do.

  Moreover, it is preferable that the specific information is information in which a time-dependent medium and a time-independent medium that can be reproduced simultaneously are associated with each other in a list of time-dependent media and time-independent media included in the content.

  According to the above configuration, the specific information is information in which the time-dependent media and the time-independent media that can be reproduced simultaneously are associated with each other in the list of time-dependent media and time-independent media included in the content.

  Therefore, by referring to the above list, it is possible to specify the time-dependent media and the time-independent media included in the content, and it is possible to specify which of these media can be played simultaneously. .

  As a result, the playback timing of the time-independent media can be limited to the playback period of the predetermined time-dependent media specified from the specific information, and the time-independent media can be played back only in combination with the specific time-dependent media. It can also be made.

  It is also possible to efficiently distribute the entire content while ensuring playback from the start of the playable period of the time-independent media.

  Further, the specific information is information in which time-dependent media and time-independent media that can be reproduced simultaneously are associated with each other, and therefore, for example, compared to the case of using information describing the reproducible time of time-independent media, It is easy to add or change combinations that can be played back at the same time.

  The playback device and the distribution device may be realized by a computer. In this case, the playback device and the distribution device are operated by causing the computer to operate as each unit of the playback device and the distribution device. A control program realized by a computer and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  As described above, the playback device of the present invention refers to the specific information for identifying the playable period of the time-independent medium acquired together with the content, and specifies the playable period of the time-independent medium. And media playback means for playing back the time-independent media during the playable period specified by the specifying means.

  In addition, as described above, the playback method of the present invention specifies the playable period of the time-independent medium with reference to the specific information for identifying the playable period of the time-independent medium acquired together with the content. And a media playback step of playing back the time-independent media during the playable period specified in the specified step.

  According to said structure, with reference to the specific information for specifying the reproducible period of time-independent media, the reproducible period of time-independent media is specified, and time-independent media are added to the specified reproducible period. Reproduce. Therefore, it is possible to limit the playback timing of the time-independent media to a predetermined playable period specified from the specific information.

  In addition, as described above, the distribution device of the present invention specifies the playable period of the time-independent medium with reference to the specific information for identifying the playable period of the time-independent medium acquired together with the content. And a delivery control means for determining a delivery time in a period from a delivery start time of the content to a start time of the reproducible period, and a delivery for delivering the time-independent medium at a delivery time determined by the delivery control means. And means.

  Then, as described above, the distribution method of the present invention specifies the reproducible period of the time-independent medium with reference to the specific information for identifying the reproducible period of the time-independent medium acquired together with the content. A distribution control step for determining a distribution time in a period from a distribution start time of the content to a start time of the reproducible period, and a distribution for distributing the time-independent medium at the distribution time determined in the distribution control step. And a step.

  In this way, by giving a range to the delivery time of the time-independent media, compared to the conventional delivery device that determines the delivery time regardless of whether it is time-dependent media or time-independent media, It is possible to efficiently distribute the entire content while ensuring reproduction from the start of the reproducible period.

  In addition, as described above, the data structure of the present invention is time-independent so that the playback device that plays back the content or the delivery device that delivers the content can specify the playable period of the time-independent media. This is a configuration in which specific information for specifying the media reproducible period is described.

  Accordingly, it is possible to allow the playback device or the distribution device to specify the playback period of the time-independent media, and to limit the playback of the time-independent media within the period, and to perform distribution in consideration of the period can do.

It is a block diagram which shows the principal part structure of the transmitter and receiver which comprise the content transmission / reception system concerning one Embodiment of this invention. It is a figure which shows an example of the data structure of the content used with the said content transmission / reception system. It is a figure which shows the outline | summary of the structure information used with the said content transmission / reception system. It is a figure which shows an example of the structure information of the movie content with a caption. It is a figure which shows an example of the structure information of a sports program content. It is a figure which shows an example of the structure information of a music program content. It is a figure which shows an example of the structure information which described the playable period of the time-independent media in the STIA element. It is a flowchart which shows an example of the delivery process in which the said transmitter delivers a content to the said receiver. It is a flowchart which shows an example of the reproduction | regeneration processing which the said receiver reproduces | regenerates the content received from the said transmitter. It is a figure which shows an example of the table which shows the correspondence of a time-dependent medium and the time-independent medium which can be utilized during reproduction | regeneration of this time-dependent medium. It is a figure which shows an example of the structure information described about the asset containing time-dependent media and time-independent media. It is a figure which shows an example of the data structure of the asset header which described the asset type and the corresponding asset. It is a figure which shows an example of the data structure of the media unit header which described the information which shows a synchronization precision. 10 is a flowchart illustrating an example of a distribution process in which the transmitter distributes content to the receiver with reference to a media unit header when asset_type is MIXED (mixed asset). It is a flowchart which shows another example of the reproduction | regeneration processing which the said receiver performs. It is a figure which shows an example of the data structure of the media unit header containing the flag which makes a time-independent medium unusable. It is a figure which shows the description position of the information which shows the reproduction conditions of a time-independent medium. It is a figure which shows a prior art and is a figure which shows the transmission aspect of a content.

  Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS.

<System configuration>
First, the configuration of the content transmission / reception system according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a main configuration of a transmitter (distribution device) 1 and a receiver (playback device) 2 that constitute the content transmission / reception system 3.

  As shown in the figure, the content transmission / reception system 3 has a configuration in which a transmitter 1 and a receiver 2 are connected via a network. In the content transmission / reception system 3, the receiver 2 receives the content transmitted by the transmitter 1. And play it.

  In the illustrated example, the transmitter 1 and the receiver 2 communicate directly, but the present invention is not limited to this. For example, the communication between the transmitter 1 and the receiver 2 may be relayed by a relay machine, or the content is distributed from the transmitter 1 to another distribution server, and the content is distributed from the distribution server to the receiver 2. Also good.

  Here, an example in which the network connecting the transmitter 1 and the receiver 2 is the Internet will be described, but this network may be any network that allows the transmitter 1 and the receiver 2 to transmit and receive content. It is not limited to this. For example, a broadcast network may be applied as the network, or hybrid distribution using both the Internet and the broadcast network may be employed.

  The transmitter 1 is a device that distributes content, and includes a transmitter control unit 10 that controls the functions of the transmitter 1 in an integrated manner, a transmitter storage unit 11 that stores data used by the transmitter 1, and the transmitter 1. Includes a transmitter communication unit 12 for communicating with an external device. The transmitter control unit 10 includes a transmission unit (distribution unit) 13 and a transmission control unit (distribution control unit) 14, and content 15 is stored in the transmitter storage unit 11.

  The transmission unit 13 performs processing for transmitting the content 15 to the receiver 2 via the transmitter communication unit 12, and the transmission control unit 14 controls transmission in the transmission unit 13. Specifically, the transmission control unit 14 determines the transmission time for each transmission packet of the content 15 and notifies the transmission unit 13 of the transmission time, and the transmission unit 13 transmits the transmission packet according to this notification.

  Content 15 is content distributed by the transmitter 1. The content is composed of a plurality of components (assets), is divided by a predetermined division unit, and is distributed as a transmission packet to which a header is added.

  On the other hand, the receiver 2 is a device that receives and reproduces content, and includes a receiver control unit 20 that controls the functions of the receiver 2 in an integrated manner, and a receiver storage unit 21 that stores data used by the receiver 2. A receiver communication unit 22 for the receiver 2 to communicate with an external device, a display unit 23 for displaying an image, an audio output unit 24 for outputting audio, and an input unit 25 for receiving user input operations. Yes. In addition, the receiver control unit 20 includes a playback control unit (specifying unit) 26, a program execution unit (media playback unit) 27, a text display processing unit (media playback unit) 28, and a video playback unit (media playback unit) 29. Contains.

  The playback control unit 26 controls the playback of the content 15 in an integrated manner. Specifically, the playback control unit 26 analyzes the configuration information of the content 15, and based on the analysis result, the content is stored in one or more of the program execution unit 27, the text display processing unit 28, and the video playback unit 29. 15 is output.

  The program execution unit 27 executes a program included in the content 15, and the text display processing unit 28 displays the text included in the content 15. In addition, the video playback unit 29 plays back moving images and audio included in the content 15.

<Data structure of content>
Next, the data structure of the content 15 will be described with reference to FIG. FIG. 2 is a diagram illustrating an example of the data structure of the content 15. In the figure, a data structure based on the currently ongoing MMT is shown.

  The content 15 is stored in the transmitter storage unit 11 as a package including a header, composition information (CI), transmission characteristics information (Transport Characteristics: TC), and a plurality of assets (Assets) ( 4th row from the top of the figure).

  An asset is a component such as video, audio, text, etc., and is composed of a header and a plurality of media units (M-Unit: MU) (third stage from the top in the figure).

  The media unit is a unit that is a unit for random access and time stamping, and includes a header and a plurality of media fragment units (MFU) (second stage from the top in the figure).

  The configuration information (CI) is referred to when the content is played back, and indicates the playback mode of the component. Specifically, the configuration information indicates a layout such as a display position and a display size of each component, whether or not the components can be combined (whether or not simultaneous reproduction with other components), and the like.

  Transmission characteristic information (TC) indicates the transmission characteristic of each component. Specifically, the transmission characteristic information indicates a necessary bandwidth and an allowable delay of each component for determining the optimum delivery route.

  FIG. 2 also shows the transmission format of the content 15. When the content 15 is transmitted by TCP / IP, UDP / IP, or the like, it is in a format of a transport packet (Transport Packet) in which a header is added to the payload (bottom of the figure).

  In addition, the payload format for distributing the package of the content 16 is a format in which a header is added to each of the media unit (MU), the configuration information (CI), and the transmission characteristic information (TC) as shown in the figure ( The second row from the bottom of the figure).

  In the figure, a payload including one media unit is illustrated, but a plurality of media units may be combined into one payload. For example, when there is a restriction on the size of the transmission packet, the media unit may be further divided and transmitted as different payloads. In this case, the payload format header may describe a flag indicating whether or not the first media fragment unit constituting the media unit is included, a flag indicating whether or not the last media fragment unit configuring the media unit is included, and the like. Good.

  Further, the configuration information (CI) and the transmission characteristic information (TC) are distributed as control messages for one-off communication other than the distribution of the media, in addition to being transmitted by multiplexing with the media stream as shown in FIG. Sometimes it is done. Or it may be sent repeatedly using a carousel structure.

<Outline of configuration information>
The content transmission / reception system 3 performs distribution based on the configuration information (CI) describing information for specifying the playable period of the time-independent medium, and the time-independent medium during the playable period described in the configuration information. The point of playing is the main feature point. Here, the configuration information used in the content transmission / reception system 3 will be described with reference to FIG.

  The time-dependent media refers to an asset for which a specific playback time is specified (which should be played back at a playback time specified by a time stamp), and a media unit that constitutes the asset. On the other hand, a time-independent medium refers to an asset whose playback timing is not limited to a specific time, and a media unit constituting the asset.

  FIG. 3 is a diagram showing an outline of configuration information used in the content transmission / reception system 3. As illustrated, the configuration information includes a LoA element defined by a <LoA> tag and an STIA element defined by a <STIA> tag.

  The LoA element indicates a usable asset. For example, a LoA element may describe a list of assets as shown in the figure. The STIA element indicates a program configuration (Spatial and Temporal Information of Asset) such as the layout and playback order of each asset.

  In the content transmission / reception system 3, for each asset described in the LoA element, information indicating whether the asset is a time-dependent medium or a time-independent medium is described. For time-independent media, information indicating assets to be reproduced at the same time is described in association with each other. Thereby, it becomes possible to reproduce the time-independent media together with the predetermined asset.

<Example 1 of configuration information>
Next, the configuration information will be described in more detail with a specific example. FIG. 4 is a diagram illustrating an example of configuration information of movie content with captions.

  The configuration information shown includes a LoA element defined by a <LoA> tag and an STIA element defined by a <STIA> tag. As described above, the LoA element indicates a usable asset, and the STIA element indicates a program configuration such as a layout and a reproduction order of each asset. In the figure, information regarding the layout is omitted for simplicity.

  In the LoA element of the figure, it is described that the number of assets is “6”, and the contents of each asset are described. More specifically, assets “asset1” to “asset6” are described, where asset1 is “package1 / video1”, asset2 is “package1 / audio1”, and asset3 is “package1 / audio2”. Also, asset4 is “package1 / text1”, asset5 is “package1 / text2”, and asset6 is “package1 / application1”.

  Specifically, asset1 is video data of movie content, asset2 is English version audio data, and asset3 is French version audio data. Asset4 is an English version subtitle data, asset5 is a French version subtitle data, and asset6 is a translation application that translates subtitles.

  Among these assets, assets 1 to 5 have the asset type “timed”. That is, these assets are time-dependent media that are played back at specified times. On the other hand, asset6 is a time-independent medium whose asset type is “non-timed”.

  Here, asset4 is associated with asset4 and asset5 in the format “available_with =“ (list of asset ids) ”. This indicates that asset6 can be used (reproduced) only when asset4 or asset5 is reproduced.

  Hereinafter, an attribute described in the format of “available_with =“ (asset list of assets) ”is referred to as an available_with attribute. The available_with attribute is information in which time-dependent media and time-independent media that can be reproduced simultaneously are associated with each other. Then, by referring to this, it is specific information that can specify the reproducible period of the time-independent medium (equal to the reproduction period of the associated time-dependent medium). Although not shown in the figure, time-independent media that do not describe the available_with attribute are always available (reproduced) without providing conditions for reproduction.

  Thus, by describing the use conditions of the time-independent medium in the configuration information, the time-independent medium can be used together with a specific time-dependent medium. In addition, addition, deletion, and change of usage conditions can be easily performed by adding, deleting, and changing the available_with attribute.

  In addition, in the STIA element included in the configuration information of the figure, the scene with the scene ID "scene1" is composed of time-dependent media (timed assets) and time-independent media (non-timed assets). It is shown.

  Furthermore, for time-dependent media, a combination of playback time and asset is specified by a <seq> tag. Specifically, asset1 (video1) is associated with time “0” to “1800” (unit: second), and asset2 (audio1) and asset4 (text1) , Asset3 (audio2) and asset5 (text2) are associated with each other. A combination of asset2 and asset4 and a combination of asset3 and asset5 are described by a <combinable> tag.

  The <combinable> tag indicates that one or both of the designated elements are selected and reproduced, and the <mutex> tag indicates that any one of the designated elements is selected and reproduced. Show.

  Thereby, it is specified that the video data (asset1) of the movie content is reproduced from time 0 to 1800. Simultaneously with the reproduction of this video data, either or both of English audio data (asset2) and English subtitle data (asset4) are reproduced, or French audio data (asset3) and French subtitle data (asset5). ) Is specified to be reproduced.

  In addition, scene6 is associated with asset6 (application1) as a time-independent medium. As described above, asset 6 is defined to be usable only when asset 4 or 5 is played back in the LoA element.

  As a result, it is specified that the translation application (asset6) can be used only when the English subtitle data (asset4) or the French subtitle data (asset5) is played back from time 0 to 1800. The

  In other words, the playback period of the translation application can be limited to playback of English subtitle data or French version subtitle data that may require translation. Can be prevented.

<Example 2 of configuration information>
Subsequently, another example of the configuration information will be described with reference to FIG. FIG. 5 is a diagram illustrating an example of configuration information of sports program content.

  The illustrated configuration information includes a LoA element and an STIA element as in the above example. In the LoA element of the figure, seven assets of assets 1 to 7 are described. Assets 1 and 2 are video data, assets 3 to 6 are audio data, and asset 7 is application data.

  Specifically, asset1 is a video of the first half of the sport game, and asset2 is a video of the second half of the game. Asset3 is the main commentary voice in the first half of the game, and asset5 is the main commentary voice in the second half of the game. Asset7 is an SNS (Social Networking Service) application that accepts comments and the like regarding the game. Asset4 is a sub commentary sound (first half) that takes into account comments and the like acquired in real time by asset7, and asset6 is a sub commentary sound (second half) that takes into account comments and the like obtained in real time by asset7.

  Among these assets, assets 1 to 6 are time-dependent media whose asset type is “timed”, and asset 7 is a time-independent medium whose asset type is “non-timed”. Also, asset7 describes asset4 and asset6 as attribute values of the available_with attribute, which indicates that asset7 can be used only when asset4 or asset6 is played back.

  In the STIA element included in the configuration information of FIG. 5, asset1 is associated with time 0 to 2700 of scene1, and assets3 and 4 are associated with the <mutex> tag. Assets 2 are associated with times 2700 to 5400, and assets 5 and 6 are associated with the <mutex> tag.

  Accordingly, it is specified that the video (asset1) of the first half of the game and the main commentary audio (asset3) or the sub-commentary audio (asset4) of the first half are reproduced from time 0 to 2700. Similarly, it is specified that the video of the second half of the game (asset2) and the main commentary audio (asset5) or auxiliary commentary audio (asset6) of the second half are played from time 2700 to 5400.

  Further, scene1 is associated with asset7 (application1) as a time-independent medium. As described above, asset 7 is defined to be usable only when asset 4 or 6 is played back in the LoA element.

  As a result, the SNS application (asset7) can be used only when the subsidiary commentary sound (asset4) is reproduced from time 0 to 2700 or when the subsidiary commentary sound (asset6) is reproduced from time 2700 to 5400. Is identified.

  That is, according to the above configuration information, the SNS application can be used only by the user who is listening to the sub-explanatory speech that takes into account comments and the like acquired in real time by the SNS application. Therefore, it is possible to prevent a user who has not heard the sub commentary sound from posting a comment that does not consider the sub comment sound.

<Example 3 of configuration information>
Subsequently, still another example of the configuration information will be described with reference to FIG. FIG. 6 is a diagram illustrating an example of configuration information of music program content.

  The illustrated configuration information includes a LoA element and an STIA element as in the above examples. In the LoA element in the figure, nine assets of assets 1 to 9 are described. Assets 1 to 4 are video data, assets 5 to 8 are audio data, and asset 9 is application data.

  Specifically, asset1 is an introduction video for song 1, and asset5 is an introduction audio for song 1. Also, asset2 is a performance video of song 1, and asset6 is a sound of song 1. Similarly, asset3 is an introduction video for song 2, and asset7 is an introduction audio for song 2. Also, asset4 is a performance video of song 2, and asset8 is the audio of song 2. Asset9 is a rating application that accepts evaluations for songs.

  Among these assets, assets 1 to 8 are time-dependent media whose asset type is “timed”, and asset 9 is a time-independent medium whose asset type is “non-timed”. Also, asset9 describes asset6 and asset8 as available_with attribute values, indicating that asset9 can be used only when asset6 or asset8 is played back.

  In the STIA element included in the configuration information of FIG. 9, asset1 and asset5 are associated with time 0 to 60 of scene1, and asset2 and asset6 are associated with time 60 to 300. Also, asset 3 and asset 7 are associated with time 300 to 360, and asset 4 and asset 8 are associated with time 360 to 600.

  Thus, it is specified that the introduction video (asset1) of song 1 and the introduction voice (asset5) of song 1 are reproduced from time 0 to 60, and the performance video (asset2) of song 1 and song 1 are played from time 60 to 300. It is specified that audio (asset6) is played. Similarly, it is specified that the introduction video (asset3) of song 2 and the introduction voice (asset7) of song 2 are reproduced from time 300 to 360, and the performance video (asset4) of song 2 and song 2 are played from time 360 to 600. It is specified that audio (asset8) is played.

  Further, scene9 is associated with asset9 (application1) as a time-independent medium. As described above, asset 9 is defined to be usable only when asset 6 or 8 is played back in the LoA element.

  As a result, the rating application (asset9) only plays the sound of song 1 (asset6) from time 60 to 300, or plays the sound of song 2 (asset8) from time 360 to 600. It is specified that it is available.

  That is, according to the configuration information described above, only the user who is reproducing the sound of the song can use the rating application, and it is possible to prevent the rating application from performing the evaluation without listening to the song.

  The use condition of the time-independent medium can also be used as a material for determining the transmission timing of the time-independent medium. For example, in the example shown in the figure, it can be specified that asset 9 is not reproduced during the period of time 0-60. As a result, it is possible to schedule transmission of asset 9 such that it is transmitted after assets 1 and 5 required at time 0.

<Example of configuration information that does not use the available_with attribute>
In each of the above examples, the available_with attribute is described in the LoA element to specify the playable period of time-independent media. However, the description position and description method of the playable period of time-independent media are limited to this. I can't. For example, the playable period of time-independent media may be described in the STIA element.

  Here, an example of configuration information in which the STIA element describes the playable period of time-independent media will be described with reference to FIG. FIG. 7 is a diagram illustrating an example of configuration information in which a time-independent medium playable period is described in the STIA element. The asset defined by the LoA element is the same as that in the example of FIG. 6 except that the available_with attribute is not described in asset9 which is a time-independent medium.

  Further, in the STIA element of the configuration information in FIG. 7, asset 9 is associated with times 60 to 300 with which assets 2 and 6 are associated, and asset 9 is associated with times 360 to 600 with which assets 4 and 8 are associated. This is different from the example of FIG.

  In asset 9 (“rating 1”) associated with times 60 to 300, start time “240” and end time “300” are described in association with each other. In addition, asset 9 (“rating 2”) associated with times 360 to 600 describes start time “540” and end time “600” in association with each other.

  Thereby, it is specified that the rating application (asset9) can be used from time 240 to 300 in the period in which the video (asset2) and audio (asset6) of the song 1 are being reproduced. Further, it is specified that the video can be used from time 540 to 600 during the period in which the video (asset4) and audio (asset8) of song 2 are being played.

  As described above, in the STIA element, the combination of the time-independent medium and the time-dependent medium can also be specified by describing the time-independent medium in association with the time-dependent medium to be reproduced at the same time. In this case, the information (id) for specifying the time-independent medium described in association with the times 60 to 300 is the specification information for specifying the playable period of the time-independent medium.

  Further, as in the example shown in the figure, by describing the reproducible period of the time-independent medium, the use condition of the time-independent medium can be specified in more detail. Thus, in the example shown in the figure, song 1 is a performance time from time 60 to 300, but if it is not viewed until at least time 240, it cannot be evaluated by the rating application, so the accuracy of evaluation is improved. Can do. The same applies to song 2. In this case, the time stamp associated with the time-independent medium from the time 540 (start time of the reproducible period) to 600 (end time of the reproducible period) specifies the usable period of the time-independent medium. Information.

<Flow of distribution processing>
Next, a flow of distribution processing (distribution method) executed by the transmitter 1 will be described with reference to FIG. FIG. 8 is a flowchart illustrating an example of distribution processing in which the transmitter 1 distributes the content 15 to the receiver 2. For simplicity, only the process of distributing one asset is shown in the figure, but each asset constituting the content 15 is actually distributed.

  First, the transmission control unit 14 refers to the LoA element of the configuration information of the content 15 stored in the transmitter storage unit 11 and identifies the asset to be distributed. The method for identifying the asset to be distributed is not particularly limited. For example, among the undistributed assets, the asset with the smallest asset ID value may be the distribution target. Further, the transmission control unit 14 refers to the LoA element of the configuration information and confirms whether the value of “asset_type” of the asset to be distributed is “TIMED” (S1).

  Here, when it is confirmed that the value of “asset_type” is “TIMED” (YES in S1), the transmission control unit 14 refers to the STIA element of the configuration information and indicates the playback start time of the asset. Get the timestamp value.

  Then, the receiver 2 determines a transmission time at which the asset can be reproduced from the time specified by the time stamp value (S6), and notifies the transmission unit 13 of the determined transmission time. Thereafter, the transmission unit 13 transmits the asset at the notified transmission time (S4), thereby ending the distribution process.

  Assets are stored and transmitted in the MMT Payload Format and MMT Transport Packet shown in FIG. At this time, a packet with one asset as one payload may be generated, or a packet in which one asset is divided into a plurality of payloads may be generated. Further, the transmission control unit 14 may describe the determined transmission time in an MMT Payload Format header or the like.

  On the other hand, when it is confirmed in S1 that the value of “asset_type” is not “TIMED” (NO in S1), the transmission control unit 14 determines whether there is an asset specified by the available_with attribute in the asset (S2). ).

  If it is determined that there is an asset specified by the available_with attribute (YES in S2), the transmission control unit 14 transmits the asset so that it can be played (used) simultaneously with the asset specified by the available_with attribute. (S3, distribution control step).

  Specifically, the transmission control unit 14 refers to the STIA element of the configuration information, and acquires a time stamp value indicating the playback start time of the asset specified by the available_with attribute. For the asset to be distributed, the distribution time is determined in a period from the distribution start time of the content 15 to the transmission time of the asset specified by the available_with attribute. Thereby, since delivery is performed at the transmission time of the asset specified by the available_with attribute at the latest, simultaneous reproduction (use) with the asset specified by the available_with attribute is ensured.

  The transmission control unit 14 notifies the transmission unit 13 of the determined transmission time, and the transmission unit 13 transmits the asset at the notified transmission time (S4, distribution step), and the distribution process ends.

  On the other hand, if it is determined in S2 that there is no asset designated by the available_with attribute (NO in S2), the transmission control unit 14 determines the transmission time of the asset regardless of the transmission time of other assets (S5). For example, the transmission control unit 14 may determine the reproduction start time of the content 15 or a time when there is a margin in the transmission band as the transmission time.

  And the transmission control part 14 notifies the determined transmission time to the transmission part 13, the transmission part 13 transmits the said asset at the said notified transmission time (S4), and a delivery process is complete | finished.

<Flow of playback processing>
Next, the flow of the reproduction process (reproduction method) executed by the receiver 2 will be described with reference to FIG. FIG. 9 is a flowchart illustrating an example of a reproduction process in which the receiver 2 reproduces the content 15 received from the transmitter 1.

  First, the playback control unit 26 analyzes the LoA element of the configuration information and generates a table describing available time-independent media (non-timed assets) for each time-dependent media (timed asset) (S11). .

  This table may be, for example, as shown in FIG. FIG. 10 is a diagram illustrating an example of a table indicating a correspondence relationship between time-dependent media and time-independent media that can be used during playback of the time-dependent media. The example shown corresponds to the configuration information of FIG. In the illustrated table, assets 1 to 5 are described as time-dependent media, and among these assets 4 and 5, asset 6 is described in association with each other. As a result, it is possible to easily specify that asset 6 is available when asset 4 or 5 is played back.

  Next, the playback control unit 26 determines whether the time-dependent media (timed asset) is being played back (S12). Here, when it is determined that the time-dependent media is not being played back (NO in S12), the playback control unit 26 determines whether or not to end the playback of the content 15 (S15). If it is determined that the reproduction of the content 15 is to be terminated (YES in S15), the reproduction process is terminated. If it is determined that the reproduction is not to be terminated (NO in S15), the process returns to S12.

  On the other hand, if it is determined in S12 that the time-dependent media is being played back (YES in S12), the playback control unit 26 refers to the table generated in S11 and can use the time-dependent media that are being played back. It is determined whether there is a non-timed asset (S13, specific step).

  If it is determined that there is no time-independent medium available (NO in S13), the process proceeds to S15. On the other hand, if it is determined that there is an available time-independent medium (YES in S13), the corresponding time-independent medium is activated, and the process proceeds to S15.

  Specifically, if the time-independent medium is an application, the playback control unit 26 causes the program execution unit 27 to execute the time-independent medium. If the time-independent medium is text, it is displayed on the text display processing unit 28 (media playback step).

  In the above example, this is executed when it is detected that there is a time-independent medium that can be used. However, the time-independent medium is used when there is an interaction from the user such as an input operation. May be executed. In this case, the user may be notified by displaying available time-independent media.

<< Embodiment 2 >>
In the above-described embodiment, an example has been described in which time-dependent media whose asset type is “timed” and time-independent media whose asset type is “non-timed” are targets of playback. However, it is also assumed that some assets include time-dependent media (timed media) and media that need not be time-dependent (non-timed media).

  Therefore, in the present embodiment, a configuration for reproducing such an asset will be described with reference to FIGS. Since the configuration of the content transmission / reception system of this embodiment is the same as that shown in FIG. 1, the description of the system configuration is omitted.

<Example of configuration information>
First, an example of configuration information used in the present embodiment will be described with reference to FIG. FIG. 11 is a diagram illustrating an example of configuration information describing assets including time-dependent media and time-independent media.

  In the illustrated configuration information, four assets (asset1 to asset4) are described in the LoA element. asset1 is video data, and asset2 is audio data. Asset3 is text data, and asset4 is an application.

  Specifically, asset1 is video and asset2 is audio corresponding to this video. Asset4 is an SNS application, and asset3 is a text acquired by the SNS application.

  Among these assets, assets 1 and 2 are time-dependent media whose asset type is “timed”, and asset 4 is a time-independent medium whose asset type is “non-timed”. Also, asset4 describes asset3 as the attribute value of the available_with attribute, which indicates that asset4 can be used only when asset3 is played back.

  Here, in the illustrated LoA element, asset3 has an asset type of “mixed”. This indicates that asset3 includes time-dependent media and time-independent media. Although details will be described later, for an asset (mixed media) whose asset type is "mixed" (hereinafter referred to as "mixed media"), is it a time-dependent media (time-dependent media unit) in units of media units constituting the asset? , The time-independent media (time-independent media unit) is indicated.

  Thereby, the time-dependent media unit can be played back at a specific time, and the time-independent media unit can be played back at an arbitrary time. Accordingly, among the comments acquired by the SNS application, those that should be displayed in a specific scene of the video (comments that mention the specific scene, etc.) are displayed in the specific scene, and other comments are arbitrary after the video ends. It is also possible to display at the timing.

  Also, in the STIA element included in the configuration information of the figure, assets 1 to 3 are associated with time 0 to 1800 of scene1. In addition, asset4 is associated with scene1 as time-independent media.

  This specifies that video (asset1), audio (asset2), and text (asset3) are output in the period from time 0 to 1800, and that application (asset4) is executed in this period.

<Example of asset header and media unit header>
Next, the asset header used in this embodiment will be described with reference to FIG. FIG. 12 is a diagram illustrating an example of a data structure of an asset header describing an asset type and a corresponding asset. The asset header is a header added to the asset, and is a header described in the third row from the top in the example of FIG. 2 (a header added to MMT Asset).

  The asset header shown in the figure contains information indicating the asset type (asset_type, 2 bits) and information specifying the asset that needs to be played back simultaneously (num_of_reference, reference_id) when the asset type is time-independent (NON_TIMED) 16 bits).

  There are three types of asset types, TIMED, NON_TIMED, and MIXED, which have already been described, and these asset types can be represented by numerical values of 0, 1, and 2, respectively, as shown. Thus, by describing information indicating the asset type in the asset header, the asset type of the asset can be specified.

  Reference_id is information equivalent to the above-mentioned available_with attribute. Therefore, as in the available_with attribute, the asset id specified by the LoA element may be described as reference_id.

  Next, the media unit header used in this embodiment will be described with reference to FIG. FIG. 13 is a diagram illustrating an example of a data structure of a media unit header describing information indicating synchronization accuracy. The media unit header is a header added to the media unit, and is the header (M-Unit: header added to MU) described in the second row from the top in the example of FIG. is there.

  In the illustrated media unit header, a timestamp used when the asset type is time-dependent (TIMED) or mixed (MIXED) is described (32 bits each). In addition, information (sync_type) indicating the synchronization accuracy when the asset type is mixed is described (1 bit). In the illustrated example, the synchronization accuracy is indicated by a numerical value of 0 or 1, where 0 indicates that strict synchronization is required (STRICT), and 1 indicates that strict synchronization is not required (ADAPTIVE). Yes. That is, a media unit with sync_type = 0 is a time-dependent media unit, and a media unit with sync_type = 1 is a time-independent media unit.

  In this way, by describing information indicating the synchronization accuracy and time stamp in the media unit header, it is possible to display only a specific media unit at a specific timing among a plurality of media units constituting the asset. become. In addition, it is possible to appropriately control the transmission timing in units of media units.

<Flow of distribution processing>
Next, the flow of distribution processing in the present embodiment will be described based on FIG. FIG. 14 is a flowchart illustrating an example of distribution processing in which the transmitter 1 distributes the content 15 to the receiver 2 with reference to the media unit header when asset_type is MIXED (mixed asset).

  First, the transmission control unit 14 refers to the media unit header of the media unit included in the asset, and determines whether sync_type is STRICT (S21).

  If it is determined that the sync_type is STRICT (YES in S21), the transmission control unit 14 acquires a time stamp value indicating the playback start time of the media unit from the media unit header. Then, a transmission time is determined for the media unit so that reproduction can be started from the time indicated by the acquired time stamp value (S24).

  Thereafter, the transmission control unit 14 notifies the determined transmission time to the transmission unit 13, and the transmission unit 13 transmits the media unit at the notified transmission time (S23), and the distribution process ends.

  On the other hand, if it is determined in S21 that the sync_type is not STRICT (NO in S21), the transmission control unit 14 determines the transmission time of the media unit regardless of the time stamp value of the media unit header (S22). For example, the transmission control unit 14 may determine the playback start time of the content 15, a time with a margin in the transmission band, and the like as the transmission time.

  Then, the transmission control unit 14 notifies the determined transmission time to the transmission unit 13, and the transmission unit 13 transmits the media unit at the notified transmission time (S23), and the distribution process ends.

  The media unit is stored and transmitted in the MMT Payload Format and MMT Transport Packet shown in FIG. At this time, a packet with one media unit as one payload may be generated, or a packet in which one media unit is divided into a plurality of payloads may be generated. Further, the transmission control unit 14 may describe the determined transmission time in an MMT Payload Format header, an MMT Transport Packet header, or the like.

  Although not included in the flowchart of FIG. 14, in the case of an asset whose asset_type is TIMED, as in S <b> 24 of FIG. 14, each media unit's The transmission time is determined, and the media unit is transmitted according to the determined transmission time. In the case of an asset whose asset_type is NON_TIMED, the transmission time is determined in the same manner as S5 in FIG. 8, and the media unit is transmitted according to the determined transmission time.

<Flow of playback processing>
Next, the reproduction process (reproduction method) in the present embodiment will be described with reference to FIG. FIG. 15 is a flowchart illustrating an example of a reproduction process executed by the receiver 2.

  In the playback processing in the present embodiment, first, the playback control unit 26 refers to the asset header of the received asset, and the media type of the asset is time-dependent (TIMED) or time-independent (NON_TIMED). It is confirmed whether it is mixed or MIXED (S30).

  Here, when it is confirmed that the asset is time-dependent media, the video playback unit 29 is instructed to play each media unit constituting the asset at the time indicated by the time stamp of the media unit header. (S31).

  Thereafter, the playback control unit 26 determines whether or not to end the playback of the content 15 (S32). If it is determined to end (YES in S32), the reproduction process ends. If it is determined not to end (NO in S32), the process returns to S30.

  On the other hand, when it is confirmed that the asset is time-independent media, the asset identified by the value of reference_id is identified as an asset (time-dependent media) that is played back simultaneously with the asset (S33, identification step).

  Then, the asset is played back at the playback start time of the identified asset (time-dependent media) (S34, media playback step). If the asset is a program, the program is executed by the program execution unit 27. If the asset is text, the program is displayed on the text display processing unit 28. Thereafter, the process proceeds to S32.

  Also, in S30, when it is confirmed that the asset is a mixed medium, the media unit whose sync_type value is 0 (STRICT) is specified with reference to the media unit header of each media unit constituting the asset. (S35).

  Then, the media unit whose sync_type value is 0 (STRICT) is played back at the time indicated by the time stamp in the media unit header of the media unit (S36). If the asset is a program, the program is executed by the program execution unit 27. If the asset is text, the program is displayed on the text display processing unit 28.

  Subsequently, the media unit whose sync_type value is 1 (ADAPTIVE) is reproduced (S37). For a media unit whose sync_type value is 1 (ADAPTIVE), the playback timing is not limited to the time indicated by the time stamp. For this reason, for example, playback may be performed at a timing when playback is instructed by a user operation, or playback may be performed at a timing such as when playback of time-dependent media is completed. Thereafter, the process proceeds to S32.

  As for the media unit whose sync_type value is 1 (ADAPTIVE), as with the time-independent media (assets) of the above embodiment, assets or media units that can be played simultaneously are associated with each other. You may replay it.

<About the flag that disables time-independent media>
In the media unit header, a flag that disables use of time-independent media may be described. This will be described with reference to FIG. FIG. 16 is a diagram illustrating an example of a data structure of a media unit header including a flag that disables use of time-independent media.

  In the illustrated example, non_timed_media_disable_flag is described as a flag that disables use of time-independent media. The value of this flag is described by 1 bit. Specifically, the availability of the time-independent medium is indicated by a numerical value of 0 (ENABLE: available) or 1 (DISABLE: unavailable).

  This makes it possible to disable the use of time-independent media during playback of a specific media unit. In addition, when there are a plurality of time-independent media, information specifying the time-independent media that cannot be used may be described together, whereby a specific time-independent medium can be disabled. .

  When playing back a media unit in which non_timed_media_disable_flag is described, the playback control unit 26 does not play back time-independent media during the playback period of the media unit. In other words, in this case, the playback control unit 26 specifies a period other than the playback period of the media unit in which non_timed_media_disable_flag is described as a playable period of time-independent media.

<Summary: Information description location>
In each of the above-described embodiments, the example in which information indicating the playback condition of the time-independent medium is described in the configuration information, the asset header, and the media unit header has been described. Here, description positions of these information will be described with reference to FIG. FIG. 17 is a diagram showing a description position of information indicating a playback condition of time-independent media.

  As shown at the bottom of the figure, the configuration information (CI) describes the asset_type attribute and the available_with attribute (first embodiment). Thereby, each asset corresponding to the configuration information can be reproduced according to the values of the asset_type attribute and the available_with attribute.

  Also, as shown in the third row from the top of the figure, asset_type, num_of_reference, and reference_id are described in the asset header (MMT Asset header) (second embodiment). As a result, the playback condition of the time-independent media can be described in units of assets as in the first embodiment.

  As described above, the data structure of each of the above embodiments specifies the reproducible period of the time-independent medium so that the transmitter 1 or the receiver 2 can specify the reproducible period of the time-independent medium. Specific information is described.

  Therefore, the transmitter 1 or the receiver 2 is allowed to specify the playable period of the time-independent medium, and the reproduction of the time-independent medium is limited to the period, and the distribution considering the period is performed. Can be possible.

  Also, as shown in the second row from the top in the figure, timestamp, sync_type, and non_timed_media_disable_flag are described in the media unit header (MU header) (second embodiment). Thereby, it is possible to describe the playback condition of the time-independent media in units of media.

  As shown in the above embodiments, the time-independent media includes assets (asset_type == NON_TIMED) including media units for which a strict playback time is not specified (consumed at non-specified time), and this A media unit constituting an asset is included (first embodiment).

  Time-independent media also includes the latter media unit in assets (asset_type == MIXED) that include media units with strict playback times and media units without strict playback times. (Embodiment 2).

<Modification>
In the configuration information, in addition to the available_with attribute, the number of times that the time-independent medium can be played (executed) (num_of_execution attribute) may be described. As a result, the number of times that the time-independent media can be played (executed) can be limited.

  In each of the above-described embodiments, an example has been described in which time-dependent media that are simultaneously played are associated with time-independent media. However, time-independent media that are simultaneously played may be associated with time-dependent media. . That is, in the configuration information, the available_with attribute may be described in association with the time-dependent media.

  Furthermore, in each of the above-described embodiments, an example in which time-dependent media and time-independent media that can be played simultaneously is associated is shown, but time-dependent media that cannot be played simultaneously and time-independent media may be associated with each other. .

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

<Example configuration by program>
Finally, each block of the transmitter 1 and the receiver 2, particularly the transmitter control unit 10 and the receiver control unit 20, can be realized in hardware by a logic circuit formed on an integrated circuit (IC chip). Alternatively, it may be realized by software using a CPU (Central Processing Unit).

  In the latter case, the transmitter 1 and the receiver 2 include a CPU that executes instructions of a program that realizes each function, a ROM (Read Only Memory) that stores the program, a RAM (Random Access Memory) that expands the program, A storage device (recording medium) such as a memory for storing the program and various data is provided. The object of the present invention is to record the program code (execution format program, intermediate code program, source program) of the control program of the transmitter 1 and the receiver 2, which is software that realizes the above-described functions, in a computer-readable manner. This can also be achieved by supplying the recording medium to the transmitter 1 and the receiver 2, and the computer (or CPU or MPU) reading and executing the program code recorded on the recording medium.

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. IC cards (including memory cards) / optical cards, semiconductor memories such as mask ROM / EPROM / EEPROM / flash ROM, PLD (Programmable logic device), FPGA (Field Programmable Gate Array), etc. Logic circuits can be used.

  Further, the transmitter 1 and the receiver 2 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited as long as it can transmit the program code. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication network, and the like can be used. The transmission medium constituting the communication network may be any medium that can transmit the program code, and is not limited to a specific configuration or type. For example, even with wired lines such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL (Asymmetric Digital Subscriber Line) line, infrared rays such as IrDA and remote control, Bluetooth (registered trademark), IEEE 802.11 wireless, HDR ( It can also be used by radio such as High Data Rate (NFC), Near Field Communication (NFC), Digital Living Network Alliance (DLNA), mobile phone network, satellite line, and digital terrestrial network. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The present invention can be used for a playback device that plays back content including a time-dependent component and a time-independent component, a distribution device that delivers the content, and the like.

1 Transmitter (distribution device)
13 Transmission unit (distribution means)
14 Transmission control unit (distribution control means)
2 Receiver (Reproducing device)
26 Playback control unit (specifying means)
27 Program execution unit (media playback means)
28 Text display processing unit (media playback means)
29 Video playback unit (media playback means)
15 content

Claims (14)

A playback device that plays back content including a time-dependent medium for which a playback time is specified and a time-independent medium whose playback timing is not limited to a specific time,
A specifying means for specifying the playable period of the time-independent medium with reference to the specific information for specifying the playable period of the time-independent medium acquired together with the content;
A playback apparatus comprising: media playback means for playing back the time-independent media during the playable period specified by the specifying means. The specific information is information in which time-dependent media and time-independent media that can be reproduced simultaneously are associated with each other,
2. The playback according to claim 1, wherein the specifying unit specifies a playback period of a time-dependent medium associated with a time-independent medium in the specifying information as a playable period of the time-independent medium. apparatus. The specific information includes information indicating a start time and an end time of the playable period,
The playback apparatus according to claim 1, wherein the specifying unit specifies a period from the start time to the end time as a playable period of the time-independent medium. It is composed of a plurality of media units that are subject to time stamping. The plurality of media units include a time-dependent media unit that is played back at the time indicated by the time stamp, and the playback timing at the time indicated by the time stamp. When playing mixed media that includes unrestricted time-independent media units,
The media playback means plays back the time-dependent media unit at a time indicated by a time stamp given to the time-dependent media unit, and the time-independent media unit plays a time given to the time-independent media unit. The playback apparatus according to any one of claims 1 to 3, wherein playback is performed without being limited to the time indicated by the stamp. The specific information includes information indicating time-dependent media that do not allow playback of the time-independent media during the playback period,
5. The method according to claim 1, wherein the specifying unit specifies a period other than the playback period of the time-dependent medium that does not permit playback of the time-independent medium as a playable period of the time-independent medium. The playback apparatus according to claim 1. A distribution device that distributes content including time-dependent media for which playback time is specified and time-independent media for which playback timing is not limited to a specific time,
Referring to the specific information for identifying the playable period of the time-independent medium acquired together with the content, the playable period of the time-independent medium is specified, and the playable from the distribution start time of the content Delivery control means for determining delivery time in a period up to the start time of the period;
A distribution device comprising: distribution means for distributing the time-independent media at a distribution time determined by the distribution control means. It is composed of a plurality of media units that are subject to time stamping. The plurality of media units include a time-dependent media unit that is played back at the time indicated by the time stamp and a playback timing indicated by the time stamp. When delivering mixed media that includes time-independent media units that are not restricted to time,
The delivery control means sets the delivery time of the time-dependent media unit based on the time indicated by the time stamp given to the time-dependent media unit, and sets the delivery time of the time-independent media unit to the time 7. The distribution apparatus according to claim 6, wherein the distribution device is set regardless of the time indicated by the time stamp assigned to the dependent media unit. Information that is associated with content including time-dependent media for which playback time is specified and time-independent media whose playback timing is not limited to a specific time, and is referred to when the content is played or distributed A data structure,
Specification for specifying the playable period of the time-independent medium so that the playback apparatus that plays the content or the distribution apparatus that delivers the content can specify the playable period of the time-independent medium A data structure characterized by the information being described.   9. The specific information is information in which a time-dependent medium and a time-independent medium that can be reproduced simultaneously are associated with each other in a list of time-dependent media and time-independent media included in the content. The data structure described in. A playback method by a playback device for playing back content including time-dependent media for which playback time is specified and time-independent media whose playback timing is not limited to a specific time,
A specifying step for specifying the playable period of the time-independent medium with reference to the specific information for specifying the playable period of the time-independent medium acquired together with the content;
And a media playback step of playing back the time-independent media in the playable period specified in the specifying step. A distribution method by a distribution device that distributes content including a time-dependent medium for which a reproduction time is specified and a time-independent medium whose reproduction timing is not limited to a specific time,
Referring to the specific information for identifying the playable period of the time-independent medium acquired together with the content, the playable period of the time-independent medium is specified, and the playable from the distribution start time of the content A delivery control step for determining a delivery time in a period up to a start time of the period;
A distribution step of distributing the time-independent medium at a distribution time determined in the distribution control step.   6. A control program for operating the playback device according to claim 1, wherein the control program causes a computer to function as the specifying unit and the media playback unit.   A control program for operating the distribution device according to claim 6 or 7, wherein the computer functions as the distribution control unit and the distribution unit.   A computer-readable recording medium on which the control program according to claim 12 or 13 is recorded.

Images