JP7070564B2 - Information processing equipment, information recording media, information processing methods, and programs - Google Patents

Description

The present disclosure relates to information processing devices, information recording media, information processing methods, and programs. More specifically, an information processing device and information recording that input MMT (MPEG Media Transport) format data, which is being standardized as a future data transmission standard for broadcast waves, etc., and record it on media so that it can be played back. Media, information processing methods, and programs.

Currently, standardization is underway to realize data transmission of high-quality images such as broadcasting of 4K images and 8K images, and one of them is a data distribution method using the MMT (MPEG Media Transport) format. Is under consideration.

The MMT format is a control information (SI: Signaling Information) consisting of coded data constituting the content such as an image (Video), audio (Audio), subtitle (Subtile), and various management information such as control information and attribute information. It defines a data transfer method (transport format) for transmitting data such as signaling information)) via broadcast waves or networks.

The MMT format is scheduled to be used for broadcasting next-generation contents such as 4K images and high dynamic range (HDR) images.

The MPEG-2 TS format is often used as a transmission format for current images (Video), audio (Audio), subtitles (Subtitles), etc., or as a data recording format for media.
Further, BDMV and BDAV standards (formats) are widely used as recording / playback application standards (formats) compatible with this MPEG-2 TS format.

BDMV and BDAV are application standards for data recording and playback mainly using BD (Blu-ray (registered trademark) Disc), but these standards are not limited to BD, but other standards such as flash memory and HD. It can also be applied to data recording / playback using media other than BD.
A data recording / reproduction processing configuration using a BD is described in, for example, Patent Document 1 (Japanese Unexamined Patent Publication No. 2011-023071).

BDMV is an application standard developed for BD-ROMs in which movie contents are recorded in advance, and is mainly widely used in non-rewritable BD-ROMs such as package contents.
On the other hand, BDAV is a standard developed mainly for the purpose of applying to data recording / playback processing using a rewritable BD-RE type disc, a BD-R type disc that can be recorded only once, and the like. BDAV is used, for example, for recording / reproducing a video taken by a user with a video camera or the like, or for recording / reproducing a television broadcast.

In order to record the distributed content according to the above-mentioned MMT format on an information recording medium (media) and perform the content reproduction processing from the media using a reproduction application compatible with the BDAV format, the data recording is performed according to this BDAV format. It is necessary to do.

Currently, discussions are underway on a configuration for expanding the BDAV format to record and play back MMT format data.
For example, when an information processing device such as a television receives distribution data according to the MMT format transmitted by a broadcasting station or the like and records the received data on a recording medium such as a BD, a flash memory, or an HDD (hard disk), an image, Discussions are progressing in the direction of recording data such as voice, subtitle data, and control information (SI) on a medium as a packet string of a packet containing data according to the MMT format.

Specifically, discussions are proceeding in the direction of recording a packet sequence of an MMTP (MMT Protocol) packet or a TLV (Type Length Value) packet, which is a higher-level packet of an MMTP packet, on a medium.

In the MMTP packet and the TLV packet, images, sounds, subtitles, which are reproduction data, and control information (SI: Signaling Information) including various management information are stored.

For example, MMTP packets and TLV packets containing contents such as images, sounds, and subtitles are recorded on recording media such as BD (Blu-ray (registered trademark) Disc), flash memory, and HDD (hard disk), and the contents from the media are recorded. In order to perform reproduction using the reproduction application corresponding to the above-mentioned BDAV format, it is necessary to record data according to this BDAV format.

The BDAV format defines database files such as playlist files and clip information files as playback control information files, and BDAV-compatible playback applications refer to these playback control information files (database files) for data playback processing. Run.
Therefore, it is necessary to perform the reproduction processing of the MMT format data by using the reproduction control information recorded in these playlist files and clip information files.

However, the data distributed according to the MMT format does not include the playlist file and the clip information file specified in this BDAV format.
Therefore, in order to record this MMT format data on the media and play the content using the BDAV format compatible application, a process of generating a playlist file or a clip information file specified by the BDAV format and recording it on the media. Is required.
However, the current situation is that this process has not been materialized at this time.

Japanese Unexamined Patent Publication No. 2011-023071

The present disclosure has been made in view of the above problems, for example, by inputting distribution data according to the MMT format, generating a database file specified in the BDAV format, and recording the data on the media. It is an object of the present invention to provide an information processing device, an information recording medium, an information processing method, and a program that enable reproduction of media recorded contents by using the database file of the above.

The first aspect of this disclosure is
It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or SPAV format, which is a data recording format for an information recording medium.
The data processing unit
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
It is in the information processing apparatus that executes the process of recording the voice identification information that can identify which of the voice data (a) and (b) is in the database file specified in the BDAV format or the SPAV format.

Further, the second aspect of the present disclosure is
It has a data processing unit that executes the reproduction processing of the recorded data of the information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The data processing unit
It is configured to execute the reproduction process of the MMT format data recorded on the information recording medium by using the recorded information of the playlist file and the clip information file which are the database files specified in the BDAV format or the SPAV format.
The data processing unit
The audio data to be played is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
It is in an information processing apparatus that acquires voice identification information indicating which data (a) or (b) is from the database file and executes voice data decoding processing according to the acquired information.

Further, the third aspect of the present disclosure is
It is an information recording medium that records recorded data according to the BDAV format or SPAV format.
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
It has a configuration in which the voice identification information that enables identification of which of the voice data (a) and (b) is recorded is recorded in a database file specified in BDAV format or SPAV format.
The reproduction device is in an information recording medium capable of identifying the type of audio data to be reproduced according to the audio identification information recorded in the database file.

Further, the fourth aspect of the present disclosure is
It is an information recording medium on which recorded data according to the BDAV format or SPAV format is recorded.
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
It has a database file specified in BDAV format or SPAV format that contains voice identification information that makes it possible to identify which of the voice data (a) and (b) is.
The reproduction device is in an information recording medium capable of identifying the type of audio data to be reproduced according to the audio identification information of the database file.

Further, the fifth aspect of the present disclosure is
It is an information processing method executed in an information processing device.
The information processing device is
It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or SPAV format, which is a data recording format for an information recording medium.
The data processing unit
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
It is an information processing method for executing a process of recording voice identification information that can identify which of the voice data (a) and (b) is in a database file specified in BDAV format or SPAV format.

Further, the sixth aspect of the present disclosure is
It is an information processing method executed in an information processing device.
The information processing device is
It has a data processing unit that executes the reproduction processing of the recorded data of the information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The data processing unit
Using the recorded information of the playlist file and the clip information file, which are database files specified in the BDAV format or the SPAV format, the MMT format data recorded in the information recording medium is reproduced.
In the reproduction process, the audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
It is an information processing method that acquires voice identification information indicating which data (a) or (b) is from the database file and executes a voice data decoding process according to the acquired information.

Further, the seventh aspect of the present disclosure is
It is a program that executes information processing to be executed in an information processing device.
The information processing device is
It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or SPAV format, which is a data recording format for an information recording medium.
The program is installed in the data processing unit.
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
There is a program that executes a process of recording voice identification information that can identify which of the voice data (a) and (b) is in a database file specified in BDAV format or SPAV format.

Further, the eighth aspect of the present disclosure is
It is a program that executes information processing to be executed in an information processing device.
The information processing device is
It has a data processing unit that executes the reproduction processing of the recorded data of the information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The program is installed in the data processing unit.
Using the recorded information of the playlist file and the clip information file, which are database files specified in the BDAV format or the SPAV format, the reproduction process of the MMT format data recorded on the information recording medium is executed.
In the reproduction process, the audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
The program has voice identification information indicating which of the data (a) and (b) is acquired from the database file, and decodes the voice data according to the acquired information.

The program of the present disclosure is, for example, a program that can be provided by a storage medium or a communication medium provided in a computer-readable format to an information processing apparatus or a computer system capable of executing various program codes. By providing such a program in a computer-readable format, processing according to the program can be realized on an information processing apparatus or a computer system.

Still other objectives, features and advantages of the present disclosure will be clarified by more detailed description based on the examples of the present disclosure and the accompanying drawings described below. In the present specification, the system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to those in the same housing.

According to the configuration of one embodiment of the present disclosure, a configuration is realized in which it is possible to quickly confirm whether the media recorded MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data.
Specifically, for example, a clip information file recording audio identification information indicating whether the MMT format audio data to be recorded on the media is MPEG4 AAC LC audio data or MPEG4 ALS audio data is generated and stored on the media. Record. The playback device identifies whether the audio data to be reproduced is MPEG4 AAC LC audio data or MPEG4 ALS audio data based on the audio identification information recorded in the clip information file, and rapidly decodes the audio data. Playback can be performed.
With this configuration, it is possible to quickly confirm whether the media recording MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data.
It should be noted that the effects described in the present specification are merely exemplary and not limited, and may have additional effects.

It is a figure explaining the use configuration example of the information processing apparatus which executes the process of this disclosure. It is a figure explaining the MMT format. It is a figure explaining the image data storage configuration example according to the MMT format. It is a figure explaining the BDAV format. It is a figure explaining the example of the data reproduction processing according to the BDAV format. It is a figure explaining the MPEG-2TS format. It is a figure explaining the MMT format. It is a figure explaining the SPAV format. It is a figure explaining the processing example which records the received data from a broadcasting station or the like as an MMTP packet string which is MMT format data on an information recording medium (media). It is a figure explaining the processing example which records the received data from a broadcasting station or the like as a TLV packet string storing MMTP packet which is MMT format data on an information recording medium (media). It is a figure explaining the processing example in the case of recording MMT format data as BDAV format data. It is a figure which shows the data structure (syntax) of a clip information file. It is a figure which shows the data structure (syntax) of the program information [ProgramInfo ()] of a clip information file. It is a figure explaining the data structure example of the coding information of a clip information file. It is a figure explaining the data recording example of the audio information of a clip information file. It is a figure explaining the data structure example of the coding information of the clip information file which recorded the identification information of the audio data of MMT format. It is a figure explaining the example of the voice identification information of the MMT format recorded in the clip information file. It is a figure explaining the configuration example of the voice data storage packet. It is a figure explaining the data structure example of the coding information of the clip information file which recorded the identification information of the audio data of MMT format. It is a figure explaining the example of the voice identification information of the MMT format recorded in the clip information file. It is a figure which shows the data structure (syntax) of the MMT package table (MPT). It is a figure explaining the specific example of the asset type (asset_type) recorded in the MMT package table (MPT). It is a figure which shows the audio attribute information recorded in the MMT package table (MPT). It is a figure which shows the specific example of the (M1) stream content information recorded in the MMT package table (MPT). It is a figure which shows the specific example of the (M2) component type recorded in the MMT package table (MPT). It is a figure which shows the specific example of the (M3) sampling frequency recorded in the MMT package table (MPT). It is a figure explaining the configuration example of the information processing apparatus which executes the data recording process with respect to the information recording medium (media). It is a figure which shows the flowchart explaining the processing sequence of the data recording processing with respect to the information recording medium (media). It is a figure which shows the flowchart explaining the processing sequence of the data recording processing with respect to the information recording medium (media). It is a figure which shows the flowchart explaining the processing sequence of the data recording processing with respect to the information recording medium (media). It is a figure explaining the configuration example of the information processing apparatus which executes the data reproduction processing from an information recording medium (media). It is a figure which shows the flowchart explaining the processing sequence of the data reproduction processing from an information recording medium (media). It is a figure which shows the flowchart explaining the processing sequence of the data reproduction processing from an information recording medium (media). It is a figure explaining the hardware configuration example of the information processing apparatus applied to the process of this disclosure.

Hereinafter, the details of the information processing apparatus, the information recording medium, the information processing method, and the program of the present disclosure will be described with reference to the drawings. The explanation will be given according to the following items.
1. 1. Configuration example of communication system 2. About MMT (MPEG Media Transport) format 3. BDAV format and SPAV format 4. 4. Processing when recording MMT format data according to BDAV format. Voice data according to MMT format 6. Recording example of voice identification information for clip information file 6-1. (Example 1) Example 6-2. Example of acquiring voice identification information recorded in a voice data storage packet and recording it in a clip information file. (Embodiment 2) Example 2 to acquire the voice identification information recorded in the MMT package table (MPT) and record it in the clip information file. 8. Configuration and processing of information processing equipment that executes data recording processing for information recording media. 9. Configuration and processing of an information processing device that executes data reproduction processing from an information recording medium. About the configuration example of the information processing device 10. Summary of the structure of this disclosure

[1. Communication system configuration example]
First, an example of a communication system, which is an example of a usage configuration of an information processing apparatus that executes the process of the present disclosure, will be described with reference to FIG.
The information processing device 30 shown in FIG. 1 is equipped with media such as a BD (Blu-ray (registered trademark) Disc), a flash memory, and a hard disk (HDD), and performs data recording processing on these mounted media and from the mounted media. Data reproduction processing, data copy processing for other media, etc. are executed.

The data recorded on the media by the information processing device 30 is, for example, transmission content provided by a transmission device 20 such as a broadcasting station (broadcast server) 21 or a data distribution server 22. Specifically, it is a broadcast program or the like provided by a television station.
These transmitted contents are transmitted from the transmitting device 20 to the information processing device 30 via a broadcast wave or a network such as the Internet.

The information processing device 30 is, for example, a recording / reproducing device 31, a television 32, a PC 33, a portable terminal 34, etc. These information processing devices are, for example, BD (Blu-ray (registered trademark) Disc) 41, HDD (hard disk). 42, various media such as a flash memory 43 are attached, and data recording processing for these media, editing processing of media recording data, data reproduction processing from media, data copy processing between media, and the like are executed.

Data transmission from the transmission device 20 to the information processing device 30 is executed according to the MMT (MPEG Media Transport) format.
The MMT format is a data transfer method (transition port format) for transmitting coded data, which is content composition data, such as image (Video), audio (Audio), and subtitle (Subtitle), via a broadcast wave or a network. It is specified.

The transmission device 20 encodes the content data, generates a data file containing the coded data and the metadata of the coded data, and stores the generated coded data in an MMTP (MMT Protocol) packet defined in the MMT. Transmit via broadcast wave or network.

The data provided by the transmission device 20 to the information processing device 30 is a control composed of reproduction target data such as images, sounds, and subtitles, as well as guidance information such as a program guide, notification information, and various management information such as control messages. It is composed of information (SI: Signaling Information).

[2. About MMT (MPEG Media Transport) format]
As described above, the data transmission from the transmission device 20 to the information processing device 30 is executed according to the MMT (MPEG Media Transport) format.
The MMT (MPEG Media Transport) format will be described with reference to FIG. 2 and the following.

FIG. 2 is a diagram showing a stack model in MMT format.
In the MMT stack model shown in FIG. 2, the bottom layer has a physical layer (PHY). The physical layer is divided into a broadcast (Broadcasting) layer that performs broadcasting-related processing and a broadband (Broadband) layer that performs network-based processing.
MMT enables processing using two communication networks, a broadcasting system and a network system.

As an upper layer of the physical layer (PHY), there is a TLV (Type Length Value) layer. The TLV is a format specification layer that defines a multiplexing method for IP packets. A plurality of IP packets are multiplexed and transmitted as TLV packets. The TLV-SI is a transmission layer of control information (SI) such as a control message according to the TLV format.

The control information (SI) is composed of setting information required for receiving and playing content (program) on the information processing apparatus 30 side, guidance information such as a program guide, notification information, control information, and management information. ..
The control information (SI) stored in the TLV packet for which processing is generated in the TLV layer is TLV-SI, and is mainly composed of control information related to reception processing.
The control information (SI) stored in the MMTP packet, which is a packet generated according to the MMT protocol (MMTP), is MMT-SI shown in the uppermost layer, and is mainly composed of control information related to reproduction control.

A UDP / IP layer is set on the TLV layer.
The UDP / IP layer can be divided into an IP layer and a UDP layer in detail, but is a layer that regulates transmission in which a UDP packet is stored in the payload of the IP packet.
An MMT layer and a File delivery method layer are set on the UDP / IP layer.
The setting is such that the case where the MMTP packet is stored in the IP packet and transmitted and the method where the data is transmitted as the IP packet by using the File delivery method, which is a data transmission method that does not use the MMTP packet, can be used together.

The following layers are set on the MMT layer.
A layer of image (Video) data which is coded image data according to HEVC (High Efficiency Video Coding) which is an image coding standard.

A voice coding standard,
(1) Coded audio data according to MPEG4 AAC LC (Advanced Audio Coding Low Complexity), or
(2) Coded audio data according to MPEG4 ALS (Audio Lossless Coding),
A layer of audio (Audio) data encoded according to these audio coding standards.

moreover,
Subtitle data, which is coded subtitle data according to TTML (Timed Text Markup Language), which is a subtitle coding standard.
Control information (MMT-SI) transmitted using MMTP packets,
Various applications described according to HTML5 (HyperText Markup Language 5),
Each of these data is stored in an MMTP packet and transmitted.

The control information (MMT-SI) is control information (signaling information) transmitted in an MMTP packet, such as setting information required for playing content (program) on the information processing apparatus 30 side, a program guide, and the like. It is composed of various management information such as guidance information, notification information, and control information.

The time information (NTP: Network Time Protocol) is absolute time information, which is directly stored in a UDP packet and transmitted.
Other data services (Data service) that distribute data, content download (Contentdownload, etc.) have a configuration that can be distributed by using a file distribution method (File delivery method) different from MMT.

As shown in FIG. 2, a control information (MMT-SI) or an application composed of images, sounds, subtitles, and various management information such as various notification information and control information is transmitted by an MMTP packet.

A specific configuration example of the MMTP packet will be described with reference to FIG.
FIG. 3 shows the following four types of data configuration examples.
(A) MPU (Media Presentation Unit)
(B) MMTP payrot (c) MMTP packet (d) TLV packet

(D) The TLV packet is a packet transmitted via a broadcast wave or a network, and each header information of a UDP header, an IP header, and a TLV header is set in the TLV packet. The TLV packet is set as an individual packet for each data type.

That is, one type of data is stored in the TLV payload of one TLV packet. Specifically, for example, an image (V), an audio (A), a subtitle (S), or a control information (SI) composed of various management information is individually stored.
Regarding the control information (SI), there are control information (MMT-SI) stored in the MMTP packet and control information (TLV-SI) transmitted in the TLV packet, which are stored in different individual TLV packets. ..

An example of the TLV payrot, which is the payload of the TLV packet, is the MMTP packet shown in FIG. 3 (c).
The MMTP packet shown in FIG. 3C is composed of an MMTP header and an MMTP payload.

One type of data is stored in the MMTP payload of one MMTP packet. Specifically, for example, an image (V), an audio (A), a subtitle (S), a control information (MMT-SI) stored in an MMTP packet, and any one of these types of data are individual MMTP packets. Stored in.

3 (a) and 3 (b) show the detailed structure of the image data stored in the MMTP payload of the MMTP packet shown in FIG. 3 (c).
FIG. 3B selects and shows only the MMTP packet whose MMTP payload is image data (V) among the MMTP packets shown in FIG. 3C.
The MMTP payload shown in FIG. 3B is composed of a header and a data unit.

As shown in FIG. 3A, the data unit stores image data and various parameters as described below.
AU Delimiter (Access Unit Delimiter)
SPS (Sequence Parameter Set)
PPS (Picture Parameter Set)
SEIs (Supplemental Enhanment Information)
These parameters are parameters used for image display.

The MPU (Media Presentation Unit) shown in FIG. 3A is one data processing unit of reproduction target data such as images, sounds, and subtitles in the MMT format. The example shown in FIG. 3A is an example of an MPU of image data, which is the same unit as GOP (Group of Pictures) as a so-called coding / decoding processing unit.

In this way, for example, the image data is divided into the parameters defined in the MMT format and the image configuration data as shown in FIG. 3A, stored in the MMTP payload shown in FIG. 3B, and shown in FIG. 3 (b). It is configured as the MMTP packet shown in c).
Further, the MMTP packet is set as the payload of the TLV packet shown in FIG. 3D, and the TLV packet is transmitted via a broadcast wave or a network.

For each data such as voice and subtitles and each data of MMT-SI, MMTP packets and TLV packets for each data type are set and transmitted.
The TLV-SI is stored in the TLV packet and transmitted without being stored in the MMTP packet.

[3. About BDAV format and SPAV format]
Next, it is a recording data format in which the distribution content according to the above-mentioned MMT format is recorded and reproduced on a medium such as BD (Blu-ray (registered trademark) Disc), flash memory, or HDD (hard disk). The BDAV format and the SPAV format will be described with reference to FIG. 4 and below.

For example, when playing content such as images, sounds, and subtitles from media such as BD (Blu-ray (registered trademark) Disc), flash memory, and HDD, playback control information for performing playback processing of these contents. And index information is required. Playback control information and index information are generally called database files.
These reproduction control information and index information differ depending on the reproduction application that executes the reproduction processing of the recorded data of the media.

As described above, there are BDMV and BDAV standards (data recording formats) as current recording / playback application standards (= data recording formats). These application standards have been established mainly as data recording / playback application standards using BD (Blu-ray (registered trademark) Disc).

BDMV and BDAV are application standards for data recording and playback mainly using BD, and are data recording formats (standards), but these standards are not limited to BD, and other than BD such as flash memory. It can also be applied to data recording and playback using media.
BDMV is an application standard developed for BD-ROMs in which movie contents are recorded in advance, and is mainly widely used in non-rewritable BD-ROMs such as package contents.
On the other hand, BDAV is a standard developed mainly for the purpose of applying to data recording / playback processing using a rewritable BD-RE type disc, a BD-R type disc that can be recorded only once, and the like. BDAV is used, for example, for recording / reproducing a video taken by a user with a video camera or the like, or for recording / reproducing a television broadcast.

In order to perform the content reproduction process from the medium in which the distribution content according to the above-mentioned MMT format is recorded by using the reproduction application corresponding to the BDAV format, it is necessary to perform the data recording according to this BDAV format.
As described above, the BDAV format defines playlist files, clip information files, etc. as playback control information recording files, and BDAV-compatible playback applications record the recording information of these playback control information files (database files). Use it to execute data playback processing.

FIG. 4 is a diagram showing an example of a directory structure of data recorded on the information recording medium (media) 40 according to the BDAV format.
As shown in FIG. 4, various management information, reproduction control information, and storage files for reproduction target data are set in the directory.

The management information file is composed of, for example, an info file (info), a menu file (menu), a mark file (mark), and the like shown in FIG. These mainly store title management information and the like to be shown to the user.
Also, as a playback control information file,
Playlist file (playlist),
Clip information file (clipinf)
For example, these files are recorded.
Further, a clip AV stream file (stream) is recorded as a reproduction data storage file.

The playlist file is a file that defines the playback order and the like of the contents according to the program information of the playback program designated by the title, and has, for example, the designated information of the clip information file in which the playback position information and the like are recorded.
The clip information file is a file specified by the playlist file, and has playback position information of the clip AV stream file and the like.

The clip AV stream file is a file that stores AV stream data to be played back and management information. The clip AV stream file is composed of packets for storing management information and data such as images, sounds, and subtitles to be played back.
The management information defined in the MPEG-2 TS format and recorded in the clip AV stream file includes, for example, PSI / SI (Program Special Information / Service Information).

The conventional broadcast data and network distribution data are MPEG-2 TS format data composed of TS (Transport Stream) packets, but the data including high-definition images such as 4K and 8K images in the future are described above. It is expected to be MMT format data composed of MMTP packets.

In FIG. 4, as a clip AV stream file (stream),
A stream file (nnnnnn.m2ts) composed of MPEG-2 TS format data composed of TS packets,
MMT format data (nnnnnn.mmtv) composed of MMTP packets,
These two types of stream files are shown.

In the directory example shown in FIG. 4, when the data received by the information processing apparatus 30 is MPEG-2 TS format data, it is recorded as it is on the media as MPEG-2 TS format data, and when the received data is MMT format data, it is recorded as it is. , This is an example of a directory in the case of setting to record on media as MMT format data.

The clip AV stream file for recording MMT format data on media is
(1) Convert the MMT format to the MPEG-2 TS format to generate a clip AV stream file, or
(2) Generate a clip AV stream file consisting of a packet string of packets storing data according to the MMT format.
These two types of processing are assumed.

Currently, discussions are underway in the process of (2) above, that is, to generate a clip AV stream file consisting of a packet sequence of packets storing data according to the MMT format and record it on a medium.
Specifically, discussions are proceeding in the direction of recording as a packet sequence of an MMTP (MMT Protocol) packet or a TLV (Type Length Value) packet which is a higher-level packet of the MMTP packet.
This specific example will be described in detail later.

The management information file, playlist file, clip information file, and these data files are storage files for management information applied to the reproduction processing of images, sounds, subtitles, etc., which are reproduction data stored in the clip AV stream file. These are files that store playback control information, attribute information of playback data, and the like, and are called database files.

The sequence for reproducing the content recorded on the information recording medium is as follows.
(A) First, a specific playlist is specified from the management information file by the playback application.
(B) Select the clip information file specified in the selected playlist, read the AV stream or command that is the playback data such as images and sounds from the clip AV stream file according to the recorded data of the clip information file. Starts playback of the AV stream and command execution processing.

FIG. 5 shows the following data recorded on the information recording medium (media) 40, that is,
Playlist file,
Clip information file,
Clip AV stream file,
It is a figure explaining the correspondence relation of these data.

An AV stream consisting of playback target data such as images, sounds, and subtitles, which are actual playback target data, is recorded as a clip AV stream (Clip AV Stream) file, and further, as management information and playback control information files of these AV streams. , A playlist (PlayList) file and a clip information (Clip Information) file are specified.

These multiple categories of files are as shown in FIG.
Playlist layer containing playlist (PlayList) files,
A clip layer consisting of a clip AV stream file and a clip information file,
It can be divided into these two layers.

One clip AV stream (Clip AV Stream) file is associated with one clip information (Clip Information) file, and these pairs are considered as one object, and these are collectively clipped or clipped. Call it a file.
Detailed information of the data included in the clip AV stream file, for example, management information such as an EP map recording I-picture position information of MPEG data is recorded in the clip information file.

The Clip AV Stream file is composed of TS packets when it is MPEG-2 TS format data.
Further, in the case of MMT format data, it is composed of MMTP packets.

The clip information (Clip Information) file corresponds to, for example, the data position of the byte string data of the clip AV stream file and the reproduction time position such as the entry point (EP) which is the reproduction start point when expanded on the time axis. Storage of clip AV stream files such as data Management information for acquiring the playback start position of data is stored.

The playlist has information indicating the access point corresponding to the reproduction start position and the reproduction end position of the clip (Clip) by a time stamp which is information on the time axis.
For example, it is possible to refer to the clip information file based on the time stamp indicating the playback time elapsed position from the start point of the content, and acquire the data read position of the clip AV stream file, that is, the address as the playback start point. Become.
The clip information file (Clip Information file) is used to find the address information from which the decoding of the stream in the clip AV stream file should be started from this time stamp.

As described above, the playlist (PlayList) file has the designated information of the reproduction section for the reproducible data included in the clip (= clip information file + clip AV stream file) layer.
One or more play items (PlayItem) are set in the playlist (PlayList) file, and each play item is a playback section for playable data included in the clip (= clip information file + clip AV stream file) layer. Has the designated information of.

As described above, the clip AV stream (Clip AV Stream) file storing the data to be reproduced is composed of TS packets in the case of the conventional MPEG-2 TS format data.
Further, in the case of high-definition image data such as 4K and 8K images whose use is expected to be expanded in the future, in the case of MMT format data, it is composed of MMTP packets.
The MMT format and the MPEG-2 TS format will be described with reference to FIGS. 6 and 7.

First, the MPEG-2 TS format will be described with reference to FIG.
The MPEG-2 TS format stores coded data and management information (PSI / SI), which are content composition data such as images (Video), audio (Audio), and subtitles (Subtile), in a recording medium (media), or broadcast waves. It is a format that defines a data storage format (container format) such as coded data when transmitting via a network.

The MPEG-2 TS format is a format standardized in ISO13818-1, and is used for, for example, data recording for BD (Blu-ray (registered trademark) Disc), digital broadcasting, and the like.

6 (a) to 6 (c) are diagrams showing the structure of MPEG-2 TS format data.
FIG. 6A shown at the bottom is a diagram showing the overall configuration of the MPEG-2 TS format data.
As shown in FIG. 6A, the MPEG-2 TS format data is composed of a plurality of elementary streams.
The elementary stream is a unit set as one unit of, for example, an image, an audio, a subtitle, and the like.

As shown in FIG. 2 (b), one elementary stream (Elementary stream) is composed of one or more PES (Packetized Elementary stream) packets.
Specifically, one elementary stream is composed of one or a plurality of PES packets having a payload type (Payload_type) = 0x0 and having the same packet identifier (Packet_id).

One PES packet is composed of one or more TS packets as shown in FIG. 6 (c).
Specifically, one PES packet is composed of one or a plurality of TS packets having a payload type (Payload_type) = 0x0 and having the same packet identifier (Packet_id).
Unlike the above-mentioned MMTP packet, the TS packet has a fixed length, and the packet size of one TS packet is fixed at 188 bytes.

Next, the MMT (MPEG Media Transport) format will be described with reference to FIG. 7.
Regarding the MMT format, FIG. 3 is referred to earlier, but the explanatory diagram of the MMT format shown in FIG. 7 is a diagram that clearly explains the correspondence with the MPEG-2 TS format described with reference to FIG. be.

As described above, the MMT format is a data transfer method for transmitting coded data, which is content composition data, such as an image (Video), audio (Audio), and subtitle (Subtitle), via a broadcast wave or a network. (Transport format) is specified.
FIG. 7 is a diagram illustrating an MMT format, which is a file format defined in ISO / IEC 23008.1.

7 (a) to 7 (c) show the structure of MMT format data.
FIG. 7A shown at the bottom is a diagram showing the overall configuration of MMT format data.
As shown in FIG. 7A, the MMT format data is composed of a plurality of media presentation units (MPU: Media presentation unit).
The MPU is a unit set as one unit of, for example, an image, sound, subtitles, and the like. For example, in the case of an image, 1MPU corresponds to 1GOP (Group of picture) which is one MPEG compressed image unit.

As shown in FIG. 7 (b), one MPU is composed of one or more media fragment units (MFU: Media Fragment unit).
Specifically, one MPU is composed of one or a plurality of MFUs having a payload type (Payload_type) = 0x0 (MPU) and having the same packet identifier (Packet_id).

One MFU is composed of one or more MMTP packets as shown in FIG. 7 (c).
Specifically, one MFU is composed of one or a plurality of MMTP packets having a payload type (Payload_type) = 0x0 (MPU) and having the same packet identifier (Packet_id).
The MMTP packet has a variable length and can be set to various packet sizes.
Each MMTP packet is composed of a header (MMTP header) for storing attribute information and the like and a payload (MMTP payload) for storing actual data and the like of a coded image.

There is a SPAV format as a format similar to the BDAV format. As described above, BDMV and BDAV are application standards for data recording / reproduction mainly using BD. On the other hand, the SPAV format is an application standard for data recording and reproduction mainly for hard disks.
However, both the BDAV format and the SPAV format are formats that can be used for recording and playback using various media such as BD, flash memory, and HDD.

The SPAV format data can be recorded and reproduced by the same processing as the data recording / reproduction processing in the BDAV format. However, the file name setting of the SPAV format is partially different from that of the BDAV format.
FIG. 8 shows an example of a directory structure in the SPAV format.

In the directory of the SPAV format shown in FIG. 8, various management information, reproduction control information, and storage files of reproduction target data are set as in the BDAV format described above with reference to FIG.

The management information file is composed of, for example, an info file (INFO), a menu file (MENU), a mark file (MARK), and the like shown in FIG. These mainly store title management information and the like to be shown to the user.
Also, as a playback control information file,
Playlist file (PLAYLIST),
Clip information file (CLIPINF)
For example, these files are recorded.
Further, a clip AV stream file (STREAM) is recorded as a reproduction data storage file.

As shown in FIG. 8, the setting of the directory name of the SPAV format and the extension of each file is different from the BDAV format described with reference to FIG.
However, the data stored in each file and the role of each file are the same as in the BDAV format.

In the following description of the embodiment, an example of processing for recording and reproducing MMT format data as BDAV format data will be described, but in the following embodiment, processing for recording and reproducing MMT format data as SPAV format data will be described. It is also applicable to.

[4. Processing when recording MMT format data according to BDAV format]
Next, a process for recording MMT format data according to the BDAV format will be described.

As described above, the MMT format is a data distribution format used for 4K images and the like scheduled to be distributed by broadcasting stations and the like in the future, and is a format according to the protocol stack described with reference to FIG. be.
On the other hand, the BDAV format is a data recording format for media, and as described with reference to FIG. 4, a database file including a playback control information file such as a playlist file or a clip information file is defined.
The BDAV format is a data recording format and is compatible with the data recording / playback application standard. Data playback recorded on the media according to the BDAV format is performed by using a playback application compatible with the BDAV format. To.

Therefore, in order to record the distributed content according to the MMT format on the media and perform the content reproduction processing from the recorded media by using the reproduction application corresponding to the BDAV format, it is necessary to record the data according to the BDAV format. is necessary.

As mentioned above, discussions are currently underway on provisions for extending the BDAV format to make MMT format data recordable and playable.

As described above, the clip AV stream file for recording MMT format data on the media is
(1) Convert the MMT format to the MPEG-2 TS format to generate a clip AV stream file, or
(2) Generate a clip AV stream file consisting of a packet string of packets storing data according to the MMT format.
These two types of processing are possible.

Currently, discussions are underway in the process of (2) above, that is, to generate a clip AV stream file consisting of a packet sequence of packets storing data according to the MMT format and record it on a medium.
Specifically, discussions are proceeding in the direction of recording as a packet sequence of an MMTP (MMT Protocol) packet or a TLV (Type Length Value) packet which is a higher-level packet of the MMTP packet.

For example, when an information processing device such as a recorder receives distribution data according to the MMT format transmitted by a broadcasting station or the like, and records the received data on a medium such as a BD, a flash memory, or an HDD (hard disk). , Image, audio, subtitle data, management information (SI), and other data are recorded as they are as a packet string of a packet that stores data according to the MMT format.

That is, the clip AV stream file set in the BDAV format shown in FIG. 4 or the SPAV format shown in FIG. 8 [02001. In mmtv, etc.], the packet sequence of the packet storing the data according to the MMT format is recorded.
A clip AV stream file containing MMT format data [012001. Regarding the playlist file and clip information file that are playback control information files corresponding to [mmtv, etc.], the recording device generates a playlist file and clip information file in which control information corresponding to MMT format data is set and records them on the media. It will be.

The clip AV stream file storing the MMT format data is specifically one of MMTP (MMT Protocol) packets, TLV (Type Length Value) packets which are higher-level packets of MMTP packets, and these two types of packets. It is possible to record as a packet string of.

A specific recording configuration example of the clip AV stream file storing the MMT format data will be described with reference to FIGS. 9 and 10.
FIG. 9 is a diagram illustrating a processing example of recording an MMTP (MMT Protocol) packet string according to the MMT format on a recording medium such as a BD, a flash memory, or an HDD (hard disk).

FIG. 9 shows the following three data.
(A) TLV packet string which is broadcast distribution data (B) One TLV packet processed as received / reproduced data (C) MMTP packet string proposed as a configuration of media recording data

(A) The TLV packet sequence, which is broadcast distribution data, is a sequence of TLV packets having the MMT (MPEG Media Transport) format described above with reference to FIG. 2.
This TLV packet sequence is transmitted from a transmission device 20 such as a broadcasting station.

(B) One TLV packet processed as received / reproduced data is one TLV packet received by an information processing apparatus 30 such as a television or a recorder and subjected to reproduction processing. The detailed configuration of one TLV packet constituting the TLV packet sequence shown in (A) is shown.
It is a TLV packet having an MMT (MPEG Media Transport) format described above with reference to FIG.

(C) The MMTP packet sequence shown as the structure of the media recording data is an MMTP packet sequence currently proposed as recording data for the media.
The MMTP packet recorded on the media is an MMTP packet which is a part of the configuration data of the TLV packet, as can be understood from the dotted line showing the correspondence with FIG. 9B, and is composed of the following elements. ..
(A) MMTP packet header (MMTP_packet_header)
(B) MMTP packet data (MMTP_packet_data) (= payload)

The MMTP packet data (MMTP_packet_data) (= payload) is composed of the following elements.
(B1) MMTP payload header (MMTP_payload_header)
(B2) MMTP payload data (MMTP_payload_data)

Currently, one configuration proposed as recording data for an information recording medium (media) is to take out only the MMTP packet, which is a component of the TLV packet, as shown in FIG. 9C, and record them side by side in a row. It is a configuration to do.

FIG. 10 is a diagram illustrating a processing example of recording a packet sequence of a higher-level TLV packet storing an MMTP packet instead of an MMTP (MMT Protocol) packet on a recording medium such as a BD, a flash memory, or an HDD (hard disk). Is.

Similar to FIG. 9, FIG. 10 shows the following three data.
(A) TLV packet string which is broadcast distribution data (B) One TLV packet processed as received / reproduced data (C) TLV packet string proposed as a configuration of media recording data

(A) and (B) are the same data as described with reference to FIG.
(C) The TLV packet sequence shown as the structure of the data for media recording is another example of the TLV packet sequence currently proposed as recording data for the media.
The TLV packet recorded on the media is a TLV packet including an MMTP packet, as can be understood from the dotted line showing the correspondence with FIG. 10B, and is composed of the following elements.
(A) TLV packet header (TLV_header)
(B) TLV packet data (TLV_data) (= payload)

As described above, as a recording mode of MMT format data for media such as BD,
The packet sequence of the MMTP (MMT Protocol) packet described with reference to FIG. 9, or
Packet sequence of TLV (Type Length Value) packets described with reference to FIG.
It is expected to be recorded as one of these packet strings.

When the MMT format data is recorded on the media with the settings shown in FIG. 9 or 10 and the reproduction process of the MMT format data is performed by using the reproduction application corresponding to the BDAV format, the reproduction control information file corresponding to the BDAV format is used. That is, the playback is performed using the playlist file and the clip information file.
The BDAV format is a data recording format and also supports a data recording / playback application standard, and playback of data recorded on a medium according to the BDAV format is executed using a playback application compatible with the BDAV format.

The BDAV format defines database files specific to the BDAV format, such as playlist files and clip information files, which are playback control information files, and BDAV-compatible playback applications record information from these playback control information files (database files). Use it to execute data playback processing.

As described above, the database files such as the playlist file and the clip information file specified in the BDAV format are originally defined as files that can be generated based on the distribution data in the MPEG-2 TS format.
Therefore, even if the distribution data according to the MMT format, which is different from the MPEG-2 TS format, is recorded as it is in the playlist file or clip information file specified in the current BDAV format, the current BDAV compatible playback application cannot be used. May be.

In order to record MMT format data on media and play back content using BDAV format compatible apps, playlist files and clips compatible with MMT format data are recorded when recording MMT format data on the media. It is necessary to generate an information file and record it on the media.
Further, when reproducing the MMT format data recorded on the media, it is necessary to reproduce using a playlist file or a clip information file corresponding to the MMT format data.

Specifically, as shown in FIG. 11, a clip information file (nnnnnn.clpi) 52 corresponding to the MMT format data storage clip AV stream file 51 and a playlist file (nnnnnn.rpls) 53 are generated to generate media (nnnnn.rpls). BD, flash memory, HDD, etc.) must be recorded and used for playback.

When playing back the MMT format data storage clip AV stream file 51 recorded on the media, the clip information file (nnnnnn.clpi) 52 corresponding to the MMT format data storage clip AV stream file 51 and the playlist file (nnnnnn. The reproduction process can be performed using rpls) 53.

However, as described above, the data distributed according to the MMT format, which is the distribution data of the broadcasting station, is not configured to include all the recording data of the playlist file and the clip information file specified in the BDAV format.
Further, the MMT format data storage clip AV stream file 51 has a data format different from that of the MPEG-2 TS format data, and is a playlist file having the same format as the MPEG-2 TS format data compatible playlist file or clip information file. Even if the clip information file is used, there is a problem that the correct playback process cannot be executed.

Therefore, in order to record this MMT format data on a medium and play back the content using the BDAV format compatible application, the playback control of the MMT format data storage clip AV stream file 51 can be controlled uniquely to the MMT format data. It is necessary to generate a playlist file or clip information file with the data format of and record it on the media.

[5. About audio data according to MMT format]
As described above with reference to FIGS. 9 and 10, when recording MMT format data distributed from a broadcasting station on a medium such as BD as BDAV format or SPAV format data, images, sounds, subtitles, etc. The reproduction data and data such as control information (SI) are recorded as, for example, an MMTP packet string or a TLV packet string.
These packet strings are recorded as a clip AV stream file specified in the BDAV format or the SPAV format.

Further, as described with reference to FIG. 11, when the reproduction data in the clip AV stream file 51 composed of the MMTP packet string or the TLV packet string storing the MMT format data recorded on the media is reproduced, the reproduction data is reproduced. It is necessary to perform the reproduction process using the clip information file (nnnnnn.clpi) 52 corresponding to the MMT format data storage clip AV stream file 51 and the playlist file (nnnnnn.rpls) 53.

However, the clip information file and the playlist file specified in the current BDAV format and SPAV format are originally specified as playback control information corresponding to the MEG-2TS format data, and are reproduced for the MMT format data. It cannot be used as it is as control information.
Therefore, in order to record MMT format data on media and play back content using a BDAV format compatible application, a process of generating a playlist file or clip information file specified by the BDAV format and recording it on the media is required. You will need it.

As described above with reference to FIG. 2, for example, the MMT format audio data distributed from a broadcasting station includes, for example, data according to the following two different audio coding standards.
(1) Coded audio data according to MPEG4 AAC LC (Advanced Audio Coding Low Complexity),
(2) Coded audio data according to MPEG4 ALS (Audio Lossless Coding),
The audio data delivered from the broadcasting station is at least one of the data according to the above two different audio coding standards.

MPEG4 AAC LC is an improved coding format based on MPEG2 AAC, and is an audio coding format that realizes reduction of coding delay, low bit rate coding, bit rate expandability, and the like.
On the other hand, MPEG4 ALS is an audio coding format to which a lossless compression method (lossless compression) that does not cause data loss is applied, and enables reproduction of high-quality audio data.

The above two types of coded voice data distributed in the MMT format are
(LATM / LOAS) Delivered in stream format.
LATM (Low Overhead Audio Transport Multiplex) is a regulation of multiplexing processing (ISO / IEC14496-3).
LOAS (Low Overhead Audio Stream) is a regulation of the transfer method (ISO / IEC14496-3).

That is, the voice-coded data stream delivered in the MMT format is
(1) MPEG4 AAC LC (LATM / LOAS)
(2) MPEG4 ALS (LATM / LOAS)
It is one of the above two streams.

It should be noted that the setting for delivering only one of the audio data for one program, that is,
With settings to deliver either MPEG4 AAC LC or MPEG4 ALS,
MPEG4 AAC LC and MPEG4 ALS, these two audio data can be distributed and set to be selectable on the receiving side.

For example, a transmitting device such as a broadcasting station stores and distributes audio data in MMTP packets and TLV packets as described above with reference to FIG.
Whether the voice data stored in the packet is the above-mentioned AAC LC coded voice data or ALS-coded voice data is determined by, for example, the attribute data recording area in the packet storing the voice data or the MMT format. It is recorded in the MMT package table (MPT) or the like, which is the corresponding control information (SI).

A receiving device such as a television that receives and reproduces broadcast waves refers to these in-packet recorded data and the MMT package table (MPT) to determine whether the data to be reproduced is AAC LC coded audio data. It is possible to determine whether the data is ALS-encoded voice data and perform decoding processing according to the determination result.

When recording MMT format data distributed from a broadcasting station or the like on a medium such as BD as BDAV format or SPAV format data, playback data such as images, sounds, and subtitles, and data such as control information (SI) are used. Recorded as an MMTP packet sequence or a TLV packet sequence.
These packet strings are recorded as a clip AV stream file specified in the BDAV format or the SPAV format.

The data reproduction procedure of the information processing apparatus (reproduction apparatus) for reproducing the recorded data from the media follows the following procedure as described above with reference to FIGS. 4 and 5.
(A) First, a specific playlist is specified from the management information file by the playback application.
(B) Select the clip information file specified in the selected playlist, read the AV stream or command that is the playback data such as images and sounds from the clip AV stream file according to the recorded data of the clip information file. Starts playback of the AV stream and command execution processing.

However, in the playlist file and clip information file specified in the current BDAV format and SPAV format, information for identifying two different audio-coded data (MPEG4 AAC LC and MPEG4 ALS) compatible with the above-mentioned MMT format is recorded. It has not been.

Therefore, the playback device acquires the voice data storage packet from the clip AV stream file and refers to the in-packet recorded data of the acquired packet, or as control information (SI) recorded in the clip AV stream file. If you do not refer to the MMT package table (MPT) of, the voice data in the packet will be
(1) Is it MPEG4 AAC LC coded audio data?
(2) Is it MPEG4 ALS coded audio data?
It is not possible to confirm which of the above voice data is used.

The decoding processes of these two different voice-coded data need to be executed as different processes. That is, it is necessary to perform decoding by applying a codec corresponding to each voice coding.
Therefore, when playing back the audio data recorded on the media, it becomes impossible to determine which codec code should be applied without referring to the in-packet recorded data of the audio data storage packet or the MMT package table (MPT). There is a problem that the delay until the start of the reproduction process becomes large.

Further, as described above, MPEG4 AAC LC, MPEG4 ALS, and these two audio data may be distributed as audio data for one program content.
When these two types of audio data are recorded on the media, it is assumed that the user (viewer) is made to select the audio to be reproduced before the content reproduction from the media is started.

However, even when such processing is performed, the voice data storage packet is acquired from the clip AV stream file and the recorded data in the packet of the acquired voice data storage packet is referred to, or the clip AV stream file is included. It is not possible to confirm that two types of audio data are recorded without referring to the MMT package table (MPT) which is the recorded control information (SI).
There arises a problem that such processing requires a large amount of processing time.

[6. About recording example of voice identification information for clip information file]
Hereinafter, as an example of configuration for solving the above-mentioned problems, an example in which voice identification information is recorded in a clip information file will be described.

The configuration described below is
When the clip AV stream file recorded on a medium such as BD is in the MMT format, the playback target audio data to which this clip information file is applied is added to the clip information file which is the playback control information file of the clip AV stream file.
(1) Is it MPEG4 AAC LC coded audio data?
(2) Is it MPEG4 ALS coded audio data?
It is a configuration in which voice identification information that enables identification of which of the above voice data is recorded is recorded.

First, the data structure (syntax) of the clip information file will be described with reference to FIG.
As described above, the clip information file records information about the data to be played by applying the clip information file. Specifically, it has, for example, playback position information of a clip AV stream file.

FIG. 12 is a diagram showing a data structure (syntax) of one clip information file.
Information about the reproduction data associated with the clip information is recorded in the clip information file. As shown in FIG. 12, for example, the following information is recorded.
Clip information [ClipInfo ()] 101,
Sequence information [SequenceInfo ()] 102,
Program information [ProgramInfo ()] 103,

In the clip information [ClipInfo ()] 101, the attribute information of the AV stream file corresponding to the clip information file is recorded.
In the sequence information [SequenceInfo ()] 102, information regarding the reproduction sequence of the reproduction target data stored in the AV stream file corresponding to this clip information file is recorded.

In the program information [ProgramInfo ()] 103, information about a program (program_sequence) including definition information of a reproduction section and a time interval of a clip AV stream reproduced by a clip information file is recorded.
The details of the recorded information of the program information [ProgramInfo ()] 103 will be described with reference to FIGS. 13 and below.

FIG. 13 is a diagram showing a data structure (syntax) of the program information [ProgramInfo ()].
The main data recorded in the program information [ProgramInfo ()] will be described.

(A) Number of program sequences [num_of_program_sequences] 111 records the number of program sequences (program_sequence) included in the clip information file.
(B) The SPN program sequence start address [SPN_program_sequence_start [i]] 112 records the relative address of the place where the program sequence starts on the AV stream file.
(C) In the program map PID [program_map_PID [i]] 113, the identifier (PID) of the packet in which the map of the program sequence (program_sequence) is stored is recorded.

(D) In the stream PID [stream_PID] 114, an identifier (PID) of a packet containing a stream to be reproduced according to the program sequence of this clip information file is recorded.
(E) Stream coding information [StreamCodingInfo] 115 records coding (encoding) information of a stream to be reproduced.

In this way, various information necessary for reproducing the clip AV stream file storage data associated as the reproduction target is recorded in the clip information file.

FIG. 14 is a diagram showing a data structure (syntax) of stream coding information [Stream Coding Info] set in the program information [Program Info ()] recording area of the clip information file.
The following data is recorded in the stream coding information [StreamCodingInfo].
(1) Image stream coding information 121,
(2) Audio stream coding information 122,

Various types of coding modes (coding type (stream_coding_type)) of the image stream and the audio stream recorded on the information recording medium (media) are allowed, and both the image and the audio correspond to each coding type. The identifier is specified in advance.
The image is associated with, for example, type identifiers = 0x01, 0x02, 0x1B, etc., depending on the coding type (encoding type).
The voice is associated with type identifiers = 0x03, 0x04, 0x0F, 0x80, 0x81 and the like according to the coding type (encoding type).

for example,
Coding type 0x01 is an MPEG-1 image stream,
0x02 is the MPEG-2 image stream,
0x03 is the MPEG-1 audio stream,
These settings.

In the MMT format, HEVC coding, which is an image coding type not specified in the current BDAV format, is used.
A new coding type identifier will be assigned to this new coding type as well.

Similarly, for voice data, the MMT format uses voice-encoded data that is not specified in the current BDAV format.
That is,
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
These coded voice data are used.

However, the coding type identifier (stream_coding_type) for these two types of coded voice data is the same in the MPEG2 standard ISO13818-1, that is, the same identifier is set for both.
Specifically, in ISO13818-1, the coding type = 0x11 for all the coded speech data to which the above-mentioned LATM (Low Overhead Audio Trusport Multiplex) is applied as the multiplexing process specified in ISO / IEC14496-3. Is set.

Speech-coded data delivered in MMT format,
(1) MPEG4 AAC LC (LATM / LOAS)
(2) MPEG4 ALS (LATM / LOAS)
Both of the above two voice-coded data are coded voice data to which LATM (Low Overhead Audio Transport Multiplex) is applied as the multiplexing process, and the same identifier [0x11] is set.

Therefore, the playback device that reproduces the BDAV format data has the coding type (stream_coding_type) recorded in the clip information file recorded on the media.
If [0x11] is set, this audio data will be
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
It can be judged that it is either of these two types,
It is not possible to identify which of these two types of coded voice data is used.

As shown in FIG. 14, the following information is recorded in the audio stream coding information 122 set in the program information [ProgramInfo ()] recording area of the current clip information file.
(2a) Voice type (audio_presentation_type) 131
(2b) Sampling frequency (sampling_frequency) 132

An example of recording each of these data will be described with reference to FIG.
FIG. 15 (a) The voice type recording data has data settings capable of identifying various voice type information such as monochannel, stereo, and surround with respect to bit values 0 to 15.
FIG. 15B is a data setting in which each sampling frequency of 48 to 192 kHz can be identified with respect to bit values 0 to 15.
Regarding these audio data formats, the distribution data according to the MMT format is also within the range of the definition data in the current BDAV format, and no particular change is required.

However, in each of these data alone, the audio data in which [0x11] is set as the coding type (stream_coding_type) is
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
It is not possible to identify which of these two types of coded voice data is used.

Hereinafter, a configuration example of a new clip information file that solves the above problem will be described.
The following two examples will be described in sequence.
(Example 1) Example of acquiring voice identification information from a voice data storage packet (Example 2) Example of acquiring voice identification information from an MMT package table (MPT)

[6-1. (Example 1) Example of acquiring voice identification information recorded in a voice data storage packet and recording it in a clip information file]
First, as the first embodiment, an embodiment in which the voice identification information recorded in the voice data storage packet is acquired and recorded in the clip information file will be described.

That is, the voice data is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
An embodiment in which identification information indicating which of these two types of voice data is used is acquired from a voice data storage packet and recorded in a clip information file will be described.

FIG. 16 is a diagram showing a data structure (syntax) of the stream coding information [Stream Coding Info] of the program information [Program Info ()] of the clip information file according to the first embodiment.

In the stream coding information [StreamCodingInfo] shown in FIG. 16, the audio data to be controlled by this clip information file is the audio data.
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
It has a configuration that makes it possible to identify which of these two types of coded voice data is.

As the stream coding information [StreamCodingInfo] shown in FIG. 16, the following data is recorded in the same manner as described above with reference to FIG.
(1) Image stream coding information 121,
(2) Audio stream coding information 122,

The stream coding information [Stream Coding Info] shown in FIG. 16 includes
Coding type (stream_coding_type) = [0x11]
The audio data attribute information recording area 130 of the above coding type [0x11] is set.

As described above, the coding type = [0x11] is
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
It is a type identifier associated with both of these two types of coded voice data, and it is possible to identify which of the above (1) and (2) is the coded voice data only by this type identifier [0x11]. I can't.

The following information is recorded in the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type 133

Among these data, the following data (a) and (b), that is,
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
These data are the same data as the data described above with reference to FIG.

In the case of MMT format data received from a transmitting device such as a broadcasting station, these information are recorded in, for example, the MMT package table (MPT) which is control information (SI) corresponding to the MMT format.
The recording device that records the MMT format data on a medium such as a BD reads each of the above data (a) and (b) from the MMT package table (MPT) that is the control information (SI) corresponding to the MMT format, and the clip information. Record in a file.
A specific example of the recorded data of the MMT package table (MPT) will be described later.

The audio attribute information of these (a) and (b), that is,
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
As described with reference to FIGS. 14 and 15, these voice attribute information is also set for voice data other than the coding type [0x11], that is, voice data such as coding types [0x03] to [0x84]. It is the information that has been done.

As shown in FIG. 16, for the audio data of the coding type [0x11], further
(C) Audio Object Type 133
Record the above audio attribute information.

This audio object type (audioObjectType) 133 is
The following two types of data included in the coding type = [0x11], that is,
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
These two types of coded voice data are used as identifiers, that is, voice identification information.

FIG. 17 shows a specific example of recorded data of the voice object type (audioObjectType) 133.
When the audio object type (audioObjectType) = 2,
The coded voice data of this coding type = [0x11] is
It means that it is MPEG4 AAC LC (LATM / LOAS) coded audio data.

on the other hand,
When the audio object type (audioObjectType) = 36,
The coded voice data of this coding type = [0x11] is
It means that it is MPEG4 ALS (LATM / LOAS) coded audio data.

The playback device that reproduces the data recorded on the media such as BD refers to the recorded data of this audio object type (audioObjectType), so that the audio data that is the reproduction control target of this clip information file can be set.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is possible to identify which of these voice data is used.

In the case of MMT format data received from a transmission device such as a broadcasting station, this audio object type (audioObjectType) information is recorded in an audio data storage packet (MMTP packet / TLV packet).
A recording device that records MMT format data on a medium such as a BD reads an "audio object type (audioObjectType)" from an audio data storage packet received from a transmission device such as a broadcasting station, and records it in a clip information file.

An example of a packet configuration of an audio data storage packet according to the MMT format transmitted by a transmission device such as a broadcasting station will be described with reference to FIG.
FIG. 18 shows a voice data storage packet 140 according to the MMT format.
As shown in FIG. 18, the packet storage data 141 of the voice data storage packet 140 is composed of a coded voice data stream and attribute information of the stream data.

The encoded voice data stream stored in the voice data storage packet 140 is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is the voice data of any of these.

In the voice data storage packet 140, the attribute information of the voice data stored in the packet is further recorded.
As shown in FIG. 18, as a part of the audio data attribute information,
The audio object type (audioObjectType) 142 is recorded.

The setting value of this audio object type (audioObjectType) 142 is the following setting.
The data stored in the packet is
When it is MPEG4 AAC LC (LATM / LOAS) coded audio data,
The audio object type (audioObjectType) = 2 is set.
On the other hand, the data stored in the packet is
When it is MPEG4 ALS (LATM / LOAS) coded audio data,
The audio object type (audioObjectType) = 36 is set.
That is, it is a set value described above with reference to FIG.

A recording device that receives MMT format data transmitted from a transmitting device such as a broadcasting station and records the MMT format data on a medium such as BD is a recording device that receives "voice" from a voice data storage packet received from a transmitting device such as a broadcasting station. The setting value (2 or 36) of "object type (audioObjectType)" is read, and this setting value is used in the clip information file shown in FIG.
Audio object type 133 Record in the recording area.

The playback device that reproduces the data recorded on the media such as BD confirms whether the recorded data of this audio object type (audioObjectType) is "2" or "36" to control the reproduction of this clip information file. The target voice data is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is possible to identify which of these voice data is used.

That is, the setting value of the audio object type (audioObjectType) from the audio attribute information recording area of the coding type = [0x11] in the stream coding information [StreamCodingInfo] set in the program information [ProgramInfo ()] recording area of the clip information file. To read.

If the audio object type (audioObjectType) = 2,
The audio data of this coding type = [0x11] is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
Is determined to be.
On the other hand, if the audio object type (audioObjectType) = 36,
The audio data of this coding type = [0x11] is
(1) MPEG4 ALS (LATM / LOAS) coded audio data,
Is determined to be.
Based on this determination information, the reproduction device can start the preparation for decoding each coded voice data, for example, the codec setting.

In addition, corresponding to the contents such as one program,
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
These two types of audio data (audio stream) may be delivered.
For example, it is a setting that allows the user (viewer) to select playback data from these two types of audio data.

In this way, the recording device that receives a plurality of audio data (audio streams) from a transmission device such as a broadcasting station and records them on a medium such as a BD can use the stream coding information [Stream Coding Info] shown in FIG. 16 for each audio data ( Audio stream) Generated individually for each and stored in one clip information file.

In this case, the playback device that reproduces the data recorded on the media such as BD is
Audio object type (audioObjectType) = 2, and
Audio object type (audioObjectType) = 36,
These two types of audio data, that is,
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It can be determined that these two types of audio data can be selectively played back by applying this clip information file.

In this case, the playback device, for example, with respect to the user (viewer).
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
Guidance information indicating that these two types of voice data can be reproduced is displayed on the display unit. Further, it is possible to have the user input the selection information of the desired reproduction sound, and perform the process of selecting and reproducing the input selection information, that is, the desired reproduction sound as the reproduction data.

[6-2. (Example 2) Example of acquiring the voice identification information recorded in the MMT package table (MPT) and recording it in the clip information file]
Next, as the second embodiment, an embodiment in which the voice identification information recorded in the MMT package table (MPT), which is the control information (SI) corresponding to the MMT format, is acquired and recorded in the clip information file will be described.

That is, the voice data is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
An embodiment in which identification information indicating which of these two types of voice data is used is acquired from the MMT package table (MPT) and recorded in a clip information file will be described.

FIG. 19 is a diagram showing a data structure (syntax) of the stream coding information [Stream Coding Info] of the program information [Program Info ()] of the clip information file according to the second embodiment.

In the new stream coding information [StreamCodingInfo] shown in FIG. 19, the audio data to be controlled by this clip information file is
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
It has a configuration that makes it possible to identify which of these two types of coded voice data is.

As the stream coding information [StreamCodingInfo] shown in FIG. 16, the following data is recorded in the same manner as described above with reference to FIG.
(1) Image stream coding information 121,
(2) Audio stream coding information 122,

The stream coding information [StreamCodingInfo] shown in FIG. 19 has the same data structure as that shown in FIG. 16 described above as the first embodiment.
Coding type (stream_coding_type) = [0x11]
The audio data attribute information recording area 130 of the above coding type [0x11] is set.

As described above, the coding type = [0x11] is
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
It is a type identifier associated with both of these two types of coded voice data, and it is possible to identify which of the above (1) and (2) is the coded voice data only by this type identifier [0x11]. I can't.

The following information is recorded in the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135

Among these data, the following data (a) and (b), that is,
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
These data are the same data as the data described above with reference to FIG.

As described above, in the case of MMT format data received from a transmitting device such as a broadcasting station, these information are recorded in, for example, the MMT package table (MPT) which is control information (SI) corresponding to the MMT format. ..
The recording device that records the MMT format data on a medium such as a BD reads each of the above data (a) and (b) from the MMT package table (MPT) that is the control information (SI) corresponding to the MMT format, and the clip information. Record in a file.
A specific example of the recorded data of the MMT package table (MPT) will be described later.

As shown in FIG. 19, for the audio data of the coding type [0x11], further
(C) Stream content (stream_content) 135
Record the above audio attribute information.

In the second embodiment, this stream content (stream_content) 135 is
The following two types of data included in the coding type = [0x11], that is,
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
These two types of coded voice data are used as identifiers, that is, voice identification information.

FIG. 20 shows a specific example of recorded data of the stream content (stream_content) 135.
When stream content (stream_content) = 0x3,
The coded voice data of this coding type = [0x11] is
It means that it is MPEG4 AAC LC (LATM / LOAS) coded audio data.

on the other hand,
When stream content (stream_content) = 0x4,
The coded voice data of this coding type = [0x11] is
It means that it is MPEG4 ALS (LATM / LOAS) coded audio data.

The playback device that plays back the data recorded on the media such as BD refers to the recorded data of this stream content (stream_content), and the audio data that is the playback control target of this clip information file can be set.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is possible to identify which of these voice data is used.

In the case of MMT format data received from a transmitting device such as a broadcasting station, this stream content (stream_content) information is recorded in the MMT package table (MPT) which is control information (SI) corresponding to the MMT format.
A recording device that records MMT format data on a medium such as a BD is a "stream content (stream_content)" from the MMT package table (MPT) that is control information (SI) corresponding to the MMT format received from a transmission device such as a broadcasting station. And record it in the clip information file.

FIG. 21 is a diagram showing a data structure (syntax) of the MMT package table (MPT).
The MMT package table (MPT: MMT Package Table) specified in the MMT format is a table in which data attribute information (asset descriptor) is recorded in detail for each data type (asset type) such as images, sounds, and subtitles. Is.

The MMT package table (MPT: MMT Package Table) 280 is stored in an MMTP packet having a packet ID = 0x0000, and the information processing apparatus can determine the stored packet in the MMT package table (MPT) based on the packet ID. can.

The MMT package table (MPT) contains, as shown in FIG.
Asset type (asset_type) 151,
Asset descriptor (asset_descriptors_byte) 152,
These data recording areas are included.

The asset type (asset_type) 151 is an area for recording identifiers for each data type such as images, sounds, and subtitles. An asset is a unit of data processing having a common attribute, and images, sounds, subtitles, etc. are set as different assets.
FIG. 22 shows a specific example of the asset type (asset_type) recorded in the MMT package table (MPT).

As shown in FIG. 22, the asset type (asset_type) recorded in the MPT includes, for example, the following types.
hvc1: HEVC image mp4a: Audio stpp: Subtitles, etc. app: Application In the MPT asset type (asset_type) 151 recording field shown in FIG. 21, for example, any of the above type information is recorded.

Shown in the lower part of the MPT in FIG. 21
Asset descriptor (asset_descriptors_byte) 152,
In this field, each asset type (for example, image, sound, subtitle), various attribute information according to these data types, for example, resolution information in the case of an image, etc. are recorded.

FIG. 23 is a diagram showing audio attribute information recorded in the MMT package table (MPT) described with reference to FIG. 21.
That is, FIG. 23 shows the case where the asset type (asset_type) 151 in the MPT shown in FIG. 21 is a voice-compatible type identifier (mp4a).
It is an example of the data recorded as the asset descriptor (asset_descriptors_byte) 152, and the data shown in FIG. 23 is a diagram showing the data structure (syntax) of the voice component descriptor (MH-Audio_Component_Descriptor).

As shown in FIG. 23, the following voice attribute information is recorded in the voice component descriptor (MH-Audio_Component_Describer).
(M1) Stream content information (M2) Component type (M3) Sampling frequency

The information processing apparatus that executes data recording processing on the information recording medium (media) reads these audio attribute information from the MMT package table (MPT) and records it as recording data for the clip information file to be recorded on the information recording medium (media). Use.

That is, the following recorded data for the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] described above with reference to FIG.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
These recorded data will be used.

The following recorded data for the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG. 16 described above as the first embodiment.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
These recorded data are also recorded data of the audio component descriptor (MH-Audio_Component_Describer) of the MMT package table (MPT) shown in FIG. 23.
(M2) Component type (M3) Sampling frequency It is possible to record using these recorded data.

The following recorded data of the MMT package table (MPT) shown in FIG. 23, that is,
(M1) Stream content information 161
(M2) Component type 162,
(M3) Sampling frequency 163,
Specific examples of these data will be described with reference to FIGS. 24 and below.

FIG. 24 is recorded in the MMT Package Table (MPT).
(M1) Stream content information 161
It is a figure which shows the specific example of.
In the MMT package table (MPT), as stream content information,
Any bit value from 0x0 to 0xF is stored. Coding mode information corresponding to each bit value is recorded.

Specifically, the settings are as follows.
(1) Stream content (stream_content) = 0x2 is
This means that the audio stream corresponding to the asset is an audio stream that does not specify the encoding method.
(2) Stream content (stream_content) = 0x3 is
It means that the audio stream corresponding to this asset is an audio stream of MPEG4 AAC (MPEG4 AAC LC (LATM / LOAS)).
(3) Stream content (stream_content) = 0x4 is
It means that the audio stream corresponding to this asset is an audio stream of MPEG4 ALC (MPEG4 ALS (LATM / LOAS)).

For example, a recording device that records MMT format data on a medium such as a BD can use this "stream content (MPT) from the MMT package table (MPT) that is control information (SI) corresponding to the MMT format received from a transmission device such as a broadcasting station. Read "stream_content)" and record it in the clip information file.
The asset in the MMT format corresponds to the stream in the MPEG format.

For example, if the value of the stream content (stream_content) recorded in the MMT package table (MPT) is 0x3 for one asset in the MMT format.
(C) Stream content (stream_content) 135 of the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG. 19, which is the recording area of the attribute information of the audio stream corresponding to this asset.
0x3 is recorded in this recording area.

On the other hand, when the value of the stream content (stream_content) recorded in the MMT package table (MPT) is 0x4 for one asset having the MMT format,
(C) Stream content (stream_content) 135 of the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG. 19, which is the recording area of the attribute information of the audio stream corresponding to this asset.
0x4 is recorded in this recording area.

In this way, the recording device that records the MMT format data on a medium such as a BD stores the stream content (stream_content) information for each asset (stream) in the clip information file and records it on the media.

The playback device that plays back the data recorded on the media such as BD refers to the recorded data of this stream content (stream_content), and the audio data that is the playback control target of this clip information file can be set.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is possible to identify which of these voice data is used.

That is, the playback device has stream content (stream_content) from the audio attribute information recording area of the coding type = [0x11] in the stream coding information [StreamCodingInfo] set in the program information [ProgramInfo ()] recording area of the clip information file. Read the setting value of.

If stream content (stream_content) = 0x3,
The audio data of this coding type = [0x11] is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
Is determined to be.
On the other hand, if the stream content (stream_content) = 0x4,
The audio data of this coding type = [0x11] is
(1) MPEG4 ALS (LATM / LOAS) coded audio data,
Is determined to be.
Based on this determination information, the reproduction device can quickly start the preparation for decoding each coded voice data, for example, the codec setting.

In addition, corresponding to the contents such as one program,
(1) MPEG4 AAC LC coded audio data,
(2) MPEG4 ALS coded audio data,
These two types of audio data (audio stream) may be delivered.
For example, it is a setting that allows the user (viewer) to select playback data from these two types of audio data.

In this way, the recording device that receives a plurality of audio data (audio streams) from a transmission device such as a broadcasting station and records them on a medium such as a BD can use the stream coding information [Stream Coding Info] shown in FIG. 19 for each audio data (audio). Stream) Generated individually for each and stored in one clip information file.

In this case, the playback device that reproduces the data recorded on the media such as BD is
Stream content (stream_content) = 0x3, and
Stream content (stream_content) = 0x4,
These two types of audio data, that is,
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It can be determined that these two types of audio data can be selectively played back by applying this clip information file.

In this case, the playback device, for example, with respect to the user (viewer).
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
Guidance information indicating that these two types of voice data can be reproduced is displayed on the display unit. Further, it is possible to have the user input the selection information of the desired reproduction sound, and perform the process of selecting and reproducing the input selection information, that is, the desired reproduction sound as the reproduction data.

Next, with reference to FIGS. 25 and 26, specific examples of the following two pieces of information shown in FIG. 23 recorded in the MMT package table (MPT) will be described.
(M2) Component type 162,
(M3) Sampling frequency 163,

FIG. 25 is recorded in the MMT Package Table (MPT).
(M12) Component type 162
It is a figure which shows the specific example of.
In the MMT package table (MPT), as component type information 162,
Any bit value from 000000 to 11111 is stored, and various audio output types (component types) such as monaural and stereo are associated with each bit value.

FIG. 26 is recorded in the MMT Package Table (MPT).
(M3) Sampling frequency 163
It is a figure which shows the specific example of.
In the MMT package table (MPT), as sampling frequency information 163,
Any bit value of 000 to 111 is stored, and a sampling frequency of 16 to 48 kHz is associated with each bit value.

As described above, the MMT package table (MPT) included in the control information (signaling information (MMT-SI)) in the MMT format data is included in the MMT package table (MPT).
(M1) Stream content information (M2) Component type (M3) Sampling frequency These specific information is recorded.

The information processing apparatus that executes data recording processing on the information recording medium (media) reads these audio attribute information from the MMT package table (MPT) and records it as recording data for the clip information file to be recorded on the information recording medium (media). Use.

Specifically, the following information of the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG. 19 is recorded.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135

The following information of the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [Stream Coding Info] described above with reference to FIG. 16 (Example 1).
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
This information is also used as recording data for the clip information file that records the recording data of the MMT package table (MPT) on the information recording medium (media).

As described above in Examples 1 and 2, the information processing apparatus that inputs MMT format data and records the input data as BDAV format data on an information recording medium (media) has audio data.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
The voice identification information indicating which of these voice data is used is acquired from the voice data storage packet or the MMT package table (MPT) as stream unit (asset unit) information and recorded in the clip information file.

The above voice identification information is
The voice object type (audioObjectType) recorded in the voice data storage packet described in the first embodiment, or.
The stream content (stream_content) recorded in the MMT package table (MPT) described in the second embodiment.
Information on any of these.

In the above embodiment, the setting value (2 or 36) of the audio object type (audioObjectType) recorded in the audio data storage packet described in the first embodiment and the stream content recorded in the MMT package table (MPT). Although the setting value (0x3 or 0x4) of (stream_content) is recorded as it is in the clip information file as an example, these values may be different values that can distinguish the two audio data, and various settings are used. Is possible.

Further, in Examples 1 and 2 described above, the definition data “audio object type (audioOjectType)” in the MMT format is set to be recorded as it is as the recording data of the clip information file shown in FIG. 16, and is also shown in FIG. As the recording data of the clip information file, the definition data "stream content (stream_content)" in the MMT format is set to be recorded as it is.
Also for these data, an expression different from the above expression, for example, a field with a new definition such as "AAC_AC_ALS_coding_type" is set, and a value that makes it possible to distinguish between the two voice data (AAC LC and ALS) is set in this field. It may be configured to be used.

[7. Configuration and processing of information processing equipment that executes data recording processing for information recording media]
Next, the configuration and processing of the information processing apparatus that executes the data recording processing for the information recording medium will be described with reference to FIGS. 27 and 27.

As described above, the information processing apparatus of the present disclosure records input data according to the MMT format as BDAV format data or SPAV format data on an information recording medium such as a BD or a flash memory.
The information processing apparatus 300 records a clip AV stream file and a database file such as a playlist or a clip information file on the information recording medium (recording medium) 320.
Image attribute information, audio attribute information, playback control information, etc. corresponding to media recording contents are recorded in a database file such as a playlist or a clip information file.

The information recorded in the database file such as the playlist or clip information file includes the playback stream data storage packet such as images and sounds included in the input data according to the MMT format, as well as the control information (SI) specified in the MMT format. It is acquired from TLV-SI, various information recording tables constituting MMT-SI, and the like.

Specifically, for example, various information is acquired from the MMT package table (MPT) included in the MMT-SI, and media recording contents are supported in database files such as playlists and clip information files specified in the BDAV format. Record the information of.

Hereinafter, the configuration and processing sequence of the information processing apparatus that executes the generation processing of the information recording medium in which such playlists and clip information files are recorded, specifically, the data recording processing for the information recording medium such as BD, will be described. do.

FIG. 27 is a diagram showing a configuration of an information processing apparatus 300 that executes data recording processing on an information recording medium such as a BD.
The information processing apparatus 300 records the recorded data of the BDAV format data or the SPAV format data on the information recording medium (recording medium) 320. That is, a database file such as a clip AV stream file composed of image and audio data, a playlist file and a clip information file which are playback control information files is recorded.

The data input unit 301 inputs MMT format data 331 for the information recording medium 320, that is, MMT format data 331 including image data, audio data, subtitle data, and the like.
The data input unit 301 is a receiving unit that transmits MMT format data 331, for example, a receiving unit that receives transmission data from a broadcasting station, a content server, or the like, or a media reading unit that reads data from a medium that records MMT format data 331. Etc.

The MMT format data 331 input from the data input unit 301 is data according to the data format described above with reference to FIG. 2, for example, high-definition image data such as a HEVC image or MPEG4 AAC LC (LATM / LOAS). ) Audio-encoded data, MPEG4 ALS (LATM / LOAS) audio-encoded data and the like are included.

The MMT format data 331 is stored in the storage unit 304 under the control of the control unit 303.
The user input unit 302 inputs, for example, a request for starting data recording to the information recording medium 320.

When a data recording start request is input from the user input unit 302, the MMT format data 331 stored in the storage unit 304 is input to the demultiplexer (DeMUX) 305 using this input as a trigger.
The demultiplexer (DeMUX) 305 uses MMT format data 331 as a packet containing data such as images, sounds, and subtitles, signaling information (TLV-SI, MMT-SI) containing notification information, control information, and the like. Auxiliary information is acquired, classified into packets of data type, and each packet is classified into subtitle data generation unit 311 of recorded data generation unit 306, image data generation unit 312, audio data generation unit 313, and auxiliary data according to the data type. It is input to the information generation unit 314.

The subtitle data generation unit 311 acquires subtitle data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data specified in the BDAV format.
The image data generation unit 312 acquires image data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data specified in the BDAV format.
The audio data generation unit 313 acquires audio data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data specified in the BDAV format.

The auxiliary information generation unit 314 is a database file specified in the BDAV format by acquiring attribute information and reproduction control information corresponding to reproduction data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304. Generates data to be stored in the playlist file or clip information file as.

Specifically, for example, data to be stored in a playlist file or a clip information file is acquired from a playback stream data storage packet such as an image or sound according to the MMT format, an MMT package table (MPT), or the like. Generate a playlist file or clip information file.

The multiplexer (MUX) 315 inputs the subtitles, images, and audio data converted by the subtitle data generation unit 311, the image data generation unit 312, and the audio data generation unit 313, and generates a stream file in which these data are stored.

As described above, the clip AV stream file for recording MMT format data on the media is
(1) Convert the MMT format to the MPEG-2 TS format to generate a clip AV stream file, or
(2) Generate a clip AV stream file consisting of a packet sequence (MMTP packet sequence or TLV packet sequence) of a packet storing data according to the MMT format.
These two types of processing are assumed.
The recording data generation unit 306 generates a clip AV stream file according to any of the processing modes (1) and (2) above.

The database file generation unit 316 stores database files such as a playlist file and a clip information file that record various information acquired from the signaling information (TLV-SI, MMT-SI) of the MMT format data 331 by the auxiliary information generation unit 314. Generate.

As explained earlier, the clip information file contains the attribute information corresponding to audio data.
(1) MPEG4 AAC LC (LATM / LOAS)
(2) MPEG4 ALS (LATM / LOAS)
The voice identification information that makes the above two voice-coded data distinguishable is recorded.
Specifically, a clip information file having the recorded data shown in FIG. 16 or FIG. 19 is generated.

The stream file data generated by the recording data generation unit 306 and the recording data 332 including the database files such as the playlist file and the clip information file are informationed by the recording unit 306 via the drive 307 under the control of the control unit 303. It is output to the recording medium 320 and recorded.

Next, a sequence of data recording processing for the information recording medium 320 executed by the information processing apparatus 300 shown in FIG. 27 will be described with reference to the flowchart shown in FIG. 28.

The processing according to the flow shown in FIG. 28 may be executed under the control of a data processing unit (control unit) having a CPU having a program execution function, for example, according to a program stored in the storage unit of the information processing apparatus. can.
Hereinafter, the processing of each step shown in the flow of FIG. 28 will be sequentially described.

(Step S101)
First, in step S101, the information processing apparatus 300 inputs MMT format data, which is recording data, via the data input unit 301.
The recording data includes image data, audio data, subtitle data, signaling information (TLV-SI, MMT-SI) storing notification information, control information, and the like.

(Step S102)
Next, in step S102, the information processing apparatus 300 acquires reproduction target data such as images and sounds from the input MMT format data, and generates an AV stream file according to the BDAV format.

(Step S103)
Next, in step S103, the information processing apparatus 300 generates a clip information file by using the configuration data of the input MMT format data.
Specifically, as described in Examples 1 and 2 above, data is acquired from a reproduction stream data storage packet such as an image or audio according to the MMT format, an MMT package table (MPT), or the like, and a clip is obtained. Generate an information file.
The details of the clip information file generation process in step S103 will be described later with reference to FIGS. 29 and 30.

(Step S104)
Next, in step S104, the information processing apparatus 300 generates a playlist file by using the configuration data of the input MMT format data.

(Step S105)
Next, in step S105, the information processing apparatus 300 uses the input MMT format data to generate other database files.

(Step S106)
Next, in step S106, the information processing apparatus 300 generates BDAV format data using the generated AV stream file and database file.

(Step S107)
Next, in step S107, the information processing apparatus 300 records the BDAV format data generated in step S106 on the information recording medium (media).

Next, the detailed sequence of the clip information file generation process executed in step S103 will be described with reference to the flowcharts shown in FIGS. 29 and 30.

FIG. 29 is a detailed sequence of the clip information file generation process according to the above-described (Example 1), that is, the embodiment of acquiring the voice identification information from the voice data storage packet.
FIG. 30 is a detailed sequence of clip information file generation processing according to the above-described (Example 2), that is, an embodiment of acquiring voice recognition information from the MMT package table (MPT).

First, with reference to FIG. 29, a detailed sequence of clip information file generation processing according to the above-described (Example 1), that is, an embodiment of acquiring voice identification information from a voice data storage packet will be described.
The processing of each step of the flow shown in FIG. 29 will be sequentially described.

(Step S121)
First, in step S121, the information processing apparatus 300 acquires an audio data storage packet to be recorded in the clip AV stream file.
This voice data storage packet corresponds to the voice data storage packet 140 described above with reference to FIG.
As shown in FIG. 18, the packet storage data 141 of the voice data storage packet 140 is composed of a coded voice data stream and attribute information of the stream data.

The coded audio data stream stored in the audio data storage packet 140 is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is the voice data of any of these.

Further, the voice data storage packet 140 records the attribute information of the voice data stored in the packet.
As shown in FIG. 18, as a part of the audio data attribute information,
A voice object type (audioObjectType) 142 is recorded.

(Step S122)
Next, in step S122, the information processing apparatus 300 acquires the set value of the voice object type (audioObjectType) from the acquired voice data storage packet.
As shown in FIG. 18, as a part of the audio data attribute information,
A voice object type (audioObjectType) 142 is recorded.

The setting value of the audio object type (audioObjectType) 142 shown in FIG. 18 is the following setting.
When the data stored in the packet is MPEG4 AAC LC (LATM / LOAS) coded audio data, the audio object type (audioOjectType) = 2.
On the other hand, when the data stored in the packet is MPEG4 ALS (LATM / LOAS) coded audio data, the audio object type (audioOjectType) = 36.

(Step S123)
Next, in step S123, the information processing apparatus 300 acquires the MMT package table (MPT) from the control information (SI) storage packet.

The MMT package table (MPT) is a table that stores various data described above with reference to FIGS. 21 to 26.
For example, the audio data is described with reference to FIGS. 23 to 26 as attribute information for each asset (stream) (M1) Stream content information 161.
(M2) Component type 162,
(M3) Sampling frequency 163,
Each of these data is recorded.

(Step S124)
Next, in step S124, the information processing apparatus 300 selects an asset descriptor whose asset type is voice from the MPT (MMT package table).

(Step S125)
Next, in step S125, the information processing apparatus 300 acquires the following voice attribute information from the MPT asset type = voice asset descriptor (asset_descriptor).
(M2) Component type 162,
(M3) Sampling frequency 163.

(Step S126)
Next, in step S126, the information processing apparatus 300 has voice attribute information acquired from the voice data storage packet, that is, shown in FIG.
Audio Object Type 142,
Further, the audio attribute information acquired from the MPT, that is, with reference to FIGS. 23 to 26, has been described.
(M2) Component type 162,
(M3) Sampling frequency 163,
Each of these pieces of information is recorded in a recording field of stream coding type = 0x11 or less set in the clip information file.

That is, the following data (a) voice type (audio_presentation_type) 131 described above with reference to FIG. 16 above.
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type 133
Each of these pieces of information is recorded in a recording field of stream coding type = 0x11 or less set in the clip information file.

By these processes, a clip information file in which predetermined audio attribute information is recorded is generated.
The playback device that reproduces the data recorded on the media such as BD refers to the audio object type (audioObjectType) recorded in the clip information file, so that the audio data that is the playback control target of this clip information file can be set.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is possible to identify which of these voice data is used.

Next, with reference to FIG. 30, a detailed sequence of the clip information file generation process according to the above-described (Example 2), that is, the embodiment of acquiring voice recognition information from the MMT package table (MPT) will be described. do.
The processing of each step of the flow shown in FIG. 30 will be sequentially described.

(Step S131)
First, in step S131, the information processing apparatus 300 acquires the MMT package table (MPT) from the control information (SI) storage packet.

The MMT package table (MPT) is a table that stores various data described above with reference to FIGS. 21 to 26.
For example, the audio data is described with reference to FIGS. 23 to 26 as attribute information for each asset (stream) (M1) Stream content information 161.
(M2) Component type 162,
(M3) Sampling frequency 163,
Each of these data is recorded.

(Step S132)
Next, in step S132, the information processing apparatus 300 selects data whose asset type is voice from the MPT (MMT package table).

(Step S133)
Next, in step S133, the information processing apparatus 300 acquires the following voice attribute information from the MPT asset type = voice asset descriptor (asset_descriptor).
(M1) Stream content information 161
(M2) Component type 162,
(M3) Sampling frequency 163.

(Step S134)
Next, in step S134, the information processing apparatus 300 has been described with reference to the voice attribute information acquired from the MPT, that is, FIGS. 23 to 26.
(M1) Stream content information 161
(M2) Component type 162,
(M3) Sampling frequency 163,
Each of these pieces of information is recorded in a recording field of stream coding type = 0x11 or less set in the clip information file.

That is, the following data (a) voice type (audio_presentation_type) 131 described above with reference to FIG. 19
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
Each of these pieces of information is recorded in a recording field of stream coding type = 0x11 or less set in the clip information file.

By these processes, a clip information file in which predetermined audio attribute information is recorded is generated.
Specifically, the playback device that reproduces the data recorded on the media such as BD becomes the playback control target of this clip information file by referring to the stream content (stream_content) recorded in the clip information file. The voice data is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is possible to identify which of these voice data is used.

[8. Configuration and processing of information processing equipment that executes data reproduction processing from information recording media]
Next, the configuration and processing of the information processing apparatus that executes the data reproduction processing from the information recording medium will be described with reference to FIGS. 31 and below.

The information processing apparatus that executes the reproduction process reads the data recorded on the information recording medium attached to the apparatus and executes the reproduction process.

FIG. 31 is a diagram showing a configuration of an information processing apparatus 400 that executes a reproduction process of data recorded on an information recording medium 510 such as a BD.
The information processing device 400 reads the data recorded on the information recording medium (recording medium) 510 shown in FIG. 31 and outputs the data to the output device (display unit + speaker) 520. The output device 520 is, for example, a television or the like, and is a display device including a display, a speaker, and the like.
The information processing device 400 may be the same device as the information processing device 300 that performs data recording described above with reference to FIG. 27. That is, it is an information processing device having both functions of data recording and reproduction.

The information recording medium (recording medium) 510 is a recording medium in which a clip AV stream file generated by the processes described with reference to FIGS. 28 to 30 and a database such as a playlist and a clip information file are recorded.

In the clip information file used for playing the clip AV stream file compatible with the MMT format, each audio stream has audio attribute information for each stream (asset) related to audio data.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
The voice identification information that makes it possible to identify which of these voice data is recorded is recorded.

That is, the following data described above with reference to FIG. 16
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type 133
These data are recorded.

Alternatively, the following data, which have been described above with reference to FIG.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
These data are recorded.

In the example shown in FIG. 16, the audio object type (audioObjectType) 133,
In the example shown in FIG. 19, stream content (stream_content) 135,
These data, the audio stream,
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
This is voice identification information indicating which of these voice data is used.

For example, the control unit 401 reads the recorded data of the information recording medium 510 via the recording / reproducing unit 404 and the drive 403 based on the input of the reproduction instruction information from the user input unit 402, and the storage unit 405 as a data buffer. It is stored in, and the stored data is output to the reproduction processing unit 406.

Further, the control unit 401 obtains the recorded content list described above with reference to FIG. 9 based on the recorded data of the information recording medium 510 based on the input of the recorded content list display instruction information from the user input unit 402. It is generated and output to the output device (display unit) 520.

Under the control of the control unit 401, the reproduction processing unit 406 acquires each data from the reproduction data read from the information recording medium 510, that is, a clip AV stream file storing each data such as images, sounds, and subtitles. To generate playback data.

The demultiplexer (DeMUX) 411 acquires a data storage packet containing each data such as an image, an audio, a subtitle, a playlist file, a clip information file, etc., classifies them into data type packets, and classifies each packet into data. Depending on the type, the data is output to the subtitle data generation unit 412, the image data generation unit 413, the audio data generation unit 414, and the auxiliary information generation unit 415.

The subtitle data generation unit 412, the image data generation unit 413, and the audio data generation unit 414 execute the decoding process of the data stored in the packet and output the decoded data to the output data generation unit 416.
The output data generation unit 416 outputs each data of subtitles, images, and voices to the output device (display unit + speaker) 520 via the input / output interface 407.

The information recording medium 510 is used as a stream file in which data to be reproduced is stored.
A stream file containing MPEG-2 TS format data and
It may have a stream file containing MMT format data.
The information processing apparatus 400 selectively applies a playlist file and a clip information file corresponding to each format, and executes a playback process of a stream file storing MPEG-2 TS format data and a stream file storing MMT format data. It will be.

The auxiliary information generation unit 415 acquires, for example, the data stored in the playlist file and the clip information file to generate a recorded content list, and the generation list is output to the output device (display unit + speaker) 520.

The output device (display unit + speaker) 520 outputs each data such as subtitles, images, and sounds input from the information processing device 400, and a recorded content list via the output device (display unit + speaker) 520.

Next, in the reproduction processing of the MMT format data from the information recording medium 510 executed by the information processing apparatus 400 shown in FIG. 31, the audio data to be reproduced is the audio data to be reproduced.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
A voice recognition processing sequence for identifying which of these voice data is used will be described with reference to the flowchart shown in FIG. 32.

The processing according to the flow shown in FIG. 32 is executed under the control of a data processing unit (control unit) having a CPU having a program execution function, for example, according to a program stored in the storage unit of the information processing apparatus 400. Can be done.

The information processing device that executes the processing according to the flow shown in FIG. 32 is the information processing device 400 shown in FIG. 31, in which an information recording medium (recording medium) 510 is attached and recorded on the attached information recording medium 510. The output data is read and output to the output device (display unit + speaker) 520. The output device 520 is, for example, a television or the like, and is a display device including a display, a speaker, and the like.

The information recording medium (recording medium) 510 is a recording medium in which a clip AV stream generated by the processes described with reference to FIGS. 28 to 31 and a database such as a playlist and a clip information file are recorded.
Hereinafter, the processing of each step shown in the flow of FIG. 32 will be sequentially described.

(Step S201)
First, the control unit 401 of the information processing apparatus 400 acquires the clip information file in step S201.
The clip AV stream file selected here is assumed to be a clip AV stream file used for playing back the clip AV stream file storing the MMT format data.

(Step S202)
Next, in step S202, the control unit 401 of the information processing apparatus 400 displays the audio data to be reproduced from the following recording field of stream coding type = 0x11 recorded in the clip information file.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
Acquires voice identification information indicating which of the above coded voice data is used.

Specifically, this is a process of acquiring the following information included in the recorded data of the stream coding information [Stream Coding Info] of the program information [Program Info ()] of the clip information file shown in FIG. 16 or FIG.

When the recorded data of the clip information file has the data structure shown in FIG.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type 133
Get these data.

On the other hand, when the recorded data of the clip information file has the data structure shown in FIG.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
Get these data.

In the example shown in FIG. 16, the audio object type (audioObjectType) 133,
In the example shown in FIG. 19, stream content (stream_content) 135,
These data, the audio stream,
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
This is voice identification information indicating which of these voice data is used.

(Step S203)
Next, in step S203, the control unit 401 of the information processing apparatus 400 displays the voice data to be reproduced based on the voice identification information read from the clip information file in step S202.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is determined which of these voice data is used.

The audio data to be played is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
If is, the process proceeds to step S204.
On the other hand, the audio data to be played is
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
If is, the process proceeds to step S205.

(Step S204)
The audio data to be played is
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
In the case of, the control unit 401 of the information processing apparatus 400 executes the decoding / reproduction process in step S204 by applying the codec corresponding to the MPEG4 AAC LC (LATM / LOAS) coded audio data.

(Step S205)
On the other hand, the audio data to be played is
(1) MPEG4 ALS (LATM / LOAS) coded audio data,
In the case of, the control unit 401 of the information processing apparatus 400 executes the decoding / reproduction process in step S205 by applying the codec corresponding to the MPEG4 ALS (LATM / LOAS) coded audio data.

In this way, the clip information file contains audio data to be played back.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
Voice identification information indicating which of these voice data is recorded is recorded, and by referring to this information, it is possible to quickly execute correct decoding processing and reproduction processing.

Next, for the content such as one program,
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
An example of a reproduction sequence of content in which these two types of audio data are set and can be selectively reproduced by a user (viewer) will be described with reference to the flowchart shown in FIG. 33.

The processing according to the flow shown in FIG. 33 is executed under the control of a data processing unit (control unit) having a CPU having a program execution function, for example, according to a program stored in the storage unit of the information processing apparatus 400. Can be done.
Hereinafter, the processing of each step shown in the flow of FIG. 33 will be sequentially described.

(Step S301)
First, the control unit 401 of the information processing apparatus 400 acquires the clip information file in step S301.
The clip AV stream file selected here is assumed to be a clip AV stream file used for playing back the clip AV stream file storing the MMT format data.

(Steps S302 to S303)
Next, in steps S302 to S303, the control unit 401 of the information processing apparatus 400 displays the audio data to be reproduced based on the recorded information in the following recording field of the stream coding type = 0x11 recorded in the clip information file.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is confirmed whether or not the above two types of coded voice data can be selectively played back.

Specifically, this is a process of acquiring the following information included in the recorded data of the stream coding information [Stream Coding Info] of the program information [Program Info ()] of the clip information file shown in FIG. 16 or FIG.

When the recorded data of the clip information file has the data structure shown in FIG.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type 133
Get these data.

On the other hand, when the recorded data of the clip information file has the data structure shown in FIG.
(A) Voice type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
Get these data.

In the example shown in FIG. 16, the audio object type (audioObjectType) 133,
In the example shown in FIG. 19, stream content (stream_content) 135,
These data are recorded in units of audio streams, and when multiple audio streams are set for content such as one program, each audio stream is used.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
Voice identification information indicating which of these voice data is used is recorded.

In steps S302 to S303, referring to the recorded data of the clip information file,
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is confirmed whether or not the above two types of coded voice data can be selectively played back.

If it is confirmed that the two types of coded voice data can be selectively played back, the process proceeds to step S304.
If it is confirmed that the two types of coded audio data cannot be selectively reproduced and only one of them can be reproduced, the process proceeds to step S305.

(Step S304)
When it is confirmed that the two types of coded voice data can be selectively played back, in step S304, the control unit 401 of the information processing apparatus 400 determines the MPEG4 AAC LC coded voice data and the MPEG4 ALS coded voice data. The display information for allowing the user (viewer) to select the two audio data of the above is presented, and the selection information by the user is input.

(Step S305)
When the selection information from the user is input in step S304, or
If it is confirmed in step S303 that the two types of coded audio data cannot be selectively reproduced and only one of them can be reproduced, the process proceeds to step S305.

In step S305, the control unit 401 of the information processing apparatus 400 receives one reproducible voice data or voice data selected by the user.
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
It is determined which of these voice data is used.

One playable audio data, or audio data selected by the user,
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
If is, the process proceeds to step S306.
On the other hand, one reproducible audio data or audio data selected by the user is
(2) MPEG4 ALS (LATM / LOAS) coded audio data,
If is, the process proceeds to step S307.

(Step S306)
One playable audio data, or audio data selected by the user,
(1) MPEG4 AAC LC (LATM / LOAS) coded audio data,
In the case of, the control unit 401 of the information processing apparatus 400 executes the decoding / reproduction process in step S306 by applying the codec corresponding to the MPEG4 AAC LC (LATM / LOAS) coded audio data.

(Step S307)
On the other hand, one reproducible audio data or audio data selected by the user is
(1) MPEG4 ALS (LATM / LOAS) coded audio data,
In the case of, the control unit 401 of the information processing apparatus 400 executes the decoding / reproduction process in step S307 by applying the codec corresponding to the MPEG4 ALS (LATM / LOAS) coded audio data.

[9. About the configuration example of the information processing device]
Next, a hardware configuration example of an information processing device applicable as an information processing device for executing data recording on an information recording medium and data reproduction from the information recording medium will be described with reference to FIG. 34.

The CPU (Central Processing Unit) 601 functions as a data processing unit that executes various processes according to a program stored in a ROM (Read Only Memory) 602 or a storage unit 608. For example, the process according to the sequence described in the above-described embodiment is executed. The RAM (Random Access Memory) 603 stores programs and data executed by the CPU 601. These CPU 601, ROM 602, and RAM 603 are connected to each other by a bus 604.

The CPU 601 is connected to an input / output interface 605 via a bus 604, and an input unit 606 consisting of various switches, a keyboard, a mouse, a microphone, etc., and an output unit 607 consisting of a display, a speaker, etc. are connected to the input / output interface 605. There is. The CPU 601 executes various processes in response to a command input from the input unit 606, and outputs the process results to, for example, the output unit 607.

The storage unit 608 connected to the input / output interface 605 is composed of, for example, a hard disk or the like, and stores a program executed by the CPU 601 and various data. The communication unit 609 functions as a transmission / reception unit for data communication via a network such as the Internet or a local area network, and further as a transmission / reception unit for broadcast waves, and communicates with an external device.

The drive 610 connected to the input / output interface 605 drives a removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card, and records or reads data.

[10. Summary of the structure of this disclosure]
As described above, the embodiments of the present disclosure have been described in detail with reference to the specific embodiments. However, it is self-evident that those skilled in the art may modify or substitute the examples without departing from the gist of the present disclosure. That is, the present invention has been disclosed in the form of an example and should not be construed in a limited manner. In order to judge the gist of this disclosure, the column of claims should be taken into consideration.

The technique disclosed in the present specification can have the following configuration.
(1) It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or the SPAV format, which is a data recording format for an information recording medium.
The data processing unit
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
An information processing device that executes a process of recording voice identification information that can identify which of the voice data (a) and (b) is in a database file specified in BDAV format or SPAV format.

(2) The data processing unit is
The information processing apparatus according to (1), which records the voice identification information in a clip information file.

(3) The data processing unit is
The information processing apparatus according to (1) or (2), wherein the voice identification information is extracted from the voice data storage packet and recorded in the database file.

(4) The data processing unit is
The information processing apparatus according to (1) or (2), wherein the voice object type (audioObjectType) recorded in the voice data storage packet is extracted and recorded in the database file as the voice identification information.

(5) The data processing unit is
The information processing apparatus according to (1) or (2), wherein the voice identification information is extracted from the MMT package table (MPT) and recorded in the database file.

(6) The data processing unit is
The information processing apparatus according to (1) or (2), wherein the stream content (stream_content) recorded in the MMT package table (MPT) is extracted and recorded in the database file as the voice identification information.

(7) The data processing unit is
The voice recognition information is stored in the attribute information recording area of the same coding type (stream_coding_type) in the stream coding information [Stream Coding Info] recording area of the clip information file.
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
The information processing apparatus according to any one of (1) to (6), which records voice identification information that enables identification of which voice data is (a) or (b).

(8) The information processing apparatus according to (7), wherein the same coding type (stream_coding_type) is 0x11.

(9) It has a data processing unit that executes reproduction processing of recorded data of an information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The data processing unit
It is configured to execute the reproduction process of the MMT format data recorded on the information recording medium by using the recorded information of the playlist file and the clip information file which are the database files specified in the BDAV format or the SPAV format.
The data processing unit
The audio data to be played is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
An information processing device that acquires voice identification information indicating which data (a) or (b) is from the database file and executes voice data decoding processing according to the acquired information.

(10) The data processing unit is
The information processing apparatus according to (9), which acquires the voice identification information from a clip information file.

(11) The data processing unit is
The information processing apparatus according to (9) or (10), wherein the voice identification information is acquired from an attribute information recording area of the same coding type (stream_coding_type) in the stream coding information [StreamCodingInfo] recording area of the clip information file.

(12) The information processing apparatus according to (11), wherein the same coding type (stream_coding_type) is 0x11.

(13) The data processing unit is
Based on the voice recognition information obtained from the database file,
Playable audio data
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
When it is determined that the data are the two types of data (a) and (b) above,
The information processing apparatus according to any one of (9) to (12), which outputs display information for allowing the user to select audio data to be reproduced.

(14) The data processing unit is
The information processing apparatus according to (13), wherein user selection information for the display information is input, and audio data to be reproduced is selected according to the input selection information.

(15) An information recording medium that records recorded data according to the BDAV format or SPAV format.
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
It has a configuration in which the voice identification information that enables identification of which of the voice data (a) and (b) is recorded is recorded in a database file specified in BDAV format or SPAV format.
An information recording medium that allows the playback device to identify the type of voice data to be played back according to the voice identification information recorded in the database file.

(16) An information recording medium on which recorded data according to the BDAV format or SPAV format is recorded.
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
It has a database file specified in BDAV format or SPAV format that contains voice identification information that makes it possible to identify which of the voice data (a) and (b) is.
An information recording medium in which a playback device can identify the type of voice data to be played back according to the voice identification information of the database file.

(17) An information processing method executed by an information processing device.
The information processing device is
It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or SPAV format, which is a data recording format for an information recording medium.
The data processing unit
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
An information processing method for executing a process of recording voice identification information that can identify which of the voice data (a) and (b) is in a database file specified in BDAV format or SPAV format.

(18) An information processing method executed by an information processing device.
The information processing device is
It has a data processing unit that executes the reproduction processing of the recorded data of the information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The data processing unit
Using the recorded information of the playlist file and the clip information file, which are database files specified in the BDAV format or the SPAV format, the MMT format data recorded in the information recording medium is reproduced.
In the reproduction process, the audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
An information processing method for acquiring voice identification information indicating which data (a) or (b) is from the database file and executing a voice data decoding process according to the acquired information.

(19) A program that executes information processing to be executed in an information processing device.
The information processing device is
It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or SPAV format, which is a data recording format for an information recording medium.
The program is installed in the data processing unit.
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
A program for executing a process of recording voice identification information that can identify which of the voice data (a) and (b) is in a database file specified in BDAV format or SPAV format.

(20) A program that executes information processing to be executed in an information processing device.
The information processing device is
It has a data processing unit that executes the reproduction processing of the recorded data of the information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The program is installed in the data processing unit.
Using the recorded information of the playlist file and the clip information file, which are database files specified in the BDAV format or the SPAV format, the reproduction process of the MMT format data recorded on the information recording medium is executed.
In the reproduction process, the audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
A program that acquires voice identification information indicating which data (a) or (b) is from the database file, and decodes the voice data according to the acquired information.

Further, the series of processes described in the specification can be executed by hardware, software, or a composite configuration of both. When executing processing by software, install the program that records the processing sequence in the memory in the computer built in the dedicated hardware and execute it, or execute the program on a general-purpose computer that can execute various processing. It can be installed and run. For example, the program can be pre-recorded on a recording medium. In addition to installing the program on a computer from a recording medium, the program can be received via a network such as a LAN (Local Area Network) or the Internet and installed on a recording medium such as a built-in hard disk.

It should be noted that the various processes described in the specification are not only executed in chronological order according to the description, but may also be executed in parallel or individually as required by the processing capacity of the device that executes the processes. Further, in the present specification, the system is a logical set configuration of a plurality of devices, and the devices having each configuration are not limited to those in the same housing.

As described above, according to the configuration of one embodiment of the present disclosure, a configuration is realized in which it is possible to quickly confirm whether the media recording MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data. To.
Specifically, for example, a clip information file recording audio identification information indicating whether the MMT format audio data to be recorded on the media is MPEG4 AAC LC audio data or MPEG4 ALS audio data is generated and stored on the media. Record. The playback device identifies whether the audio data to be reproduced is MPEG4 AAC LC audio data or MPEG4 ALS audio data based on the audio identification information recorded in the clip information file, and rapidly decodes the audio data. Playback can be performed.
With this configuration, it is possible to quickly confirm whether the media recording MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data.

20 Transmitter 21 Broadcast server 22 Data distribution server 30 Information processing device 31 Recording / playback device 32 TV
33 PC
34 Mobile terminal 40 Information recording medium (media)
41 BD
42 HDD
43 Flash memory 300 Information processing device 301 Data input unit 302 User input unit 303 Control unit 304 Storage unit 305 Demultiplexer 306 Recording data generation unit 307 Recording unit 308 Drive 311 Subtitle data generation unit 312 Image data generation unit 313 Audio data generation unit 314 Auxiliary information generation unit 315 multiplexer 316 database file generation unit 320 information recording medium 400 information processing device 401 control unit 402 user input unit 403 drive 404 recording / playback unit 405 storage unit 406 playback processing unit 407 input / output I / F
411 Demultiplexer 412 Subtitle data generation unit 413 Image data generation unit 414 Audio data generation unit 415 Auxiliary information generation unit 416 Output data generation unit 510 Information recording medium 520 Output device (display unit + speaker)
601 CPU
602 ROM
603 RAM
604 Bus 605 I / O interface 606 Input section 607 Output section 608 Storage section 609 Communication section 610 Drive 611 Removable media

Claims (18)

It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or SPAV format, which is a data recording format for an information recording medium.
The data processing unit
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
An information processing device that executes a process of recording voice identification information that can identify which of the voice data (a) and (b) is in a database file specified in BDAV format or SPAV format. The data processing unit
The information processing apparatus according to claim 1, wherein the voice identification information is recorded in a clip information file. The data processing unit
The information processing apparatus according to claim 1, wherein the voice identification information is extracted from the voice data storage packet and recorded in the database file. The data processing unit
The information processing apparatus according to claim 1, wherein the voice object type (audioObjectType) recorded in the voice data storage packet is extracted and recorded in the database file as the voice identification information. The data processing unit
The information processing apparatus according to claim 1, wherein the voice identification information is extracted from the MMT package table (MPT) and recorded in the database file. The data processing unit
The information processing apparatus according to claim 1, wherein the stream content (stream_content) recorded in the MMT package table (MPT) is extracted and recorded in the database file as the voice identification information. The data processing unit
The voice recognition information is stored in the attribute information recording area of the same coding type (stream_coding_type) in the stream coding information [Stream Coding Info] recording area of the clip information file.
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
The information processing apparatus according to claim 1, wherein the voice identification information that makes it possible to identify which of the voice data (a) and (b) is. The information processing apparatus according to claim 7, wherein the same coding type (stream_coding_type) is 0x11. It has a data processing unit that executes the reproduction processing of the recorded data of the information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The data processing unit
It is configured to execute the reproduction process of the MMT format data recorded on the information recording medium by using the recorded information of the playlist file and the clip information file which are the database files specified in the BDAV format or the SPAV format.
The data processing unit
The audio data to be played is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
An information processing device that acquires voice identification information indicating which data (a) or (b) is from the database file and executes voice data decoding processing according to the acquired information. The data processing unit
The information processing apparatus according to claim 9, wherein the voice identification information is acquired from the clip information file. The data processing unit
The information processing apparatus according to claim 9, wherein the voice identification information is acquired from an attribute information recording area of the same coding type (stream_coding_type) in the stream coding information [StreamCodingInfo] recording area of the clip information file. The information processing apparatus according to claim 11, wherein the same coding type (stream_coding_type) is 0x11. The data processing unit
Based on the voice recognition information obtained from the database file,
Playable audio data
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
When it is determined that the data are the two types of data (a) and (b) above,
The information processing device according to claim 9, which outputs display information that causes the user to select audio data to be reproduced. The data processing unit
The information processing apparatus according to claim 13, wherein user selection information for the display information is input, and audio data to be reproduced is selected according to the input selection information. It is an information processing method executed in an information processing device.
The information processing device is
It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or SPAV format, which is a data recording format for an information recording medium.
The data processing unit
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
An information processing method for executing a process of recording voice identification information that can identify which of the voice data (a) and (b) is in a database file specified in BDAV format or SPAV format. It is an information processing method executed in an information processing device.
The information processing device is
It has a data processing unit that executes the reproduction processing of the recorded data of the information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The data processing unit
Using the recorded information of the playlist file and the clip information file, which are database files specified in the BDAV format or the SPAV format, the MMT format data recorded in the information recording medium is reproduced.
In the reproduction process, the audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
An information processing method for acquiring voice identification information indicating which data (a) or (b) is from the database file and executing a voice data decoding process according to the acquired information. It is a program that executes information processing to be executed in an information processing device.
The information processing device is
It has a data processing unit that inputs MMT format data and generates recorded data according to the BDAV format or SPAV format, which is a data recording format for an information recording medium.
The program is installed in the data processing unit.
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
A program for executing a process of recording voice identification information that can identify which of the voice data (a) and (b) is in a database file specified in BDAV format or SPAV format. It is a program that executes information processing to be executed in an information processing device.
The information processing device is
It has a data processing unit that executes the reproduction processing of the recorded data of the information recording medium.
The information recording medium is an information recording medium that stores data in which MMT format data is recorded according to the BDAV format or the SPAV format.
The program is installed in the data processing unit.
Using the recorded information of the playlist file and the clip information file, which are database files specified in the BDAV format or the SPAV format, the reproduction process of the MMT format data recorded on the information recording medium is executed.
In the reproduction process, the audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) coded audio data,
(B) MPEG4 ALS (LATM / LOAS) coded audio data,
A program that acquires voice identification information indicating which data (a) or (b) is from the database file, and decodes the voice data according to the acquired information.

Images