JPWO2018216424A1 - Information processing apparatus, information recording medium, information processing method, and program - Google Patents

Abstract

It is possible to realize a configuration in which it is possible to quickly confirm whether the media recording MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data. A clip information file that records audio identification information indicating whether the MMT format audio data to be recorded on the medium is MPEG4 AAC LC audio data or MPEG4 ALS audio data is generated and recorded on the medium. The playback device identifies, based on the audio identification information recorded in the clip information file, whether the audio data to be reproduced is MPEG4 AAC LC audio data or MPEG4 ALS audio data, and quickly decodes the audio data. Playback can be performed.

Description

  The present disclosure relates to an information processing device, an information recording medium, an information processing method, and a program. More specifically, an information processing apparatus capable of inputting MMT (MPEG Media Transport) format data, which is being standardized as a future data transmission standard for broadcast waves and the like, recording the same on a medium, and reproducing the information, an information recording apparatus The present invention relates to a medium, an information processing method, and a program.

  Currently, standardization for realizing data transmission of high-quality images, such as broadcasting of 4K images and 8K images, is being promoted. One of them is a data distribution method using an MMT (MPEG Media Transport) format. Examination is underway.

  The MMT format includes control information (SI: Signaling Information (SI) including various management information such as control information and attribute information, such as coded data constituting content, such as an image (Video), audio (Audio), and subtitle (Subtitle). Signaling information)) defines a data transfer method (transport format) for transmitting data such as broadcast waves and networks.

  The MMT format is scheduled to be used for broadcasting next-generation content such as 4K images and high dynamic range (HDR) images.

The MPEG-2TS format is often used as a current transmission format for images (Video), audio (Audio), subtitles, and the like, or as a data recording format for media.
Further, BDMV and BDAV standards (formats) are widely used as recording / reproduction application standards (formats) corresponding to the MPEG-2TS format.

It should be noted that BDMV and BDAV are application standards for data recording and reproduction mainly using BD (Blu-ray (registered trademark) Disc), but these standards are not limited to BD, and other standards such as flash memory and HD The present invention is also applicable to data recording and reproduction using media other than BD.
A data recording / reproducing processing configuration using a BD is described in, for example, Japanese Patent Application Laid-Open No. 2011-023071.

BDMV is an application standard developed for, for example, a BD-ROM in which movie contents and the like are recorded in advance, and is widely used mainly in non-rewritable BD-ROMs such as package contents.
On the other hand, BDAV is a standard developed for the purpose of being mainly applied to data recording / reproducing processing using a rewritable BD-RE type disc, a once-recordable BD-R type disc, and the like. The BDAV is used, for example, for recording and reproducing a video taken by a user with a video camera or the like and for recording and reproducing a television broadcast.

  In order to record the distribution content according to the above-mentioned MMT format on an information recording medium (media) and to perform a process of reproducing the content from the medium using a BDAV format-compatible reproduction application, data is recorded according to the BDAV format. It is necessary to do.

Currently, discussions are underway on a configuration for extending the BDAV format and enabling recording and reproduction of MMT format data.
For example, when an information processing device such as a television receives distribution data according to the MMT format transmitted by a broadcast station or the like and records the received data on a recording medium such as a BD, a flash memory, or an HDD (hard disk), an image, Discussions are underway in the direction of recording data such as audio, caption data, and control information (SI) on a medium as a packet sequence of packets storing data in accordance with the MMT format.

  Specifically, discussions are proceeding in the direction of recording a packet sequence of an MMTP (MMT Protocol) packet or a TLV (Type Length Value) packet, which is an upper packet of the MMTP packet, on a medium.

  The MMTP packet and the TLV packet store reproduction data such as images, audio, subtitles, and control information (SI: Signaling Information) including various management information.

  For example, MMTP packets or TLV packets storing contents such as images, sounds, and subtitles are recorded on a recording medium such as a BD (Blu-ray (registered trademark) Disc), a flash memory or an HDD (hard disk), and the contents from the medium are recorded. In order to perform reproduction using the above-described BDAV format-compatible reproduction application, it is necessary to perform data recording in accordance with the BDAV format.

The BDAV format defines a database file such as a playlist file or a clip information file as a playback control information file, and a BDAV-compatible playback application performs data playback processing with reference to these playback control information files (database files). Execute.
Therefore, it is necessary to perform reproduction processing on the MMT format data using the reproduction control information recorded in the playlist file and the clip information file.

However, data distributed according to the MMT format does not include a playlist file or a clip information file defined by the BDAV format.
Therefore, in order to record the MMT format data on the medium and play back the content using the BDAV format compatible application, a process of generating a playlist file or a clip information file defined by the BDAV format and recording the generated file on the medium. Is required.
However, at present, this processing is not specified at present.

JP 2011-023071 A

  The present disclosure has been made, for example, in view of the above-described problems. The present disclosure is configured to input distribution data in accordance with the MMT format, generate a database file defined in the BDAV format, record the database file in a medium, and It is an object of the present invention to provide an information processing apparatus, an information recording medium, an information processing method, and a program which enable media recorded content to be reproduced using the database file of the present invention.

A first aspect of the present disclosure is:
A data processing unit for inputting MMT format data and generating recording data according to a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The data processing unit includes:
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing apparatus for executing a process of recording audio identification information that makes it possible to identify which of the above (a) and (b) the audio data is in a database file stipulated in the BDAV format or the SPAV format.

Further, a second aspect of the present disclosure includes:
A data processing unit that executes a reproduction process of the recording data of the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The data processing unit includes:
A configuration for executing reproduction processing of MMT format data recorded on the information recording medium by using recording information of a playlist file and a clip information file, which are database files defined in the BDAV format or the SPAV format,
The data processing unit includes:
The audio data to be played is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
The information processing apparatus acquires voice identification information indicating which of the above (a) and (b) the data is from the database file and executes a decoding process of the voice data according to the obtained information.

Further, a third aspect of the present disclosure includes:
An information recording medium on which recording data in accordance with a BDAV format or a SPAV format is recorded;
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
(A) or (b) a configuration in which audio identification information enabling identification of the audio data is recorded in a database file of BDAV format or SPAV format.
According to another aspect of the present invention, there is provided an information recording medium in which a reproducing apparatus is capable of identifying a type of audio data to be reproduced according to audio identification information recorded in the database file.

Further, a fourth aspect of the present disclosure includes:
An information recording medium on which recording data according to a BDAV format or a SPAV format is recorded;
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
A database file of a BDAV format or a SPAV format definition including audio identification information that makes it possible to identify which of the above (a) and (b) audio data,
A playback device is provided on an information recording medium that is capable of identifying the type of audio data to be played according to the audio identification information of the database file.

Further, a fifth aspect of the present disclosure includes:
An information processing method executed in the information processing apparatus,
The information processing device,
A data processing unit for inputting MMT format data and generating recording data according to a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The data processing unit includes:
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
The present invention is directed to an information processing method for executing a process of recording the audio identification information that makes it possible to identify which of the above (a) and (b) the audio data is in a database file stipulated in the BDAV format or the SPAV format.

Further, a sixth aspect of the present disclosure includes:
An information processing method executed in the information processing apparatus,
The information processing device,
A data processing unit that executes a reproduction process of the recording data of the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The data processing unit includes:
Using the recording information of the playlist file and the clip information file, which are the database files of the BDAV format or the SPAV format, execute the reproduction process of the MMT format data recorded on the information recording medium,
At the time of the reproduction process, audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing method for acquiring audio identification information indicating which of the above (a) and (b) the data is from the database file and executing a decoding process of the audio data according to the acquired information.

Further, a seventh aspect of the present disclosure includes:
A program for executing information processing executed in the information processing apparatus,
The information processing device,
A data processing unit for inputting MMT format data and generating recording data according to a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The program, the data processing unit,
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
The program is for executing a process of recording the audio identification information which makes it possible to identify which of the above (a) and (b) the audio data is in a database file of BDAV format or SPAV format.

Further, an eighth aspect of the present disclosure includes:
A program for executing information processing executed in the information processing apparatus,
The information processing device,
A data processing unit that executes a reproduction process of the recording data of the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The program, the data processing unit,
Using the recording information of the playlist file and the clip information file, which are the database files of the BDAV format or the SPAV format, the reproducing process of the MMT format data recorded on the information recording medium is executed,
At the time of the reproduction process, audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
The program is to acquire from the database file audio identification information indicating which of the above (a) and (b) data, and to perform audio data decoding processing according to the acquired information.

  The program of the present disclosure is, for example, a program that can be provided to an information processing device or a computer system that can execute various program codes by a storage medium or a communication medium provided in a computer-readable format. By providing such a program in a computer-readable format, processing according to the program is realized on an information processing device or a computer system.

  Further objects, features, and advantages of the present disclosure will become apparent from the following detailed description based on the embodiments of the present disclosure and the accompanying drawings. In this specification, a system is a logical set configuration of a plurality of devices, and is not limited to a configuration in which devices of each configuration are in the same housing.

According to the configuration of the embodiment of the present disclosure, a configuration is realized in which it is possible to quickly confirm whether the media recording MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data.
More specifically, for example, a clip information file that records audio identification information indicating whether the MMT format audio data to be recorded on the medium is MPEG4 AAC LC audio data or MPEG4 ALS audio data is generated, and the clip information file is generated on the medium. Record. The playback device identifies whether the audio data to be played back is MPEG4 AAC LC audio data or MPEG4 ALS audio data based on the audio identification information recorded in the clip information file, and quickly decodes the audio data. Playback can be performed.
With this configuration, a configuration is realized in which it is possible to quickly confirm whether the media-recorded MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data.
It should be noted that the effects described in the present specification are merely examples and are not limited, and may have additional effects.

FIG. 11 is a diagram for describing a usage configuration example of an information processing device that executes a process of the present disclosure. FIG. 3 is a diagram illustrating an MMT format. FIG. 3 is a diagram for describing an example of an image data storage configuration according to an MMT format. It is a figure explaining a BDAV format. FIG. 9 is a diagram for describing an example of a data reproduction process according to the BDAV format. FIG. 3 is a diagram illustrating an MPEG-2TS format. FIG. 3 is a diagram illustrating an MMT format. It is a figure explaining a SPAV format. FIG. 9 is a diagram illustrating a processing example of recording data received from a broadcast station or the like as an MMTP packet sequence that is MMT format data on an information recording medium (media). FIG. 11 is a diagram illustrating a process example of recording data received from a broadcast station or the like as an TLV packet sequence storing MMTP packets that are MMT format data on an information recording medium (media). FIG. 7 is a diagram for describing a processing example when MMT format data is recorded as BDAV format data. It is a figure showing the data composition (syntax) of a clip information file. It is a figure which shows the data structure (syntax) of the program information [ProgramInfo ()] of a clip information file. FIG. 4 is a diagram illustrating an example of a data configuration of coding information of a clip information file. FIG. 8 is a diagram for describing an example of data recording of audio information of a clip information file. FIG. 4 is a diagram illustrating a data configuration example of coding information of a clip information file in which identification information of audio data in the MMT format is recorded. FIG. 5 is a diagram for describing an example of MMT format audio identification information recorded in a clip information file. FIG. 4 is a diagram illustrating a configuration example of a voice data storage packet. FIG. 4 is a diagram illustrating a data configuration example of coding information of a clip information file in which identification information of audio data in the MMT format is recorded. FIG. 5 is a diagram for describing an example of MMT format audio identification information recorded in a clip information file. FIG. 3 is a diagram illustrating a data configuration (syntax) of an MMT package table (MPT). FIG. 11 is a diagram for describing a specific example of an asset type (asset_type) recorded in an MMT package table (MPT). FIG. 3 is a diagram illustrating audio attribute information recorded in an MMT package table (MPT). It is a figure showing the example of (M1) stream contents information recorded on an MMT package table (MPT). It is a figure which shows the specific example of (M2) component type recorded on MMT package table (MPT). It is a figure showing the example of (M3) sampling frequency recorded on a MMT package table (MPT). FIG. 3 is a diagram illustrating a configuration example of an information processing device that executes a data recording process on an information recording medium (media). FIG. 4 is a flowchart illustrating a processing sequence of a data recording process on an information recording medium (media). FIG. 4 is a flowchart illustrating a processing sequence of a data recording process on an information recording medium (media). FIG. 4 is a flowchart illustrating a processing sequence of a data recording process on an information recording medium (media). FIG. 3 is a diagram illustrating a configuration example of an information processing device that executes a process of reproducing data from an information recording medium (media). It is a figure showing the flow chart explaining the processing sequence of the data reproduction processing from the information recording medium (media). It is a figure showing the flow chart explaining the processing sequence of the data reproduction processing from the information recording medium (media). FIG. 3 is a diagram for describing a hardware configuration example of an information processing device applied to the processing of the present disclosure.

Hereinafter, details of an information processing device, an information recording medium, an information processing method, and a program of the present disclosure will be described with reference to the drawings. The description will be made according to the following items.
1. 1. Configuration example of communication system 2. About MMT (MPEG Media Transport) format 3. About BDAV format and SPAV format 4. Processing when MMT format data is recorded in accordance with BDAV format 5. About audio data according to MMT format Recording example of audio identification information in clip information file 6-1. (Embodiment 1) Embodiment in which audio identification information recorded in an audio data storage packet is acquired and recorded in a clip information file 6-2. (Embodiment 2) Embodiment in which audio identification information recorded in an MMT package table (MPT) is acquired and recorded in a clip information file. 7. Configuration and processing of information processing device that executes data recording processing on information recording medium 8. Configuration and processing of information processing device that executes data reproduction processing from information recording medium 9. Configuration example of information processing apparatus Summary of configuration of the present disclosure

[1. Configuration Example of Communication System]
First, an example of a communication system, which is an example of a usage configuration of an information processing device that executes the processing of the present disclosure, will be described with reference to FIG.
The information processing apparatus 30 illustrated in FIG. 1 mounts a medium such as a BD (Blu-ray (registered trademark) Disc), a flash memory, and a hard disk (HDD), performs a data recording process on the mounted medium, and performs processing from the mounted medium. And data copy processing for other media.

The data recorded on the medium by the information processing device 30 is, for example, transmission content provided by the transmission device 20 such as a broadcast station (broadcast server) 21 or a data distribution server 22. Specifically, it is a broadcast program or the like provided by a television station.
These transmission contents are transmitted from the transmission device 20 to the information processing device 30 via a broadcast wave or a network such as the Internet.

  The information processing device 30 is, for example, a recording / reproducing device 31, a television 32, a PC 33, a portable terminal 34, and the like. These information processing devices are, for example, a BD (Blu-ray (registered trademark) Disc) 41, an HDD (hard disk). Various media such as the flash memory 42 and the flash memory 43 are mounted, and a data recording process for these media, a process of editing media recorded data, a process of reproducing data from media, and a process of copying data between media are performed.

Data transmission from the transmission device 20 to the information processing device 30 is performed according to an MMT (MPEG Media Transport) format.
The MMT format is a data transfer method (transport format) for transmitting encoded data, which is content configuration data, such as an image (Video), audio (Audio), and subtitles (Subtitle), via a broadcast wave or a network. It is specified.

  The transmission device 20 encodes the content data, generates a data file including the encoded data and the metadata of the encoded data, and stores the generated encoded data in an MMTP (MMT Protocol) packet specified in the MMT. Transmit via broadcast waves or network.

  The data provided by the transmitting device 20 to the information processing device 30 includes, in addition to reproduction target data such as images, sounds, subtitles, and the like, control information configured by various management information such as guide information such as a program guide, notification information, and control messages. Information (SI: Signaling Information (signaling information)).

[2. MMT (MPEG Media Transport) Format]
As described above, data transmission from the transmission device 20 to the information processing device 30 is performed in accordance with the MMT (MPEG Media Transport) format.
The MMT (MPEG Media Transport) format will be described with reference to FIG.

FIG. 2 is a diagram showing a stack model in the MMT format.
In the MMT stack model shown in FIG. 2, a physical layer (PHY) is at the lowest layer. The physical layer is divided into a broadcast (Broadcasting) layer for performing a broadcast-based process and a broadband (Broadband) layer for performing a network-based process.
MMT enables processing using two communication networks, a broadcasting system and a network system.

  As a higher layer of the physical layer (PHY), there is a TLV (Type Length Value) layer. TLV is a format definition layer that defines a multiplexing method for IP packets. A plurality of IP packets are multiplexed and transmitted as TLV packets. The TLV-SI is a transmission layer of control information (SI) such as a control message according to the TLV format.

The control information (SI) includes setting information necessary for receiving and reproducing the content (program) on the information processing device 30 side, guide information such as a program guide, notification information, control information, and management information. .
The control information (SI) stored in the TLV packet for which the processing is generated in the TLV layer is the TLV-SI, which is mainly configured by the control information regarding the reception processing.
The control information (SI) stored in the MMTP packet, which is a packet generated according to the MMT protocol (MMTP), is the MMT-SI shown in the uppermost layer, and is mainly configured by control information relating to reproduction control.

A UDP / IP layer is set on the TLV layer.
The UDP / IP layer, which can be divided into an IP layer and a UDP layer in detail, is a layer that defines transmission for storing a UDP packet in a payload of the IP packet.
An MMT layer and a File delivery method layer are set on the UDP / IP layer.
The setting is such that the case where the MMTP packet is stored in the IP packet and transmitted, and the system where the data is transmitted as the IP packet using the File delivery method which is the data transmission method without using the MMTP packet, can be used together.

The following layers are set on the MMT layer.
A layer of image (Video) data, which is encoded image data according to HEVC (High Efficiency Video Coding), which is an image coding standard.

A speech coding standard,
(1) Encoded audio data according to MPEG4 AAC LC (Advanced Audio Coding Low Complexity), or
(2) encoded audio data according to MPEG4 ALS (Audio Loss Coding);
A layer of audio (Audio) data encoded according to these audio encoding standards.

further,
Caption (Subtitle) data, which is coded caption data according to TTML (Timed Text Markup Language), which is a caption coding standard;
Control information (MMT-SI) transmitted using an MMTP packet,
Various applications written according to HTML5 (HyperText Markup Language 5),
Each of these data is stored in an MMTP packet and transmitted.

  The control information (MMT-SI) is control information (signaling information) transmitted in an MMTP packet, and includes setting information necessary for reproducing the content (program) on the information processing device 30 side, and a program guide and the like. It is composed of various management information such as guidance information, notification information, control information and the like.

The time information (NTP: Network Time Protocol) is absolute time information and is directly stored and transmitted in a UDP packet.
Other data delivery services (Data service), content download, etc. (Content download, etc.) can be delivered using a file delivery method different from MMT.

  As shown in FIG. 2, control information (MMT-SI) including various management information such as images, audio, subtitles, various notification information and control information, and applications are transmitted by MMTP packets.

A specific configuration example of the MMTP packet will be described with reference to FIG.
FIG. 3 shows the following four types of data configuration examples.
(A) MPU (Media Presentation Unit)
(B) MMTP Payload (c) MMTP Packet (d) TLV Packet

  (D) A TLV packet is a packet transmitted via a broadcast wave or a network, and header information of a UDP header, an IP header, and a TLV header is set in the TLV packet. The TLV packet is set as an individual packet for each data type.

That is, one type of data is stored in the TLV payload of one TLV packet. Specifically, for example, an image (V), a sound (A), a caption (S), or control information (SI) including various management information is individually stored.
The control information (SI) includes control information (MMT-SI) stored in an MMTP packet and control information (TLV-SI) transmitted in a TLV packet, which are stored in different individual TLV packets. .

An example of the TLV payload, which is the payload of the TLV packet, is the MMTP packet shown in FIG.
The MMTP packet shown in FIG. 3C is composed of an MMTP header and an MMTP payload.

  One type of data is stored in the MMTP payload of one MMTP packet. Specifically, for example, the image (V), the audio (A), the caption (S), and the control information (MMT-SI) stored in the MMTP packet, any one of these data is an individual MMTP packet. Is stored in

FIGS. 3A and 3B show a detailed configuration of image data stored in the MMTP payload of the MMTP packet shown in FIG. 3C.
FIG. 3B shows only the MMTP packets shown in FIG. 3C in which the MMTP payload is the image data (V).
The MMTP payload shown in FIG. 3B includes a header and a data unit.

As shown in FIG. 3A, the data unit stores image data and the following various parameters.
AU Delimiter (Access Unit Delimiter)
SPS (Sequence Parameter Set)
PPS (Picture Parameter Set)
SEIs (Supplemental Enhancement Information)
These parameters are parameters used for image display.

  An MPU (Media Presentation Unit) shown in FIG. 3A is one data processing unit of reproduction target data such as an image, a sound, and a caption in the MMT format. The example shown in FIG. 3A is an example of an MPU of image data, and is the same unit as a GOP (Group of Pictures) as a so-called encoding and decoding processing unit.

In this way, for example, as shown in FIG. 3A, the image data is divided into parameters defined in the MMT format and image configuration data, stored in the MMTP payload shown in FIG. It is configured as an MMTP packet shown in c).
Further, the MMTP packet is set as a payload of the TLV packet shown in FIG. 3D, and the TLV packet is transmitted via a broadcast wave or a network.

It should be noted that MMTP packets and TLV packets are set and transmitted for each data type such as audio data, subtitle data, and MMT-SI data.
The TLV-SI is stored in the TLV packet without being stored in the MMTP packet and transmitted.

[3. About BDAV format and SPAV format]
Next, this is a recording data format for recording and reproducing distribution content according to the above-described MMT format on a medium such as a BD (Blu-ray (registered trademark) Disc), a flash memory, or an HDD (hard disk). The BDAV format and the SPAV format will be described with reference to FIG.

For example, when reproducing content such as images, audio, subtitles, and the like from a medium such as a BD (Blu-ray (registered trademark) Disc), a flash memory, or an HDD, reproduction control information for performing reproduction processing of these contents. Or index information is required. The reproduction control information and the index information are generally called a database file.
The playback control information and the index information differ depending on the playback application that executes the playback process of the recording data on the medium.

  As described above, there are BDMV and BDAV standards (data recording formats) as current recording / reproducing application standards (= data recording formats). These application standards are mainly formulated as data recording / reproducing application standards using BD (Blu-ray (registered trademark) Disc).

It should be noted that BDMV and BDAV are application standards for data recording and reproduction mainly using BDs, and are data recording formats (standards). These standards are not limited to BDs, and other standards other than BDs, such as flash memories, may be used. The present invention is also applicable to data recording and reproduction using media.
BDMV is an application standard developed for, for example, a BD-ROM in which movie contents and the like are recorded in advance, and is widely used mainly in non-rewritable BD-ROMs such as package contents.
On the other hand, BDAV is a standard developed for the purpose of being mainly applied to data recording / reproducing processing using a rewritable BD-RE type disc, a once-recordable BD-R type disc, and the like. The BDAV is used, for example, for recording and reproducing a video taken by a user with a video camera or the like and for recording and reproducing a television broadcast.

In order to perform a content reproduction process from a medium on which a distribution content according to the above-described MMT format is recorded by using a BDAV format-compatible reproduction application, it is necessary to perform data recording in accordance with the BDAV format.
As described above, the BDAV format defines a playlist file, a clip information file, and the like as a recording file of the playback control information, and the BDAV-compatible playback application stores the recording information of the playback control information file (database file). The data reproduction process is executed using the data.

FIG. 4 is a diagram showing an example of a directory structure of data recorded on the information recording medium (media) 40 in accordance with the BDAV format.
As shown in FIG. 4, various management information, reproduction control information, and files for storing reproduction target data are set in the directory.

The management information file includes, for example, an info file (info), a menu file (menu), a mark file (mark), and the like shown in FIG. These mainly store title management information to be shown to the user.
Also, as the playback control information file,
Playlist file (playlist),
Clip information file (clipinf)
For example, these files are recorded.
Further, a clip AV stream file (stream) is recorded as a reproduction data storage file.

The playlist file is a file in which the order of content reproduction is specified in accordance with the program information of the reproduction program specified by the title, and has, for example, the specification information of a clip information file that records reproduction position information and the like.
The clip information file is a file specified by the playlist file, and has playback position information of the clip AV stream file and the like.

The clip AV stream file is a file storing AV stream data to be played back and management information. A clip AV stream file is composed of data to be reproduced, such as images, sounds, subtitles, and the like, and packets storing management information.
The management information specified in the MPEG-2TS format and recorded in the clip AV stream file includes, for example, PSI / SI (Program Specific Information / Service Information).

  Conventional broadcast data and network distribution data are MPEG-2TS format data composed of TS (Transport Stream) packets, but future data including high-definition images such as 4K and 8K images will be described above. It is expected to be MMT format data composed of MMTP packets.

FIG. 4 shows a clip AV stream file as a stream.
A stream file (nnnnn.m2ts) composed of MPEG-2 TS format data composed of TS packets,
MMT format data (nnnnnn.mmtv) composed of MMTP packets,
These two types of stream files are shown.

  In the directory example shown in FIG. 4, if the data received by the information processing device 30 is MPEG-2TS format data, it is recorded as it is on the medium as MPEG-2TS format data, and if the received data is MMT format data, , Is an example of a directory in a case of setting to record on a medium as MMT format data.

Note that a clip AV stream file for recording MMT format data on a medium is:
(1) Convert the MMT format to the MPEG-2TS format to generate a clip AV stream file, or
(2) generating a clip AV stream file composed of a packet sequence of packets storing data according to the MMT format;
These two types of processing are assumed.

At present, discussions are proceeding in the direction of the above-described process (2), that is, generating a clip AV stream file composed of a packet sequence of packets storing data according to the MMT format and recording the clip AV stream file on a medium.
More specifically, discussions are proceeding in the direction of recording as a packet sequence of an MMTP (MMT Protocol) packet or a TLV (Type Length Value) packet which is an upper packet of the MMTP packet.
This specific example will be described in detail later.

  The management information file, the playlist file, the clip information file, and these data files are storage files of management information applied to playback processing of images, sounds, subtitles, and the like, which are playback data stored in the clip AV stream file. These are files storing reproduction control information, attribute information of reproduction data, and the like, and are called database files.

The sequence for reproducing the content recorded on the information recording medium is as follows.
(A) First, a specific playlist is specified from the management information file by the reproduction application.
(B) A clip information file specified in the selected playlist is selected, and an AV stream or a command, which is playback data such as an image and a sound, is read from the clip AV stream file according to the recording data of the clip information file, The reproduction of the AV stream and the execution of the command are started.

FIG. 5 shows the following data recorded on the information recording medium (media) 40:
Playlist file,
Clip information file,
Clip AV stream file,
It is a figure explaining the correspondence of these data.

  An AV stream composed of data to be reproduced, such as images, sounds, and subtitles, which are actual data to be reproduced, is recorded as a clip AV stream (Clip AV Stream) file, and further, as management information and a reproduction control information file for these AV streams. , A playlist (PlayList) file and a clip information (Clip Information) file are defined.

These multiple categories of files, as shown in FIG.
A playlist layer including a playlist (PlayList) file;
A clip layer including a clip AV stream (Clip AV Stream) file and a clip information (Clip Information) file;
It can be divided into these two layers.

One clip AV stream (Clip AV Stream) file is associated with one clip information (Clip Information) file. These pairs are considered as one object, and these are put together into a clip (Clip) or clip. Call it a file.
Detailed information of data included in the clip AV stream file, for example, management information such as an EP map in which I picture position information of MPEG data is recorded is recorded in the clip information file.

Note that a clip AV stream (Clip AV Stream) file is composed of TS packets when the data is MPEG-2 TS format data.
If the data is MMT format data, the data is composed of MMTP packets.

  The clip information (Clip Information) file corresponds to, for example, the data position of the byte sequence data of the clip AV stream file and the reproduction time position of an entry point (EP) which is a reproduction start point when expanded on the time axis. It stores management information for acquiring a reproduction start position of data stored in the clip AV stream file, such as data.

The playlist has information indicating an access point corresponding to a reproduction start position or a reproduction end position of a clip (Clip) by a time stamp which is information on a time axis.
For example, it is possible to obtain the data read position of the clip AV stream file, that is, the address as the reproduction start point, by referring to the clip information file based on the time stamp indicating the position where the reproduction time has elapsed from the start point of the content. Become.
The clip information file is used to find, from the time stamp, address information at which decoding of a stream in the clip AV stream file should be started.

As described above, the playlist (PlayList) file has the reproduction section designation information for the reproducible data included in the clip (= clip information file + clip AV stream file) layer.
One or more play items (PlayItem) are set in the play list (PlayList) file, and each of the play items is a playback section for playable data included in a clip (= clip information file + clip AV stream file) layer. With the specified information.

As described above, a clip AV stream (Clip AV Stream) file in which data to be reproduced is stored is constituted by TS packets in the case of conventional MPEG-2 TS format data.
Further, in the case of high-definition image data such as 4K and 8K images whose use is expected to be expanded in the future, if the data is MMT format data, it is constituted by MMTP packets.
The MMT format and the MPEG-2TS format will be described with reference to FIGS.

First, the MPEG-2TS format will be described with reference to FIG.
In the MPEG-2TS format, encoded data and management information (PSI / SI), which are content configuration data, such as images (Video), audio (Audio), and subtitles (Subtitles), are stored in a recording medium (media). This is a format that defines a data storage format (container format) for encoded data and the like when transmitted via a network.

  The MPEG-2TS format is a format standardized in ISO13818-1, and is used, for example, for data recording on a BD (Blu-ray (registered trademark) Disc), digital broadcasting, and the like.

FIGS. 6A to 6C are diagrams showing the structure of MPEG-2TS format data.
FIG. 6A shown at the bottom shows the entire configuration of the format data of MPEG-2TS.
As shown in FIG. 6A, the MPEG-2TS format data is composed of a plurality of elementary streams.
An elementary stream is a unit set as one unit of, for example, an image, a sound, a caption, and the like.

As shown in FIG. 2B, one elementary stream (Elementary stream) is composed of one or a plurality of PES (Packetized Elementary stream) packets.
Specifically, one elementary stream (Elementary stream) is composed of one or more PES packets having a payload type (Payload_type) = 0x0 and having the same packet identifier (Packet_id).

One PES packet is configured by one or a plurality of TS packets as shown in FIG.
Specifically, one PES packet includes one or a plurality of TS packets having a payload type (Payload_type) = 0x0 and the same packet identifier (Packet_id).
The TS packet has a fixed length unlike the MMTP packet described above, and the packet size of one TS packet is fixed at 188 bytes.

Next, an MMT (MPEG Media Transport) format will be described with reference to FIG.
Regarding the MMT format, reference is first made to FIG. 3, but the explanatory diagram of the MMT format shown in FIG. 7 is a diagram for easily understanding the correspondence relationship with the MPEG-2TS format described with reference to FIG. 6. is there.

As described above, the MMT format is a data transfer method for transmitting encoded data, such as images (Video), audio (Audio), and subtitles, which are content configuration data, via broadcast waves or networks. (Transport format).
FIG. 7 is a diagram illustrating an MMT format which is a file format defined in ISO / IEC 23008-1.

FIGS. 7A to 7C show the structure of MMT format data.
FIG. 7A shown at the bottom shows the overall structure of MMT format data.
As shown in FIG. 7A, the MMT format data is composed of a plurality of media presentation units (MPUs).
The MPU is a unit that is set as one unit such as an image, a sound, and a caption. For example, in the case of an image, 1 MPU corresponds to 1 GOP (Group of picture) which is one MPEG compressed image unit.

One MPU is configured by one or a plurality of media fragment units (MFU) as shown in FIG. 7B.
Specifically, one MPU includes one or more MFUs having a payload type (Payload_type) = 0x0 (MPU) and the same packet identifier (Packet_id).

One MFU is composed of one or a plurality of MMTP packets as shown in FIG.
Specifically, one MFU includes one or more MMTP packets having a payload type (Payload_type) = 0x0 (MPU) and the same packet identifier (Packet_id).
MMTP packets are of variable length and can be set to various packet sizes.
Each MMTP packet is composed of a header (MMTP header) storing attribute information and the like, and a payload (MMTP payload) storing actual data of the encoded image and the like.

Note that there is a SPAV format as a format similar to the BDAV format. As described above, BDMV and BDAV are application standards for data recording / reproduction mainly using BD. On the other hand, the SPAV format is an application standard for recording and reproducing data mainly on a hard disk.
However, both the BDAV format and the SPAV format are formats that can be used for recording and reproduction using various media such as BDs, flash memories, and HDDs.

For SPAV format data, data recording and reproduction can be performed by the same processing as data recording and reproduction processing in the BDAV format. However, the SPAV format is partially different from the BDAV format in the file name setting.
FIG. 8 shows an example of a directory structure in the SPAV format.

  In the directory of the SPAV format shown in FIG. 8, various management information, playback control information, and storage files of playback target data are set as in the BDAV format described above with reference to FIG.

The management information file includes, for example, an info file (INFO), a menu file (MENU), a mark file (MARK), and the like shown in FIG. These mainly store title management information to be shown to the user.
Also, as the playback control information file,
Playlist file (PLAYLIST),
Clip information file (CLIPINF)
For example, these files are recorded.
Further, a clip AV stream file (STREAM) is recorded as a reproduction data storage file.

As shown in FIG. 8, the setting of the directory name and the extension of each file in the SPAV format is different from the BDAV format described with reference to FIG.
However, the data stored in each file and the role of each file are the same as in the BDAV format.

  In the following description of the embodiment, an example of processing for recording and reproducing MMT format data as BDAV format data will be described. However, in the embodiment described below, processing for recording and reproducing MMT format data as SPAV format data will be described. Is also applicable.

[4. Processing for Recording MMT Format Data According to BDAV Format]
Next, a process for recording MMT format data according to the BDAV format will be described.

As described above, the MMT format is a data distribution format used for 4K images and the like scheduled to be distributed by broadcast stations and the like in the future, and is a format according to the protocol stack described with reference to FIG. is there.
On the other hand, the BDAV format is a data recording format for media, and as described with reference to FIG. 4, a database file including a playback control information file such as a playlist file and a clip information file is defined.
The BDAV format is a data recording format and also supports a data recording / reproducing application standard. For reproducing data recorded on a medium according to the BDAV format, a reproducing process is executed using a BDAV format-compatible reproducing application. You.

  Therefore, in order to record the distribution content according to the MMT format on a medium and perform the content reproduction process from the recorded medium using a reproduction application compatible with the BDAV format, it is necessary to perform data recording according to the BDAV format. is necessary.

  As described above, at present, discussions are underway on rules for extending the BDAV format and enabling recording and reproduction of MMT format data.

As described above, a clip AV stream file when recording MMT format data on a medium is:
(1) Convert the MMT format to the MPEG-2TS format to generate a clip AV stream file, or
(2) generating a clip AV stream file composed of a packet sequence of packets storing data according to the MMT format;
These two types of processing are possible.

At present, discussions are proceeding in the direction of the above-described process (2), that is, generating a clip AV stream file composed of a packet sequence of packets storing data according to the MMT format and recording the clip AV stream file on a medium.
More specifically, discussions are proceeding in the direction of recording as a packet sequence of an MMTP (MMT Protocol) packet or a TLV (Type Length Value) packet which is an upper packet of the MMTP packet.

  For example, a case where an information processing device such as a recorder receives distribution data in accordance with the MMT format transmitted from a broadcast station or the like, and performs a process of recording the received data on a medium such as a BD, a flash memory, or an HDD (hard disk). , Images, audio, caption data, management information (SI), and the like, are recorded as they are as a packet sequence of packets storing data in accordance with the MMT format.

That is, the clip AV stream file [02001.0] set in the BDAV format shown in FIG. 4 or the SPAV format shown in FIG. mmtv etc.], a packet sequence of packets storing data in accordance with the MMT format is recorded.
Note that a clip AV stream file [02001. mmtv etc.], the recording apparatus generates a playlist file and a clip information file in which control information corresponding to MMT format data is set, and records the playlist file and the clip information file as playback control information files corresponding to MMT format data. Will be.

  The clip AV stream file storing the MMT format data is, specifically, an MMTP (MMT Protocol) packet, a TLV (Type Length Value) packet which is an upper packet of the MMTP packet, or any of these two types of packets. Can be recorded as a packet sequence.

A specific recording configuration example of the clip AV stream file storing the MMT format data will be described with reference to FIGS.
FIG. 9 is a diagram illustrating an example of processing for recording an MMTP (MMT Protocol) packet sequence according to the MMT format on a recording medium such as a BD, a flash memory, or an HDD (hard disk).

FIG. 9 shows the following three data.
(A) TLV packet sequence as broadcast distribution data (B) One TLV packet processed as received and reproduced data (C) MMTP packet sequence proposed as a configuration of media recording data

(A) The TLV packet sequence as broadcast distribution data is a sequence (sequence) of TLV packets having the MMT (MPEG Media Transport) format described above with reference to FIG.
This TLV packet sequence is transmitted from the transmitting device 20 such as a broadcasting station.

(B) One TLV packet processed as received reproduction data is one TLV packet received by the information processing device 30 such as a television or a recorder and subjected to reproduction processing. 4A shows a detailed configuration of one TLV packet forming the TLV packet sequence shown in FIG.
This is a TLV packet having the MMT (MPEG Media Transport) format described above with reference to FIG.

(C) The MMTP packet sequence shown as the configuration of the media recording data is the MMTP packet sequence currently proposed as the recording data for the medium.
The MMTP packet recorded on the medium is an MMTP packet which is part of the TLV packet, as can be understood from the dotted line indicating the correspondence with FIG. 9B, and includes the following elements. .
(A) MMTP packet header (MMTP_packet_header)
(B) MMTP packet data (MMTP_packet_data) (= payload)

The MMTP packet data (MMTP_packet_data) (= payload) is composed of the following elements.
(B1) MMTP payload header (MMTP_payload_header)
(B2) MMTP payload data (MMTP_payload_data)

  At present, one configuration proposed as recording data for an information recording medium (media) is to extract only MMTP packets, which are components of a TLV packet, as shown in FIG. It is a configuration to do.

  FIG. 10 is a view for explaining an example of processing for recording not a MMTP (MMT Protocol) packet but a packet sequence of a higher-order TLV packet storing an MMTP packet on a recording medium such as a BD, a flash memory, or an HDD (hard disk). It is.

FIG. 10 shows the following three data as in FIG.
(A) TLV packet sequence as broadcast distribution data (B) One TLV packet processed as received and reproduced data (C) TLV packet sequence proposed as a configuration of media recording data

(A) and (B) are the same data as described with reference to FIG.
(C) The TLV packet sequence shown as the configuration of media recording data is another example of a TLV packet sequence that is currently proposed as recording data for media.
The TLV packet recorded on the medium is a TLV packet including an MMTP packet, as can be understood from the dotted line indicating the correspondence with FIG. 10B, and includes the following elements.
(A) TLV packet header (TLV_header)
(B) TLV packet data (TLV_data) (= payload)

Thus, as a recording mode of the MMT format data on a medium such as a BD,
The packet sequence of the MMTP (MMT Protocol) packet described with reference to FIG.
A packet sequence of a TLV (Type Length Value) packet described with reference to FIG.
It is assumed that the packet is recorded as one of these packet sequences.

When the MMT format data is recorded on the medium with the settings shown in FIG. 9 or FIG. 10 and the reproduction process of the MMT format data is performed using a BDAV format compatible playback application, a BDAV format compatible playback control information file That is, the reproduction is performed using the playlist file and the clip information file.
The BDAV format is a data recording format and also complies with a data recording / reproducing application standard. Reproduction of data recorded on a medium according to the BDAV format is executed using a BDAV format-compatible reproducing application.

  The BDAV format defines a database file specific to the BDAV format, such as a playlist file and a clip information file, which are playback control information files, and a BDAV-compatible playback application stores recording information of these playback control information files (database files). The data reproduction process is executed using the data.

As described above, the database files such as the playlist file and the clip information file in the BDAV format are originally defined as files that can be generated based on the distribution data in the MPEG-2TS format.
Therefore, even if the distribution data according to the MMT format different from the MPEG-2TS format is recorded as it is in a playlist file or a clip information file specified by the current BDAV format, the data cannot be used by the current BDAV compatible playback application. It may be.

In order to record MMT format data on a medium and enable content playback using a BDAV format compatible application, a playlist file or clip compatible with the MMT format data must be recorded when the MMT format data is recorded on the medium. It is necessary to generate an information file and record it on a medium.
When reproducing MMT format data recorded on a medium, it is necessary to perform reproduction using a playlist file and a clip information file compatible with the MMT format data.

  Specifically, as shown in FIG. 11, a clip information file (nnnnnn.clpi) 52 corresponding to the clip AV stream file 51 storing the MMT format data and a playlist file (nnnnnn.rpls) 53 are generated, and the media ( (BD, flash memory, HDD, etc.) and use it for reproduction.

  When reproducing the clip AV stream file 51 storing the MMT format data recorded on the medium, the clip information file (nnnnnn.clpi) 52 corresponding to the clip AV stream file 51 storing the MMT format data and the playlist file (nnnn. rpls) 53 to perform the reproduction process.

However, as described above, data distributed according to the MMT format, which is distribution data of a broadcasting station, is not configured to include all recording data of a playlist file and a clip information file defined in the BDAV format.
Further, the clip AV stream file 51 storing the MMT format data has a data format different from that of the MPEG-2TS format data, and a playlist file having the same format as the playlist file and the clip information file corresponding to the MPEG-2TS format data. Even if a clip information file is used, there is a problem that correct reproduction processing cannot be executed.

  Therefore, in order to record the MMT format data on a medium and play back the content by using the BDAV format compatible application, it is necessary to control the playback of the clip AV stream file 51 storing the MMT format data. It is necessary to generate a playlist file or a clip information file having the data format described above and record it on a medium.

[5. Audio data according to MMT format]
As described above with reference to FIGS. 9 and 10, when recording MMT format data distributed from a broadcasting station as BDAV format or SPAV format data on a medium such as a BD, images, audio, subtitles, etc. , And data such as control information (SI) are recorded as, for example, an MMTP packet sequence or a TLV packet sequence.
These packet sequences are recorded as clip AV stream files defined in the BDAV format or SPAV format.

  Also, as described with reference to FIG. 11, when reproducing the reproduction data in the clip AV stream file 51 composed of the MMTP packet sequence or the TLV packet sequence storing the MMT format data recorded on the medium, It is necessary to perform a playback process using a clip information file (nnnn.clpi) 52 corresponding to the clip AV stream file 51 storing the MMT format data and a playlist file (nnnn.rpls) 53.

However, the clip information file and the playlist file defined in the current BDAV format and SPAV format are originally defined as playback control information corresponding to the MEG-2TS format data. It cannot be used as it is as control information.
Therefore, in order to record the MMT format data on the medium and play back the content using the application compatible with the BDAV format, a process of generating a playlist file or a clip information file defined by the BDAV format and recording the generated file on the medium is required. Required.

As described above with reference to FIG. 2, for example, the MMT format audio data distributed from a broadcast station includes, for example, data according to the following two different audio coding standards.
(1) encoded audio data according to MPEG4 AAC LC (Advanced Audio Coding Low Complexity);
(2) encoded audio data according to MPEG4 ALS (Audio Loss Coding);
The audio data distributed from the broadcasting station is at least one of the data according to the two different audio coding standards.

MPEG4 AAC LC is an improved encoding format based on MPEG2 AAC, and is an audio encoding format that achieves encoding delay reduction, low bit rate encoding, bit rate expandability, and the like.
On the other hand, MPEG4 ALS is an audio encoding format to which a lossless compression method (lossless compression) that does not cause data loss is applied, and enables reproduction of high-quality audio data.

The above two types of encoded audio data distributed in the MMT format are:
(LATM / LOAS) is distributed in a stream format.
LATM (Low Overhead Audio Transport Multiplex) is a specification of multiplexing processing (ISO / IEC14496-3),
LOAS (Low Overhead Audio Stream) is a specification (ISO / IEC14496-3) of a transfer method.

That is, the audio encoded data stream delivered in the MMT format is
(1) MPEG4 AAC LC (LATM / LOAS)
(2) MPEG4 ALS (LATM / LOAS)
One of the above two streams.

In addition, for one program, a setting for distributing only one of the audio data, that is,
A setting to deliver either MPEG4 AAC LC or MPEG4 ALS,
MPEG4 AAC LC, MPEG4 ALS, and these two types of audio data are distributed, and a setting that can be selected on the receiving side is possible.

For example, a transmission device such as a broadcasting station stores and distributes audio data in MMTP packets and TLV packets as described above with reference to FIG.
Whether the audio data stored in the packet is the AAC LC encoded audio data or the ALS encoded audio data is determined by, for example, an attribute data recording area in the packet storing the audio data, an MMT format, or the like. The corresponding control information (SI) is recorded in an MMT package table (MPT) or the like.

  A receiving device such as a television that receives and reproduces a broadcast wave, such as a television, refers to the recorded data in the packet and the MMT package table (MPT) to determine whether the data to be reproduced is AAC LC encoded audio data, It is possible to determine whether the data is ALS-encoded audio data, and perform a decoding process according to the determination result.

When MMT format data distributed from a broadcast station or the like is recorded on a medium such as a BD as BDAV format or SPAV format data, reproduction data such as images, sounds, subtitles, and data such as control information (SI) include: It is recorded as an MMTP packet sequence or a TLV packet sequence.
These packet sequences are recorded as clip AV stream files defined in the BDAV format or SPAV format.

The data reproducing procedure of the information processing apparatus (reproducing apparatus) for reproducing recorded data from the medium follows the following procedure as described above with reference to FIGS.
(A) First, a specific playlist is specified from the management information file by the reproduction application.
(B) A clip information file specified in the selected playlist is selected, and an AV stream or a command, which is playback data such as an image and a sound, is read from the clip AV stream file according to the recording data of the clip information file, The reproduction of the AV stream and the execution of the command are started.

  However, information for identifying the two different audio encoded data (MPEG4 AAC LC and MPEG4 ALS) corresponding to the above-mentioned MMT format is recorded in the playlist file or clip information file of the current BDAV format or SPAV format. It has not been.

Therefore, the playback device acquires the audio data storage packet from the clip AV stream file and refers to the recording data in the acquired packet, or as the control information (SI) recorded in the clip AV stream file. If the audio data in the packet is not referred to the MMT package table (MPT) of
(1) Whether the data is MPEG4 AAC LC encoded audio data,
(2) Whether the data is MPEG4 ALS encoded audio data,
It is not possible to confirm which of the above audio data is.

The decoding processing of these two different audio encoded data needs to be executed as different processing. That is, it is necessary to perform decoding using a codec corresponding to each audio encoding.
Therefore, when reproducing the audio data recorded on the medium, it is not possible to determine which codec to apply without referring to the recording data in the packet of the audio data storage packet or the MMT package table (MPT), There is a problem that the delay until the start of the reproduction process increases.

Further, as described above, MPEG2 AAC LC and MPEG4 ALS may be distributed as audio data for one program content.
When these two types of audio data are recorded on a medium, it is assumed that a process of allowing the user (viewer) to select the audio to be reproduced before starting the reproduction of the content from the medium.

However, even when such processing is performed, the audio data storage packet is acquired from the clip AV stream file and the recording data in the packet of the acquired audio data storage packet is referred to, or the audio data storage packet is included in the clip AV stream file. Unless the MMT package table (MPT) which is the recorded control information (SI) is referred to, it cannot be confirmed that two types of audio data are recorded.
There is a problem that such processing requires a great deal of processing time.

[6. Recording example of audio identification information for clip information file]
Hereinafter, an example in which audio identification information is recorded in a clip information file will be described as one configuration example that solves the above-described problem.

The configuration described below is
When a clip AV stream file recorded on a medium such as a BD is in the MMT format, audio data to be reproduced to which the clip information file is applied is added to a clip information file that is a reproduction control information file of the clip AV stream file.
(1) Whether the data is MPEG4 AAC LC encoded audio data,
(2) Whether the data is MPEG4 ALS encoded audio data,
This is a configuration in which audio identification information that enables identification of any of the above audio data is recorded.

First, the data configuration (syntax) of the clip information file will be described with reference to FIG.
As described above, information on data to be reproduced by applying the clip information file is recorded in the clip information file. Specifically, for example, it has playback position information of a clip AV stream file.

FIG. 12 is a diagram showing the data configuration (syntax) of one clip information file.
In the clip information file, information on reproduction data associated with the clip information is recorded. As shown in FIG. 12, for example, the following information is recorded.
Clip information [ClipInfo ()] 101,
Sequence information [SequenceInfo ()] 102,
Program information [ProgramInfo ()] 103,

In the clip information [ClipInfo ()] 101, attribute information of the AV stream file corresponding to the clip information file is recorded.
In the sequence information [SequenceInfo ()] 102, information on the reproduction sequence of the reproduction target data stored in the AV stream file corresponding to this clip information file is recorded.

The program information [ProgramInfo ()] 103 records information on a program (program_sequence) including definition information of a playback section and a time section of a clip AV stream played by the clip information file.
Details of the recording information of the program information [ProgramInfo ()] 103 will be described with reference to FIG.

FIG. 13 is a diagram illustrating a data configuration (syntax) of the program information [ProgramInfo ()].
Main data recorded in the program information [ProgramInfo ()] will be described.

(A) The number of program sequences [num_of_program_sequences] 111 records the number of program sequences (program_sequence) included in the clip information file.
(B) SPN program sequence start address [SPN_program_sequence_start [i]] 112 records the relative address of the place where the program sequence starts on the AV stream file.
(C) The program map PID [program_map_PID [i]] 113 records an identifier (PID) of a packet in which a map of the program sequence (program_sequence) is stored.

(D) In the stream PID [stream_PID] 114, an identifier (PID) of a packet storing a stream reproduced according to the program sequence of the clip information file is recorded.
(E) Stream coding information [StreamCodingInfo] 115 records coding (encoding) information of the stream to be reproduced.

  As described above, in the clip information file, various information necessary for reproducing the data stored in the clip AV stream file associated with the reproduction target is recorded.

FIG. 14 is a diagram showing the data configuration (syntax) of stream coding information [StreamCodingInfo] set in the program information [ProgramInfo ()] recording area of the clip information file.
The following data is recorded in the stream coding information [StreamCodingInfo].
(1) Image stream coding information 121,
(2) audio stream coding information 122;

Note that various types of encoding modes (coding types (stream_coding_type)) of an image stream and an audio stream recorded on an information recording medium (media) are allowed, and both the image and the audio correspond to each coding type. An identifier is defined in advance.
The images are associated with, for example, type identifiers 0x01, 0x02, 0x1B, etc., according to the coding type (encoding type).
The audio is associated with type identifiers 0x03, 0x04, 0x0F, 0x80, 0x81, etc. according to the coding type (encoding type).

For example,
Coding type 0x01 is an MPEG-1 image stream,
0x02 is an MPEG-2 image stream,
0x03 is an MPEG-1 audio stream,
These are the settings.

In the MMT format, HEVC encoding, which is an image encoding type not defined in the current BDAV format, is used.
A new coding type identifier is also assigned to this new coding type.

Similarly, for audio data, in the MMT format, audio encoded data that is not specified in the current BDAV format is used.
That is,
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
These encoded audio data are used.

However, the coding type identifier (stream_coding_type) for these two types of coded audio data is the same in ISO13818-1, which is the MPEG2 standard, that is, both have the same identifier setting.
Specifically, according to ISO13818-1, coding type = 0x11 is applied to all coded audio data to which the above-described LATM (Low Overhead Audio Transport Multiplex) is applied as multiplexing processing specified in ISO / IEC14496-3. Is set.

Speech encoded data delivered in the MMT format.
(1) MPEG4 AAC LC (LATM / LOAS)
(2) MPEG4 ALS (LATM / LOAS)
Both of the two encoded audio data are encoded audio data to which LATM (Low Overhead Audio Transport Multiplex) is applied as a multiplexing process, and the same identifier [0x11] is set.

Therefore, a playback apparatus that plays back BDAV format data uses a coding type (stream_coding_type) recorded in a clip information file recorded on a medium as a coding type (stream_coding_type).
If [0x11] is set, this audio data
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
You can judge that it is one of these two types,
It is not possible to identify which of these two types of encoded audio data is the encoded audio data.

As shown in FIG. 14, the following information is recorded in the audio stream coding information 122 set in the program information [ProgramInfo ()] recording area of the current clip information file.
(2a) Audio type (audio_presentation_type) 131
(2b) Sampling frequency (sampling_frequency) 132

A recording example of each of these data will be described with reference to FIG.
In FIG. 15A, the audio type recording data is set so that various audio type information such as mono channel, stereo, and surround can be identified for bit values 0 to 15.
FIG. 15B is a data setting in which the sampling frequency of 48 to 192 kHz can be identified for the bit values 0 to 15.
With respect to these audio data formats, the distribution data according to the MMT format is also within the range of the definition data in the current BDAV format, and does not require any particular change.

However, with only each of these data, audio data for which [0x11] is set as the coding type (stream_coding_type) is:
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
It is not possible to identify which of these two types of encoded audio data is the encoded audio data.

Hereinafter, a configuration example of a new clip information file that solves the above problem will be described.
The following two embodiments will be sequentially described.
(Embodiment 1) Embodiment in which voice identification information is obtained from a voice data storage packet (Example 2) Embodiment in which voice identification information is obtained from an MMT package table (MPT)

[6-1. (Example 1) Example in which audio identification information recorded in an audio data storage packet is acquired and recorded in a clip information file]
First, as Embodiment 1, an embodiment in which audio identification information recorded in an audio data storage packet is acquired and recorded in a clip information file will be described.

That is, the audio data is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
An embodiment in which identification information indicating which of these two types of audio data is obtained from the audio data storage packet and recorded in the clip information file will be described.

  FIG. 16 is a diagram illustrating a data configuration (syntax) of stream coding information [StreamCodingInfo] of program information [ProgramInfo ()] of a clip information file according to the first embodiment.

The stream coding information [StreamCodingInfo] shown in FIG. 16 includes audio data to be controlled by the clip information file.
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
It has a configuration in which one of these two types of encoded audio data can be identified.

In the stream coding information [StreamCodingInfo] shown in FIG. 16, the following data is recorded in the same manner as described above with reference to FIG.
(1) Image stream coding information 121,
(2) audio stream coding information 122;

The stream coding information [StreamCodingInfo] shown in FIG.
Coding type (stream_coding_type) = [0x11]
The audio data attribute information recording area 130 of the coding type [0x11] is set.

As described above, coding type = [0x11]
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
This type identifier is associated with both of these two types of encoded audio data. With only this type identifier [0x11], it is possible to identify which of the above (1) and (2) the encoded audio data is. Can not.

The following information is recorded in the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type (audioObjectType) 133

Among these data, the following data (a) and (b):
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
These data are the same as the data described above with reference to FIG.

In the case of MMT format data received from a transmitting device such as a broadcasting station, such information is recorded in, for example, an MMT package table (MPT) which is control information (SI) corresponding to the MMT format.
A recording device that records MMT format data on a medium such as a BD reads the data (a) and (b) from the MMT package table (MPT), which is control information (SI) corresponding to the MMT format, and outputs clip information. Record to file.
A specific example of recording data of the MMT package table (MPT) will be described later.

These audio attribute information (a) and (b), that is,
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
As described with reference to FIGS. 14 and 15, these pieces of audio attribute information are set for audio data other than the coding type [0x11], that is, audio data of the coding types [0x03] to [0x84]. The information that is being done.

As shown in FIG. 16, for audio data of coding type [0x11],
(C) Audio Object Type (audioObjectType) 133
The above audio attribute information is recorded.

This audio object type (audioObjectType) 133 is
The following two types of data included in the coding type = [0x11]:
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
These two types of encoded audio data are used as identifiers, that is, audio identification information.

FIG. 17 shows a specific example of recorded data of the audio object type (audioObjectType) 133.
If the audio object type (audioObjectType) = 2,
The encoded audio data of this coding type = [0x11]
It means that the audio data is MPEG4 AAC LC (LATM / LOAS) encoded audio data.

on the other hand,
If the audio object type (audioObjectType) = 36,
The encoded audio data of this coding type = [0x11]
It means that the data is MPEG4 ALS (LATM / LOAS) encoded audio data.

A playback device that plays back data recorded on a medium such as a BD refers to the recorded data of the audio object type (audioObjectType), so that the audio data to be controlled for reproduction of the clip information file is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is possible to identify any of these audio data.

In the case of MMT format data received from a transmitting device such as a broadcasting station, the audio object type (audioObjectType) information is recorded in an audio data storage packet (MMTP packet / TLV packet).
A recording device that records MMT format data on a medium such as a BD reads “audio object type (audioObjectType)” from an audio data storage packet received from a transmission device such as a broadcast station and records the read audio object type in a clip information file.

With reference to FIG. 18, a description will be given of an example of a packet configuration of an audio data storage packet conforming to the MMT format transmitted by a transmission device such as a broadcasting station.
FIG. 18 shows an audio data storage packet 140 according to the MMT format.
As shown in FIG. 18, the packet storage data 141 of the audio data storage packet 140 includes an encoded audio data stream and attribute information of the stream data.

Note that the encoded audio data stream stored in the audio data storage packet 140 is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
Any of these audio data.

The audio data storage packet 140 further records attribute information of the audio data stored in the packet.
As shown in FIG. 18, as a part of the audio data attribute information,
An audio object type (audioObjectType) 142 is recorded.

The setting values of the audio object type (audioObjectType) 142 are as follows.
The data stored in the packet is
In the case of MPEG4 AAC LC (LATM / LOAS) encoded audio data,
Audio object type (audioObjectType) is set to 2.
On the other hand, the data stored in the packet is
In the case of MPEG4 ALS (LATM / LOAS) encoded audio data,
Audio object type (audioObjectType) is set to 36.
That is, the set value described above with reference to FIG.

A recording device that receives MMT format data transmitted from a transmission device such as a broadcast station and records the MMT format data on a medium such as a BD transmits a voice data storage packet received from the transmission device such as a broadcast station to “audio data”. The setting value (2 or 36) of the “object type (audioObjectType)” is read, and the setting value is read from the clip information file shown in FIG.
The sound object type 133 is recorded in the recording area.

A playback device that plays back data recorded on a medium such as a BD checks whether the recorded data of the audio object type (audioObjectType) is “2” or “36”, thereby controlling the playback of the clip information file. The target audio data is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is possible to identify any of these audio data.

  That is, from the audio attribute information recording area of coding type = [0x11] in the stream coding information [StreamCodingInfo] set in the program information [ProgramInfo ()] recording area of the clip information file, the setting value of the audio object type (audioObjectType) Read.

If the audio object type (audioObjectType) = 2,
The audio data of this coding type = [0x11]
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
Is determined.
On the other hand, if the audio object type (audioObjectType) = 36,
The audio data of this coding type = [0x11]
(1) MPEG4 ALS (LATM / LOAS) encoded audio data,
Is determined.
The playback device can start preparations for decoding each coded audio data, for example, codec setting, based on the determination information.

In addition, corresponding to contents such as one program,
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
These two types of audio data (audio stream) may be distributed.
For example, the setting is such that a user (viewer) can select reproduction data from these two types of audio data.

  A recording device that receives a plurality of audio data (audio streams) from a transmission device such as a broadcast station and records the same on a medium such as a BD as described above converts stream coding information [StreamCodingInfo] shown in FIG. Audio streams) and individually generated and stored in one clip information file.

In this case, a playback device that plays back data recorded on a medium such as a BD,
Audio object type (audioObjectType) = 2, and
Audio object type (audioObjectType) = 36,
These two types of audio data, namely,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It can be determined that these two types of audio data can be selectively reproduced by applying this clip information file.

In this case, the playback device, for example,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
Guidance information indicating that these two types of audio data can be reproduced is displayed on the display unit. Further, it is possible to perform a process of allowing the user to input selection information of desired reproduction sound, and selecting and reproducing the input selection information, that is, the desired reproduction sound as reproduction data.

[6-2. (Example 2) Example in which audio identification information recorded in an MMT package table (MPT) is acquired and recorded in a clip information file]
Next, as a second embodiment, an embodiment will be described in which audio identification information recorded in an MMT package table (MPT), which is control information (SI) corresponding to the MMT format, is acquired and recorded in a clip information file.

That is, the audio data is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
An embodiment will be described in which identification information indicating which of these two types of audio data is obtained from the MMT package table (MPT) and is recorded in the clip information file.

  FIG. 19 is a diagram illustrating a data configuration (syntax) of stream coding information [StreamCodingInfo] of program information [ProgramInfo ()] of a clip information file according to the second embodiment.

The new stream coding information [StreamCodingInfo] shown in FIG. 19 includes audio data to be controlled by the clip information file.
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
It has a configuration in which one of these two types of encoded audio data can be identified.

In the stream coding information [StreamCodingInfo] shown in FIG. 16, the following data is recorded in the same manner as described above with reference to FIG.
(1) Image stream coding information 121,
(2) audio stream coding information 122;

The stream coding information [StreamCodingInfo] shown in FIG. 19 has the same data configuration as that shown in FIG.
Coding type (stream_coding_type) = [0x11]
The audio data attribute information recording area 130 of the coding type [0x11] is set.

As described above, coding type = [0x11]
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
This type identifier is associated with both of these two types of encoded audio data. With only this type identifier [0x11], it is possible to identify which of the above (1) and (2) the encoded audio data is. Can not.

The following information is recorded in the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135

Among these data, the following data (a) and (b):
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
These data are the same as the data described above with reference to FIG.

As described above, in the case of MMT format data received from a transmitting device such as a broadcasting station, these pieces of information are recorded in, for example, an MMT package table (MPT) which is control information (SI) corresponding to the MMT format. .
A recording device that records MMT format data on a medium such as a BD reads the data (a) and (b) from the MMT package table (MPT), which is control information (SI) corresponding to the MMT format, and outputs clip information. Record to file.
A specific example of recording data of the MMT package table (MPT) will be described later.

As shown in FIG. 19, for audio data of coding type [0x11],
(C) Stream content (stream_content) 135
The above audio attribute information is recorded.

In the second embodiment, the stream content (stream_content) 135 is
The following two types of data included in the coding type = [0x11]:
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
These two types of encoded audio data are used as identifiers, that is, audio identification information.

FIG. 20 shows a specific example of recording data of the stream content (stream_content) 135.
If the stream content (stream_content) = 0x3,
The encoded audio data of this coding type = [0x11]
It means that the audio data is MPEG4 AAC LC (LATM / LOAS) encoded audio data.

on the other hand,
If the stream content (stream_content) = 0x4,
The encoded audio data of this coding type = [0x11]
It means that the data is MPEG4 ALS (LATM / LOAS) encoded audio data.

A playback device that plays back data recorded on a medium such as a BD refers to the recorded data of the stream content (stream_content), so that the audio data to be controlled for playback of the clip information file is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is possible to identify any of these audio data.

In the case of MMT format data received from a transmission device such as a broadcasting station, the stream content (stream_content) information is recorded in an MMT package table (MPT) which is control information (SI) corresponding to the MMT format.
A recording device that records MMT format data on a medium such as a BD uses a “stream content (stream_content)” from an MMT package table (MPT), which is control information (SI) corresponding to the MMT format, received from a transmission device such as a broadcasting station. Is read and recorded in the clip information file.

FIG. 21 is a diagram illustrating a data configuration (syntax) of the MMT package table (MPT).
An MMT package table (MPT: MMT Package Table) specified in the MMT format is a table in which data attribute information (asset descriptor) is recorded in detail for each data type (asset type) such as image, audio, subtitle, and the like. It is.

  An MMT package table (MPT: MMT Package Table) 280 is stored in an MMTP packet with a packet ID of 0x0000, and the information processing apparatus may determine a packet stored in the MMT package table (MPT) based on the packet ID. it can.

In the MMT package table (MPT), as shown in FIG.
Asset type (asset_type) 151,
Asset descriptors (asset_descriptors_byte) 152,
These data recording areas are included.

The asset type (asset_type) 151 is an area for recording an identifier for each data type such as an image, a sound, and a caption. An asset is a unit of data processing having a common attribute, and images, audio, subtitles, and the like are set as different assets.
FIG. 22 shows a specific example of the asset type (asset_type) recorded in the MMT package table (MPT).

As shown in FIG. 22, the asset type (asset_type) recorded in the MPT includes, for example, the following types.
hvc1: HEVC image mp4a: audio stpp: subtitles, etc. aapp: application In the MPT asset type (asset_type) 151 recording field shown in FIG. 21, for example, any of the above type information is recorded.

As shown in the lower part of the MPT of FIG.
Asset descriptors (asset_descriptors_byte) 152,
In this field, each asset type (for example, image, audio, subtitle) and various attribute information corresponding to these data types, such as resolution information for an image, are recorded.

FIG. 23 is a diagram showing audio attribute information recorded in the MMT package table (MPT) described with reference to FIG.
That is, FIG. 23 illustrates a case where the asset type (asset_type) 151 in the MPT shown in FIG. 21 is a type identifier (mp4a) corresponding to audio.
This is an example of data recorded as an asset descriptor (asset_descriptors_byte) 152, and the data illustrated in FIG. 23 is a diagram illustrating a data configuration (syntax) of an audio component descriptor (MH-Audio_Component_Descriptor).

As shown in FIG. 23, the following audio attribute information is recorded in the audio component descriptor (MH-Audio_Component_Descriptor).
(M1) Stream content information (M2) Component type (M3) Sampling frequency

  An information processing apparatus that executes a data recording process on an information recording medium (media) reads the audio attribute information from the MMT package table (MPT), and records the audio attribute information as recording data for a clip information file to be recorded on the information recording medium (media). Use.

That is, the following recording data for the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] described with reference to FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
These are recorded data.

The following recording data for the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
These recording data are also recording data of the audio component descriptor (MH-Audio_Component_Descriptor) of the MMT package table (MPT) shown in FIG.
(M2) Component type (M3) Sampling frequency Recording can be performed using these recording data.

The following recording data of the MMT package table (MPT) shown in FIG.
(M1) stream content information 161,
(M2) component type 162,
(M3) sampling frequency 163,
Specific examples of these data will be described with reference to FIG.

FIG. 24 shows the information recorded in the MMT package table (MPT).
(M1) Stream content information 161
It is a figure which shows the specific example of.
In the MMT package table (MPT), as stream content information,
Any bit value of 0x0 to 0xF is stored. Encoding mode information corresponding to each bit value is recorded.

Specifically, the settings are as follows.
(1) The stream content (stream_content) = 0x2 is
This means that the audio stream corresponding to the asset is an audio stream whose encoding method is not specified.
(2) The stream content (stream_content) = 0x3 is
This means that the audio stream corresponding to the asset is an audio stream of MPEG4 AAC (MPEG4 AAC LC (LATM / LOAS)).
(3) The stream content (stream_content) = 0x4 is
This means that the audio stream corresponding to the asset is an audio stream of MPEG4 ALC (MPEG4 ALS (LATM / LOAS)).

For example, a recording device that records MMT format data on a medium such as a BD reads this “stream content (MPT)” from an MMT package table (MPT) which is control information (SI) corresponding to the MMT format received from a transmission device such as a broadcasting station. stream_content) ”and records it in the clip information file.
An asset in the MMT format corresponds to a stream in the MPEG format.

For example, when the value of the stream content (stream_content) recorded in the MMT package table (MPT) for one asset having the MMT format is 0x3,
(C) Stream content (stream_content) 135 in the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG. 19, which is the recording area of the attribute information of the audio stream corresponding to the asset.
0x3 is recorded in this recording area.

On the other hand, when the value of the stream content (stream_content) recorded in the MMT package table (MPT) for one asset having the MMT format is 0x4,
(C) Stream content (stream_content) 135 in the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG. 19, which is the recording area of the attribute information of the audio stream corresponding to the asset.
0x4 is recorded in this recording area.

  As described above, the recording apparatus that records MMT format data on a medium such as a BD stores stream content (stream_content) information in asset (stream) units in a clip information file and records the clip information file on the medium.

A playback device that plays back data recorded on a medium such as a BD refers to the recorded data of the stream content (stream_content), so that the audio data to be controlled for playback of the clip information file is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is possible to identify any of these audio data.

  That is, the playback device reads the stream content (stream_content) from the audio attribute information recording area of coding type = [0x11] in the stream coding information [StreamCodingInfo] set in the program information [ProgramInfo ()] recording area of the clip information file. Read the set value of.

If the stream content (stream_content) = 0x3,
The audio data of this coding type = [0x11]
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
Is determined.
On the other hand, if the stream content (stream_content) = 0x4,
The audio data of this coding type = [0x11]
(1) MPEG4 ALS (LATM / LOAS) encoded audio data,
Is determined.
The playback device can promptly start preparations for decoding each coded audio data, for example, codec settings, based on the determination information.

In addition, corresponding to contents such as one program,
(1) MPEG4 AAC LC encoded audio data,
(2) MPEG4 ALS encoded audio data,
These two types of audio data (audio stream) may be distributed.
For example, the setting is such that a user (viewer) can select reproduction data from these two types of audio data.

  As described above, the recording device that receives a plurality of audio data (audio streams) from a transmission device such as a broadcast station and records it on a medium such as a BD transmits stream coding information [StreamCodingInfo] shown in FIG. Stream) are generated individually and stored in one clip information file.

In this case, a playback device that plays back data recorded on a medium such as a BD,
Stream content (stream_content) = 0x3, and
Stream content (stream_content) = 0x4,
These two types of audio data, namely,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It can be determined that these two types of audio data can be selectively reproduced by applying this clip information file.

In this case, the playback device, for example,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
Guidance information indicating that these two types of audio data can be reproduced is displayed on the display unit. Further, it is possible to perform a process of allowing the user to input selection information of desired reproduction sound, and selecting and reproducing the input selection information, that is, the desired reproduction sound as reproduction data.

Next, specific examples of the following two pieces of information shown in FIG. 23 and recorded in the MMT package table (MPT) will be described with reference to FIGS.
(M2) component type 162,
(M3) sampling frequency 163,

FIG. 25 shows the information recorded in the MMT package table (MPT).
(M12) Component type 162
It is a figure which shows the specific example of.
In the MMT package table (MPT), as component type information 162,
One of bit values 0000 to 11111 is stored, and various audio output types (component types) such as monaural and stereo are associated with each bit value.

FIG. 26 shows the information recorded in the MMT package table (MPT).
(M3) Sampling frequency 163
It is a figure which shows the specific example of.
In the MMT package table (MPT), as sampling frequency information 163,
One of the bit values 000 to 111 is stored, and a sampling frequency of 16 to 48 kHz is associated with each bit value.

As described above, the MMT package table (MPT) included in the control information (signaling information (MMT-SI)) in the MMT format data includes:
(M1) Stream content information (M2) Component type (M3) Sampling frequency These specific information are recorded.

  An information processing apparatus that executes a data recording process on an information recording medium (media) reads the audio attribute information from the MMT package table (MPT), and records the audio attribute information as recording data for a clip information file to be recorded on the information recording medium (media). Use.

Specifically, the following information in the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] shown in FIG. 19 is recorded.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135

The following information of the audio data attribute information recording area 130 of the coding type [0x11] of the stream coding information [StreamCodingInfo] described with reference to FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
These pieces of information are also used as recording data for a clip information file for recording the recording data of the MMT package table (MPT) on an information recording medium (media).

As described in the first and second embodiments, the information processing apparatus that inputs MMT format data and records the input data as BDAV format data on an information recording medium (media) has the following features.
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
The audio identification information indicating which of the audio data is obtained is obtained from an audio data storage packet or an MMT package table (MPT) as stream-based (asset-based) information and recorded in a clip information file.

In addition, the above voice identification information is
The audio object type (audioObjectType) recorded in the audio data storage packet described in the first embodiment, or
Stream content (stream_content) recorded in the MMT package table (MPT) described in the second embodiment,
Any of these information.

  In the above embodiment, the set value (2 or 36) of the audio object type (audioObjectType) recorded in the audio data storage packet described in the first embodiment, and the stream content recorded in the MMT package table (MPT) The embodiment has been described in which the setting value (0x3 or 0x4) of (stream_content) is recorded in the clip information file as it is. However, these values may be different values that can distinguish two pieces of audio data. Is possible.

Further, in the above-described first and second embodiments, the setting data for recording the MMT format definition data “audio object type (audioObjectType)” as it is as the recording data of the clip information file shown in FIG. As the recording data of the clip information file, the definition data “stream content (stream_content)” of the MMT format is set to be recorded as it is.
Also for these data, an expression different from the above expression, for example, a field of a new definition such as “AAC_AC_ALS_coding_type” is set, and a value that makes it possible to distinguish two audio data (AAC LC and ALS) is set in this field. It is good also as a structure which performs.

[7. Configuration and Processing of Information Processing Apparatus for Performing Data Recording Processing on Information Recording Medium]
Next, the configuration and processing of an information processing apparatus that executes data recording processing on an information recording medium will be described with reference to FIG.

As described above, the information processing apparatus of the present disclosure records input data according to the MMT format as BDAV format data or SPAV format data on an information recording medium such as a BD or a flash memory.
The information processing device 300 records a clip AV stream file and a database file such as a playlist and a clip information file on an information recording medium (recording medium) 320.
In a database file such as a playlist or a clip information file, image attribute information, audio attribute information, playback control information, and the like corresponding to the media recorded content are recorded.

  Information to be recorded in a database file such as a playlist or a clip information file includes packets for storing reproduction stream data such as images and sounds included in input data according to the MMT format, as well as control information (SI) defined in the MMT format. From the TLV-SI and various information recording tables constituting the MMT-SI.

  Specifically, for example, various kinds of information are acquired from an MMT package table (MPT) included in the MMT-SI, and media recording content compatible with a database file such as a playlist or a clip information file defined in the BDAV format is obtained. Record the information.

  Hereinafter, a description will be given of a configuration of an information processing apparatus that executes a process of generating an information recording medium on which such a playlist or a clip information file is recorded, specifically, a data recording process on an information recording medium such as a BD, and a processing sequence. I do.

FIG. 27 is a diagram illustrating a configuration of an information processing apparatus 300 that executes a data recording process on an information recording medium such as a BD.
The information processing apparatus 300 records BDAV format data or SPAV format data recording data on an information recording medium (recording medium) 320. That is, a clip AV stream file including image and audio data, and a database file such as a play list file and a clip information file as playback control information files are recorded.

The data input unit 301 inputs MMT format data 331 for the information recording medium 320, that is, MMT format data 331 including image data, audio data, subtitle data, and the like.
The data input unit 301 is a receiving unit that transmits the MMT format data 331, for example, receives transmission data from a broadcast station, a content server, or the like, or a media reading unit that reads data from a medium on which the MMT format data 331 is recorded. Etc.

  The MMT format data 331 input from the data input unit 301 is data in accordance with the data format described above with reference to FIG. 2, for example, high-definition image data such as an HEVC image, or MPEG4 AAC LC (LATM / LOAS). ) Speech encoded data, MPEG4 ALS (LATM / LOAS) speech encoded data, and the like are included.

The MMT format data 331 is stored in the storage unit 304 under the control of the control unit 303.
The user input unit 302 inputs, for example, a request to start recording data on the information recording medium 320.

When a data recording start request is input from the user input unit 302, the MMT format data 331 stored in the storage unit 304 is input to the demultiplexer (DeMUX) 305 using this input as a trigger.
The demultiplexer (DeMUX) 305 converts the MMT format data 331 into packets storing data such as images, audio, subtitles, etc., and signaling information (TLV-SI, MMT-SI) storing notification information, control information, and the like. Of the recording data generation unit 306, the image data generation unit 312, the audio data generation unit 313, and the auxiliary data of the recording data generation unit 306. The information is input to the information generation unit 314.

The subtitle data generation unit 311 obtains subtitle data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data defined in the BDAV format.
The image data generation unit 312 obtains image data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data defined in the BDAV format.
The audio data generation unit 313 acquires audio data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and generates stream file storage data defined in the BDAV format.

  The auxiliary information generation unit 314 obtains attribute information and playback control information corresponding to playback data from the MMT format data 331 input by the data input unit 301 and stored in the storage unit 304, and obtains a database file defined in the BDAV format. To generate data to be stored in a playlist file or a clip information file.

  Specifically, for example, data to be stored in a playlist file or a clip information file is obtained from a reproduction stream data storage packet such as an image and a sound according to the MMT format, an MMT package table (MPT), and the like. Generate playlist files and clip information files.

  The multiplexer (MUX) 315 receives the subtitle, image, and audio data converted by the subtitle data generation unit 311, the image data generation unit 312, and the audio data generation unit 313, and generates a stream file that stores these data.

As described above, a clip AV stream file when recording MMT format data on a medium is:
(1) Convert the MMT format to the MPEG-2TS format to generate a clip AV stream file, or
(2) generating a clip AV stream file composed of a packet sequence (MMTP packet sequence or TLV packet sequence) of a packet storing data according to the MMT format;
These two types of processing are assumed.
The recording data generation unit 306 generates a clip AV stream file according to one of the processing modes (1) and (2).

  The database file generation unit 316 stores a database file such as a playlist file or a clip information file in which the auxiliary information generation unit 314 records various information obtained from the signaling information (TLV-SI, MMT-SI) of the MMT format data 331. Generate.

As described above, the clip information file includes, as attribute information corresponding to audio data,
(1) MPEG4 AAC LC (LATM / LOAS)
(2) MPEG4 ALS (LATM / LOAS)
Speech identification information which makes the two encoded speech data identifiable is recorded.
Specifically, a clip information file having the recording data shown in FIG. 16 or FIG. 19 is generated.

  The stream file data generated by the recording data generation unit 306 and the recording data 332 including the database files such as the playlist file and the clip information file are transmitted from the recording unit 306 via the drive 307 under the control of the control unit 303. The data is output to the recording medium 320 and recorded.

  Next, a sequence of a data recording process on the information recording medium 320 executed by the information processing apparatus 300 shown in FIG. 27 will be described with reference to a flowchart shown in FIG.

The processing according to the flow illustrated in FIG. 28 may be executed under the control of a data processing unit (control unit) including a CPU having a program execution function, for example, according to a program stored in a storage unit of the information processing device. it can.
Hereinafter, the processing of each step shown in the flow of FIG. 28 will be sequentially described.

(Step S101)
First, in step S101, the information processing apparatus 300 inputs MMT format data that is recording data via the data input unit 301.
The recording data includes image data, audio data, caption data, and signaling information (TLV-SI, MMT-SI) storing notification information, control information, and the like.

(Step S102)
Next, in step S102, the information processing device 300 acquires reproduction target data such as an image and a sound from the input MMT format data, and generates an AV stream file according to the BDAV format.

(Step S103)
Next, in step S103, the information processing device 300 generates a clip information file using the input configuration data of the MMT format data.
More specifically, as described in the first and second embodiments, data is obtained from a reproduction stream data storage packet such as an image and a sound according to the MMT format, data from an MMT package table (MPT), and the like. Generate an information file.
The details of the clip information file generation process in step S103 will be described later with reference to FIGS. 29 and 30.

(Step S104)
Next, in step S104, the information processing device 300 generates a playlist file using the input configuration data of the MMT format data.

(Step S105)
Next, in step S105, the information processing device 300 generates another database file using the input MMT format data.

(Step S106)
Next, in step S106, the information processing device 300 generates BDAV format data using the generated AV stream file and database file.

(Step S107)
Next, in step S107, the information processing device 300 records the BDAV format data generated in step S106 on an information recording medium (media).

  Next, the detailed sequence of the clip information file generation process executed in step S103 will be described with reference to the flowcharts shown in FIGS.

FIG. 29 is a detailed sequence of the clip information file generation process according to the embodiment described above (the first embodiment), that is, the embodiment in which the audio identification information is acquired from the audio data storage packet.
FIG. 30 is a detailed sequence of the clip information file generation process according to the embodiment described above (the second embodiment), that is, the embodiment in which the audio identification information is acquired from the MMT package table (MPT).

First, with reference to FIG. 29, a detailed sequence of the clip information file generation process according to the above-described embodiment (first embodiment), that is, the embodiment for acquiring the audio identification information from the audio data storage packet will be described.
The processing of each step of the flow shown in FIG. 29 will be sequentially described.

(Step S121)
First, in step S121, the information processing device 300 acquires an audio data storage packet to be recorded in a clip AV stream file.
This audio data storage packet corresponds to the audio data storage packet 140 described above with reference to FIG.
As shown in FIG. 18, the packet storage data 141 of the audio data storage packet 140 includes an encoded audio data stream and attribute information of the stream data.

The encoded audio data stream stored in the audio data storage packet 140 is:
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
Any of these audio data.

Further, in the audio data storage packet 140, attribute information of the audio data stored in the packet is recorded.
As shown in FIG. 18, as a part of the audio data attribute information,
An audio object type (audioObjectType) 142 is recorded.

(Step S122)
Next, in step S122, the information processing device 300 acquires a setting value of the audio object type (audioObjectType) from the acquired audio data storage packet.
As shown in FIG. 18, as a part of the audio data attribute information,
An audio object type (audioObjectType) 142 is recorded.

The setting values of the audio object type (audioObjectType) 142 shown in FIG. 18 are as follows.
If the data stored in the packet is MPEG4 AAC LC (LATM / LOAS) encoded audio data, the audio object type (audioObjectType) = 2.
On the other hand, if the data stored in the packet is MPEG4 ALS (LATM / LOAS) encoded audio data, the audio object type (audioObjectType) = 36.

(Step S123)
Next, in step S123, the information processing device 300 acquires an MMT package table (MPT) from the control information (SI) storage packet.

The MMT package table (MPT) is a table that stores various data described above with reference to FIGS.
For example, as for audio data, (M1) stream content information 161, which has been described with reference to FIGS.
(M2) component type 162,
(M3) sampling frequency 163,
Each of these data is recorded.

(Step S124)
Next, in step S124, the information processing device 300 selects an asset descriptor whose asset type is audio from the MPT (MMT package table).

(Step S125)
Next, in step S125, the information processing device 300 acquires the following audio attribute information from the MPT asset type = audio asset descriptor (asset_descriptor).
(M2) component type 162,
(M3) Sampling frequency 163.

(Step S126)
Next, in step S126, the information processing device 300 acquires the audio attribute information acquired from the audio data storage packet,
Audio object type (audioObjectType) 142,
Further, the voice attribute information obtained from the MPT, that is, described with reference to FIGS.
(M2) component type 162,
(M3) sampling frequency 163,
These pieces of information are recorded in a recording field of stream coding type = 0x11 or less set in the clip information file.

That is, the following data described above with reference to FIG. 16 (a) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type (audioObjectType) 133
These pieces of information are recorded in a recording field of stream coding type = 0x11 or less set in the clip information file.

Through these processes, a clip information file in which predetermined audio attribute information is recorded is generated.
A playback device that plays back data recorded on a medium such as a BD refers to an audio object type (audioObjectType) recorded in a clip information file, so that audio data to be controlled for reproduction of the clip information file is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is possible to identify any of these audio data.

Next, a detailed sequence of the clip information file generation process according to the embodiment described above (the second embodiment), that is, the embodiment in which the audio identification information is acquired from the MMT package table (MPT) will be described with reference to FIG. I do.
The processing of each step of the flow shown in FIG. 30 will be sequentially described.

(Step S131)
First, in step S131, the information processing device 300 acquires an MMT package table (MPT) from a control information (SI) storage packet.

The MMT package table (MPT) is a table that stores various data described above with reference to FIGS.
For example, as for audio data, (M1) stream content information 161, which has been described with reference to FIGS.
(M2) component type 162,
(M3) sampling frequency 163,
Each of these data is recorded.

(Step S132)
Next, in step S132, the information processing device 300 selects data whose asset type is audio from the MPT (MMT package table).

(Step S133)
Next, in step S133, the information processing apparatus 300 acquires the following audio attribute information from the MPT asset type = audio asset descriptor (asset_descriptor).
(M1) stream content information 161,
(M2) component type 162,
(M3) Sampling frequency 163.

(Step S134)
Next, in step S134, the information processing device 300 acquires the voice attribute information acquired from the MPT, that is, the description has been given with reference to FIGS.
(M1) stream content information 161,
(M2) component type 162,
(M3) sampling frequency 163,
These pieces of information are recorded in a recording field of stream coding type = 0x11 or less set in the clip information file.

That is, the following data described above with reference to FIG. 19 (a) audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
These pieces of information are recorded in a recording field of stream coding type = 0x11 or less set in the clip information file.

Through these processes, a clip information file in which predetermined audio attribute information is recorded is generated.
Specifically, a playback device that plays back data recorded on a medium such as a BD becomes a playback control target of the clip information file by referring to the stream content (stream_content) recorded in the clip information file. The audio data is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is possible to identify any of these audio data.

[8. Configuration and Processing of Information Processing Apparatus that Executes Data Reproduction Processing from Information Recording Medium]
Next, the configuration and processing of an information processing apparatus that executes data reproduction processing from an information recording medium will be described with reference to FIG.

  An information processing device that executes a reproduction process reads data recorded on an information recording medium mounted on the device and executes a reproduction process.

FIG. 31 is a diagram illustrating a configuration of an information processing apparatus 400 that executes a reproduction process of data recorded on an information recording medium 510 such as a BD.
The information processing apparatus 400 reads data recorded on an information recording medium (recording medium) 510 shown in FIG. 31 and outputs the data to an output device (display unit + speaker) 520. Note that the output device 520 is, for example, a television or the like, and is a display device including a display, a speaker, and the like.
The information processing device 400 may be the same device as the information processing device 300 that performs the data recording described above with reference to FIG. That is, the information processing apparatus has both functions of data recording and reproduction.

  The information recording medium (recording medium) 510 is a recording medium in which a clip AV stream file generated by the processing described with reference to FIGS. 28 to 30 and a database such as a playlist and a clip information file are recorded.

The clip information file used for reproducing the clip AV stream file compatible with the MMT format includes audio streams as audio attribute information for each stream (asset) relating to audio data.
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
Audio identification information that enables identification of any of these audio data is recorded.

That is, the following data described with reference to FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type (audioObjectType) 133
These data are recorded.

Alternatively, the following data described with reference to FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
These data are recorded.

In the example shown in FIG. 16, the audio object type (audioObjectType) 133,
In the example shown in FIG. 19, the stream content (stream_content) 135,
These data, the audio stream,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
The audio identification information indicates which of these audio data is used.

  The control unit 401 reads the recording data of the information recording medium 510 via the recording / reproducing unit 404 and the drive 403 based on the input of the reproduction instruction information from the user input unit 402, for example, and the storage unit 405 as a data buffer And outputs the stored data to the reproduction processing unit 406.

  Further, the control unit 401, based on the input of the recorded content list display instruction information from the user input unit 402, and based on the recording data of the information recording medium 510, stores the recorded content list described earlier with reference to FIG. Generated and output to the output device (display unit) 520.

  Under the control of the control unit 401, the reproduction processing unit 406 acquires each piece of data from the clip AV stream file that stores the reproduction data read from the information recording medium 510, that is, each data such as an image, a sound, and a caption. To generate playback data.

  The demultiplexer (DeMUX) 411 acquires a data storage packet storing data such as an image, a sound, a caption, and a playlist file, a clip information file, and the like, classifies the packet into a data type packet, and classifies each packet into a data type. Output to the caption data generation unit 412, image data generation unit 413, audio data generation unit 414, and auxiliary information generation unit 415 according to the type.

The caption data generation unit 412, the image data generation unit 413, and the audio data generation unit 414 execute decoding processing of data stored in the packet and output decoded data to the output data generation unit 416.
The output data generation unit 416 outputs subtitle, image, and audio data to an output device (display unit + speaker) 520 via the input / output interface 407.

Note that the information recording medium 510 is a stream file that stores the data to be reproduced.
A stream file storing MPEG-2TS format data,
There may be a stream file storing MMT format data.
The information processing apparatus 400 selects and applies a playlist file and a clip information file corresponding to each format, and executes a reproduction process of a stream file storing MPEG-2TS format data and a stream file storing MMT format data. Will be.

  The auxiliary information generation unit 415 obtains data stored in, for example, a playlist file and a clip information file, generates a recorded content list, and outputs the generated list to the output device (display unit + speaker) 520.

  The output device (display unit + speaker) 520 outputs, via the output device (display unit + speaker) 520, data such as captions, images, and audio input from the information processing device 400, and a recorded content list.

Next, in the process of reproducing the MMT format data from the information recording medium 510 executed by the information processing apparatus 400 shown in FIG.
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
An audio identification processing sequence for identifying any of these audio data will be described with reference to the flowchart shown in FIG.

  The processing according to the flow illustrated in FIG. 32 is executed under control of a data processing unit (control unit) including a CPU having a program execution function according to a program stored in a storage unit of the information processing device 400, for example. Can be.

  The information processing apparatus that executes the processing according to the flow shown in FIG. 32 is the information processing apparatus 400 shown in FIG. 31, in which the information recording medium (recording medium) 510 is mounted, and the information is recorded on the mounted information recording medium 510. The read data is read and output to an output device (display unit + speaker) 520. Note that the output device 520 is, for example, a television or the like, and is a display device including a display, a speaker, and the like.

The information recording medium (recording medium) 510 is a recording medium in which a clip AV stream generated by the processing described with reference to FIGS. 28 to 31 and a database such as a playlist and a clip information file are recorded.
Hereinafter, the processing of each step shown in the flow of FIG. 32 will be sequentially described.

(Step S201)
First, in step S201, the control unit 401 of the information processing device 400 acquires a clip information file.
It is assumed that the clip AV stream file selected here is a clip AV stream file used for reproducing the clip AV stream file storing the MMT format data.

(Step S202)
Next, in step S202, the control unit 401 of the information processing apparatus 400 converts reproduction target audio data from the following recording fields of stream coding type = 0x11 recorded in the clip information file,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
The audio identification information indicating which of the above encoded audio data is obtained.

  This is a process of acquiring the following information included in the recording data of the stream coding information [StreamCodingInfo] of the program information [ProgramInfo ()] of the clip information file shown in FIG. 16 or FIG.

When the recording data of the clip information file has the data configuration shown in FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type (audioObjectType) 133
Get these data.

On the other hand, when the recording data of the clip information file has the data configuration shown in FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
Get these data.

In the example shown in FIG. 16, the audio object type (audioObjectType) 133,
In the example shown in FIG. 19, the stream content (stream_content) 135,
These data, the audio stream,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
The audio identification information indicates which of these audio data is used.

(Step S203)
Next, in step S203, the control unit 401 of the information processing device 400 generates audio data to be reproduced based on the audio identification information read from the clip information file in step S202.
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is determined which of these audio data is.

The audio data to be played is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
If it is, the process proceeds to step S204.
On the other hand, if the audio data to be played is
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
If it is, the process proceeds to step S205.

(Step S204)
The audio data to be played is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
In step S204, the control unit 401 of the information processing apparatus 400 executes decoding and reproduction processing using a codec compatible with MPEG4 AAC LC (LATM / LOAS) encoded audio data.

(Step S205)
On the other hand, if the audio data to be played is
(1) MPEG4 ALS (LATM / LOAS) encoded audio data,
In step S205, the control unit 401 of the information processing apparatus 400 performs decoding and reproduction processing using a codec compatible with MPEG4 ALS (LATM / LOAS) encoded audio data.

As described above, the clip information file contains the audio data to be reproduced.
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
Audio identification information indicating which of these audio data is recorded is recorded, and by referring to this information, it is possible to quickly execute a correct decoding process and a reproducing process.

Next, for content such as one program,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
An example of a content reproduction sequence in which these two types of audio data are set and which can be selectively reproduced by a user (viewer) will be described with reference to the flowchart shown in FIG.

The processing according to the flow illustrated in FIG. 33 is executed under the control of a data processing unit (control unit) including a CPU having a program execution function, for example, according to a program stored in a storage unit of the information processing device 400. Can be.
Hereinafter, the processing of each step shown in the flow of FIG. 33 will be sequentially described.

(Step S301)
First, in step S301, the control unit 401 of the information processing apparatus 400 acquires a clip information file.
It is assumed that the clip AV stream file selected here is a clip AV stream file used for reproducing the clip AV stream file storing the MMT format data.

(Steps S302 to S303)
Next, in steps S302 to S303, the control unit 401 of the information processing apparatus 400 converts the audio data to be played back based on the recording information of the following recording field of stream coding type = 0x11 recorded in the clip information file.
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is confirmed whether or not the above two types of encoded audio data can be selectively reproduced.

  Specifically, this is a process of acquiring the following information included in the recording data of the stream coding information [StreamCodingInfo] of the program information [ProgramInfo ()] of the clip information file shown in FIG. 16 or FIG.

When the recording data of the clip information file has the data configuration shown in FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Audio Object Type (audioObjectType) 133
Get these data.

On the other hand, when the recording data of the clip information file has the data configuration shown in FIG.
(A) Audio type (audio_presentation_type) 131
(B) Sampling frequency (sampling_frequency) 132
(C) Stream content (stream_content) 135
Get these data.

In the example shown in FIG. 16, the audio object type (audioObjectType) 133,
In the example shown in FIG. 19, the stream content (stream_content) 135,
These data are recorded in units of audio streams, and when a plurality of audio streams are set in content such as one program, each audio stream is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
Audio identification information indicating which of these audio data is recorded.

In steps S302 to S303, referring to the recording data of the clip information file,
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is confirmed whether or not the above two types of encoded audio data can be selectively reproduced.

If it is confirmed that two types of encoded audio data can be selectively reproduced, the process proceeds to step S304.
If it is confirmed that the two types of encoded audio data cannot be selectively reproduced and only one of them can be reproduced, the process proceeds to step S305.

(Step S304)
If it is confirmed that the two types of encoded audio data can be selectively reproduced, in step S304, the control unit 401 of the information processing apparatus 400 determines whether the MPEG4 AAC LC encoded audio data and the MPEG4 ALS encoded audio data The display information for allowing the user (viewer) to select the two pieces of audio data is presented, and the information selected by the user is input.

(Step S305)
In step S304, when selection information is input from the user, or
If it is determined in step S303 that the two types of encoded audio data cannot be selectively reproduced and only one of them can be reproduced, the process proceeds to step S305.

In step S305, the control unit 401 of the information processing device 400 determines that one piece of reproducible audio data or the audio data selected by the user is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
It is determined which of these audio data is.

One audio data that can be reproduced or audio data selected by the user is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
If it is, the process proceeds to step S306.
On the other hand, one audio data that can be reproduced or audio data selected by the user is
(2) MPEG4 ALS (LATM / LOAS) encoded audio data,
If it is, the process proceeds to step S307.

(Step S306)
One audio data that can be reproduced or audio data selected by the user is
(1) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
In step S306, the control unit 401 of the information processing apparatus 400 performs decoding and reproduction processing using a codec that supports MPEG4 AAC LC (LATM / LOAS) encoded audio data.

(Step S307)
On the other hand, one audio data that can be reproduced or audio data selected by the user is
(1) MPEG4 ALS (LATM / LOAS) encoded audio data,
In step S307, the control unit 401 of the information processing apparatus 400 performs decoding and reproduction processing using a codec that supports MPEG4 ALS (LATM / LOAS) encoded audio data.

[9. Configuration Example of Information Processing Device]
Next, an example of a hardware configuration of an information processing apparatus applicable as an information processing apparatus that executes data recording on an information recording medium and data reproduction from the information recording medium will be described with reference to FIG.

  A CPU (Central Processing Unit) 601 functions as a data processing unit that executes various processes according to a program stored in a ROM (Read Only Memory) 602 or a storage unit 608. For example, the processing according to the sequence described in the above embodiment is executed. A RAM (Random Access Memory) 603 stores programs executed by the CPU 601 and data. The CPU 601, the ROM 602, and the RAM 603 are interconnected by a bus 604.

  The CPU 601 is connected to an input / output interface 605 via a bus 604, and an input unit 606 including various switches, a keyboard, a mouse, a microphone, and the like, and an output unit 607 including a display, a speaker, and the like are connected to the input / output interface 605. I have. The CPU 601 executes various processes in response to a command input from the input unit 606, and outputs a processing result to, for example, the output unit 607.

  The storage unit 608 connected to the input / output interface 605 includes, for example, a hard disk and stores programs executed by the CPU 601 and various data. The communication unit 609 functions as a transmission / reception unit for data communication via a network such as the Internet or a local area network, and also as a transmission / reception unit for broadcast waves, and communicates with an external device.

  A drive 610 connected to the input / output interface 605 drives a removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card to record or read data.

[10. Summary of Configuration of the Present Disclosure]
The embodiment of the present disclosure has been described in detail with reference to the specific embodiment. However, it is obvious that those skilled in the art can modify or substitute the embodiments without departing from the gist of the present disclosure. That is, the present invention has been disclosed by way of example, and should not be construed as limiting. In order to determine the gist of the present disclosure, the claims should be considered.

The technology disclosed in the present specification can have the following configurations.
(1) a data processing unit which receives MMT format data and generates recording data in accordance with a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The data processing unit includes:
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing apparatus for executing a process of recording the audio identification information which makes it possible to identify which of the above (a) and (b) the audio data is in a database file of BDAV format or SPAV format.

(2) The data processing unit includes:
The information processing apparatus according to (1), wherein the audio identification information is recorded in a clip information file.

(3) The data processing unit includes:
The information processing apparatus according to (1) or (2), wherein the voice identification information is extracted from a voice data storage packet and recorded in the database file.

(4) The data processing unit includes:
The information processing apparatus according to (1) or (2), wherein an audio object type (audioObjectType) recorded in the audio data storage packet is extracted and recorded in the database file as the audio identification information.

(5) The data processing unit includes:
The information processing apparatus according to (1) or (2), wherein the voice identification information is extracted from an MMT package table (MPT) and recorded in the database file.

(6) The data processing unit includes:
The information processing apparatus according to (1) or (2), wherein stream information (stream_content) recorded in an MMT package table (MPT) is extracted and recorded in the database file as the audio identification information.

(7) The data processing unit includes:
The audio identification information is stored in the attribute information recording area of the same coding type (stream_coding_type) in the stream coding information [Stream Coding Info] recording area of the clip information file.
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
(1) The information processing apparatus according to any one of (1) to (6), which records audio identification information that makes it possible to identify which of the audio data is (a) and (b).

  (8) The information processing device according to (7), wherein the same coding type (stream_coding_type) is 0x11.

(9) a data processing unit for executing a process of reproducing recorded data on the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The data processing unit includes:
A configuration for executing reproduction processing of MMT format data recorded on the information recording medium by using recording information of a playlist file and a clip information file, which are database files defined in the BDAV format or the SPAV format,
The data processing unit includes:
The audio data to be played is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing apparatus that acquires voice identification information indicating which of the data (a) and (b) is from the database file, and executes a decoding process of the voice data according to the acquired information.

(10) The data processing unit includes:
The information processing device according to (9), wherein the audio identification information is obtained from a clip information file.

(11) The data processing unit includes:
The information processing apparatus according to (9) or (10), wherein the audio identification information is obtained from an attribute information recording area of the same coding type (stream_coding_type) in a stream coding information [StreamCodingInfo] recording area of a clip information file.

  (12) The information processing device according to (11), wherein the same coding type (stream_coding_type) is 0x11.

(13) The data processing unit includes:
Based on the voice identification information obtained from the database file,
Playable audio data
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
If it is determined that the data is the two types of data (a) and (b),
The information processing apparatus according to any one of (9) to (12), which outputs display information for allowing a user to select audio data to be reproduced.

(14) The data processing unit includes:
The information processing apparatus according to (13), wherein user selection information for the display information is input, and audio data to be reproduced is selected according to the input selection information.

(15) An information recording medium on which recording data according to the BDAV format or the SPAV format is recorded,
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
(A) or (b) a configuration in which audio identification information enabling identification of the audio data is recorded in a database file of BDAV format or SPAV format.
An information recording medium in which a reproducing device can identify a type of audio data to be reproduced according to audio identification information recorded in the database file.

(16) An information recording medium on which recording data according to the BDAV format or the SPAV format is recorded,
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
A database file of a BDAV format or a SPAV format definition including audio identification information that makes it possible to identify which of the above (a) and (b) audio data,
An information recording medium in which a reproducing device can identify a type of audio data to be reproduced according to the audio identification information of the database file.

(17) An information processing method executed by the information processing apparatus,
The information processing device,
A data processing unit for inputting MMT format data and generating recording data according to a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The data processing unit includes:
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing method for executing a process of recording the audio identification information that makes it possible to identify which of the above (a) and (b) the audio data is in a database file defined in the BDAV format or the SPAV format.

(18) An information processing method executed by the information processing apparatus,
The information processing device,
A data processing unit that executes a reproduction process of the recording data of the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The data processing unit includes:
Using the recording information of the playlist file and the clip information file, which are the database files of the BDAV format or the SPAV format, execute the reproduction process of the MMT format data recorded on the information recording medium,
At the time of the reproduction process, audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing method for acquiring audio identification information indicating which of the above (a) and (b) the data is from the database file, and executing a decoding process of the audio data according to the acquired information.

(19) A program for executing information processing executed in the information processing apparatus,
The information processing device,
A data processing unit for inputting MMT format data and generating recording data according to a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The program, the data processing unit,
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
A program for executing a process of recording the audio identification information that makes it possible to identify which of the above (a) and (b) the audio data is in a database file defined in the BDAV format or the SPAV format.

(20) A program for executing information processing executed in the information processing apparatus,
The information processing device,
A data processing unit that executes a reproduction process of the recording data of the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The program, the data processing unit,
Using the recording information of the playlist file and the clip information file, which are the database files of the BDAV format or the SPAV format, the reproducing process of the MMT format data recorded on the information recording medium is executed,
At the time of the reproduction process, audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
A program for acquiring, from the database file, audio identification information indicating which of the above (a) and (b) the data is, and performing a decoding process on the audio data according to the acquired information.

  Further, the series of processes described in the specification can be executed by hardware, software, or a combination of both. When processing by software is performed, the program recording the processing sequence is installed in a memory in a computer built in dedicated hardware and executed, or the program is stored in a general-purpose computer capable of executing various processing. It can be installed and run. For example, the program can be recorded in a recording medium in advance. In addition to installing the program from the recording medium to the computer, the program can be received via a network such as a LAN (Local Area Network) or the Internet, and installed on a recording medium such as a built-in hard disk.

  The various processes described in the specification may be executed not only in chronological order according to the description, but also in parallel or individually according to the processing capacity of the device that executes the processes or as necessary. Further, in this specification, a system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to those in the same housing.

As described above, according to the configuration of the embodiment of the present disclosure, a configuration is realized in which it is possible to quickly confirm whether the media recording MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data. You.
More specifically, for example, a clip information file that records audio identification information indicating whether the MMT format audio data to be recorded on the medium is MPEG4 AAC LC audio data or MPEG4 ALS audio data is generated, and the clip information file is generated on the medium. Record. The playback device identifies whether the audio data to be played back is MPEG4 AAC LC audio data or MPEG4 ALS audio data based on the audio identification information recorded in the clip information file, and quickly decodes the audio data. Playback can be performed.
With this configuration, a configuration is realized in which it is possible to quickly confirm whether the media-recorded MMT format audio data is MPEG4 AAC LC audio data or MPEG4 ALS audio data.

Reference Signs List 20 transmission device 21 broadcast server 22 data distribution server 30 information processing device 31 recording / reproducing device 32 TV
33 PC
34 Mobile terminal 40 Information recording medium (media)
41 BD
42 HDD
43 Flash memory 300 Information processing device 301 Data input unit 302 User input unit 303 Control unit 304 Storage unit 305 Demultiplexer 306 Recording data generation unit 307 Recording unit 308 Drive 311 Caption data generation unit 312 Image data generation unit 313 Audio data generation unit 314 Auxiliary information generation unit 315 Multiplexer 316 Database file generation unit 320 Information recording medium 400 Information processing device 401 Control unit 402 User input unit 403 Drive 404 Recording / playback unit 405 Storage unit 406 Playback processing unit 407 Input / output I / F
411 Demultiplexer 412 Caption data generator 413 Image data generator 414 Audio data generator 415 Auxiliary information generator 416 Output data generator 510 Information recording medium 520 Output device (display unit + speaker)
601 CPU
602 ROM
603 RAM
604 Bus 605 Input / output interface 606 Input unit 607 Output unit 608 Storage unit 609 Communication unit 610 Drive 611 Removable media

Claims (20)

A data processing unit for inputting MMT format data and generating recording data according to a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The data processing unit includes:
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing apparatus for executing a process of recording the audio identification information which makes it possible to identify which of the above (a) and (b) the audio data is in a database file of BDAV format or SPAV format. The data processing unit includes:
2. The information processing apparatus according to claim 1, wherein the audio identification information is recorded in a clip information file. The data processing unit includes:
The information processing apparatus according to claim 1, wherein the voice identification information is extracted from the voice data storage packet and recorded in the database file. The data processing unit includes:
The information processing apparatus according to claim 1, wherein an audio object type (audioObjectType) recorded in the audio data storage packet is extracted and recorded in the database file as the audio identification information. The data processing unit includes:
The information processing apparatus according to claim 1, wherein the voice identification information is extracted from an MMT package table (MPT) and recorded in the database file. The data processing unit includes:
The information processing apparatus according to claim 1, wherein the stream content (stream_content) recorded in an MMT package table (MPT) is extracted and recorded in the database file as the audio identification information. The data processing unit includes:
The audio identification information is stored in the attribute information recording area of the same coding type (stream_coding_type) in the stream coding information [Stream Coding Info] recording area of the clip information file.
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
2. The information processing apparatus according to claim 1, wherein the voice identification information is recorded so that the voice data can be identified as either (a) or (b).   The information processing apparatus according to claim 7, wherein the same coding type (stream_coding_type) is 0x11. A data processing unit that executes a reproduction process of the recording data of the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The data processing unit includes:
A configuration for executing reproduction processing of MMT format data recorded on the information recording medium by using recording information of a playlist file and a clip information file, which are database files defined in the BDAV format or the SPAV format,
The data processing unit includes:
The audio data to be played is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing apparatus that acquires voice identification information indicating which of the data (a) and (b) is from the database file, and executes a decoding process of the voice data according to the acquired information. The data processing unit includes:
The information processing apparatus according to claim 9, wherein the audio identification information is obtained from a clip information file. The data processing unit includes:
The information processing apparatus according to claim 9, wherein the audio identification information is obtained from an attribute information recording area of the same coding type (stream_coding_type) in a stream coding information [StreamCodingInfo] recording area of a clip information file.   The information processing apparatus according to claim 11, wherein the same coding type (stream_coding_type) is 0x11. The data processing unit includes:
Based on the voice identification information obtained from the database file,
Playable audio data
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
If it is determined that the data is the two types of data (a) and (b),
The information processing apparatus according to claim 9, wherein display information for allowing a user to select audio data to be reproduced is output. The data processing unit includes:
14. The information processing apparatus according to claim 13, wherein user selection information for the display information is input, and audio data to be reproduced is selected according to the input selection information. An information recording medium on which recording data in accordance with a BDAV format or a SPAV format is recorded;
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
(A) or (b) a configuration in which audio identification information enabling identification of the audio data is recorded in a database file of BDAV format or SPAV format.
An information recording medium in which a reproducing device can identify a type of audio data to be reproduced according to audio identification information recorded in the database file. An information recording medium on which recording data according to a BDAV format or a SPAV format is recorded;
The audio data recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
A database file of a BDAV format or a SPAV format definition including audio identification information that makes it possible to identify which of the above (a) and (b) audio data,
An information recording medium in which a reproducing device can identify a type of audio data to be reproduced according to the audio identification information of the database file. An information processing method executed in the information processing apparatus,
The information processing device,
A data processing unit for inputting MMT format data and generating recording data according to a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The data processing unit includes:
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing method for executing a process of recording the audio identification information that makes it possible to identify which of the above (a) and (b) the audio data is in a database file defined in the BDAV format or the SPAV format. An information processing method executed in the information processing apparatus,
The information processing device,
A data processing unit that executes a reproduction process of the recording data of the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The data processing unit includes:
Using the recording information of the playlist file and the clip information file, which are the database files of the BDAV format or the SPAV format, execute the reproduction process of the MMT format data recorded on the information recording medium,
At the time of the reproduction process, audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
An information processing method for acquiring audio identification information indicating which of the above (a) and (b) the data is from the database file, and executing a decoding process of the audio data according to the acquired information. A program for executing information processing executed in the information processing apparatus,
The information processing device,
A data processing unit for inputting MMT format data and generating recording data according to a BDAV format or a SPAV format which is a data recording format for an information recording medium,
The program, the data processing unit,
The audio data to be recorded on the information recording medium is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
A program for executing a process of recording the audio identification information that makes it possible to identify which of the above (a) and (b) the audio data is in a database file defined in the BDAV format or the SPAV format. A program for executing information processing executed in the information processing apparatus,
The information processing device,
A data processing unit that executes a reproduction process of the recording data of the information recording medium,
The information recording medium is an information recording medium storing data recorded in accordance with BDMT format or SPAV format in MMT format data,
The program, the data processing unit,
Using the recording information of the playlist file and the clip information file, which are the database files of the BDAV format or the SPAV format, the reproducing process of the MMT format data recorded on the information recording medium is executed,
At the time of the reproduction process, audio data to be reproduced is
(A) MPEG4 AAC LC (LATM / LOAS) encoded audio data,
(B) MPEG4 ALS (LATM / LOAS) encoded audio data,
A program for acquiring, from the database file, audio identification information indicating which of the above (a) and (b) the data is, and performing a decoding process on the audio data according to the acquired information.

Images