JP2016027512A - Information processing device, information recording medium, and information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To convert an MPEG-2TS format data into an MP4 file and record it without breaking an encryption arrangement prescribed in an MP4 format.SOLUTION: An information processing device obtains key information embedded data (VMD: variant media data) prescribed in an MP4 format, and encrypted data of meta data (vmet) that stores an identifier of a decryption key of the key information embedded data (VMD), from either a TS packet constituting an MPEG-2TS format data or a file storing the encrypted data; and sets it as a box storage data in an MP4 file without decrypting it. In addition, the information processing device obtains or generates vloc box storage data prescribed by the MP4 format as an identification storage box of the meta data (vmet) decryption key, and records it in the MP4 file.SELECTED DRAWING: Figure 28

Description

  The present disclosure relates to an information processing device, an information recording medium, an information processing method, and a program. More specifically, the present invention relates to an information processing apparatus, an information recording medium, an information processing method, and a program that execute data recording with format conversion, for example.

  DVD (Digital Versatile Disc) and BD (Blu-ray (registered trademark) Disc) are widely used as information recording media (media) for recording various contents such as movies and music.

Various data such as images, sounds, and reproduction control data are recorded on these discs in a data recording format defined in advance.
For example, a BDMV (Blu-ray (registered trademark) Disc Movie) format is used as a data recording format for a BD.
In order to reproduce the recorded data in the BDMV format, it is necessary to hold a program for reproducing the BDMV format data.

In recent years, an increasing number of users are viewing content such as movies on smartphones (smartphones) and mobile terminals such as tablet terminals.
Such a portable terminal does not always have a playback application compatible with the BDMV format. Therefore, when copying the recording data of the BD to the media of the mobile terminal, it is necessary to change the recording format to a format that can be played back by the playback application of the mobile terminal that is not in the BDMV format.
Note that data copy processing between media is described in, for example, Japanese Patent Application Laid-Open No. 2008-98765 and Japanese Patent Application Laid-Open No. 2011-2222078.

There is an MP4 format (hereinafter referred to as MP4) as a data recording format standardized in consideration of use by a portable terminal or the like.
Many portable terminals have a reproduction application capable of reproducing the MP4 data recorded in the MP4 format, and when recording the content on the medium of the portable terminal, it is required to record in the MP4 format.

Therefore, for example, when copying data in the BDMV format to a medium such as an SD card used in the portable terminal, it is necessary to perform a copy process with format conversion from BDMV to MP4.
However, no specific proposal for this format conversion has been made at present. If format conversion is not performed reliably, content reproduction at the copy destination may not be possible.

JP 2008-98765 A JP 2011-2222078

  The present disclosure has been made in view of such problems. For example, an information processing apparatus and an information recording apparatus that enable normal data reproduction after format conversion in a configuration in which data recording processing involving format conversion is performed. It is an object to provide an information recording medium, an information processing method, and a program.

The first aspect of the present disclosure is:
A data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format and generates an MP4 file;
The data converter is
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
Obtained from the TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data, and sets the obtained encrypted data as the storage data of the box defined in the MP4 file without decrypting It is in the information processing device.

Furthermore, the second aspect of the present disclosure is:
A data processing unit for generating MPEG-2TS format data;
The data processing unit
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data is stored.
Furthermore, the present invention is an information processing apparatus that generates an MP4 header information file storing vloc data that is storage data of a vloc box defined in the MP4 format as a key identifier storage box of a key for decoding the metadata (vmet).

Furthermore, the third aspect of the present disclosure is:
An information recording medium on which MPEG-2TS format data is recorded,
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD);
The key identifier of the key for decoding the metadata (vmet), which is storage data of the vloc box defined in the MP4 format as the key identifier storage box of the key for decoding the metadata (vmet),
Stored in a TS packet or data file constituting the MPEG-2 TS format data,
A playback device for playing back data stored in the information recording medium acquires a key for decrypting the metadata (vmet) from the TS packet or data file, decrypts the metadata (vmet), and based on the decryption information The information recording medium is capable of acquiring a key to be used for decrypting the key information embedded data (VMD) and decrypting and reproducing the key information embedded data (VMD).

Furthermore, the fourth aspect of the present disclosure is:
An information processing method executed in an information processing apparatus,
The information processing apparatus includes a data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format to generate an MP4 file,
The data converter is
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
Data stored in the box in the MP4 file without decrypting the encrypted data stored in the acquired packet, obtained from the TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data The information processing method is set as

Furthermore, the fifth aspect of the present disclosure is:
An information processing method executed in an information processing apparatus,
The information processing apparatus includes a data processing unit that generates MPEG-2TS format data,
The data processing unit
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data is stored.
Further, the present invention is an information processing method for generating an MP4 header information file storing vloc data, which is storage data of a vloc box defined in the MP4 format, as a key identifier storage box of the metadata (vmet) decryption key.

Furthermore, the sixth aspect of the present disclosure is:
A program for executing information processing in an information processing apparatus;
The information processing apparatus includes a data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format to generate an MP4 file,
The program is stored in the data conversion unit.
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The data stored in the box in the MP4 file without decrypting the encrypted data stored in the acquired packet, obtained from the data file storing the TS packet or each encrypted data constituting the MPEG-2 TS format data In the program to be recorded as.

Furthermore, the seventh aspect of the present disclosure is:
A program for executing information processing in an information processing apparatus;
The information processing apparatus includes a data processing unit that generates MPEG-2TS format data,
The program is stored in the data processing unit.
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2TS format data or the data file storing each encrypted data is stored,
Further, the present invention is a program for generating an MP4 header information file storing vloc data which is storage data of a vloc box defined in the MP4 format as a key identifier storage box of a key for decoding the metadata (vmet).

  Note that the program of the present disclosure is a program that can be provided by, for example, a storage medium or a communication medium provided in a computer-readable format to an information processing apparatus or a computer system that can execute various program codes. By providing such a program in a computer-readable format, processing corresponding to the program is realized on the information processing apparatus or the computer system.

  Other objects, features, and advantages of the present disclosure will become apparent from a more detailed description based on embodiments of the present disclosure described below and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to one in which the devices of each configuration are in the same casing.

According to the configuration of an embodiment of the present disclosure, a configuration in which MPEG-2TS format data is converted into an MP4 file and recorded without breaking the encryption configuration defined in the MP4 format is realized.
Specifically, MPEG4 format key information embedded data (VMD: variant media data) and encrypted data (meta) (vmet) storing the decryption key identifier of the key information embedded data (VMD) are converted into MPEG. -2 Acquired from a TS packet constituting TS format data or a file storing encrypted data, and used as box storage data in an MP4 file without decryption. Also, vloc box storage data defined by the MP4 format is acquired or generated as an identifier storage box for metadata (vmet) decryption key, and is recorded in the MP4 file.
With this configuration, a configuration is realized in which MPEG-2TS format data is converted into an MP4 file and recorded without breaking the encryption configuration defined in the MP4 format.
Note that the effects described in the present specification are merely examples and are not limited, and may have additional effects.

It is a figure explaining the example of a directory structure of the data recorded on a medium according to a BDMV format. It is a figure explaining the response | compatibility with the play list prescribed | regulated in a BDMV format, and reproduction | regeneration data. It is a figure explaining the structural example of MPEG-2TS (transport stream) as a data structure of a clip AV stream (Clip AV Stream) file. It is a figure explaining MP4 format. It is a figure explaining the structure of CFF (Common File Format). It is a figure explaining the structure of AVC and HEVC encoded data. It is a figure explaining the difference between MPEG-2TS and MP4 format. It is a figure explaining the structure of the access unit corresponding to one picture stored in MPEG-2TS. It is a figure explaining the example of a conversion process from MPEG-2TS format to MP4 format. It is a figure explaining an example of the data encryption structure in MP4 format. It is a figure explaining the setting example of the data encryption structure in MP4 format, and the key applied to a decoding. It is a figure explaining the structural example of the MP4 file produced | generated according to MP4 format. It is a figure explaining the setting example of the data encryption structure in MP4 format, and the key applied to a decoding. It is a figure explaining the packet structural example for implement | achieving the encryption structure of MP4 format in MPEG-2TS format. It is a figure explaining the data structure of the ECM_PID packet according to MPEG-2TS format, and the data structure of the vloc box recording data of MP4. It is a figure explaining the example of a conversion process from MPEG-2TS format to MP4 format. It is a figure explaining the example of a directory structure which set the vloc corresponding | compatible data etc. for MP4 conversion. It is a figure explaining the example of a production | generation of the MP4 file using the data with the directory structure which set the vloc corresponding | compatible data etc. for MP4 conversion shown in FIG. It is a figure explaining the process example which acquires the vloc data for MP4 file recording from a server. It is a figure explaining the process example which information processing apparatus produces | generates the vloc data for MP4 file recording. It is a figure explaining the example of a process which information processing apparatus produces | generates the vloc data for MP4 file recording based on the storage data of an ECM_PID packet. It is a figure explaining the problem which generate | occur | produces based on the recording position of key information embedding data (VMD) and metadata (vmet). It is a figure explaining the example of a setting of the recording position of key information embedding data (VMD) and metadata (vmet). It is a figure explaining the example of recording of the instruction data for selectively performing the recording position of key information embedding data (VMD) and metadata (vmet). It is a figure explaining the example of recording of the instruction data for selectively performing the recording position of key information embedding data (VMD) and metadata (vmet). 10 is a diagram illustrating an example of a directory of recording data of a medium according to the second embodiment. FIG. It is a figure explaining the specific example of a clip AV stream file. FIG. 27 is a diagram illustrating a data flow in a data copy process involving format conversion when an MP4 file is generated using BDMV format data including the MPEG-2TS format data illustrated in FIG. 26. It is a figure which shows the correspondence of the data recorded on the mdat box of MP4 file, and the data used as a recording source in the conversion process from MPEG-2TS format data to MP4 format data. It is a figure explaining the process which extracts one (vmet + VMD) data from the data continuously recorded on the vdat file using the recording information of a trun box, and records it on the predetermined position of MP4 file. It is a figure explaining the example of a process which acquires (downloads) the vdat file which stored key information embedding data (VMD) and metadata (vmet) from the external device, and records it on a MP4 file. FIG. 25 is a diagram for describing a configuration example of an information processing device. FIG. 25 is a diagram for describing a configuration example of an information processing device. FIG. 25 is a diagram for describing a configuration example of an information processing device. FIG. 11 is a diagram illustrating a flowchart for describing a sequence of processing executed by the information processing apparatus. FIG. 11 is a diagram illustrating a flowchart for describing a sequence of processing executed by the information processing apparatus. FIG. 11 is a diagram illustrating a flowchart for describing a sequence of processing executed by the information processing apparatus. FIG. 11 is a diagram illustrating a flowchart for describing a sequence of processing executed by the information processing apparatus. FIG. 11 is a diagram illustrating a flowchart for describing a sequence of processing executed by the information processing apparatus. FIG. 11 is a diagram illustrating a flowchart for describing a sequence of processing executed by the information processing apparatus.

The details of the information processing apparatus, information recording medium, information processing method, and program of the present disclosure will be described below with reference to the drawings. The description will be made according to the following items.
1. 1. About MPEG-2TS format and MP4 format 2. Problems when converting MPEG-2TS to MP4 3. Data encryption configuration in MP4 format 4. Configuration example when realizing the encryption configuration in the MP4 format in the MPEG-2TS format 5. Conversion process from MPEG-2 TS format data to MP4 format data 5-1. Example of processing for reading MP4-compatible vloc data recorded independently on media and recording it in MP4 format data 5-2. Example of processing for acquiring (downloading) vloc data from an external device and recording it in an MP4 file 5-3. 5. Regarding a processing example in which the conversion processing execution device generates and records vloc data to be recorded in the MP4 file after conversion with reference to the payload of the ECM_PID packet included in the MPEG-2TS format data 6. Restriction of recording position of key information embedded data (VMD: variant media data) and metadata (vmet) Example of Acquiring Key Information Embedded Data (VMD) and Metadata (vmet) from Other Than MPEG-2TS Format Data File (Example 2)
7-1. Regarding a configuration example in which a file storing key information embedded data (VMD) and metadata (vmet) is set in a medium and used 7-2. 7. Example of processing for acquiring (downloading) a vdat file storing key information embedded data (VMD) and metadata (vmet) from an external device and recording the vdat file in an MP4 file 8. Configuration example of information processing apparatus 9. Processing sequence executed by information processing apparatus Summary of composition of this disclosure

[1. MPEG-2TS format and MP4 format]
First, the MPEG-2TS (Transport stream) format and the MP4 format will be described.
The MPEG-2TS format and the MP4 format are all stored in a recording medium (media) such as image (Video), audio (Audio), subtitle (Subtitle), etc., in a recording medium (media), or broadcast wave or network Is a format that prescribes a data storage format (container format) for encoded data or the like when transmitted via the Internet.

The MPEG-2TS format is a format standardized in ISO13818-1, and is used for data recording, digital broadcasting, and the like for BD (Blu-ray (registered trademark) Disc), for example.
On the other hand, the MP4 format is a format defined by ISO / IECC 14496-14, and is a format suitable for recording data in a flash memory, for example.

  Many portable terminals used in recent years have a reproduction application capable of reproducing MP4 data recorded in accordance with the MP4 format, and when recording content on the medium of the portable terminal, it is possible to record in the MP4 format. Often required.

  The BDMV (Blu-ray (registered trademark) Disc Movie) format, which is a data recording format for the BD described above, is a BD-dedicated format including encoded data such as images and sounds stored in accordance with the MPEG-2TS format. is there.

Note that the encoded data of images, sounds, and still images that are allowed to be stored in accordance with the MPEG-2TS format is, for example, the following encoded data.
Images: MPEG-1, MPEG-2, AVC (MPEG-4AVC), HEVC (MPEG-4HEVC),
Audio: MP1, MP2, MP3, linear PCM, DTS
Still image: JPEG
For example, each encoded data is distributed and stored in TS (Transport Stream) packets defined in MPEG-2TS.

First, the MPEG-2TS format used for BD and broadcasting will be described with reference to FIG.
FIG. 1 is a diagram showing a directory of recording data according to a BDMV format recorded on a medium 10 which is, for example, a ROM type BD (Blu-ray (registered trademark) Disc).

As shown in FIG. 1, the directory is divided into a management information setting unit 11 (AACS directory) and a data unit 12 (BDMV directory).
The management information setting unit 11 (AACS directory) stores a CPS unit key file and a usage control information file that are data encryption keys.

On the other hand, under the BDMV directory of the data part 12,
Index files,
Playlist files,
Clip information file,
Clip AV stream file,
BDJO file,
For example, these files are recorded.

The index file stores title information as index information applied to the reproduction process.
The playlist file is a file that defines the playback order of contents in accordance with the program information of the playback program specified by the title, and has playback position information and designation information for clip information.
The clip information file is a file specified by the playlist file, and has reproduction position information of the clip AV stream file and the like.
The clip AV stream file is a file storing AV stream data to be reproduced.
The BDJO file is a file that stores execution control information of a file that stores JAVA (registered trademark) programs, commands, and the like.

The sequence in which the information processing apparatus reproduces the content recorded on the information recording medium is as follows.
(A) First, a specific title is designated from the index file by the reproduction application.
(B) A reproduction program associated with the designated title is selected.
(C) A playlist that defines the playback order of contents is selected according to the program information of the selected playback program.
(D) The AV stream or the command as the actual content data is read out by the clip information defined in the selected playlist, and the AV stream is reproduced and the command is executed.

FIG. 2 shows the following data recorded on the medium 10, namely:
Playlist files,
Clip information file,
Clip AV stream file,
It is a figure explaining the correspondence of these data.

  An AV stream composed of image and audio data as actual reproduction target data is recorded as a clip AV stream (Clip AV Stream) file, and a playlist (PlayList) is used as management information and reproduction control information file of these AV streams. A file and a clip information file are defined.

These multiple categories of files are shown in FIG.
A playlist layer including a playlist (PlayList) file,
A clip layer consisting of a clip AV stream (Clip AV Stream) file and a clip information (Clip Information) file,
It can be divided into these two layers.

Note that one clip AV stream (Clip AV Stream) file is associated with one clip information (Clip Information) file, these pairs are considered as one object, and these are collectively referred to as a clip (Clip). There is also.
Detailed information of data included in the clip AV stream file, for example, management information such as an EP map in which I picture position information of MPEG data is recorded is recorded in the clip information file.

  A clip AV stream (Clip AV Stream) file stores data in which MPEG-2 TS (transport stream) is arranged in accordance with a BDMV format specified structure. Details of this configuration will be described later with reference to FIG.

  In addition, in the clip information (Clip Information) file, for example, the data position of the byte string data of the clip AV stream file and the playback time such as the playback start point when expanded on the time axis (entry point: EP), etc. The management information for acquiring the reproduction start position of the data stored in the clip AV stream file, such as the corresponding data such as the position, is stored.

  For example, when a time stamp indicating the playback time elapsed position from the start point of the content is given, the clip information file is referred to, and the data read position of the clip AV stream file, that is, the address as the playback start point is acquired. Is possible.

The playlist (PlayList) file has designation information of a playback section for playable data included in a clip (= clip information file + clip AV stream file) layer.
In the playlist (PlayList) file, one or more play items (PlayItem) are set, and each play item is a playback section for playable data included in a clip (= clip information file + clip AV stream file) layer. Specified information.

  A clip AV stream (Clip AV Stream) file storing actual image and audio data to be reproduced has, for example, an MPEG-2 transport stream (TS) file structure as shown in FIG.

As shown in FIG. 3, the MPEG-2TS format has the following characteristics.
1) An MPEG-2TS file is composed of an integer number of aligned units.
2) The size of the aligned unit is 6 kB (= 6144 bytes (2048 × 3 bytes)).
3) The aligned unit starts from the first byte of the source packet.
4) The source packet is 192 bytes long. One source packet includes a TP_extra_header and a TS packet. The TP_extra_header is 4 bytes long, and the TS packet is 188 bytes long.

5) The TS packet has a header (TP header) and a payload portion. The payload of one TS packet stores encoded data of any one type of data such as an image and sound.
6) A PID (program ID) indicating the data type of the payload is recorded in the header (TP header) of the TS packet.
7) The payload of a TS packet is composed of a packet (packetized elementary stream (PES)) that stores an elementary stream (ES) that is encoded data such as an image and sound, a PES header, and the like.
8) In the PES header, a presentation time stamp (PTS) indicating playback time information of the elementary stream (ES) stored in the subsequent PES packet is recorded.

Further, as shown in FIG. 3E, the following data is stored in the header information of the TS packet.
(A) Byte for synchronization (Sync byte)
(B) Transport error identifier (Transport_error_indicator)
(C) Payload unit start identifier (Payload_unit_start_indicator)
(D) Transport priority (Transport_priority)
(E) Program ID (PID)
(F) Transport scrambling control (Transport scrambling control)
(G) Adaptation field control (Adaptation field control)
(H) Continuity counter
(I) Adaptation field (Adaptation field)

Next, an outline of the MP4 format will be described with reference to FIGS.
FIG. 4 shows the following two examples as examples of the MP4 format defined by ISO / IEC 14496-14.
(A) Fragmented (split type) MP4 file (fragmented movie)
(B) Non-fragmented MP4 file (Non-fragmented movie)
These MP4 files shown in FIGS. 4A and 4B are files set as one processing unit in data recording or reproduction processing according to the MP4 format.

(A) A fragmented (divided type) MP4 file (fragmented movie) is a file format in which data such as images and sounds, which are reproduction target data, is divided and stored for each reproduction data within a predetermined time.
(B) A non-fragmented (non-segmented) MP4 file (Non-fragmented movie) is a file format in which data such as images and sounds that are reproduction target data is stored without being divided.

In the MP4 file, an area is set in units of boxes, and data defined in units of boxes is stored in each box.
Each box has areas of a box size (box-size), a box type (box-type), and box data (box-data).
The box data size (byte size) is recorded in the box size (box-size).
In the box type (box-type), the type of data stored in the box is recorded.
In the box data (box-data), data of the type indicated by the box type is recorded.

The following types of boxes are set in the fragmented (split type) MP4 file shown in FIG.
moov box,
trak box,
moof box,
traf box,
mdat box,
Each box above is set.

Actual data that is reproduction target data such as images, sounds, and captions is divided into mdat boxes and stored.
Further, each mdat box is associated with a moof box, and the moof box stores metadata such as attribute information and reproduction control information related to the divided actual data stored in the mdat box associated with the moof box. To do.

  The fragmented (divided) MP4 file shown in FIG. 4A includes a large number of pieces of actual data (mdat) that is divided data of reproduction target data and metadata corresponding to the divided actual data (moof) as one set data. It has a configuration in which set data is stored, and metadata regarding all of the plurality of stored set data is stored in a moov box.

A traf box is set in the metadata (moof) corresponding to the divided actual data.
The traf box stores reproduction sequence information of associated real data (mdat) and the like.

The moov box is a box set as a storage area for metadata such as reproduction control information of data stored in the entire MP4 file.
One or more trak boxes are set in the moov box. The trak box can be set for each data type such as image, sound, subtitle, etc., and stores reproduction sequence information of each data.

If the playback data stored in the MP4 file includes a plurality of different image data, such as HD images, 4K images, etc., it is possible to set individual trak boxes according to these image types. .
Also, if the stored audio data of the MP4 file includes a plurality of different audio data, for example, Japanese audio, English audio, etc., individual trak boxes can be set according to these audio types.
Similarly, when the stored subtitle data of the MP4 file includes a plurality of different subtitle data, for example, Japanese subtitles, English subtitles, etc., individual trak boxes can be set according to these subtitle types.

(B) A non-fragmented (non-segmented) MP4 file (Non-fragmented movie) is a file format in which data such as images and sounds that are reproduction target data is stored without being divided.
The following types of boxes are set in the non-fragmented (non-divided) MP4 file shown in FIG.
moov box,
trak box,
mdat box,
Each box above is set.

The mdat box stores actual data to be reproduced.
The moov box stores metadata set corresponding to the actual data (mdat) that is the reproduction target data, for example, metadata including the attributes of the reproduction target real data (mdat) and the reproduction control information.
The trak box set in the moov box stores reproduction sequence information of actual data (mdat).

  Similar to the above-described (a) fragmented (divided) MP4 file, one or more trak boxes are set in the moov box set in (b) non-fragmented (non-divided) MP4 file. Each trak box is set for each data type, such as image, audio, and caption.

FIG. 4 shows a basic configuration example of the MP4 format.
DECE (Digital Entertainment Content Ecosystem), a standardization organization related to the MP4 format, has standardized CFF (Common File Format) as a new MP4-based file format. This CFF will be described with reference to FIG.

  The CFF (Common File Format) shown in FIG. 5 basically has the same data configuration as the fragmented movie MP4 described with reference to FIG.

That is, in the CFF (Common File Format) file shown in FIG. 5, the following boxes are set as in the fragmented (split type) MP4 file shown in FIG.
moov box,
trak box,
moof box,
traf box,
mdat box,
Each box above is set.

The data stored in each box is almost the same as the fragmented (split) MP4 file shown in FIG.
However, in CFF, each mdat box has a restriction that only one type of data is stored.
That is, in each mdat box,
(A) Image (b) Audio (c) Subtitle One kind of data is stored. There is a restriction that the above data (a) to (c) should not be mixed and stored.

When a plurality of different image data such as HD images, 4K images, etc. are included in the CFF file, these different images are stored in different mdat boxes.
Similarly, different audio data such as Japanese audio and English audio are stored in individual mdat boxes, and Japanese subtitles and English subtitles are also stored in different mdat boxes.

In the general fragmented (divided) MP4 file shown in FIG. 4A, different types of data such as images, audio, and subtitles are stored in the mdat box set as a storage box for one divided data (fragment). It was allowed to store a mixture.
However, in CFF (Common File Format) shown in FIG. 5, there is a restriction that only one type of data can be stored in one mdat box.

That is, only one kind of data of image, sound, or subtitle is individually stored in each mdat box.
Accordingly, the moof box, which is a metadata storage area corresponding to the mdat box, is also set to store metadata set corresponding to one type of data of image, audio, and caption.

Note that the data stored in the mdat box, which is the data portion of the MP4 format, is divided into samples as basic data units.
In CFF (Common File Format), a set of only image samples, a set of only audio samples, a set of only subtitle samples, or a set of data samples of the same type is stored in one mdat box. .

Furthermore, the CFF defined by DECE also defines the coding mode (codec) and data format of images, audio, and subtitles that are allowed to be stored in the CFF file.
Examples of data formats that are allowed to be stored in the CFF file include the following data formats.
Image (Video): AVC (MPEG-4AVC), HEVC (MPEG-4HEVC),
Audio: MPEG-4-AAC, Dolby, AC-3
Subtitle: SMPTE Timed Text (SMPTE-TT)

[2. Problems in converting MPEG-2TS to MP4]
For example, MPEG-2TS format data recorded on a BD (Blu-ray (registered trademark) Disc), or MPEG-2TS format data input via a network or broadcast wave is converted into an MP4 format and flash memory, etc. A problem in the case of performing processing for recording on a medium will be described.

In the following, an example of conversion processing of AVC or HEVC encoded image data permitted to be stored in both MPEG-2TS and MP4 formats will be described.
That is, processing when AVC or HEVC encoded image data stored in a medium such as BD is converted into an encoded data storage format in accordance with MP4 format data and recorded in a medium such as flash memory An example will be described.

First, the basic configuration of AVC or HEVC encoded image data will be described with reference to FIG.
For example, encoded data corresponding to one piece of image data (one picture), parameters applied to decoding processing thereof, and the like are stored in a plurality of NAL units (Network Abstraction Layer Units).
A set of NAL units corresponding to one image data is called an access unit (AU).
That is, AVC encoded image data and HEVC encoded image data are configured by a plurality of NAL units as shown in FIG.

Each NAL unit has a NAL header and NAL data, and attribute information (metadata) corresponding to the NAL data such as data type identification information of the NAL unit is stored in the NAL header.
In addition to image encoded data, each NAL unit stores, for example, sequence information of encoded data, parameters to be applied to decoding processing, and the like.
The type of data stored in each NAL unit is identified by the ID of the NAL header.

The data stored in the NAL unit is, for example, the following data.
(1) AU delimiter (AUD): start position of access unit (AU) (2) SPS: sequence parameter (3) PPS: picture parameter (4) SEI: various auxiliary information (5) Slice data: coded image (video) ) Data components (6) Filler data: Size adjustment data (7) End of **: End position of access unit (AU) These data are stored in each NAL unit.

  The MPEG-2TS format and the MP4 format, which define the storage format (container format) of encoded data, each store the NAL unit shown in FIG. 6 when storing AVC encoded image data or HEVC encoded image data. Store according to format.

FIG. 7 shows an example of NAL unit storage according to these two formats.
FIG. 7A shows an example of storing a NAL unit in accordance with the MPEG-2TS format, which is called a byte stream format.
FIG. 7B is an example of storing a NAL unit in accordance with the MP4 format, and is called a sample structure.

In the MPEG-2TS format shown in FIG. 7A, a start code (SC: Start code) is set at the front position of each NAL unit.
The start code (SC) is an identifier indicating the start position of the NAL unit, and is configured by a specific bit string (0x000001).

  For example, a playback apparatus that processes MPEG-2TS format data can detect the code (0x000001) of the start code (SC) and identify the next position of the SC as the NAL unit start position. By this identification processing, it is possible to accurately extract NAL unit configuration data.

On the other hand, in the MP4 format shown in FIG. 7 (2), length information (Length) is set at the front position of each NAL unit.
This length information (Length) is data indicating the data length (size) of the next NAL unit, and stores the data length (size) of each NAL unit.
For example, a playback device that processes MP4 format data determines the data length of the NAL unit from the next position based on this length information (Length), and extracts NAL unit configuration data according to the data length (size). It becomes possible to do.
The NAL unit can be set to various data lengths, and the length of each NAL unit is different.

As shown in FIGS. 7A and 7B, the MPEG-2TS format storing the AVC / HEVC image encoded data and the MP4 format are different formats.
Specifically, the MPEG-2 TS start code (SC) is replaced with length information (Length) in the MP4 format.

The NAL unit is stored in both MPEG-2TS and MP4 formats.
Therefore, when converting MPEG-2TS format data to MP4 format data, the position of the MPEG-2TS start code (SC) is accurately determined, and the NAL unit is reliably obtained from the MPEG-2TS format data. A process of setting as configuration data of MP4 format data is required.

However, the existing BD-ROM BDMV standard defines that encryption is performed in units of aligned units (aligned units (6144 bytes)) described above with reference to FIG. According to this rule, the start code (SC) is also encrypted and recorded.
In order to perform conversion processing from MPEG-2TS to MP4, it is necessary to identify the position of the start code (SC). Therefore, the encrypted data is once decrypted in units of aligned units, and the start code (SC) ( = 0x000001)).

  In this way, the data is decrypted at the time of the format conversion from MPEG-2TS to MP4, the start code (SC) (= 0x000001) is confirmed, re-encrypted, converted to the MP4 format, and recorded in the flash memory. This increases the processing load on the user device. In addition, the possibility of leakage of plaintext content is increased by the decryption process at the time of conversion, which is not preferable from the viewpoint of content copyright protection.

In order to solve such problems, ISO 23001-9 (under development) is preparing a new standard for BD-ROM. More specifically, the MPEG-2TS encryption method is changed to allow a standard that allows sub-sample encryption that encrypts only a part of the configuration data of MPEG-2TS.
In this new standard, the start code (SC) in MPEG-2TS is excluded from the encryption target, and the start code (SC) included in MPEG-2TS is allowed to be recorded in MPEG-2TS as plain text.

This allows image data with high confidentiality to be encrypted, and accompanying data such as a start code (SC) to be unencrypted data (plain text).
FIG. 8 shows a configuration example of MPEG-2TS subjected to this subsample encryption.
FIG. 8 shows MPEG-2TS format data in one access unit (AU) unit composed of encoded image data in one picture unit and metadata, that is, data obtained by encrypting only the encoded image data area, An example of MPEG-2TS with sub-sample encryption is shown.

The start code (SC) is non-encrypted data, and a specific code (0x000001) is maintained as it is. Therefore, an apparatus that performs conversion from MPEG-2TS to MP4 detects a start code (SC = 0x000001) from MPEG-2TS, extracts a NAL unit following the SC, and sets the NAL unit as MP4 configuration data. It becomes possible.
Since the encoded image data in the NAL unit is encrypted data, there is little possibility of data leakage, and safe format conversion and recording processing can be performed.

  FIG. 9 shows MPEG-2TS format data of PES packets defined in the MPEG-2TS format, that is, the constituent data of the PES packet storing encoded data and its metadata corresponding to one picture corresponding to one image frame. And the correspondence between MP4 format data and FIG.

The PES packet shown in FIG. 9 (2) is a packet in which metadata including image data corresponding to one image frame (one picture) and information applied to the decoding process is stored as a payload.
This PES packet is composed of a plurality of TS packets as shown in FIG.
A detailed configuration example of one TS packet (Pn) is shown in FIG.

FIG. 9 (4) shows a data string in which only the TS payload is extracted from the TS packets constituting the MPEG-2 TS format data and arranged.
This corresponds to ES (elementary stream) byte stream format (AVC / HEVC ES byte stream format) data of AVC or HEVC encoded data.

  When converting from the MPEG-2TS format to the MP4 format, the byte stream data shown in FIG. 9 (4) is converted into an MP4 compatible MP4 sample structure (AVC / HEVC sample structure) shown in FIG. 9 (5). Will do.

  In this conversion processing, the image and audio data to be reproduced remain unchanged as encrypted slice data in both the MPEG-2TS format and the MP4 format. Therefore, when data recorded in the MPEG-2TS format is changed to the MP4 format and recorded on other media, the image or audio data to be reproduced is not subjected to decryption processing or re-encryption processing. It becomes possible to record.

[3. Data encryption configuration in MP4 format]
As described above, according to the new BD-ROM standard ISO 23001-9 that is currently being formulated, it is not necessary to decode image and audio data when converting the format from MPEG-2TS to MP4, and the degree of safety is increased. Copy between media with high format conversion processing.

However, the MP4 format has a unique data encryption configuration that is not found in the current MPEG-2 TS format.
When generating an MP4 file in accordance with this MP4 original encryption configuration, it may not be possible to normally execute MP4 format conversion from MPEG-2TS only with the above-mentioned correspondence.

A data encryption configuration defined in the MP4 format will be described with reference to FIG.
This data encryption configuration is a configuration in which a key applied to a decryption process can be determined based on decrypted (plaintext) content generated by decrypting encrypted content stored in accordance with the MP4 format.

  This is because, for example, in an MP4 playback device such as a smart phone, the encrypted content read from the MP4 storage medium is decrypted, and the decrypted (plaintext) content is illegally copied and spread over a network or the like. The configuration is such that the origin of the decrypted (plaintext) content of the copy source can be traced based on the copy content.

The decrypted content generated by decrypting the encrypted content, for example, decrypted image data is analyzed, and the key applied to the decryption of the image can be specified.
For example, when copy data of image data decrypted in a certain playback device is distributed via the Internet or the like, the content management device may perform image analysis of the copy content and identify the key applied to the decryption of the image. it can.

The management device has correspondence data between the encryption key (decryption key) and the identification information of the device storing the key, that is, the reproduction device identification information of the user, and the encryption key is based on the encryption key identifier information. It becomes possible to specify the device storing the.
Note that the encryption key (decryption key) stored in each playback device differs depending on the device unit, device type unit, manufacturer unit, or the like, and the origin can be traced according to these setting units.

FIG. 10 is a diagram showing an example of MP4 format data decoding and playback processing that is stored in the medium 100 such as a flash memory.
The medium 100 stores content that can be decrypted by a plurality of different encryption keys, ie, a media key Km and segment keys Ksa, Ksb, Ksc,. Here, the case of an image will be described as an example of content. The image may be either a still image or a moving image.

For example, the following encrypted image data is stored in the medium 100.
(1) Sample 100 = encrypted image that can be decrypted with the media key Km,
(2) Key information embedded data A102a = encrypted image that can be decrypted with two keys of media key Km and segment key Ksa,
(3) Key information embedded data B102b = encrypted image that can be decrypted with two keys of media key Km and segment key Ksb,
(4) Key information embedded data C102c = encrypted image that can be decrypted with two keys of media key Km and segment key Ksc,
:

The encrypted image of (1) above is an image that can be decrypted by applying only the media key Km, and is an encrypted image of a partial area or the entire area of one frame image constituting a still image or a moving image.
The encrypted images (2) to (4) are images that can be decrypted by applying the media key Km and one segment key Ksx, that is, images that have been subjected to double encryption, and are still images or moving images. Is the image data of a partial area of one frame image constituting the image data.
In order to generate one completed image frame, for example, the decrypted image 115 shown in FIG. 10, it is necessary to combine the decrypted results of the plurality of encrypted images (1) to (4).

  In each of the above images (1) to (4), or at least each of the images (2) to (4), identification information of a level that cannot be visually recognized is embedded, and by analyzing the decoded image, It has a configuration capable of determining which image of (2) to (4), that is, which key is applied for decryption.

When the medium 100 is attached to a content playback device (player) such as a smart phone, the content playback device (player) reads out the encrypted data recorded as the MPEG-2TS format.
Thereafter, the playback device applies the encryption key stored in the memory to execute the decryption process, and generates and plays back the decrypted image.

The key stored in the memory of each playback device is
Media key Km,
Segment key Ksx
It becomes.
The media key Km is stored in all playback devices (devices).
On the other hand, for the segment key (Ksx), the storage type and the number are variously set for each type of playback device (device) or playback device.

Specifically, different settings are made for each predetermined device category, such as for each device, each device type, or each device manufacturer.
In the example shown in FIG.
The playback device 110 holds a media key Km and a segment key Ksa.
On the other hand, the playback device 120 holds a media key Km and a segment key Ksb.

The playback device 110 executes decryption and output processing of the encrypted data according to the playback application stored in the playback device 110.
The playback application selects the encryption key to be applied to decryption for each image area unit and generates the decrypted image 115.

The playback device 110
(A) an image area to be decrypted by applying only the media key Km;
(B) an image area to be decrypted by applying the media key Km and the segment key Ksa;
These two image regions are combined to generate and output a decoded image 115.
That is, the decoded image 115 is
(A) an image area decrypted by applying only the media key Km;
(B) an image area decrypted by applying the media key Km and the segment key Ksa;
These two types of image areas are mixed.

For example, when the decoded image 115 is distributed via the network, the decoded image 115 is analyzed by analyzing the decoded image 115.
(A) an image area decrypted by applying only the media key Km;
(B) an image area decrypted by applying the media key Km and the segment key Ksa;
It is determined that the image is a mixed image of these two types of image areas.
According to this determination result, it is possible to determine that the decrypted image 115 is an image decrypted by the playback device that holds the media key Km and the segment key Ksa.

On the other hand, the playback device 120 also executes decryption and output processing of encrypted data according to the playback application stored in the playback device 120.
The playback application selects the encryption key to be applied to the decryption for each image area and generates the decrypted image 125.

The playback device 120
(A) an image area to be decrypted by applying only the media key Km;
(B) an image area to be decrypted by applying the media key Km and the segment key Ksb;
These two image areas are combined to generate and output a decoded image 125.
That is, the decoded image 125 is
(A) an image area decrypted by applying only the media key Km;
(B) an image area decrypted by applying the media key Km and the segment key Ksb;
These two types of image areas are mixed.

For example, when the decoded image 125 is distributed via the network, the decoded image 115 is analyzed by analyzing the decoded image 125.
(A) an image area decrypted by applying only the media key Km;
(B) an image area decrypted by applying the media key Km and the segment key Ksb;
It is determined that the image is a mixed image of these two types of image areas.
According to this determination result, the decrypted image 125 can be determined to be an image decrypted by the playback device that holds the media key Km and the segment key Ksb.

In the example shown in the figure, the decoded images 115 and 125 are both
(A) an image area decrypted by applying only the media key Km;
(B) an image area decrypted by applying the media key Km and the segment key Ksa or Ksb;
Although described as a combination of these two types of image areas, this is merely an example, and an image composed of a combination of a large number of three or more different keys may be used. By mixing more types of image regions, it is possible to more precisely specify the playback device that has performed the decoding process.

  FIG. 11 is a diagram illustrating an example of using data stored in the medium 100 when the playback device 110 and the playback device 120 generate decoded images 115 and 125.

The playback device 110 is a playback device that stores a media key Km and a segment key Ksa in a memory.
The playback apparatus 110 acquires the sample 101 stored in the medium 100 and the key information embedded data A102a.
As described with reference to FIG. 10, various key information embedded data A, B, C.

The playback device 110 selects the media key Km held by the playback device 110 and the key information embedded data A102a that can be decrypted by the segment key Ksa according to the metadata stored in the media 100.
The configuration of metadata will be described in detail later.

The playback device 110 acquires the sample 101 stored in the medium 100 and the key information embedded data A102a, decrypts the sample 101 by applying the media key Km, and the information embedded data A102a And decrypting by applying the segment key Ksa.
By these decoding processes, a decoded image 115 is generated.

On the other hand, the playback device 120 is a playback device that stores a media key Km and a segment key Ksb in a memory.
The playback device 120 acquires the sample 101 stored in the medium 100 and the key information embedded data B102b.

The playback device 120 also selects the media key Km held by itself and the key information embedded data B102b that can be decrypted by the segment key Ksb in accordance with the metadata stored in the medium 100.
The playback device 120 acquires the sample 101 stored in the medium 100 and the key information embedded data B102b, decrypts the sample 101 by applying the media key Km, and the information embedded data B102b And decrypting by applying the segment key Ksb.
By these decoding processes, a decoded image 125 is generated.

As described with reference to FIG. 11, it is necessary for each playback device to refer to metadata in order to select data that can be decrypted by applying a key held by itself.
This metadata will be described with reference to FIG.

FIG. 12 is a diagram showing the structure of an MP4 file similar to that described above with reference to FIGS.
As described above with reference to FIGS. 4 and 5, various boxes classified by data type are set in the MP4 file.
Actual data that is reproduction target data such as images, sounds, and captions is divided into mdat boxes and stored.
Each mdat box is associated with a moof box, and each moof box stores metadata such as attribute information and reproduction control information related to divided data stored in the associated mdat box.
In the moov box, metadata corresponding to the entire MP4 file storage data is stored.

As shown in FIG. 12, key information embedded data (VMD: variant media data) 131 is stored in an mdat box together with a sample which is encrypted data of one picture corresponding to one frame image, for example.
FIG. 12 shows only one key information embedded data (VMD: variant media data) 131, but this is a representative example, and different encryption keys other than the data 131 are applied to the mdat box. A plurality of key information embedded data (VMD) that can be decrypted are stored.

  The key information embedded data (VMD: variant media data) 131 shown in FIG. 12 is data that can be decrypted by the media key Km and the segment key Ksa, for example, and has been decrypted from the decrypted image by the media key Km and the segment key Ksa. It is data which can analyze the identification information which shows.

Metadata indicating that the key information embedded data (VMD: variant media data) 131 can be decrypted by the media key Km and the segment key Ksa is metadata (vmet) 132.
The metadata (vmet) 132 is not reproduction target data, but is stored in the mdat box.
The metadata (vmet) 132 includes a key identifier (ID) applied to decryption of the key information embedded data (variant media data) 131 and recording position information of the key information embedded data (variant media data) 131 in the MP4 file. It is recorded.

In this example, key information embedded data (VMD: variant media data) 131 is data that can be decrypted by the media key Km and the segment key Ksa.
Therefore, the metadata (vmet) 132 includes
Key identifier (Km-ID) of the media key Km,
Identifier (Ksa-ID) of the segment key Ksa,
The identifiers of these two keys are recorded.

As described above, the metadata (vmet) 132 includes a key identifier applied to decryption of the key information embedded data (VMD: variant media data) 131 and recording position information of the key information embedded data (VMD: variant media data) 131. Is metadata recorded.
By referring to the metadata (vmet) 132, the playback device can select and obtain decryptable key information embedded data (variant media data) 131 with the key held by the playback device.

However, the metadata (vmet) 132 itself is also recorded in the MP4 file as encrypted data.
The identifier (Kmet-ID) of the key (vmet key (Kmet)) applied to the decryption of the metadata (vmet) 132 is recorded in the vloc box set in the moof box shown in FIG.

As shown in FIG. 12, in the vloc box, an identifier (Kmet-ID) of a key (vmet key (Kmet)) applied to decryption of the metadata (vmet) 132 and metadata (vmet) 132 in the MP4 file are stored. The vloc data 133 including the recording position information is recorded. The vloc data is not reproduction target data but metadata.
The vloc data is recorded in the MP4 file as unencrypted plain text data, that is, unencrypted data.

  The playback device first reads vloc data, which is metadata recorded in the moof box, and an identifier (Kmet-ID) of a key (vmet key (Kmet)) applied to decryption of the metadata (vmet) 132; The recording position information of the metadata (vmet) 132 in the MP4 file is acquired.

According to the identifier (Kmet-ID) of the key (vmet key (Kmet)) applied to the decryption of the metadata (vmet) 132, the vmet key (Kmet) is acquired from the memory of the playback device.
In addition to the media key Km and the segment key Ksx described above, the playback device also stores a vmet key (Kmet) that is applied to the decryption of the metadata (vmet).
Similarly to the segment key, a plurality of types of vmet key (Kmet) can be set, and different keys can be stored depending on the device.

  FIG. 12 shows only vloc, vmet, key information embedded data (variant media data), and one set of these three data, but a large number of these data sets can be set in the MP4 file.

  The playback device reads the metadata vloc recorded as unencrypted data, and uses the vmet key (Kmet) according to the vloc recording information in which the identification information of the vmet key (Kmet) stored in the memory of the device is recorded. Get from memory. Further, according to the vmet position information recorded in the vloc, the vmet recording position is determined, vmet data is obtained, and decryption processing using the vmet key (Kmet) is performed.

  By this decryption processing, the identifier of the key applied to the decryption of the key information embedded data (VMD: variant media data) 131 from the metadata (vmet) 132 and the recording position of the key information embedded data (VMD: variant media data) 131 Get information.

  The playback device refers to the metadata (vmet) 132, obtains decryptable key information embedded data (VMD: variant media data) 131 using the key held by the device, and stores the key (media that is held by the device) The key information embedded data (variant media data) 131 is decrypted by applying the key Km and the segment key Ksa).

By this decoding process, for example, image data constituting the decoded image 115 described above with reference to FIGS. 10 and 11 can be generated.
Note that the decrypted image 115 is, for example, an image obtained by combining the decryption result of the sample and the decryption result of the key information embedded data (variant media data) 131, and the playback apparatus needs to execute the decryption process of the sample as well. .

FIG. 13 is a diagram illustrating an example of a correspondence relationship between encrypted image data stored in an MP4 file and decrypted images generated by selective application of each encrypted data.
In the medium 100 storing MP4 format data, as shown in the figure,
(1) Key information embedded data A (VMD-A) 141,
(2) Key information embedded data B (VMD-B) 142,
(3) Key information embedded data C (VMD-C) 143,
(4) sample 145,
These encrypted image data are stored.
In the example shown in FIG. 13, the image generated based on the encrypted image data is any one of the decrypted images 151 to 153 shown in FIG.

Each of the decoded images 151 to 153 is an image of the same content with the same playback time, and the playback device generates and plays back any one of the decoded images 151 to 153 according to the key of the playback device. Will do.
In each of the decrypted images 151 to 153, identification information capable of analyzing the key applied to the decryption process is recorded.

The key information embedded data A (VMD-A) 141 is image data that can be decrypted by the media key Km and the segment key Ksa.
The key information embedded data A (VMD-A) 141 is decrypted by the playback device that stores the media key Km and the segment key Ksa, and is combined with the decrypted data of the sample 145 that can be decrypted by the media key Km. 151 can be generated.

Key information embedded data B (VMD-B) 142 is image data that can be decrypted by the media key Km and the segment key Ksb.
The key information embedded data B (VMD-B) 142 is decrypted by the playback device storing the media key Km and the segment key Ksb, and combined with the decrypted data of the sample 145 that can be decrypted by the media key Km. 152 can be generated.

Furthermore, the key information embedded data C (VMD-C) 143 is image data that can be decrypted by the media key Km and the segment key Ksc.
The key information embedded data C (VMD-C) 143 is decrypted by the playback device storing the media key Km and the segment key Ksc, and combined with the decrypted data of the sample 145 that can be decrypted by the media key Km. 153 can be generated.

In each of the decrypted images 151 to 153, identification information capable of analyzing the key applied to the decryption process is recorded.
For example, when copy data of the decrypted image 151 is illegally distributed through a network such as the Internet, the decrypted image 151 is decrypted by applying the media key Km and the segment key Ksa by analyzing the copy data. It is possible to determine that it is.
Therefore, it is possible to determine that the device that decrypts the original image of the copy content is a device that stores the media key Km and the segment key Ksa.

[4. Configuration example when realizing the encryption configuration in the MP4 format in the MPEG-2TS format]
A description will be given of a configuration example for realizing in the MPEG-2TS format the data encryption configuration defined in the MP4 format described above, that is, the data encryption configuration in which the decryption key information can be obtained from the plaintext data as the decryption result. .

As described above with reference to FIG. 12, each of the following data is recorded in the MP4 format data that realizes a data encryption configuration that enables decryption key information to be analyzed from plaintext data.
(1) Key information embedded data (VMD: variant media data) 131,
(2) metadata (vmet) 132 in which an identifier of a key applied to decryption of the key information embedded data (variant media data) 131 and recording position information of the key information embedded data (variant media data) 131 is recorded;
(3) Metadata in which the identifier (Kmet-ID) of the key (vmet key (Kmet)) applied to the decryption of the metadata (vmet) 132 and the recording position information of the metadata (vmet) 132 in the MP4 file are recorded. Some vloc data 133,

  In order to realize an encryption configuration in which decryption key information can be analyzed from plaintext data in MPEG-2TS format data, the above data (1) to (3) should be stored in TS packets constituting MPEG-2TS. Is required.

FIG. 14 is a diagram showing an example in which the data (1) to (3) are stored in TS packets constituting the MPEG-2 TS format.
A medium 200 shown in FIG. 14 is a disk storing data according to the MPEG-2TS format.
In the figure, one clip AV stream file [01234. m2ts] is a TS packet sequence.

The VMD correspondence data 211 illustrated in FIG. 14 is the VMD correspondence data 211 corresponding to the key information embedded data (VMD: variant media data) 131 of the MP4 file illustrated in FIG.
In the example illustrated in FIG. 14, the VMD-compatible data 211 is configured by a TS packet in which key information embedded data that can be decrypted by applying the media key Km and the segment key Ksa is stored as a TS payload.

Further, the vmet correspondence data 212 shown in FIG. 14 is data corresponding to the metadata (vmet) 132 of the MP4 file shown in FIG.
The vmet corresponding data 212 shown in FIG. 14 is a TS in which a key identifier applied to decryption of the VMD corresponding data 211 that is key information embedded data (variant media data) and recording position information of the VMD corresponding data 211 are stored as a TS payload. Consists of packets.

The VMD compatible data 211 and the vmet compatible data 212 are both stored in the TS packet as encrypted data.
The VMD corresponding data 211 is data encrypted with the media key Km and the segment key Ksa, and is data that can be decrypted with the media key Km and the segment key Ksa.
The vmet corresponding data 212 is data encrypted with the vmet key (Kmet), and can be decrypted with the vmet key (Kmet).

The vloc correspondence data 213 illustrated in FIG. 14 is data corresponding to the vloc data 133 of the MP4 file illustrated in FIG.
The vloc compatible data 213 uses an ECM_PID packet that is an encryption key information storage TS packet defined in the MPEG-2 TS format, that is, a packet in which PID = ECM is set as a PID that is a packet identifier.
The ECM_PID packet is defined in the MPEG-2TS format as a packet for storing key information applied to decryption of encrypted data stored in a subsequent packet, for example.

  As described above, the vloc corresponding data 213 is set using the ECM_PID packet defined in the MPEG-2TS format. As a payload of this packet, an identifier (Kmet-ID) of a key (vmet key (Kmet)) applied to decrypting the vmet corresponding data 212 is recorded. These data are stored in the TS packet as unencrypted data.

However, the recording data of the ECM_PID packet defined in the MPEG-2TS format does not completely match the recording data of the vloc box in the MP4 format.
That is, the ECM_PID packet defined in the MPEG-2TS format is a packet capable of recording encryption key information. The data recording configuration (syntax) of this packet is the data recording configuration (syntax) of the vloc box of the MP4 file. And there is a difference, not exactly.

In FIG.
(1) Data recording configuration of ECM_PID packet defined in MPEG-2TS format,
(2) MP4 file vloc box data recording configuration,
These data structures are shown.
As shown in FIG. 15, each has a setting capable of recording a key identifier (key_id) as key information.

  However, the data structures in FIGS. 15 (1) and 15 (2) are not completely the same, and the syntax (syntax) of the recording data is different. Therefore, the recording data of the ECM_PID packet defined in the MPEG-2TS format cannot be copied as it is and recorded as data in the vloc box of the MP4 file.

  When processing for converting MPEG-2TS format data into MP4 format data and recording on the media is performed, data corresponding to the data recording configuration (syntax) of the vloc box defined in the MP4 file is acquired or generated. It will be necessary.

  However, the MPEG-2TS format data having the packet configuration shown in FIG. 14 has a setting that can record almost the same data as the recording data of vloc, vmet, and VMD (variant media data) boxes defined in the MP4 format. Yes, the decryption based on the MPEG-2TS data and the key applied to the decryption can be analyzed from the reproduction data.

  That is, a configuration in which a key applied to decryption can be analyzed from plaintext data obtained by decryption and reproduction using MP4 format data can be realized in a data configuration according to the MPEG-2TS format.

  The VMD correspondence data 211, the vmet correspondence data 212, and the vloc correspondence data 213 illustrated in FIG. 14 have been described above. Further, FIG. 14 shows VMD corresponding data 221, vmet corresponding data 222, and vloc corresponding data 223 following these data. These are data sets corresponding to the next segment key (Ksb) set in the TS packet sequence.

The VMD correspondence data 221 is data corresponding to key information embedded data (VMD: variant media data) 131 of the MP4 file shown in FIG.
The VMD-compatible data 221 is configured by a TS packet in which key information embedded data that can be decrypted by applying the media key Km and the segment key Ksb is stored as a TS payload.

Further, the vmet correspondence data 222 shown in FIG. 14 is data corresponding to the metadata (vmet) 132 of the MP4 file shown in FIG.
The vmet corresponding data 222 shown in FIG. 14 is a TS that stores, as a TS payload, a key identifier applied to decryption of the VMD corresponding data 221 that is key information embedded data (variant media data) and recording position information of the VMD corresponding data 221. Consists of packets.

  The vloc corresponding data 223 is a setting using an ECM_PID packet defined in the MPEG-2TS format. An identifier (Kmet-ID) of a key (vmet key (Kmet)) applied to decrypting the vmet corresponding data 222 is stored in the TS packet as unencrypted data.

The media key Km applied encrypted data 231 corresponds to the sample data of the MP4 file shown in FIG.
The non-encrypted-key identifier storage packet 232 stores a media key identifier (Km-ID) applied to the decryption of the media key Km-applied encrypted data 231 and recording position information of the media key Km-applied encrypted data 231. It is composed of TS packets.

  The MPEG-2TS format data having the settings shown in FIG. 14 has a configuration including vloc, vmet, and VMD (variant media data) data stored in the MP4 file described with reference to FIG. Therefore, based on the image data decrypted based on the MPEG-2TS data, the key applied to the decryption can be analyzed, and the origin can be traced when an illegal copy occurs.

[5. Conversion process from MPEG-2TS format data to MP4 format data]
Next, processing when MPEG-2 TS format data having the TS packet configuration described with reference to FIG. 14 is converted into MP4 format data and recorded will be described.

FIG. 16 shows the following three types of data.
(1) MPEG-2TS format data (2) PES layer data (3) MP4 format data

  (1) MPEG-2 TS format data is data composed of a TS packet sequence described with reference to FIG. 14, and vmet and VMD (variant media data = key information embedded data) defined in MP4 are used as a payload. This is a configuration having a stored TS packet and an ECM_PID packet defined in the MPEG-2 TS format, that is, a packet storing a key identifier similar to vloc in MP4.

  A TS packet (ECM) 251 shown in FIG. 16A is an ECM_PID packet defined in the MPEG-2 TS format, and stores vloc box corresponding data in the MP4 file. Specifically, key information (key ID) for decrypting the TS packet (vmet) shown in FIG.

A TS packet (vmet) 252 shown in FIG. 16A is a packet storing the same data as the recording information in the vmet box of the MP4 file.
The TS packet (VMD) shown in FIG. 16 (1) is a packet storing the same data as key information embedded data (VMD: variant media data) of the MP4 file.

  When converting the MPEG-2TS format data shown in FIG. 16 (1) into an MP4 file, the information processing apparatus that executes the conversion process first converts the MPEG-2TS format data shown in FIG. ) Is converted into PES layer data composed of PES packets, which are data in units of pictures, and thereafter, processing for converting the PES layer data into an MP4 file shown in FIG. 16 (3) is executed.

The stored data (payload) of the TS packet (vmet) 252 in the MPEG-2TS format of FIG. 16A is the same data as the vmet box data of the MP4 file shown in FIG.
Similarly, the storage data (payload) of the TS packet (VMD) 253 in the MPEG-2TS format of FIG. 16A is the same data as the VMD (variant media data) box data of the MP4 file.

  Accordingly, the data of these packets 252 and 253 in the MPEG-2TS format of FIG. 16A are set as the payload of the PES packet and then set as the vmet box data of the MP4 file and the VMD (variant media data) box data. can do.

  In other words, by using the MPEG-2 TS format data having the TS packet configuration described with reference to FIG. 14, these vmet and VMD data can be encrypted without being decrypted or re-encrypted. It is possible to convert from MPEG-2TS format data to MP4 format data as is.

However, the record data of the payload of the ECM_PID packet defined in the MPEG-2TS format described with reference to FIG. 14 cannot be used as the storage data in the vloc box defined in the MP4 format data.
As described above with reference to FIG. 15, the ECM_PID packet defined in the MPEG-2TS format has a setting capable of recording encryption key information and the like, but the data recording configuration (syntax) is MP4. This is different from the data recording configuration (syntax) of the vloc box of the file.

  That is, even if the payload of the ECM_PID packet defined in the MPEG-2TS format is copied as it is, the data does not conform to the syntax of the vloc box of the MP4 file, and normal reproduction processing of the MP4 file is hindered. .

Therefore, when converting from MPEG-2TS format data to MP4 format, it is necessary to separately obtain or newly generate vloc data. Specifically, one of the following three processes is executed.
(1) The vloc data for recording in the converted MP4 file is additionally recorded in advance on the medium on which the MPEG-2TS format data is recorded, and the conversion processing execution device reads the additional recording data from the medium and reads the MP4 file. To record.
(2) A device that executes conversion processing from the MPEG-2TS format to the MP4 format acquires (downloads) vloc data from an external device, for example, a copy management server, and records it in an MP4 file.
(3) The conversion processing execution device refers to the payload of the ECM_PID packet included in the MPEG-2TS format data, and generates and records vloc data to be recorded in the converted MP4 file.

An apparatus that performs conversion processing from MPEG-2TS format data to MP4 format data and performs MP4 file recording processing executes any one of the above-described processes (1) to (3) and stores vloc data in the MP4 file. It is necessary to record.
Hereinafter, specific examples of the processes (1) to (3) will be sequentially described.

[5-1. Example of processing for reading MP4-compatible vloc data recorded independently on media and recording it in MP4 format data]
First, with reference to FIGS. 17 and 18, an example of processing for reading MP4-compatible vloc data recorded independently on a medium and recording it in MP4 format data will be described.

  That is, the vloc data for recording in the converted MP4 file is additionally recorded in advance on the medium on which the MPEG-2TS format data is recorded, and the device that executes the conversion process reads the additional recording data and reads the MP4 file. This is an example of processing to be recorded.

FIG. 17 is a diagram illustrating a directory example of recording data of the medium 200 according to the present embodiment. The medium 200 is a Blu-ray (registered trademark) disc, and is the ROM-type BD (Blu-ray (registered trademark) Disc) described above with reference to FIG.
Data according to the BDMV format is recorded on the medium 200. The clip AV stream in this data is MPEG-2TS format data, that is, MPEG-2TS format data composed of TS packets.

A medium 200 having a data recording configuration according to the present embodiment includes:
BDMV directory 301,
EXPPORT directory 302,
Have these directories.

In the BDMV directory 301, as described above with reference to FIG.
Index files,
Playlist files,
Clip information file,
Clip AV stream file,
For example, these files are recorded.

The index file stores title information as index information applied to the reproduction process.
The playlist file is a file that defines the playback order of contents according to the program information of the playback program specified by the title, and has playback position information and designation information for clip information.
The clip information file is a file specified by the playlist file, and has reproduction position information of the clip AV stream file.
The clip AV stream file is a file storing AV stream data to be reproduced, and image data to be reproduced is recorded in accordance with the MPEG-2TS format.

In this embodiment, the clip AV stream file [xxxx. m2ts] is a file having the packet configuration described above with reference to FIG.
That is, it is defined in the MP4 format.
Data corresponding to key information embedded data (VMD: variant media data),
Vmet-compatible data in which key information for decrypting key information embedded data (VMD), VMD position information, and the like are recorded,
Each of these has a TS packet stored as a payload.
further,
an ECM_PID packet in which an identifier (Kvmet-ID) of a key for decrypting vmet (Kvmet) is recorded;
A clip AV stream file [xxxx. m2ts].

As shown in FIG. 17, the medium 200 of the present embodiment has
In addition to the BDMV directory 301,
EXPPORT directory 302,
Have

  The EXPORT directory 302 is a directory in which data that is referred to or required when MPEG-2TS format data is converted into MP4 format data and recorded on other media is set.

As shown in FIG. 17, the following files are set in the EXPPORT directory 302.
(1) Manifest file 311,
(2) MP4 header information file 312

The manifest file 311 is a file that is referred to when data is copied between media.
When data is copied between media, there is a copy management system that permits copying on condition that copy permission information is received from an external management server.
The manifest file 311 is a copy control management file (MCMF: Managed Copy Manifest File) used when performing data copying according to this copy management system.

For example, as a copy process according to the above copy management system, when the information processing apparatus performs a copy process of converting MPEG-2TS format data recorded on the first medium into the MP4 format and recording it on the second medium. Copy permission information from an external management server must be received.
In processing according to the copy management system, the information processing apparatus first reads a manifest file (MCMF: Managed Copy Manifest File) 311 recorded on the first medium.

  The manifest file (MCMF) 311 is played as access information (URL) of the management server that provides copy permission information of the content recorded on the first medium in which the copy source data is recorded, or data information (dealManifest) that allows copying. List file names are recorded. Only data specified by the playlist file name recorded in the manifest file (MCMF) 311 is copy-permitted data.

  When the manifest file (MCMF) 311 is recorded on the first medium in which the copy source data is recorded, the information processing apparatus receives the copy permission information from the management server, and plays the recorded information in the manifest file (MCMF) 311. Data specified by the list file name is selected from the first medium and recorded on the second medium.

The manifest file 311 records correspondence data between the playlist file and the MP4 header information file 312 in addition to the identifier of the playlist file permitted to be copied.
That is, when one playlist file is selected as a copy target, MP4 file-specific data necessary for copying data corresponding to the playlist file, for example, data for recording a moov box or moof box is recorded. The identifier of the header information file 312 is recorded.

In the figure, only one MP4 header information file 312 is shown, but a plurality of MP4 header information files are recorded in the EXPPORT directory 302.
These are associated with any of the playlist files that are allowed to be copied.
The information processing apparatus that executes the copy process first selects one playlist file recorded in the manifest file 311 as a copy target.
Next, the MP4 header information file associated with the selected playlist file is selected based on the record information of the manifest file.

The selected MP4 header information file cannot be obtained directly from the MPEG-2TS format data or the database file set in the BDMV directory or difficult to obtain during the data copy process involving conversion of MPEG-2TS to MP4 format. Data specific to MP4 is recorded.
For example, data to be recorded in a moov box or a moof box constituting an MP4 file is recorded.

The MP4 header information file 312 also records vloc box storage data set in the MP4 format file.
The information processing apparatus that executes the copy process can acquire the vloc box storage data recorded in the MP4 header information file 312 and record the acquired data in the vloc box of the MP4 file generated by the conversion process.

In the MPEG-2TS format described above with reference to FIG. 14, the key identifier (Kmet-ID) of the vmet decryption key (Kmet) is added to the ECM_PID packet defined as the key information storage packet in the MPEG-2TS format. It was set to store.
However, the recording data of the ECM_PID packet does not completely match the recording data of the vloc box defined in the MP4 format. This is as described above with reference to FIG.
Therefore, the record data of the ECM_PID packet cannot be directly copied to the vloc box defined in the MP4 format.

  The vloc box recording data in accordance with the MP4 format is recorded in the MP4 header information file 312 of the EXPPORT directory shown in FIG. 17, so that the MP4 format can be used for data copying involving conversion processing from the MPEG-2TS format to the MP4 format. Thus, it is possible to reliably acquire data for storing the vloc box in accordance with the above-mentioned regulations.

  A data flow in a data copy process accompanied by format conversion when an MP4 file is generated using the BDMV format data including the MPEG-2TS format data shown in FIG. 17 will be described with reference to FIG.

  FIG. 18 shows a clip AV stream [xxxx.x consisting of the MPEG-2 TS format data described with reference to FIG. The correspondence relationship between the recording data of the medium 200 including m2ts] and the recording destination of the MP4 file is shown.

A clip AV stream file including reproduction target data such as images and sounds is a clip AV stream file [01001. m2ts] 313.
Clip AV stream file [01001. m2ts] 313 is a clip AV stream file including reproduction target data of a playlist file selected as a copy target in accordance with the manifest file 311.

The clip AV stream file 313 is composed of the TS packet sequence described with reference to FIG.
That is, correspondence data of key information embedded data (VMD: variant media data) defined in the MP4 format,
Vmet compatible data in which key information for decryption of key information embedded data (VMD), position information of key information embedded data (VMD), and the like are recorded;
Each of these has a TS packet stored as a payload.

  As shown in FIG. 18, the configuration data of the clip AV stream file 313 is recorded in a vmet box and a VMD (variant media data) box set in the mdat box of the MP4 file.

  As described above with reference to FIG. 16, the payload of the TS packet storing vmet compatible data is recorded in the vmet box of the MP4 file, and the corresponding data of VMD (variant media data) which is key information embedded data is stored. The TS packet payload is recorded in a VMD (variant media data) box of the MP4 file.

  These vmet and VMD copy processes may be recorded in each box as they are without decrypting the encrypted data recorded in the TS packet, as described above with reference to FIG.

Furthermore, the vloc data recorded in the MP4 header information file 312 set in the EXPPORT directory is recorded in the vloc box set in the traf box in the moof box of the MP4 file.
The vloc data recorded in the MP4 header information file 312 set in the EXPORT directory is data according to the data structure defined in the MP4 format, and may be recorded in the vloc box of the MP4 file as it is.

With these processes, the following data recording according to the MP4 format rules is completed.
VMD (variant media data) data which is key information embedded data,
Vmet data recording key information (key identifier) for decrypting data recorded in the VMD box and position information of the VMD box;
vloc data including a key identifier (Kmet-ID) of a key (Kmet) for decrypting data recorded in the vmet box, and recording position information of the vmet box;
These data recordings are performed reliably.

  Note that the apparatus that executes the format conversion and data recording processing uses the data set in the directory shown in FIG. 17 for other sample data of these data and other metadata, and each box of the MP4 file. Execute the process to record.

With these processes, the data copy accompanied by the conversion process from the MPEG-2 TS format to the MP4 format is completed.
The MP4 file generated by this data copy processing is a file having the following data according to the MP4 format.
VMD (variant media data) data which is key information embedded data,
Vmet data recording key information (key identifier) for decrypting data recorded in the VMD box and position information of the VMD box;
vloc data including a key identifier (Kmet-ID) of a key (Kmet) for decrypting data recorded in the vmet box, and recording position information of the vmet box;

Therefore, it is possible to analyze the key applied to the decryption from the decrypted / reproduced data using the MP4 file generated by the copy process.
That is, as described above with reference to FIGS. 10 and 11, the key applied to the decryption can be analyzed from the decryption result data. For example, when an illegal copy is distributed, the copy data becomes the copy source. It is possible to trace the device that has generated (decoded) data.

[5-2. Example of processing for acquiring (downloading) vloc data from an external device and recording it in an MP4 file]
Next, a description will be given of a processing example in which a device that performs conversion processing from the MPEG-2TS format to the MP4 format acquires (downloads) vloc data from an external device, for example, a copy management server, and records it in an MP4 file.

  FIG. 19 is a diagram illustrating processing executed by the information processing apparatus 400 that executes conversion processing from the MPEG-2TS format to the MP4 format.

  The information processing apparatus 400 mounts a first medium 410 storing MPEG-2TS format data serving as copy source data, and a second medium 420 serving as a copy destination medium for recording MP4 format data after format conversion, thereby converting the format. And start the copy process.

The clip AV stream file recorded on the first medium 410 storing the MPEG-2 TS format data as copy source data is composed of the TS packet sequence described with reference to FIG.
That is, TS corresponding to data corresponding to VMD (variant media data) which is key information embedded data defined in the MP4 format, and vmet corresponding data in which key information for VMD decryption, VMD position information, and the like are stored as a payload. Have a packet.

  The information processing apparatus 400 reads these data and records them in the second medium 420 as data of each box of the MP4 file. Specifically, each of these data is recorded in a vmet box and a VMD (variant media data) box set in the mdat box of the MP4 file.

That is, as described above with reference to FIG.
The payload of the TS packet storing the vmet compatible data is recorded in the vmet box of the MP4 file. further,
The payload of a TS packet storing corresponding data of VMD (variant media data) which is key information embedded data is recorded in a VMD (variant media data) box of the MP4 file.

  As described above with reference to FIG. 16, the recording (copying) processing of these vmet and VMD data may be recorded in each box as it is without decrypting the encrypted data.

  Furthermore, the information processing apparatus 400 sends the data identifier (for example, content ID, playlist ID, etc.) of the data to be copied to the external apparatus, for example, the server 401 that executes copy management, or the first medium. Identification information that can specify copy data such as a media identifier is transmitted.

After confirming the copy target data, the server 401 transmits vloc data corresponding to the confirmation data to the information processing apparatus 400.
The information processing apparatus 400 records the vloc data received from the server 401 in the vloc box in the moof box of the MP4 file.
The vloc data provided by the server 401 is data according to the data structure defined in the MP4 format, and may be recorded in the vloc box of the MP4 file as it is.

With these processes, the MP4 file storing the following data in accordance with the MP4 format rules is recorded in the second medium 420 for each of the following boxes.
VMD box = VMD (variant media data) data which is key information embedded data,
vmet box = vmet data in which key information (key identifier) for decrypting data recorded in the VMD box and position information of the VMD box are recorded;
vloc box = vloc data including a key identifier (Kmet-ID) of a key (Kmet) for decrypting data recorded in the vmet box, and recording position information of the vmet box,
On the second medium 420, an MP4 file having a box storing the MP4 format definition data is recorded.

  The apparatus that performs format conversion and copy processing records sample data and other metadata other than the above data in each box of the MP4 file using the recording data of the first medium 410. Execute the process.

With these processes, the data copy accompanied by the conversion process from the MPEG-2 TS format to the MP4 format is completed.
In the MP4 file generated by this data copy process, key information embedded data (VMD: variant media data) data, vmet data, vloc data, and these data according to the MP4 format are recorded.

  Therefore, the key applied to the decryption can be analyzed based on the decryption result data described above with reference to FIGS. 10 and 11. For example, when an illegal copy is distributed, the data that is the copy source from the copy data Can be traced.

[5-3. Example of processing in which conversion processing execution device generates and records vloc data to be recorded in converted MP4 file with reference to payload of ECM_PID packet included in MPEG-2TS format data]
Next, a processing example in which the information processing apparatus that executes the conversion process generates and records vloc data to be recorded in the converted MP4 file with reference to the payload of the ECM_PID packet included in the MPEG-2TS format data. explain.

  FIG. 20 is a diagram illustrating processing executed by the information processing apparatus 400 that executes conversion processing from the MPEG-2TS format to the MP4 format, as in FIG. 19.

  The information processing apparatus 400 mounts a first medium 410 storing MPEG-2TS format data serving as copy source data, and a second medium 420 serving as a copy destination medium for recording MP4 format data after format conversion, thereby converting the format. And start the copy process.

The clip AV stream file recorded on the first medium 410 storing the MPEG-2 TS format data as copy source data is composed of the TS packet sequence described with reference to FIG.
That is, TS corresponding to data corresponding to VMD (variant media data) which is key information embedded data defined in the MP4 format, and vmet corresponding data in which key information for VMD decryption, VMD position information, and the like are stored as a payload. Have a packet.

  The information processing apparatus 400 reads these data, sets the read data as recording data for each box constituting the MP4 file, and records the data in the second medium 420. Specifically, each of these data is recorded in a vmet box and a VMD (variant media data) box set in the mdat box of the MP4 file.

That is, as described above with reference to FIG.
The payload of the TS packet storing the vmet compatible data is recorded in the vmet box of the MP4 file. further,
The payload of a TS packet storing corresponding data of VMD (variant media data) which is key information embedded data is recorded in a VMD (variant media data) box of the MP4 file.

  These vmet and VMD copy processes may be recorded in each box as they are without decrypting the encrypted data recorded in the TS packet, as described above with reference to FIG.

  Furthermore, the information processing apparatus 400 refers to the payload of the ECM_PID packet included in the MPEG-2TS format data recorded on the first medium 410, and generates vloc data to be recorded in the converted MP4 file.

One specific column of the vloc data generation process executed by the information processing apparatus 400 will be described with reference to FIG.
FIG. 21 is similar to that described above with reference to FIG.
(1) Data recording configuration of ECM_PID packet defined in MPEG-2TS format,
(2) MP4 file vloc box data recording configuration,
These are shown.

The information processing apparatus 400 extracts the ECM_PID packet from the clip AV stream file of the first medium in which the copy source data is recorded, and acquires the data recorded as the payload of this packet, that is, the data shown in FIG. To do.
The information processing apparatus 400 uses the data recording information to generate MP4 vloc box storage data shown in FIG.

The record data of the ECM_PID packet defined in the MPEG-2TS format shown in FIG.
Initialization vector (IV) size,
Key ID,
Initialization vector (IV) data,
These data are included.
The key ID is a key identifier (ID) for decrypting vmet data.

The information processing apparatus 400 reads out these data and generates vloc data in accordance with the MP4 format rule shown in FIG.
As shown in FIG. 21 (2), the key ID recording area, the size of the initialization vector (IV), and the data recording area are also set in the MP4-defined vloc data.
The vmKID shown in FIG. 21 (2) corresponds to the identifier (Kmet-ID) of the vmet decryption key (Kmet) described in this specification.

  The information processing apparatus performs conversion processing so that data read from the recording data of the ECM_PID packet conforms to the MP4 default vloc data syntax, and generates vloc data according to the MP4 format rules.

Note that the information processing apparatus 400 holds a conversion program necessary for the data conversion processing in a memory, and performs generation processing of vloc data using the conversion program.
The vloc data generated by this conversion process is data according to the data structure defined in the MP4 format, and can be recorded in the vloc box of the MP4 file as it is.

With these processes, the MP4 file storing the following data in accordance with the MP4 format rules is recorded in the second medium 420 for each of the following boxes.
VMD box = VMD (variant media data) data which is key information embedded data,
vmet box = vmet data in which key information (key identifier) for decrypting data recorded in the VMD box and position information of the VMD box are recorded;
vloc box = vloc data including a key identifier (Kmet-ID) of a key (Kmet) for decrypting data recorded in the vmet box, and recording position information of the vmet box,
On the second medium 420, an MP4 file having a box storing the MP4 format definition data is recorded.

  The apparatus that performs format conversion and copy processing records sample data and other metadata other than the above data in each box of the MP4 file using the recording data of the first medium 410. Execute the process.

With these processes, the data copy accompanied by the conversion process from the MPEG-2 TS format to the MP4 format is completed.
In the MP4 file generated by the data copy process, key information embedded data (VMD: variant media data) data, vmet data, vloc data, and the like are recorded according to the MP4 format.

  Therefore, the key applied to the decryption can be analyzed from the decryption result data described with reference to FIGS. 10 and 11. For example, when an illegal copy is distributed, the copy source data is generated from the copy data ( It is possible to track the device that has been decoded.

[6. Restriction on recording position of key information embedded data (VMD: variant media data) and metadata (vmet)]
As understood from the above description, in the process of converting the MPEG-2 TS format data to the MP4 format data and recording the MP4 format data on the medium, the key information embedded data (VMD: variant media data) and the metadata (vmet ) Is recorded in the MP4 file as it is without decrypting the encrypted data stored in the MPEG-2TS packet.

  However, as described above with reference to FIG. 12 and the like, the metadata (vmet) includes a media key (Km) or a segment key that is a key for decrypting key information embedded data (VMD: variant media data). In addition to (Ksx) key identifiers (Km-ID, Ksx-ID), recording position information of key information embedded data (VMD: variant media data) is recorded.

  Therefore, an apparatus that executes format conversion and MP4 file recording processing embeds key information when recording key information embedded data (VMD: variant media data) and metadata (vmet) in an MP4 file generated by format conversion. It is necessary to match the recording position of data (VMD: variant media data) with the recording position information recorded in the metadata (vmet).

However, as described above, in the conversion process from MPEG-2TS to MP4 format, key information embedded data (VMD: variant media data) and metadata (vmet) are recorded in the MP4 file as encrypted data without being decrypted. To do.
Therefore, there is a problem that an apparatus that performs format conversion and copy recording cannot confirm the recording position information recorded in the metadata (vmet).

  As shown in FIG. 22, the moof box, which is a metadata storage box of an MP4 file, has playback data (sample (sample)) of an image or sound stored in the mdat box, which is a playback data storage box. )) A play box in which playback time information (sample_duration) and sample size information (sample_size) are recorded is set.

This trun box is a box in which playback time information (sample_duration) and sample size information (sample_size) of each sample are recorded in order of sample number (# 1, # 2, # 3...) Playback control information is recorded.
A playback apparatus that performs playback processing using an MP4 file can perform accurate playback in units of samples with reference to playback control information corresponding to each sample recorded in the trun box.
Each sample stored in the mdat box is constituted by one image frame (picture) in the case of image data, and reproduced audio data within a predetermined time range in the case of audio data.

As shown in FIG. 22 (1), the reproduction data includes sample data that does not include key information embedded data (VMD: variant media data) and metadata (vmet) corresponding to the key information embedded data (VMD). In the trun box, the playback time information (sample_duration) and sample size information (sample_size) for each sample are arranged in sample number order (sample_count (# 1, # 2, # 3...). ) Can be recorded sequentially and continuously.
The playback device can extract sample data from the mdat box in the order of sample numbers and perform playback processing in the order of samples.

  However, as shown in FIG. 22 (2), if the reproduction data includes key information embedded data (VMD: variant media data) and metadata (vmet) corresponding to the key information embedded data (VMD), the reproduction target data Is not only sample data.

In the example shown in FIG. 22 (2), metadata (vmet) corresponding to key information embedded data (VMD) and key information embedded data (VMD: variant media data) are set as subsequent data of samples # 1 and # 2. Then, subsequent sample # 3 is set.
This key information embedded data (VMD: variant media data) is, for example, key information embedded image data reproduced together with the image data of sample # 2.

  In this way, the metadata (vmet) corresponding to the key information embedded data (VMD) and the key information embedded data (VMD: variant media data) are set between the sample data that should be continuous reproduction data, and the mdat box. If the playback control information corresponding to the sample is recorded in the trun box in the order of the sample number (# 1, # 2, # 3...), The playback process referring to the data in the trun box is correctly executed. There is a possibility that it will not be possible.

As a measure for solving this problem, one of the following measures can be considered.
(A) Metadata (vmet) corresponding to key information embedded data (VMD) and key information embedded data (VMD: variant media data) are not recorded between samples.
(B) When the metadata (vmet) corresponding to the key information embedded data (VMD) and the key information embedded data (VMD: variant media data) are recorded between the samples (sample), the metadata (vmet) and the key The first trun box in which the reproduction control information corresponding to the continuous sample recorded before the information embedded data (VMD) is recorded, the metadata (vmet), and the continuous sample recorded after the key information embedded data (VMD). The second trun box in which the corresponding reproduction control information is recorded is set individually. That is, a plurality of trun boxes corresponding to continuous samples are set.
(C) When metadata (vmet) and key information embedded data (VMD) are recorded as subsequent data of one sample in the mdat box, as size information of this sample to be recorded in the trun box,
Sample size + (size of metadata (vmet) and key information embedded data (VMD))
Record this total size information.

  By taking any of the above measures (A) to (C), it is possible to execute the reproduction process using the reproduction control information corresponding to the sample recorded in the trun box without any problem.

An example of data recording in the mdat box of the MP4 file when the above measures are taken will be described with reference to FIG.
FIG. 23 shows the following three data recording examples (1) to (3).
(1) A front-packing method in which metadata (vmet) and key information embedded data (VMD) are recorded before a sample continuously recorded in the mdat box.
(2) A post-packing method in which metadata (vmet) and key information embedded data (VMD) are recorded after a sample continuously recorded in the mdat box.
(3) An inter-sample recording method in which metadata (vmet) and key information embedded data (VMD) are recorded between samples continuously recorded in the mdat box.

The (1) front-filled recording method and (2) post-filled recording method shown in FIG. 23 are specific examples corresponding to the countermeasure (A). That is,
(A) Metadata (vmet) corresponding to key information embedded data (VMD) and key information embedded data (VMD: variant media data) are not recorded between samples.
This is a specific example corresponding to this measure (A).

Further, the (3) inter-sample recording method shown in FIG. 23 is a specific example corresponding to the countermeasure (B) or (C). That is,
(B) When the metadata (vmet) corresponding to the key information embedded data (VMD) and the key information embedded data (VMD: variant media data) are recorded between the samples (sample), the metadata (vmet) and the key The first trun box in which the reproduction control information corresponding to the continuous sample recorded before the information embedded data (VMD) is recorded, the metadata (vmet), and the continuous sample recorded after the key information embedded data (VMD). A second trun box in which corresponding reproduction control information is recorded is set, and a plurality of trun boxes corresponding to consecutive samples are set.
(C) When metadata (vmet) and key information embedded data (VMD) are recorded as subsequent data of one sample in the mdat box, as size information of the sample,
Sample size + (size of metadata (vmet) and key information embedded data (VMD))
Record this total size information.

With such a setting, it is ensured that the reproduction process using the reproduction control information corresponding to the sample recorded in the trun box is executed without any problem.
In any of the above measures (A) to (C), the key information embedded data (VMD: variant media data) and the metadata (vmet) storing the recording position information are continuously stored in the MP4 file. Record.

That is, it is set to record the metadata (vmet) storing the recording position information of the key information embedded data (VMD) immediately before the key information embedded data (VMD: variant media data).
In this case, the metadata (vmet) is set to record the position information indicating that the subsequent position of the metadata (vmet) is the recording position as the recording position information of the key information embedded data (VMD). .

With this setting, there is no need to confirm the recording position information of the key information embedded data (VMD) stored in the metadata (vmet) during the conversion process from the MPEG-2TS to the MP4 format. it can.
That is, in the conversion process from the MPEG-2 TS to the MP4 format, the recording process is performed according to the rule that the metadata (vmet) and the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. With this recording process, it is not necessary to confirm the recording position information of the key information embedded data (VMD) stored in the metadata (vmet), and these data remain as encrypted data in the MPEG-2TS format to the MP4 format data. It becomes possible to record after conversion.

  In addition, as an actual processing example, a setting in which any one of the specific examples (1) to (3) shown in FIG. 23 is fixedly used, and a specific example (1) to (3) in FIG. There is a setting for selectively using one of the methods.

  When any one of the specific examples of (1) to (3) in FIG. 23 is selectively used, the information processing apparatus that executes the conversion process is selected according to, for example, the playlist file selected as the conversion target. It is possible to perform processing such as determining which method of the specific examples of (1) to (3) in FIG.

That is, information specifying in advance how to record the metadata (vmet) and the key information embedded data (VMD) in the MP4 file is recorded in the clip information file.
FIG. 24 shows an example of a clip information file in which this designation information is recorded.
FIG. 24 (1) shows an example of the data structure of a clip information file. The clip information file includes a clip AV stream having the MPEG-2 TS format [xxxx. m2ts] is set as a reproduction control information file associated with the file.

  The clip information file is provided with a reserved area (reserved_for_future_use) in advance, and various data can be set in the reserved area.

  FIG. 24 (2) shows the above-described method designation information in the reserved area, that is, metadata (vmet) and key information embedded data (VMD) in any of the specific examples of (1) to (3) in FIG. It is a figure which shows the example which recorded the information which designates whether it should record to MP4 file.

As shown in FIG. 24 (2), the following information is recorded in the clip information file.
(A) Presence / absence of key information embedded data (is_variant) = 1 bit
(B) Recording method (variant_type) of metadata (vmet) and key information embedded data (VMD) = 8 bits

A specific bit value setting example of each piece of information is shown in FIG.
(A) Presence / absence of key information embedded data (is_variant) = 1 bit
For this item, the bit value is set as follows.
Bit value = 0: No key information embedded data (VMD: variant media data) Bit value = 1: Key information embedded data (VMD: variant media data) exists

In addition, (b) metadata (vmet) and key information embedded data (VMD) recording method (variant_type) = 8 bits
For this item, the bit value is set as follows.
Bit value = 0: Front-packing method [recording area of vmet and VMD (variant media data) set in front of sample] (= method of FIG. 23 (1))
Bit value = 1: Post-packing method [Recording area of vmet and VMD (variant media data) set behind sample] (= method of FIG. 23 (2))
Bit value = 2: The recording area of the inter-sample recording method [vmet and VMD (variant media data) is set between samples (data is set in decoding order and the trun box is divided or the sample size to be recorded in the trun box is set. Sample + vmet + VMD)] (= method of FIG. 23 (3))

Note that the bit value setting example shown in FIG. 25 is an example, and the bit value setting is not limited to this example, and various other settings are possible.
Thus, as described with reference to FIGS. 24 and 25, the following information is recorded in the clip information file.
(A) Presence / absence of key information embedded data (is_variant)
(B) Recording method of metadata (vmet) and key information embedded data (VMD) (variant_type)

  An information processing apparatus for recording an MP4 file generated by executing conversion from the MPEG-2TS format to the MP4 format on a medium is subject to conversion processing and copy processing with reference to information recorded in the clip information file. It can be determined whether or not key information embedded data is included in the clip AV stream file.

Furthermore, when key information embedded data is included in a clip AV stream file to be converted and copied, metadata (vmet) and key information embedded data (VMD) are added to the converted MP4 file. It is possible to determine which method (1) to (3) described with reference to FIG.
The information processing apparatus records the metadata (vmet) and the key information embedded data (VMD) in the mdat box of the MP4 file according to the designation method recorded in the clip information file.

In the above example,
(A) Presence / absence of key information embedded data (is_variant)
(B) Recording method of metadata (vmet) and key information embedded data (VMD) (variant_type)
Although this information has been described as an example of recording in a clip information file, it may be configured to record in other reproduction control information files such as a playlist file or a database file.

[7. Example of Obtaining Key Information Embedded Data (VMD) and Metadata (vmet) from Other Than MPEG-2TS Format Data File (Example 2)]
In the embodiment described above, the MPEG-2 TS file is composed of key information embedded data (VMD) recorded in the mdat box of the MP4 file and metadata (vmet) corresponding to the key information embedded data (VMD). Stored in the TS packet.

  An information processing apparatus that executes processing for converting from the MPEG-2 TS format to the MP4 format extracts key information embedded data (VMD) and metadata (vmet) from the TS packet of the MPEG-2 TS format data, and stores the box of the MP4 file. The process of recording is performed.

Specifically, for example, as described with reference to FIGS. 14 to 16, a clip AV stream file [xxxx.x] storing reproduction target data set in the BDMV directory. m2ts] stores key information embedded data (VMD: variant media data) and key information embedded data (VMD) compatible metadata (vmet), and records this data in the mdat box of the MP4 file. Examples have been described.
This example is referred to as Example 1.

In the second embodiment described below, the key information embedded data (VMD) and the metadata (vmet) are not recorded in the TS packet constituting the MPEG-2 TS format data, but the key information embedded data (VMD) and the metadata (vmet) are not recorded. ) Is used in the embodiment. Specifically, one of the following two processes is performed.
(1) Similar to the MP4 header information file 312 storing vloc data described above with reference to FIGS. 17 to 18, key information embedded data (VMD) and metadata ( vmet).
(2) Key information embedded data (VMD) and metadata (vmet) are acquired from an external device, for example, a copy management server, as in the vloc data acquisition configuration described above with reference to FIG.
Hereinafter, these two configuration examples will be sequentially described.

[7-1. Regarding a configuration example in which a file storing key information embedded data (VMD) and metadata (vmet) is set and used on a medium]
First, a configuration example in which a file storing key information embedded data (VMD) and metadata (vmet) is set and used in a medium will be described with reference to FIG.

  A storage file of key information embedded data (VMD) and metadata (vmet) for recording in the converted MP4 file is additionally recorded in advance on a medium on which MPEG-2TS format data, which is the format conversion target content, is recorded. . The information processing apparatus that executes the conversion process reads this additional recording data and records it in a predetermined box of the MP4 file.

FIG. 26 is a diagram illustrating a directory example of recording data of the medium 450 according to the present embodiment. The medium 450 is a Blu-ray (registered trademark) disk, and is the ROM type BD (Blu-ray (registered trademark) Disc) described above with reference to FIG.
Data according to the BDMV format is recorded on the medium 450. The clip AV stream in this data is MPEG-2TS format data, that is, MPEG-2TS format data composed of TS packets.

A medium 450 having a data recording configuration according to the present embodiment is:
BDMV directory 451,
EXPORT directory 452,
Have these directories.

In the BDMV directory 451, as described above with reference to FIG.
Index files,
Playlist files,
Clip information file,
Clip AV stream file,
For example, these files are recorded.

The index file stores title information as index information applied to the reproduction process.
The playlist file is a file that defines the playback order of contents according to the program information of the playback program specified by the title, and has playback position information and designation information for clip information.
The clip information file is a file specified by the playlist file, and has reproduction position information of the clip AV stream file.
The clip AV stream file is a file storing AV stream data to be reproduced, and image data to be reproduced is recorded in accordance with the MPEG-2TS format.

In this embodiment, the clip AV stream file [xxxx. m2ts] is a conventional general clip AV stream file [xxxx. m2ts].
In the first embodiment described above, as described with reference to FIG. 14, the following data defined in the MP4 format is included.
Data corresponding to key information embedded data (VMD: variant media data),
Vmet compatible data in which key information for decryption of key information embedded data (VMD), position information of VMD, and the like are recorded.
In the second embodiment, the clip AV stream file [xxxx. m2ts] is configured by a TS packet similar to the conventional one not including these data.

A specific example of the clip AV stream file in the second embodiment is shown in FIG.
The clip AV stream file in the second embodiment has the same configuration as the clip AV stream file set in the conventional general BDMV directory, and stores the media key Km-applied encrypted data 231 and the non-encrypted-key identifier storage. In this configuration, the packet 232 is included.

The media key Km applied encrypted data 231 corresponds to the sample data of the MP4 file shown in FIG.
The non-encrypted-key identifier storage packet 232 stores a media key identifier (Km-ID) applied to the decryption of the media key Km-applied encrypted data 231 and recording position information of the media key Km-applied encrypted data 231. It is composed of TS packets.

  Thus, in this embodiment, the clip AV stream file [xxxx. m2ts] is a conventional general clip AV stream file [xxxx. m2ts].

As shown in FIG. 26, the media 450 of this embodiment includes
In addition to the BDMV directory 451,
EXPORT directory 452,
Have

  The EXPORT directory 452 is a directory in which data that is referred to or required when MPEG-2TS format data is converted into MP4 format data and recorded on other media is set.

As shown in FIG. 26, the following files are set in the EXPORT directory 452.
(1) Manifest file 461,
(2) MP4 header information file 462,
(3) vdat file 463 (= key information embedded data (VMD) & metadata (vmet) storage file)

The manifest file 461 is a file that is referred to when copying data between media.
When data is copied between media, there is a copy management system that permits copying on condition that copy permission information is received from an external management server.
The manifest file 461 is a copy control management file (MCMF: Managed Copy Manifest File) used when performing data copying according to this copy management system.

For example, as a copy process according to the above copy management system, when the information processing apparatus performs a copy process of converting MPEG-2TS format data recorded on the first medium into the MP4 format and recording it on the second medium. Copy permission information from an external management server must be received.
In processing according to this copy management system, the information processing apparatus first reads a manifest file (MCMF: Managed Copy Manifest File) 461 recorded on the first medium.

  The manifest file (MCMF) 461 is played as access information (URL) of the management server that provides copy permission information of the content recorded on the first medium in which the copy source data is recorded, and data information (dealManifest) that allows copying. List file names are recorded. Only data specified by the playlist file name recorded in the manifest file (MCMF) 461 is copy-permitted data.

  When the manifest file (MCMF) 461 is recorded on the first medium in which the copy source data is recorded, the information processing apparatus receives the copy permission information from the management server, and plays the recorded information in the manifest file (MCMF) 461. Data specified by the list file name is selected from the first medium and recorded on the second medium.

The manifest file 461 records correspondence data between the playlist file, the MP4 header information file 462, and the vdat file 463, in addition to the identifier of the playlist file that is allowed to be copied.
That is, when one playlist file is selected as the copy target, the identifier of the file storing the data specific to the MP4 file necessary for copying the data associated with the playlist file is recorded.

  Specifically, for example, a moov box set in an MP4 file, an MP4 header information file 462 in which data for moof box recording is recorded, and a vdat file 463 for mdat box recording set in the MP4 file (= The file identifier of key information embedded data (VMD) & metadata (vmet) storage file) is recorded in association with the playlist file.

The EXPORT directory shown in FIG. 26 shows only one MP4 header information file 462 and one vdat file (key information embedded data (VMD) & metadata (vmet) storage file) 463. A plurality of files can be set in the EXPORT directory 452.
These are associated with any of the playlist files that are allowed to be copied.

The information processing apparatus that executes the copy process first selects one playlist file recorded in the manifest file 461 as a copy target.
Next, an MP4 header information file and a vdat file (key information embedded data (VMD) & metadata (vmet) storage file) associated with the selected playlist file are selected based on the record information of the manifest file. .

The selected MP4 header information file 462 cannot be obtained directly from the MPEG-2TS format data or the database file set in the BDMV directory or difficult to obtain at the time of data copy processing involving conversion of MPEG-2TS to MP4 format. MP4 specific data is recorded.
For example, data to be recorded in a moov box or a moof box constituting an MP4 file is recorded.

The MP4 header information file 462 also stores vloc box storage data set in the MP4 format file.
The information processing apparatus that executes the copy process can acquire the vloc box storage data recorded in the MP4 header information file 312 and record the acquired data in the vloc box of the MP4 file generated by the conversion process.

  The vloc box recording data in accordance with the MP4 format is recorded in the MP4 header information file 462 in the EXPPORT directory shown in FIG. 26, so that the MP4 format can be used for data copying involving conversion processing from the MPEG-2TS format to the MP4 format. Thus, it is possible to reliably acquire data for storing the vloc box in accordance with the above-mentioned regulations.

A vdat file (key information embedded data (VMD) & metadata (vmet) storage file) 463 shown in FIG. 26 is a file storing the following data.
(1) Key information embedded data (VMD: variant media data),
(2) metadata (vmet) that records an identifier of a key applied to decryption of key information embedded data (variant media data) and recording position information of the key information embedded data (variant media data);
Each of these data is stored as encrypted data that can be directly recorded in the MP4 file.

  The information processing apparatus that executes the copy process selects one playlist file recorded in the manifest file 461 as a copy target, and a vdat file (key information embedded data (VMD)) associated with the selected playlist file. & Metadata (vmet) storage file) is selected based on the record information of the manifest file.

The information processing apparatus extracts the key information embedded data (VMD) and the metadata (vmet) stored in the selected vdat file (key information embedded data (VMD) & metadata (vmet) storage file) and stores the MP4 file. Record in the mdat box.
The key information embedded data (VMD) and the metadata (vmet) are stored in the vdat file 463 as encrypted data, and the encrypted data is recorded in the MP4 file as it is without being decrypted.

  With reference to FIG. 28, a data flow in a data copy process involving format conversion when an MP4 file is generated using BDMV format data including the MPEG-2TS format data shown in FIG. 26 will be described.

  FIG. 28 shows a clip AV stream [xxxx.x consisting of MPEG-2TS format data described with reference to FIG. The correspondence relationship between the recording data of the medium 450 including m2ts] and the recording destination of the MP4 file is shown.

A clip AV stream file including reproduction target data such as images and sounds is a clip AV stream file [01001. m2ts] 464.
Clip AV stream file [01001. m2ts] 464 is a clip AV stream file including reproduction target data of a playlist file selected as a copy target in accordance with the manifest file 461.

The clip AV stream file 464 includes the TS packet sequence described with reference to FIG.
That is, as with the conventional clip AV stream file set in the BDMV directory, the media key Km-applied encrypted data 231 and the unencrypted-key identifier storage packet 232 are included as the payload.

  As shown in FIG. 28, the data stored in the clip AV stream file 464 is recorded in the sample box set in the mdat box of the MP4 file.

Further, a vdat file (key information embedded data (VMD) & metadata (vmet) storage file) 463 including reproduction target data of a playlist file selected as a copy target according to the manifest file 461 is selected from the EXPPORT directory.
The data stored in the vdata file (key information embedded data (VMD) & metadata (vmet) storage file) 463 selected from the EXPORT directory is stored in the vmet box and VMD (variant media data) box set in the mdat box of the MP4 file. Record.

The metadata (vmet) acquired from the vdat file (key information embedded data (VMD) & metadata (vmet) storage file) 463 is recorded in the vmet box of the MP4 file.
Furthermore, VMD (variant media data), which is key information embedded data acquired from the vdata file (key information embedded data (VMD) & metadata (vmet) storage file) 463, is recorded in the VMD (variant media data) box of the MP4 file. To do.

  The data copy processing for these vmet and VMD boxes is recorded in each box without decrypting the encrypted data recorded in the vdat file (key information embedded data (VMD) & metadata (vmet) storage file) 463. It is performed as a process.

Further, the vloc data recorded in the MP4 header information file 462 set in the EXPPORT directory is recorded in the vloc box set in the traf box in the moof box of the MP4 file.
The vloc data recorded in the MP4 header information file 462 set in the EXPPORT directory is data according to the data structure defined in the MP4 format, and may be recorded in the vloc box of the MP4 file as it is.

With these processes, the following data recording according to the MP4 format rules is completed.
VMD (variant media data) data which is key information embedded data,
Vmet data recording key information (key identifier) for decrypting data recorded in the VMD box and position information of the VMD box;
vloc data including a key identifier (Kmet-ID) of a key (Kmet) for decrypting data recorded in the vmet box, and recording position information of the vmet box;
These data recordings are performed reliably.

  In addition to these data, the apparatus that executes the format conversion and data recording process executes a process of recording various metadata in each box of the MP4 file using data set in the directory shown in FIG. To do.

With these processes, the data copy accompanied by the conversion process from the MPEG-2 TS format to the MP4 format is completed.
The MP4 file generated by this data copy processing is a file having the following data according to the MP4 format.
VMD (variant media data) data which is key information embedded data,
Vmet data recording key information (key identifier) for decrypting data recorded in the VMD box and position information of the VMD box;
vloc data including a key identifier (Kmet-ID) of a key (Kmet) for decrypting data recorded in the vmet box, and recording position information of the vmet box;

Therefore, it is possible to analyze the key applied to the decryption from the decrypted / reproduced data using the MP4 file generated by the copy process.
That is, as described above with reference to FIGS. 10 and 11, the key applied to the decryption can be analyzed from the decryption result data. For example, when an illegal copy is distributed, the copy data becomes the copy source. It is possible to trace the device that has generated (decoded) data.

  FIG. 29 is a diagram for explaining the correspondence between the format data in the conversion process from the MPEG-2 TS format data to the MP4 format data, and the correspondence between the data recorded in the mdat box of the MP4 file and the recording source data. Showing the relationship.

FIG. 29 (4) shows the converted MP4 file. The reproduction target data is recorded in the mdat box. The following data is recorded in the mdat box.
(A) Sample 476
(B) Metadata (vmet) 477
(C) Key information embedded data (VMD: variant media data) 478
The sample 476 stores conventional normal encrypted image data in which key information is not embedded.

Note that the data array of the mdat box of the MP4 file shown in FIG. 29 (4) is an example according to the front-packing method described above with reference to FIG. 23 (1).
In addition to this setting, various settings such as the post-packing method shown in FIG. 23 (2) and the inter-sample recording method shown in FIG. 23 (3) are possible.

In FIG.
(A) Sample 476
(B) Metadata (vmet) 477
(C) Key information embedded data (VMD: variant media data) 478
The supply source of each of these data is shown.
(A) The sample 476 is obtained from the PES payload 472 converted into the PES layer, which is the source of the TS packet 471 that is a constituent packet of the MPEG-2 TS file.
(B) The metadata (vmet) 477 is supplied from the vdat file, and the vmet data 473 of the vdat file is recorded in the MP4 file as shown in the figure.
(C) The vdat file is also supplied from the key information embedded data (VMD: variant media data) 478, and the key information embedded data (VMD) 474 of the vdat file is recorded in the MP4 file as shown in the figure.

As described above, each of the above data is recorded in the mdat box of the MP4 file.
However, as described above, the recording position of the metadata (vmet) in the MP4 format is recorded in the vloc box, and it is necessary to record the metadata (vmet) at a position corresponding to the vloc recording information. .
An information processing apparatus that performs conversion from the MPEG-2TS format to the MP4 format and generates an MP4 file needs to calculate the recording position of this metadata (vmet).

  A vdat file (key information embedded data (VMD) & metadata (vmet) storage file) 463 set in the EXPPORT directory shown in FIG. 26 includes metadata (vmet) and key information embedded data (VMD: variant media data). ) Are continuously recorded.

An information processing apparatus that performs conversion processing from the MPEG-2 TS to the MP4 format includes a set of metadata (vmet) and a key from a vdat file (key information embedded data (VMD) & metadata (vmet) storage file) 463. Information embedded data (VMD) needs to be sequentially extracted and copied and recorded at a predetermined position in the MP4 file.
That is, the information processing apparatus performs a process of accurately extracting a set of (vmet + VMD) data from a plurality of vmet and VMD data strings continuously recorded in the vdat file 463 and recording the data at a predetermined position in the MP4 file. Is required.

A specific processing example for executing this data extraction will be described with reference to FIG.
30 extracts one (vmet + VMD) data from the data continuously recorded in the vdat file 463 using the record information of the run box recorded in the MP4 file described above with reference to FIG. It is a figure explaining the process recorded on the predetermined position of MP4 file.

As described above with reference to FIG. 22, the moof box, which is an MP4 file metadata storage box, contains images and audio stored in an mdat box, which is a reproduction data storage box, as shown in FIG. A play box for recording reproduction time information (sample_duration) for each piece of reproduction data (sample (sample)) and sample size information (sample_size) is set.
Note that the record data of the trun box set in the MP4 file is recorded in advance in the MP4 header information file 462 set in the EXPORT directory in the directory structure described with reference to FIG.

As shown in FIG. 30, byte offset information of each sample is recorded in the trun box.
The byte offset information recorded in the trun box indicates the distance from the head of the mdat box recorded following the moof box in which the trun box is recorded to each sample recording position.
In this embodiment, the byte offset information recorded in the trun box includes
Offset information up to the recording position of each set including metadata (vmet) and key information embedded data (VMD: variant media data) is also included.

With reference to FIG. 30, an example of a recording position determination process for key information embedded data (VMD: variant media data) and metadata (vmet) using offset information recorded in the trun box will be described.
An information processing apparatus that performs conversion from MPEG-2TS format data to MP4 format and generates an MP4 file, stores an MP4 header information file 462 recorded on a medium on which MPEG-2TS format data, which is the content to be converted, is recorded. Acquire and read the trun box recorded in the MP4 header information file 462.

FIG. 30A shows an example of recorded data in the trun box.
In the trun box, byte offset information of each sample is recorded.

In the present embodiment, the sample includes a set of key information embedded data (VMD: variant media data) and metadata (vmet).
That is, in the trun box, for example, in the MP4 file shown in FIG. 30C, each metadata (vmet) recorded in the mdat box at the subsequent position of the moof box 479 storing the trun box is stored in the moof box 479. The subsequent offset (separation distance) from the mdat box head position is recorded.
Specifically, byte offsets (OFSa, OFSb...) Shown in FIG. 30C are recorded.

  An information processing apparatus that performs conversion from MPEG-2TS format data to MP4 format and generates an MP4 file sequentially reads byte offset information from the trun box recorded in the MP4 header information file 462. The information processing apparatus executes data extraction by determining a data extraction area from the vdat file 463 (= key information embedded data (VMD) & metadata (vmet) storage file) according to the read offset information.

An example of data extraction from the vdat file shown in FIG. 30B will be described.
The information processing apparatus that executes format conversion uses, for example, one byte offset information (OFSa) recorded in the trun box shown in FIG. 30A as the data extraction start point, and further the next byte recorded in the trun box. Data extraction is executed using the offset information (OFSb) as a data extraction end point.
By this data extraction process, a set of one metadata (vmet) and key information embedded data (VMD) can be accurately selected and extracted.

The information processing apparatus that executes format conversion records the data extracted from the vdat file 463 in this way in the mdat box of the MP4 file. Also in the recording process, recording is performed at a recording position according to the offset information recorded in the trun box.
The offset information recorded in the trun box is recorded as position information that matches the vmet recording position defined in the vloc box.

  The information processing apparatus that executes format conversion refers to the byte offset information of the trun box in this way to determine the data extraction position from the vdat file, so that exactly one metadata (vmet) and key information embedded data ( VMD) set can be extracted.

In addition to the metadata (vmet) and key information embedded data (VMD), sample data in which key information is not embedded is recorded in the MP4 file. As described with reference to FIG. 23, there are the following settings.
(1) A front-packing method in which metadata (vmet) and key information embedded data (VMD) are recorded before a sample continuously recorded in the mdat box.
(2) A post-packing method in which metadata (vmet) and key information embedded data (VMD) are recorded after a sample continuously recorded in the mdat box.
(3) A sample-to-sample recording method in which metadata (vmet) and key information embedded data (VMD) are recorded between samples without key information embedded continuously recorded in the mdat box.

  The recording positions of the metadata (vmet) and the key information embedded data (VMD) are set differently depending on each of these methods, and the offset information recorded in the run box must be data corresponding to each method.

Further, the number of trun boxes is not limited to one, and may be divided into a plurality of trun boxes.
For example, it is possible to divide the trun box using the sample recording position without embedding key information as a division position.
Further, for example, offset information regarding a set of metadata (vmet) and key information embedded data (VMD) up to one or a predetermined upper limit number is recorded in one trun box, and next metadata (vmet) exceeding the upper limit number and The offset information regarding the key information embedded data (VMD) and subsequent sets may be set to be recorded in the second trun box.

[7-2. Example of processing for acquiring (downloading) a vdat file storing key information embedded data (VMD) and metadata (vmet) from an external device and recording it in an MP4 file]
Next, a device that executes conversion processing from the MPEG-2TS format to the MP4 format obtains (downloads) a vdat file storing key information embedded data (VMD) and metadata (vmet) from an external device, for example, a copy management server. An example of processing to be recorded in the MP4 file will be described.

  FIG. 31 is a diagram illustrating processing executed by the information processing device 480 that executes conversion processing from the MPEG-2TS format to the MP4 format.

  The information processing apparatus 480 mounts a first medium 481 storing MPEG-2TS format data serving as copy source data and a second medium 482 serving as a copy destination medium for recording MP4 format data after format conversion, and converts the format. And start the copy process.

A clip AV stream file recorded on the first medium 481 storing MPEG-2 TS format data serving as copy source data is composed of a TS packet sequence similar to conventional BDMV format data.
That is, as described with reference to FIG. 27, the media key Km-applied encrypted data 231 and the TS packet storing the non-encrypted-key identifier storage packet 232 are included as the payload.

  The information processing device 480 reads the clip AV stream file recorded on the first medium 481, other reproduction control information files, and database files, and records them on the second medium 482 as data of each box of the MP4 file.

Specifically, the read data from the clip AV stream file is recorded in the sample box set in the mdat box of the MP4 file.
Further, necessary information is acquired and recorded in the moov box and moof box of the MP4 file from the file set in the BDMV directory or the file set in the EXPPORT directory.

  Furthermore, the information processing device 480 sends the data identifier (eg, content ID or playlist ID) of the data to be copied to the external device, eg, the server 490 that executes copy management, or the first medium. Identification information that can specify copy data such as a media identifier is transmitted.

After confirming the copy target data, the server 480 transmits vloc data, metadata (vmet), and key information embedded data (VMD) corresponding to the confirmation data to the information processing device 480.
The information processing device 480 records the vloc data received from the server 490 in the vloc box in the moof box of the MP4 file.
The vloc data provided by the server 490 is data according to the data structure defined in the MP4 format, and may be recorded in the vloc box of the MP4 file as it is.

Furthermore, the information processing device 480 records the metadata (vmet) received from the server 490 and the key information embedded data (VMD) in the mdat box of the MP4 file.
Specifically, each of these data is recorded in a vmet box and a VMD (variant media data) box set in the mdat box of the MP4 file.

That is, as described above with reference to FIG.
The payload of the TS packet storing the vmet compatible data is recorded in the vmet box of the MP4 file. further,
The payload of a TS packet storing corresponding data of VMD (variant media data) which is key information embedded data is recorded in a VMD (variant media data) box of the MP4 file.

  The recording (copying) processing of each data of vmet and VMD may be recorded in each box as it is without decrypting the encrypted data received from the server.

Through these processes, the MP4 file storing the following data in accordance with the MP4 format specification is recorded in the second medium 482 for each of the following boxes.
VMD box = VMD (variant media data) data which is key information embedded data,
vmet box = vmet data in which key information (key identifier) for decrypting data recorded in the VMD box and position information of the VMD box are recorded;
vloc box = vloc data including a key identifier (Kmet-ID) of a key (Kmet) for decrypting data recorded in the vmet box, and recording position information of the vmet box,
On the second medium 482, an MP4 file having a box storing the MP4 format definition data is recorded.

With these processes, the data copy accompanied by the conversion process from the MPEG-2 TS format to the MP4 format is completed.
In the MP4 file generated by this data copy process, key information embedded data (VMD: variant media data) data, vmet data, vloc data, and these data according to the MP4 format are recorded.

  Therefore, the key applied to the decryption can be analyzed based on the decryption result data described above with reference to FIGS. 10 and 11. For example, when an illegal copy is distributed, the data that is the copy source from the copy data Can be traced.

[8. Configuration example of information processing apparatus]
Next, an outline of the configuration and processing of the information processing apparatus according to an embodiment of the present disclosure will be described.
FIG. 32 is a block diagram illustrating a configuration example of the information processing apparatus 500 according to an embodiment of the present disclosure. The information processing apparatus 500 reads out data recorded on the first medium 510 which is an information recording medium such as a BD (Blu-ray (registered trademark) Disc), for example, and the second medium 520 is an information recording medium such as a flash memory. So-called copy processing is performed.
Alternatively, a process of recording data input via the communication unit 503 on the second medium 520 such as a flash memory is performed.

  The data format of data input via the first medium 510 or the communication unit 503 is a first format, and the format of data recorded on the second medium 520 is a second format.

  The information processing apparatus converts the first format data into the second format data when recording the first format data input via the first medium 510 or the communication unit 503 in the second medium 520 such as a flash memory. The process to do is performed.

For example, the first format input from the first medium 510 or the communication unit 503 is the MPEG-2TS format, and the second format that is the recording format of the second medium is the MP4 format.
The information processing apparatus 500 executes format conversion for converting the MPEG-2 TS format into the MP4 format during the data recording process on the second medium 520.

  32, the information processing apparatus 500 includes a control unit 501, an input unit 502, a communication unit 503, a storage unit 504, an output unit 505, a first media IF (interface) 506, a data buffer 507, and a data conversion unit 508. And a second media IF 509.

  The control unit 501 performs control of data processing executed in the information processing apparatus 500 such as data recording / playback using media and data copy processing between media. These controls are performed according to a program stored in the storage unit 504, for example. Done.

The input unit 502 is an input unit such as a switch, button, or touch panel that can be operated by the user, and is an input unit that inputs instructions for various processes such as reproduction, copying, and recording.
Further, the input unit 502 may have a configuration including an imaging unit that inputs an image or sound to be recorded on a medium, and a microphone.
The communication unit 503 communicates with, for example, an external server or an external device, and is used for various communication processes such as acquisition of recording data for media, control information related to recording data, or permission information for copy processing.

The storage unit 504 is used for a program executed by the control unit 501, a storage area for parameters used for program execution, and a work area for program execution.
Specifically, it is also used as an area for temporarily storing data read from the first medium 510 when data is recorded on the second medium 520 or data input via the communication unit 503.
The storage unit 504 is configured by a medium such as a RAM, a ROM, or an HDD, for example.
The output unit 505 is used for output processing of reproduction data from the medium, and further used for displaying the progress of data recording processing on the second medium 520 and displaying messages to the user, and is configured by a display, a speaker, and the like.

  The first media interface (IF) 506 is a data recording / reproducing unit that accesses the first medium 510 such as a BD (Blu-ray (registered trademark) Disc) and performs data recording and data reading on the first medium 510. A functional interface.

The data buffer 507 is a buffer that temporarily stores read data from the first medium 510 and data input from the communication unit 503. For example, data to be recorded on the second medium 520 is temporarily stored.
The data conversion unit 508 records data recorded in the first medium 510 or data in the first format, which is the format of data input via the communication unit 503, in the second medium 520 that is the data recording destination. A format conversion process for converting to a second format which is a format is executed.

  The second media interface (IF) 509 is an interface that functions as a data recording / reproducing unit that accesses the second medium 520 and performs data recording or reading processing on the second medium 520.

As described above, the information processing apparatus 500 performs processing of recording data in the first format input via the first medium 510 or the communication unit 503 in the second medium 520 such as a flash memory. In this process, a process for converting the first format data into the second format data is performed.
The first format is, for example, the MPEG-2TS format, and the second format is MP4 format data.

  Note that the information processing apparatus 500 acquires data that cannot be acquired from the first medium 510 from an external server via the communication unit 503, and receives the read data from the first medium 510 and the reception acquired via the communication unit 503. You may perform the process which records data on the 2nd medium 520 collectively.

In the configuration shown in FIG. 32, the first medium 510 is, for example, a BD (Blu-ray (registered trademark) Disc). The second medium 520 is a flash memory such as an SD card, for example.
The first medium 510 and the second medium 520 are not limited to the above combinations, and various combinations are possible.

Next, the detailed configuration of the data conversion unit 508 will be described with reference to FIG.
As shown in FIG. 33, the data conversion unit 508 includes a data analysis unit 551, an image data conversion unit 552, an audio data conversion unit 553, a caption data conversion unit 554, a key information embedded data related information conversion unit 555, and a multiplexing process execution. Part 556.

The data analysis unit 551 is based on the read data from the first medium 510 stored in the data buffer 507 or the identifier (PID: program ID) set in the data (packet) input via the communication unit 503. Each data (packet)
image data,
Audio data,
Subtitle data,
Key information embedded data (VMD: variant media data),
Metadata (vmet),
These are classified into each type of data.

  The data analysis unit 551 outputs image data to the image data conversion unit 552, outputs audio data to the audio data conversion unit 553, outputs subtitle data to the subtitle data conversion unit 554, and stores key information embedded data (VMD: variant). media data), metadata (vmet), and vloc data are output to the key information embedded data-related information conversion unit 555.

  The image data conversion unit 552, the audio data conversion unit 553, the subtitle data conversion unit 554, and the key information embedded data related information conversion unit 555 convert the first format that is the data format of the input data, for example, MPEG-2TS format data into the second format. A process of converting to the second format to be recorded on the medium 520, specifically, for example, MP4 format data is executed.

That is, the image data conversion unit 552 generates MP4 format image data, which is a data recording format for the second medium 520, and outputs the image data to the multiplexing processing execution unit 556.
The audio data conversion unit 553 generates MP4 format audio data and outputs it to the multiplexing process execution unit 556.
The caption data conversion unit 554 generates caption data in MP4 format and outputs it to the multiplexing process execution unit 556.

The key information embedded data related information conversion unit 555 generates or acquires MP4 format key information embedded data (VMD) and metadata (vmet), and vloc data, and outputs the generated data to the multiplexing processing execution unit 556.
The key information embedded data related information conversion unit 555 does not decrypt the key information embedded data (VMD) and the metadata (vmet) stored in the TS packet in the MPEG-2 TS format data, and remains the encrypted data. Set as MP4 format data.

The multiplexing process execution unit 556
(A) second format (MP4) format image data generated by the image data conversion unit 552;
(B) audio data in the second format (MP4) format generated by the audio data converter 553;
(C) Subtitle data in the second format (MP4) generated by the subtitle data conversion unit 554,
(D) The key information embedded data (VMD), metadata (vmet), and vloc data in the second format (MP4) format generated or acquired by the key information embedded data related information conversion unit 555,
(E) data extracted from, for example, a reproduction control information file stored in the storage unit 504;
Multiplex processing of each of these data is executed to generate recording data in the second format (MP4) format.

  Data generated by the multiplexing process execution unit 556 is recorded on the second medium 520 via the second media interface 509.

  In this way, the information processing apparatus 500 uses the second medium 520 as the recording format of the second medium 520, using the recording data of the first medium 510 or the data of the first format (BDMV format) input via the communication unit 503. A process of converting to the format (MP4) and recording on the second medium 520 is executed.

  Next, a hardware configuration example of an information processing apparatus that can be applied as a reproduction apparatus, an information generation apparatus, and a recording apparatus will be described with reference to FIG.

  A CPU (Central Processing Unit) 601 functions as a data processing unit that executes various processes in accordance with a program stored in a ROM (Read Only Memory) 602 or a storage unit 608. For example, processing according to the sequence described in the above-described embodiment is executed. A RAM (Random Access Memory) 603 stores programs executed by the CPU 601 and data. These CPU 601, ROM 602, and RAM 603 are connected to each other by a bus 604.

  The CPU 601 is connected to an input / output interface 605 via a bus 604, and an input unit 606 including various switches, a keyboard, a mouse, and a microphone, and an output unit 607 including a display and a speaker are connected to the input / output interface 605. Yes. The CPU 601 executes various processes in response to commands input from the input unit 606 and outputs the processing results to the output unit 607, for example.

  The storage unit 608 connected to the input / output interface 605 includes, for example, a hard disk and stores programs executed by the CPU 601 and various data. The communication unit 609 functions as a data communication transmission / reception unit via a network such as the Internet or a local area network, and further as a broadcast wave transmission / reception unit, and communicates with an external device.

  A drive 610 connected to the input / output interface 605 drives a removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory such as a memory card, and executes data recording or reading.

  Data encoding or decoding can be executed as processing of the CPU 601 as a data processing unit, but a configuration including a codec as dedicated hardware for executing encoding processing or decoding processing may be adopted.

For example, an information processing apparatus that executes data generation and recording processing according to the MPEG-2 TS format having the TS packet sequence described above with reference to FIG. 14 includes a data processing unit that generates MPEG-2 TS format data. Have
The data processor
A packet storing key information embedded data (VMD: variant media data) defined in the MP4 format as encrypted data;
A packet in which metadata (vmet) storing an identifier of a key applied to decryption of key information embedded data (VMD) is stored as encrypted data.
Generated as TS packets that make up MPEG-2TS,
Furthermore, the data generated by executing processing for generating an MP4 header information file storing vloc data, which is storage data of a vloc box defined in the MP4 format, as a storage box for a metadata (vmet) decryption key To the media.

As specific processing, for example, first, encrypted data is generated by applying different keys to the configuration data of each image frame. Note that encrypted data using a plurality of different keys may be generated for the same area.
For example,
Area 1 = encrypted with media key Km
Area 2 = encrypted with media key Km and segment key Ksa
Area 2 = encrypted with media key Km and segment key Ksb,
Area 2 = encrypted with media key Km and segment key Ksc,
Area 3 = encrypted with media key Km and segment key Ksb,
Area 3 = encrypted with media key Km and segment key Kse,
Area 3 = encrypted with media key Km and segment key Ksf,
Area 4 = encrypted with media key Km and segment key Ksg,
...
In this way, data encrypted with various key combinations is generated for each area.
Note that the identifier of the key information applied to decryption is included in the image data that is encrypted by applying any of the segment keys Ksx.

Next, each encrypted data is stored in a TS packet.
Data encrypted by applying any one of the segment keys Ksx is stored in a packet as key information embedded data (VMD: variant media data), and the packet header is a key information embedded data (VMD) storage packet. The indicated packet identifier is set as the PID.

Further, a metadata (vmet) storage packet is set before the key information embedded data (VMD) storage packet.
In the metadata (vmet) storage packet, the key identifier (Km-ID, Ksx-ID) and key information embedded in the decryption of the encrypted data stored in the subsequent key information embedded data (VMD) storage packet are embedded. The recording position information of data (VMD) is stored as encrypted data. The key applied to the encryption process is the Vmet key.
In the packet header, a packet identifier indicating a metadata (vmet) storage packet is set as a PID.

  Further, an ECM_PID packet storing the identifier of the vmet key as plain text data is set before the metadata (vmet) storage packet.

Note that an unencrypted-key identifier storage packet in which a media key identifier (Km-ID) is stored as unencrypted data (plain text) is placed in a preceding stage of a packet storing data encrypted only with the media key Km. Set.
In this way, MPEG-2TS format data having the configuration shown in FIG. 14 is generated.
This data is recorded on a disc such as a BD.

In addition, the manifest file 311 and the MP4 header information file described with reference to FIG. 17 are further recorded on a disc such as a BD.
The manifest file 311 is a file provided by the management server that executes the copy management process, and records the identifier of the playlist file that is allowed to be copied and the identifier of the MP4 header information file that is associated with each playlist file. Yes.
The MP4 header information file 312 is a file storing vloc box recording data of an MP4 file.

  Further, according to the second embodiment described above with reference to FIG. 26 and others, in the case of setting to record a vdat file, a vdat file in which key information embedded data (VMD) and metadata (vmet) are recorded is generated. Record in the EXPORT directory.

[9. Processing sequence executed by information processing apparatus]
Next, the information processing apparatus shown in FIG. 32, that is, the information processing apparatus 500 that executes processing for converting, for example, MPEG-2TS format data read from the first medium 510 into MP4 format data and recording it in the second medium 520 is performed. Will be described with reference to the flowchart shown in FIG.

  The flowchart shown in FIG. 35 shows the overall processing of the process in which the information processing apparatus shown in FIG. 32 converts, for example, MPEG-2TS format data read from the first medium 510 into MP4 format data and records it in the second medium 520. It is a flowchart explaining a sequence.

Note that the flowchart shown in FIG. 35 is executed by the data conversion unit 508 or the like according to a program stored in the storage unit 504, for example, under the control of the control unit 501 of the information processing apparatus.
Processing of each step shown in the flow will be described sequentially.

(Step S101)
First, the information processing apparatus refers to the manifest file and acquires a playlist file to be converted that is permitted to be copied.
As described above with reference to FIG. 17, the manifest file is a file that is referred to when data is copied between media. When data is copied between media, there is a copy management system that permits copying on condition that copy permission information is received from an external management server. The manifest file is a copy control management file (MCMF: Managed Copy Manifest File) used when performing data copying according to the copy management system.

  The manifest file (MCMF) is a playlist as access information (URL) of a management server that provides copy permission information of content recorded on the first medium in which copy source data is recorded, and data information (dealManifest) that allows copying. File names etc. are recorded. Only data specified by the playlist file name recorded in the manifest file (MCMF) is copy-permitted data.

In the manifest file, in addition to the identifier of the playlist file that is allowed to be copied, correspondence data between the playlist file and the MP4 header information file shown in FIG. 17 is recorded.
That is, when one playlist file is selected as a copy target, MP4 file-specific data necessary for copying data corresponding to the playlist file, for example, MP4 to be selected as data for recording moov box or moof box The identifier of the header information file is recorded.

  In the above description with reference to FIG. 17, the manifest file has been described as being recorded on the medium on which the MPEG-2TS format data is recorded. However, the manifest file may be acquired from an external server, for example.

  In step S101, the information processing apparatus determines a playlist file to be converted that is permitted to be copied by referring to a medium on which MPEG-2TS format data is recorded or a manifest file acquired from a server, and the playlist file is determined from the medium. get.

(Step S102)
Next, in step S102, the information processing apparatus searches for an MP4 header information file (a file including vloc-compatible data) associated with the playlist file to be converted with reference to the manifest file. It is the MP4 header information file shown in FIG.

(Step S103)
In the search process in step S102, it is determined whether there is an MP4 header information file (a file including vloc-compatible data) associated with the playlist file to be converted. If there is, the process proceeds to step S104. Proceed to step S105.

(Step S104)
If there is an MP4 header information file (file containing vloc-compatible data) associated with the playlist file to be converted, the information processing apparatus, in step S104, determines the MP4 header information associated with the playlist file to be converted. Read a file (a file containing vloc compatible data) from the media.

(Step S105)
Next, in step S105, the clip information file specified by the playlist file selected as the conversion target and the clip AV stream file associated with the clip information file are acquired.

(Step S106)
Next, in step S106, the image, audio, subtitle, key information embedded data (VMD: variant media data), and metadata (vmet) data stored in the clip AV stream file are separated for each data type. This process is a process executed by the data analysis unit 551 of the data conversion unit 508 shown in FIG.

(Step S107)
Next, in step S107, format conversion of each data of image, audio, caption, key information embedded data (VMD: variant media data), and metadata (vmet) is performed and stored in each mdat box of the MP4 file. Generate data.

This processing is executed by the image data conversion unit 552, the audio data conversion unit 553, the caption data conversion unit 554, and the key information embedded data related information conversion unit 555 of the data conversion unit 508 shown in FIG.
Note that the key information embedded data (VMD) and the metadata (vmet) are extracted from the MPEG-2TS format data as encrypted data without being decrypted or re-encrypted and set as MP4 format data.

(Step S108)
Next, in step S108, the contents of the playlist file, clip information file, and MP4 header information file are analyzed to generate data to be stored in the metadata recording box (moov / moof) of the MP4 file.
This processing is executed by the multiplexing processing execution unit 556 of the data conversion unit 508 shown in FIG. 33 under the control unit 501 shown in FIG.

In the process of step S108, the vloc correspondence data acquired from the MP4 header information file associated with the playlist file to be converted is recorded in the vloc box set in the traf box of the moof box of the MP4 file. Set as data.
Finally, the generated MP4 file is recorded on the second medium, and the process is completed.

Note that in the generation and recording processing of the recording data for the mdat box of the MP4 file in step S107, the recording positions of the key information embedded data (VMD: variant media dta) and the metadata (vmet) are shown in FIG. As described with reference to FIG. 25, the processing referring to the designation information of the clip information file is performed.
This processing sequence will be described with reference to the flowchart shown in FIG.

(Step S201)
First, in step S201, the information processing apparatus refers to the clip information file and acquires the following information.
(A) Key information embedded data (VMD: variant media data) presence / absence information (is_variant),
(B) vmet, VMD setting information (variant_type),
Each piece of information is acquired with reference to the clip information file described with reference to FIG.
These pieces of information include, for example, information according to the bit value setting shown in FIG.

(Step S202)
Next, the information processing apparatus records the clip information file in step S202.
(A) Key information embedded data (VMD: variant media data) presence / absence information (is_variant),
(B) vmet, VMD setting information (variant_type),
Based on these pieces of information, the recording positions of metadata (vmet) and key information embedded data (VMD: variant media data) are determined.

  That is, for the metadata (vmet) acquired from the clip AV stream file which is the MPEG-2TS format data of the copy source and the key information embedded data (VMD: variant media data), the recording position in the mdat box of the MP4 file is set. Determine and record.

Specifically, a process of determining and recording a relative position with a sample generated from acquired data from a clip AV stream file is performed.
That is, the following methods shown in FIG.
(1) Pre-packing method (2) Back-packing method (3) Inter-sample recording method According to any one of the methods specified in the clip information file, metadata (vmet) and key information embedded data (VMD: variant media) data) is recorded in the mdat box of the MP4 file.

  In the flow described with reference to FIG. 35, the process of acquiring the vloc compatible data to be recorded in the vloc box of the MP4 file from the MP4 header information file recorded on the medium on which the MPEG-2TS format data is recorded has been described.

As described above, the vloc compatible data recorded in the vloc box of the MP4 file can be obtained from an external server as described with reference to FIG. As described above, the information may be generated in an information processing apparatus that performs format conversion and copy processing.
A sequence in the case of performing each of these processes will be described with reference to flowcharts shown in FIGS.
37 and 38 are similar to the flowchart shown in FIG. 35, for example, according to a program stored in the storage unit 504 under the control of the control unit 501 of the information processing apparatus shown in FIG. And so on.

  First, with reference to the flowchart shown in FIG. 37, the processing sequence in the case of acquiring the vloc corresponding data recorded in the vloc box of the MP4 file from an external server will be described. Processing of each step shown in the flow will be described sequentially.

(Step S301)
First, the information processing apparatus refers to the manifest file and acquires a playlist file to be converted that is permitted to be copied.
As described above with reference to FIG. 17, the manifest file is a file that is referred to when data is copied between media, and the access information (URL) of the management server that provides the copy permission information and the copy. A playlist file name and the like are recorded as permissible data information (dealManifest).

In the manifest file, correspondence data between the playlist file and the MP4 header information file shown in FIG. 17 is recorded in addition to the identifier of the playlist file permitted to be copied.
Furthermore, in this example, it is assumed that the URL for obtaining the vloc box recording data (vloc data) of the MP4 file is recorded in the manifest file.

(Step S302)
In step S302, the information processing apparatus acquires access information (URL) for acquiring vloc data corresponding to the playlist file to be converted from the manifest file.

(Step S303)
Next, in step S303, the vloc associated with the playlist file to be converted is downloaded by applying the access information (URL) acquired in step S202.

(Step S304)
Next, in step S304, the clip information file specified by the playlist file selected as the conversion target and the clip AV stream file associated with the clip information file are acquired.

(Step S305)
Next, in step S305, the image, audio, subtitle, key information embedded data (VMD: variant media data), and metadata (vmet) data stored in the clip AV stream file are separated for each data type. This process is a process executed by the data analysis unit 551 of the data conversion unit 508 shown in FIG.

(Step S306)
Next, in step S306, format conversion of each data of image, audio, caption, key information embedded data (VMD: variant media data), and metadata (vmet) is performed and stored in each mdat box of the MP4 file. Generate data.

This processing is executed by the image data conversion unit 552, the audio data conversion unit 553, the caption data conversion unit 554, and the key information embedded data related information conversion unit 555 of the data conversion unit 508 shown in FIG.
Note that the key information embedded data (VMD) and the metadata (vmet) are extracted from the MPEG-2TS format data as encrypted data without being decrypted or re-encrypted and set as MP4 format data.

(Step S307)
Next, in step S307, the contents of the playlist file and the clip information file are analyzed, and data to be stored in the metadata recording box (moov / moof) of the MP4 file is generated.
This processing is executed by the multiplexing processing execution unit 556 of the data conversion unit 508 shown in FIG. 33 under the control unit 501 shown in FIG.

In the process of step S307, the vloc corresponding data acquired from the server is set as recording data for the vloc box set in the trof box of the moof box of the MP4 file.
Finally, the generated MP4 file is recorded on the second medium, and the process is completed.

Next, with reference to the flowchart shown in FIG. 38, the processing sequence in the case where the information processing apparatus that executes the format conversion and copy processing generates the vloc box storage data of the MP4 file as described with reference to FIG. explain.
Processing of each step shown in the flow will be described sequentially.

(Step S401)
First, the information processing apparatus refers to the manifest file and acquires a playlist file to be converted that is permitted to be copied.
As described above with reference to FIG. 17, the manifest file is a file that is referred to when data is copied between media, and the access information (URL) of the management server that provides the copy permission information and the copy. A playlist file name and the like are recorded as permissible data information (dealManifest).

  In the manifest file, correspondence data between the playlist file and the MP4 header information file shown in FIG. 17 is recorded in addition to the identifier of the playlist file permitted to be copied.

(Step S402)
Next, in step S402, the information processing apparatus acquires a vloc box recording information storage packet (PID = ECM_PID setting packet) from the clip AV stream file associated with the playlist file selected as the copy process target from the manifest file. .
This is a packet having the data shown in FIG.

(Step S403)
Next, in step S403, the information processing apparatus acquires the vloc box recording information of the MP4 file from the MPEG-2TS vloc box recording information storage packet (PID = ECM_PID setting packet).
Specifically, as described above with reference to FIG.
Initialization vector (IV) size (iv_size),
Key ID (key_id),
Initialization vector data (initialization_vector),
Get these data.

(Step S404)
Next, in step S404, vloc box recording data of the MP4 file is generated based on the information acquired from the vloc box recording information storage packet (PID = ECM_PID setting packet) in step S403.

(Step S405)
Next, in step S405, the clip information file specified by the playlist file selected as the conversion target and the clip AV stream file associated with the clip information file are acquired.

(Step S406)
Next, in step S406, the image, audio, subtitle, key information embedded data (VMD: variant media data), and metadata (vmet) data stored in the clip AV stream file are separated for each data type. This process is a process executed by the data analysis unit 551 of the data conversion unit 508 shown in FIG.

(Step S407)
Next, in step S407, the format conversion of each data of image, sound, caption, key information embedded data (VMD: variant media data), and metadata (vmet) is performed and stored in each mdat box of the MP4 file. Generate data.

This processing is executed by the image data conversion unit 552, the audio data conversion unit 553, the caption data conversion unit 554, and the key information embedded data related information conversion unit 555 of the data conversion unit 508 shown in FIG.
Note that the key information embedded data (VMD) and the metadata (vmet) are extracted from the MPEG-2TS format data as encrypted data without being decrypted or re-encrypted and set as MP4 format data.

(Step S408)
Next, in step S408, the contents of the playlist file and clip information file are analyzed, and data to be stored in the metadata recording box (moov / moof) of the MP4 file is generated.
This processing is executed by the multiplexing processing execution unit 556 of the data conversion unit 508 shown in FIG. 33 under the control unit 501 shown in FIG.

In the process of step S408, the vloc box storage data generated in steps S403 to 404 is set as recording data for the vloc box set in the trof box of the moof box of the MP4 file.
Finally, the generated MP4 file is recorded on the second medium, and the process is completed.

Next, a processing sequence corresponding to the second embodiment described with reference to FIGS. 26 to 31 will be described with reference to flowcharts shown in FIGS.
The flowchart shown in FIG. 39 applies the configuration described with reference to FIGS. 26 to 30, that is, the configuration in which the vdat file (key information embedded data (VMD) & metadata (vmet) storage file) is recorded in the medium. Is a processing sequence.
The flowchart shown in FIG. 40 is a processing sequence when the processing described with reference to FIG. 31, that is, a vdat file (key information embedded data (VMD) & metadata (vmet) storage file) is acquired from the server.

  First, a processing sequence for obtaining a vdat file (key information embedded data (VMD) & metadata (vmet) storage file) from a medium will be described with reference to a flowchart shown in FIG.

The flowchart shown in FIG. 39 is executed in the data conversion unit 508 and the like according to a program stored in the storage unit 504, for example, under the control of the control unit 501 of the information processing apparatus.
Processing of each step shown in the flow will be described sequentially.

(Step S501)
First, the information processing apparatus refers to the manifest file and acquires a playlist file to be converted that is permitted to be copied.
As described above, the manifest file is a file that is referred to when data is copied between media. When data is copied between media, there is a copy management system that permits copying on condition that copy permission information is received from an external management server. The manifest file is a copy control management file (MCMF: Managed Copy Manifest File) used when performing data copying according to the copy management system.

  The manifest file (MCMF) is a playlist as access information (URL) of a management server that provides copy permission information of content recorded on the first medium in which copy source data is recorded, and data information (dealManifest) that allows copying. File names etc. are recorded. Only data specified by the playlist file name recorded in the manifest file (MCMF) is copy-permitted data.

In addition to the playlist file identifier that is allowed to be copied, the manifest file includes the playlist file, the MP4 header information file shown in FIG. 26, and the vdat file (key information embedded data (VMD) & metadata (vmet). Corresponding data with () storage file) is recorded.
That is, when one playlist file is selected as a copy target, MP4 file-specific data necessary for copying data corresponding to the playlist file, for example, MP4 to be selected as data for recording moov box or moof box The identifier of the header information file and the identifier of the vdat file (key information embedded data (VMD) & metadata (vmet) storage file) are recorded.

Although the manifest file has been described as being recorded on a medium on which MPEG-2 TS format data is recorded, the manifest file may be acquired from an external server, for example.
In step S501, the information processing apparatus determines a playlist file to be converted that is permitted to be copied by referring to a medium in which MPEG-2TS format data is recorded or a manifest file acquired from a server, and the playlist file is determined from the medium. get.

(Step S502)
Next, in step S502, the information processing apparatus refers to the manifest file and refers to the MP4 header information file (file including vloc-compatible data) associated with the playlist file to be converted, and the vdat file (key information embedded data). (VMD) & metadata (vmet) storage file). FIG. 26 shows an MP4 header information file and a vdat file (key information embedded data (VMD) & metadata (vmet) storage file).

(Step S503)
In the search process in step S502, it is determined whether there is an MP4 header information file (a file including vloc-compatible data) associated with the playlist file to be converted. If there is, the process proceeds to step S504. Proceed to step S505.

(Step S504)
When there is an MP4 header information file (a file including vloc-compatible data) associated with the playlist file to be converted, the information processing apparatus, in step S504, stores the MP4 header information associated with the playlist file to be converted. Read a file (a file containing vloc compatible data) from the media.

(Step S505)
In step S505, the clip information file specified by the playlist file selected as the conversion target, the clip AV stream file associated with the clip information file, and the vdat file (key information embedded data (VMD) & Metadata (vmet) storage file).

(Step S506)
In step S506, the clip AV stream file and the image, audio, subtitle, and key information embedded data (VMD: variant stored in the vdat file (key information embedded data (VMD) & metadata (vmet) storage file)) are stored. Media data) and metadata (vmet) are separated for each data type. This process is a process executed by the data analysis unit 551 of the data conversion unit 508 shown in FIG.

(Step S507)
Next, in step S507, format conversion of each data of image, audio, caption, key information embedded data (VMD: variant media data), and metadata (vmet) is performed and stored in each mdat box of the MP4 file. Generate data.

This processing is executed by the image data conversion unit 552, the audio data conversion unit 553, the caption data conversion unit 554, and the key information embedded data related information conversion unit 555 of the data conversion unit 508 shown in FIG.
Note that the key information embedded data (VMD) and the metadata (vmet) are extracted from the MPEG-2TS format data as encrypted data without being decrypted or re-encrypted and set as MP4 format data.

(Step S508)
Next, in step S508, the contents of the playlist file, clip information file, and MP4 header information file are analyzed to generate data to be stored in the metadata recording box (moov / moof) of the MP4 file.
This processing is executed by the multiplexing processing execution unit 556 of the data conversion unit 508 shown in FIG. 33 under the control unit 501 shown in FIG.

In the process of step S508, the vloc correspondence data acquired from the MP4 header information file associated with the playlist file to be converted is recorded in the vloc box set in the trof box of the moof box of the MP4 file. Set as data.
Finally, the generated MP4 file is recorded on the second medium, and the process is completed.

It should be noted that in the generation and recording processing of the recording data for the mdat box of the MP4 file in step S507, the key information embedded data (VMD) && from the vdat file (key information embedded data (VMD) & metadata (vmet) storage file) It is necessary to acquire metadata (vmet) sequentially.
This acquisition process is executed by applying the byte offset information that is the recording data of the run box as described above with reference to FIG. By this processing, it is possible to accurately extract a set of metadata (vmet) and key information embedded data (VMD).

  Next, with reference to the flowchart shown in FIG. 40, the processing described with reference to FIG. 31, that is, the case where the vdat file (key information embedded data (VMD) & metadata (vmet) storage file) is acquired from the server. A processing sequence will be described.

Note that the flowchart shown in FIG. 40 is executed by the data conversion unit 508 or the like according to a program stored in the storage unit 504, for example, under the control of the control unit 501 of the information processing apparatus.
Processing of each step shown in the flow will be described sequentially.

(Step S601)
First, the information processing apparatus refers to the manifest file and acquires a playlist file to be converted that is permitted to be copied.
In the manifest file, in addition to the identifier of the playlist file that is allowed to be copied, correspondence data between the playlist file and the MP4 header information file shown in FIG. 26 is recorded.
Furthermore, in this example, the vloc box recording data (vloc data) of the MP4 file and the URL for acquiring the vdat file (key information embedded data (VMD) & metadata (vmet) storage file) are recorded in the manifest file. It is assumed that

(Step S602)
In step S602, the information processing apparatus acquires vloc data corresponding to the playlist file to be converted and vdat file (key information embedded data (VMD) & metadata (vmet) storage file) access information from the manifest file. (URL) is acquired.

(Step S603)
Next, in step S603, by applying the access information (URL) acquired in step S602, the vloc associated with the playlist file to be converted, the vdat file (key information embedded data (VMD) & metadata ( vmet) storage file).

(Step S604)
Next, in step S604, a clip information file specified by the playlist file selected as the conversion target and a clip AV stream file associated with the clip information file are acquired.

(Step S605)
In step S605, the clip AV stream file and the image, audio, subtitle, and key information embedded data (VMD: variant stored in the vdat file (key information embedded data (VMD) & metadata (vmet) storage file)) are stored. Media data) and metadata (vmet) are separated for each data type. This process is a process executed by the data analysis unit 551 of the data conversion unit 508 shown in FIG.

(Step S606)
Next, in step S606, format conversion of each data of image, audio, subtitle, key information embedded data (VMD: variant media data), and metadata (vmet) is performed and stored in each mdat box of the MP4 file. Generate data.

This processing is executed by the image data conversion unit 552, the audio data conversion unit 553, the caption data conversion unit 554, and the key information embedded data related information conversion unit 555 of the data conversion unit 508 shown in FIG.
Note that the key information embedded data (VMD) and the metadata (vmet) are extracted from the MPEG-2TS format data as encrypted data without being decrypted or re-encrypted and set as MP4 format data.

(Step S607)
Next, in step S607, the contents of the playlist file and the clip information file are analyzed, and data to be stored in the metadata recording box (moov / moof) of the MP4 file is generated.
This processing is executed by the multiplexing processing execution unit 556 of the data conversion unit 508 shown in FIG. 33 under the control unit 501 shown in FIG.

  In the process of step S607, the vloc corresponding data acquired from the server is set as recording data for the vloc box set in the trof box of the moof box of the MP4 file.

Further, the key information embedded data (VMD) and metadata (vmet) acquired from the vdat file (key information embedded data (VMD) & metadata (vmet) storage file) acquired from the server are recorded in the mdat box of the MP4 file. .
In this recording process, it is necessary to sequentially obtain key information embedded data (VMD) & metadata (vmet) from a vdat file (key information embedded data (VMD) & metadata (vmet) storage file). Become.
This acquisition process is executed by applying the byte offset information that is the recording data of the run box as described above with reference to FIG. By this processing, it becomes possible to accurately and individually extract a set of metadata (vmet) and key information embedded data (VMD).
Finally, the generated MP4 file is recorded on the second medium, and the process is completed.

[10. Summary of composition of the present disclosure]
As described above, the embodiments of the present disclosure have been described in detail with reference to specific embodiments. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present disclosure. In other words, the present invention has been disclosed in the form of exemplification, and should not be interpreted in a limited manner. In order to determine the gist of the present disclosure, the claims should be taken into consideration.

The technology disclosed in this specification can take the following configurations.
(1) having a data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format to generate an MP4 file;
The data converter is
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
Obtained from the TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data, and sets the obtained encrypted data as the storage data of the box defined in the MP4 file without decrypting Information processing device.

(2) The data converter is
Vloc data that is storage data of a vloc box defined in the MP4 format as a key identifier storage box of a key for decoding the metadata (vmet),
The information processing apparatus according to (1), wherein the information is read from a medium storing the MPEG-2TS format data and set as storage data in a vloc box in the MP4 file.

(3) The data converter is
Vloc data that is storage data of a vloc box defined in the MP4 format as a key identifier storage box of a key for decoding the metadata (vmet),
The information processing apparatus according to (1) or (2), acquired from an external server and set as storage data in a vloc box in the MP4 file.

(4) The data converter is
Vloc data that is storage data of a vloc box defined in the MP4 format as a key identifier storage box of a key for decoding the metadata (vmet),
The information processing according to any one of (1) to (3), wherein the information is generated based on storage data of a medium storing the MPEG-2TS format data, and the generated data is set as storage data of a vloc box in the MP4 file. apparatus.

(5) The data converter is
The information processing apparatus according to (4), wherein the vloc data is generated based on storage data of an ECM_PID packet that is a key information storage packet defined in the MPEG-2TS format.

(6) The data converter is
The metadata (vmet) storing the key information embedded data (VMD) and the identifier of the key applied to decrypting the key information embedded data (VMD) is recorded in a continuous position in the mdat box of the MP4 file. The information processing apparatus according to any one of (1) to (5).

(7) The data converter
A sample (sample) in which the key information embedded data (VMD) and the metadata (vmet) storing an identifier of a key applied to decrypting the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. The information processing apparatus according to any one of (1) to (6), wherein the information is recorded at a front position or a subsequent position.

(8) The data converter is
A sample (sample) in which the key information embedded data (VMD) and the metadata (vmet) storing an identifier of a key applied to decrypting the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. ) Record during
A trun box that stores sample information of the MP4 file
The MP4 file set as an individual trun box for each continuous sample before and after being divided by the key information embedded data (VMD) and the metadata (vmet) is generated. Information processing device.

(9) The data converter is
A sample (sample) in which the key information embedded data (VMD) and the metadata (vmet) storing an identifier of a key applied to decrypting the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. ) Record during
Record the trun box with the sample size to be recorded in the run box storing the sample information of the MP4 file, the size of the sample alone plus the size of the key information embedded data (VMD) and the metadata (vmet) The information processing apparatus according to any one of (1) to (8), wherein the MP4 file is generated.

(10) The data converter is
A sample (sample) in which the key information embedded data (VMD) and the metadata (vmet) storing an identifier of a key applied to decrypting the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. ) Is determined according to the recording information of the reproduction control information file acquired from the medium on which the MPEG-2TS format data is recorded. (9) The information processing apparatus according to any one of the above.

    (11) The information processing apparatus according to (10), wherein the reproduction control information file is a clip information file or a playlist file.

(12) having a data processing unit for generating MPEG-2TS format data;
The data processing unit
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data is stored.
Further, an information processing apparatus for generating an MP4 header information file storing vloc data, which is storage data of a vloc box defined in the MP4 format, as a key identifier storage box of a key for decoding the metadata (vmet).

(13) The data processing unit
An identifier (PID) that can be identified as a key information embedded data (VMD) storage packet is set in a packet header of the key information embedded data (VMD) storage packet;
The information processing apparatus according to (12), wherein an identifier (PID) that can identify the metadata (vmet) storage packet is set in a packet header of the metadata (vmet) storage packet.

    (14) The information processing apparatus according to (12) or (13), wherein the key information embedded data (VMD: variant media data) is data that can analyze a key applied to decryption based on decryption data.

(15) An information recording medium on which MPEG-2TS format data is recorded,
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD);
The key identifier of the key for decoding the metadata (vmet), which is storage data of the vloc box defined in the MP4 format as the key identifier storage box of the key for decoding the metadata (vmet),
Stored in a TS packet or data file constituting the MPEG-2 TS format data,
A playback device for playing back data stored in the information recording medium acquires a key for decrypting the metadata (vmet) from the TS packet or data file, decrypts the metadata (vmet), and based on the decryption information An information recording medium capable of acquiring a key to be used for decrypting the key information embedded data (VMD) and decrypting and reproducing the key information embedded data (VMD).

    (16) The information recording medium according to (15), wherein the key information embedded data (VMD: variant media data) is data that can analyze a key applied to decryption based on decryption data.

(17) An information processing method executed in the information processing apparatus,
The information processing apparatus includes a data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format to generate an MP4 file,
The data converter is
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
Data stored in the box in the MP4 file without decrypting the encrypted data stored in the acquired packet, obtained from the TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data Information processing method to set as.

(18) An information processing method executed in the information processing apparatus,
The information processing apparatus includes a data processing unit that generates MPEG-2TS format data,
The data processing unit
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data is stored.
Furthermore, an information processing method for generating an MP4 header information file storing vloc data, which is storage data of a vloc box defined in the MP4 format, as a key identifier storage box of the metadata (vmet) decryption key.

(19) A program for executing information processing in an information processing device,
The information processing apparatus includes a data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format to generate an MP4 file,
The program is stored in the data conversion unit.
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The data stored in the box in the MP4 file without decrypting the encrypted data stored in the acquired packet, obtained from the data file storing the TS packet or each encrypted data constituting the MPEG-2 TS format data Program to be recorded as.

(20) A program for executing information processing in an information processing device,
The information processing apparatus includes a data processing unit that generates MPEG-2TS format data,
The program is stored in the data processing unit.
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2TS format data or the data file storing each encrypted data is stored,
Furthermore, a program for generating an MP4 header information file storing vloc data which is storage data of a vloc box defined in the MP4 format as a key identifier storage box of the metadata (vmet) decryption key.

  The series of processing described in the specification can be executed by hardware, software, or a combined configuration of both. When executing processing by software, the program recording the processing sequence is installed in a memory in a computer incorporated in dedicated hardware and executed, or the program is executed on a general-purpose computer capable of executing various processing. It can be installed and run. For example, the program can be recorded in advance on a recording medium. In addition to being installed on a computer from a recording medium, the program can be received via a network such as a LAN (Local Area Network) or the Internet and can be installed on a recording medium such as a built-in hard disk.

  Note that the various processes described in the specification are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Further, in this specification, the system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to being in the same casing.

As described above, according to the configuration of an embodiment of the present disclosure, a configuration in which MPEG-2TS format data is converted into an MP4 file and recorded without breaking the encryption configuration defined in the MP4 format is realized. Is done.
Specifically, MPEG4 format key information embedded data (VMD: variant media data) and encrypted data (meta) (vmet) storing the decryption key identifier of the key information embedded data (VMD) are converted into MPEG. -2 Acquired from a TS packet constituting TS format data or a file storing encrypted data, and used as box storage data in an MP4 file without decryption. Also, vloc box storage data defined by the MP4 format is acquired or generated as an identifier storage box for metadata (vmet) decryption key, and is recorded in the MP4 file.
With this configuration, a configuration is realized in which MPEG-2TS format data is converted into an MP4 file and recorded without breaking the encryption configuration defined in the MP4 format.

10 Media 11 AACS Directory 12 BDMV Directory 100 Media 101 Sample 102 Key Information Embedded Data 110, 120 Playback Device 115, 125 Decrypted Image 131 Key Information Embedded Data (VMD: variant media data)
132 Metadata (vmet)
133 vloc data 141 to 143 key information embedded data 145 samples 151 to 153 decrypted images 211 and 221 VMD compatible data 212 and 222 vmet compatible data 213 and 223 vloc compatible data 231 Media key Km applied encrypted data 232 Unencrypted key identifier Storage packet 251 TS packet (ECM)
252 TS packet (vmet)
253 TS packet (VMD)
301 BDMV directory 302 EXPORT directory 311 Manifest file 312 MP4 header information file 400 Information processing device 401 Server 410 First medium 420 Second medium 450 Media 451 BDMV directory 452 EXPORT directory 461 Manifest file 462 MP4 header information file 463 vdat file Embedded data (VMD) & metadata (vmet) storage file)
480 Information processing device 481 First medium 482 Second medium 490 Server 500 Information processing device 501 Control unit 502 Input unit 503 Communication unit 504 Storage unit 505 Output unit 506 First media interface 507 Data buffer 508 Data conversion unit 509 Second media interface 510 First medium 520 Second medium 551 Data analysis unit 552 Image data conversion unit 553 Audio data conversion unit 554 Subtitle data conversion unit 555 Key information embedded data related information conversion unit 556 Multiplexing processing execution unit 601 CPU
602 ROM
603 RAM
604 bus 605 input / output interface 606 input unit 607 output unit 608 storage unit 609 communication unit 610 drive 611 removable media

Claims (20)

A data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format and generates an MP4 file;
The data converter is
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
Obtained from the TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data, and sets the obtained encrypted data as the storage data of the box defined in the MP4 file without decrypting Information processing device. The data converter is
Vloc data that is storage data of a vloc box defined in the MP4 format as a key identifier storage box of a key for decoding the metadata (vmet),
2. The information processing apparatus according to claim 1, wherein the information is read from a medium storing the MPEG-2TS format data and set as storage data in a vloc box in the MP4 file. The data converter is
Vloc data that is storage data of a vloc box defined in the MP4 format as a key identifier storage box of a key for decoding the metadata (vmet),
The information processing apparatus according to claim 1, wherein the information processing apparatus is acquired from an external server and set as storage data in a vloc box in the MP4 file. The data converter is
Vloc data that is storage data of a vloc box defined in the MP4 format as a key identifier storage box of a key for decoding the metadata (vmet),
The information processing apparatus according to claim 1, wherein the information processing apparatus generates the MPEG-2TS format data based on storage data of a medium and sets the generated data as storage data of a vloc box in the MP4 file. The data converter is
The information processing apparatus according to claim 4, wherein the vloc data is generated based on storage data of an ECM_PID packet that is a key information storage packet defined in the MPEG-2TS format. The data converter is
The metadata (vmet) storing the key information embedded data (VMD) and the identifier of the key applied to decrypting the key information embedded data (VMD) is recorded in a continuous position in the mdat box of the MP4 file. Item 4. The information processing apparatus according to Item 1. The data converter is
A sample (sample) in which the key information embedded data (VMD) and the metadata (vmet) storing an identifier of a key applied to decrypting the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. The information processing apparatus according to claim 1, wherein the information processing apparatus is recorded at a front position or a subsequent position. The data converter is
A sample (sample) in which the key information embedded data (VMD) and the metadata (vmet) storing an identifier of a key applied to decrypting the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. ) Record during
A trun box that stores sample information of the MP4 file
The information processing apparatus according to claim 1, wherein an MP4 file set as an individual run box for each successive sample before and after being divided by the key information embedded data (VMD) and the metadata (vmet) is generated. The data converter is
A sample (sample) in which the key information embedded data (VMD) and the metadata (vmet) storing an identifier of a key applied to decrypting the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. ) Record during
Record the trun box with the sample size to be recorded in the run box storing the sample information of the MP4 file, the size of the sample alone plus the size of the key information embedded data (VMD) and the metadata (vmet) The information processing apparatus according to claim 1, wherein the MP4 file is generated. The data converter is
A sample (sample) in which the key information embedded data (VMD) and the metadata (vmet) storing an identifier of a key applied to decrypting the key information embedded data (VMD) are continuously recorded in the mdat box of the MP4 file. 2) is determined according to the recording information of the reproduction control information file acquired from the medium on which the MPEG-2TS format data is recorded. Information processing device.   The information processing apparatus according to claim 10, wherein the reproduction control information file is a clip information file or a playlist file. A data processing unit for generating MPEG-2TS format data;
The data processing unit
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data is stored.
Further, an information processing apparatus for generating an MP4 header information file storing vloc data, which is storage data of a vloc box defined in the MP4 format, as a key identifier storage box of a key for decoding the metadata (vmet). The data processing unit
An identifier (PID) that can be identified as a key information embedded data (VMD) storage packet is set in a packet header of the key information embedded data (VMD) storage packet;
13. The information processing apparatus according to claim 12, wherein an identifier (PID) that can identify that the packet is a metadata (vmet) storage packet is set in a packet header of the storage packet of the metadata (vmet).   13. The information processing apparatus according to claim 12, wherein the key information embedded data (VMD: variant media data) is data that can analyze a key applied to decryption based on decryption data. An information recording medium on which MPEG-2TS format data is recorded,
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD);
The key identifier of the key for decoding the metadata (vmet), which is storage data of the vloc box defined in the MP4 format as the key identifier storage box of the key for decoding the metadata (vmet),
Stored in a TS packet or data file constituting the MPEG-2 TS format data,
A playback device for playing back data stored in the information recording medium acquires a key for decrypting the metadata (vmet) from the TS packet or data file, decrypts the metadata (vmet), and based on the decryption information An information recording medium capable of acquiring a key to be used for decrypting the key information embedded data (VMD) and decrypting and reproducing the key information embedded data (VMD).   The information recording medium according to claim 15, wherein the key information embedded data (VMD: variant media data) is data that can analyze a key applied to decryption based on decryption data. An information processing method executed in an information processing apparatus,
The information processing apparatus includes a data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format to generate an MP4 file,
The data converter is
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
Data stored in the box in the MP4 file without decrypting the encrypted data stored in the acquired packet, obtained from the TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data Information processing method to set as. An information processing method executed in an information processing apparatus,
The information processing apparatus includes a data processing unit that generates MPEG-2TS format data,
The data processing unit
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2 TS format data or the data file storing each encrypted data is stored.
Furthermore, an information processing method for generating an MP4 header information file storing vloc data, which is storage data of a vloc box defined in the MP4 format, as a key identifier storage box of the metadata (vmet) decryption key. A program for executing information processing in an information processing apparatus;
The information processing apparatus includes a data conversion unit that performs format conversion from the MPEG-2TS format to the MP4 format to generate an MP4 file,
The program is stored in the data conversion unit.
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The data stored in the box in the MP4 file without decrypting the encrypted data stored in the acquired packet, obtained from the data file storing the TS packet or each encrypted data constituting the MPEG-2 TS format data Program to be recorded as. A program for executing information processing in an information processing apparatus;
The information processing apparatus includes a data processing unit that generates MPEG-2TS format data,
The program is stored in the data processing unit.
Encryption key information embedded data obtained by encrypting key information embedded data (VMD: variant media data) defined in the MP4 format;
Encrypted metadata obtained by encrypting metadata (vmet) storing a key identifier applied to decrypting the key information embedded data (VMD),
The TS packet constituting the MPEG-2TS format data or the data file storing each encrypted data is stored,
Furthermore, a program for generating an MP4 header information file storing vloc data which is storage data of a vloc box defined in the MP4 format as a key identifier storage box of the metadata (vmet) decryption key.

Images