WO2012046437A1 - Support d'enregistrement et procédé de copie de données - Google Patents

Support d'enregistrement et procédé de copie de données Download PDF

Info

Publication number
WO2012046437A1
WO2012046437A1 PCT/JP2011/005595 JP2011005595W WO2012046437A1 WO 2012046437 A1 WO2012046437 A1 WO 2012046437A1 JP 2011005595 W JP2011005595 W JP 2011005595W WO 2012046437 A1 WO2012046437 A1 WO 2012046437A1
Authority
WO
WIPO (PCT)
Prior art keywords
stream
file
data
audio
video
Prior art date
Application number
PCT/JP2011/005595
Other languages
English (en)
Japanese (ja)
Inventor
泰治 佐々木
洋 矢羽田
智輝 小川
Original Assignee
パナソニック株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by パナソニック株式会社 filed Critical パナソニック株式会社
Publication of WO2012046437A1 publication Critical patent/WO2012046437A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
    • G11B20/0021—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
    • G11B20/00485—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier characterised by a specific kind of data which is encrypted and recorded on and/or reproduced from the record carrier
    • G11B20/00492—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier characterised by a specific kind of data which is encrypted and recorded on and/or reproduced from the record carrier wherein content or user data is encrypted
    • G11B20/005—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier characterised by a specific kind of data which is encrypted and recorded on and/or reproduced from the record carrier wherein content or user data is encrypted wherein only some specific parts of the content are encrypted, e.g. encryption limited to I-frames
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10527—Audio or video recording; Data buffering arrangements
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/93—Regeneration of the television signal or of selected parts thereof
    • H04N5/931—Regeneration of the television signal or of selected parts thereof for restoring the level of the reproduced signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B20/10527—Audio or video recording; Data buffering arrangements
    • G11B2020/10537—Audio or video recording
    • G11B2020/10546—Audio or video recording specifically adapted for audio data
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G11B2020/10833—Copying or moving data from one record carrier to another
    • G11B2020/10842—Copying or moving data from one record carrier to another wherein not all recorded data are copied or moved
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2541—Blu-ray discs; Blue laser DVR discs

Definitions

  • the present invention relates to a technology for copying data between recording media.
  • Optical discs such as DVDs and Blu-ray (registered trademark) discs are widely used for distributing movie contents such as movie works.
  • a video that can be recorded on a DVD is SD (Standard Definition)
  • a video that can be recorded on a Blu-ray Disc is a HD (High Definition) of up to 1920 ⁇ 1080.
  • digital copy In recent years, it has become possible to view video content on mobile devices such as mobile phones and smartphones. Accordingly, “digital copy” has become widespread. In digital copy, content that is the same content but low resolution is stored in a single recording medium separately from the main content, and is stored in a recording medium such as a hard disk drive (HDD) or SD memory card. This refers to a function that permits copying of low-resolution content (for example, see Patent Document 1).
  • HDD hard disk drive
  • SD memory card This refers to a function that permits copying of low-resolution content (for example, see Patent Document 1).
  • FIG. 73 is a schematic diagram showing the digital copy function.
  • the BD-ROM disc 7301 stores HD content and SD content.
  • the HD content is the main content and the SD content is the digital copy content.
  • the BD-ROM playback device 7302 reads the HD content from the BD-ROM disc 7301 and displays it on the high-definition image quality TV 7303.
  • the BD-ROM playback device 7302 reads SD content from the BD-ROM disc 7301 and writes it to an external recording medium 7304 such as an SD memory card.
  • the mobile device 7305 plays SD content from the external recording medium 7304. In this way, one content can be enjoyed on both the TV and the mobile device.
  • the SD-Video standard is a standard for encrypting and recording data such as video, audio, and captions on an SD memory card.
  • several profiles are prepared as formats and can be selected according to the application.
  • ISDB-T Mobile Video Profile (Mobile ⁇ Video ⁇ ⁇ Profile) is a standard for one-segment broadcast recording based on the Japanese ARIB standard, and the stream is in the MPEG-2 transport stream (TS) format (non-patent literature). 1).
  • TS MPEG-2 transport stream
  • the H.264 mobile video profile is a standard for storing high-quality content at a higher bit rate than the ISDB-T mobile video profile, and the stream is in the MPEG-4 system format (see Non-Patent Document 2 below). , “MP4 format”).
  • MP4 format MP4 format
  • SD-Video standard data is encrypted by the CPRM (Content Protect for Recordable Media) method at the time of recording.
  • a large number of audio streams can be stored in HD content stored on a BD-ROM disc.
  • the reason is that the reading rate of the BD-ROM disc is as high as 54 Mbps and the processing performance of the BD-ROM playback device is high.
  • a maximum of 32 audio streams can be stored in one content. Thereby, it is not necessary to create a BD-ROM disc for each language, so that the cost required for authoring can be suppressed.
  • SD content for digital copying has a limited number of audio streams that can be stored. This is because the bit rate of SD content is limited to a low level by the processing performance of the mobile device. For example, in the ISDB-T mobile video profile, the maximum number of audio streams that can be stored in one content is limited to two. The H.264 mobile video profile is limited to a maximum of one. Therefore, the number of audio streams that can be stored in the SD content is smaller than the number of audio streams that can be stored in the HD content. This causes the following problem.
  • FIG. 74 (a) is a schematic diagram showing an audio stream stored in the HD content.
  • the HD content stores five audio streams of English, Japanese, Chinese, German, and French along with one video stream.
  • FIG. 74B is a schematic diagram showing an audio stream stored in SD content for digital copy.
  • only one audio stream can be stored in one SD content. Accordingly, five audio streams of English, Japanese, Chinese, German, and French are stored in different SD contents. Furthermore, the same video stream is stored in each SD content. The total data amount of these five SD contents is not small.
  • An object of the present invention is to make the number of audio streams that can be stored in digital copy content the same as the number of audio streams stored in the copy source content without excessively increasing the total data amount. Another object is to provide a recording medium that can be used.
  • the first content, and the second content and the third content for digital copy with respect to the first content are recorded.
  • the second content includes a video stream and a first audio stream
  • the third content includes a second audio stream.
  • the first audio stream and the second audio stream have the same number of audio frames for each unit of encryption.
  • the second audio stream is a unit of encryption with the first audio stream. Each can be replaced.
  • the recording medium according to the present invention when the second content is copied to the external recording medium, the second audio stream is replaced with the first audio stream. Accordingly, it is sufficient that one video stream for digital copying is stored in the recording medium according to the present invention.
  • the above-described recording medium according to the present invention can reduce the number of audio streams that can be stored in the digital copy content without excessively increasing the total data amount, and the audio stream stored in the copy source content. The number can be matched.
  • FIG. 2 is a schematic diagram showing a data structure on a BD-ROM disc 101 shown in FIG.
  • A is a schematic diagram showing a data structure of a file identification descriptor 241 of a lower directory.
  • (B) is a schematic diagram showing the data structure of the file identification descriptor 242 of the lower file.
  • FIG. 3 is a schematic diagram showing a part of a directory / file structure of data stored in a volume area 202B of the BD-ROM disc 101 shown in FIG.
  • FIG. 3 is a schematic diagram showing another part of the directory / file structure of data stored in the volume area 202B of the BD-ROM disc 101 shown in FIG. 6 is a table showing elementary streams multiplexed in an AV stream file 541 placed immediately under the STREAM directory 540 shown in FIG. 6 is a schematic diagram showing the arrangement of TS packets belonging to elementary streams 801, 802, 803, and 804 in an AV stream file 800.
  • FIG. (A) is a schematic diagram which shows the data structure of TS header 901H.
  • (B) is a schematic diagram showing a format of a TS packet sequence constituting an AV stream file.
  • (C) is a schematic diagram showing the format of a source packet sequence composed of TS packet sequences of an AV stream file.
  • FIG. (D) is a schematic diagram of sectors on the volume area 202B of the BD-ROM disc 101 on which a series of source packets 902 are continuously recorded.
  • 3 is a schematic diagram showing a data structure of a PG stream 1000.
  • FIG. 3 is a schematic diagram showing details of a data structure of a video stream 1100.
  • FIG. 12 is a schematic diagram showing details of a method for storing a video stream 1201 in a PES packet sequence 1202.
  • FIG. It is a schematic diagram which shows the data structure of PMT1310.
  • FIG. 6 is a schematic diagram showing a data structure of a clip information file (01000.clpi) 531 shown in FIG. (A) is a schematic diagram showing the data structure of entry map 1430.
  • FIG. 6 is a schematic diagram showing a data structure of a playlist file (00001.mpls) 521 shown in FIG. It is a schematic diagram which shows the data structure of PI # N shown by FIG. (A),
  • (b) is a schematic diagram showing the relationship between two playback sections PI # (N ⁇ 1), PI # N to be connected when CC is “5”, “6”, respectively. It is.
  • FIG. 22 is a schematic diagram showing a correspondence relationship between a PTS indicated by a playlist file (00001.mpls) 521 and a portion reproduced from an AV stream file (01000.m2ts) 541.
  • FIG. FIG. 6 is a schematic diagram showing a data structure of an index file (index.bdmv) 511 shown in FIG. It is a schematic diagram which shows the data structure of MP4 file. It is a schematic diagram which shows the structure of the Box which comprises MP4 file.
  • (A) is a schematic diagram which shows the data structure of moov shown by FIG.
  • (B) is a tree diagram showing the hierarchical structure of Boxes in moov.
  • (C) is a table indicated by a sample-to-chunk box (stsc).
  • FIG. 3 is a schematic diagram showing a VAU data structure when an MPEG-4 AVC video stream is stored in an MP4 file. It is a schematic diagram which shows the data structure of the file of TS format.
  • A is a schematic diagram showing an example of a data structure when the digital copy AV stream file 622 is an MP4 file.
  • B is a schematic diagram showing the data structures of the replacement stream files 631, 632, and 633.
  • FIG. FIG. 2 is a functional block diagram of the playback device 103 shown in FIG. 1.
  • FIG. 29 is a list of system parameters (SPRM) installed in the player variable storage unit 2836 shown in FIG.
  • SPRM system parameters
  • FIG. 29 is a flowchart of the reproducing operation of the reproducing device 103 shown in FIG. 28.
  • FIG. 29 is a flowchart of playlist reproduction processing by the reproduction control unit 2835 shown in FIG.
  • FIG. 29 is a functional block diagram of the system target decoder 2823 shown in FIG. 28.
  • (A) is a flowchart of a process in which the PG decoder 3272 shown in FIG. 28 decodes a graphics object from one data entry in the PG stream.
  • (B)-(e) are schematic diagrams showing graphics objects that change in accordance with the processing shown in (a).
  • FIG. 29 is a block diagram showing a playback processing system in the playback device 103 shown in FIG. 28.
  • (A) is a graph showing changes in the data amount DA accumulated in the read buffer 3402 during the reproduction operation.
  • (B) is a schematic diagram showing the correspondence between the extent group 3510 to be played and the playback path 3520.
  • FIG. Jump distance S JUMP and maximum jump time for BD-ROM disc which is an example of a correspondence table between the T JUMP - MAX.
  • A) is a schematic diagram showing an encryption procedure performed when a CPRM-compatible device records content on an SD memory card.
  • (B) is a schematic diagram showing a decoding procedure performed when a CPRM-compatible device reproduces content from an SD memory card.
  • FIG. 42 is a schematic diagram showing a process of replacing an audio stream chunk included in a digital copy AV stream file with a chunk included in a replacement stream file in step S4107 shown in FIG. 41.
  • Directory indicating a storage location of new header information required when the bit rate and the attribute are different between the chunk of the audio stream included in the digital copy AV stream file and the chunk of the replacement stream file.
  • FIG. 1 is a directory diagram showing three digital copy AV stream files that share header information and video stream chunks.
  • FIG. 4 is a schematic diagram showing a relationship between a physical arrangement of data on a BD-ROM disc 101 and an LBN range indicated by allocation descriptors of three types of files.
  • FIG. 4 is a schematic diagram showing a relationship between a physical arrangement of data on a BD-ROM disc 101 and LBN ranges indicated by allocation descriptors of four types of digital copy AV stream files.
  • (A) and (b) are examples of the relationship between the physical arrangement of data on the BD-ROM disc 101 and the LBN range indicated by the allocation descriptor of two types of digital copy AV stream files. It is a schematic diagram shown.
  • FIG. 4 is a schematic diagram showing a relationship between a physical arrangement of data on a BD-ROM disc 101 and LBN ranges indicated by allocation descriptors of four types of digital copy AV stream files.
  • FIG. 4 is a schematic diagram showing a relationship between a physical arrangement of data on a BD-ROM disc 101 and LBN ranges indicated by allocation descriptors of four types of digital copy AV stream files.
  • (A) and (b) are examples of the relationship between the physical arrangement of data on the BD-ROM disc 101 and the LBN range indicated by the allocation de
  • FIG. 4 is a schematic diagram showing a file group constituting digital copy content 5110 recorded on a BD-ROM disc 101 and a digital copy AV stream file 5120 generated from the file group.
  • A is a schematic diagram showing an example of the data structure of a digital copy AV stream file in TS format.
  • (B) is a schematic diagram showing an example of the data structure of a TS format replacement stream file.
  • (A) is a schematic diagram which shows another example of the data structure of the digital copy AV stream file of TS format.
  • (B) is a schematic diagram showing another example of the data structure of a replacement stream file in the TS format.
  • 10 is a flowchart of processing for determining whether or not a BD-ROM disc is a digital copy compatible disc.
  • FIG. 56 is a table showing the structure of dialogue data shown in Fig. 56.
  • A) is a schematic diagram showing an example of a physical arrangement of an AV stream file and a digital copy AV stream file on a BD-ROM disc.
  • B) is a schematic diagram showing an elementary stream multiplexed in an AV stream file.
  • C) is a block diagram showing a playback processing system of the playback device for processing the AV stream file shown in (b).
  • (A) is a schematic diagram showing a physical arrangement of an extent of an AV stream file and an extent of a digital copy AV stream file on a BD-ROM disc.
  • (B) is a block diagram showing a playback processing system of a playback device for reading the extent group shown in (a).
  • (A) is a graph showing increase / decrease in the data amount DA accumulated in the read buffer when the non-digital copy compatible device reads the extent MN of the AV stream file from the extent arrangement 6010 shown in (b). It is.
  • (B) shows the arrangement 6010 of the extent DC of the digital copy AV stream file and the extent MN of the AV stream file on the BD-ROM disc, and reproduction when the non-digital copy compatible machine reads the extent from the arrangement.
  • FIG. 6 is a schematic diagram showing a path 6020.
  • FIG. (A), (b) shows the extent MN of the AV stream file stored in the read buffer when the digital copy compatible machine reads the extents DC, MN from the extent arrangement 6110 shown in (c). It is a graph which shows increase / decrease in data amount DA1 and increase / decrease in data amount DA2 of extent DC of a digital copy AV stream file.
  • (C) shows the arrangement 6110 of the extent DC of the digital copy AV stream file and the extent MN of the AV stream file on the BD-ROM disc, and the playback path when the digital copy compatible machine reads the extent from the arrangement.
  • 6 is a schematic diagram showing 6120.
  • (A) is a schematic diagram showing a physical arrangement of the extent B of the first AV stream file and the extent D of the second AV stream file arranged on the BD-ROM disc.
  • (B) is a block diagram showing a playback processing system of a playback device for processing the extent group shown in (a).
  • (A) is a flowchart of the process by the reproducing
  • (B) is a flowchart of processing by the mobile device in the digital copy.
  • 6 is a schematic diagram showing a directory structure of an update kit 6410 stored in a local storage 6401.
  • FIG. It is a block diagram of the reproducing
  • (A) is a schematic diagram showing processing for constructing a virtual package 6630 from original data 6610 stored in a BD-ROM disc and an update kit 6620 stored in local storage.
  • (B) is a table showing the correspondence between the path in the local storage and the path on the virtual package for each file of the update kit 6620 stored in the merge management information file 6621.
  • (A), (b), (c) is a schematic diagram showing pseudo streaming playback processing of an AV stream file using a virtual package.
  • (A) is a schematic diagram showing a playback system before a videophone call.
  • (B) is a schematic diagram showing a playback system when a videophone call is received.
  • (A) is a schematic diagram showing a playback system before a telephone call.
  • FIG. 72 is a flowchart of a method for recording movie content on a BD-ROM disc using the recording device 7100 shown in FIG. 71.
  • FIG. 72 It is a schematic diagram which shows the function of a digital copy.
  • A) is a schematic diagram showing an audio stream stored in HD content.
  • B) is a schematic diagram showing an audio stream stored in SD content for digital copy.
  • FIG. 1 is a schematic diagram showing a home theater system according to Embodiment 1 of the present invention.
  • the home theater system uses a disk medium 101 as a reproduction target and an SD memory card 102 as a digital copy writing destination.
  • the home theater system includes a playback device 103, a display device 104, and a remote controller 105.
  • the playback device 103 can be further connected to the mobile device 107 through the network 106.
  • the disk medium 101 is a read-only Blu-ray disc (BD), that is, a BD-ROM disc.
  • the disk medium 101 may be another portable recording medium, for example, a semiconductor memory device such as an optical disk according to another method such as a DVD, a removable hard disk drive (HDD), or an SD memory card.
  • the disc medium, that is, the BD-ROM disc 101 stores HD content and SD content representing the same movie.
  • the HD content is the main content and the SD content is the digital copy content.
  • the playback device 103 is equipped with a BD-ROM drive 110 and a card reader 111.
  • the BD-ROM drive 110 is an optical disk drive conforming to the BD-ROM system.
  • the card reader 111 is a drive that can read data from the SD memory card 102.
  • the playback device 103 uses the BD-ROM drive 110 to read HD content or SD content from the BD-ROM disc 101.
  • the playback device 103 further decodes the HD content into video data / audio data and transmits it to the display device 104.
  • the playback device 103 also writes the SD content into the SD memory card 102 using the card reader 111. By inserting the SD memory card 102 into the mobile device, the SD content can be played back on the mobile device.
  • the playback device 103 sends SD content to the mobile device 107 through the network 106.
  • the mobile device 107 reproduces the SD content or writes it to the SD memory card 108.
  • the display device 104 is a liquid crystal display.
  • the display device 104 may be a flat panel display or projector of another type such as a plasma display and an organic EL display.
  • the display device 104 displays the video of the HD content on the screen according to the video data, and generates sound from the built-in speaker according to the audio data.
  • the remote control 105 includes an operation unit and a transmission unit.
  • the operation unit includes a plurality of buttons. Each button is associated with each function of the playback device 103 or the display device 104, such as turning on / off the power or starting or stopping playback of the BD-ROM disc 101.
  • the operation unit detects pressing of each button by the user, and transmits the identification information of the button to the transmission unit by a signal.
  • the transmission unit converts the signal into an infrared or wireless signal and sends the signal to the playback device 103 or the display device 104.
  • each of the playback device 103 and the display device 104 receives the signal, specifies a button indicated by the signal, and executes a function associated with the button. In this way, the user can remotely operate the playback device 103 or the display device 104.
  • FIG. 2 is a schematic diagram showing a data structure on the BD-ROM disc 101.
  • a BCA (BursturCutting Area) 201 is provided at the innermost periphery of the data recording area on the BD-ROM disc 101. Access to the BCA is permitted only by the BD-ROM drive 121, and access by the application program is prohibited. Thereby, the BCA 201 is used for copyright protection technology.
  • tracks extend spirally from the inner periphery to the outer periphery.
  • the track 202 is schematically drawn in the horizontal direction. The left side represents the inner periphery of the disc 101, and the right side represents the outer periphery.
  • the track 202 includes a lead-in area 202A, a volume area 202B, and a lead-out area 202C in order from the inner periphery.
  • the lead-in area 202A is provided immediately outside the BCA 201.
  • the lead-in area 202A includes information necessary for accessing the volume area 202B by the BD-ROM drive 121, such as the size and physical address of data recorded in the volume area 202B.
  • the lead-out area 202C is provided at the outermost periphery of the data recording area and indicates the end of the volume area 202B.
  • the volume area 202B includes application data such as video and audio.
  • the volume area 202B is divided into small areas 202D called “sectors”.
  • the sector size is common, for example, 2048 bytes.
  • Each sector 202D is assigned a serial number in order from the tip of the volume area 202B. This serial number is called a logical block number (LBN) and is used as a logical address on the BD-ROM disc 101.
  • LBN logical block number
  • the volume area 202B can be accessed on a sector basis.
  • the logical address is substantially equal to the physical address. In particular, in a region where LBN is continuous, physical addresses are also substantially continuous. Therefore, the BD-ROM drive 121 can continuously read data from sectors having consecutive LBNs without causing the optical pickup to seek.
  • the data recorded in the volume area 202B is managed by a predetermined file system.
  • UDF Universal Disc Format
  • the file system may be ISO 9660.
  • the data recorded in the volume area 202B is expressed in a directory / file format. That is, these data can be accessed in directory units or file units.
  • FIG. 2 shows the data structure of the volume area 202B when UDF is used as the file system.
  • the volume area 202B generally includes areas in which a plurality of directories 213 to 215, a file set descriptor 211, and an end descriptor 212 are recorded.
  • Each “directory” 213, 214, 215 is a data group constituting the same directory.
  • the “file set descriptor” 211 indicates the LBN of the sector in which the file entry of the root directory 213 is recorded.
  • An “end descriptor” 212 indicates the end of the recording area of the file set descriptor 211.
  • Each directory 213, 214, 215 has a common data structure.
  • FIG. 2 shows the data structure of directory # 1214 as a typical example.
  • Directory # 1214 includes a file entry 221, a directory file 222, and lower file groups 223-225.
  • the “file entry” 221 includes a descriptor tag 231, an ICB (Information Control Block) tag 232, and an allocation descriptor 233.
  • “Descriptor tag” 231 indicates that the type of data including the descriptor tag is a file entry. For example, when the value of the descriptor tag is “261”, the data type is a file entry.
  • the “ICB tag” 232 indicates attribute information of the file entry itself.
  • the “allocation descriptor” 233 indicates the LBN of the sector in which the directory file 222 belonging to the directory # 1214 is recorded.
  • FIG. 3A is a schematic diagram showing the data structure of the file identification descriptor 241 in the lower directory.
  • the “file identifier descriptor of the lower directory” 241 is information for accessing a lower directory placed directly under the directory # 1.
  • the file identification descriptor 241 of the lower directory includes identification information 311 of the lower directory, a directory name length 312, a file entry address 313, and a directory name 314.
  • the file entry address 313 indicates the LBN of the sector in which the file entry of the lower directory is recorded.
  • 3B is a schematic diagram showing the data structure of the file identification descriptor 242 of the lower file.
  • the “file identification descriptor of the lower file” 242 is information for accessing the lower file placed immediately under the directory # 1.
  • the file identification descriptor 242 of the lower file includes identification information 321 of the lower file, a file name length 322, a file entry address 323, and a file name 324.
  • the file entry address 323 indicates the LBN of the sector in which the file entry of the lower file is recorded.
  • the “file entry of the lower file” includes address information of data constituting the entity of the lower file.
  • the file set descriptor 211 and the file identification descriptor of the lower directory / file are traced in order, the file / file of any directory / file recorded in the volume area 202B can be obtained. You can access the entry. As a specific example, it is assumed that a lower file # 1223 in the directory # 1214 is accessed. First, the file entry of the root directory 213 is identified from the file set descriptor 211, and the directory file of the root directory 213 is identified from the allocation descriptor in the file entry. Next, the file identification descriptor of the directory # 1214 is detected from the directory file, and the file entry 221 of the directory # 1214 is specified from the file entry address therein.
  • the directory file 222 of the directory # 1214 is specified from the allocation descriptor 233 in the file entry 221. Subsequently, in the directory file 222, the file entry of the lower file # 1223 is specified from the file entry address 323 in the file identification descriptor 242 of the lower file # 1.
  • FIG. 4 is a schematic diagram showing the data structure of the lower file # 1223 as a typical example of the common data structure.
  • lower file # 1223 includes extents 410-430 and file entry 400.
  • the “extents” 410, 420, 430,... are generally a plurality, and each is a data string in which logical addresses on the disk, that is, LBNs are continuous.
  • the extents 410, 420, 430,... Constitute the lower file # 1223.
  • the “file entry” 400 includes a descriptor tag 401, an ICB tag 402, and allocation descriptors 411-413.
  • “Descriptor tag” 401 indicates that the type of data 400 including the descriptor tag 401 is a file entry.
  • An “ICB tag” 402 indicates attribute information of the file entry 400 itself.
  • Each of the “allocation descriptors” 411, 412, 413,... Is provided for each extent 410, 420, 430,..., And the arrangement of each extent 410-430 on the volume area 202B, specifically each The extent size and the LBN at its tip are shown.
  • the arrangement of one extent may be indicated in the whole of the plurality of allocation descriptors. As shown by the dashed arrows in FIG. 4, each extent 410, 420,...
  • each allocation descriptor 411, 412 Can be accessed by referring to each allocation descriptor 411, 412,.
  • the upper 2 bits of each allocation descriptor 411,... Indicate whether or not extents 410,... Are actually recorded in the LBN sector indicated by the allocation descriptor. That is, when the upper 2 bits are “0”, it indicates that the extent has been allocated and recorded for the sector, and when it is “1”, the extent has been allocated to the sector. Indicates unrecorded.
  • FIG. 5 and 6 are schematic views showing the directory / file structure of data stored in the volume area 202B of the BD-ROM disc 101.
  • FIG. 5 and 6 in this directory / file structure, a BD movie (BDMV: BD501Movie) directory 501 and a digital copy (DCOPY) directory 502 are placed immediately under a root (ROOT) directory 500.
  • BDMV BD501Movie
  • DCOPY digital copy
  • FIG. 5 particularly shows the structure of the BDMV directory 501.
  • an index file (index.bdmv) 511 and a movie object file (MovieObject.bdmv) 512 are placed immediately below the BDMV directory 501.
  • the index file 511 is information for managing the entire content recorded on the BD-ROM disc 101.
  • the information includes information for causing the playback device 103 to recognize the content, and an index table.
  • the index table is a correspondence table between titles constituting the content and programs for controlling the operation of the playback device 103.
  • the program is called “object”.
  • Object types include movie objects and BD-J (BD Java (registered trademark)) objects.
  • the movie object file 512 generally includes a plurality of movie objects. Each movie object includes a sequence of navigation commands.
  • the navigation command is a control command for causing the playback device 103 to execute playback processing similar to playback processing by a general DVD player.
  • Types of navigation commands include, for example, an instruction to read a playlist file corresponding to a title, an instruction to reproduce an AV stream file indicated by the playlist file, and an instruction to transition to another title.
  • the navigation command is described in an interpreted language and is decoded by an interpreter incorporated in the playback apparatus 103, that is, a job control program, and causes the control unit to execute a desired job.
  • a navigation command consists of an opcode and an operand.
  • the opcode indicates the type of operation to be executed by the playback apparatus 103, such as title branching, playback, and computation.
  • the operand indicates identification information of the operation target such as a title number.
  • the control unit of the playback device 103 calls each movie object in accordance with a user operation, and executes navigation commands included in the movie object in the order of the columns.
  • the playback device 103 first displays a menu on the display device 104 and allows the user to select a command, as in a general DVD player.
  • the playback device 103 dynamically changes the progress of the video to be played back, such as starting / stopping playback of the title and switching to another title.
  • BDMV directory 501 As shown in FIG. 5, immediately below the BDMV directory 501, a playlist (PLAYLIST) directory 520, a clip information (CLIPINF) directory 530, a stream (STREAM) directory 540, a BD-J object (BDJO: BD Java) An Object) directory 550 and a Java archive (JAR: Java ⁇ ⁇ ⁇ ⁇ ⁇ Archive) directory 560 are placed.
  • PLAYLIST playlist
  • CLIPINF clip information
  • STREAM stream directory
  • BDJO BD Java
  • An Object Java archive
  • JAR Java ⁇ ⁇ ⁇ ⁇ ⁇ ⁇ Archive
  • An AV stream file (01000.m2ts) 541 is placed directly under the STREAM directory 540.
  • the “AV stream file” refers to a video content entity recorded on the BD-ROM disc 101 and arranged in a file format determined by the file system.
  • the substance of video content generally means stream data in which various stream data representing video, audio, subtitles, and the like are multiplexed.
  • the AV stream file is preferably a digital stream in the MPEG-2TS format.
  • One AV stream file includes one primary video stream and up to 32 audio streams.
  • An AV stream file (01000.m2ts) 541 placed directly under the STREAM directory 540 particularly represents an HD video.
  • a clip information file (01000.clpi) 531 is placed in the CLIPINF directory 530.
  • the “clip information file” is associated one-to-one with the AV stream file placed immediately below the STREAM directory 540, and includes an entry map of each file.
  • the “entry map” is a correspondence table between the display time of each scene represented by the AV stream file and the address in each file in which the scene is recorded.
  • the clip information file (01000.clpi) 531 is associated with the AV stream file (01000.m2ts) 541 placed directly under the STREAM directory 540.
  • a playlist file (00001.mpls) 521 is placed in the PLAYLIST directory 520.
  • the “playlist file” defines the playback path of the AV stream file, that is, the playback target portion of the AV stream file and the playback order thereof.
  • the playlist file (00001.mpls) 521 defines the playback path of the AV stream file (01000.m2ts) 541 placed directly under the STREAM directory 540.
  • a BD-J object file (XXXXX.bdjo) 551 is placed in the BDJO directory 550.
  • the BD-J object file 551 includes one BD-J object.
  • the BD-J object is a bytecode program for causing a Java virtual machine installed in the playback device 103 to execute title playback processing and graphics video rendering processing.
  • the BD-J object is described in a compiler type language such as Java language.
  • the BD-J object includes an application management table and identification information of a playlist file to be referenced.
  • the application management table is a list of Java application programs to be executed by the Java virtual machine and their execution timing (life cycle).
  • the identification information of the playlist file to be referenced is information for identifying the playlist file corresponding to the reproduction target title.
  • the Java virtual machine calls each BD-J object according to a user operation or an application program, and executes the Java application program according to an application management table included in the BD-J object.
  • the playback device 103 dynamically changes the progress of the video of each title to be played back, or causes the display device 104 to display the graphics video independently of the title video.
  • the JAR file 561 generally includes a plurality of Java application program bodies to be executed according to the application management table indicated by the BD-J object.
  • the Java application program is a bytecode program written in a compiler type language such as the Java language, like the BD-J object.
  • the types of Java application programs include those that cause the Java virtual machine to execute title playback processing and those that cause the Java virtual machine to execute graphics video rendering processing.
  • the JAR file 561 is a Java archive file, and is expanded in its internal memory when it is read into the playback device 103. Thereby, a Java application program is stored in the memory.
  • FIG. 6 particularly shows the structure of the DCOPY directory 502.
  • a data xx (DATAxx) directory 601 and a data xx_audio (DATAxx_Audio) directory 602 are placed immediately below the DCOPY directory 502.
  • the characters “xx” represent serial numbers 01, 02,.
  • DATAxx directory digital copy content data is stored.
  • the data is stored in the SD-Video format under the DATAxx directory with the DATAxx directory as the root directory.
  • DATA01 directory 601 is in the SD-Video format
  • a data information (DATA_INFO) directory 610 and a program nnn (PROGRAMnnn) directory 620 are placed immediately below.
  • nnn represent serial numbers 001, 002,.
  • a data information file (data.info) 611 is placed directly under the DATA_INFO directory 610.
  • the data information file 611 stores information on the entire data placed under the DATA01 directory 601 such as the number of programs stored in the DATA01 directory 601, the total playback time of those programs, and playlist information for those programs. Yes.
  • the “program” includes a digital copy content, a still image, or a menu screen.
  • a management information file (pgnnn.strm) 621 and a digital copy AV stream file (mvnnn.strm) 622 are placed immediately below the PROGRAMnnnn directory 620.
  • the digital copy AV stream file 622 represents the content having the same content as the HD content represented by the AV stream file placed immediately below the STREAM directory 540, but the image quality is SD.
  • One digital copy AV stream file 622 includes one video stream and one or two audio streams. Therefore, the audio stream in the digital copy AV stream file corresponds to only one or two audio streams in the HD content.
  • SD content corresponding to HD content represented by one AV stream file placed directly under the STREAM directory 540 may be represented by a plurality of digital copy AV stream files.
  • the management information file 621 includes information regarding the digital copy AV stream file 622.
  • the information includes attribute information of the video stream and audio stream stored in the digital copy AV stream file 622.
  • the video stream attribute information includes a codec type, a frame rate, a resolution, and an aspect ratio
  • the audio stream attribute information includes a codec type, a sampling frequency, and the number of channels.
  • a program nnn (PROGRAMnnn) directory 630 is placed immediately below the DATAxx_Audio directory 602.
  • the characters “nnn” represent serial numbers 001, 002,.
  • a plurality of audio streams (mvnnn.strm.a1, mvnnn.strm.a2, mvnnn.strm.a3) 631 to 633 are placed in the PROGRAMnnn directory 630.
  • These audio streams are audio streams included in an AV stream file placed directly under the STREAM directory 540, and are converted into a digital copy AV stream file placed in the PROGRAMnnnn directory 620 directly under the DATAxx directory 601. Corresponds to what is not included.
  • an AV stream file (01000.m2ts) 541 placed directly under the STREAM directory 540 contains English, Japanese, Chinese, and German audio streams, and is a digital copy placed in the DATA01 directory 601.
  • the DATA01_Audio directory 602 includes a Japanese audio stream (mv001.strm.a1) 631, a Chinese audio stream (mv001.strm). strm.a2) 632 and a German audio stream (mv001.strm.a3) 633.
  • an audio stream placed in the DATAxx_Audio directory is referred to as a “replacement stream file”.
  • FIG. 7 is a table showing elementary streams multiplexed in the AV stream file 541 placed immediately below the STREAM directory 540 shown in FIG.
  • the AV stream file includes a primary video stream 701 and primary audio streams 702A and 702B.
  • the file may additionally include presentation graphics (PG) streams 703A, 703B, interactive graphics (IG) stream 704, secondary audio stream 705, and secondary video stream 706.
  • PG presentation graphics
  • IG interactive graphics
  • secondary audio stream 705 secondary audio stream
  • the primary video stream 701 represents the main video of the movie
  • the secondary video stream 706 represents the sub video.
  • the main video means a main video of content such as a main video of a movie, for example, one displayed on the entire screen.
  • the sub-picture means a picture that is displayed on the screen simultaneously with the main picture by using a picture-in-picture method, such as a picture that is displayed on a small screen in the main picture.
  • Each video stream 701, 706 is encoded by a moving image compression encoding method such as MPEG-2, MPEG-4 AVC, or SMPTE VC-1.
  • Primary audio streams 702A and 702B represent the main audio of the movie.
  • the secondary audio stream 705 represents the sub audio to be mixed with the main audio.
  • Each audio stream 702A, 702B, 705 is AC-3, Dolby Digital Plus (Dolby Digital Plus: “Dolby Digital” is a registered trademark), MLP (Meridian Lossless Packing: registered trademark), DTS (Digital Theater System) : Registered trademark), DTS-HD, or linear PCM (Pulse Code Modulation).
  • Each PG stream 703A, 703B represents a graphics video to be displayed overlaid on the video represented by the primary video stream 701, such as graphics subtitles.
  • the language of the caption is different between the two PG streams 703A and 703B.
  • the IG stream 704 represents a graphics component for a graphic user interface (GUI) for configuring an interactive screen on the screen of the display device 104 and its arrangement.
  • GUI graphic user interface
  • Elementary streams 701-706 are identified by packet identifiers (PID). For example, PID assignment is as follows.
  • the primary video stream 701 is assigned a hexadecimal value of 0x1011. Up to 32 elementary streams other than video streams can be multiplexed for each type in one AV stream file.
  • any one of 0x1100 to 0x111F is assigned to the primary audio streams 702A and 702B.
  • One of 0x1200 to 0x121F is assigned to the PG streams 703A and 703B.
  • Any of 0x1400 to 0x141F is assigned to the IG stream 704.
  • the secondary audio stream 705 is assigned one of 0x1A00 to 0x1A1F.
  • the secondary video stream 706 is assigned any one of 0x1B00 to 0x1B1F.
  • FIG. 8 is a schematic diagram showing the arrangement of TS packets belonging to the elementary streams 801, 802, 803, and 804 in the AV stream file 800.
  • each frame 801A is converted into one PES (Packetized Elementarty Stream) packet 811.
  • PES Packetized Elementarty Stream
  • each PES packet 811 is generally converted into a plurality of TS packets 821.
  • the audio stream 802, the PG stream 803, and the IG stream 804 are once converted into a sequence of PES packets 812, 813, and 814, and then converted into a sequence of TS packets 822, 823, and 824, respectively.
  • TS packets 821, 822, 823, and 824 obtained from the elementary streams 801, 802, 803, and 804 are multiplexed on a single stream data 800 by time division.
  • each TS packet 901 is a packet having a length of 188 bytes.
  • each TS packet 901 includes a TS payload 901P, an adaptation field (hereinafter abbreviated as an AD field) 901A, and a TS header 901H.
  • the TS payload 901P and the AD field 901A are both a data area having a length of 184 bytes.
  • the TS payload 901P is used as a PES packet storage area.
  • the AD field 901A is an area for storing stuffing bytes (that is, dummy data) when the data amount of the TS payload 901P is less than 184 bytes.
  • the AD field 901A is used as an information storage area when the TS packet 901 is, for example, a PCR described later.
  • the TS header 901H is a 4-byte data area.
  • FIG. 9 is a schematic diagram showing a data structure of the TS header 901H.
  • the TS header 901H includes a TS priority (transport_priority) 911, a PID 912, and an AD field control (adaptation_field_control) 913.
  • the PID 912 indicates the PID of the elementary stream to which the data stored in the TS payload 901P in the same TS packet 901 belongs.
  • the TS priority 911 indicates the priority of the TS packet 901 in the TS packet group having a common value indicated by the PID 912.
  • the AD field control 913 indicates whether each of the AD field 901A and the TS payload 901P in the TS packet 901 is present.
  • the TS packet 901 does not include the AD field 901A but includes the TS payload 901P.
  • the AD field control 913 indicates “2”.
  • the TS packet 901 includes both the AD field 901A and the TS payload 901P.
  • FIG. 9 is a schematic diagram showing the format of a source packet sequence composed of TS packet sequences of an AV stream file.
  • each source packet 902 is a 192-byte packet, and one of the TS packets 901 shown in FIG. 9B and a 4-byte header (TP_Extra_Header) 902H.
  • TP_Extra_Header TP_Extra_Header
  • the source packet 902 is configured by adding a header 902H to the TS packet 901.
  • the header 902H includes ATS (Arrival_Time_Stamp).
  • ATS is time information and is used as follows: When the source packet 902 is sent from the BD-ROM disc 101 to the system target decoder in the playback apparatus 103, the source packet 902 is transmitted to the TS packet. 902P is extracted and transferred to the PID filter in the system target decoder. The ATS in the header 902H indicates the time at which the transfer should start.
  • the “system target decoder” refers to a device that decodes an AV stream file for each elementary stream. Details of the system target decoder and its use of ATS will be described later.
  • FIG. 9D is a schematic diagram of sectors on the volume area 202B of the BD-ROM disc 101 in which a series of source packets 902 are continuously recorded.
  • the 32 source packets 902 recorded in three consecutive sectors 921 to 923 are referred to as “aligned unit” 920.
  • the playback device 103 reads source packets 902 from the BD-ROM disc 101 for each aligned unit 920, that is, 32 pieces.
  • the sector groups 921, 922, 923,... Are divided into 32 pieces in order from the top, and each constitutes one error correction code (ECC) block 930.
  • ECC error correction code
  • the BD-ROM drive performs error correction processing for each ECC block 930.
  • FIG. 10 is a schematic diagram showing the data structure of the PG stream 1000.
  • the PG stream 1000 includes a plurality of data entries # 1, # 2,. Each data entry represents a display unit (display set) of the PG stream 1000, and includes data necessary for causing the playback device 103 to configure one graphics plane.
  • Graphics plane refers to plane data generated from graphics data representing a graphics video.
  • Plane data refers to a two-dimensional array of pixel data having a size equal to the resolution of a video frame.
  • One set of pixel data consists of a combination of a color coordinate value and an ⁇ value (opacity). The color coordinate value is represented by an RGB value or a YCrCb value.
  • Types of graphics planes include PG planes, IG planes, image planes, and on-screen display (OSD) planes.
  • the PG plane is generated from the PG stream.
  • the IG plane is generated from the IG stream.
  • the image plane is generated according to the BD-J object.
  • the OSD plane is generated according to the firmware of the playback device 103.
  • each data entry includes multiple functional segments. These functional segments are, in order from the top, a display control segment (Presentation Control Segment: PCS), a window definition segment (Window Definition Segment: WDS), a palette definition segment (Pallet Definition Segment: PDS), and an object definition segment (Object Definition). Segment: ODS).
  • a display control segment Presentation Control Segment: PCS
  • a window definition segment Window Definition Segment: WDS
  • a palette definition segment Pallet Definition Segment: PDS
  • ODS object definition segment
  • the WDS defines a rectangular area in the graphics plane, that is, a window.
  • the WDS includes a window ID 1011, a window position 1012, and a window size 1013.
  • the window ID 1011 is WDS identification information (ID).
  • the window position 1012 indicates the position of the window in the graphics plane, for example, the coordinates of the upper left corner of the window.
  • Window size 1013 indicates the height and width of the window.
  • the PDS defines a correspondence relationship between a predetermined type of color ID and color coordinate values (for example, luminance Y, red difference Cr, blue difference Cb, opacity ⁇ ).
  • the PDS includes a palette ID 1021 and a color lookup table (CLUT) 1022.
  • the palette ID 1021 is the PDS ID.
  • ODS generally represents a single graphics object.
  • the “graphics object” is data that represents a graphics image with a correspondence relationship between a pixel code and a color ID.
  • the graphics object is compressed using a run-length encoding method and then divided and distributed to each ODS.
  • Each ODS further includes an object ID, i.e., the ID of the graphics object.
  • PCS shows details of display sets belonging to the same data entry, and in particular defines the screen configuration using graphics objects.
  • the screen composition types are cut-in / out (Cut-In / Out), fade-in / out (Fade-In / Out), color change (Color Change), scroll (Scroll), and wipe-in / out. Includes Out (Wipe-In / Out).
  • the PCS includes an object display position 1001, cropping information 1002, a reference window ID 1003, a reference palette ID 1004, and a reference object ID 1005.
  • the object display position 1001 is a position in the graphics plane where the graphics object is to be displayed, for example, the coordinates of the upper left corner of the area where the graphics object is to be displayed, using the coordinates in the window specified by the WDS.
  • the cropping information 1002 indicates a range of a rectangular portion to be cut out from the graphics object by the cropping process. The range is defined by, for example, the coordinates, height, and width of the upper left corner. That portion is actually drawn at the position indicated by the object display position 1001.
  • the reference window ID 1003, the reference palette ID 1004, and the reference object ID 1005 indicate the IDs of the WDS, PDS, and graphics object to be referred to in the graphics object drawing process, respectively.
  • the content provider uses the parameters in the PCS to instruct the playback apparatus 103 to configure the screen. As a result, for example, the playback device 103 can realize a visual effect of “displaying the next subtitle while gradually erasing a subtitle”.
  • the IG stream 804 includes an interactive composition segment (ICS), a PDS, and an ODS.
  • PDS and ODS are functional segments similar to those included in the PG stream 803.
  • a graphics object included in the ODS represents a GUI graphic component that forms an interactive screen such as a button and a pop-up menu.
  • the ICS defines interactive operations using those graphics objects.
  • the ICS defines states that can be taken for each of the graphics objects such as buttons and pop-up menus whose states change according to the user operation, that is, normal, selected, and active states.
  • the ICS further includes button information.
  • the button information includes a command to be executed by the playback device when the user performs a confirmation operation on the button or the like.
  • FIG. 11 is a schematic diagram showing details of the data structure of the video stream 1100.
  • the video stream 1100 includes pictures 1111, 1112, 1113, 1114,.
  • Each picture 1111,... Represents one frame or one field, and is compressed by a moving image compression encoding method such as MPEG-2 or MPEG-4 AVC.
  • inter-picture predictive coding For compression of each picture by the above encoding method, redundancy in the spatial direction and temporal direction of the picture is used.
  • intra-picture coding coding of a picture that uses only redundancy in the spatial direction.
  • inter-picture predictive coding coding of a picture that uses redundancy in the temporal direction, that is, data closeness between a plurality of pictures in the display order.
  • inter-picture predictive coding In inter-picture predictive coding, first, another picture whose display time is before or after the picture to be coded is set as a reference picture. Next, a motion vector is detected between the picture to be encoded and the reference picture, and motion compensation is performed using the motion vector. Further, a difference value between the motion-compensated picture and the picture to be encoded is obtained, and redundancy in the spatial direction is removed from the difference value. Thus, the data amount of each picture is compressed.
  • pictures included in the video stream 1100 are generally divided into a plurality of GOPs (Group Of Pictures) 1110 and 1120.
  • GOP refers to a sequence of a plurality of consecutive pictures starting from an I (Intra) picture.
  • I picture refers to a picture compressed by intra-picture coding.
  • a GOP generally includes a P (Predictive) picture and a B (Bidirectionally Predictive) picture in addition to an I picture.
  • a “P picture” is a picture compressed by inter-picture predictive coding, in which one I picture or another P picture whose display time is earlier than that is used as a reference picture.
  • B picture refers to a picture compressed by inter-picture predictive coding, in which two I-pictures or P-pictures whose display time is earlier or later are used as reference pictures.
  • B pictures those used as reference pictures in inter-picture predictive coding for other pictures are particularly referred to as “Br (reference B) pictures”.
  • the pictures in each GOP 1110 and 1120 are compressed in the following order.
  • the first picture 1111 is first compressed into an I 0 picture.
  • a subscript number indicates a serial number assigned to each picture in order of display time.
  • the fourth picture 1114 is compressed as P 3 picture as a reference picture to I 0 picture 1111.
  • the second and third pictures 1112 and 1113 are compressed into a B 1 picture and a B 2 picture, respectively, using the I 0 picture 1111 and the P 3 picture 1114 as reference pictures.
  • the first picture 1121 is first compressed into an I picture, and then the third picture 1124 is compressed into a P picture using the I picture 1121 as a reference picture. Subsequently, the second and third pictures 1122, 1123 are compressed into B pictures using the I picture 1121 and the P picture 1124 as reference pictures.
  • each GOP 1110, 1120 always includes an I picture at the head, the picture can be decoded for each GOP.
  • the I 0 picture 1111 is first decoded alone.
  • the P 3 picture 1114 is decoded using the decoded I 0 picture 1111.
  • B 1 picture 1112 and B 2 picture 1113 are decoded using decoded I 0 picture 1111 and P 3 picture 1114.
  • Subsequent pictures are similarly decoded.
  • the video stream 1100 can be decoded independently, and can be randomly accessed in units of GOPs.
  • an actual video stream 1100 is generally composed of a plurality of video sequences # 1, # 2,.
  • Video sequence is a group of pictures 1111, 1112, 1113, 1114,... Composing one GOP 1110 and additional information such as a header individually.
  • a combination of this additional information and each picture is called a “video access unit (VAU)”. That is, in each GOP 1110, 1120, one VAU # 1, # 2,... Is configured for each picture.
  • Each picture can be read from the video stream 1100 in units of VAUs.
  • VAU # 11131 includes an access unit (AU) identification code 1131A, a sequence header 1131B, a picture header 1131C, supplementary data 1131D, and compressed picture data 1131E.
  • the second and subsequent VAU # 2,... Have the same structure as VAU # 11131, except that the sequence header 1131B is not included.
  • the AU identification code 1131A is a predetermined code indicating the tip of VAU # 11131.
  • the sequence header 1131B is also called a GOP header, and includes an identification number of the video sequence # 1 including VAU # 11131.
  • the sequence header 1131B further includes information common to the entire GOP 1110, such as resolution, frame rate, aspect ratio, and bit rate.
  • the picture header 1131C indicates a unique identification number, an identification number of the video sequence # 1, and information necessary for decoding a picture, for example, the type of encoding method.
  • the supplementary data 1131D includes additional information related to other than decoding of pictures, for example, character information indicating closed captions, information about the GOP structure, and time code information.
  • the compressed picture data 1131E includes a compressed picture.
  • the VAU may include any or all of padding data 1131F, sequence end code 1131G, and stream end code 1131H as necessary.
  • Padding data 1131F is dummy data.
  • the sequence end code 1131G indicates that the VAU is located at the end of the video sequence.
  • the stream end code 1131H indicates the end of the video stream 1100.
  • each part of the VAU shown in FIG. 11 is composed of one NAL (Network Abstraction Layer) unit.
  • NAL Network Abstraction Layer
  • the AU identification code 1131A, the sequence header 1131B, the picture header 1131C, the supplementary data 1131D, the compressed picture data 1131E, the padding data 1131F, the sequence end code 1131G, and the stream end code 1131H are respectively an AU delimiter.
  • Access Unit Delimiter SPS (Sequence Parameter Set), PPS (Picture Parameter Set), SEI (Supplemental Enhancement Information), View Component, Filler Data (Filler Data), End of Sequence (End of Sequence) and End of Stream (End of Stream).
  • FIG. 12 is a schematic diagram showing details of a method for storing the video stream 1201 in the PES packet sequence 1202.
  • pictures are multiplexed in the coding order instead of the display time order. That is, as shown in FIG. 12, in the VAU constituting the video stream 1201, an I 0 picture 1210, a P 3 picture 1211, a B 1 picture 1212, a B 2 picture 1213,. Has been.
  • a subscript number indicates a serial number assigned to each picture in order of display time.
  • P 3 picture 1211 The coding of P 3 picture 1211 is used as reference picture I 0 picture 1210, as in the coding of the B 1 picture 1212 and B 2 picture 1213 I 0 picture 1210 and P 3 picture 1211 and the reference picture Used.
  • These VAUs are stored one by one in different PES packets 1220, 1221, 1222, 1223,.
  • Each PES packet 1220 includes a PES payload 1220P and a PES header 1220H.
  • the VAU is stored in the PES payload 1220P.
  • the PES header 1220H includes a display time (PTS: Presentation Time-Stamp) of a picture stored in the PES payload 1220P of the same PES packet 1220, and a decoding time (DTS: Decoding Time-Stamp) of the picture.
  • PTS Presentation Time-Stamp
  • DTS Decoding Time-Stamp
  • each PES payload of a series of PES packets includes a PTS of data stored in the PES payload of the PES packet.
  • the types of TS packets included in the AV stream file include, in addition to those converted from the elementary stream shown in FIG. 8, PAT (Program Association Table), PMT (Program Map Table), and PCR (Program Clock Reference).
  • PCR, PMT, and PAT are defined in the European digital broadcasting standard, and originally have a role of defining a partial transport stream constituting one program.
  • the AV stream file is also defined in the same manner as the partial transport stream.
  • PAT indicates the PID of the PMT included in the same AV stream file.
  • the PID of the PAT itself is 0.
  • the PMT includes the PID of each elementary stream representing video / audio / subtitles and the attribute information included in the same AV stream file.
  • the PMT further includes various descriptors (also referred to as descriptors) regarding the AV stream file.
  • the descriptor includes copy control information indicating permission / prohibition of copying of the AV stream file.
  • the PCR includes information indicating the value of STC (System Time Clock) to be associated with the ATS assigned to itself.
  • STC System Time Clock
  • STC is a clock used as a reference for PTS and DTS by the decoder in the playback apparatus 103.
  • the decoder uses PCR to synchronize the STC with the ATC.
  • FIG. 13 is a schematic diagram showing the data structure of the PMT 1310.
  • the PMT 1310 includes a PMT header 1301, a descriptor 1302, and stream information 1303.
  • the PMT header 1301 indicates the length of data included in the PMT 1310.
  • Each descriptor 1302 is a descriptor relating to the entire AV stream file including the PMT 1310.
  • the aforementioned copy control information is included in one of the descriptors 1302.
  • the stream information 1303 is information regarding each elementary stream included in the AV stream file, and is assigned to a different elementary stream one by one.
  • Each stream information 1303 includes a stream type 1331, a PID 1332, and a stream descriptor 1333.
  • the stream type 1331 includes identification information of a codec used for compressing the elementary stream.
  • PID1332 indicates the PID of the elementary stream.
  • the stream descriptor 1333 includes attribute information of the elementary stream, such as a frame rate and an aspect ratio.
  • the decoder in the playback device 103 can process the AV stream file in the same manner as a partial transport stream compliant with the European digital broadcasting standard. Thereby, compatibility between the playback device for the BD-ROM disc 101 and a terminal device compliant with the European digital broadcasting standard can be ensured.
  • FIG. 14 is a schematic diagram showing the data structure of the clip information file (01000.clpi) 531 shown in FIG.
  • the clip information file 531 includes clip information 1410, stream attribute information 1420, and an entry map 1430.
  • the clip information 1410 includes a system rate 1411, a playback start time 1412, and a playback end time 1413, as shown in FIG.
  • the system rate 1411 defines the system rate R TS for the AV stream file (01000.m2ts) 541 shown in FIG.
  • the playback apparatus 103 internally transfers the AV stream file in units of TS packets.
  • the ATS interval of the source packet is set in the AV stream file 541 so that the transfer rate of the TS packet at that time is suppressed to the system rate R TS or less.
  • the reproduction start time 1412 indicates the PTS assigned to the top VAU of the AV stream file 541.
  • the playback end time 1412 indicates an STC value that is further delayed by a predetermined amount from the PTS assigned to the VAU at the rear end of the AV stream file 541, for example, a value obtained by adding the playback time per frame to the PTS of the last frame. .
  • the stream attribute information 1420 is a correspondence table between the PID 1421 of each elementary stream included in the AV stream file 541 and its attribute information 1422 as shown in FIG.
  • the attribute information 1422 is different for each of the video stream, the audio stream, the PG stream, and the IG stream.
  • the attribute information associated with PID 0x1011 of the primary video stream indicates the type of codec used for compression of the video stream, the resolution of each picture constituting the video stream, the aspect ratio, and the frame rate. Including.
  • the attribute information associated with PID 0x1100 of the primary audio stream includes the type of codec used for compression of the audio stream, the number of channels included in the audio stream, the language, and the sampling frequency.
  • the attribute information 1422 is used by the playback device 103 to initialize the decoder.
  • FIG. 15 is a schematic diagram showing the data structure of the entry map 1430.
  • the entry map 1430 includes a table 1500.
  • the number of tables 1500 is the same as the number of video streams multiplexed in the AV stream file 541, and one table is assigned to each video stream.
  • each table 1500 is distinguished by the PID of the video stream to which it is assigned.
  • Each table 1500 includes an entry map header 1501 and an entry point 1502.
  • the entry map header 1501 includes the PID associated with the table 1500 and the total number of entry points 1502 included in the table 1500.
  • the entry point 1502 associates a pair of a PTS 1503 and a source packet number (SPN) 1504 one by one with a different entry point ID (EP_ID) 1505.
  • the PTS 1503 is equal to the PTS of any I picture included in the PID video stream indicated by the entry map header 1501.
  • the SPN 1504 is equal to the first SPN of the source packet group in which the I picture is stored.
  • SPN refers to a serial number assigned in order from the top to a source packet group belonging to one AV stream file.
  • the SPN is used as an address of each source packet in the AV stream file. That is, the entry point 1502 represents the correspondence between the PTS and address of each I picture included in the AV stream file 541, that is, the SPN.
  • FIG. 15B is a schematic diagram showing the source packet group 1510 belonging to the AV stream file 541 that is associated with each EP_ID 1505 by the entry map 1430.
  • the playback device 103 obtains the product of the SPN and the data amount of 192 bytes per source packet, and further quotient SPN ⁇ 192 when the product is divided by the data amount of 2048 bytes per sector. / 2048 is obtained.
  • the quotient is recorded in the source packet group 1510 belonging to the AV stream file 541 in the part before the source packet to which the SPN is assigned. Equal to the total number of sectors.
  • the playback device 103 refers to the file entry of the AV stream file 541, and specifies the LBN of the sector (the above total number + 1) from the head of the sector group in which the source packet group 1510 is recorded.
  • the LBN of the 301st sector counted from the beginning of the sector group in which the extents EXT [0], EXT [1], EXT [2],. Is identified.
  • the playback device 103 designates the LBN as the BD-ROM drive. Thereby, the source packet group 1510 is read out in units of aligned units in order from the sector of the LBN.
  • the playback device 103 selects a source packet indicated by the entry point of the playback start position from the aligned unit that is read first, and extracts and decodes the I picture from them. Thereafter, subsequent pictures are sequentially decoded using the previously decoded pictures. In this way, the playback device 103 can play back the video after the specific PTS from the AV stream file 541.
  • Entry map 1430 is further advantageous for efficient processing of special playback such as fast forward playback and rewind playback.
  • the playback device 103 uses the file entry of the AV stream file 541 to specify the LBN of the sector corresponding to each SPN.
  • the playback device 103 designates each LBN as a BD-ROM drive. Thereby, the aligned unit is read from the sector of each LBN.
  • the playback device 103 further selects a source packet indicated by each entry point from each aligned unit, extracts an I picture from them, and decodes it.
  • FIG. 16 is a schematic diagram showing the data structure of the playlist file (00001.mpls) 521 shown in FIG. Referring to FIG. 16, the playlist file 521 includes a main path 1601 and two sub paths 1602 and 1603.
  • the main path 1601 is an array of play item information (hereinafter abbreviated as PI), and defines the main playback path of the AV stream file 541, that is, the playback target portion and the playback order.
  • # N defines a different playback section of the main playback path with a pair of PTSs. One of the pairs represents the start time (In-Time) of the playback section, and the other represents the end time (Out-Time).
  • the order of PIs in the main path 1601 represents the order of the corresponding playback sections in the playback path.
  • Each sub-path 1602 and 1603 is an array of sub-playitem information (hereinafter abbreviated as SUB_PI), and defines playback paths that can accompany the main playback path of the AV stream file 541 in parallel.
  • the playback path includes a part different from the part of the AV stream file 541 represented by the main path 1601 and its playback order, or a part of stream data multiplexed in another AV stream file and its playback order. Show.
  • the video represented by the stream data is to be played back simultaneously with the video played from the AV stream file 541 according to the main path 1601, for example, a sub-picture, a browser screen, a pop-up in the picture-in-picture method -Includes menus or subtitles.
  • Sub-paths 1602 and 1603 are assigned serial numbers “0” and “1” in the order of registration in the playlist file 521.
  • the serial number is used as a sub path ID to identify each of the sub paths 1602 and 1603.
  • # M the number of the pair
  • Each SUB_PI # M defines a playback section having a different playback path by a pair of PTSs. One of the pair represents the reproduction start time of the reproduction section, and the other represents the reproduction end time.
  • the order of SUB_PI in each of the sub-paths 1602 and 1603 represents the order of the corresponding playback section in the playback path.
  • FIG. 17 is a schematic diagram showing the data structure of PI # N.
  • PI # N includes reference clip information 1701, playback start time (In_Time) 1702, playback end time (Out_Time) 1703, connection condition 1704, and stream selection table (hereinafter STN (Stream Number)). (Abbreviated as table) 1705 included.
  • the reference clip information 1701 is information for identifying the clip information file 531.
  • the reproduction start time 1702 and the reproduction end time 1703 indicate the respective PTSs at the front end and the rear end of the reproduction target portion of the AV stream file 541.
  • connection condition 1704 connects the video in the playback section specified by the playback start time 1702 and the playback end time 1703 to the video in the playback section specified by the previous PI # (N ⁇ 1). Specify the conditions for when.
  • the STN table 1705 represents a list of elementary streams that can be selected from the AV stream file 541 by the decoder in the playback device 103 between the playback start time 1702 and the playback end time 1703.
  • the data structure of the SUB_PI is common to the data structure of the PI shown in FIG. 17 in that it includes reference clip information, a reproduction start time, and a reproduction end time.
  • the reproduction start time and reproduction end time of SUB_PI are represented by values on the same time axis as those of PI.
  • the SUB_PI further includes a field called “SP connection condition”.
  • the SP connection condition has the same meaning as the PI connection condition.
  • connection condition (hereinafter abbreviated as CC) 1704 can take, for example, three types of values “1”, “5”, and “6”.
  • CC1704 is “1”
  • the video reproduced from the portion of the AV stream file 541 defined by PI # N is the portion of the AV stream file 541 defined by the immediately preceding PI # (N ⁇ 1). It is not always necessary to be seamlessly connected to the video reproduced from the video.
  • CC1704 is “5” or “6” both of the images must be seamlessly connected.
  • 18 (a) and 18 (b) show the relationship between two playback sections PI # (N ⁇ 1) and PI # N to be connected when CC is “5” and “6”, respectively. It is a schematic diagram shown. Here, PI # (N ⁇ 1) defines the first part 1801 of the AV stream file 541, and PI # N defines the second part 1802 of the AV stream file 541.
  • STC may be interrupted between two PI # (N ⁇ 1) and PI # N. That is, PTS # 1 at the rear end of the first portion 1801 and PTS # 2 at the front end of the second portion 1802 may be discontinuous. However, some constraints must be met.
  • the portions 1801 and 1802 when the second portion 1802 is supplied to the decoder following the first portion 1801, the portions 1801 and 1802 must be created so that the decoder can continue the decoding process smoothly. Furthermore, the last frame of the audio stream included in the first portion 1801 must overlap the first frame of the audio stream included in the second portion 1802.
  • CC when CC is “6”, the first part 1801 and the second part 1802 must be able to be handled as a series of parts in the decoding process of the decoder. . That is, between the first part 1801 and the second part 1802, both STC and ATC must be continuous.
  • the SP connection condition is “5” or “6”
  • both the STC and the ATC must be continuous between the portions of the file 2D defined by two adjacent SUB_PIs.
  • the STN table 1705 is an array of stream registration information.
  • Stream registration information is information individually indicating elementary streams that can be selected as playback targets from the AV stream file 541 between the playback start time 1702 and the playback end time 1703.
  • a stream number (STN) 1706 is a serial number individually assigned to the stream registration information, and is used by the playback apparatus 103 to identify each elementary stream.
  • the STN 1706 further represents the priority of selection among elementary streams of the same type.
  • the stream registration information includes a stream entry 1709 and stream attribute information 1710.
  • the stream entry 1709 includes stream path information 1707 and stream identification information 1708.
  • the stream path information 1707 is information indicating the AV stream file to which the selected elementary stream belongs.
  • the AV stream file corresponds to the clip information file indicated by the reference clip information 1701.
  • Either the playback start time or the playback end time specified by the SUB_PI is included in the period from the playback start time 1702 specified by the PI including the STN table 1705 to the playback end time 1703.
  • the stream identification information 1708 indicates the PID of the elementary stream multiplexed in the AV stream file specified by the stream path information 1707.
  • the elementary stream indicated by this PID can be selected between the reproduction start time 1702 and the reproduction end time 1703.
  • Stream attribute information 1710 represents attribute information of each elementary stream. For example, each attribute information of the audio stream, PG stream, and IG stream indicates the type of language.
  • FIG. 19 is a schematic diagram showing the correspondence between the PTS indicated by the playlist file (00001.mpls) 521 and the portion reproduced from the AV stream file (01000.m2ts) 541.
  • PI # 1 defines PTS # 1 indicating the reproduction start time IN1 and PTS # 2 indicating the reproduction end time OUT1.
  • the reference clip information of PI # 1 indicates a clip information file (01000.clpi) 531.
  • the playback device 103 refers to the entry map of the clip information file 531, and searches for the SPN # 1 and # 2 in the AV stream file 541 corresponding to the PTS # 1 and # 2. Subsequently, the playback device 103 calculates the number of sectors corresponding to each from the SPNs # 1 and # 2. The playback device 103 further uses the number of sectors and the file entry of the AV stream file 541 to read the leading end of the sector group P1 in which the extent group EXT [0],... EXT [n] to be played back is recorded. LBN # 1 and rear end LBN # 2 are identified. The calculation of the number of sectors and the identification of the LBN are as described with reference to FIG.
  • the playback device 103 designates the range from LBN # 1 to LBN # 2 to the BD-ROM drive.
  • the source packet group belonging to the extent group EXT [0],..., EXT [n] is read from the sector group P1 in the range.
  • the pair of PTS # 3 and # 4 indicated by PI # 2 is first converted to the pair of SPN # 3 and # 4 using the entry map of the clip information file 531.
  • the pair of SPN # 3 and # 4 is converted into the pair of LBN # 3 and # 4.
  • the source packet group belonging to the extent group is read from the sector group P2 in the range from LBN # 3 to LBN # 4.
  • the playback device 103 can play back video from the AV stream file 541 in accordance with the main path 1601 of the playlist file 521.
  • the playlist file 521 may include an entry mark 1901.
  • An entry mark 1901 indicates a point in the main path 1601 where playback should actually start. For example, as shown in FIG. 19, a plurality of entry marks 1901 may be set for PI # 1.
  • the entry mark 1901 is used for searching for the playback start position, particularly in cue playback. For example, when the playlist file 521 defines the playback path of a movie title, an entry mark 1901 is added to the beginning of each chapter. Thereby, the playback device 103 can play back the movie title for each chapter.
  • FIG. 20 is a schematic diagram showing the data structure of the index file (index.bdmv) 511 shown in FIG.
  • the index file 511 includes an index table 2010.
  • the control unit of the playback device 103 refers to a corresponding item in the index table 2010.
  • the control unit further calls an object associated with the item from the BD-ROM disc 101, and executes various processes in accordance therewith.
  • an item “first play” 2001 specifies an object to be called when the BD-ROM disc 101 is inserted into the BD-ROM drive 110.
  • an object for displaying a menu on the display device 104 when a command “return to menu” is input by a user operation is designated.
  • titles constituting the content on the BD-ROM disc 101 are individually assigned. For example, when a title to be played is specified by a user operation, an object for playing a video from an AV stream file corresponding to the title is specified in the item “title k” to which the title is assigned. ing.
  • the movie object MVO # 1 associated with the item “title 1” includes a group of instructions related to video playback processing using the playlist file (00001.mpls) 521.
  • the playlist file 521 is read from the BD-ROM disc 101 in accordance with the movie object MVO # 1, and the video is recorded along the playback path defined therein. Playback processing is executed.
  • the BD-J object BDJO # 1 associated with the item “title 2” includes an application management table related to video playback processing using the playlist file 521.
  • the Java application program is called from the JAR file 561 and executed according to the application management table in the BD-J object BDJO # 1.
  • the playlist file 521 is read from the BD-ROM disc 101, and video playback processing is executed along the playback path defined therein.
  • the data structure of the digital copy AV stream file (mv001.strm) 622 shown in FIG. 6 has two types, MP4 format and TS format.
  • FIG. 21 is a schematic diagram showing the data structure of an MP4 format file (hereinafter referred to as an MP4 file).
  • the MP4 file includes header information 2101 and media data 2102.
  • Media data 2102 is an entity of encoded video data and audio data. Specifically, the media data 2102 includes a plurality of chunks 2121, 2122, 2123, 2124,.
  • a “chunk” is a unit of encryption and consists of a plurality of samples.
  • Sample is a basic unit for handling the media data 2102, which means video access units VAU1, VAU2,... For video data, and audio frames AFR1, AFR2,. Means. Each sample is assigned a serial number (referred to as a sample number) in order of decoding time.
  • the header information 2101 indicates the position of each chunk 2121-2124 in the MP4 file, the playback time and size of the sample included in each chunk 2112-1124, whether random access is possible, and attribute information.
  • the header information 2101 is organized by the type of elementary stream, that is, by track.
  • the header information 2101 includes a video track trak (V) and an audio track trak (A).
  • the video track trak (V) includes information regarding the chunk (V) # 1 and chunk (V) # 2 of the video data
  • the audio track trak (A) includes the chunk (A) # 1 of audio data.
  • Information related to chunk (A) # 2 is included.
  • chunks referred to by the header information 2101 are indicated by dashed arrows.
  • MP4 files are organized as a collection of objects called boxes.
  • a Box consists of the following fields: The size (size) represents the size of the entire box.
  • the type (type) is an identifier of the Box, and is usually represented by four alphabetic characters.
  • the field length of type is 4 bytes.
  • searching for a Box in the MP4 file it is determined whether or not the 4-byte data representing the search target matches the identifier of the type field.
  • the version indicates the version number of the box.
  • a flag (flags) represents flag information set for each box.
  • the data is an area in which header information 2101 or media data 2102 is stored. Since version and flags are not essential, there is a box that does not include these.
  • FIG. 22 is a schematic diagram showing the configuration of a Box constituting an MP4 file.
  • an MP4 file is mainly composed of three types of boxes: ftyp, moov, and mdat.
  • ftyp Box identifiers, which are described in the type field of each Box.
  • ftyp is a box placed at the head of the MP4 file, and includes identification information of the MP4 file.
  • the moov includes header information 2101
  • the mdat includes media data 2102.
  • FIG. 23 is a schematic diagram showing a moov data structure. Boxes are arranged hierarchically in the moov data field. In particular, header information 2101 is stored in different boxes, “trak” for each track. Further, Boxes are arranged hierarchically in the data field of trak.
  • FIG. 23B is a tree diagram showing the hierarchical structure of Boxes in moov. Referring to (b) of FIG. 23, a box “stbl” is placed in the data field of trak, and a plurality of Boxes, “stco”, “stsc”, “stts”, “Stsz”, “stss”, and “stsd” are placed.
  • stco is called a chunk offset box (ChunkOffsetBox) and indicates the position of the chunk in the MP4 file.
  • stsc is a sample-to-chunk box (SampleToChunkBox), and indicates the correspondence between samples and chunks.
  • stts is a time-to-sample box (TimeToSampleBox), and indicates time information such as the decoding time and display start time of the sample.
  • stsz is a sample size box (SampleSizeBox) and is table information describing the size of each sample.
  • stss is a sync sample box (SyncSampleBox), and indicates a sample that can be randomly accessed.
  • stsd is called a sample description box (SampleDescriptionBox), and indicates attribute information applied to each sample.
  • (C) in FIG. 23 is a table indicated by a sample-to-chunk box (stsc).
  • stsc is table information, and each entry stores a chunk number, the number of samples, and a sample description ID.
  • the chunk number is an identification number assigned to the chunk included in the media data 2102.
  • the number of samples indicates the number of samples included in the chunk indicated by the chunk number.
  • the sample description ID includes identification information for referring to the sample description box (stsd). For chunks with common attribute information, the sample description ID is also common.
  • FIG. 25 is a schematic diagram showing the data structure of a VAU when an MPEG-4 AVC video stream is stored in an MP4 file. Unlike the VAU shown in FIG. 11, the VAU shown in FIG. 25 does not include a sequence header, a picture header, and padding data.
  • NAL units In terms of NAL units, they correspond to SPS, PPS, and filler data.
  • the compressed picture data is divided into a plurality of slice data. Size information is stored instead of the start code at the head of the NAL unit corresponding to each of the AU identification code and the slice data. Note that the AU identification code may be omitted.
  • FIG. 26 is a schematic diagram showing the data structure of a TS format file.
  • the TS format digital copy AV stream file is an MPEG-2 TS format digital stream similar to the AV stream file stored in the BDMV directory 501. Therefore, the data structure is the same as that shown in FIGS. 7, 8, 9, 12, and 13. For those similar parts, the explanations for those figures are incorporated.
  • a digital copy AV stream file in the TS format is called a TOD (Transport Stream Object ⁇ ⁇ ⁇ ⁇ Data) file.
  • the TOD file 2601 is composed of a plurality of packet sequences 2602.
  • the packet sequence 2602 is a unit of encryption.
  • Each packet sequence 2602 includes one or more ETS (Extended Transport Stream) packets 2603.
  • the ETS is 192 bytes long and includes one TS packet.
  • the header of ETS does not include ATS and is a reserved value.
  • FIG. 27A is a schematic diagram showing an example of a data structure when the digital copy AV stream file 622 is an MP4 file. Referring to (a) of FIG. 27, in the digital copy AV stream file 622, the number of samples of chunk # 1 of the audio stream is 10, the number of samples of chunk # 2 is 15, and the number of samples of chunk # 3 The number of samples is 10. (B), (c), and (d) of FIG. 27 are schematic diagrams showing the data structures of the replacement stream files 631, 632, and 633.
  • Each data structure of the replacement stream files 631 to 633 is the same data structure as the audio stream stored in the MP4 file. That is, each file is divided into a plurality of chunks and encrypted, and each chunk includes a plurality of audio frames.
  • the replacement stream files 631 to 633 are not limited to audio files stored in the digital copy AV stream file 622 shown in FIG.
  • the stream and chunk configuration are common. This configuration is shown in the sample to chunk box (stsc).
  • the replacement stream files 631 to 633 have the same attributes as the audio stream stored in the digital copy AV stream file 622, such as the number of channels and the sampling frequency.
  • the replacement stream files 631 to 633 are recorded at a constant bit rate (CBR). Accordingly, the chunk #n of the replacement stream file 631 to 633 is equal in size to the chunk #n of the digital copy AV stream file 622.
  • the replacement stream files 631 to 633 are encrypted with the same content encryption key as the digital copy AV stream file 622.
  • FIG. 28 is a functional block diagram of the playback device 103.
  • the playback apparatus 103 includes a BD-ROM drive 2801, a playback unit 2802, and a control unit 2803.
  • the playback unit 2802 includes a read buffer 2821, a system target decoder 2823, and a plane adder 2824.
  • the control unit 2803 includes a dynamic scenario memory 2831, a static scenario memory 2832, a user event processing unit 2833, a program execution unit 2834, a playback control unit 2835, and a player variable storage unit 2836.
  • the playback unit 2802 and the control unit 2803 are mounted on different integrated circuits. In addition, both may be integrated into a single integrated circuit.
  • the BD-ROM drive 2801 includes an optical pickup, that is, an optical head.
  • the optical head includes a semiconductor laser, a collimator lens, a beam splitter, an objective lens, a condenser lens, and a photodetector.
  • the light beam emitted from the semiconductor laser is collected in the recording layer of the disk 101 through the collimator lens, the beam splitter, and the objective lens in this order.
  • the collected light beam is reflected / diffracted by the recording layer.
  • the reflected / diffracted light is collected on a photodetector through an objective lens, a beam splitter, and a condenser lens.
  • the photodetector generates a reproduction signal having a level corresponding to the amount of collected light. Further, data is demodulated from the reproduced signal.
  • the BD-ROM drive 2801 reads data from the BD-ROM disc 101 in accordance with a request from the playback control unit 2835. Among the data, the extent of the AV stream file is transferred to the read buffer 2821, the dynamic scenario information is transferred to the dynamic scenario memory 2831, and the static scenario information is transferred to the static scenario memory 2832. .
  • “Dynamic scenario information” includes an index file, a movie object file, and a BD-J object file.
  • Static scenario information includes a playlist file and a clip information file.
  • the read buffer 2821, the dynamic scenario memory 2831, and the static scenario memory 2832 are all buffer memories.
  • a memory element built in the playback unit 2802 is used, and as the dynamic scenario memory 2831 and the static scenario memory 2832, a memory element built in the control unit 2803 is used.
  • different regions of a single memory element may be utilized as part or all of their buffer memories 2821, 2831, 2832.
  • the read buffer 2821 stores extents
  • the dynamic scenario memory 2831 stores dynamic scenario information
  • the static scenario memory 2832 stores static scenario information.
  • the system target decoder 2823 reads extents from the read buffer 2821 in units of source packets, performs demultiplexing processing, and performs decoding processing on each separated elementary stream.
  • information necessary for decoding each elementary stream such as the type of codec and the attribute of the stream, is sent from the reproduction control unit 2835 to the system target decoder 2823 in advance.
  • the system target decoder 2823 further converts each VAU in the decoded primary video stream, secondary video stream, IG stream, and PG stream into a main video plane, a sub video plane, an IG plane, and a PG plane. And is sent to the plane adder 2824.
  • the system target decoder 2823 mixes the decoded primary audio stream and secondary audio stream, and sends them to an audio output device such as the built-in speaker 104A of the display device 104.
  • the system target decoder 2823 receives graphics data from the program execution unit 2834.
  • the graphics data is for displaying graphics such as a GUI menu on the screen, and is represented by raster data such as JPEG or PNG.
  • the system target decoder 2823 processes the graphics data, converts it into an image plane, and sends it to the plane adder 2824.
  • the system target decoder 2823 further sends the audio data to the speaker 104A. Details of the system target decoder 2823 will be described later.
  • the plane adder 2824 reads the main video plane, sub-video plane, IG plane, PG plane, and image plane from the system target decoder 2823, and superimposes them on one video plane (frame or field). To synthesize.
  • the combined video plane is sent to the display device 104.
  • the user event processing unit 2833 detects a user operation through the remote control 105 or the front panel of the playback device 103, and requests the program execution unit 2834 or the playback control unit 2835 to perform processing depending on the type of the operation. For example, when the user presses a button on the remote controller 105 and instructs to display a pop-up menu, the user event processing unit 2833 detects the press and identifies the button. The user event processing unit 2833 further requests the program execution unit 2834 to execute a command corresponding to the button, that is, a pop-up menu display process. On the other hand, when the user presses the fast forward or rewind button on the remote controller 105, the user event processing unit 2833 detects the press and identifies the button. The user event processing unit 2833 further requests the playback control unit 2835 to perform fast forward or rewind processing of the currently played playlist.
  • the program execution unit 2834 is a processor that reads a program from a movie object file or a BD-J object file stored in the dynamic scenario memory 2831 and executes the program.
  • the program execution unit 2834 further performs the following control in accordance with each program: (1) Command the playback control unit 2835 to play a playlist; (2) Graphics or game graphics data for PNG or JPEG Is generated as raster data and transferred to the system target decoder 2823, and the system target decoder 2823 synthesizes the data with other video data.
  • the specific contents of these controls can be designed relatively freely through program design. That is, those control contents are determined by the movie object file and BD-J object file programming steps in the authoring step of the BD-ROM disc 101.
  • the playback control unit 2835 controls processing of transferring various data such as extents and index files from the BD-ROM disc 101 to the read buffer 2821, the dynamic scenario memory 2831, and the static scenario memory 2832.
  • a file system for managing the directory / file structure shown in FIGS. 5 and 6 is used as follows.
  • the playback control unit 2835 gives a file name to be searched to the file system by using a system call for file opening, and searches the directory / file structure.
  • the file system first transfers the file entry of the transfer target file to the memory in the reproduction control unit 2835, and generates an FCB (File Control Block) in the memory.
  • FCB File Control Block
  • the file system returns the file handle of the transfer target file to the reproduction control unit 2835.
  • the playback control unit 2835 presents the file handle to the BD-ROM drive 2801.
  • the BD-ROM drive 2801 transfers the file to be transferred from the BD-ROM disc 101 to the buffer memories 2821, 2831, and 2832.
  • the playback control unit 2835 controls the BD-ROM drive 2801 and the system target decoder 2823 to decode video data and audio data from the AV stream file. Specifically, the playback control unit 2835 first reads a playlist file from the static scenario memory 2832 in response to an instruction from the program execution unit 2834 or a request from the user event processing unit 2833, and stores the contents. Interpret. Next, the playback control unit 2835 designates the AV stream file to be played back to the BD-ROM drive 2801 and the system target decoder 2823 according to the interpreted content, particularly the playback path, and reads and decodes the AV stream file. Instruct. Such reproduction processing according to the playlist file is referred to as “playlist reproduction processing”.
  • the playback control unit 2835 sets various player variables in the player variable storage unit 2836 using static scenario information.
  • the playback control unit 2835 further refers to these player variables, specifies the elementary stream to be decoded to the system target decoder 2823, and provides information necessary for decoding each elementary stream.
  • the player variable storage unit 2836 is a register group for storing player variables.
  • the types of player variables include system parameters (SPRM) and general-purpose parameters (GPRM).
  • SPRM indicates the state of the playback device 103.
  • FIG. 29 is a list of SPRMs. Referring to FIG. 29, each SPRM is assigned a serial number 2901, and a variable value 2902 is individually associated with each serial number 2901. There are 64 SPRMs, for example, and the meanings of each are as follows. Here, the numbers in parentheses indicate serial numbers 2901.
  • SPRM (10) indicates the PTS of the picture being decoded, and is updated each time the picture is decoded and written to the main video plane memory. Therefore, the current playback point can be known by referring to SPRM (10).
  • the parental level of SPRM (13) indicates the lower limit of the age of the viewer who uses the playback device 103, and is used for parental control on the viewing of the title recorded on the BD-ROM disc 101.
  • the value of SPRM (13) is set by the user of the playback device 103 using the OSD of the playback device 103 or the like.
  • parental control refers to a process of limiting the viewing of a title depending on the age of the viewer.
  • the playback device 103 performs parental control for each title, for example, as follows. First, the playback device 103 reads the age limit for viewing the title from the BD-ROM disc 101 and compares it with the value of SPRM (13).
  • the restricted age represents the lower limit of the age of the viewer who is permitted to view the title. If the restricted age is less than or equal to the value of SPRM (13), playback device 103 continues to play the title. If the restricted age exceeds the value of SPRM (13), playback device 103 stops playback of the title.
  • the SPRM (16) audio stream language code and the SPRM (18) subtitle stream language code indicate default language codes of the playback device 103. They can be changed by the user by using the OSD of the playback apparatus 103, or can be changed to an application program through the program execution unit 2834. For example, when SPRM (16) indicates “English”, the playback control unit 2835 first selects the “English” language from the PI indicating the current playback section, that is, the STN table included in the current PI, in the playlist playback processing. Search for stream entries that contain code. Next, the playback control unit 2835 extracts the PID from the stream identification information of the stream entry and passes it to the system target decoder 2823. Thereby, the audio stream of the PID is selected and decoded by the system target decoder 2823. These processes can be executed by the playback control unit 2835 using a movie object file or a BD-J object file.
  • the player variable is updated by the playback control unit 2835 according to the change of the playback state during the playback process.
  • SPRM (1), SPRM (2), SPRM (21), and SPRM (22) are updated. They indicate the STNs of the audio stream, subtitle stream, secondary video stream, and secondary audio stream that are being processed in order.
  • SPRM (1) is changed by the program execution unit 2834.
  • the playback control unit 2835 uses the STN indicated by the changed SPRM (1) to search the STN table in the current PI for a stream entry including the STN.
  • the playback control unit 2835 extracts the PID from the stream identification information in the stream entry and passes it to the system target decoder 2823. Thereby, the audio stream of the PID is selected and decoded by the system target decoder 2823. In this way, the audio stream to be reproduced is switched.
  • subtitles and secondary video streams to be reproduced can be switched.
  • FIG. 30 is a flowchart of the reproduction operation of the reproduction apparatus 103. This operation is started, for example, when the BD-ROM disc 101 is inserted into the BD-ROM drive 2801.
  • step S3001 the playback device 103 reads stream data from the BD-ROM disc 101 by the BD-ROM drive 2801 and stores it in the read buffer 2821. Thereafter, the process proceeds to step S3002.
  • step S3002 the playback apparatus 103 reads the stream data from the read buffer 2821 by the system target decoder 2823, and demultiplexes the elementary stream from the stream data. Thereafter, processing proceeds to step S3003.
  • step S3003 the playback device 103 decodes each elementary stream by the system target decoder 2823.
  • a primary video stream, a secondary video stream, an IG stream, and a PG stream are decoded into a main video plane, a sub video plane, an IG plane, and a PG plane, respectively.
  • the primary audio stream and the secondary audio stream are mixed.
  • the graphics data from the program execution unit 2834 is converted into an image plane. Thereafter, processing proceeds to step S3004.
  • step S3004 the playback device 103 combines the main video plane, sub-video plane, IG plane, PG plane, and image plane decoded by the system target decoder 2823 into one video plane by the plane adder 2824. To do. Thereafter, processing proceeds to step S3005.
  • step S3005 the playback device 103 transmits the video plane combined by the plane adder 2824, the audio data mixed by the system target decoder 2823, and the control data from the playback control unit 2835 to the display device 104. Thereafter, processing proceeds to step S3006.
  • step S3006 the playback device 103 checks whether or not unprocessed stream data remains in the read buffer 2821. If it remains, the process is repeated from step S3001. If not, the process ends.
  • FIG. 31 is a flowchart of playlist playback processing by the playback control unit 2835.
  • the playlist playback process is started when the playback control unit 2835 reads a playlist file from the static scenario memory 2832.
  • step S3101 the playback control unit 2835 first reads one PI from the main path in the playlist file and sets it as the current PI.
  • the playback control unit 2835 selects the PID of the elementary stream to be played from the STN table of the current PI, and specifies the attribute information necessary for decoding them.
  • the selected PID and attribute information are instructed to the system target decoder 2823.
  • the playback control unit 2835 further specifies the SUB_PI associated with the current PI from the subpath in the playlist file. Thereafter, the process proceeds to step S3102.
  • step S3102 the playback control unit 2835 reads the reference clip information, the PTS # 1 indicating the playback start time IN1, and the PTS # 2 indicating the playback end time OUT1 from the current PI. From the reference clip information, the clip information file corresponding to the AV stream file to be reproduced is specified. Further, when there is a SUB_PI associated with the current PI, similar information is read out from them. Thereafter, the process proceeds to step S3103.
  • step S3103 the playback control unit 2835 searches for the SPN # 1 and # 2 in the AV stream file corresponding to the PTS # 1 and # 2 with reference to the entry map of the clip information file. Similarly, the PTS pair indicated by SUB_PI is also converted into a SPN pair. Thereafter, processing proceeds to step S3104.
  • the sector number pair converted from the PTS pair indicated by SUB_PI is also converted into an LBN pair and designated in the BD-ROM drive 2801.
  • the source packet group belonging to the extent group is read out in aligned unit units from the sector group in the specified range. Thereafter, processing proceeds to step S3106.
  • step S3106 the playback control unit 2835 checks whether an unprocessed PI remains in the main path. If it remains, the process is repeated from step S3101. If not, the process ends.
  • FIG. 32 is a functional block diagram of the system target decoder 2823.
  • the system target decoder 2823 includes a source depacketizer 3210, an ATC counter 3220, a first 27 MHz clock 3230, a PID filter 3240, an STC counter (STC1) 3250, a second 27 MHz clock 3260, a main Video decoder 3270, sub video decoder 3271, PG decoder 3272, IG decoder 3273, main audio decoder 3274, sub audio decoder 3275, image processor 3280, main video plane memory 3290, sub video plane memory 3291, PG plane memory 3292, an IG plane memory 3293, an image plane memory 3294, and an audio mixer 3295.
  • STC1 STC counter
  • the source depacketizer 3210 reads the source packet from the read buffer 2821, extracts the TS packet from the read packet, and sends it to the PID filter 3240.
  • the source depacketizer 3210 further adjusts the transmission time to the time indicated by the ATS of each source packet. Specifically, the source depacketizer 3210 first monitors the ATC value generated by the ATC counter 3220. Here, the value of ATC is incremented by the ATC counter 3220 according to the pulse of the clock signal of the first 27 MHz clock 3230. Next, the source depacketizer 3210 transfers the TS packet extracted from the source packet to the PID filter 3240 at the moment when the ATC value matches the ATS of the source packet. By adjusting the transmission time, the average transfer rate of TS packets from the source depacketizer 3210 to the PID filter 3240 does not exceed the value R TS defined by the system rate 1411 in the clip information file 531.
  • the PID filter 3240 first monitors the PID included in the TS packet sent from the source / depacketizer 3210. When the PID matches the PID designated in advance by the playback control unit 2835, the PID filter 3240 selects the TS packet and transfers it to the decoder 3270-3275 suitable for decoding the elementary stream indicated by the PID. For example, when the PID is 0x1011, the TS packet is transferred to the main video decoder 3270.
  • the TS packets are the sub video decoder 3271, the main audio decoder 3274, and the sub audio decoder, respectively. 3275, PG decoder 3272, and IG decoder 3273.
  • the PID filter 3240 further detects PCR from the TS packet using the PID of each TS packet. At that time, the PID filter 3240 sets the value of the STC counter 3250 to a predetermined value. Here, the value of the STC counter 3250 is incremented according to the pulse of the clock signal of the second 27 MHz clock 3260. Further, the value to be set in the STC counter 3250 is instructed from the reproduction control unit 2835 to the PID filter 3240 in advance.
  • Each decoder 3270-3275 uses the value of the STC counter 3250 as the STC. Specifically, each decoder 3270-3275 first reconstructs the TS packet received from the PID filter 3240 into a PES packet. Each decoder 3270-3275 then adjusts the timing of the decoding process of the data included in the PES payload according to the time indicated by the PTS or DTS included in the PES header.
  • the main video decoder 3270 includes a transport stream buffer (TB) 3201, a multiplexing buffer (MB) 3202, and an elementary stream buffer (EB).
  • TB transport stream buffer
  • MB multiplexing buffer
  • EB elementary stream buffer
  • An Elementary Stream Buffer 3203, a compressed video decoder (DEC) 3204, and a decoded picture buffer (DPB) 3205 are included.
  • the TB3201, MB3202, and EB3203 are all buffer memories, and each use one area of a memory element built in the main video decoder 3270. In addition, any or all of them may be separated into different memory elements.
  • the TB 3201 stores TS packets received from the PID filter 3240 as they are.
  • the MB 3202 stores the PES packet restored from the TS packet stored in the TB 3201.
  • the TS header is removed from the TS packet.
  • the EB 3203 extracts the encoded VAU from the PES packet and stores it.
  • the VAU stores compressed pictures, that is, I pictures, B pictures, and P pictures.
  • the PES header is removed from the PES packet.
  • the DEC 3204 is a hardware decoder specialized for the decoding process of compressed pictures, and is particularly composed of an LSI having an accelerator function for the decoding process.
  • the DEC 3204 decodes the picture from each VAU in the EB 3203 at the time indicated by the DTS included in the original PES packet.
  • the DEC 3204 analyzes the header of the VAU in advance, specifies the compression encoding method and stream attribute of the compressed picture stored in the VAU, and selects the decoding method based on them.
  • the compression encoding scheme includes, for example, MPEG-2, MPEG-4 AVC, and VC1.
  • the DEC 3204 further transfers the decoded uncompressed picture to the DPB 3205.
  • DPB 3205 is a buffer memory similar to TB3201, MB3202, and EB3203, and uses a region of a memory element built in main video decoder 3270. In addition, the DPB 3205 may be separated into different memory elements from the other buffer memories 3201, 3202, and 3203. The DPB 3205 temporarily holds the decoded picture. When a P picture or a B picture is decoded by the DEC 3204, the DPB 3205 retrieves a reference picture from the held decoded picture and provides it to the DEC 3204 in accordance with an instruction from the DEC 3204. Further, the DPB 3205 writes each held picture to the main video plane memory 3290 at the time indicated by the PTS included in the original PES packet.
  • the sub video decoder 3271 includes the same configuration as the main video decoder 3270.
  • the sub-picture decoder 3271 first decodes the TS packet of the secondary video stream received from the PID filter 3240 into an uncompressed picture. Next, the sub-picture decoder 3271 writes an uncompressed picture to the sub-picture plane memory 3291 at the time indicated by the PTS included in the PES packet.
  • the PG decoder 3272 decodes the TS packet received from the PID filter 3240 into an uncompressed graphics object, and writes it into the PG plane memory 3292 at the time indicated by the PTS included in the PES packet. Details of the writing process will be described later.
  • the IG decoder 3273 decodes the TS packet received from the PID filter 3240 into an uncompressed graphics object.
  • the IG decoder 3273 further writes the uncompressed graphics object to the IG plane memory 3293 at the time indicated by the PTS included in the PES packet restored from those TS packets. Details of these processes are the same as those performed by the PG decoder 3272.
  • the main audio decoder 3274 first stores the TS packets received from the PID filter 3240 in a built-in buffer. Next, the main audio decoder 3274 removes the TS header and the PES header from the TS packet group in the buffer, and decodes the remaining data into uncompressed LPCM audio data. The main audio decoder 3274 further sends the audio data to the audio mixer 3295 at the time indicated by the PTS included in the original PES packet. Here, the main audio decoder 3274 selects a decoding method of the compressed audio data according to the compression encoding method and stream attribute of the primary audio stream included in the TS packet.
  • the compression encoding method includes, for example, AC-3 or DTS.
  • the sub audio decoder 3275 includes the same configuration as the main audio decoder 3274.
  • the secondary audio decoder 3275 restores the PES packet from the TS packet group of the secondary audio stream received from the PID filter 3240, and decodes the data included in the PES payload into uncompressed LPCM audio data.
  • the secondary audio decoder 3275 sends the uncompressed LPCM audio data to the audio mixer 3295 at the time indicated by the PTS included in the PES header.
  • the secondary audio decoder 3275 selects a decoding method of the compressed audio data according to the compression encoding method and stream attribute of the secondary audio stream included in the TS packet.
  • the compression encoding method includes, for example, Dolby Digital Plus or DTS-HD LBR.
  • the audio mixer 3295 receives uncompressed audio data from each of the main audio decoder 3274 and the sub audio decoder 3275 and performs mixing using them.
  • the audio mixer 3295 further sends the synthesized sound obtained by the mixing to the built-in speaker 104A of the display device 104 or the like.
  • the image processor 3280 receives graphics data, that is, PNG or JPEG raster data from the program execution unit 2834. At that time, the image processor 3280 performs rendering processing on the graphics data and writes it to the image plane memory 3294.
  • FIG. 33A is a flowchart of processing in which the PG decoder 3272 decodes a graphics object from one data entry in the PG stream. This process is started when the PG decoder 3272 receives from the PID filter 3240 a TS packet group that constitutes one data entry shown in FIG.
  • FIGS. 33B to 33E are schematic diagrams showing graphics objects that change in accordance with the processing shown in FIG.
  • the PG decoder 3272 first identifies an ODS having the same object ID as the reference object ID 1005 in the PCS. The PG decoder 3272 then decodes the graphics object from the identified ODS and writes it to the object buffer.
  • the “object buffer” is a buffer memory built in the PG decoder 3272.
  • the “Nico-chan mark” FOB shown in FIG. 33B shows an example of a graphics object written in the object buffer.
  • step S3302 the PG decoder 3272 performs a cropping process according to the cropping information 1002 in the PCS, cuts out a part from the graphics object, and writes it in the object buffer.
  • the strip-like regions LST and RST are cut off from the left and right ends of the Nico-chan mark FOB, and the remaining portion OBJ is written in the object buffer.
  • step S3303 the PG decoder 3272 first identifies a WDS having the same window ID as the reference window ID 1003 in the PCS. Next, the PG decoder 3272 determines the display position of the graphics object in the graphics plane from the window position 1012 indicated by the specified WDS and the object display position 1001 in the PCS. In FIG. 33D, the position of the upper left corner of the window WIN in the graphics plane GPL and the position DSP of the upper left corner of the graphics object OBJ are determined.
  • step S3304 the PG decoder 3272 writes the graphics object in the object buffer at the display position determined in step S3303. At this time, the PG decoder 3272 determines a drawing range of the graphics object using the window size 1013 indicated by the WDS. In FIG. 33D, the graphics object OBJ is written in the graphics plane GPL within the range of the window WIN from the position DSP at the upper left corner.
  • step S3305 the PG decoder 3272 first identifies a PDS having the same palette ID as the reference palette ID 1004 in the PCS. Next, the PG decoder 3272 uses the CLUT 1022 in the PDS to determine a color coordinate value to be indicated by each pixel data in the graphics object. In FIG. 33 (e), the color of each pixel in the graphics object OBJ is determined. Thus, the drawing process of the graphics object including one data entry is completed. Steps S3301 to S3305 are executed by the time indicated by the PTS included in the same PES packet as the graphics object.
  • each extent of a file is composed of aligned units.
  • each extent constituting one AV stream file are separated from each other.
  • the size of each extent only needs to satisfy the following conditions.
  • FIG. 34 is a block diagram showing a playback processing system in the playback device 103.
  • the playback processing system includes a BD-ROM drive 3401, a read buffer 3402, and a system target decoder 3403.
  • the BD-ROM drive 3401 reads the extent from the BD-ROM disc 101 and transfers it to the read buffer 3402 at the reading speed RUD54 .
  • the read buffer 3402 receives and stores extents from the BD-ROM drive 3401.
  • the system target decoder 3403 reads the source packet from each extent stored in the read buffer 3402 at the average transfer rate R EXT and decodes it into video data VD and audio data AD.
  • the average transfer rate R EXT is equal to 192/188 times the average rate at which the system target decoder 3403 extracts TS packets from each source packet in the read buffer 3402.
  • the coefficient 192/188 is equal to the ratio of the number of bytes between the source packet and the TS packet.
  • the average transfer rate R EXT is usually expressed in bits / second, and specifically, is equal to a value obtained by dividing the extent size expressed in bits by the extent ATC time.
  • ATC Arriv Time Clock
  • the “extent ATC time” is the size of the ATS range given to the source packet in one extent, that is, the ATS time between the first source packet of the extent and the first source packet of the next extent. Represents the difference. The difference is equal to the time required for the playback device 103 to transfer all the source packets in the extent from the read buffer 3402 to the system target decoder 3403 in terms of the value of ATC.
  • the average transfer rate R EXT is generally different for each extent.
  • the maximum value R MAX of the average transfer rate R EXT is equal to 192/188 times the system rate R TS for the AV stream file.
  • the “system rate” defines the maximum value of the TS packet processing speed by the system target decoder 3403. Since the system rate R TS is usually expressed in bits / second (bps), it is equal to eight times the recording rate (TS recording rate) of the main TS expressed in bytes / second (Bps).
  • the extent ATC time may be calculated as follows: First, for one extent, the time interval from the ATS of the first source packet to the ATS of the last source packet is obtained. Next, the transfer time per source packet is added to the time interval. The sum is determined as the extent ATC time of the extent. Since the extent ATC time is not required to refer to the next extent, the extent ATC time can be calculated even if there is no next extent. Even when the next extent exists, the calculation of the extent ATC time can be simplified. However, in the calculation, it must be considered that ATS wraparound occurs.
  • the read rate R UD54 is usually expressed in bits / second and is set to a value higher than the maximum value R MAX of the average transfer rate R EXT , for example 54 Mbps: R UD54 > R MAX .
  • FIG. 35A is a graph showing changes in the data amount DA accumulated in the read buffer 3402 during the reproducing operation.
  • FIG. 35B is a schematic diagram showing the correspondence between the extent group 3510 to be played back and the playback path 3520.
  • the accumulated data amount DA is the difference between the read speed R UD54 and the average transfer speed R EXT [n]. Increases at a rate equal to R UD54 -R EXT [n].
  • a jump J [n] occurs between two consecutive extents EXT [n ⁇ 1] and EXT [n].
  • the jump period PJ [n] reading of data from the BD-ROM disc 101 is stopped. Accordingly, in the jump period PJ [n], the accumulated data amount DA decreases at the average transfer rate R EXT [n].
  • the read / transfer operation by the BD-ROM drive 3401 is actually not continuous as suggested from the graph of FIG. 35 (a), but is intermittent. This prevents the accumulated data amount DA from exceeding the capacity of the read buffer 3402 during the read period PR [n] of each extent, that is, overflow of the read buffer 3402. That is, the graph of FIG. 35 (a) approximately represents a stepwise increase / decrease as a linear increase / decrease.
  • the size S EXT [n] of each extent EXT [n] May be at least a predetermined lower limit. This lower limit is called “minimum extent size”.
  • the extent interval may be equal to or less than a predetermined upper limit.
  • the size S EXT [n] of each extent EXT [n] is the amount of data transferred from the read buffer 3402 to the system target decoder 3403 over the read period PR [n] to the next jump period PJ [n + 1]. be equivalent to.
  • the accumulated data amount DA does not fall below the amount at the end of the jump period PJ [n + 1] and at the start of the read period PR [n]. That is, in each jump period PJ [n], data supply from the read buffer 3402 to the system target decoder 3403 is continued, and in particular, the read buffer 3402 does not cause an underflow.
  • the length of the read period PR [n] is equal to a value S EXT [n] / R UD54 obtained by dividing the size S EXT [n] of the extent EXT [n] by the read speed R UD54 . Therefore, the minimum extent size of each extent EXT [n] is represented by the right side of the following equation (1):
  • the jump time T JUMP [n] is the length of the jump period PJ [n] and is expressed in seconds.
  • the function CEIL () means an operation of rounding up the fractional part of the numerical value in parentheses.
  • the maximum value of the jump time T JUMP [n] is limited. That is, even if the accumulated data amount DA immediately before the jump period PJ [n] is full in the read buffer 3402, if the jump time T JUMP [n] is too long, the accumulated data during the jump period PJ [n] There is a risk that the amount DA reaches zero and the underflow of the read buffer 3402 occurs.
  • the maximum value of the time T JUMP is referred to as “maximum jump time T JUMP_MAX ”.
  • FIG. 36 is an example of a correspondence table between the jump distance S JUMP and the maximum jump time T JUMP_MAX for the BD-ROM disc.
  • the jump distance S JUMP is expressed in units of sectors
  • the maximum jump time T JUMP_MAX is expressed in units of milliseconds.
  • One sector is equal to 2048 bytes.
  • the maximum jump time T JUMP_MAX are 0 ms, 200 ms, 300 ms, 350 ms, 700 ms, and 1400 ms, respectively.
  • the maximum jump time includes overhead associated with error correction processing.
  • “Overhead associated with error correction processing” means extra time resulting from error correction processing performed twice using the ECC block when the boundary of two extents does not coincide with the boundary of the ECC block Say.
  • the entire ECC block is necessary for error correction processing. Therefore, when one ECC block is shared by two consecutive extents, the entire ECC block is read out and used for error correction processing in any extent read processing. As a result, every time one of the extents is read, extra data of up to 32 sectors is read in addition to the extent.
  • the overhead associated with error correction processing is the sum of the reading time of the extra data, that is, 32 [sectors] ⁇ 2048 [bytes / sector] ⁇ 8 [bits / bytes] ⁇ 2 [times] / reading speed [bits / second]. It is evaluated with.
  • the jump time T JUMP [n] to be substituted into the equation (1) is the maximum jump time T JUMP_MAX defined for each jump distance by the BD-ROM disc standard. Specifically, in the table of FIG. 36, the maximum jump time T JUMP_MAX corresponding to the jump distance S JUMP between two consecutive extents EXT [n] and EXT [n + 1] is the jump time T JUMP [n]. Is substituted into equation (1).
  • the jump distance S JUMP is equal to the number of sectors from the rear end of the (n + 1) th extent EXT [n] to the front end of the (n + 2) th extent EXT [n + 1].
  • the jump distance S JUMP of when the jump time T JUMP is equal to the maximum jump time T JUMP - MAX referred to as "maximum jump distance S JUMP - MAX".
  • the extent interval needs to be less than or equal to the maximum jump distance S JUMP_MAX .
  • the time required for the long jump further includes the time required for the recording layer switching operation, that is, the “layer switching time” in addition to the maximum jump time T JUMP_MAX defined in the table of FIG.
  • the layer switching time is, for example, 350 milliseconds.
  • CPRM In the SD-Video standard, CPRM is adopted as an encryption method. CPRM is one of copyright protection technologies for recording media. A unique media ID and MKB (Media Key Block) are recorded on a recording medium compatible with CPRM. The MKB is changed every time a certain number of recording media are produced. When the recording apparatus records content on the recording medium, the device key of the recording apparatus is used for encryption in addition to the media ID and MKB of the recording medium.
  • MKB Media Key Block
  • FIG. 37 (a) is a schematic diagram showing an encryption procedure performed when a CPRM-compatible device records content on an SD memory card.
  • the CPRM compatible device 3710 includes a unique device key 3701
  • the SD memory card 3720 includes a media ID 3702 and an MKB 3703.
  • the recording area of the SD memory card 3720 includes an authentication area 3721 and a normal area 3722.
  • the authentication area 3721 is a recording area that can be accessed only by the CPRM-compatible device 3710.
  • the normal area 3722 is a recording area that can be accessed by devices other than the CPRM-compatible device 3710.
  • the CPRM compatible device 3710 encrypts the content 3706 according to the following procedure.
  • a media unique key 3704 is generated from the device key 3701, the media ID 3702, and the MKB 3703.
  • an authentication process is performed between the CPRM-compatible device 3710 and the SD memory card 3720, and then a content encryption key 3705 is generated.
  • the content 3706 is encrypted using the content encryption key 3705.
  • the encrypted content 3707 is written in the normal area 3722 of the SD memory card 3720.
  • the content encryption key 3705 is encrypted using the media unique key 3704.
  • the encrypted content encryption key 3708 is written in the authentication area 3721 of the SD memory card 3720.
  • FIG. 37 (b) is a schematic diagram showing a decryption procedure performed when a CPRM-compatible device reproduces content from the SD memory card.
  • the CPRM compatible device 3710 includes a unique device key 3701
  • the SD memory card 3720 includes a media ID 3702 and an MKB 3703.
  • the recording area of the SD memory card 3720 includes an authentication area 3721 and a normal area 3722.
  • the CPRM compatible device 3710 decrypts the content 3706 according to the following procedure. (1) First, a media unique key 3704 is generated from the device key 3701, the media ID 3702, and the MKB 3703. (2) Next, the encrypted content encryption key 3708 is read from the authentication area 3721 of the SD memory card 3720.
  • the content encryption key 3705 is decrypted using the media unique key 3704.
  • the encrypted content 3707 is read from the normal area 3722 of the SD memory card 3720.
  • the content 3706 is decrypted using the content encryption key 3705.
  • the content encryption key 3708 cannot be read. Further, even if the device key 3701 of the CPRM compatible device 3710 is known, CPRM has a mechanism called revocation. In the revocation, the MKB 3703 in the SD memory card 3720 is updated. As a result, the media unique key 3704 cannot be generated from the known device key 3701.
  • Both the digital copy AV stream file 622 and the replacement stream files 631 to 633 shown in FIG. 6 are already recorded on the BD-ROM disc 101 in a state of being encrypted with the content encryption key. Therefore, when the playback device 103 performs digital copy, the encryption process shown in FIG. 37A is not performed.
  • FIG. 38 is a schematic diagram showing the data structure of an encrypted MP4 file.
  • ftyp, moov, and moof are not encrypted.
  • media data in mdat is encrypted in units of chunks.
  • the content encryption key is 2048 bytes, when the data amount of one chunk is 2048 bytes or more, the encryption process is reset every 2048 bytes.
  • FIG. 39 is a schematic diagram showing a method for encrypting one chunk.
  • One chunk is encrypted in order from the top in units of several bytes, for example, 8-byte units A0, B0, C0, and D0.
  • the previously encrypted data is used to encrypt the next data. Specifically, first, the leading 8-byte data A0 is converted into encrypted data A1. Next, the next 8-byte data B0 is converted into the next encrypted data B1 using the encrypted data A1. Further, the next 8-byte data C0 is converted into encrypted data C1 using the encrypted data B1. Thereafter, the same operation is repeated. As described above, since encryption is performed in a chain manner, the encrypted data A1, B1, C1, D1,... Must be decrypted in order from the top.
  • FIG. 40 is a block diagram showing the configuration of a system that realizes digital copying.
  • This system includes a playback device 103, a display device 104, an authentication server 4001, and an SD memory card writing means 4002.
  • the authentication server 4001 manages a content encryption key for digital copy content.
  • the authentication server 4001 is connected to the playback device 103 through a network.
  • the authentication server 4001 receives the password or the ID attached to the BD-ROM disc 101 from the playback device 103, and authenticates the user using them. When the user authentication is successful, the authentication server 4001 passes the content encryption key to the playback device 103.
  • the SD memory card writing means 4002 is a CPRM compatible device and is a card reader 111 built in the playback device 103.
  • the SD memory card writing means 4002 may be a card reader externally attached to the playback device 103 or a card reader built in a mobile device connected to the playback device 103 through a network or the like.
  • the SD memory card writing unit 4002 writes the digital copy content and the content encryption key to the SD memory card 102.
  • FIG. 41 is a flowchart of digital copying. This process is started when the BD-ROM disc 101 is inserted into the BD-ROM drive of the playback apparatus 103.
  • step S4101 the playback device 103 detects the BD-ROM disc 101 inserted into the BD-ROM drive.
  • the playback device 103 reads the index file 511 from the BD-ROM disc 101 and activates the object defined in the item table first play of the index table. In the case of digital copy, this object is a BD-J object. Thereafter, the process proceeds to step S4102.
  • step S4102 the playback device 103 causes the display device 104 to display a menu screen according to the BD-J object.
  • a digital copy of the data in the DCOPY directory 502 is displayed as an option.
  • options for the language of the digital copy content such as “English”, “Japanese”, “Chinese”, and “German” are also displayed. Thereafter, processing proceeds to step S4103.
  • step S4103 the playback device 103 specifies the language of the digital copy content selected from the user through the remote controller 105 or the like, and then accepts an instruction to execute digital copy. Thereafter, the process proceeds to step S4104.
  • step S4104 the playback device 103 authenticates the user with the authentication server 4001 according to the BD-J object. Specifically, first, the playback device 103 prompts the user to input a password or the like. When the user inputs a password or the like using the remote controller 105 or the like, the playback device 103 passes the password or the like to the authentication server 4001. The authentication server 4001 verifies the passed password or the like with a password or the like held in advance. If the two match, the authentication server 4001 passes the content encryption key to the playback device 103. Thereafter, the process proceeds to step S4105.
  • step S4105 the playback apparatus 103 determines whether any copy of the replacement stream file 631-633 is necessary according to the language selected in step S4102 according to the BD-J object. For example, when the language of the audio stream included in the digital copy AV stream file 622 is English, if the user selects “English”, the copy of the replacement stream file is unnecessary, and the user selects “English”. If any other is selected, a copy of any one of the replacement stream files 631 to 633 is required. If no copy of any replacement stream file 631-633 is required, the process advances to step S4106. If any one of the replacement stream files 631 to 633 needs to be copied, the process proceeds to step S4107.
  • step S4106 no copy of any replacement stream file 631-633 is required. Therefore, the playback device 103 passes the data in the DATA01 directory 601 to the SD memory card writing means 4002 in accordance with the BD-J object.
  • the SD memory card writing means 4002 writes the data into the normal area of the SD memory card 102. Thereafter, processing proceeds to step S4108.
  • step S4107 a copy of the replacement stream file 631-633 corresponding to the language selected by the user is required. Therefore, the playback device 103 replaces the chunk of the audio stream included in the digital copy AV stream file 622 with the chunk included in the replacement stream file according to the BD-J object (details will be described later).
  • the playback apparatus 103 further passes the digital copy AV stream file 622 in which the chunk of the audio stream is replaced to the SD memory card writing unit 4002 together with other data in the DATA01 directory 601.
  • the SD memory card writing means 4002 writes the data into the normal area of the SD memory card 102. Thereafter, processing proceeds to step S4108.
  • step S4108 the playback device 103 passes the content encryption key acquired from the authentication server 4001 to the SD memory card writing means 4002 in accordance with the BD-J object.
  • the SD memory card writing means 4002 first generates a media unique key, and then encrypts the content encryption key with the media unique key. Thereafter, the SD memory card writing means 4002 writes the encrypted content encryption key into the authentication area of the SD memory card 3720. Thereafter, processing proceeds to step S4109.
  • step S4109 in accordance with the BD-J object, the playback device 103 causes the display device 104 to display that the writing of the digital copy content to the SD memory card 102 has been completed. Thus, digital copying is completed.
  • FIG. 42 is a schematic diagram showing processing for replacing the audio stream chunk included in the digital copy AV stream file with the chunk included in the replacement stream file in step S4107.
  • the digital copy AV stream file 622 is recorded on the BD-ROM disc 101 in the order of moov and mdat. moov indicates header information.
  • the chunk V of the video stream and the chunk A1 of the audio stream are recorded alternately.
  • the chunk A2 included in the replacement stream file 631 is recorded in order on the BD-ROM disc 101.
  • the playback device 103 continuously reads out the header information of the digital copy AV stream file 622 and the first chunk V of the video stream.
  • the playback device 103 reads the first chunk A2 of the replacement stream file 631, as indicated by the arrow (2) in FIG. Subsequently, the playback device 103 skips reading the chunk A1 of the audio stream included in the digital copy AV stream file 622 as indicated by the arrow (3) in FIG. Read chunk V of. Further, the playback device 103 reads the next chunk A2 of the replacement stream file 631, as indicated by the arrow (4) in FIG. Thereafter, the playback device 103 reads only the chunk V of the video stream from the digital copy AV stream file 622.
  • the playback device 103 reads the chunk A2 from the replacement stream file 631. Thereby, the chunk A1 of the audio stream included in the digital copy AV stream file 622 can be replaced with the chunk A2 of the replacement stream file.
  • the number of samples, the size, and the attributes match between the exchanged chunks. Therefore, the chunks can be replaced quickly without changing the header information.
  • the audio stream included in the digital copy AV stream file is replaced with the replacement stream file in units of chunks.
  • the video stream for digital copy only needs to be included in the digital copy AV stream file.
  • the number of audio streams that can be stored in the digital copy content is kept small, and the number of audio streams that can be stored in the content matches the number of audio streams stored in the AV stream file in the BDMV directory. Can do.
  • the playback device 103 causes the SD memory card writing means 4002 to write the digital copy content to the SD memory card 102.
  • the playback apparatus 103 may stream the digital copy content to a mobile device connected to the playback apparatus 103, such as the mobile device 107 shown in FIG.
  • step S4102 shown in FIG. 41 a list of model names or model numbers of mobile devices capable of reproducing digital copy content may be displayed on the menu screen.
  • the user can see the list to know whether or not a specific mobile device can reproduce the digital copy content.
  • the above list is downloaded to the playback device 103 via a network, for example.
  • the playback device 103 allows the user to input the model name of the mobile device, and whether or not the mobile device can playback the digital copy content depending on whether or not the model name is searched from the above list. May be notified to the user.
  • the model name may be registered in the playback device 103 as internal information of the playback device 103.
  • the playback device 103 allows the user to input the phone number or email address of the mobile device, and sends a mail originating from the input phone number or email address to the server of the mobile device sales company through the network. Also good.
  • the ID of the model of the mobile device is described in the body of the email.
  • the server notifies the mobile device whether or not the mobile device can reproduce the digital copy content depending on whether or not the ID is retrieved from the list.
  • the charging for the digital copy may be performed not when the playback apparatus 103 performs the digital copy but when the mobile device plays back the digital copy content using the mobile device charging system.
  • FIG. 43 is a directory diagram showing the storage location of new header information required in that case. Referring to FIG. 43, three files (mv001.strm.a1.h, mv001.strm.a2.h, mv001.strm.a3.h) 4301-4303 in the same directory as the replacement stream file 631-633 Is placed.
  • These files are obtained by converting the header information suitable for the MP4 file in which the chunks of the audio stream included in the digital copy AV stream file 622 are replaced with the chunks of the replacement stream files 631 to 633, that is, moov into a file. is there.
  • step S4107 shown in FIG. 41 not only the chunk of the audio stream included in the digital copy AV stream file 622 is replaced with the chunk of the replacement stream file 631-633, but the header information is also replaced with a new header. Replaced with information 4301-4303.
  • the bit rate and the attribute may be different between the chunk of the audio stream included in the digital copy AV stream file and the chunk of the replacement stream file, the encoding of the replacement stream file is possible. The degree of freedom can be increased.
  • FIG. 44A is a schematic diagram showing an example of a physical arrangement of a digital copy AV stream file and a replacement stream file on the BD-ROM disc 101.
  • the digital copy AV stream file header information 4401 and chunks V and A1 are continuously recorded, and then the replacement stream file chunk A2 is continuously recorded.
  • the logical block numbers (LBN) indicated by the allocation descriptor of the digital copy AV stream file are continuous throughout the file.
  • the LBN indicated by the allocation descriptor of the replacement stream file is also continuous throughout the file.
  • the data is read as follows. First, as indicated by the solid line arrow (1) in FIG. 44A, the header information 4401 of the digital copy AV stream file and the first chunk V of the video stream are read out successively. Thereafter, as shown by the dashed arrow (2) in FIG. 44A, data is read from the leading end of the first chunk A1 of the audio stream to the leading end of the first chunk A2 of the replacement stream file. The position moves. The moving distance at that time corresponds to almost the entire length of the digital copy AV stream file. Next, as indicated by a solid arrow (3) in FIG.
  • the first chunk A2 of the replacement stream file is read. Thereafter, as indicated by a dashed arrow (4) in FIG. 44 (a), the video stream included in the digital copy AV stream file starts from the rear end of the first chunk A2 of the replacement stream file. The data read position moves to the tip of the second chunk V. The moving distance at that time also corresponds to almost the entire length of the digital copy AV stream file. Further, as indicated by a solid arrow (5) in FIG. 44 (a), the second chunk V of the video stream is read out. As described above, in the physical arrangement shown in FIG. 44A, a large movement of the data reading position, that is, a jump is repeated during digital copying. As a result, the time required for reading data is relatively long.
  • FIG. 44 (b) is a schematic diagram showing another example of the physical arrangement of the digital copy AV stream file and the replacement stream file on the BD-ROM disc 101.
  • FIG. Referring to (b) of FIG. 44, first, header information 4402 of the digital copy AV stream file, the first chunk V of the video stream, and the first chunk A1 of the audio stream are continuously recorded. . Next, the first chunk A2 of the replacement stream file is recorded. Thereafter, every time one video stream chunk V and one audio stream chunk A1 included in the digital copy AV stream file are recorded, one replacement stream file chunk is recorded continuously. ing. Thereby, as indicated by arrows 4430, 4431, 4440, 4441 in FIG.
  • the LBN indicated by the allocation descriptor of the digital copy AV stream file and the allocation descriptor of the replacement stream file The LBN shown in FIG.
  • the data is read as follows. First, as indicated by a solid line arrow (1) in FIG. 44B, the header information 4401 of the digital copy AV stream file and the first chunk V of the video stream are read out successively. After that, as indicated by the dashed arrow (2) in FIG. 44B, reading of the first chunk A1 of the audio stream is skipped. At that time, the movement distance of the data read position is only the length of the chunk A1.
  • the first chunk A2 of the replacement stream file is read.
  • the second chunk V of the video stream included in the digital copy AV stream file is read out.
  • reading of the second chunk A1 of the audio stream included in the digital copy AV stream file is skipped.
  • the movement distance of the data read position is only the length of the chunk A1.
  • the second chunk A2 of the replacement stream file is read out.
  • FIG. 45 is a schematic diagram showing still another example of the physical arrangement of the digital copy AV stream file and the replacement stream file on the BD-ROM disc 101.
  • header information 4401 of the digital copy AV stream file and chunk V of the video stream are continuously recorded, and then chunk A1 of the audio stream is continuously recorded.
  • chunk A2 of the replacement stream file is continuously recorded.
  • the LBN indicated by the allocation descriptor of the digital copy AV stream file is continuous throughout the file.
  • the LBN indicated by the allocation descriptor of the replacement stream file is continuous throughout the file.
  • the data is read as follows. First, as indicated by the solid line arrow (1) in FIG. 45, the header information 4501 of the digital copy AV stream file and all the chunks V of the video stream are successively read out. After that, as shown by the dashed arrow (2) in FIG. 45, reading of all chunks A1 of the audio stream is skipped. Next, as shown by the solid line arrow (3) in FIG. 45, all the chunks A2 of the replacement stream file are read continuously.
  • the physical arrangement shown in FIG. 45 requires only one jump for digital copying. As a result, in the physical arrangement shown in FIG. 45, the time required for data reading can be shortened compared to that shown in FIG.
  • FIG. 46 is a directory diagram showing three digital copy AV stream files that share header information and video stream chunks.
  • the copy AV stream file (mv001.strm) 4631 shares header information and video stream chunks.
  • the first digital copy AV stream file 4601 includes a chunk of the first audio stream.
  • the second digital copy AV stream file 4602 shares a chunk of the second audio stream with the first replacement stream file 4641 included in the DATA01_Audio directory 4604 by file cross-linking.
  • the third digital copy AV stream file 4603 shares a chunk of the third audio stream with the second replacement stream file 4642 included in the DATA01_Audio directory 4604 by file cross-linking.
  • FIG. 47 is a schematic diagram showing the relationship between the physical arrangement of data on the BD-ROM disc 101 and the LBN range indicated by the three types of file allocation descriptors.
  • the LBN range indicated by the allocation descriptor of the first digital copy AV stream file 4611 includes header information 4701, a chunk V of the video stream, and a chunk A1 of the first audio stream.
  • the range of LBN indicated by the allocation descriptor of the first interchange stream file 4641 includes the chunk A2 of the second audio stream.
  • the range of the LBN indicated by the allocation descriptor of the second digital copy AV stream file 4621 includes header information 4701, a chunk V of the video stream, and a chunk A2 of the second audio stream. Therefore, the playback device 103 automatically passes the data to the SD memory card writing means 4002 according to the allocation descriptor of the second digital copy AV stream file 4621, and is automatically included in the first digital copy AV stream file 4611.
  • the chunk A1 of the audio stream can be replaced with the chunk A2 of the first replacement stream file. In this case, since the replacement stream file is not necessary for digital copying, the file entry may be deleted from the file system.
  • FIG. 48A is a schematic diagram showing an example of the relationship between the physical arrangement of data on the BD-ROM disc 101 and the LBN ranges indicated by the allocation descriptors of the three types of digital copy AV stream files.
  • FIG. 48 (a) on the BD-ROM disc 101, following the header information 4801, the video stream chunk V, the first audio stream chunk A1, and the second audio stream chunk. A2 and chunk A3 of the third audio stream are recorded alternately.
  • the LBN range indicated by the allocation descriptor of the first digital copy AV stream file 4611 includes header information 4801, video stream chunk V, and first audio stream chunk A1.
  • the LBN range indicated by the allocation descriptor of the second digital copy AV stream file 4621 includes header information 4801, video stream chunk V, and second audio stream chunk A2.
  • the LBN range indicated by the allocation descriptor of the third digital copy AV stream file 4631 includes header information 4801, video stream chunk V, and third audio stream chunk A3.
  • a continuous range of LBNs indicated by one allocation descriptor indicates one extent.
  • the first digital copy AV stream file 4611 includes four extents between the header information and the fourth chunk of the audio stream.
  • the file 4621 includes 8 extents
  • the third digital copy AV stream file 4631 includes 5 extents. When a file is read, a jump occurs between extents.
  • the number of jumps required to read the same data amount differs among the three digital copy AV stream files 4611 to 4631.
  • the time required for reading differs between these files.
  • the first digital copy AV stream file 4611 and the third digital copy AV stream file 4631 are read faster than the second digital copy AV stream file 4621. Therefore, the priority of the first digital copy AV stream file 4611 and the third digital copy AV stream file 4631 may be set higher than the priority of the second digital copy AV stream file 4621. For example, an audio stream in the language in which the BD-ROM disc 101 is sold is stored in a high-priority digital copy AV stream file.
  • FIG. 48 (b) shows another example of the relationship between the physical arrangement of data on the BD-ROM disc 101 and the LBN range indicated by the allocation descriptors of the three types of digital copy AV stream files. It is a schematic diagram shown. 48B, on the BD-ROM disc 101, following the header information 4801, the video stream chunk V, the first audio stream chunk A1, and the second audio stream chunk. A2 and chunk A3 of the third audio stream are recorded alternately. However, unlike the arrangement shown in FIG. 48A, the order of the chunks A1, A2, and A3 of the three types of audio streams is cyclically changed.
  • the range of LBN indicated by the allocation descriptor of each digital copy AV stream file 4611-4463 is the same as that shown in FIG.
  • the first digital copy AV stream file 4611 includes five extents
  • the second digital copy AV stream file 4621 includes six extents
  • the third The digital copy AV stream file 4631 includes six extents. Therefore, between the three digital copy AV stream files 4611 to 4631, the number of jumps required to read the same data amount is almost equal. As a result, the time required for reading is substantially uniform between these files.
  • FIG. 49 is a schematic diagram showing the relationship between the physical arrangement of data on the BD-ROM disc 101 and the LBN range indicated by the allocation descriptors of the four types of digital copy AV stream files. Referring to FIG. 49, on the BD-ROM disc 101, following two types of header information 4901 and 4902, a video stream chunk V, a first audio stream chunk A1, and a second audio stream are recorded. Chunk A2 and chunk A3 of the third audio stream are recorded alternately.
  • the range of LBN indicated by the allocation descriptor of the first digital copy AV stream file 4611 includes second header information 4902, a chunk V of the video stream, and a chunk A1 of the first audio stream.
  • the LBN range indicated by the allocation descriptor of the second digital copy AV stream file 4621 includes second header information 4902, a chunk V of the video stream, and a chunk A2 of the second audio stream.
  • the range of LBN indicated by the allocation descriptor of the third digital copy AV stream file 4631 includes the second header information 4902, the chunk V of the video stream, and the chunk A3 of the third audio stream. Since these three digital copy AV stream files include only one audio stream, they share the same header information 4902.
  • the range of the LBN indicated by the allocation descriptor of the fourth digital copy AV stream file 4911 includes header information 4901 at the beginning, video stream chunk V, and all audio stream chunks A1-A3.
  • the first header information 4901 is header information representing a state in which three audio streams are stored in one digital copy AV stream file. As shown in FIG. 49, in the fourth digital copy AV stream file 4911, all chunks are included in one extent. Each audio stream is extracted from the extent using the header information 4911 at the head.
  • the data of the lower version file can be used as the data of the upper version file by using the file cross-link.
  • FIG. 50A is a schematic diagram illustrating an example of the relationship between the physical arrangement of data on the BD-ROM disc 101 and the LBN range indicated by the allocation descriptor of two types of digital copy AV stream files.
  • the range of LBN indicated by the allocation descriptor of the first digital copy AV stream file 5011 includes header information 5001, chunk V1 of the first video stream, chunk V of the third video stream, and chunk A of the audio stream.
  • the range of LBN indicated by the allocation descriptor of the second digital copy AV stream file 5012 includes header information 5001, chunk V2 of the second video stream, chunk V of the third video stream, and chunk A of the audio stream.
  • the first video stream represents a scene in which subtitles are embedded.
  • the second video stream represents a scene obtained by removing subtitles from the scene represented by the first video stream.
  • the third video stream represents a scene that does not require subtitles. Accordingly, a scene with subtitles is reproduced from the first digital copy AV stream file 5011, and a scene without subtitles is reproduced from the second digital copy AV stream file 5012.
  • FIG. 50 (b) shows another example of the relationship between the physical arrangement of data on the BD-ROM disc 101 and the LBN range indicated by the allocation descriptor of two types of digital copy AV stream files. It is a schematic diagram shown. Referring to (b) of FIG.
  • the range of LBN indicated by the allocation descriptor of the third digital copy AV stream file 5013 is the first header information 5021, the chunk V1 of the first video stream, the chunk V of the third video stream, and the chunk of the audio stream.
  • the range of LBN indicated by the allocation descriptor of the fourth digital copy AV stream file 5014 includes the second header information 5022, the chunk V2 of the second video stream, the chunk V of the third video stream, and the chunk of the audio stream.
  • the first video stream represents a scene included only in the normal version.
  • the second video stream represents a scene included only in the director's cut version.
  • the third video stream represents a scene common to both the normal version and the director's cut version.
  • the number of chunks is different between the first video stream and the second video stream. Accordingly, different header information 5021 and 5022 are required for the two digital copy AV stream files 5013 and 5014.
  • the parental level may be the same as that for the AV stream file 541 stored in the BDMV directory 501. Further, in order to release the parental lock and update the parental level, a release code is required, but the release code may be the same as that preset in the playback device 103. . Further, the release code may be transferred to the authentication area of the SD memory card 102 during digital copying.
  • FIG. 51 is a schematic diagram showing a file group constituting the digital copy content 5110 recorded on the BD-ROM disc 101 and a digital copy AV stream file 5120 generated from the file group.
  • the video stream and the audio stream may be configured as separate files.
  • digital copy content 5110 includes two types of video streams 5111 and 5112 and two types of audio streams 5121 and 5122. Each stream is encrypted in one chunk for each of the data portions V1, V2, A1, A2 whose reproduction time is 1 second, for example.
  • the digital copy content 5110 further includes chunk / sample information 5131, 5132, 5141, 5142. One piece of chunk / sample information is associated with each of the video stream and the audio stream.
  • the chunk / sample information corresponding to each stream includes the number and size of chunk samples constituting the stream, attribute information and size of each sample, and identification information of a sample that can be randomly accessed.
  • the playback device 103 can configure stco, stsc, stts, stsz, stss, and stsd using chunk / sample information.
  • the chunk / sample information may be configured as one file. In addition, it may be configured as an MP4 file together with the corresponding stream. In that case, chunk / sample information is incorporated as header information in moov or moof.
  • the playback device 103 generates a digital copy AV stream file 5120 from the digital copy content 5110 shown in FIG. 51 according to the BD-J object as follows.
  • the playback device 103 first causes the user to select an elementary stream to be incorporated into the digital copy AV stream file 5120. In the example of FIG. 51, the second video stream 5112 and the first audio stream 5121 are selected.
  • the playback device 103 reads the selected stream and writes it to the SD memory card 102 while converting it into MP4 format media data.
  • the playback device 103 refers to the chunk / sample information 5132 and 5141 to interpret the configuration of the chunks and samples of each stream.
  • the playback device 103 further generates header information from the interpreted configuration and writes it to the SD memory card 102.
  • header information may be prepared in advance for the number of combinations of elementary streams in the digital copy content 5110. Further, when a new combination of elementary streams is permitted after the BD-ROM disc 101 is released, the header information of the MP4 file after the combination may be downloaded from the network to the playback device 103. Using the header information, the playback device 103 can generate an MP4 file including a new combination of elementary streams and write it to the SD memory card 102. Further, an elementary stream constituting the digital copy content 5110 may be downloaded from the network to the playback device 103.
  • FIG. 52A is a schematic diagram showing an example of the data structure of a digital copy AV stream file in TS format, that is, a TOD file 5201.
  • each packet sequence includes 32 ETS packets.
  • These ETS packets include an ETS packet (hereinafter referred to as a video packet) V storing a video stream, an ETS packet (hereinafter referred to as an audio packet) A1 storing a first audio stream, and an RDI ( Real-time (Data Information) packet RDI is included.
  • the RDI packet is an ETS packet placed at the beginning of a packet sequence, and includes information such as copyright information relating to an elementary stream included in the same packet sequence.
  • the packet sequence may include PAT, PMT, SIT, and PCR.
  • one packet sequence includes only one type of elementary stream.
  • the first packet sequence # 1 and the third packet sequence # 3 include an RDI packet and a video packet V, and do not include an audio packet A1.
  • the second packet sequence # 2 does not include the video packet V but includes the RDI packet and the audio packet A1.
  • different elementary streams are not mixed in one packet sequence.
  • FIG. 52 (b) is a schematic diagram showing an example of the data structure of the TS format replacement stream file 5202.
  • the first audio stream and the second audio stream are both encoded by CBR, the sizes of both streams are equal. Therefore, the audio packet A1 included in the packet sequence # 2 of the TOD file 5201 and the audio packet A2 included in the replacement stream file 5202 differ only in the PES payload, and the TS header and the like are common.
  • the replacement stream file 5202 is further associated with management information 5203.
  • the management information 5203 includes information (Packet_Seq_id) for identifying the packet sequence of the TOD file 5201 to be replaced with the replacement stream file 5202. Therefore, the playback device 103 can correctly replace the packet sequence # 2 of the TOD file 5201 with the replacement stream file 5202 by referring to the management information 5203. As shown in FIG. 44, the replacement may be performed by referring to the allocation descriptors of the TOD file 5201 and the replacement stream file 5202 and appropriately changing the reading position. Also, as shown in FIG. 47, the file may be generated by exchanging audio packets of the TOD file 5201 using a file cross-link.
  • FIG. 53A is a schematic diagram showing another example of the data structure of the TOD file 5301.
  • FIG. 53A unlike the example shown in FIG. 52A, one packet sequence may include two types of elementary streams.
  • the second packet sequence # 2 includes an RDI packet, 21 video packets V, and 10 audio packets A1.
  • the audio packet A1 is continuously recorded at the rear end of the second packet sequence # 2.
  • FIG. 53 (b) is a schematic diagram showing another example of the data structure of the TS format replacement stream file 5302.
  • the replacement stream file 5302 is composed of the same number of ETS packets A2 as the number of audio packets A1 included in the packet sequence # 2 of the TOD file 5301.
  • Each ETS packet A2 stores a second audio stream.
  • the first audio stream and the second audio stream are both encoded by CBR, the sizes of both streams are equal. Therefore, the audio packet A1 included in the packet sequence # 2 of the TOD file 5301 and the audio packet A2 included in the replacement stream file 5302 differ only in the PES payload, and the TS header and the like are common.
  • the replacement stream file 5302 is further associated with management information 5303.
  • the management information 5303 includes information (Packet_Seq_id) for identifying the packet sequence of the TOD file 5301 including the audio packet to be replaced with the replacement stream file 5202.
  • the management information 5303 further includes information (PacketOffset) indicating the position of the beginning of the audio packet to be replaced with the replacement stream file 5202 from the beginning of the packet sequence. Therefore, the playback device 103 can correctly replace the audio packet A1 included in the packet sequence # 2 of the TOD file 5301 with the audio packet A2 of the replacement stream file 5302 by referring to the management information 5303. .
  • the audio packet A1 is collected at the rear end portion of the packet sequence # 2, the replacement of the audio packet does not break the chain structure of the encryption by CPRM shown in FIG. In this way, since two or more types of elementary streams can be mixed in the packet sequence of the TOD file 5301, the restriction on multiplexing for the TOD file is eased.
  • BD-ROM discs There are two types of BD-ROM discs: a “non-digital copy compatible disc” that does not support the digital copy function and a “digital copy compatible disc” that supports the digital copy function. Therefore, the BD-J object must prevent the playback device from displaying the digital copy function menu when playing back a non-digital copy compatible disc, and display the digital copy function menu when playing back a digital copy compatible disc. . For this purpose, it is necessary to give the BD-J object a function for determining whether or not the BD-ROM disc is a digital copy compatible disc.
  • FIG. 54 is a flowchart of processing for determining whether or not the BD-ROM disc is a digital copy compatible disc. This process is started by inserting a BD-ROM disc into the playback device.
  • step S5401 the playback device detects a BD-ROM disc inserted in the BD-ROM drive. As a result, the playback apparatus reads the index file 511 from the BD-ROM disc, and activates the BD-J object defined in the index table item first play. Thereafter, processing proceeds to step S5402.
  • step S5402 the playback device analyzes the directory structure of the BD-ROM disc in accordance with the BD-J object, and determines whether there is a DCOPY directory next to the BDMV directory. If there is a DCOPY directory, the BD-ROM disc is a digital copy compatible disc. In that case, processing proceeds to step S5403. If there is no DCOPY directory, the BD-ROM disc is a non-digital copy compatible disc. In that case, the process ends.
  • step S5403 since the BD-ROM disc is a digital copy compatible disc, the playback apparatus sets a value indicating that in a reserved area of a specific GPRM or SPRM. Thereafter, the process ends.
  • the playback device refers to the above GPRM when performing menu display according to the BD-J object.
  • the playback device adds a digital copy function option to the menu display.
  • the format of subtitle data and menu data is determined.
  • the mobile device can display subtitles and menus by decoding the data in that format.
  • the support for the format is an option, there may be a mobile device that does not support the format. Those mobile devices cannot reproduce subtitles from the subtitle data written in the SD memory card.
  • the language of subtitles that can be displayed on the mobile device is limited to the language of subtitle data that is written in advance on the SD memory card. Therefore, it is difficult to add a new language later. In order to solve these problems, it is only necessary that the mobile device downloads subtitle data and menu data in a compatible format from the network.
  • FIG. 55 is a block diagram of a system target decoder mounted on a mobile device that can download subtitle data and the like from a network.
  • a system target decoder 5510 includes a read buffer 5501, a demultiplexer 5502, an audio decoder 5503, a video decoder 5504, a URL (Uniform Resource Locator) data acquisition unit 5505, and a graphics decoder 5506.
  • the read buffer 5501 stores the digital copy AV stream file read from the SD memory card SDC.
  • the demultiplexer 5502 separates the video stream, the audio stream, and the header information from the digital copy AV stream file stored in the read buffer 5501.
  • the audio decoder 5503 receives the audio stream from the demultiplexer 5502, decodes the audio data from the stream, and sends it to the speaker.
  • the video decoder 5504 receives the video stream from the demultiplexer 5502, decodes the video data from the stream, and writes it into the video plane memory 5507.
  • the video plane memory 5507 stores one video plane, that is, one frame or one field of video data.
  • the URL data acquisition unit 5505 receives header information from the demultiplexer 5502 and reads URL data from the header information.
  • the URL data indicates the location of a server on the network NET that stores caption data and menu data.
  • the URL data acquisition unit 5505 accesses the server indicated by the URL data, and searches for caption data or menu data in a format compatible with the system target decoder 5510.
  • the searched subtitle data or menu data is transferred from the server to the graphics decoder 5506.
  • the subtitle data is attached with time information on the time axis such as a video stream included in the digital copy AV stream file. The same applies to menu data.
  • the graphics decoder 5506 decodes the subtitle data and menu data transferred from the server and writes them into the subtitle menu plane memory 5508.
  • the subtitle menu plane memory 5508 stores subtitles or menu video data to be superimposed on one video plane.
  • the plane adder 5509 superimposes the video data stored in the subtitle menu plane memory 5508 on the video plane stored in the video plane memory 5507, synthesizes one plane, and sends it to the display. Thus, a video with captions or a menu screen is displayed on the display.
  • the system target decoder 5510 shown in FIG. 55 acquires subtitle data and menu data from a server on the network NET, not the SD memory card SDC. Therefore, the mobile device can always obtain subtitle data or the like in a compatible format. In addition, after digital copy, subtitle data and the like included in the digital copy AV stream file can be updated. Further, by storing subtitle data or the like having different resolutions in the server, the mobile device can acquire subtitle data or the like that matches the resolution of the mobile device.
  • the URL data may be stored in a management information file different from the digital copy AV stream file, in addition to being stored in the digital copy AV stream file.
  • FIG. 56 is a block diagram of a system target decoder installed in a mobile device capable of generating speech from text data.
  • the system target decoder 5610 includes a read buffer 5601, a demultiplexer 5602, an audio decoder 5603, a video decoder 5604, a URL data acquisition unit 5605, a video plane memory 5606, and a speech decoder 5607. , An audio database 5608, and a mixer 5609.
  • the read buffer 5601 stores the digital copy AV stream file read from the SD memory card SDC.
  • the demultiplexer 5602 separates the video stream, the audio stream, and the header information from the digital copy AV stream file stored in the read buffer 5601.
  • the audio decoder 5603 receives the audio stream from the demultiplexer 5602, decodes audio data from the stream, and sends the audio data to the mixer 5609.
  • the audio stream does not include dialogue speech but only background sound.
  • the video decoder 5604 receives the video stream from the demultiplexer 5602, decodes the video data from the stream, and writes it into the video plane memory 5606.
  • the video plane memory 5606 stores one video plane, that is, video data of one frame or one field. The video plane is sent to the display and displayed on the screen.
  • the URL data acquisition unit 5605 receives header information from the demultiplexer 5602, and reads URL data from the header information.
  • the URL data indicates the location of the server on the network NET that stores the dialogue data.
  • the URL data acquisition unit 5605 accesses the server indicated by the URL data, and transfers the dialogue data from the server to the dialogue decoder 5607.
  • FIG. 57 is a table showing the structure of dialogue data.
  • the dialogue data includes a start time 5701, an end time 5702, a text 5703, and a person name 5704.
  • the start time 5701 represents the time at which speech is started, and the end time 5702 represents the time at which speech is ended.
  • Text 5703 is text data indicating the content of the dialogue.
  • the person name 5704 is the name of the person who speaks the dialogue.
  • the voice database 5608 stores voice data of each person indicated by the person name 5704 of the dialogue data.
  • the speech decoder 5607 synthesizes speech data (PCM speech) of the speech indicated by the speech data text 5703 from the speech of the person indicated by the person name 5704 using the speech database 5608.
  • the synthesized audio data is sent to the mixer 5609 in accordance with the time indicated by the dialogue data start time 5701.
  • the mixer 5609 mixes the audio data received from the speech decoder 5607 with the background sound data received from the audio decoder 5603, and transmits the mixed audio data to the speaker.
  • the system target decoder 5610 shown in FIG. 56 can generate speech in various languages from speech data acquired from a server on the network NET. Accordingly, the SD memory card SDC only needs to store an audio stream representing only the background sound, so that the data amount is reduced.
  • the dialogue data may further include information on dialogue inflection (volume change pattern and accent), speed, volume, emotion expressed by dialogue (feeling of emotion).
  • the dialogue decoder 5607 uses the information to give an appropriate effect to the synthesized speech. Thereby, a more realistic expression is possible.
  • the text data represented by the text 5703 may be divided in phrase units so that the dialogue decoder 5607 can set inflections in phrase units. Thereby, a more subtle effect can be given to the synthesized voice.
  • the URL data may be stored in a management information file different from the digital copy AV stream file, in addition to being stored in the digital copy AV stream file.
  • a playback device for a BD-ROM disc may include the configuration shown in FIG.
  • the mobile device may generate subtitle bitmap data from the dialogue data text 5703 by a graphics decoder and superimpose it on the video plane. For this purpose, data such as font, font size, and subtitle coordinates may be added to the header information.
  • FIG. 58A is a schematic diagram showing an example of a physical arrangement of an AV stream file and a digital copy AV stream file on a BD-ROM disc.
  • an AV stream file 5801 is continuously recorded, and then a digital copy AV stream file 5802 is continuously recorded.
  • the reason is as follows. As indicated by solid arrows in FIG. 58A, the AV stream file 5801 and the digital copy AV stream file 5802 are alternately read.
  • FIG. 58 is a schematic diagram showing an elementary stream multiplexed in the AV stream file.
  • AV stream file 5810 a video stream 5811, an audio stream 5812, and a digital copy stream 5813 are multiplexed.
  • the digital copy stream 5813 is data in the same format as the digital copy AV stream file.
  • a unique PID is assigned to the digital copy stream 5813 as in the case of other elementary streams.
  • FIG. 58C is a block diagram showing a playback processing system of the playback device.
  • the BD-ROM drive 5820 reads the AV stream file 5810 shown in FIG.
  • the demultiplexer 5822 checks the PID of each elementary stream multiplexed in the AV stream file 5810. If the PID is assigned to an elementary stream to be decoded, such as a video stream, the demultiplexer 5822 passes the stream to an appropriate decoder (Dec) 5823. On the other hand, if the PID is assigned to the digital copy stream 5813, the demultiplexer 5822 passes the stream 5813 to the SD memory card. In this way, the process of reproducing video and the like from the AV stream file 5810 and the process of writing the digital copy stream 5813 to the SD memory card can be performed in parallel.
  • Dec decoder
  • FIG. 59A is a schematic diagram showing the physical arrangement of the extent of the AV stream file and the extent of the digital copy AV stream file on the BD-ROM disc.
  • the extent DC of the digital copy AV stream file and the extent MN of the AV stream file are recorded alternately on the BD-ROM disc.
  • the extent ranges referred to by the allocation descriptors of the AV stream file 5901, the digital copy AV stream file 5902, and the read file 5903 are further indicated by arrows.
  • the read file 5903 shares extents with the AV stream file 5901 and the digital copy AV stream file 5902 using file cross links.
  • the allocation descriptor of the read file 5903 refers to all extents DC and MN of the AV stream file 5901 and the digital copy AV stream file 5902 as one extent.
  • the playback device reads the read file 5903 from the BD-ROM disc, thereby sequentially reading the extent MN of the AV stream file 5901 and the extent DC of the digital copy AV stream file 5902 in order. it can.
  • FIG. 59B is a block diagram showing a playback processing system of the playback apparatus.
  • the BD-ROM drive 5910 continuously reads the extent MN of the AV stream file 5901 and the extent DC of the digital copy AV stream file 5902 from the BD-ROM disc with reference to the allocation descriptor of the read file 5903.
  • the switch 5911 uses the extent boundary information to write the extent MN of the AV stream file 5901 to the first read buffer (RB1) 5912, and the extent DC of the digital copy AV stream file 5902 to the second read buffer (RB2). Write to 5913.
  • the extent boundary information is information indicating the position of the boundary between the extent MN of the AV stream file 5901 and the extent DC of the digital copy AV stream file 5902.
  • the extent boundary information is recorded on the BD-ROM disc as one file.
  • the demultiplexer 5914 separates each elementary stream from the extent MN of the AV stream file stored in the RB 15912 and passes it to the decoder (Dec) 5915.
  • the decoder 5915 decodes each elementary stream.
  • the playback apparatus writes the extent DC of the digital copy AV stream file stored in RB25913 to the SD memory card 5916. In this way, the process of reproducing video or the like from the AV stream file and the process of writing the digital copy AV stream file to the SD memory card can be performed in parallel.
  • FIG. 60B shows an arrangement 6010 of the extent DC of the digital copy AV stream file and the extent MN of the AV stream file on the BD-ROM disc, and the non-digital copy compatible machine reads the extent from the arrangement.
  • FIG. 20 is a schematic diagram showing a reproduction path 6020 at the time. Referring to (b) of FIG. 60, the non-digital copy compatible machine skips reading the extent DC of the digital copy AV stream file and reads only the extent MN of the AV stream file.
  • 60A shows the amount of data stored in the read buffer when the non-digital copy compatible machine reads the extent MN of the AV stream file from the extent arrangement 6010 shown in FIG. 60B. It is a graph which shows increase / decrease in DA. Referring to FIG.
  • the amount of data read from the BD-ROM disc to the read buffer is changed from the read buffer to the system buffer. Since it is larger than the amount of data sent to the target decoder, the data amount DA of the read buffer increases.
  • TJ in which the reading of the extent DC of the digital copy AV stream file is skipped, only the transmission of data from the read buffer to the system target decoder is continued. The data amount DA of the read buffer decreases.
  • the data amount DA of the read buffer should not fall below 0 during the jump period TJ, that is, the read buffer will not underflow. It is necessary to make it.
  • the extent MN of the AV stream file must have a sufficiently large size.
  • FIG. 61 shows the arrangement 6110 of the extent DC of the digital copy AV stream file and the extent MN of the AV stream file on the BD-ROM disc, and when the digital copy compatible device reads the extent from the arrangement.
  • FIG. 6 is a schematic diagram showing a reproduction path 6120. Referring to (c) of FIG. 61, the digital copy compatible device sequentially reads the digital copy AV stream file extent DC and the AV stream file extent MN in order. The digital copy compatible device stores the extent DC of the digital copy AV stream file and the extent MN of the AV stream file in different read buffers.
  • 61A and 61B show AV streams accumulated in a read buffer when a digital copy compatible machine reads extents DC and MN from the extent arrangement 6110 shown in FIG. 61C.
  • the amount of data in the extent MN of the AV stream file read into the buffer is larger than the amount of data sent from the read buffer to the system target decoder, the amount of data DA1 stored in the read buffer increases.
  • the extent DC of the digital copy AV stream file is only written from the read buffer to the SD memory card, the data amount DA2 stored in the read buffer decreases.
  • TR2 in which the extent DC of the digital copy AV stream file is read to the read buffer (hereinafter referred to as a second read period) TR2
  • the extent MN of the AV stream file is sent from the read buffer to the system target decoder.
  • the data amount DA1 of the read buffer decreases.
  • the amount of data in the extent DC of the digital copy AV stream file read from the BD-ROM disc to the read buffer is larger than the amount of data written from the read buffer to the SD memory card, it is stored in the read buffer.
  • the amount of data DA2 increases.
  • the data amount DA2 of the extent DC of the digital copy AV stream file stored in the read buffer in the second read period TR2 exceeds a predetermined upper limit, that is, if the read buffer overflows.
  • the reading speed of the extent AV of the copy AV stream file must be suppressed.
  • the data amount DA2 of the extent DC of the digital copy AV stream file stored in the read buffer is first read so that the read buffer does not overflow during the second read period TR2. It must fall to zero during period TR1.
  • the digital copy AV stream When the extent is read from the BD-ROM disc to the read buffer at a speed R UD and the extent DC of the digital copy AV stream file is written from the read buffer to the SD memory card at a speed W UD , the digital copy AV stream
  • the size S EXTD of the file extent DC and the size S EXT1 of the extent MN of the AV stream file need only satisfy the following formula: S EXTD / W UD ⁇ (S EXTD + S EXT1 ) / R UD .
  • the digital copy compatible machine performs jump JP to the next recording area at the break GP of the recording area of the extent.
  • the time for performing the jump JP depends on the length of the extent DC in addition to the length of the break GP. Therefore, to prevent underflow of the read buffer during jump JP, the data amount DA1 depending on the length of the extent DC in addition to the length of the break GP is accumulated in the read buffer. I have to do something. As a result, the capacity required for the read buffer increases. Therefore, the extent DC of the digital copy AV stream file is not arranged immediately before and after the break GP.
  • the time to perform the jump JP depends only on the length of the break GP, so it must be accumulated in the read buffer to prevent underflow of the read buffer during the jump JP.
  • Data volume DA1 can be reduced. As a result, the capacity required for the read buffer can be suppressed.
  • the AV stream file stored in the BDMV directory may represent 3D video.
  • the AV stream file includes two types, one representing a left-eye video (hereinafter referred to as a first AV stream file) and one representing a right-eye video (hereinafter referred to as a second AV stream file). It is a kind.
  • FIG. 62A is a schematic diagram showing a physical arrangement of the extent B of the first AV stream file and the extent D of the second AV stream file arranged on the BD-ROM disc. Referring to (a) of FIG. 62, extents B and D of both files are alternately arranged.
  • the digital copy stream is multiplexed in the second AV stream file in the same manner as that shown in FIG.
  • the extent ranges to be referenced by the allocation descriptors of the first AV stream file 6201, the second AV stream file 6202, and the read file 6203 are indicated by arrows.
  • the read file 6203 shares extents with the first AV stream file 6201 and the second AV stream file 6202 using file cross links.
  • the allocation descriptor of the read file 6203 refers to all of the extent B of the first AV stream file 6201 and the extent D of the second AV stream file 6202 as one extent.
  • FIG. 62B is a block diagram showing a playback processing system of the playback device.
  • the BD-ROM drive 6210 continuously reads the extent B of the first AV stream file 6201 and the extent D of the second AV stream file 6202 from the BD-ROM disc with reference to the allocation descriptor of the reading file 6203.
  • the switch 6211 uses the extent boundary information to write the extent B of the first AV stream file 6201 to the first read buffer (RB1) 6212 and the extent D of the second AV stream file 6202 to the second read buffer (RB2). Write to 6213.
  • the extent boundary information indicates the position of the boundary between the extent B of the first AV stream file 6201 and the extent D of the second AV stream file 6202.
  • the extent boundary information is recorded on the BD-ROM disc as one file.
  • the first demultiplexer 6214 separates each elementary stream from the extent B of the first AV stream file stored in the RB 16122 and passes it to the first decoder (Dec 1) 6215.
  • the first decoder 6215 decodes each elementary stream, particularly a video stream representing a video for the left eye.
  • the second demultiplexer 6216 checks the PID of each elementary stream multiplexed in the extent D of the second AV stream file stored in the RB 26213. If the PID is assigned to an elementary stream to be decoded, such as a video stream representing the video for the right eye, the second demultiplexer 6216 passes the stream to the second decoder (Dec 2) 6217. On the other hand, if the PID is assigned to the digital copy stream, the second demultiplexer 6216 passes the stream to the SD memory card 6218. In this way, the process of reproducing 3D video from the first AV stream file and the second AV stream file and the process of writing the digital copy stream to the SD memory card can be performed in parallel.
  • the playback device may switch the data supply source as follows. While the BD-ROM disc is inserted into the BD-ROM drive, the playback device writes digital copy content from the disc to the SD memory card. When the BD-ROM disc is removed from the BD-ROM drive during the writing process, the playback device downloads the digital copy content from the server on the network to the SD memory card. By doing so, the BD-ROM disc can be removed from the BD-ROM drive in the middle of the digital copy, so that video can be reproduced from another BD-ROM disc in parallel with the digital copy.
  • the playback device 103 can be connected to a mobile device 107 through a network 106. Therefore, digital copy may be performed to the SD memory card 108 inserted into the mobile device 107 through the network 106.
  • FIG. 63 (a) is a flowchart of processing performed by the playback apparatus in digital copying through a network.
  • FIG. 63B is a flowchart of processing by the mobile device in the digital copy. These processes are started when a BD-ROM disc is inserted into the playback apparatus.
  • step S6301 the playback device 103 detects the BD-ROM disc 101 inserted in the BD-ROM drive.
  • the playback device 103 reads the index file 511 from the BD-ROM disc 101 and activates the BD-J object defined in the index table item first play. Thereafter, processing proceeds to step S6302.
  • step S6302 the playback device 103 causes the display device 104 to display a menu screen according to the BD-J object.
  • the menu screen in addition to playback of the AV stream file 541 in the BDMV directory 501, a digital copy of the data in the DCOPY directory 502 is displayed as an option. Thereafter, processing proceeds to step S6303.
  • step S6303 the playback device 103 receives an instruction to execute digital copy from the user through the remote controller 105 or the like. At this time, the language may be selected similarly to the flowchart shown in FIG. Thereafter, processing proceeds to step S6304.
  • step S6304 the playback device 103 searches the network 106 for the mobile device 107 according to the BD-J object. Further, the playback device 103 notifies the mobile device 107 of the execution of digital copy. The notification may be made by e-mail. Thereafter, the process proceeds to step S6307.
  • step S6305 the mobile device 107 receives the notification sent from the playback device 103 in step S6304, and notifies the user of the notification through a screen display.
  • the process proceeds to step S6306.
  • step S6306 the mobile device 107 authenticates the authentication server and the user according to the HTTP protocol. Specifically, first, the mobile device 107 prompts the user to input a password or the like. When the user inputs a password or the like to the mobile device 107, the mobile device 107 passes the password or the like to the authentication server. The authentication server verifies the passed password or the like with a password or the like held in advance. If the two match, the authentication server passes the content encryption key to the mobile device 107. Thereafter, processing proceeds to step S6308.
  • a password to be input to the mobile device 107 is stored in the playback device 103. May be displayed on the display device 104.
  • authentication processing may be performed between the playback device 103 and the mobile device 107 using a proximity wireless technology such as “TransferJet (registered trademark)” or “WirelessHD”.
  • step S6307 the playback device 103 sends digital copy content to the mobile device 107 via the network 106.
  • a protocol such as HTTP or FTP is used.
  • the playback device 103 may replace the audio stream included in the digital copy AV stream file with the audio stream included in any replacement stream file. Thereafter, processing proceeds to step S6309.
  • step S6308 the mobile device 107 receives the digital copy content from the playback device 103 and writes it in the normal area of the SD memory card 108. Thereafter, the process proceeds to step S6310.
  • step S6309 the playback device 103 causes the display device 104 to display that the writing of the digital copy content to the SD memory card 108 is completed according to the BD-J object. Thereafter, the processing by the playback device 103 ends. While the mobile device 107 writes the digital copy content to the SD memory card 108, the playback device 103 displays a progress bar on the display device 104 in accordance with the BD-J object. May be communicated.
  • step S6310 the mobile device 107 generates a media unique key and encrypts the content encryption key with the media unique key. Thereafter, the mobile device 107 writes the encrypted content encryption key in the authentication area of the SD memory card 108. Thus, the process by the mobile device 107 is completed.
  • (S) Mobile devices are easier to connect to a wide area network such as a mobile phone network than playback devices. Therefore, the playback device realizes a virtual package function by using the mobile device as a local storage.
  • the virtual package function will be described, and then the application of the virtual package function in the system according to the embodiment of the present invention will be described.
  • “Virtual package” means a directory structure of a virtual BD-ROM disc built on a memory built in a playback device. Specifically, the virtual package is transferred from each access path of the original data stored in the BD-ROM disk and the update data stored in the local storage to the access path on the same BD-ROM disk. Specifies the mapping of.
  • “Local storage” refers to a storage device such as an HDD built in or externally attached to a playback device. The update data is downloaded from the WWW server to the local storage through the network. In an application program such as a BD-J object, access to original data and update data can be described by a path on a virtual package instead of an actual path.
  • the original data and the update data can be accessed as data on the same BD-ROM disc.
  • the video represented by the update data can be superimposed on the video represented by the original data.
  • the subtitles represented by the original data can be displayed by replacing the subtitles represented by the update data.
  • FIG. 64 is a schematic diagram showing the directory structure of the update kit 6410 stored in the local storage 6401.
  • An “update kit” refers to a group of update data arranged in a directory structure.
  • an additional content storage directory (BD_BUDA) 6412 is placed immediately below the ROOT directory 6411 of the local storage 6401, and an OrgID directory 6413 is placed immediately below.
  • a DiscID directory 6414 is placed immediately below the OrgID directory 6413.
  • DiscID directory 6414 Immediately under the DiscID directory 6414, a merge management information file (merge.xml) 6415, a signature information file (merge.sf) 6416, and an additional content data file (ccc.mpl, vvv.m2t, vvv.clp) 6417 , 6418, 6419 are placed.
  • merge management information file (merge.xml) 6415
  • signature information file (merge.sf) 6416
  • additional content data file ccc.mpl, vvv.m2t, vvv.clp) 6417 , 6418, 6419 are placed.
  • the directory name of the OrgID directory 6413 is made up of 8 characters representing a 32-bit identifier (OrgID: organization ID) assigned to the original data provider in hexadecimal.
  • the OrgID is stored in the index file 511. When “0” is arranged at the head of the OrgID, those “0” are omitted from the directory name. For example, when the OrgID is 0x0000001A, the directory name of the OrgID directory is “1A”.
  • the directory name of the DiscID directory 6414 is made up of 32 characters in which a 128-bit identifier (DiscID) assigned to the recording layer of the BD-ROM disc is divided into four 32 bits from the beginning and each part is expressed in hexadecimal.
  • the Disc ID is stored in the index file 511. When “0” is arranged at the head of the DiscID, those “0” are omitted from the directory name.
  • the merge management information file 6415 indicates the correspondence between the path in the local storage and the path in the virtual package for each file included in the update kit 6410.
  • the signature information file 6416 includes an electronic signature of the original data provider.
  • the electronic signature is obtained by encrypting the hash value of the merge management information file 6415 with a predetermined secret key.
  • the private key is paired with the public key included in the merge certificate. That is, the electronic signature can be decrypted using the public key.
  • the merge certificate is not shown in FIGS. 5 and 6, but is stored on the BD-ROM disc with the file name “bd.cert”.
  • the file format of the merge certificate is, for example, X. 509 is used.
  • the additional content data file 6417-6419 is a file group that represents video or the like that should be added to or replaced with video or audio represented by the original data.
  • the additional content data file generally includes a playlist file (ccc.mpl) 6417, an AV stream file (vvv.m2t) 6418, and a clip information file (vvv.clp) 6419.
  • FIG. 65 is a block diagram of a playback device equipped with a virtual package function.
  • the components shown in FIG. 65 are different from the components shown in FIG. 28 in that a playback control unit 6535, read buffers 6521 and 6522, a local storage control unit 6501, and a system target decoder 6523 are included. Different. Since the other components are the same as those shown in FIG. 28, the description of those components shown in FIG.
  • the playback control unit 6535 constructs a virtual package based on the update kit stored in the local storage 6401. That is, the playback control unit 6535 replaces the virtual package path specified by the application program with the actual path on the BD-ROM disc 101 or in the local storage 6401.
  • the playback control unit 6535 further instructs the BD-ROM drive 2801 or the local storage control unit 6501 to read data according to the read path.
  • the first read buffer (RB1) 6521 corresponds to the read buffer 2821 shown in FIG. 28, and stores the AV stream file read from the BD-ROM disc 101 by the BD-ROM drive 2801.
  • the second read buffer (RB2) 6522 stores the AV stream file read from the local storage 6401 by the local storage control unit 6501.
  • the local storage control unit 6501 accesses the update kit stored in the local storage 6401 according to the instruction from the playback control unit 6535 to transfer data from the local storage 6401, dynamic scenario memory 2831, static scenario Transfer to memory 2832 or RB 26522
  • the system target decoder 6523 reads the AV stream file from each of the RB 16521 and the RB 26522, and decodes it in parallel.
  • FIG. 66 (a) is a schematic diagram showing a process of constructing a virtual package 6630 from original data 6610 stored in a BD-ROM disc and an update kit 6620 stored in the local storage.
  • the OrgID directory “1” is placed immediately under the BD_BUDA directory, and the DiscID directory “1” is placed immediately below it.
  • a merge management information file (merge.xml) 6621, a signature information file (merge.sf) 6622, a playlist file (ccc.mpl) 6623, a first AV stream file (vvv. m2t) 6624, a first clip information file (vvv.clp) 6625, and a second clip information file (sss.clp) 6626 are placed.
  • the playback control unit 6640 When constructing a virtual package, the playback control unit 6640 first reads the merge management information file 6621 and the signature information file 6622 from the update kit 6620, and reads the merge certificate from the original data 6610. The playback control unit 6640 decrypts the signature information file 6622 with the public key included in the merge certificate, and collates the decryption result with the merge management information file 6621. Thereby, the merge management information file 6621 is authenticated.
  • the playback control unit 6640 After successfully authenticating the merge management information file 6621, the playback control unit 6640 refers to the merge management information file 6621 and associates the actual path and the path in the virtual package for each file of the update kit 6620. As a result, the application program can request the reproduction control unit 6640 to access each file through the virtual package path.
  • FIG. 66B shows a path in the local storage (local storage path) and a path on the virtual package (virtual package path) for each file of the update kit 6620 stored in the merge management information file 6621. It is a table
  • the playback control unit 6640 uses the playlist file “ccc.mpls” 6631 of the virtual package 6630. "6623 is accessed.
  • the application program requests the playback control unit 6640 to access the clip information files “vvv.clpi” 6632 and “sss.clpi” 6633 of the virtual package 6630
  • the playback control unit 6640 uses the clip of the update kit 6620.
  • the information files “vvv.clp” 6625 and “sss.clp” 6626 are accessed.
  • the playback control unit 6640 uses the first AV stream file “vvv” of the update kit 6620. .m2t ”6624 is accessed.
  • the application program requests the playback control unit 6640 to access the second AV stream file “sss.m2ts” 6635 of the virtual package 6630, the corresponding AV stream file does not exist in the update kit 6620.
  • the second AV stream file “sss.m2ts” 6635 has a progressive attribute.
  • “Progressive attribute” means that the file does not have to exist in the local storage when the virtual package is constructed, and may be downloaded from the network when access is requested. Therefore, when the application program requests the playback control unit 6640 to access the second AV stream file “sss.m2ts” 6635 of the virtual package 6630, the playback control unit 6640 sends the second AV stream file from the network to the local storage. Download “sss.m2ts” 6635. After the download is completed, the playback control unit 6640 accesses the second AV stream file “sss.m2ts” 6635.
  • 67 (a), (b), and (c) are schematic diagrams showing pseudo streaming playback processing of an AV stream file using a virtual package.
  • the playlist file 6701 includes five play items PL # 1, PL # 2,..., PL # 5.
  • Each play item refers to a different AV stream file “00001.m2ts”, “00002.m2ts”, “00003.m2ts”, “00004.m2ts”, “00005.m2ts”. All of these AV stream files are included in the update kit and have a progressive attribute.
  • the first AV stream file “00001.m2ts” and the second AV stream file “00002.m2ts” whose playback order is early have already been downloaded to the local storage, and the BD-J application Set to Enable according to the program.
  • the remaining AV stream files “00003.m2ts”, “00004.m2ts”, and “00005.m2ts” have not yet been downloaded to the local storage, or have been downloaded but are invalid ( Disable) state.
  • the reproduction processing is executed in order from the AV stream file in the valid state.
  • the “valid state” means a state where the playback process can be performed by the playback device
  • the “invalid state” means a state where the playback process cannot be performed. Switching between the valid state and the invalid state is performed according to the API.
  • the API When an API for setting an AV stream file to a valid state is executed, the AV stream file has a read-only attribute and can be played back by a playback device. An AV stream file that has never been set in a valid state is in an invalid state.
  • the AV stream file When deleting or overwriting a valid AV stream file, the AV stream file must be temporarily changed to an invalid state by the API.
  • the playback position indicated by the tip of the arrow 6702 reaches the rear end of the third play item PL # 3.
  • the fourth AV stream file “00004.m2ts” referred to by the fourth play item PL # 4 has not yet been downloaded or is in an invalid state.
  • the playback control unit stops playback of the playlist and notifies the application program of a playback stop event 6703.
  • the application program completes the download of the fourth AV stream file and changes its state to a valid state. Thereafter, the playback of the AV stream file is resumed from the playback position when the playback stop event 6703 is notified.
  • the mobile device and the playback device build a virtual package as follows. First, the mobile device downloads the update kit from the network to the built-in storage device. Next, the mobile device and the playback device are connected by proximity wireless technology or wireless LAN. Application programs exchange information with mobile devices via socket-to-socket communication. The playback device treats the mobile device as local storage. Thereby, the playback apparatus can construct a virtual package using the update kit held in the mobile device. Note that the virtual package may be constructed by the mobile device writing the update kit to the SD memory card and the playback device handling the SD memory card as a local storage.
  • the playback device uses the virtual package function to May be displayed superimposed on the video reproduced from the BD-ROM disc.
  • FIG. 68 (a) is a schematic diagram showing a playback system before a videophone call is received.
  • the playback device 103 plays back the video BG of the primary video stream from the BD-ROM disc 101 and displays it on the display device 104.
  • the mobile device 107 downloads the secondary video stream representing the transparent video TR from the server 6801.
  • the secondary video stream is assigned a progressive attribute.
  • the reproduction device 103 reproduces the transparent video TR from the secondary video stream by the pseudo streaming reproduction processing, and displays it on the display device 104 so as to be superimposed on the video BG of the primary video stream.
  • the mobile device 107 itself may generate the secondary video stream.
  • FIG. 68 (b) is a schematic diagram showing a playback system when a videophone call is received.
  • the mobile device 107 encodes the videophone video PH to generate a secondary video stream, and replaces it with the secondary video stream downloaded from the server 6801. Accordingly, the playback device 103 plays back the video PH of the videophone from the secondary video stream by pseudo streaming playback processing, and displays it on the display device 104 so as to be superimposed on the video BG of the primary video stream.
  • a playback device uses a mobile device as local storage to create a virtual package and a call is received on the mobile device, the playback device uses the virtual package function to The sound reproduced from the BD-ROM disc may be mixed and reproduced.
  • FIG. 69A is a schematic diagram showing a playback system before a call is received.
  • the playback device 103 plays back the audio MA of the primary audio stream from the BD-ROM disc 101 and reproduces it on the speaker of the display device 104.
  • the mobile device 107 downloads the secondary audio stream representing the non-voice SA from the server 6801.
  • the secondary audio stream is assigned a progressive attribute.
  • the reproduction device 103 reproduces the non-voice SA from the secondary audio stream by pseudo streaming reproduction processing, and mixes it with the audio MA of the primary audio stream to reproduce it on the speaker of the display device 104.
  • FIG. 69 (b) is a schematic diagram showing a playback system when a call is received.
  • the mobile device 107 encodes the telephone voice PA to generate a secondary audio stream, and replaces the secondary audio stream downloaded from the server 6801.
  • the playback device 103 reproduces the telephone audio PA from the secondary audio stream by pseudo streaming playback processing, and mixes it with the audio MA of the primary audio stream and reproduces it on the speaker of the display device 104.
  • the playback device 103 may cause the display device 104 to display a message indicating that a call has been received in graphics according to the application program.
  • the playback device 103 performs a pause according to the application program and displays a message indicating that the user has answered the call received on the mobile device 107. It may be displayed on the device 104. Note that this processing may be automatically performed by the playback device 103 without depending on the application program.
  • the playback device 103 may monitor the remaining battery level of the mobile device and the free space of the storage device, and display information about them on the display device 104 in graphics.
  • the playback device may be connected to the mobile device through a server on the network.
  • FIG. 70 is a schematic diagram showing a mobile device and a playback device connected through a server on the network.
  • the mobile device 7001 generates an AV stream file representing video PH or audio of a videophone and uploads it to the server 7002.
  • the server 7002 incorporates the AV stream file into the update kit.
  • the playback device 7003 includes a local storage and is connected to the server 7002 through a network.
  • the playback device 7003 downloads an update kit from the server 7002 to the local storage, and constructs a virtual package using the update kit. Thereby, the playback device 7003 causes the display device 7005 to reproduce the video or audio of the videophone on the video BG or audio played back from the BD-ROM disc 7004.
  • the playback device When the playback device is connected to a plurality of mobile devices, the playback device receives information on the communication speed and the remaining battery level (including whether it is connected to an outlet) from each mobile device, Based on this, the mobile device to be used may be selected. For example, when a high bit rate content is downloaded from a network and played back, the playback device selects a mobile device with a high communication speed. Also, when content with a long playback time is downloaded from the network and played back, the playback device selects a mobile device with a long battery life. Note that a benchmark for performing a communication test may be used for measuring the communication speed. The playback device may further obtain a Mac address from each mobile device and associate it with each mobile device.
  • the playback device can identify the mobile device from the Mac address, so that the information of each mobile device can be displayed on the display device as graphics.
  • the playback device can display on the display device that it is connected to another mobile device.
  • the playback device may be connected to all of the plurality of mobile devices at the same time. For example, the playback device may be connected to only one mobile device in a normal state, and may be connected to two or more mobile devices when a larger communication band is required.
  • the recording device is a so-called authoring device.
  • the authoring device is usually installed in a production studio for distributing movie content and used by authoring staff.
  • the recording apparatus first converts the movie content into a digital stream of a compression encoding method in accordance with the MPEG standard, that is, an AV stream file.
  • the recording device then generates a scenario.
  • the scenario is information that defines a method for reproducing each title included in the movie content, and specifically includes the dynamic scenario information and the static scenario information.
  • the recording device then generates a volume image or update kit for the BD-ROM disc from the above digital stream and scenario.
  • the recording apparatus records the volume image on the recording medium using the extent arrangement according to the first embodiment.
  • FIG. 71 is a block diagram showing the internal configuration of the recording apparatus.
  • the recording apparatus includes a video encoder 7101, a material production unit 7102, a scenario generation unit 7103, a BD program production unit 7104, a multiplexing processing unit 7105, a format processing unit 7106, and a database unit 7107.
  • the database unit 7107 is a non-volatile storage device built in the recording device, and is particularly an HDD.
  • the database unit 7107 may be an HDD externally attached to the recording device, or may be a non-volatile semiconductor memory device built in or externally attached to the recording device.
  • the video encoder 7101 receives video data such as uncompressed bitmap data from the authoring staff and compresses it with a compression encoding method such as MPEG-4 AVC or MPEG-2. As a result, the main video data is converted into a primary video stream, and the sub-video data is converted into a secondary video stream. The video encoder 7101 further generates a video stream of digital copy content from the same video data. Each video stream 7111 is stored in the database unit 7107.
  • the material production unit 7102 creates an elementary stream other than a video stream, for example, an audio stream 7112, a PG stream 7113, and an IG stream 7114, and stores them in the database unit 7107.
  • the material production unit 7102 receives uncompressed LPCM audio data from the authoring staff, encodes it with a compression encoding method such as AC-3, and converts it into an audio stream 7112.
  • the material production unit 7102 generates an audio stream of digital copy content in addition to the main audio stream.
  • the material production unit 7102 receives a caption information file from the authoring staff, and creates a PG stream 7113 accordingly.
  • the caption information file defines image data representing captions, display timing of the captions, and visual effects such as fade-in / fade-out to be added to the captions.
  • the material production unit 7102 further receives bitmap data and a menu file from the authoring staff, and creates an IG stream 7114 according to them.
  • Bitmap data represents a menu image.
  • the menu file defines the state transition of each button arranged in the menu and the visual effect to be applied to each button.
  • the scenario generation unit 7103 creates BD-ROM scenario data 7115 in accordance with an instruction received from the authoring staff via the GUI, and stores it in the database unit 7107.
  • the BD-ROM scenario data 7115 defines a playback method of each elementary stream 7111-7114 stored in the database unit 7107.
  • the BD-ROM scenario data 7115 includes an index file 511, a movie object file 512, a playlist file 521, and a data information file 611 among the files shown in FIGS.
  • the scenario generation unit 7103 further creates a parameter file PRF and sends it to the multiplexing processing unit 7105.
  • the parameter file PRF defines stream data to be multiplexed into the AV stream file and the digital copy AV stream file from the elementary streams 7111 to 7114 stored in the database unit 7107.
  • the BD program creation unit 7104 provides the authoring staff with a programming environment for BD-J objects and Java application programs.
  • the BD program creation unit 7104 receives a request from the user through the GUI, and creates a source code of each program according to the request.
  • the BD program creation unit 7104 further creates a BD-J object file 551 from the BD-J object, and compresses the Java application program into a JAR file 561.
  • the program file group BDP is sent to the format processing unit 7106.
  • the multiplexing processing unit 7105 converts each elementary stream 7111-7114 stored in the database unit 7107 into an MPEG-2TS format AV stream file, or an MP4 format or MPEG-2TS format digital Multiplexed into a copy AV stream file.
  • each elementary stream 7111-7114 is converted into a source packet sequence, and the source packets in each column are combined into one column to form an AV stream file.
  • VAUs and audio frames are grouped into chunks, and video stream chunks and audio stream chunks are alternately arranged, so that a digital copy AV stream file is obtained. Is configured.
  • the multiplexing processing unit 7105 creates the clip information file 531 according to the following procedure.
  • the entry map 1430 shown in FIG. 15 is generated for the AV stream file.
  • the stream attribute information shown in FIG. 14 is extracted from each elementary stream to be multiplexed into the AV stream file.
  • a combination of an entry map and stream attribute information is associated with clip information.
  • the multiplexing processing unit 7105 creates the management information file 621 shown in FIG. Specifically, attribute information is extracted from a video stream and an audio stream to be multiplexed into a digital copy AV stream file, and arranged into a file format.
  • the format processing unit 7106 includes a BD-ROM scenario data 7115 stored in the database unit 7107, a program file group BDP such as a BD-J object file produced by the BD program production unit 7104, and a multiplexing processing unit. From the AV stream file AVF, digital copy AV stream file DCF, clip information file CLI, and management information file MIF generated by 7105, the BD-ROM disc image 7120 having the directory structure shown in FIGS. create. In the directory structure, UDF is used as a file system.
  • the format processing unit 7106 refers to the entry map included in the clip information file when creating each file entry of the AV stream file and the digital copy AV stream file. Thereby, the SPN of each entry point is used to create each allocation descriptor. In particular, the allocation descriptor is created so that the extent arrangement as shown in FIG. 44B or FIG. 45 is represented.
  • FIG. 72 is a flowchart of a method for recording movie content on a BD-ROM disc using the recording device 7100 shown in FIG. This method is started, for example, when the recording apparatus 7100 is turned on.
  • step S7201 elementary streams, programs, and scenario data to be recorded on the BD-ROM disc are created. That is, the video encoder 7102 creates a video stream 7111.
  • the material production unit 7103 creates an audio stream 7112, a PG stream 7113, and an IG stream 7114.
  • the scenario generation unit 7104 creates BD-ROM scenario data 7115.
  • the generated data 7111-7115 are stored in the database unit 7101.
  • the scenario generation unit 7104 creates a parameter file PRF and sends it to the multiplexing processing unit 7106.
  • the BD program creation unit 7105 creates a program file group BDP including a BD-J object file and a JAR file and sends the program file group BDP to the format processing unit 7107. Thereafter, processing proceeds to step S7202.
  • step S7202 the multiplexing processing unit 7106 reads each elementary stream 7111-7114 from the database unit 7101 according to the parameter file PRF, and multiplexes it into an AV stream file and a digital copy AV stream file. Thereafter, processing proceeds to step S7203.
  • step S7203 the multiplexing processing unit 7106 creates a clip information file and a management information file.
  • the extent size of each file is designed so that read buffer overflow and underflow do not occur. Thereafter, processing proceeds to step S7204.
  • step S7204 the format processing unit 7107 performs processing from the BD-ROM scenario data 7115, the program file group BDP, the AV stream file AVF, the digital copy AV stream file DCF, the clip information file CLI, and the management information file MIF.
  • a BD-ROM disk image 7120 is created. Thereafter, processing proceeds to step S7205.
  • step S7205 the BD-ROM disc image 7120 is converted into BD-ROM press data. Further, this data is recorded on the master of the BD-ROM disc. Thereafter, processing proceeds to step S7206.
  • step S7206 mass production of a BD-ROM disc is performed using the master obtained in step S7205 for the pressing process. Thus, the process ends.
  • the present invention relates to a technology for copying data between recording media, and as described above, an audio stream is replaced with another audio stream during digital copying.
  • the present invention is clearly industrially applicable.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)

Abstract

Selon la présente invention, un premier contenu, et un deuxième contenu et un troisième contenu, qui sont utilisés pour copier numériquement le premier contenu, sont enregistrés sur un support d'enregistrement. Le deuxième contenu comprend un flux vidéo et un premier flux audio, et le troisième contenu comprend un second flux audio. Le premier flux audio et le second flux audio ont le même nombre de trames audio dans chaque unité de chiffrement. Quand le deuxième contenu est copié sur un support d'enregistrement externe pour lequel le nombre de flux audio qui peuvent être multiplexés en un seul flux vidéo est limité, le second flux audio peut être remplacé par le premier flux audio dans chaque unité de chiffrement.
PCT/JP2011/005595 2010-10-08 2011-10-04 Support d'enregistrement et procédé de copie de données WO2012046437A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US39117410P 2010-10-08 2010-10-08
US61/391,174 2010-10-08

Publications (1)

Publication Number Publication Date
WO2012046437A1 true WO2012046437A1 (fr) 2012-04-12

Family

ID=45927443

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/005595 WO2012046437A1 (fr) 2010-10-08 2011-10-04 Support d'enregistrement et procédé de copie de données

Country Status (1)

Country Link
WO (1) WO2012046437A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015182491A1 (fr) * 2014-05-30 2015-12-03 ソニー株式会社 Dispositif de traitement d'informations et procédé de traitement d'informations
WO2015182492A1 (fr) * 2014-05-30 2015-12-03 ソニー株式会社 Processeur d'informations et procédé de traitement d'informations
WO2016002738A1 (fr) * 2014-06-30 2016-01-07 ソニー株式会社 Processeur d'informations et procédé de traitement d'informations

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11205750A (ja) * 1998-01-14 1999-07-30 Matsushita Electric Ind Co Ltd 映像音声多重化装置、及び映像と音声の多重化方法、並びに映像と音声を多重化するプログラムを記録した記録媒体
JP2002237170A (ja) * 2001-02-05 2002-08-23 Samsung Electronics Co Ltd マルチストリームが記録された情報貯蔵媒体、その記録装置、その記録方法、その再生装置、及びその再生方法
JP2004007533A (ja) * 2002-03-29 2004-01-08 Toshiba Corp マルチメディア・ファイル・フォーマットのデータ構造、その暗号化方法並びに装置及びその暗号の復号化方法及び装置
JP2004096282A (ja) * 2002-08-30 2004-03-25 Toshiba Corp 映像信号記録装置、映像信号再生装置、記録媒体
JP2007059011A (ja) * 2005-08-26 2007-03-08 Hitachi Ltd データ記録方法、記録媒体、再生装置及び記録再生装置
JP2008027472A (ja) * 2006-07-18 2008-02-07 Hitachi Ltd 記録再生装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11205750A (ja) * 1998-01-14 1999-07-30 Matsushita Electric Ind Co Ltd 映像音声多重化装置、及び映像と音声の多重化方法、並びに映像と音声を多重化するプログラムを記録した記録媒体
JP2002237170A (ja) * 2001-02-05 2002-08-23 Samsung Electronics Co Ltd マルチストリームが記録された情報貯蔵媒体、その記録装置、その記録方法、その再生装置、及びその再生方法
JP2004007533A (ja) * 2002-03-29 2004-01-08 Toshiba Corp マルチメディア・ファイル・フォーマットのデータ構造、その暗号化方法並びに装置及びその暗号の復号化方法及び装置
JP2004096282A (ja) * 2002-08-30 2004-03-25 Toshiba Corp 映像信号記録装置、映像信号再生装置、記録媒体
JP2007059011A (ja) * 2005-08-26 2007-03-08 Hitachi Ltd データ記録方法、記録媒体、再生装置及び記録再生装置
JP2008027472A (ja) * 2006-07-18 2008-02-07 Hitachi Ltd 記録再生装置

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015182491A1 (fr) * 2014-05-30 2015-12-03 ソニー株式会社 Dispositif de traitement d'informations et procédé de traitement d'informations
WO2015182492A1 (fr) * 2014-05-30 2015-12-03 ソニー株式会社 Processeur d'informations et procédé de traitement d'informations
CN106463148A (zh) * 2014-05-30 2017-02-22 索尼公司 信息处理装置和信息处理方法
JPWO2015182492A1 (ja) * 2014-05-30 2017-04-20 ソニー株式会社 情報処理装置および情報処理方法
US10375439B2 (en) 2014-05-30 2019-08-06 Sony Corporation Information processing apparatus and information processing method
CN106463148B (zh) * 2014-05-30 2019-10-01 索尼公司 信息处理装置和信息处理方法
WO2016002738A1 (fr) * 2014-06-30 2016-01-07 ソニー株式会社 Processeur d'informations et procédé de traitement d'informations

Similar Documents

Publication Publication Date Title
JP5914888B2 (ja) 高画質化に関わる記録媒体、再生装置、記録装置、符号化方法、復号化方法
JP4564102B2 (ja) 記録媒体、再生装置、及び集積回路
JP4847631B2 (ja) 記録媒体、再生装置、及び集積回路
US8165458B2 (en) Playback device, playback method, playback program, and integrated circuit
JP4642939B2 (ja) 記録媒体、再生装置、及び集積回路
US8045844B2 (en) Recording medium, playback apparatus, and integrated circuit
US8849088B2 (en) Playback device, recording device, playback method, and recording method
WO2010038409A1 (fr) Dispositif de reproduction, support d'enregistrement et circuit intégré
JP5908894B2 (ja) 記録媒体、再生装置、及び記録装置
KR20110063615A (ko) 3ｄ 영상이 기록된 기록매체, 3ｄ 영상을 재생하는 재생장치 및 시스템 ｌｓｉ
JP2020098661A (ja) 再生装置、及び、再生方法
JP2018152154A (ja) 再生装置
JP2010273351A (ja) 記録媒体、再生装置、及び集積回路
WO2012046437A1 (fr) Support d'enregistrement et procédé de copie de données

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11830371

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11830371

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP