WO2010098134A1 - 記録媒体、再生装置、及び集積回路 - Google Patents
記録媒体、再生装置、及び集積回路 Download PDFInfo
- Publication number
- WO2010098134A1 WO2010098134A1 PCT/JP2010/001339 JP2010001339W WO2010098134A1 WO 2010098134 A1 WO2010098134 A1 WO 2010098134A1 JP 2010001339 W JP2010001339 W JP 2010001339W WO 2010098134 A1 WO2010098134 A1 WO 2010098134A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- picture
- stream
- view
- video
- main view
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
- G11B20/0021—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
- G11B20/00217—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier the cryptographic key used for encryption and/or decryption of contents recorded on or reproduced from the record carrier being read from a specific source
- G11B20/00253—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier the cryptographic key used for encryption and/or decryption of contents recorded on or reproduced from the record carrier being read from a specific source wherein the key is stored on the record carrier
- G11B20/00362—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier the cryptographic key used for encryption and/or decryption of contents recorded on or reproduced from the record carrier being read from a specific source wherein the key is stored on the record carrier the key being obtained from a media key block [MKB]
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
- G11B20/0021—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
- G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
- G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
- G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
- G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
- G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
- G11B27/327—Table of contents
- G11B27/329—Table of contents on a disc [VTOC]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/178—Metadata, e.g. disparity information
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/172—Processing image signals image signals comprising non-image signal components, e.g. headers or format information
- H04N13/183—On-screen display [OSD] information, e.g. subtitles or menus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/189—Recording image signals; Reproducing recorded image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/187—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scalable video layer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/597—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/84—Television signal recording using optical recording
- H04N5/85—Television signal recording using optical recording on discs or drums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
- H04N9/8211—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being a sound signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
- H04N9/8233—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being a character code signal
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
- G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
- G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
- G11B2020/10675—Data buffering arrangements, e.g. recording or playback buffers aspects of buffer control
- G11B2020/10685—Data buffering arrangements, e.g. recording or playback buffers aspects of buffer control input interface, i.e. the way data enter the buffer, e.g. by informing the sender that the buffer is busy
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
- G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
- G11B2020/10675—Data buffering arrangements, e.g. recording or playback buffers aspects of buffer control
- G11B2020/10703—Data buffering arrangements, e.g. recording or playback buffers aspects of buffer control processing rate of the buffer, e.g. by accelerating the data output
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
- G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
- G11B2020/10675—Data buffering arrangements, e.g. recording or playback buffers aspects of buffer control
- G11B2020/1074—Data buffering arrangements, e.g. recording or playback buffers aspects of buffer control involving a specific threshold value
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
- G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
- G11B2020/10805—Data buffering arrangements, e.g. recording or playback buffers involving specific measures to prevent a buffer overflow
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/10527—Audio or video recording; Data buffering arrangements
- G11B2020/1062—Data buffering arrangements, e.g. recording or playback buffers
- G11B2020/10814—Data buffering arrangements, e.g. recording or playback buffers involving specific measures to prevent a buffer underrun
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B2020/10916—Seeking data on the record carrier for preparing an access to a specific address
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/20—Disc-shaped record carriers
- G11B2220/21—Disc-shaped record carriers characterised in that the disc is of read-only, rewritable, or recordable type
- G11B2220/213—Read-only discs
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/20—Disc-shaped record carriers
- G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
- G11B2220/2537—Optical discs
- G11B2220/2541—Blu-ray discs; Blue laser DVR discs
Definitions
- the present invention relates to a technique for reproducing stereoscopic video, that is, three-dimensional (3D) video, and more particularly to video stream decoding processing.
- 2D playback device means a conventional playback device capable of playing only a planar view video, that is, a two-dimensional (2D) video
- 3D playback device means playback capable of playing 3D video. Means device. In this specification, it is assumed that the 3D playback device can also play back conventional 2D video.
- FIG. 100 is a schematic diagram showing a technique for ensuring compatibility with a 2D playback device for an optical disc on which 3D video content is recorded (see, for example, Patent Document 1).
- Two types of video streams are stored on the optical disc 9201.
- One is a 2D / left-view video stream and the other is a right-view video stream.
- the “2D / left-view video stream” represents a 2D video to be viewed by the viewer's left eye when reproducing 3D video, that is, “left view”, and represents the 2D video itself when reproducing 2D video.
- the “right-view video stream” represents a 2D video that is shown to the viewer's right eye during playback of the 3D video, that is, “right view”.
- the frame rate is the same between the left and right video streams, but the frame display timing is shifted by half the frame period. For example, when the frame rate of each video stream is 24 frames per second, the frames of the 2D / left-view video stream and the right-view video stream are alternately displayed every 1/48 seconds.
- Each video stream is divided into a plurality of extents 9202A-C and 9203A-C on the optical disk 9201 as shown in FIG.
- Each extent includes one or more GOPs (Group of Pictures) and is read in a batch by the optical disk drive.
- GOPs Group of Pictures
- the 2D / left-view extent 9202A-C and the right-view extent 9203A-C are alternately arranged on the track 9201A of the optical disc 9201.
- the playback time is equal between two adjacent extents 9202A-9203A, 9202B-9203B, and 9202C-9203C.
- Such arrangement of extents is referred to as “interleaved arrangement”. Extents recorded in an interleaved arrangement are used for both 3D video playback and 2D video playback as described below.
- the optical disc drive 9204A reads out only the 2D / left-view extent 9202A-C from the top of the extents on the optical disc 9201, while skipping the reading of the right-view extent 9203A-C. Further, the video decoder 9204B sequentially decodes the extents read by the optical disc drive 9204A into video frames 9206L. Thereby, since only the left view is displayed on the display device 9207, the viewer can see a normal 2D video.
- the optical disk drive 9205A reads the 2D / left-view extent and the right-view extent alternately from the optical disk 9201, that is, in order of 9202A, 9203A, 9202B, 9203B, 9202C, and 9203C. Further, from each read extent, the 2D / left-view video stream is sent to the left video decoder 9205L, and the right-view video stream is sent to the right video decoder 9205R. Each video decoder 9205L, 9205R alternately decodes each video stream into video frames 9206L, 9206R. Accordingly, the left view and the right view are alternately displayed on the display device 9208.
- the shutter glasses 9209 make the left and right lenses opaque alternately in synchronization with the screen switching by the display device 9208. Accordingly, a viewer wearing the shutter glasses 9209 sees the video displayed on the display device 9208 as a 3D video.
- the interleaved arrangement of extents is used as described above. Accordingly, the recording medium can be used for both 2D video playback and 3D video playback.
- the 3D playback device 9205 is required to have a processing speed at least twice that of the 2D playback device 9204.
- the decoding process of stream data is a heavy burden on the playback apparatus, the reduction is extremely effective for further improving the reliability of the playback apparatus.
- An object of the present invention is to provide a recording medium in which stream data representing 3D video is stored in a data structure that can further reduce the burden of the playback apparatus on the decoding process, and reliability is improved by performing the decoding process more efficiently. Is to provide a reproducing apparatus capable of further improving
- the main-view stream and the sub-view stream are recorded on the recording medium according to the embodiment of the present invention, and the main-view stream is used for reproducing a planar view video.
- the sub-view stream is combined with the main view stream and used for reproducing stereoscopic video.
- the main view stream includes a plurality of main view pictures
- the sub view stream includes a plurality of sub view pictures.
- the main view picture and the subview picture correspond one-to-one.
- the corresponding main view picture is either an I picture or a P picture, and the B picture is not used as a reference picture for compression.
- the main view stream further includes at least one main view picture header
- the sub view stream further includes at least one sub view picture header.
- the main view picture header includes information indicating the encoding method of the main view picture.
- the subview picture header includes information indicating a coding scheme of the subview picture.
- Each main view picture refers to the main view picture header, but does not refer to the subview picture header.
- Each subview picture refers to the subview picture header, but does not refer to the main view picture header.
- a playback device is a playback device for playing back video from a main view stream and a subview stream, and includes a decoding unit and a control unit.
- the main view stream is used for playback of planar video.
- the sub-view stream is combined with the main view stream and used to reproduce a stereoscopic video.
- the decoding unit extracts a compressed picture from the main view stream and the subview stream, analyzes a header included in the compressed picture, and decodes the compressed picture.
- the control unit determines a method for decoding the compressed picture from the header of the compressed picture analyzed by the decoding unit, and instructs the decoding unit.
- control unit determines the decoding method of the compressed picture from the header of the compressed picture included in the main view stream
- the decoding unit performs either header analysis or decoding of the compressed picture included in the subview stream. Do. While the control unit determines the decoding method of the compressed picture from the header of the compressed picture included in the subview stream, the decoding unit decodes the compressed picture included in the main view stream.
- the recording medium when an I picture or a P picture is selectively decoded from the main view stream, 3D video can be reproduced if the corresponding picture is decoded from the subview stream. . Therefore, the recording medium can further reduce the burden on the 3D playback device for the decoding process of the stream data, particularly when special playback of 3D video is performed.
- the main-view picture and the sub-view picture do not refer to each other's picture header. Therefore, the recording medium can further reduce the burden of the 3D playback device for the encoding method discrimination process of each picture.
- any of the above-described recording media according to the present invention can further reduce the burden on the 3D playback device for the decoding process of the stream data of the 3D video.
- FIG. 10 is a schematic diagram illustrating a data structure of a rear end portion of the video sequence illustrated in FIG. 9.
- 12 is a schematic diagram showing details of a method for storing a video stream 1101 in a PES packet sequence 1102.
- FIG. (A) is a schematic diagram showing a relationship between a PTS and a DTS assigned to each picture of the base-view video stream 1201.
- (B) is a schematic diagram showing the relationship between the PTS assigned to each picture of the dependent-view video stream 1202 and the DTS.
- FIG. (A) is a schematic diagram which shows the data structure of the supplementary data 931D shown by FIG. (A)
- (b) is a schematic diagram which shows two examples of the decoding counter allocated to each picture of the base view video stream 1401 and the dependent view video stream 1402.
- (A) is a schematic diagram showing the arrangement of the main TS 1601 and the sub TS 1602 recorded individually and continuously on a certain BD-ROM disc.
- (B) shows the base view data blocks B [0], B [1], B [2],...
- FIG. 6 is a schematic diagram showing an arrangement of data blocks D [0], D [1], D [2],. (A) and (b) are dependent view data block groups D [0], D [1], D [2] and base view data block group B [0] recorded in an interleaved arrangement.
- FIG. 6 is a schematic diagram showing two examples of extent ATC times for B [1] and B [2].
- FIG. 16 is a schematic diagram showing a playback path 1801 in 2D playback mode, a playback path 1802 in L / R mode, and a playback path 1803 in depth mode for the data block group shown in FIG.
- FIG. (B) is a schematic diagram showing the effective section of the offset entry shown in (a).
- (A) is a schematic diagram showing a data structure of extent start point 2042 shown in FIG.
- (B) is a schematic diagram showing a data structure of extent start point 2320 included in right-view clip information file (02000.clpi) 232 shown in FIG.
- (C) is a schematic diagram showing base view data blocks L1, L2,... Extracted from the first file SS (01000.ssif) 244A shown in FIG. 2 by the playback device 102 in the L / R mode.
- FIG. (D) is a right-view extent EXT2 [0], EXT2 [1],... Belonging to the first file DEP (02000.m2ts) 242 shown in FIG.
- (b) is a schematic diagram showing the correspondence between the starting point 2320 and SPN2322.
- (E) is a schematic diagram showing an example of a correspondence relationship between the 3D extents EXTSS [0], EXTSS [1],... Belonging to the first file SS 244A and the data block group 2350 on the BD-ROM disc. .
- the data block group 2400 including the 3D video content recorded on the BD-ROM disc according to the first embodiment of the present invention and the extent groups of the file 2D 2410, the file base 2411, the file DEP 2412, and the file SS 2420 It is a schematic diagram which shows a correspondence.
- FIG. 10 is a schematic diagram showing an example of entry points set in a base-view video stream 2510 and a dependent-view video stream 2520 in the BD-ROM disc according to Embodiment 1 of the present invention.
- FIG. 3 is a schematic diagram showing a data structure of a 2D playlist file (00001.mpls) 221 shown in FIG. 2. It is a schematic diagram which shows the data structure of PI # N shown by FIG. (A) and (b) are schematic diagrams showing the relationship between two playback sections 2801 and 2802 to be connected when the connection condition 2704 shown in FIG. 27 is “5” and “6”, respectively.
- FIG. FIG. 27 is a schematic diagram showing a correspondence relationship between a PTS indicated by the 2D playlist file 221 shown in FIG.
- FIG. 3 is a schematic diagram showing a data structure of a 3D playlist file (00002.mpls) 222 shown in FIG. 2. It is a schematic diagram which shows the data structure of STN table SS3030 shown by FIG. (A), (b), and (c) are the stream registration information sequence 3112 of the dependent-view video stream, the stream registration information sequence 3113 of the PG stream, and the stream of the IG stream shown in FIG. 31, respectively. 6 is a schematic diagram showing a data structure of a registration information sequence 3114.
- FIG. 3 is a schematic diagram showing an index table 3410 in the index file (index.bdmv) 211 shown in FIG.
- It is a flowchart of the play list file selection processing to be performed when a 3D video title is selected by the playback device according to the first embodiment of the present invention.
- It is a functional block diagram in 2D reproduction mode of the reproducing
- 37 is a list of system parameters in the player variable storage unit 3608 shown in FIG. 36.
- FIG. 37 is a functional block diagram of the system target decoder 3603 shown in FIG. 36.
- FIG. 41 is a functional block diagram of the system target decoder 4023 shown in FIG. 40.
- (A) is processed by the decoder driver 4037 and the DEC 4104 in the decoding process of the primary video stream pair of the base view and the dependent view by the 3D playback device shown in FIGS. It is a schematic diagram which shows the flow of data.
- FIG. 41 is a functional block diagram of a plane adder 4024 shown in FIG. 40.
- (A), (b) is a schematic diagram which shows the cropping process by the 2nd cropping process part 4332 shown by FIG. (A), (b), and (c) respectively show the PG planes of the left view and the right view generated by the cropping process shown in FIG. 44, and the 3D video perceived by the viewer from them.
- It is a schematic diagram. It is a schematic diagram which shows the reference relationship of the header between VAU of a base view video stream and VAU of a dependent view video stream by the modification [B] of Embodiment 1 of this invention.
- FIG. 41 is a functional block diagram of a plane adder 4024 shown in FIG. 40.
- (A) is a schematic diagram which shows the cropping process by the 2nd cropping process part 4332 shown by FIG. (A), (b), and (c) respectively show the PG planes of the left view and the right view generated by the cropping process shown in FIG.
- FIG. 47 is a schematic diagram showing the structure of a main video decoder 4715 for decoding the video stream shown in FIG. 46. It is a schematic diagram which shows the data structure of PMT4810 to which the data regarding the reproduction
- (A) is a schematic diagram showing a playback path when the extent ATC time differs between the data blocks of the adjacent base view and dependent view and the playback time of the video stream is different.
- (B) is a schematic diagram showing a playback path when the playback time of the video stream is equal between adjacent base-view data blocks and dependent-view data blocks.
- FIG. 38 is a functional block diagram of a system target decoder 5301 in the 3D playback device according to Modification [I] of Embodiment 1 of the present invention.
- FIG. 54 is a schematic diagram showing a decoding order of a base-view video stream VAU 5401 and a dependent-view video stream VAU 5402 by the system target decoder 5301 shown in FIG. 53;
- FIG. 37 is a schematic diagram showing a playback processing system in the playback device 102 in the 2D playback mode shown in FIG. 36.
- FIG. 55A is a graph showing a change in the data amount DA accumulated in the read buffer 3621 during the operation of the playback device 102 in the 2D playback mode shown in FIG. (B) is a schematic diagram showing the correspondence between the data block group 5610 to be played back and the playback path 5620 in the 2D playback mode.
- FIG. 41 is a schematic diagram showing a playback processing system in the playback device 102 in the 3D playback mode shown in FIG. 40.
- (A) and (b) show changes in the data amounts DA1 and DA2 stored in the read buffers 4021 and 4022, respectively, when the playback device 102 shown in FIG. 58 is operating in the L / R mode. It is a graph which shows.
- (C) is a schematic diagram showing a correspondence relationship between a data block group 5910 to be reproduced and a reproduction path 5920 in the L / R mode.
- FIG. 3 is a schematic diagram showing a playback processing system when a playback device 102 in 3D playback mode according to the present invention uses a single read buffer.
- (A) is a schematic diagram showing a reproduction path 6220 in the L / R mode for a data block group 6210 arranged in an interleaved manner.
- FIG. 61B is a schematic diagram showing changes in the area of data stored in the read buffer 6101 when the playback device 102 shown in FIG. 61 operates according to the playback path 6220 shown in FIG.
- FIG. (A) shows each read when each reproduction processing system shown in FIGS. 58 and 61 reads the data block group 6310 according to the reproduction path 6320 in the L / R mode for the data block group 6310 arranged in an interleaved manner.
- 4 is a graph showing changes in the amount of data DA accumulated in buffers 6101, 4021, and 4022.
- (B) is a schematic diagram showing the reproduction path 6320.
- FIG. 6 is a schematic diagram showing long jumps J LY , J BDJ 1, and J BDJ 2 that occur when the playback device 102 according to Embodiment 1 of the present invention performs playback processing in the L / R mode.
- A is a schematic diagram showing data block groups 6701 and 6702 recorded before and after the layer boundary LB of the BD-ROM disc 101 according to Embodiment 1 of the present invention.
- B is a schematic diagram showing playback paths 6710, 6711, 6712 in each playback mode for 3D extent blocks 6701, 6702.
- (A) is a schematic diagram showing a second example of the physical arrangement of data block groups recorded before and after the layer boundary LB of the BD-ROM disc 101 according to Embodiment 1 of the present invention.
- (B) is a schematic diagram showing a playback path 7010 in 2D playback mode, a playback path 7020 in L / R mode, and a playback path 7030 in depth mode for the data block group shown in (a). It is.
- (A) is a schematic diagram showing a third example of the physical arrangement of data block groups recorded before and after the layer boundary LB of the BD-ROM disc 101 according to Embodiment 1 of the present invention.
- (A) is a schematic diagram showing a fifth example of the physical arrangement of data block groups recorded before and after the layer boundary LB of the BD-ROM disc 101 according to Embodiment 1 of the present invention.
- (B) is a schematic diagram showing a playback path 7510 in 2D playback mode, a playback path 7520 in L / R mode, and a playback path 7530 in depth mode for the data block group shown in (a). It is.
- (A) and (b) are stored in the respective read buffers 4021 and 4022 in the data block read period according to the reproduction path 7520 in the L / R mode shown in FIG. 75 (b). It is a graph which shows the change of data amount DA1 and DA2 to be performed.
- FIG. 1 It is a schematic diagram showing the interleaved arrangement of extent groups 7901 assumed in the calculation of the minimum extent size and the playback paths 7920 and 7930 in 3D playback mode for them.
- A is a schematic diagram showing a state in which multiplexed stream data is divided into data blocks EXT [0] -EXT [n-1] (n ⁇ 1) of the minimum extent ATC time minT ext in order from the head.
- (B) shows the multiplexed stream data when the extent ATC time of each data block EXT [0] -EXT [n-1] shown in (a) is extended beyond the minimum extent ATC time minT ext. It is a schematic diagram which shows.
- (A) and (b) are stored in the read buffers 4021 and 4022 when a series of 3D extent blocks satisfying the expressions (50) to (53) are read by the playback device 102 in the L / R mode. It is a graph which shows the change of data amount DA1 and DA2.
- (A) is a schematic diagram showing the correspondence between a 3D extent block 8310 designed to use the method ⁇ I >> or ⁇ II >> in the 2D playback mode and the playback path 8320 in the 2D playback mode.
- FIG. (B) is a graph showing a change in the accumulated data amount DA of the read buffer 3621 when the 3D extent block 8310 is read according to the playback path 8320 in the 2D playback mode.
- (C) is a graph showing a change in the accumulated data amount DA of the read buffer 3621 when the entire 3D extent block 8310 shown in (a) is read.
- (A) is a schematic diagram showing a case where a BD-J object file is read out during a period in which 3D video is played back from 3D extent block 8401 according to playback path 8420 in the L / R mode.
- (B) is a schematic diagram showing a case where a BD-J object file reading process is performed during a period in which 2D video is played back from the 3D extent block 8401 according to the playback path 8410 in 2D playback mode.
- FIG. 6B is a schematic diagram showing a data block group 8601 recorded on a BD-ROM disc according to the modified example [U] of the first embodiment of the present invention and a playback path 8602 in the L / R mode for them. It is.
- C is a schematic diagram showing 3D extent blocks constituting stream data Ak, Bk, and Ck for each angle.
- (A) is a schematic diagram showing a first 3D extent block 8701 corresponding to multi-angle and three kinds of reproduction paths 8710, 8720, and 8730 corresponding thereto.
- (B) is a schematic diagram showing a second 3D extent block 8702 corresponding to multi-angle and three kinds of reproduction paths 8711, 8721, 8731 corresponding thereto.
- FIG. 1 is a schematic diagram showing a third 3D extent block 8703 corresponding to multi-angle and three kinds of reproduction paths 8712, 8722, and 8732 corresponding thereto. It is a block diagram which shows the internal structure of the recording device by Embodiment 2 of this invention.
- (A) is a schematic diagram showing a left video picture and a right video picture, respectively, used for displaying one scene of 3D video in the recording apparatus according to Embodiment 2 of the present invention.
- (C) is a schematic diagram showing the depth information calculated from these pictures by the video encoder 8801.
- FIG. 66 is a functional block diagram showing a typical configuration of the stream processing unit 5 shown in FIG. 65.
- FIG. 67 is a schematic diagram showing a peripheral structure when the switching unit 53 shown in FIG. 66 is a DMAC.
- FIG. 66 is a functional block diagram showing a typical configuration of the AV output unit 8 shown in FIG. 65.
- 69 is a schematic diagram showing details of a portion related to data output of the playback device 102 including the AV output unit 8 shown in FIG. 68.
- FIG. FIG. 66 is a schematic diagram showing examples (a) and (b) of the topology of the control bus and the data bus in the integrated circuit 3 shown in FIG. 65.
- FIG. 66 is a flowchart of a reproduction process performed by the reproduction device 102 using the integrated circuit 3 shown in FIG.
- FIG. 72 is a flowchart showing details of steps S1-5 shown in FIG. 71.
- FIG. (A)-(c) is a schematic diagram for demonstrating the reproduction principle of 3D image
- 11 is a schematic diagram illustrating an example in which a left view 9103L and a right view 9103R are configured from a combination of a 2D video 9101 and a depth map 9102.
- FIG. It is a schematic diagram which shows the technique for ensuring the compatibility with a 2D reproducing
- FIG. 1 is a schematic diagram showing a home theater system using a recording medium according to Embodiment 1 of the present invention.
- This home theater system adopts a 3D video (stereoscopic video) playback method using parallax video, and particularly adopts a continuous separation method as a display method (refer to ⁇ Supplement> for details).
- this home theater system uses a recording medium 101 as a playback target, and includes a playback device 102, a display device 103, shutter glasses 104, and a remote controller 105.
- the recording medium 101 is a read-only Blu-ray Disc (registered trademark) (BD: Blu-ray Disc), that is, a BD-ROM disc.
- the recording medium 101 may be another portable recording medium, for example, a semiconductor memory device such as an optical disk, a removable hard disk drive (HDD), an SD memory card, or the like according to another method such as a DVD.
- the recording medium, that is, the BD-ROM disc 101 stores movie content by 3D video. This content includes a video stream representing each of the left view and the right view of the 3D video. The content may further include a video stream representing the depth map of the 3D video. These video streams are arranged on the BD-ROM disc 101 in units of data blocks, and are accessed using a file structure described later.
- the video stream representing the left view or the right view is used by each of the 2D playback device and the 3D playback device to play back the content as 2D video.
- a pair of video streams representing each of the left view and the right view, or a pair of video streams representing either the left view or the right view and each of the depth maps is obtained by the 3D playback device. Used to play back as 3D video.
- the playback device 102 is equipped with a BD-ROM drive 121.
- the BD-ROM drive 121 is an optical disk drive conforming to the BD-ROM system.
- the playback device 102 reads content from the BD-ROM disc 101 using the BD-ROM drive 121.
- the playback device 102 further decodes the content into video data / audio data.
- the playback device 102 is a 3D playback device and can play back the content as either 2D video or 3D video.
- the operation modes of the playback device 102 when playing back 2D video and 3D video are referred to as “2D playback mode” and “3D playback mode”.
- the video data includes a video frame of either a left view or a right view.
- the video data includes both left view and right view video frames.
- 3D playback mode can be further divided into left / right (L / R) mode and depth mode.
- L / R mode a pair of video frames of the left view and the right view is reproduced from a combination of video streams representing the left view and the right view.
- depth mode a video frame pair of a left view and a right view is reproduced from a combination of video streams representing either a left view or a right view and a depth map.
- the playback device 102 has an L / R mode.
- the playback device 102 may further include a depth mode.
- the playback device 102 is connected to the display device 103 via an HDMI (High-Definition Multimedia Interface) cable 122.
- the playback device 102 converts the video data / audio data into an HDMI video / audio signal, and transmits the converted video / audio data to the display device 103 via the HDMI cable 122.
- either the left view or the right view video frame is multiplexed in the video signal.
- both left-view and right-view video frames are multiplexed in the video signal in a time division manner.
- the playback device 102 further exchanges CEC messages with the display device 103 through the HDMI cable 122. As a result, the playback device 102 can inquire of the display device 103 whether or not 3D video playback is supported.
- the display device 103 is a liquid crystal display.
- the display device 103 may be a flat panel display or projector of another type such as a plasma display and an organic EL display.
- the display device 103 displays a video on the screen 131 according to the video signal, and generates a sound from a built-in speaker according to the audio signal.
- the display device 103 can support 3D video playback. During the playback of 2D video, either the left view or the right view is displayed on the screen 131. When the 3D video is reproduced, the left view and the right view are alternately displayed on the screen 131.
- the display device 103 includes a left / right signal transmission unit 132.
- the left / right signal transmitting unit 132 transmits the left / right signal LR to the shutter glasses 104 by infrared rays or wirelessly.
- the left / right signal LR indicates whether the video currently displayed on the screen 131 is the left view or the right view.
- the display device 103 detects frame switching by identifying a left-view frame and a right-view frame from a control signal accompanying the video signal.
- the display device 103 further causes the left / right signal transmission unit 132 to switch the left / right signal LR in synchronization with the detected frame switching.
- the two liquid crystal display panels 141L and 141R alternately transmit light in synchronization with the frame switching.
- the left view is reflected only in the viewer's left eye
- the right view is reflected only in the right eye.
- the viewer perceives the difference between the images shown in each eye as binocular parallax with respect to the same stereoscopic object, so that the video looks stereoscopic.
- the remote control 105 includes an operation unit and a transmission unit.
- the operation unit includes a plurality of buttons. Each button is associated with each function of the playback device 102 or the display device 103, such as turning on / off the power or starting or stopping playback of the BD-ROM disc 101.
- the operation unit detects pressing of each button by the user, and transmits the identification information of the button to the transmission unit by a signal.
- the transmission unit converts the signal into an infrared or wireless signal IR and sends the signal IR to the playback device 102 or the display device 103.
- each of the playback device 102 and the display device 103 receives the signal IR, specifies a button indicated by the signal IR, and executes a function associated with the button. In this way, the user can remotely operate the playback device 102 or the display device 103.
- FIG. 2 is a schematic diagram showing a data structure on the BD-ROM disc 101.
- a BCA Breast Cutting Area
- FIG. 2 is a schematic diagram showing a data structure on the BD-ROM disc 101.
- a BCA Breast Cutting Area
- the BCA 201 is used for copyright protection technology.
- tracks extend spirally from the inner periphery to the outer periphery.
- the track 202 is schematically drawn in the horizontal direction.
- the track 202 includes a lead-in area 202A, a volume area 202B, and a lead-out area 202C in order from the inner periphery.
- the lead-in area 202A is provided immediately outside the BCA 201.
- the lead-in area 202A includes information necessary for accessing the volume area 202B by the BD-ROM drive 121, such as the size and physical address of data recorded in the volume area 202B.
- the lead-out area 202C is provided at the outermost periphery of the data recording area and indicates the end of the volume area 202B.
- the volume area 202B includes application data such as video and audio.
- the movie object file 212 generally includes a plurality of movie objects. Each movie object includes a sequence of navigation commands.
- the navigation command is a control command for causing the playback device 102 to execute playback processing similar to playback processing by a general DVD player.
- Types of navigation commands include, for example, an instruction to read a playlist file corresponding to a title, an instruction to reproduce an AV stream file indicated by the playlist file, and an instruction to transition to another title.
- the navigation command is written in an interpreted language, and is interpreted by an interpreter incorporated in the playback apparatus 102, that is, a job control program, and causes the control unit to execute a desired job.
- a navigation command consists of an opcode and an operand.
- Each PG stream 303A, 303B represents a graphics video to be displayed superimposed on the video represented by the primary video stream 301, such as subtitles by graphics.
- the IG stream 304 represents a graphics component for a graphics user interface (GUI) for configuring an interactive screen on the screen 131 of the display device 103 and its arrangement.
- GUI graphics user interface
- Elementary streams 301-306 are identified by a packet identifier (PID).
- PID assignment is as follows. Since one main TS includes only one primary video stream, the hexadecimal value 0x1011 is assigned to the primary video stream 301.
- any one of 0x1100 to 0x111F is assigned to the primary audio streams 302A and 302B.
- One of 0x1200 to 0x121F is allocated to the PG streams 303A and 303B.
- Any of 0x1400 to 0x141F is assigned to the IG stream 304.
- the secondary audio stream 305 is assigned one of 0x1A00 to 0x1A1F. Any number from 0x1B00 to 0x1B1F is assigned to the secondary video stream 306.
- the primary video stream 311 represents the right view of the 3D video.
- a PG stream pair 312A + 313A, 312B + 313B of the left view and the right view represents a pair of the left view and the right view when displaying graphics video such as subtitles as 3D video.
- the IG stream pair 314 and 315 of the left view and the right view represents a pair of the left view and the right view when the graphics image of the interactive screen is displayed as a 3D image.
- the secondary video stream 316 is a right-view video stream, and when the secondary video stream 306 in the main TS represents a left view of the 3D video, the secondary video stream 316 represents the right view of the 3D video.
- FIG. 3 is a list of elementary streams multiplexed in the second sub-TS on the BD-ROM disc 101.
- the second sub-TS is multiplexed stream data in the MPEG-2 TS format, and is included in the second file DEP243 shown in FIG.
- the second sub-TS includes a primary video stream 321.
- the second sub-TS may include depth map PG streams 323A and 323B, depth map IG stream 324, and secondary video stream 326.
- the primary video stream 321 is a depth map stream and represents 3D video in combination with the primary video stream 301 in the main TS.
- Depth map PG streams 323A and 323B are PG streams representing the depth map of the 3D video when the 2D video represented by the PG streams 323A and 323B in the main TS is used as a projection of the 3D video onto a virtual 2D screen.
- Used as The depth map IG stream 324 is used as an IG stream representing the depth map of the 3D video when the 2D video represented by the IG stream 304 in the main TS is used as a projection of the 3D video onto the virtual 2D screen.
- the secondary video stream 326 is a depth map stream, and represents 3D video in combination with the secondary video stream 306 in the main TS.
- PID assignment to the elementary streams 321 to 326 is as follows.
- the primary video stream 321 is assigned 0x1013.
- any one of 0x1260 to 0x127F is assigned to the depth map PG streams 323A and 323B.
- Any one of 0x1460 to 0x147F is assigned to the depth map IG stream 324.
- the secondary video stream 326 is assigned one of 0x1B40 to 0x1B5F.
- FIG. 4 is a schematic diagram showing the arrangement of TS packets in the multiplexed stream data 400.
- This packet structure is common to the main TS and the sub-TS.
- each elementary stream 401, 402, 403, 404 is converted into a sequence of TS packets 421, 422, 423, 424.
- each frame 401A or each field is converted into one PES (Packetized Elementary Stream) packet 411.
- PES Packetized Elementary Stream
- each PES packet 411 is generally converted into a plurality of TS packets 421.
- the TS packet 501 does not include the AD field 501A but includes the TS payload 501P.
- the AD field control 513 indicates “2”.
- the TS packet 501 includes both the AD field 501A and the TS payload 501P.
- ATS is time information and is used as follows: When the source packet 502 is sent from the BD-ROM disc 101 to the system target decoder in the playback device 102, the TS packet from the source packet 502 is transmitted. 502P is extracted and transferred to the PID filter in the system target decoder. The ATS in the header 502H indicates the time at which the transfer should start.
- system target decoder refers to a device that decodes multiplexed stream data for each elementary stream. Details of the system target decoder and its use of ATS will be described later.
- a motion vector is detected between the picture to be encoded and its reference picture, and motion compensation for the reference picture is performed using the motion vector. Further, a difference value between the picture obtained by motion compensation and the picture to be encoded is obtained, and redundancy in the spatial direction is removed from the difference value. Thus, the data amount of each picture is compressed.
- An “I (Intra) slice” 621 is a slice compressed by intra-picture coding.
- a “P (Predictive) slice” 622 is a slice compressed by inter-picture predictive coding, and one picture 601 whose display time is earlier than that is used as a reference picture.
- a “B (Bidirectionally Predivtive) slice” 623 is a slice compressed by inter-picture predictive coding, and two pictures 601 and 603 whose display time is earlier or later are used as reference pictures. Say things.
- reference destinations of the P slice 622 and the B slice 623 are indicated by arrows.
- one picture 602 may include different types of slices.
- MPEG-2 one picture contains only slices of the same type.
- one picture includes only the same type of slice regardless of the encoding method.
- the compressed pictures are divided into three types, i.e., I picture, P picture, and B picture, depending on the type of slice.
- B pictures those used as reference pictures in inter-picture predictive coding for other pictures are particularly referred to as “Br (reference B) pictures”.
- FIG. 7 is a schematic diagram showing pictures of the base-view video stream 701 and the right-view video stream 702 in order of display time.
- a base-view video stream 701 includes pictures 710, 711, 712,... 719 (hereinafter referred to as base-view pictures), and a right-view video stream 702 includes pictures 720 and 721. , 722,..., 729 (hereinafter referred to as right-view pictures).
- Each picture 710-719 and 720-729 represents one frame or one field, and is compressed by a moving picture compression encoding method such as MPEG-2, MPEG-4, or AVC.
- the base view picture 710-719 is generally divided into a plurality of GOPs 731,732.
- “GOP” refers to a sequence of a plurality of consecutive pictures starting from the I picture. Pictures belonging to each GOP 731 and 732 are compressed in the following order.
- the first GOP 731 the first picture is first compressed into an I 0 picture 710.
- the subscript number indicates a serial number assigned to each picture in order of display time.
- the fourth picture is compressed into a P 3 picture 713 using the I 0 picture 710 as a reference picture.
- Each arrow shown in FIG. 7 indicates that the leading picture is a reference picture for the trailing picture.
- the second and third pictures are compressed into Br 1 picture 711 and Br 2 picture 712 using both I 0 picture 710 and P 3 picture 713 as reference pictures, respectively.
- the seventh picture is compressed into a P 6 picture 716 using the P 3 picture 713 as a reference picture.
- the fourth and fifth pictures are compressed into Br 4 picture 714 and Br 5 picture 715, respectively, using both P 3 picture 713 and P 6 picture 716 as reference pictures.
- the first picture is first compressed to the I 7 picture 717, and then the third picture is compressed to the P 9 picture 719 using the I 7 picture 717 as a reference picture.
- the second picture is compressed into a Br 8 picture 718 using both the I 7 picture 717 and the P 9 picture 719 as reference pictures.
- right-view pictures 720-729 are compressed by inter-picture predictive coding.
- the encoding method is different from the encoding method of the base-view pictures 710 to 719, and also uses the redundancy between the left and right images in addition to the redundancy in the time direction of the images.
- a base-view picture having the same display time as each right-view picture is selected as one of the reference pictures of the right-view picture.
- These pictures represent a pair of right view and left view of the same scene of 3D video, that is, parallax video.
- the base view picture is either an I picture or a P picture
- the B picture is not selected as the reference picture in the compression of the right view picture corresponding to the base view picture.
- the second picture is compressed into a B 1 picture 721 using the Br 1 picture 711 in the base-view video stream 701 as a reference picture.
- the third picture is compressed into a B 2 picture 722 using the Br 2 picture 712 in the base-view video stream 701 as a reference picture in addition to the P 0 picture 720 and the P 3 picture 723.
- a base-view picture whose display time is substantially the same as that picture is used as a reference picture.
- MPEG-4 AVC / H. H.264 modified standards are known.
- MVC was established in July 2008 by JVT (Joint Video Team), a joint project between ISO / IEC MPEG and ITU-T VCEG, and is used to encode videos that can be viewed from multiple viewpoints. Is the standard.
- JVT Joint Video Team
- MVC not only the similarity in the temporal direction of video but also the similarity between videos with different viewpoints is used for inter-picture predictive coding.
- the video compression rate is higher than the predictive coding in which the video viewed from each viewpoint is individually compressed.
- FIG. 8 is a schematic diagram showing pictures of the base-view video stream 701 and the depth map stream 801 in order of display time.
- the base view video stream 701 is similar to that shown in FIG. Therefore, the explanation about the details uses the explanation about FIG.
- the depth map stream 801 includes depth maps 810, 811, 812,.
- the depth map 810-819 has a one-to-one correspondence with the base view picture 710-719, and represents a depth map for 2D video of one frame or one field indicated by each picture.
- Each depth map 810-819 is compressed by a moving image compression encoding method such as MPEG-2 or MPEG-4 AVC, similarly to the base view picture 710-719.
- a moving image compression encoding method such as MPEG-2 or MPEG-4 AVC
- inter-picture predictive coding is used in the coding method. That is, each depth map is compressed using another depth map as a reference picture.
- the base view picture is either an I picture or a P picture
- the B picture is not selected as the reference picture in the compression of the depth map corresponding to the base view picture.
- the depth map stream 801 is divided into units of GOPs similarly to the base-view video stream 701, and each GOP always includes an I picture at the head thereof. Therefore, the depth map can be decoded for each GOP. For example, the I 0 picture 810 is first decoded independently, and then the P 3 picture 813 is decoded using the decoded I 0 picture 810. Subsequently, the B 1 picture 811 and the B 2 picture 812 are decoded using both the decoded I 0 picture 810 and the P 3 picture 813. Subsequent picture groups 814, 815,... Are similarly decoded. Thus, the depth map stream 801 can be decoded independently. However, since the depth map itself is only information representing the depth of each part of the 2D video for each pixel, the depth map stream 801 cannot be used alone for video playback.
- the base-view picture is either an I picture or a P picture
- the corresponding depth map is encoded without using the B picture as a reference picture. Accordingly, when an I picture or a P picture is selectively decoded from the base-view video stream, 3D video can be reproduced if the corresponding depth map is decoded from the depth map stream. Therefore, the burden on the 3D playback device for the decoding process of the video stream is further reduced particularly during special playback of 3D video.
- FIGS. 9 and 10 are schematic diagrams showing details of the data structure of the video stream 900.
- the video stream 900 is generally composed of a sequence of a plurality of video sequences # 1, # 2,..., #M (the integer M is 1 or more).
- a “video sequence” is a combination of picture groups 911, 912, 913, 914,.
- a combination of this additional information and each picture is called a “video access unit (VAU)”. That is, in each video sequence # 1, # 2,..., #M, one VAU is configured for each picture.
- VAU video access unit
- Each picture can be read from the video stream 900 in units of VAUs.
- Such a VAU structure is substantially common to the base-view video stream and the dependent-view video stream.
- VAU # 1 located at the top of each video sequence is different between the base-view video stream and the dependent-view video stream.
- the VAU # 1931 of the base-view video stream includes an access unit (AU) identification code 931A, a sequence header 931B, a picture header 931C, supplementary data 931D, and compressed picture data 931E.
- the AU identification code 931A is a predetermined code indicating the tip of VAU # 1931.
- the sequence header 931B is also called a GOP header, and includes an identification number of the video sequence # 1 including VAU # 1931.
- the sequence header 931B further includes information common to the entire GOP 910, such as resolution, frame rate, aspect ratio, and bit rate.
- the picture header 931C indicates a unique identification number, an identification number of the video sequence # 1, and information necessary for decoding a picture, for example, the type of encoding method.
- the supplementary data 931D includes additional information related to other than decoding of pictures, for example, character information indicating closed captions, information about the GOP structure, and time code information. Supplementary data 931D particularly includes decoding switch information described later.
- the compressed picture data 931E includes the first base-view picture 911 of the GOP 910, that is, an I picture. In the compressed picture data 931E, a header is given to each slice of the I picture 911. Hereinafter, this header is referred to as a “slice header”. Each slice header includes the identification number of the picture header 931C. As shown by the dashed arrow in FIG. 9, by searching for the picture header 931C having the same identification number, information necessary for decoding each slice can be obtained from the picture header 931C.
- VAU # 1931 may include padding data 931F as necessary. Padding data 931F is dummy data.
- the dependent-view video stream VAU # 1932 includes a sub-sequence header 932B, a picture header 932C, supplementary data 932D, and compressed picture data 932E.
- Subsequence header 932B includes an identification number of video sequence # 1 including VAU # 1932.
- the subsequence header 932B further includes information common to the entire GOP 910, such as resolution, frame rate, aspect ratio, and bit rate. In particular, these values are equal to the values set for the corresponding GOP of the base-view video stream, that is, the values indicated by the sequence header 931B of VAU # 1931.
- the picture header 932C indicates a unique identification number, an identification number of the video sequence # 1, and information necessary for decoding the picture, for example, the type of encoding method.
- the supplemental data 932D includes additional information related to other than decoding of pictures, for example, character information indicating closed captions, information related to the GOP structure, and time code information. Supplementary data 932D particularly includes decoding switch information described later.
- the compressed picture data 932E includes the first dependent view picture 911 of the GOP 910, that is, a P picture or an I picture. In the compressed picture data 932E, a slice header is given to each slice of the dependent-view picture 911. Each slice header includes the identification number of the picture header 932C. As shown by the dashed arrow in FIG.
- VAU # 1932 may include padding data 932F as necessary. Padding data 932F is dummy data.
- VAU # N 941 may further include a sequence end code 941G.
- the sequence end code 941G indicates that VAU # N941 is located at the rear end of the video sequence #M.
- the sequence end code 941G may indicate that VAU # N 941 is located at the boundary of a series of playback sections of the video stream 900 (for details, refer to Modification [I]).
- VAU # N 941 may also include a stream end code 941H in addition to the sequence end code 941G.
- the stream end code 941H indicates the rear end of the video stream 900.
- VAU # N 942 differs from VAU # 1932 shown in FIG. 9 in the following points.
- VAU # N 942 does not include a subsequence header.
- the identification number of the video sequence indicated by the picture header 942C is the value indicated by the subsequence header 942B of VAU # 1 located at the front end of the video sequence #M including VAU # N942, that is, the video sequence #. Equal to M's identification number. Therefore, as shown by the dashed line arrow in FIG. 10, the subsequence header 942B is searched using the identification number of the video sequence #M, so that the resolution, frame rate, aspect ratio of each slice is obtained.
- VAU # N 942 may further include a sequence end code 942G.
- the sequence end code 942G indicates that VAU # N 942 is located at the rear end of the video sequence #M.
- the sequence end code 942G may indicate that VAU # N 942 is located at the boundary of a series of playback sections of the video stream 900 (for details, refer to Modification [I]).
- VAU # N 942 may also include a stream end code 942H in addition to the sequence end code 942G.
- the stream end code 942H indicates the rear end of the video stream 900.
- each part of the VAU shown in FIGS. 9 and 10 is composed of one NAL (Network Abstraction Layer) unit.
- NAL Network Abstraction Layer
- the AU identification code 931A, the sequence header 931B, the picture header 931C, the supplementary data 931D, the compressed picture data 931E, the padding data 931F, the sequence end code 941G, and the stream end code 941H are respectively an AU delimiter.
- FIG. 11 is a schematic diagram showing details of a method of storing the video stream 1101 in the PES packet sequence 1102.
- the video stream 1101 may be a base-view video stream or a dependent-view video stream.
- pictures are multiplexed in the coding order instead of the display time order. That is, as shown in FIG. 11, in the VAU constituting the video stream 1101, an I 0 picture 1110, a P 3 picture 1111, a B 1 picture 1112, a B 2 picture 1113,.
- the subscript number indicates a serial number assigned to each picture in order of display time.
- the PES header 1120H includes a display time (PTS: Presentation Time-Stamp) of a picture stored in the PES payload 1120P of the same PES packet 1120, and a decoding time (DTS: Decoding Time-Stamp) of the picture.
- PTS Presentation Time-Stamp
- DTS Decoding Time-Stamp
- 12A and 12B show the relationship between the PTS and DTS assigned to each picture for each of the base-view video stream 1201 and the dependent-view video stream 1202. It is a schematic diagram. Referring to FIG. 12, between both video streams 1201 and 1202, the same PTS and the same DTS are assigned to a pair of pictures representing the same frame or field of 3D video. For example, the first frame or field of the 3D video is reproduced from the combination of the I 1 picture 1211 of the base-view video stream 1201 and the P 1 picture 1221 of the dependent-view video stream 1202. Accordingly, the PTS is equal and the DTS is equal in the picture pairs 1211 and 1221.
- the subscript number indicates a serial number assigned to each picture in the order of DTS.
- the dependent-view video stream 1202 is a depth map stream
- the P 1 picture 1221 is replaced with an I picture representing a depth map for the I 1 picture 1211.
- the second picture of each video stream 1201, 1202, ie, the pair of P 2 pictures 1212, 1222 has the same PTS and the same DTS.
- the third picture of each video stream 1201, 1202, ie, a pair of Br 3 picture 1213 and B 3 picture 1223 both PTS and DTS are common. The same applies to the pair of Br 4 picture 1214 and B 4 picture 1224.
- FIG. 13 is a schematic diagram showing the data structure of supplementary data 931D shown in FIG. Supplementary data 931D corresponds to a kind of NAL unit “SEI” particularly in MPEG-4 AVC.
- Supplementary data 931D corresponds to a kind of NAL unit “SEI” particularly in MPEG-4 AVC.
- supplemental data 931D includes decoding switch information 1301.
- Decoding switch information 1301 is included in each VAU in both the base-view video stream and the dependent-view video stream.
- the decoding switch information 1301 is information for allowing the decoder in the playback device 102 to easily specify the VAU to be decoded next.
- the decoder alternately decodes the base-view video stream and the dependent-view video stream in units of VAU.
- the decryption switch information 1301 includes a next access unit type 1311, a next access unit size 1312, and a decryption counter 1313.
- the next access unit type 1311 indicates whether the VAU to be decoded next belongs to a base-view video stream or a dependent-view video stream. For example, when the value of the next access unit type 1311 is “1”, the VAU to be decoded next belongs to the base-view video stream, and when it is “2”, the dependent-view video Belongs to a stream. When the value of the next access unit type 1311 is “0”, the current VAU is located at the rear end of the stream to be decoded, and there is no VAU to be decoded next.
- the next access unit size 1312 indicates the size of the VAU to be decoded next.
- the decoder in the playback device 102 can specify the size without analyzing the VAU structure itself. Therefore, the decoder can easily extract the VAU from the buffer.
- the decoding counter 1313 indicates the order in which the VAU to which it belongs should be decoded. The order is counted from the VAU that contains the I picture in the base-view video stream.
- FIG. 14 is a schematic diagram showing an example of decoding counters 1410 and 1420 assigned to the pictures of the base-view video stream 1401 and the dependent-view video stream 1402.
- the decoding counters 1410 and 1420 are alternately incremented between the two video streams 1401 and 1402. For example, “1” is assigned as the decoding counter 1410 to the VAU 1411 including the I picture in the base-view video stream 1401. Next, “2” is assigned as the decoding counter 1420 to the VAU 1421 including the P picture in the dependent-view video stream 1402 to be decoded.
- the decoder reads and holds the decoding counter 1420 from the VAU 1422 in the decoding process of the P picture included in the second VAU 1422 of the dependent-view video stream 1402. Therefore, the decoder can predict the decoding counter 1410 of the VAU to be processed next. Specifically, since the decoding counter 1420 in the VAU 1422 including the P picture is “4”, the decoding counter 1410 of the VAU to be read next is predicted to be “5”. However, actually, since the next read VAU is the fourth VAU 1414 of the base-view video stream 1401, its decoding counter 1410 is “7”.
- the decoder can detect that one VAU is missed. Therefore, the decoder can perform the following error processing: “For the B picture extracted from the third VAU 1423 of the dependent-view video stream 1402, the Br picture to be referred to is missing, so the decoding process is performed. skip". Thus, the decoder checks the decoding counters 1410 and 1420 for each decoding process. Accordingly, the decoder can quickly detect a VAU reading error and can execute appropriate error processing quickly. As a result, it is possible to prevent noise from being mixed into the reproduced video.
- the decoder when the decoder decodes one VAU of the dependent-view video stream 1402, it can be predicted as follows: “The value obtained by adding 1 to the decoding counter 1440 is the base view to be decoded next. Equal to the VAU decoding counter 1430 of the video stream 1401 ”. Therefore, the decoder can quickly detect a VAU reading error from the decoding counters 1430 and 1440 at any time, and can execute appropriate error processing quickly. As a result, it is possible to prevent noise from being mixed into the reproduced video.
- FIG. 15 is a schematic diagram showing the physical arrangement on the BD-ROM disc 101 of the data block groups belonging to each of the main TS, the first sub-TS, and the second sub-TS shown in FIG. is there.
- Data block refers to a series of data recorded in a continuous area on the BD-ROM disc 101, that is, a plurality of physically continuous sectors.
- LBN is also continuous in each data block. Therefore, the BD-ROM drive 121 can continuously read one data block without causing the optical pickup to seek.
- base-view data blocks Belonging to the main TS are referred to as “base-view data blocks”, and data blocks R0, R1, R2,..., D0, D1, D2,. Is called “Dependent View Data Block”.
- the data blocks R0, R1, R2,... Belonging to the first sub-TS are called “right-view data blocks”, and the data blocks D0, D1, D2,. ⁇ This is called a data block.
- data block groups are continuously recorded along a track 1501 on the BD-ROM disc 101.
- the base view data blocks L0, L1, L2,..., The right view data blocks R0, R1, R2,... And the depth map data blocks D0, D1, D2,. Is arranged. Such an arrangement of data blocks is called “interleaved arrangement”.
- the P picture of the right-view video stream represents a right view when the 2D video represented by the I picture of the base-view video stream is a left view.
- the P picture is compressed using the I picture of the base-view video stream as a reference picture, as shown in FIG. Therefore, the playback device 102 in the 3D playback mode can start playback of 3D video from any set of data blocks Dn, Rn, and Ln.
- the BD-ROM drive 121 temporarily stops the reading operation by the optical pickup and increases the rotation speed of the BD-ROM disc. Accordingly, the sector on the BD-ROM disc in which the tip portion of the sub TS 1602 indicated by the arrow (2) is recorded is quickly moved to the position of the optical pickup. As described above, an operation for temporarily stopping the reading operation of the optical pickup and positioning the optical pickup on the next reading target area during this time is called “jump”.
- the dashed arrows shown in FIG. 16A indicate the range of each jump required during the reading process. During each jump period, the reading process by the optical pickup stops and only the decoding process by the decoder proceeds. In the example shown in FIG. 16A, the jump is excessive, and it is difficult to keep the read process in time for the decoding process. As a result, it is difficult to reliably maintain seamless playback.
- the dependent view data block has a higher compression ratio than the base view data block. Therefore, the speed of the decoding process of the dependent-view data block is generally lower than the speed of the decoding process of the base-view data block.
- the extent ATC time is equal, the dependent-view data block has a smaller data amount than the base-view data block. Therefore, as shown in FIGS. 17A and 17B, when the extent ATC time is equal between adjacent data blocks, the speed at which the data to be decoded is supplied to the system target decoder is Easy to maintain processing speed and balance. In other words, the system target decoder can easily synchronize the decoding process of the base-view data block and the decoding process of the dependent-view data block, especially in the dive reproduction.
- the file entry 1520 of the first file DEP (02000.m2ts) 242 indicates the size of the right-view data block R0, R1, R2,. Accordingly, each right-view data block R0, R1, R2,... Can be accessed as extents EXT2 [0], EXT2 [1], EXT2 [2],.
- extents EXT2 [0], EXT2 [1], EXT2 [2],... Belonging to the first file DEP242 are referred to as “right view extents”.
- AV stream file cross-linking is realized as follows.
- the file entry 1540 of the first file SS (01000.ssif) 244A regards the pairs R0 + L0, R1 + L1, R2 + L2,... Of adjacent right-view data blocks and base-view data blocks as one extent. Each size and the LBN at its tip are shown. Therefore, each pair of data blocks R0 + L0, R1 + L1, R2 + L2,... Can be accessed as extents EXTSS [0], EXTSS [1], EXTSS [2],.
- the extents EXTSS [0], EXTSS [1], EXTSS [2],... Belonging to the first file SS 244A are referred to as “3D extents”.
- the file entry 1550 of the second file SS (02000.ssif) 244B includes the sizes of the depth map data blocks D0, D1, D2,... And the base view data blocks L0, L1, L2,.
- the tip LBN is shown alternately. Therefore, each data block D1, L1, D2, L2,... Can be accessed as extents EXTSS [0], EXTSS [1], EXTSS [2], EXTSS [3],.
- Each extent of the second file SS 244B shares a base-view data block Ln with the file 2D 241 and shares a depth map data block Dn with the second file DEP 243.
- FIG. 18 is a schematic diagram showing a playback path 1801 in 2D playback mode, a playback path 1802 in L / R mode, and a playback path 1803 in depth mode for the data block group shown in FIG. .
- the playback device 102 plays back the file 2D241 in the 2D playback mode. Therefore, as indicated by the playback path 1801 in the 2D playback mode, the base-view data blocks L0, L1, and L2 are sequentially read as 2D extents EXT2D [0], EXT2D [1], and EXT2D [2]. That is, the first base-view data block L0 is read first, and the reading of the depth map data block D1 and right-view data block R1 immediately after that is skipped by the first jump J2D1 . Next, the second base-view data block L1 is read, and the next read-out of the depth map data block D2 and right-view data block R2 is skipped by the second jump J 2D 2. The Subsequently, the third base-view data block L2 is read.
- the playback device 102 plays back the first file SS 244A in the L / R mode. Therefore, as indicated by the playback path 1802 in the L / R mode, the pair R0 + L0, R1 + L1, R2 + L2 of the adjacent right-view data block and base-view data block is in turn in the 3D extents EXTSS [0], EXTSS [ 1], read as EXTSS [2]. That is, the first right-view data block R0 and the immediately subsequent base-view data block L0 are successively read, and the immediately following depth map data block D1 is read by the first jump J LR Skipped by 1.
- the second right-view data block R1 and the base-view data block L1 immediately after it are read continuously, and the next-time reading of the depth map data block D2 is the second jump. Skipped by J LR 2. Subsequently, the third right-view data block R2 and the immediately subsequent base-view data block L2 are read out successively.
- the playback device 102 plays back the second file SS 244B in the depth mode. Therefore, as indicated by the playback path 1803 in the depth mode, the depth map data blocks D0, D1,... And the base view data blocks L0, L1,. ], EXTSS [1], EXTSS [2], EXTSS [3],. That is, the first depth map data block D0 is read first, and the right view data block R0 immediately after that is skipped by the first jump JLD1 . Next, the top base-view data block L0 is read, and then the depth map extent D1 immediately after is read. Further, reading of the right-view extent R1 immediately after that is skipped by the second jump J LD 2 and the second base-view data block L1 is read.
- the reproduction device 102 may read the data block group substantially in order from the top.
- a jump occurs during the reading process.
- the distance of each jump is different from that shown in FIG. 16A and is sufficiently shorter than the entire length of the main TS and the sub-TS.
- the playback device 102 can reduce the buffer capacity compared to the reverse case.
- the playback device 102 reads the data block group as the extent group of the first file SS 244A in the L / R mode. That is, the playback device 102 reads the LBN at the tip of each 3D extent EXTSS [0], EXTSS [1],... And the size from the file entry 1540 of the first file SS 244A and passes it to the BD-ROM drive 121.
- the BD-ROM drive 121 continuously reads data of that size from the LBN. In these processes, the control of the BD-ROM drive 121 is easier at the following two points (A) and (B) than the process of reading the data block group as the extents of the first file DEP242 and the file 2D241.
- the playback device 102 may refer to each extent in turn using one file entry; (B) the total number of extents to be read is substantially halved, so that the BD-ROM drive 121 The total number of LBN / size pairs to be passed is small.
- the advantage (A) also applies to the process of reading the data block group as the extent of the second file SS 244B in the depth mode. However, the playback device 102 must read the 3D extents EXTSS [0], EXTSS [1],..., And then separate them into right-view data blocks and base-view data blocks and pass them to the decoder. .
- a clip information file is used for the separation process. Details thereof will be described later.
- TS packets included in AV stream file The types of TS packets included in the AV stream file include PAT (Program Association Table), PMT (Program Map Table), and PCR (PCR) in addition to those converted from the elementary stream shown in FIG. Program Clock Reference).
- PCR, PMT, and PAT are defined in the European digital broadcasting standard, and originally have a role of defining a partial transport stream constituting one program.
- the AV stream file is also defined in the same manner as the partial transport stream.
- the PAT indicates the PMT PID included in the same AV stream file.
- the PID of the PAT itself is 0.
- the PMT includes the PID of each elementary stream representing video / audio / subtitles and the attribute information included in the same AV stream file.
- the PMT further includes various descriptors (also referred to as descriptors) regarding the AV stream file.
- the descriptor includes copy control information indicating permission / prohibition of copying of the AV stream file.
- the PCR includes information indicating an STC (System Time Clock) value to be associated with the ATS assigned to the PCR.
- STC System Time Clock
- STC System Time Clock
- FIG. 19 is a schematic diagram showing the data structure of PMT 1910.
- the PMT 1910 includes a PMT header 1901, a descriptor 1902, and stream information 1903.
- the PMT header 1901 indicates the length of data included in the PMT 1910.
- Each descriptor 1902 is a descriptor relating to the entire AV stream file including the PMT 1910.
- the aforementioned copy control information is included in one of the descriptors 1902.
- the stream information 1903 is information regarding each elementary stream included in the AV stream file, and is assigned to a different elementary stream one by one.
- Each stream information 1903 includes a stream type 1931, a PID 1932, and a stream descriptor 1933.
- the stream type 1931 includes identification information of a codec used for compression of the elementary stream.
- PID 1932 indicates the PID of the elementary stream.
- the stream descriptor 1933 includes attribute information of the elementary stream, such as a frame rate and an aspect ratio.
- the decoder in the playback device 102 can process the AV stream file in the same manner as a partial transport stream compliant with the European digital broadcasting standard. Thereby, compatibility between the playback device for the BD-ROM disc 101 and a terminal device compliant with the European digital broadcasting standard can be ensured.
- FIG. 20 is a schematic diagram showing the data structure of the first clip information file (01000.clpi), that is, the 2D clip information file 231.
- the dependent view clip information files (02000.clpi, 03000.clpi) 232 and 233 have the same data structure.
- the data structure common to all clip information files will be described by taking the data structure of the 2D clip information file 231 as an example. Subsequently, differences in data structure between the 2D clip information file and the dependent view clip information file will be described.
- the clip information 2010 includes a system rate 2011, a playback start time 2012, and a playback end time 2013 as shown in FIG.
- the system rate 2011 indicates the maximum value of the rate at which “TS packets” belonging to the file 2D (01000.m2ts) 241 are transferred from the read buffer to the system target decoder in the playback device 102.
- the ATS interval of the source packet is set so that the transfer rate of the TS packet can be suppressed below the system rate.
- the reproduction start time 2012 indicates the PTS of the first VAU of the file 2D241, for example, the PTS of the first video frame.
- the reproduction end time 2012 indicates an STC value delayed by a predetermined amount from the PAU of the VAU at the rear end of the file 2D241, for example, a value obtained by adding the reproduction time per frame to the PTS of the last video frame.
- the stream attribute information 2020 is a correspondence table between the PID 2021 of each elementary stream included in the file 2D 241 and its attribute information 2022.
- the attribute information 2022 is different for each of the video stream, the audio stream, the PG stream, and the IG stream.
- the attribute information associated with PID 0x1011 of the primary video stream indicates the type of codec used for compression of the video stream, the resolution of each picture constituting the video stream, the aspect ratio, and the frame rate. Including.
- the attribute information associated with PID 0x1101 of the primary audio stream includes the type of codec used for compression of the audio stream, the number of channels included in the audio stream, the language, and the sampling frequency.
- the attribute information 2022 is used by the playback device 102 to initialize the decoder.
- SPN means a number assigned to a source packet group belonging to the file 2D 241, that is, a source packet group constituting the main TS. Therefore, the entry point 2102 represents the correspondence between the PTS and address of each I picture included in the file 2D 241, that is, the SPN.
- Entry point 2102 may not be set for all I pictures in file 2D241. However, when the I picture is located at the beginning of the GOP and the TS packet including the beginning of the I picture is located at the beginning of the 2D extent, the entry point 2102 must be set for the I picture.
- FIG. 21B is a schematic diagram showing the source packet group 2110 belonging to the file 2D241 that is associated with each EP_ID 2105 by the entry map 2030.
- the reproducing device 102 uses the entry map 2030 to specify the SPN of the source packet including the frame from the PTS of the frame representing an arbitrary scene.
- the playback device 102 designates the LBN to the BD-ROM drive 121. As a result, the base-view data block group is read out in units of aligned units in order from the LBN sector. Further, the playback device 102 selects a source packet indicated by the entry point at the playback start position from the aligned unit read first, and decodes it to an I picture. Thereafter, subsequent pictures are sequentially decoded using the previously decoded pictures. In this way, the playback device 102 can play back 2D video images after a specific PTS from the file 2D241.
- Entry map 2030 is further advantageous for efficient processing of special playback such as fast forward playback and rewind playback.
- the playback device 102 uses the file entry of the file 2D 241 to identify the LBN of the sector corresponding to each SPN.
- the playback device 102 designates each LBN to the BD-ROM drive 121. Thereby, the aligned unit is read from the sector of each LBN.
- the playback device 102 further selects a source packet indicated by each entry point from each aligned unit and decodes it to an I picture.
- the playback device 102 can selectively play back I pictures from the file 2D 241 without analyzing the 2D extent group EXT2D [n] itself.
- FIG. 22A is a schematic diagram showing the data structure of the offset table 2041.
- the offset table 2041 is information used for the cropping process by the playback device 102 in the 3D playback mode.
- the “cropping process” refers to a process of generating a pair of plane data representing a left view and a right view from data representing a 2D video.
- “Plane data” means a two-dimensional array of pixel data, the size of which is equal to the resolution of the video frame.
- One set of pixel data consists of a combination of color coordinate values and ⁇ values.
- the color coordinate value is represented by an RGB value or a YCrCb value.
- the playback device 102 in the L / R mode uses the extent start points 2042 and 2320 in addition to the entry maps of the clip information files 231 and 232 to write any scene. From the PTS of the frame representing the view, the LBN of the sector in which the right-view data block including the frame is recorded is specified. Specifically, the playback device 102 first searches the SPN associated with the PTS from the entry map of the right view / clip information file 232, for example. Assume that the source packet indicated by the SPN is included in the third right-view extent EXT2 [2] of the first file DEP242, that is, the right-view data block R3.
- the playback device 102 in the L / R mode can play back 3D video images after the specific PTS from the first file SS 244A.
- the playback apparatus 102 can actually enjoy the advantages (A) and (B) related to the control of the BD-ROM drive 121.
- FIG. 23C is a schematic diagram showing the base-view data blocks L1, L2,... Extracted from the first file SS 244A by the playback device 102 in the L / R mode.
- the SPN 2312 indicated by the extent start point 2042 is equal to the SPN of the source packet located at the tip of each base-view data block.
- file base a base-view data block group extracted from one file SS using the extent start point.
- base view data block included in the file base is referred to as “base view extent”.
- Each base view extent is referred to by an extent start point in the 2D clip information file, as shown in FIG.
- Two consecutive dependent-view data block and base-view data block pairs D [0] + B [0], D [1] + B [1] are files as one 3D extent EXTSS [0] It belongs to SS2420.
- the pair D [2] + B [2], D [3] + B [3] of two consecutive dependent-view data blocks and base-view data blocks is one 3D extent EXTSS [1 ] Belongs to the file SS2420.
- 3D extents EXTSS [0] and EXTSS [1] share base-view data block B [n] with 2D extent EXT2D [n] and depend with dependent-view extent EXT2 [n] Share view data block D [n].
- Each 3D extent EXTSS [0] and EXTSS [1] is read into the playback device 102 and then separated into a dependent-view data block D [n] and a base-view data block B [n]. .
- Those base-view data blocks B [n] belong to the file base 2411 as base-view extents EXT1 [n].
- the clip between the base view extent EXT1 [n] and the dependent view extent EXT2 [n] in each 3D extent EXTSS [n] is a clip associated with each of the file 2D2410 and the file DEP2412 It is specified using the extent start point in the information file.
- the dependent view clip information file has the same data structure as the 2D clip information file shown in FIGS. 20-23. Therefore, in the following description, the difference between the dependent-view clip information file and the 2D clip information file will be referred to, and the description of the similar points will be referred to the above description.
- the dependent view clip information file differs from the 2D clip information file mainly in the following three points (i), (ii), and (iii): (i) Conditions are imposed on the stream attribute information; ii) A condition is imposed on the entry point; (iii) 3D metadata does not include an offset table.
- the dependent-view video stream is compressed using the base-view video stream.
- the dependent-view video stream has the same base-view video stream and video stream attributes.
- the codec, resolution, aspect ratio, and frame rate must match between the video stream attribute information. If the codec types match, a reference relationship in encoding is established between the pictures of the base-view video stream and the dependent-view video stream, so that each picture can be decoded. If the resolution, aspect ratio, and frame rate all match, the screen display of the left and right images can be synchronized. Therefore, those videos can be shown as 3D videos without giving the viewer a sense of incongruity.
- the dependent view clip information file entry map includes a table assigned to the dependent view video stream.
- the table includes an entry map header and entry points, similar to 2100 shown in FIG.
- the entry map header indicates the PID of the corresponding dependent-view video stream, ie 0x1012 or 0x1013.
- Each entry point associates a pair of PTS and SPN with one EP_ID.
- the PTS of each entry point is equal to the PTS of the first picture of any GOP included in the dependent-view video stream.
- the SPN of each entry point is equal to the first SPN of the source packet group in which the picture indicated by the PTS belonging to the same entry point is stored.
- SPN means a serial number assigned in order from the top to the source packet group belonging to the file DEP, that is, the source packet group constituting the sub-TS.
- the PTS of each entry point must match the PTS of the entry point in the table assigned to the base view video stream in the entry map of the 2D clip information file. That is, when an entry point is set at the head of a source packet group including one of a pair of pictures included in the same 3D / VAU, the entry point is always set at the head of the source packet group including the other. Must have been.
- FIG. 25 is a schematic diagram showing examples of entry points set in the base-view video stream 2510 and the dependent-view video stream 2520.
- GOPs in the same order counted from the beginning represent videos in the same reproduction period.
- entry points 2501B, 2503B, and 2505B are set at the heads of GOP # 1, GOP # 3, and GOP # 5 that are odd-numbered from the head. Has been.
- entry points 2501D, 2503D, and 2505D are set at the heads of the odd-numbered GOP # 1, GOP # 3, and GOP # 5 counted from the head. ing.
- the playback device 102 can immediately calculate the SPN of the playback start position in the file SS from the SPN of the corresponding entry points 2503B and 2503D.
- the sum of the SPNs of entry points 2503B and 2503D is reproduced in the file SS. Equal to the starting position SPN.
- the LBN of the sector in which the portion of the reproduction start position in the file SS is recorded can be calculated from the number of source packets. In this way, even in the playback of 3D video, the response speed of processing that requires random access of the video stream, such as jumping playback, can be improved.
- FIG. 26 is a schematic diagram showing the data structure of a 2D playlist file.
- the first playlist file (00001.mpls) 221 shown in FIG. 2 has this data structure.
- the 2D playlist file 221 includes a main path 2601 and two sub paths 2602 and 2603.
- the main path 2601 is an array of play item information (PI), and specifies the main playback path of the file 2D 241, that is, the playback target portion and the playback order.
- PI play item information
- # N defines a different playback section of the main playback path with a pair of PTSs. One of the pairs represents the start time (In-Time) of the playback section, and the other represents the end time (Out-Time).
- the order of PIs in the main path 2601 represents the order of the corresponding playback sections in the playback path.
- Each sub-path 2602, 2603 is an array of sub-play item information (SUB_PI), and defines playback paths that can accompany the main playback path of the file 2D241 in parallel.
- the playback path means a part different from the part of the file 2D241 represented by the main path 2601 or a part of stream data multiplexed in another file 2D and a playback order thereof.
- the stream data represents another 2D video to be played simultaneously with the 2D video played from the file 2D 241 according to the main path 2601.
- the other 2D video includes, for example, a sub-video in a picture-in-picture system, a browser screen, a pop-up menu, or subtitles.
- Sub-paths 2602 and 2603 are assigned serial numbers “0” and “1” in the order of registration in the 2D playlist file 221.
- the serial number is used as a sub path ID for identifying each of the sub paths 2602 and 2603.
- Each SUB_PI # M defines a playback section having a different playback path by a pair of PTSs. One of the pair represents the reproduction start time of the reproduction section, and the other represents the reproduction end time.
- the order of SUB_PI in each sub-path 2602, 2603 represents the order of the corresponding playback section in the playback path.
- FIG. 27 is a schematic diagram showing the data structure of PI # N.
- PI # N includes reference clip information 2701, playback start time (In_Time) 2702, playback end time (Out_Time) 2703, connection condition 2704, and stream selection table (hereinafter STN (Stream Number)).
- STN Stream Number
- the reference clip information 2701 is information for identifying the 2D clip information file 231.
- the reproduction start time 2702 and the reproduction end time 2703 indicate the PTSs at the front end and the rear end of the reproduction target portion of the file 2D241.
- connection condition 2704 connects the video in the playback section specified by the playback start time 2702 and the playback end time 2703 to the video in the playback section specified by the immediately preceding PI # (N ⁇ 1). Specify the conditions for when.
- the STN table 2705 represents a list of elementary streams that can be selected from the file 2D241 by the decoder in the playback apparatus 102 between the playback start time 2702 and the playback end time 2703.
- connection condition 2704 can take, for example, three types of values “1”, “5”, and “6”.
- connection condition 2704 is “1”
- the video reproduced from the portion of the file 2D241 defined by PI # N is reproduced from the portion of the file 2D241 defined by the immediately preceding PI # (N ⁇ 1). It is not always necessary to be seamlessly connected to the video.
- connection condition 2704 is “5” or “6”
- both images must be seamlessly connected.
- 28A and 28B are schematic diagrams showing the relationship between two playback sections 2801 and 2802 to be connected when the connection condition 2704 is “5” and “6”, respectively.
- PI # (N ⁇ 1) defines the first part 2801 of the file 2D241
- PI # N defines the second part 2802 of the file 2D241.
- the STC may be interrupted between two PI # (N ⁇ 1) and PI # N. That is, PTS # 1 at the rear end of the first portion 2801 and PTS # 2 at the front end of the second portion 2802 may be discontinuous. However, some constraints must be met.
- FIG. 29 is a schematic diagram showing the correspondence between the PTS indicated by the 2D playlist file (00001.mpls) 221 and the portion reproduced from the file 2D (01000.m2ts) 241.
- PI # 1 defines PTS # 1 indicating the reproduction start time IN1 and PTS # 2 indicating the reproduction end time OUT1.
- Reference clip information 2701 of PI # 1 indicates a 2D clip information file (01000.clpi) 231.
- the playback device 102 first reads PTS # 1 and # 2 from PI # 1.
- the sub-path 3002 defines the reproduction path of the sub-TS shown in FIGS. 3B and 3C, that is, the reproduction path of either the first file DEP242 or the second file DEP243.
- the data structure of the sub path 3002 is the same as the data structure of the sub paths 2602 and 2603 of the 2D playlist file 241 shown in FIG. Therefore, the description using FIG. 26 is used for the details of the similar data structure, particularly the details of the data structure of SUB_PI.
- Subpath 3002 has a one-to-one correspondence with PI # N in the main path 3001. Furthermore, the playback start time and playback end time specified by each SUB_PI # N are equal to the playback start time and playback end time specified by the corresponding PI # N, respectively.
- Subpath 3002 additionally includes subpath type 3010. “Sub-path type” generally indicates whether or not the reproduction processing should be synchronized between the main path and the sub-path. In the 3D playlist file 222, the sub-path type 3010 particularly indicates the type of 3D playback mode, that is, the type of dependent-view video stream to be played according to the sub-path 3002. In FIG.
- the extended data 3003 is a part that is interpreted only by the playback device 102 in the 3D playback mode, and is ignored by the playback device 102 in the 2D playback mode.
- the extension data 3003 includes an extension stream selection table 3030.
- the “extended stream selection table (STN_table_SS)” (hereinafter abbreviated as STN table SS) is an array of stream registration information to be added to the STN table indicated by each PI in the main path 3001 in the 3D playback mode. This stream registration information indicates an elementary stream that can be selected as a playback target from the sub-TS.
- FIG. 31 is a schematic diagram showing the data structure of the STN table SS3030.
- the STN table SS 3030 includes stream registration information sequences 3101, 3102, 3103,.
- the stream registration information columns 3001, 3002, 3003,... Individually correspond to the PIs # 1, # 2, # 3,... In the main path 3001, and the STN table in the corresponding PI by the playback device 102 in 3D playback mode. Is used in combination with the stream registration information sequence included in.
- a stream registration information column 3101 for each PI includes a popup period offset (Fixed_offset_during_Popup) 3111, a dependent-view video stream stream registration information column 3112, a PG stream stream registration information column 3113, and an IG stream stream registration information. Includes column 3114.
- the BD display mode is selected as the display mode of the video plane, and the 2-plane mode or 1 plane + offset mode is selected as the display mode of the PG plane.
- the value of the offset 3111 of the pop-up period is “1”
- the pop-up menu is reproduced from the IG stream.
- the BB display mode is selected as the video plane display mode
- the 1 plane + zero offset mode is selected as the display mode of the PG plane.
- the playback device 102 alternately outputs plane data decoded from the video streams of the left view and the right view. Accordingly, since the left view frame and the right view frame represented by the video plane are alternately displayed on the screen of the display device 103, the viewer can see them as a 3D image.
- the playback device 102 maintains the operation mode in the 3D playback mode (particularly, maintains the frame rate at the value at the time of 3D playback, for example, 48 frames / second), the base view video, Only the plain data decoded from the stream is output twice per frame. Accordingly, since only one of the left view and right view frames is displayed on the screen of the display device 103, the viewer can only see them as 2D video.
- the playback device 102 In “1 plane + zero offset mode”, the playback device 102 temporarily stops the cropping process while maintaining the operation mode in the 3D playback mode, and decodes the plane decoded from the graphics stream in the main TS. -Output data twice per frame. Therefore, since only the PG plane of the left view or the right view is displayed on the screen of the display device 103, the viewer can only see them as 2D video.
- the playback device 102 in the 3D playback mode refers to the offset 3111 of the pop-up period for each PI.
- the playback device 102 selects the BB display mode and the 1 plane + zero offset mode. select. Thereby, while the pop-up menu is displayed, the other 3D video is temporarily changed to the 2D video, thereby improving the visibility and operability of the pop-up menu.
- this stream registration information sequence 3112 generally includes a plurality of stream registration information (SS_dependent_view_block) 3201. They are the same as the stream registration information in the corresponding PI indicating the base-view video stream.
- Each stream registration information 3201 includes an STN 3211, a stream entry 3212, and stream attribute information 3213.
- STN 3211 is a serial number individually assigned to the stream registration information 3201 and is equal to the STN of stream registration information to be combined in the corresponding PI.
- the stream entry 3212 includes subpath ID reference information (ref_to_Subpath_id) 3221, stream file reference information (ref_to_subClip_entry_id) 3222, and PID (ref_to_stream_PID_subclip) 3223.
- the subpath ID reference information 3221 indicates the subpath ID of the subpath that defines the playback path of the dependent-view video stream.
- the stream file reference information 3222 is information for identifying the file DEP in which the dependent-view video stream is stored.
- PID 3223 is the PID of the dependent-view video stream.
- the stream attribute information 3213 includes attributes of the dependent-view video stream, such as frame rate, resolution, and video format. In particular, they are the same as those of the base-view video stream indicated by the stream registration information to be combined in the corresponding PI.
- this stream registration information sequence 3113 generally includes a plurality of stream registration information 3231. They are the same as the number indicating the PG stream among the stream registration information in the corresponding PI.
- Each stream registration information 3231 includes an STN 3241, a stereoscopic flag (is_SS_PG) 3242, a base view stream entry (stream_entry_for_base_view) 3243, a dependent view stream entry (stream_entry_for_dependent_view) 3244, and stream attribute information 3245.
- the STN 3241 is a serial number individually assigned to the stream registration information 3231 and is equal to the STN of the stream registration information to be combined in the corresponding PI.
- the stereoscopic flag 3242 indicates whether or not the BD-ROM disc 101 includes both a base view and a dependent view, for example, a left view and a right view PG stream. When the stereoscopic flag 3242 is on, both PG streams are included in the sub-TS. Accordingly, any of the fields of the base view stream entry 3243, the dependent view stream entry 3244, and the stream attribute information 3245 are read by the playback device. When the stereoscopic flag 3242 is off, any of these fields 3243-3245 are ignored by the playback device.
- Each of the base view stream entry 3243 and the dependent view stream entry 3244 includes sub path ID reference information, stream file reference information, and PID.
- the sub path ID reference information indicates a sub path ID of a sub path that defines a playback path of each PG stream in the base view and the dependent view.
- the stream file reference information is information for identifying the file DEP in which each PG stream is stored.
- PID is the PID of each PG stream.
- the stream attribute information 3245 includes attributes of each PG stream, for example, language type.
- the stream registration information sequence 3114 generally includes a plurality of stream registration information 3251. They are the same number as the stream registration information in the corresponding PI indicating the IG stream.
- Each stream registration information 3251 includes an STN 3261, a stereoscopic flag (is_SS_IG) 3262, a base view stream entry 3263, a dependent view stream entry 3264, and stream attribute information 3265.
- the STN 3261 is a serial number individually assigned to the stream registration information 3251 and is equal to the STN of the stream registration information to be combined in the corresponding PI.
- the stereoscopic flag 3262 indicates whether or not the BD-ROM disc 101 includes both base view and dependent view, for example, left view and right view IG streams. When the stereoscopic flag 3262 is on, both IG streams are included in the sub-TS. Accordingly, any of the fields of the base view stream entry 3263, the dependent view stream entry 3264, and the stream attribute information 3265 are read by the playback device. When the stereoscopic flag 3262 is off, any of these fields 3263-3265 are ignored by the playback device.
- Each of the base view stream entry 3263 and the dependent view stream entry 3264 includes sub path ID reference information, stream file reference information, and PID.
- the subpath ID reference information indicates a subpath ID of a subpath that defines a playback path of each IG stream in the base view and the dependent view.
- the stream file reference information is information for identifying the file DEP in which each IG stream is stored.
- PID is the PID of each IG stream.
- the stream attribute information 3265 includes attributes of each IG stream, for example, language type.
- FIG. 33 is a schematic diagram showing the correspondence between the PTS indicated by the 3D playlist file (00002.mpls) 222 and the portion reproduced from the first file SS (01000.ssif) 244A.
- PI # 1 defines PTS # 1 indicating the playback start time IN1 and PTS # 2 indicating the playback end time OUT1.
- the reference clip information of PI # 1 indicates a 2D clip information file (01000.clpi) 231.
- the playback device 102 When the playback device 102 plays back 3D video in accordance with the 3D playlist file 222, the playback device 102 first reads PTS # 1 and # 2 from PI # 1 and SUB_PI # 1. Next, the playback device 102 refers to the entry map of the 2D clip information file 231 and searches for the SPNs # 1 and # 2 in the file 2D241 corresponding to the PTSs # 1 and # 2. At the same time, the playback device 102 refers to the entry map of the right-view clip information file 232 and searches for the SPNs # 11 and # 12 in the first file DEP242 corresponding to the PTSs # 1 and # 2. Next, as described in the explanation of FIG.
- the playback device 102 uses the number of sectors and the file entry of the first file SS 244A to use the sector group P11 in which the 3D extent group EXTSS [0],..., EXTSS [n] to be played back is recorded.
- the LBN # 1 at the front end and the LBN # 2 at the rear end are specified.
- the calculation of the number of sectors and the specification of the LBN are the same as those described in the explanation of FIG.
- the playback device 102 designates the range from LBN # 1 to LBN # 2 to the BD-ROM drive 121. Thereby, the source packet group belonging to the 3D extent group EXTSS [0],..., EXTSS [n] is read from the sector group P11 in the range.
- the pair of PTS # 3 and # 4 indicated by PI # 2 and SUB_PI # 2 is first set using the entry map of clip information files 231 and 232 and the pair of SPN # 3 and # 4 and SPN # 2. 13 and a pair of # 14.
- the number of source packets SPN # 23 from the top of the first file SS244A to the playback start position is calculated from SPN # 3 and # 13, and playback ends from the top of the first file SS244A from SPN # 4 and # 14.
- the number of source packets SPN # 24 up to the position is calculated.
- the pair of SPN # 23 and # 24 is converted into the pair of LBN # 3 and # 4.
- the source packet group belonging to the 3D extent group is read from the sector group P12 in the range from LBN # 3 to LBN # 4.
- the item “title 3” and the item “title 4” are assigned to the title of the 3D video.
- the movie object MVO-3D associated with the item “title 3” includes a 3D playlist file (00002.mpls) 222, in addition to a group of commands related to 2D video playback processing using the 2D playlist file 221. (00003.mpls) includes a group of instructions related to 3D video playback processing using any one of 223.
- the application management table includes a 3D playlist in addition to a Java application program related to 2D video playback processing using the 2D playlist file 221.
- a Java application program relating to 3D video playback processing using either one of the files 222 and 223 is defined.
- the playback apparatus 102 includes a first flag and a second flag as a premise of the selection process.
- the first flag is “0”
- the playback device 102 can support only playback of 2D video, and when it is “1”, it can also support playback of 3D video.
- the second flag is “0”
- the playback device 102 is in the L / R mode, and when it is “1”, it is in the depth mode.
- step S3501 the playback device 102 checks the value of the first flag. If the value is “0”, processing proceeds to step S3505. If the value is “1”, processing proceeds to step S3502.
- step S3504 the playback device 102 checks the value of the second flag. If the value is “0”, processing proceeds to step S3506. If the value is “1”, processing proceeds to step S3507.
- step S3506 the playback device 102 selects the 3D playlist file 222 for L / R mode as a playback target. Thereafter, the process ends.
- step S3507 the playback device 102 selects the 3D playlist file 223 for depth mode as a playback target. Thereafter, the process ends.
- the user event processing unit 3633 detects a user operation through the remote controller 105 or the front panel of the playback device 102, and requests the program execution unit 3634 or the playback control unit 3635 to perform processing according to the type of the operation. For example, when the user presses a button on the remote controller 105 to instruct the display of a pop-up menu, the user event processing unit 3633 detects the press and identifies the button. The user event processing unit 3633 further requests the program execution unit 3634 to execute a command corresponding to the button, that is, a pop-up menu display process. On the other hand, for example, when the user presses the fast forward or rewind button of the remote controller 105, the user event processing unit 3633 detects the press and identifies the button. The user event processing unit 3633 further requests the playback control unit 3635 to perform fast forward or rewind processing of the currently playing playlist.
- the program execution unit 3634 is a processor, and reads and executes a program from the movie object file and the BD-J object file stored in the dynamic scenario memory 3631.
- the program execution unit 3634 further performs the following control in accordance with each program: (1) Instruct the reproduction control unit 3635 to perform playlist reproduction processing; (2) Assign graphics data for menus or games to PNG or JPEG Is generated as raster data and transferred to the system target decoder 3622 to be synthesized with other video data.
- the specific contents of these controls can be designed relatively freely through program design. That is, those control contents are determined by the movie object file and BD-J object file programming steps in the authoring step of the BD-ROM disc 101.
- the SPRM (16) audio stream language code and the SPRM (18) subtitle stream language code indicate default language codes of the playback device 102. They can be changed by the user using an OSD (On Screen Display) of the playback apparatus 102, or can be changed to an application program through the program execution unit 3634. For example, when SPRM (16) indicates “English”, the playback control unit 3635 first searches the STN table in the PI for a stream entry including the language code “English” in the playlist playback process. Next, the playback control unit 3635 extracts the PID from the stream identification information of the stream entry and passes it to the system target decoder 3622. Thereby, the audio stream of that PID is selected and decoded by the system target decoder 3622. These processes can be executed by the playback control unit 3635 using a movie object file or a BD-J object file.
- the decoder driver 3637 is further involved in the decoding process as follows when the system target decoder 3622 decodes a picture from the 2D extent.
- the decoder driver 3637 first causes the system target decoder 3622 to analyze the header of the VAU including the picture to be decoded.
- the header includes a slice header in the sequence header 931B, picture header 931C, supplemental data 931D, and compressed picture data 931E shown in FIG.
- the decoder driver 3637 then receives the analysis result from the system target decoder 3622 and determines how to decode the picture based on it.
- the decoder driver 3637 then instructs the system target decoder 3622 how to decode. In response, system target decoder 3622 begins decoding the picture. Details of these processes will be described later.
- the source depacketizer 3810 reads the source packet from the read buffer 3621, takes out the TS packet from the read packet, and sends it to the PID filter 3840.
- the source depacketizer 3810 further adjusts the transmission time to the time indicated by the ATS of each source packet. Specifically, the source depacketizer 3810 first monitors the value of ATC generated by the ATC counter 3720. Here, the value of ATC is incremented by the ATC counter 3820 in accordance with the pulse of the clock signal of the first 27 MHz clock 3830.
- the source depacketizer 3810 then forwards the TS packet extracted from the source packet to the PID filter 3840 at the moment when the ATC value matches the ATS of the source packet.
- the average transfer rate R TS of TS packets from the source depacketizer 3810 to the PID filter 3840 does not exceed the system rate 2011 indicated by the 2D clip information file shown in FIG.
- the PID filter 3840 further detects PCR from the TS packet using the PID of each TS packet. At that time, the PID filter 3840 sets the value of the STC counter 3850 to a predetermined value. Here, the value of the STC counter 3850 is incremented according to the pulse of the clock signal of the second 27 MHz clock 3860. The value to be set in the STC counter 3850 is instructed from the reproduction control unit 3635 to the PID filter 3840 in advance. Each decoder 3870-3875 uses the value of the STC counter 3850 as the STC. That is, the timing of the decoding process for the TS packet transmitted from the PID filter 3840 is adjusted according to the time indicated by the PTS or DTS included in the TS packet.
- the DEC 3804 receives a decoding method instruction from the decoder driver 3637, the DEC 3804 starts decoding a picture from the VAU by the decoding method.
- the DEC 3804 further forwards the decoded uncompressed picture to the DPB 3805. Details of each procedure will be described later.
- the PG decoder 3872 decodes the TS packet received from the PID filter 3840 into uncompressed graphics data, and writes it into the PG plane memory 3892 at the time indicated by the PTS included in the TS packet.
- the audio mixer 3895 receives uncompressed audio data from each of the main audio decoder 3874 and the auxiliary audio decoder 3875, and performs mixing (sound superposition) using them.
- the audio mixer 3895 further sends the synthesized sound obtained by the mixing to the built-in speaker 103A of the display device 103 or the like.
- the type of coding scheme of the slice is acquired from the picture header.
- the DEC 3804 searches the sequence header using the identification number (for example, the identification number of the SPS) of the video sequence indicated by the picture header, as indicated by the one-dot chain line arrow in FIG. Thereby, the resolution, frame rate, aspect ratio, and bit rate of the slice are obtained from the sequence header. From the data thus obtained, the DEC 3804 configures information necessary for determining a picture decoding method as an analysis result of the header HI.
- Step C Send notification: The DEC 3804 sends a finish notification RES to the decoder / driver 3637 when the header analysis in Step B is completed.
- the end notification RES includes the analysis result of the header HI configured in step B.
- Step D Determination of picture decoding method:
- the decoder / driver 3637 performs preprocessing for the picture decoding process in response to the end notification RES. Specifically, the decoder / driver 3637 refers to the resolution, the frame rate, the aspect ratio, the bit rate, the type of encoding method, and the like based on the analysis result of the header HI indicated by the end notification RES. Decide how to decode pictures.
- Step E Picture decoding: The DEC 3804 performs the following processing according to the decoding start instruction COMB. First, the DEC 3804 reads compressed picture data from the VAU specified in the immediately preceding step B. Next, the DEC 3804 decodes the compressed picture data by the decoding method indicated by the decoding start instruction COMB. The DEC 3804 further stores the decoded uncompressed picture PIC in the DPB 3805. The uncompressed picture PIC is then written from the DPB 3805 to the main video plane memory 3890.
- FIG. 39 is a schematic diagram showing the flow of the decoding process of the primary video stream. Referring to (b) of FIG. 39, in the series of processes, the above five types of steps AE are repeated as follows.
- the decoder driver 3637 sends the first header analysis instruction COMA1 to the DEC 3804.
- the DEC 3804 performs the first step BB1 in response to the instruction COMA1. That is, the DEC 3804 reads out the VAU header HI indicated by the instruction COMA1 from the EB 3803 and analyzes it.
- the DEC 3804 performs the first step CC1 following the step BB1. That is, the DEC 3804 sends the first end notification RES1 to the decoder / driver 3637 to notify the analysis result of the header HI.
- the decoder / driver 3637 performs the first step DD1 in response to the notification RES1.
- the decoder / driver 3637 reads the analysis result of the header HI from the notification RES1, and determines a picture decoding method based on the result. Subsequently, the decoder / driver 3637 performs the second step AA2. That is, the decoder / driver 3637 sends the second header analysis instruction COMA2 and the first decoding start instruction COMB1 to the DEC 3804.
- the DEC 3804 starts the first step EE1 in response to the decoding start instruction COMB1. That is, the DEC 3804 decodes the picture from the VAU indicated by the first header analysis instruction COMA1 by using the decoding method indicated by the instruction COMB1.
- DEC3804 performs the second step BB2 following the first step EE1. That is, the DEC 3804 reads out from the EB 3803 and analyzes the header HI of the VAU indicated by the second header analysis instruction COMA2. The DEC 3804 performs the second step CC2 following the step BB2. That is, the DEC 3804 sends a second end notification RES2 to the decoder / driver 3637 to notify the analysis result of the header HI. The decoder / driver 3637 performs the second step DD2 in response to the notification RES2. That is, the decoder / driver 3637 reads the analysis result of the header HI from the notification RES2, and determines a picture decoding method based on the result.
- the decoder / driver 3637 performs the third step AA3. That is, the decoder / driver 3637 sends the third header analysis instruction COMA3 and the second decoding start instruction COMB2 to the DEC 3804.
- the DEC 3804 starts the second step EE2 in response to the decoding start instruction COMB2. That is, the DEC 3804 decodes the picture from the VAU indicated by the second header analysis instruction COMA2 by using the decoding method indicated by the instruction COMB2.
- the decoder driver 3637 and the DEC 3804 cooperate with each other in the same manner as described above to repeat Steps AE.
- FIG. 40 is a functional block diagram of the 3D playback device 4000.
- the 3D playback device 4000 includes a BD-ROM drive 4001, a playback unit 4002, and a control unit 4003.
- the playback unit 4002 includes a switch 4020, a first read buffer 4021, a second read buffer 4022, a system target decoder 4023, and a plane adder 4024.
- the control unit 4003 includes a dynamic scenario memory 4031, a static scenario memory 4032, a user event processing unit 4033, a program execution unit 4034, a playback control unit 4035, a player variable storage unit 4036, and a decoder / driver 4037.
- the reproduction unit 4002 and the control unit 4003 are mounted on different integrated circuits.
- both may be integrated into a single integrated circuit.
- the dynamic scenario memory 4031, the static scenario memory 4032, the user event processing unit 4033, and the program execution unit 4034 are the same as those in the 2D playback device shown in FIG. Therefore, the description about those details uses the description about said 2D reproduction
- Both the first read buffer 4021 and the second read buffer 4022 are buffer memories using memory elements in the reproduction unit 4002. In particular, different regions within a single memory device are utilized as each read buffer 4021, 4022. In addition, different memory elements may be individually used as the read buffers 4021 and 4022.
- the first read buffer 4021 receives the base view extent from the switch 4020 and stores it.
- the second read buffer 4022 receives the dependent view extent from the switch 4020 and stores it.
- the system target decoder 4023 associates the output of plane data from each plane memory of the left video and the right video with each of the BD display mode and the BB display mode as follows.
- the system target decoder 4023 alternately outputs plane data from each plane memory of the left video and the right video.
- the system target decoder 4023 keeps the operation mode in the 3D playback mode from the plane memory of either the left video or the right video. Only output plain data twice per frame.
- the system target decoder 4023 When one plane + offset mode is instructed from the reproduction control unit 4035, the system target decoder 4023 further passes the offset value designated by the reproduction control unit 4035 to the plane addition unit 4024. On the other hand, when one plane + zero offset mode is instructed from the reproduction control unit 4035, the system target decoder 4023 passes “0” as an offset value to the plane addition unit 4024.
- the player variable storage unit 4036 includes the SPRM shown in FIG. 37 as in the 2D playback device.
- any two of the SPRMs (24)-(32) which are spares in FIG. 37 include the first flag and the second flag shown in FIG. 35 individually.
- SPRM (24) includes a first flag
- SPRM (25) includes a second flag.
- the playback device 102 can support only playback of 2D video, and when it is “1”, it can also support playback of 3D video.
- SPRM (25) is “0”
- the playback device 102 is in the L / R mode, and when it is “1”, it is in the depth mode.
- the plane adder 4024 receives various types of plane data from the system target decoder 4023, and superimposes them on one another to compose one frame or field. Particularly in the L / R mode, the left video plane data represents a left-view video plane, and the right video plane data represents a right-view video plane. Accordingly, the plane adding unit 4024 superimposes the left video plane data that represents the left view and superimposes the right video plane data on the right video plane data. On the other hand, in the depth mode, the right video plane data represents a depth map for the video plane represented by the left video plane data. Accordingly, the plane adder 4024 first generates a pair of video plane data of the left view and the right view from both video plane data. Thereafter, the plane adder 4024 performs the synthesis process in the same manner as the synthesis process in the L / R mode.
- FIG. 41 is a functional block diagram of the system target decoder 4023.
- the components shown in FIG. 41 are different from those of the 2D playback device 3622 shown in FIG. 38 in the following two points: (1) The input system from the read buffer to each decoder is duplicated. (2) The main video decoder can support the 3D playback mode, and the sub-video decoder, PG decoder, and IG decoder can support the 2-plane mode. That is, any of these video decoders can alternately decode the base-view stream and the dependent-view stream.
- the main audio decoder, sub audio decoder, audio mixer, image processor, and each plane memory are the same as those of the 2D playback device shown in FIG.
- the corresponding TS packets are sub video decoder, main audio decoder, sub audio, respectively. Transferred to decoder, PG decoder, and IG decoder.
- the second PID filter 4114 Each time the second PID filter 4114 receives a TS packet from the second source / depacketizer 4112, the second PID filter 4114 compares the PID with the PID to be selected.
- the PID to be selected is designated in advance by the playback control unit 4035 according to the STN table SS in the 3D playlist file.
- the second PID filter 4114 forwards the TS packet to the decoder assigned to the PID. For example, when the PID is 0x1012 or 0x1013, the TS packet is transferred to TB (2) 4108 in the main video decoder 4115.
- the DEC 4104 performs the third step CC3 following the third step BB3. That is, the DEC 4104 sends the second base-view header analysis end notification BRES2 to the decoder / driver 4037 to notify the analysis result of the header BHI.
- the decoder / driver 4037 performs the third step DD3 in response to the notification BRES2. That is, the decoder / driver 4037 reads the analysis result of the header BHI from the notification BRES2, and determines the decoding method of the base-view picture based on the result. On the other hand, the decoder / driver 4037 performs the fourth step AA4 at the start of the step DD3.
- the decoder / driver 4037 sends the second dependent view header analysis instruction DCOMA2 and the first dependent view decoding start instruction DCOMB1 to the DEC 4104.
- the DEC 4104 starts the second step EE2 in response to the decoding start instruction DCOMB1. That is, the DEC 4104 decodes the dependent-view picture from the VAU indicated by the first dependent-view / header analysis instruction DCOMA1 using the decoding method indicated by the decoding start instruction DCOMB1. Accordingly, step EE2 by DEC 4104 proceeds in parallel with step DD3 by decoder driver 4037.
- the main video decoder 4715 shown in FIG. 47 can further improve the reliability of the decoding process as compared with the one 4115 shown in FIG.
- a playback apparatus capable of playing back video at a high frame rate can selectively play back video of only the odd-numbered frame group and video of both frame groups. In this way, it is possible to ensure compatibility with a playback apparatus that can only play back video at a normal frame rate on a recording medium that stores video at a high frame rate.
- the multiplexed stream data 5101 to be played back indicated by PI # 1 includes video gaps G1 and G2.
- the “video gap” refers to a portion where the playback time of the video stream is interrupted in the multiplexed stream data.
- a sequence end code is set in the VAU located immediately before each video gap G1, G2.
- the video decoder can detect each video gap G1, G2 from the sequence end code. As a result, the video decoder can avoid the freeze in each video gap G1, G2, that is, “the state of waiting for the next VAU to be transferred”. In this way, it is possible to prevent the problem that “the video represented by the data written in the video plane immediately before the video gaps G1 and G2 continues to be displayed”.
- the multiplexed stream data 5101 to be played back indicated by PI # 1 includes STC sequence discontinuities.
- STC sequence refers to a series of data in which PTS is continuous. Therefore, “discontinuous point of STC sequence” means a place where PTS is not continuous.
- the discontinuity occurs, for example, the case where the STC value is updated according to PCR is included.
- the PTS is discontinuous between two consecutive VAUs. In that case, a sequence termination code is set in the front one of those VAUs. The video decoder can detect the discontinuity of the STC sequence from the sequence end code.
- the setting condition of the sequence end code is the same for the main TS reproduced according to the main path in the 3D playlist file and the sub TS reproduced according to the sub path.
- the sequence termination code when the sequence termination code is set in one of the VAU in the main TS and the VAU in the sub-TS belonging to the same 3D • VAU, the sequence termination code must be set in the other.
- a condition that “only when the sequence end code is set, is placed immediately after it” may be imposed on the setting of the stream end code. Further, when the playback apparatus can detect the boundary of the video sequence from information other than the sequence end code, some or all of the above conditions may be removed depending on the detection capability. That is, whether or not a sequence end code is actually set for each VAU indicated by hatching in FIGS. 51A to 51F may be determined by the above-described detection capability of the playback apparatus.
- FIG. 52 is a schematic diagram showing a data structure of a TS packet sequence storing VAU # N in a base-view video stream in which a sequence end code is set.
- VAU # N is generally divided into a plurality of parts and stored in a plurality of TS packets 5210 and 5220 after a PES header is added to the head.
- the value of the TS priority 5211 is “1”.
- the value of the TS priority 5221 is “0”.
- the TS priority filter 5301 stores these TS packets in TB (1) 4101.
- the sequence end code and the stream end code of the VAU 5401 are stored in a TS packet 5210 whose TS priority value is “1”. Therefore, the TS priority filter 5301 discards those TS packets. Thereby, decoding of the sequence end code and the stream end code is skipped, as indicated by an X mark 5404 in FIG.
- the sequence end code and stream end code in the VAU 5401 of the base-view video stream are not transferred to the main video decoder 4115. Therefore, the end-of-sequence code is not detected by the main video decoder 4115 from the VAU 5401 of the base-view video stream before the dependent-view video stream VAU 5402 is decoded. Therefore, the risk that the position of the sequence end code is mistaken as the boundary of the video sequence is avoided, so that the last 3D VAU reproduction error due to the interruption of the decoding process can be prevented.
- the sequence end code and stream end code of the VAU of the base-view video stream are stored in TS packets whose TS priority value is “0”, and other data are: It may be stored in a TS packet whose TS priority value is “1”.
- the TS priority filter 5301 discards the TS packet whose TS priority value is “0”, and transfers the TS packet whose TS priority value is “1” to the TB (1) 4101. Thereby, it is possible to prevent the main video decoder 4115 from detecting the sequence end code in the VAU of the base-view video stream, similar to that shown in FIG.
- FIGS. Forming an interleaved arrangement.
- the interleaved arrangement is advantageous for seamless playback of both 2D video and 3D video.
- the size of each data block should satisfy the following conditions based on the performance of the playback device 102.
- FIG. 55 is a schematic diagram showing a playback processing system in the playback device 102 in 2D playback mode.
- the reproduction processing system includes a BD-ROM drive 3601, a read buffer 3621, and a system target decoder 3622 shown in FIG.
- the BD-ROM drive 3601 reads a 2D extent from the BD-ROM disc 101 and transfers it to the read buffer 3621 at a reading speed Rud-2D .
- the system target decoder 3622 reads a source packet from each 2D extent stored in the read buffer 3621 at an average transfer rate R ext2D and decodes it into video data VD and audio data AD.
- the extent ATC time is equal to the time required to transfer all the source packets in the extent from the read buffer 3621 to the system target decoder 3622.
- the size of each extent may be aligned to a certain multiple of the source packet length.
- the extent ATC time may be defined as a value obtained by adding the transfer time per source packet to the time interval from the ATS of the first source packet of one extent to the ATS of the last source packet of the same extent. Good. In that case, the calculation of the extent ATC time does not require the reference of the next extent, and thus the calculation can be simplified. In addition, in the calculation of the extent ATC time described above, it must be considered that a wrap around occurs in the ATS.
- the read rate R ud-2D is normally expressed in bits / second and is set to a value higher than the maximum value R max2D of the average transfer rate R ext2D , for example 54 Mbps: R ud ⁇ 2D > R max2D .
- FIG. 56A is a graph showing changes in the data amount DA accumulated in the read buffer 3621 during the operation in the 2D playback mode.
- FIG. 56B is a schematic diagram showing a correspondence relationship between the data block group 5610 to be played back and the playback path 5620 in the 2D playback mode.
- each base-view data block Ln is read from the BD-ROM disc 101 to the read buffer 3621 as one 2D extent EXT2D [n].
- the accumulated data amount DA is determined by the read speed R ud ⁇ 2D.
- the average transfer rate R ext2D [n] is increased at a rate equal to R ud ⁇ 2D ⁇ R ext2D [n].
- the BD-ROM drive 3601 performs the read / transfer operation intermittently instead of continuously as shown in FIG. This prevents the accumulated data amount DA from exceeding the capacity of the read buffer 3621 during the read period PR 2D [n] of each 2D extent, that is, prevents the read buffer 3621 from overflowing. Therefore, the graph of FIG. 56 (a) approximately represents a stepwise increase / decrease as a linear increase / decrease.
- each jump period PJ 2D [n] the data supply from the read buffer 3621 to the system target decoder 3622 must be continued to ensure a continuous output of the decoder 3622.
- the size S ext2D [n] of each 2D extent EXT2D [n] is read from the read period PR 2D [n] to the next jump period PJ 2D [n + 1]. It is equal to the amount of data transferred from the buffer 3621 to the system target decoder 3622.
- the accumulated data amount DA falls below the value at the end of the jump period PJ 2D [n + 1] and at the start of the read period PR 2D [n]. Absent.
- the jump time T jump ⁇ 2D [n] is the length of the jump period PJ 2D [n] and is expressed in seconds.
- both the reading speed R ud-2D and the average transfer speed R ext2D are expressed in bits / second. Therefore, in equation (1), the average transfer rate R ext2D is divided by the number “8”, and the unit of the size S ext2D [n] of the 2D extent is converted from bits to bytes. In other words, the size S ext2D [n] of the 2D extent is expressed in bytes.
- the function CEIL () means an operation of rounding up the fractional part of the numerical value in parentheses.
- the maximum value of the jump time T jump ⁇ 2D [n] is limited. That is, even if the accumulated data amount DA is just before the jump period PJ 2D [n], if the jump time T jump ⁇ 2D [n] is too long, the jump period PJ 2D [n] There is a risk that the accumulated data amount DA reaches 0 and the read buffer 3621 underflows.
- the time until the accumulated data amount DA reaches 0 from the maximum capacity of the read buffer 3621 in a state where data supply from the BD-ROM disc 101 to the read buffer 3621 is interrupted, that is, seamless reproduction can be guaranteed.
- the maximum value of the jump time T jump-2D is called “maximum jump time”.
- the maximum jump time T jump_max are 50 ms, 250 ms, 300 ms, 350 ms, 700 ms, and 1400 ms, respectively.
- Zero sector transition time T jump-0 The maximum jump time when the jump distance S jump is equal to 0 sector is particularly referred to as “zero sector transition time T jump-0 ”.
- Zero sector transition refers to the movement of the optical pickup between two consecutive data blocks. In the zero sector transition period, the optical pickup temporarily stops the reading operation and waits.
- the zero sector transition time may include an overhead associated with error correction processing in addition to the movement time of the position of the optical pickup due to the rotation of the BD-ROM disc 101.
- “Overhead associated with error correction processing” is an extra error caused by performing error correction processing using the ECC block twice when the boundary between the two data blocks does not coincide with the boundary of the ECC block. Say good time. The entire ECC block is necessary for error correction processing.
- the entire ECC block is read out and used for error correction processing in any data block read processing.
- extra data of up to 32 sectors is read in addition to the data block.
- the overhead associated with error correction processing is evaluated by the total read time of the extra data, that is, 32 [sectors] ⁇ 2048 [bytes] ⁇ 8 [bits / bytes] ⁇ 2 [times] / reading speed R ud ⁇ 2D.
- the Note that the overhead associated with error correction processing may be excluded from the zero sector transition time by configuring each data block in units of ECC blocks.
- the jump time T jump-2D [n] to be substituted into the equation (1) is the maximum jump time T jump_max defined for each jump distance by the BD-ROM disc standard.
- the jump distance S jump between the 2D extents EXT2D [n ⁇ 1] and EXT2D [n], that is, (n + 1) from the rear end of the nth 2D extent EXT2D [n].
- the maximum jump time T jump — max corresponding to the number of sectors up to the tip of the second 2D extent EXT2D [n + 1] is substituted into equation (1) as the jump time T jump ⁇ 2D [n].
- the interval between 2D extents needs to be equal to or less than the maximum jump distance S jump_max .
- FIG. 58 is a schematic diagram showing a playback processing system in the playback device 102 in 3D playback mode.
- the playback processing system includes a BD-ROM drive 4001, a switch 4020, a pair of read buffers 4021 and 4022, and a system target decoder 4023 among the elements shown in FIG. Including.
- the BD-ROM drive 4001 reads a 3D extent from the BD-ROM disc 101 and transfers it to the switch 4020 at a reading speed Rud-3D .
- the switch 4020 separates each 3D extent into a base view extent and a dependent view extent.
- the base view extent is stored in the first read buffer 4021, and the dependent view extent is stored in the second read buffer 4022.
- the accumulated data in the second read buffer 4022 is a right-view extent in the L / R mode and a depth map extent in the depth mode.
- the system target decoder 4023 reads the source packet from each base-view extent stored in the first read buffer 4021 at the first average transfer rate R ext1 .
- the system target decoder 4023 in the L / R mode reads the source packet from each right view extent stored in the second read buffer 4022 at the second average transfer rate R ext2 .
- the depth mode system target decoder 4023 reads the source packet from each depth map extent stored in the second read buffer 4022 at the third average transfer rate R ext3 .
- the system target decoder 4023 further decodes the read base view extent and dependent view extent pair into video data VD and audio data AD.
- the first average transfer rate R ext1 is referred to as “base view transfer rate”.
- the base-view transfer rate R ext1 is equal to 192/188 times the average transfer rate R TS1 of TS packets from the first source depacketizer 4111 to the first PID filter 4113 shown in FIG. Different.
- the maximum value R max1 of the base view transfer rate R ext1 is equal to 192/188 times the system rate for the file 2D.
- the system rate is defined in the 2D clip information file.
- the base view transfer rate R ext1 is normally expressed in bits / second, and specifically, is equal to a value obtained by dividing the size of the base view extent expressed in bits by the extent ATC time.
- the extent ATC time is equal to the time required to transfer all the source packets in the base-view extent from the first read buffer 4021 to the system target decoder 4023.
- the second average transfer rate R ext2 is referred to as “right-view transfer rate”, and the third average transfer rate R ext3 is referred to as “depth map transfer rate”. Both transfer rates R ext2 and R ext3 are equal to 192/188 times the average transfer rate R TS2 of TS packets from the second source depacketizer 4112 to the second PID filter 4114, and are generally different for each dependent view extent. .
- the maximum value R max2 of the right-view transfer rate R ext2 is equal to 192/188 times the system rate for the first file DEP
- the maximum value R max3 of the depth map transfer rate R ext3 is 192/188 of the system rate for the second file DEP. Equal to twice.
- Each system rate is defined in the right view clip information file and the depth map clip information file.
- the transfer rates R ext2 and R ext3 are normally expressed in bits / second, and specifically, equal to a value obtained by dividing the size of the dependent view extent expressed in bits by the extent ATC time.
- the extent ATC time is equal to the time required to transfer all source packets in each dependent view extent from the second read buffer 4022 to the system target decoder 4023.
- the read rate R ud-3D is normally expressed in bits / second and is set to a value higher than any of the maximum values R max1 -R max3 of the first to third average transfer rates R ext1 -R ext3 , for example, 72 Mbps: R ud-3D > R max1 , R ud-3D > R max2 , R ud-3D > R max3 .
- FIGS. 59A and 59B are graphs showing changes in the data amounts DA1 and DA2 stored in the read buffers 4021 and 4022, respectively, during operation in the L / R mode.
- FIG. 59C is a schematic diagram showing a correspondence relationship between a data block group 5910 to be played back and a playback path 5920 in the L / R mode.
- each pair of adjacent right-view data block Rk and base-view data block Lk is read as a single 3D extent EXTSS [k]. After that, the right-view extent and the base-view extent are separated from the 3D extent EXTSS [k] by the switch 4020 and stored in the read buffers 4021 and 4022.
- base view data block and base view extent are not distinguished, and “dependent view data block” and “dependent view extent” are not distinguished.
- (n ⁇ 1) 3D extents have already been read and the integer n is sufficiently larger than 1.
- the accumulated data amounts DA1 and DA2 of both the read buffers 4021 and 4022 are already maintained at the lower limit values UL1 and UL2, respectively.
- These lower limit values UL1 and UL2 are referred to as “buffer margin”. Details of the buffer margins UL1 and UL2 will be described later.
- the accumulated data amount DA2 of the second read buffer 4022 is read at the reading speed R ud.
- the difference between ⁇ 3D and the right-view transfer rate R ext2 [n] increases at a rate equal to R ud ⁇ 3D ⁇ R ext2 [n], and the accumulated data amount DA1 of the first read buffer 4021 is the base-view transfer rate Decrease with R ext1 [n-1].
- a zero sector transition J 0 [n] occurs between the adjacent right-view extent Rn and the base-view extent Ln. As shown in FIGS.
- the accumulated data amount DA1 of the first read buffer 4021 is equal to the base-view transfer rate R ext1 [n ⁇ 1] continues to decrease, and the accumulated data amount DA2 of the second read buffer 4022 decreases at the right-view transfer rate R ext2 [n].
- the accumulated data amount DA1 of the first read buffer 4021 is read speed R.
- the difference between ud ⁇ 3D and the base view transfer rate R ext1 [n] increases at a rate equal to R ud ⁇ 3D ⁇ R ext1 [n].
- the accumulated data amount DA2 of the second read buffer 4022 continues to decrease at the right-view transfer rate R ext2 [n].
- a jump J LR [n] occurs from the base-view extent Ln to the next right-view extent R (n + 1). As shown in FIGS.
- the accumulated data amount DA1 of the first read buffer 4021 decreases at the base view transfer rate R ext1 [n].
- the accumulated data amount DA2 of the second read buffer 4022 continues to decrease at the right-view transfer rate R ext2 [n].
- the size S ext1 [n] of the nth base-view extent Ln is at least from the read period PR L [n], the jump period PJ LR [n], and the next right-view extent R (n + 1). It is equal to the amount of data transferred from the first read buffer 4021 to the system target decoder 4023 over the read period PR R [n] and the zero sector transition period PJ 0 [n + 1]. In this case, at the end of the zero sector transition period PJ 0 [n + 1], as shown in FIG. 59A, the accumulated data amount DA1 of the first read buffer 4021 is equal to the first buffer margin amount UL1.
- the length of the read period PR L [n] of the nth base-view extent Ln is a value S ext1 obtained by dividing the size S ext1 [n] of the base-view extent Ln by the read speed R ud ⁇ 3D. [n] / R ud – equal to 3D .
- the length of the read period PR R [n + 1] of the (n + 1) th right-view extent R (n + 1) is the size S ext2 [n + 1] of the right-view extent R (n + 1) as the read speed R ud ⁇ the value S ext2 [n + 1] divided by 3D / R equals ud-3D. Therefore, the size S ext1 [n] of the base-view extent Ln only needs to satisfy the following equation (2):
- the size S ext2 [n] of the nth right-view extent Rn is at least from the read period PR R [n], the zero sector transition period PJ 0 [n], and the next base-view extent Ln. It is equal to the amount of data transferred from the second read buffer 4022 to the system target decoder 4023 over the read period PR L [n] and the jump period PJ LR [n]. In that case, at the end of the jump period PJ LR [n], the accumulated data amount DA2 of the second read buffer 4022 does not fall below the second buffer margin amount UL2, as shown in FIG. 59 (b). .
- the length of the read period PR R [n] of the nth right-view extent Rn is a value S ext2 obtained by dividing the size S ext2 [n] of the right-view extent Rn by the read speed R ud ⁇ 3D. [n] / R ud – equal to 3D . Therefore, the size S ext2 [n] of the right-view extent Rn only needs to satisfy the following expression (3):
- the jump time T jump ⁇ 3D [n] to be substituted into the equations (2) and (3) is, for example, the (n + 1) th right view from the nth base view extent Ln in the table of FIG. • Jump distance S jump to extent R (n + 1), that is, the maximum jump corresponding to the number of sectors from the rear end of the nth base view extent Ln to the front end of the (n + 1) th right view extent R (n + 1) Equal to time T jump_max .
- the jump time T jump-3D [n] is limited to the maximum jump time T jump_max
- the jump distance S jump is also limited to the maximum jump distance S jump_max or less.
- each extent satisfies the expressions (2) and (3), and in addition, the base view extent Ln and the right view extent R (n + 1) It is necessary that the distance between and be less than or equal to the maximum jump distance S jump_max .
- [Depth mode] 60A and 60B are graphs showing changes in the data amounts DA1 and DA2 stored in the read buffers 4021 and 4022, respectively, during operation in the depth mode.
- FIG. 60C is a schematic diagram showing a correspondence relationship between the data block group 6010 to be reproduced and the reproduction path 6020 in the depth mode.
- the data block group 6010 is composed of data block groups Dk, Rk, and Lk having an interleaved arrangement similar to that of 5610 shown in (c) of FIG. ing.
- the depth map data block Dk and the base view data block Dk are each read as one 3D extent. As in the case of FIG.
- the accumulated data amount DA2 of the second read buffer 4022 is read at the reading speed R ud.
- the difference between ⁇ 3D and the depth map transfer rate R ext3 [n] increases at a rate equal to R ud ⁇ 3D ⁇ R ext3 [n], and the accumulated data amount DA1 of the first read buffer 4021 is the base view transfer rate. Decrease with R ext1 [n-1].
- a jump J LD [n] occurs from the depth map extent Dn to the next base-view extent Ln. As shown in FIGS.
- the accumulated data amount DA1 of the first read buffer 4021 is equal to the base view transfer rate R ext1 [n ⁇ 1].
- the accumulated data amount DA2 of the second read buffer 4022 decreases at the depth map transfer rate R ext3 [n].
- the accumulated data amount DA1 of the first read buffer 4021 is read at the reading speed R.
- the difference between ud ⁇ 3D and the base view transfer rate R ext1 [n] increases at a rate equal to R ud ⁇ 3D ⁇ R ext1 [n].
- the accumulated data amount DA2 of the second read buffer 4022 continues to decrease at the depth map transfer rate R ext3 [n].
- a zero sector transition J 0 [n] occurs between the adjacent left-view extent Ln and the depth map extent D (n + 1). As shown in FIGS.
- the accumulated data amount DA1 of the first read buffer 4021 is equal to the base view transfer rate R ext1 [n ]
- the accumulated data amount DA2 of the second read buffer 4022 continues to decrease at the depth map transfer rate R ext3 [n].
- the size S ext1 [n] of the n-th base-view extent Ln is at least from the read period PR L [n], the zero sector transition period PJ 0 [n], and the next depth map extent D ( It is equal to the amount of data transferred from the first read buffer 4021 to the system target decoder 4023 over the read period PR D [n] of n + 1) and the jump period PJ LD [n + 1]. In that case, at the end of the jump period PJ LD [n + 1], as shown in FIG. 60A, the accumulated data amount DA1 of the first read buffer 4021 does not fall below the first buffer margin amount UL1.
- the length of the read period PR L [n] of the nth base-view extent Ln is a value S ext1 obtained by dividing the size S ext1 [n] of the base-view extent Ln by the read speed R ud ⁇ 3D. [n] / R ud – equal to 3D .
- (n + 1) -th readout period of the depth map extent D (n + 1) PR D [n + 1] of length, speed R reads the size S ext3 [n + 1] of the depth map extent D (n + 1) ud- the value S ext3 [n + 1] divided by 3D / R equals ud-3D. Therefore, the size S ext1 [n] of the base-view extent Ln only needs to satisfy the following equation (4):
- the size S ext3 [n] of the nth depth map extent Dn is at least from the read period PR D [n], the jump period PJ JD [n], and the read period PR of the next base-view extent Ln. L [n] and the amount of data transferred from the second read buffer 4022 to the system target decoder 4023 over the zero sector transition period PJ 0 [n]. In this case, at the end of the zero sector transition period PJ 0 [n], as shown in FIG. 60B, the accumulated data amount DA2 of the second read buffer 4022 is equal to the second buffer margin amount UL2.
- the length of the read period PR D [n] of the nth depth map extent Dn is the value S ext3 obtained by dividing the size S ext3 [n] of the depth map extent Dn by the read speed R ud ⁇ 3D. [n] / R ud – equal to 3D . Accordingly, the size S ext3 [n] of the depth map extent Dn only needs to satisfy the following equation (5):
- the jump time T jump-3D [n] to be substituted into the equations (4) and (5) is, for example, in the table of FIG. 57, from the nth depth map extent Dn to the nth base view extent. It is equal to the jump distance S jump to Ln, that is, the maximum jump time T jump_max corresponding to the number of sectors from the rear end of the nth depth map extent Dn to the front end of the nth base view extent Ln.
- the jump time T jump-3D [n] is limited to the maximum jump time T jump_max
- the jump distance S jump is also limited to the maximum jump distance S jump_max or less.
- the size of each extent satisfies Equations (4) and (5), and the interval between the depth map extent Dn and the base view extent Ln is It is necessary to be less than or equal to the maximum jump distance S jump_max .
- the size of each data block may be designed so as to satisfy all of the above equations (1) to (5).
- the size of the base view data block only needs to be equal to or larger than the maximum size among the right sides of the expressions (1), (3), and (5).
- minimum extent size the lower limit value of the size of the data block that satisfies all the expressions (1) to (5).
- the 3D extent EXTSS [n] of the file SS 2420 is read and divided into a base view extent EXT1 [n] and a dependent view extent EXT2 [n].
- a base view extent EXT1 [n] a dependent view extent
- EXT2 [n] a dependent view extent
- the nth base-view extent EXT1 [n] that is, the size S ext1 [n] of the base-view data block B [n] is Instead of the above formula (2), the following formula (6) is satisfied.
- equation (3) Satisfies (7).
- equations (6) and (7) are equivalent to equations (2) and (3), respectively, in which jump time T jump-3D is replaced with zero sector transition time T jump-0 :
- the size of the base-view data block B [n] only needs to satisfy both equations (1) and (6).
- the zero sector transition time T jump-0 [n] may be regarded as 0.
- equations (6) and (7) are changed to:
- the playback device 102 in the 3D playback mode may use a single read buffer instead of the two read buffers 4021 and 4022 shown in FIG.
- FIG. 61 is a schematic diagram showing a playback processing system in the playback device 102 in the 3D playback mode in that case.
- the playback processing system differs from that shown in FIG. 58, and includes a single read buffer 6101 instead of switch 4020 and a pair of read buffers 4021 and 4022.
- the BD-ROM drive 4001 reads the 3D extent from the BD-ROM disc 101 and transfers it to the read buffer 6101.
- the read buffer 6101 stores the data of the 3D extent in the order of transfer.
- the system target decoder 4023 receives information indicating the boundary of each data block included in the 3D extent from the playback control unit 4035.
- the system target decoder 4023 further uses this information to detect the boundary between data blocks from the 3D extent stored in the read buffer 6101. Thereby, the system target decoder 4023 identifies an area in the read buffer 6101 in which each of the base view extent and the dependent view extent is stored. The system target decoder 4023 further transfers the source packet from the extent stored in each area in the read buffer 6101 to different source depacketizers 4111 and 4112. Here, the transfer source / depacketizers 4111 and 4112 are selected according to the type of extent stored in the transfer source area. The system target decoder 4023 further reads the source packet from the read buffer 6101 at an average transfer rate equal to the sum of the base view transfer rate and the right view transfer rate (or depth map transfer rate).
- 62A and 62B show changes in the area of data stored in the read buffer 6101 when the interleaved data block group 6210 is read along the reproduction path 6220 in the L / R mode. It is a schematic diagram shown.
- the system target decoder 4023 keeps from the read buffer 6101. Waits without starting reading the source packet.
- the system target decoder 4023 detects the boundary between the first right-view extent EXT2 [0] and the first base-view extent EXT1 [0] from the read buffer 6101. To identify the accumulated area. The system target decoder 4023 further starts the transfer of the source packet from the read buffer 6101.
- the right-view extents EXT2 [0] stored in the read buffer 6101 are read in order from the top of the read buffer 6101.
- the first base-view extent EXT1 [0] is stored in the area next to the area where the first right-view extent EXT2 [0] is stored, and at the same time, is read sequentially from the previously stored part. Has been.
- the fourth time point PD on the playback path 6220 all the first base view extents EXT1 [0] are accumulated in the read buffer 6101.
- This area is an empty area generated by reading the first right-view extent EXT2 [0]. Therefore, the first base-view extent EXT1 [0] is divided into two parts S11 and S12 and stored in the read buffer 6101.
- the system target decoder 4023 further defines the boundary between the first base-view extent EXT1 [0] and the second right-view extent EXT2 [1] from the read buffer 6101. Detect and identify the area where each is accumulated.
- the second right-view extent EXT2 [1] is accumulated in the area next to the area where the first right-view extent EXT2 [0] is accumulated.
- the second right-view extent EXT2 [1] is read in the order of accumulation.
- the second base-view extent EXT1 [1] is accumulated in the area next to the area where the first base-view extent EXT1 [0] is accumulated. The area further reaches a free area generated by reading the second right-view extent EXT2 [1].
- the base view extent EXT1 [n] and the right view extent can be used even in a single read buffer 6101 by using the free area in the read buffer 6101.
- EXT2 [n] can be stored alternately.
- the capacity RB0 required for the read buffer 6101 can be reduced as compared with the total capacity of the pair of read buffers 4021 and 4022 shown in FIG.
- 63 (b) is a schematic diagram showing a reproduction path 6320 in the L / R mode for the data block group 6310 arranged in an interleaved manner.
- 63A shows changes in the data amount DA accumulated in the read buffers 6101, 4021, and 4022 when the reproduction processing systems in FIGS. 58 and 61 read out the data block group 6310 according to the reproduction path 6320. It is a graph to show. In FIG.
- a solid line graph GR0 indicates a change in the amount of accumulated data in the read buffer 6101
- a dashed line graph GR1 indicates a change in the amount of accumulated data in the first read buffer 4021
- a broken line graph GR2 indicates a change in the amount of data stored in the second read buffer 4022.
- the accumulated data amount of the read buffer 6101 is equal to the sum of the accumulated data amounts of the pair of read buffers 4021 and 4022.
- FIG. 64 is a schematic diagram showing such an ATS setting.
- FIG. 64 shows a rectangle 6410 representing base view extent source packets SP # 10, SP # 11, SP # 12, SP # 13, and dependent view extent source packets SP # 20, SP # 21, Rectangles 6420 representing SP # 22 and SP # 23 are arranged in the order of ATS of each source packet in the ATC time axis direction.
- the head position of each rectangle 6410, 6420 represents the ATS value of the source packet.
- the length of each of the rectangles 6410 and 6420 is such that one source packet is transferred from the read buffer 6101 to the system target decoder 4023 in the playback processing system in the 3D playback device shown in FIG.
- this time is referred to as a first time AT1.
- the time required for one source packet to be transferred from the read buffer 3621 to the system target decoder 3622 is the second time AT2. Call.
- the ATS interval between adjacent source packets is set to at least the second time AT2. For example, setting the ATS of SP # 11 before the time when the second time AT2 has elapsed from the ATS of SP # 10 is prohibited. With this setting, the system target decoder 3622 of the 2D playback device can finish transferring all SP # 10 from the read buffer 3621 during the period from the ATS of SP # 10 to the ATS of SP # 11. Therefore, the system target decoder 3622 can start transferring SP # 11 from the read buffer 3621 at the time indicated by the ATS of SP # 11.
- the period from the ATS of each source packet SP # 20, SP # 21,... Of the dependent view extent until the first time AT1 elapses is the source packet SP # 10, SP # of the base view extent. It should not overlap with the period from the ATS of 11,. That is, in FIG. 64, the ATC period corresponding to the longitudinal range of the rectangle 6420 representing each source packet SP # 20, SP # 21,... Is a rectangle representing each source packet SP # 10, SP # 11,. It should not overlap with the ATC period corresponding to the 6410 longitudinal extent. For example, setting the interval between the ATS of SP # 22 and the ATS of SP # 13 to be shorter than the first time AT1 is prohibited.
- the system target decoder 4023 of the 3D playback device can transfer SP # 22 and SP # 13 from the read buffer 6101 in different periods. In this way, it is possible to prevent two source packets assigned with the same ATS from being transferred from the read buffer 6101 to the system target decoder 4023 at the same time.
- FIG. 65 (a) is a schematic diagram showing a data block group in an interleaved arrangement including only multiplexed stream data.
- FIG. 65 (b) is a schematic diagram showing an interleaved data block group including extents belonging to other files.
- the data block group 6501 includes depth map data blocks D1, D2, and D3, right-view data blocks R1, R2, and R3, a base-view data block L1, Includes L2 and L3 alternately.
- pairs R1 + L1, R2 + L2, and R3 + L3 of adjacent right-view data blocks and base-view data blocks are sequentially read.
- a zero sector transition J 0 occurs between the right-view data block and the base-view data block.
- reading of each depth map data block D1, D2, D3 is skipped by jump JLR .
- the depth map data blocks D1, D2, and D3 and the base view data blocks L1, L2, and L3 are alternately read.
- a zero sector transition J 0 occurs between adjacent base-view data blocks and depth map data blocks. Further, reading of each right-view data block R1, R2, R3 is skipped by jump JLD .
- extents A1 and A2 belonging to different files are inserted into the data block group 6504 similar to FIG. 65 (a).
- the other file may be a movie object file, a BD-J object file, or a JAR file, for example.
- the extents A1 and A2 are both inserted between the depth map data block and the right-view data block that are adjacent in FIG.
- the playback path 6505 in the L / R mode has a longer jump JLR distance than the playback path 6502 shown in FIG.
- A2 next to one of the base-view data blocks may not change the zero sector transition J 0 to the normal jump.
- the maximum jump time generally increases more greatly when the zero sector transition is changed to a normal jump than when the jump distance is changed. Therefore, as is apparent from equations (2)-(5), the minimum extent size is generally much larger when changing zero sector transitions to normal jumps than when changing jump distances. Therefore, when the extents A1 and A2 are inserted into the interleaved data block group 6501, as shown in FIG. 65 (b), the depth map data block and the right view data Insert between blocks. Thereby, an increase in the minimum extent size accompanying the insertion can be suppressed, and an increase in the minimum capacity of the read buffer can be avoided.
- the sizes G1 and G2 of the extents A1 and A2 in units of sectors may be limited to the maximum jump distance MAX_EXTJUMP3D or less: G1 ⁇ MAX_EXTJUMP3D, G2 ⁇ MAX_EXTJUMP3D.
- the maximum jump distance MAX_EXTJUMP3D represents the maximum jump distance among the jumps J LR and J LD generated in the data block group 6504 in units of sectors.
- the maximum jump time to be assigned to the right side of the equations (2) to (5) is difficult to increase, so that the minimum extent size is difficult to increase. Therefore, an increase in the minimum capacity of the read buffer accompanying the insertion of the extents A1 and A2 can be avoided.
- each extent A1, A2 size G1, G2 and adjacent dependent-view data blocks D2, R2, D3, R3 sizes S ext3 [2], S ext2 [2], S ext3 [3 ], S ext2 [3] and the sum may be limited to the maximum jump distance MAX_EXTJUMP3D or less: CEIL (S ext3 [2] / 2048) + G1 ⁇ MAX_EXTJUMP3D, CEIL (S ext2 [2] / 2048) + G1 ⁇ MAX_EXTJUMP3D, CEIL (S ext3 [3] / 2048) + G2 ⁇ MAX_EXTJUMP3D, CEIL (S ext2 [3] / 2048) + G2 ⁇ MAX_EXTJUMP3D.
- the unit of each size is converted from bytes to sectors by dividing the size in bytes of the dependent-view data block by the number of bytes 2048 per sector.
- the maximum jump time to be assigned to the right side of the expressions (2) to (5) does not exceed a certain value.
- the maximum jump time does not exceed 350 milliseconds from the table of FIG. Therefore, the minimum extent size does not exceed a certain value. In this way, it is possible to reliably avoid an increase in the minimum capacity of the read buffer due to the insertion of the extents A1 and A2.
- each extent A1, the size of the A2 G1, G2 and dependent-view data block adjacent thereto D2, R2, D3, the size of R3 S ext3 [2], S ext2 [2] , S ext3 [3], S ext2 [3] may be limited to no more than the maximum jump distance MAX_JUMP (•) for the size of the dependent-view data block: CEIL (S ext3 [2] / 2048) + G1 ⁇ MAX_JUMP (S ext3 [2]), CEIL (S ext2 [2] / 2048) + G1 ⁇ MAX_JUMP (S ext2 [2]), CEIL (S ext3 [3] / 2048) + G2 ⁇ MAX_JUMP (S ext3 [3]), CEIL (S ext2 [3] / 2048) + G2 ⁇ MAX_JUMP (S ext2 [3]).
- the maximum jump distance MAX_JUMP (•) with respect to the size of the dependent-view data block is the number of sectors corresponding to the same maximum jump time as the number of sectors in the table of FIG.
- the maximum jump time to be assigned to the right side of the expressions (2) to (5) is not changed, so the minimum extent size is unchanged. Therefore, an increase in the minimum capacity of the read buffer accompanying the insertion of the extents A1 and A2 can be avoided more reliably.
- the lower limit values UL1 and UL2 of the accumulated data amounts DA1 and DA2 of the read buffers 4021 and 4022 shown in FIGS. Represents the buffer margin.
- the “buffer margin” refers to the lower limit value of the accumulated data amount to be maintained in each read buffer during the reading period of the data block group in the interleaved arrangement.
- the buffer margin is set to an amount that can prevent underflow of each read buffer during a long jump.
- long jump is a general term for jumps that have a long seek time, and specifically, jumps that exceed a predetermined threshold.
- the threshold value depends on the type of the optical disk and the performance related to the reading process of the disk drive. For example, in the BD-ROM standard, the threshold is defined as 40000 sectors. Long jumps specifically include focus jumps and track jumps.
- Focus jump refers to a jump that occurs when the recording layer to be read is switched when the BD-ROM disc 101 includes a plurality of recording layers. The focus jump particularly includes a process of changing the focal length of the optical pickup.
- Track jump refers to a jump including a process of moving the optical pickup in the radial direction of the BD-ROM disc 101.
- a long jump occurs when the recording layer to be read is switched during the reading of stream data or when another file reading process is interrupted.
- the other files include files other than the AV stream file shown in FIG. 2, for example, a movie object file 212, a BD-J object file 251, and a JAR file 261.
- the long jump is longer than the jump considered in the derivation of equations (2)-(5).
- the occurrence time of a long jump caused by an interruption in the reading process of another file is indefinite, and may occur even during the reading of one data block. Therefore, it is more advantageous to maintain the buffer margin amount than setting the minimum extent size by substituting the maximum jump time of the long jump into the equations (2) to (5).
- FIG. 66 is a schematic diagram showing long jumps J LY , J BDJ 1, and J BDJ 2 that occur during playback processing in the L / R mode.
- the layer boundary LB represents the boundary between two recording layers.
- a first 3D extent block 6601 is arranged in the first recording layer located before the layer boundary LB, and a second 3D extent block 6602 is arranged in the second recording layer located after the layer boundary LB.
- the “3D extent block” refers to a series of data block groups recorded in an interleaved arrangement.
- the 3D extent block may include extents of other files as shown in FIG. 65 (b).
- a BD-J object file 6603 is recorded in an area away from any 3D extent blocks 6601 and 6602.
- a long jump JLY associated with the switching of the recording layer occurs.
- the reading process of the BD-J object file 6603 is interrupted during reading of the first 3D extent block 6601, a pair of long jumps J BDJ 1 and J BDJ 2 are generated.
- the buffer margins UL1 and UL2 required for each long jump J LY and J BDJ are calculated as follows.
- the maximum jump time T jump-LY of the long jump J LY accompanying the layer switching is equal to the sum of the maximum jump time corresponding to the jump distance of the first long jump J LY and the layer switching time in the table of FIG.
- the jump distance is determined by the rear end of the last base-view data block L3 in the first 3D extent block 6601 and the front end of the first right-view data block R4 in the second 3D extent block 6602. Is equal to the number of sectors between.
- the “layer switching time” means a time required for the recording layer switching operation such as focus / jump and is, for example, 350 milliseconds.
- the base view transfer rate R ext1 does not exceed the maximum value R max1 .
- the amount of data read from the first read buffer 4021 during the long jump J LY does not exceed the product of the maximum value R max1 of the base view transfer rate and the maximum jump time T jump-LY .
- the product value is determined as the first buffer margin UL1. That is, the first buffer margin UL1 is calculated by the following equation (6):
- the product of the maximum value of the data amount read from the second read buffer 4022 during the long jump J LY that is, the maximum value R max2 of the right-view transfer rate and the maximum jump time T jump ⁇ LY is the second buffer.
- the margin is determined as UL2. That is, the second buffer margin UL2 is calculated by the following equation (9):
- the jump distance is 40000 sectors, that is, the maximum jump time T jump-LY is 700 msec and the system rate for the first file DEP is 16 Mbps, the second buffer margin UL2 is (16 Mbps ⁇ 192/188).
- X 0.7 seconds equal to about 1.36 MB.
- the reading process interrupt of the BD-J object file 6603 occurs during the reading period of the first 3D extent block 6601, the first long jump J BDJ 1 occurs.
- the jump time T BDJ is defined in advance as a constant value, for example, 900 milliseconds.
- the BD-J object file 6603 is read.
- the time required for reading is equal to 8 ⁇ S BDJ [n] / R ud-3D , which is eight times the size S BDJ of the extent belonging to the file 6603 divided by the reading speed R ud-3D (usually the extent size)
- the size S BDJ is expressed in bytes, and the reading speed R ud-3D is expressed in bits / second, so 8 times is required).
- the second long jump J BDJ 2 occurs.
- the jump time T BDJ is equal to the first jump time, eg 900 ms.
- the first buffer margin UL1 is calculated by the following equation (10):
- the second buffer margin UL2 is calculated by the following equation (11):
- the first buffer margin UL1 is set to the larger one of the values represented by the right side of the equations (8) and (10).
- the second buffer margin amount UL2 is set to the larger one of the values represented by the right sides of the equations (9) and (11).
- the capacity RB1 [n] required for the first read buffer 4021 is as shown in FIGS. Of the peaks of the graph shown in each (a), the value may be equal to or greater than the value at the end of reading of the nth base-view data block Ln. Therefore, the capacity RB1 [n] may satisfy the following equation (12) in both the L / R mode and the depth mode:
- the capacity RB2 LR [n] required for the second read buffer 4022 is the peak of the graph shown in FIG. Of these, the value may be equal to or greater than the value at the end of reading of the nth right-view data block Rn. Therefore, the capacity RB2 LR [n] should satisfy the following equation (13):
- the system target decoder 4023 does not read data from the second read buffer 4022 until the entire right-view data block to be read first is stored in the second read buffer 4022. Therefore, the capacity RB2 LR [n] of the second read buffer 4022 is different from the capacity RB1 [n] of the first read buffer 4021 and, as shown in the equation (13), “at least the nth write The condition “larger than the size S ext2 [n] of the view data block Rn” is further satisfied.
- the capacity RB2 LD [n] of the second read buffer 4022 required when reading the nth depth map data block Dn in the depth mode may satisfy the following equation (14):
- each 3D extent block 6701, 6702 is the same as that 1501 shown in FIG. Furthermore, three data blocks D2, R2, L2 located at the rear end of the first 3D extent block 6701, and three data blocks D3, R3, located at the front end of the second 3D extent block 6702, The contents of each stream data are continuous with L3.
- the size of each data block R2, L2 is the value Smin2, Smin1 that can maintain the buffer margin until immediately before the long jump J LY. Good. That is, these values Smin2 and Smin1 are values obtained by subtracting the layer switching time from the maximum jump time T jump_max of the long jump J LY as the jump time T jump-3D [n] on the right side of the equations (3) and (2). May be calculated by substituting. As a result, the sizes Smin2 and Smin1 of the data blocks R2 and L2 are equal to the minimum extent size when it is assumed that “two 3D extent blocks 6701 and 6702 are continuously arranged”.
- Arrangement 1 68A is a schematic diagram showing a first example of the physical arrangement of data block groups recorded before and after the layer boundary LB of the BD-ROM disc 101.
- this arrangement is referred to as “arrangement 1”.
- the first 3D extent block 6801 is recorded before the layer boundary LB
- the second 3D extent block 6802 is recorded after the layer boundary LB.
- the respective 3D extent blocks 6801 and 6802 are the same as those 6701 and 6702 shown in FIG.
- one base-view data block L3 2D is further arranged between the rear end L2 of the first 3D extent block 6801 and the layer boundary LB.
- cross-linking of AV stream files is realized as follows.
- R3 + L1, R2 + L2, R3 + L3 SS , R4 + L4 SS , R5 + L5 pairs of adjacent right-view data block and base-view data block in each 3D extent block 7001, 7002 are each a single file of the first file SS244A.
- the 3D extents EXTSS [0], EXTSS [1], EXTSS [2], EXTSS [3], and EXTSS [4] can be accessed.
- the 3D extents EXTSS [0], EXTSS [1], and EXTSS [4] are the base view data, respectively.
- the blocks L1, L2, and L5 are shared with the 2D extents EXT2D [0], EXT2D [1], and EXT2D [2].
- the block exclusively for 2D playback (L3 + L4) 2D can be accessed as part of the 2D extent EXT2D [1].
- the 3D playback dedicated blocks L3 SS and L4 SS are accessible as part of the 3D extents EXTSS [2] and EXTSS [3].
- the 2D playback dedicated block (L3 + L4) 2D is read, but the reading of the 3D playback dedicated blocks L3 SS and L4 SS is skipped.
- the 2D playback block (L3 + L4) 2D is skipped, but the 3D playback blocks L3 SS and L4 SS are read out.
- the 2D playback-dedicated block (L3 + L4) 2D and the entire 3D playback-dedicated block L3 SS + L4 SS match in bit units, so that the left-view video frame to be played back is the same in any playback mode.
- the size S ext2D [1] S ext1 [1] + S 2D of the 2D extent EXT2D [1] is kept constant,
- the size S ext1 [1] of the base-view data block L2 can be further reduced.
- the size S ext2 [1] of the right-view data block R2 can also be limited to be smaller.
- the seamless playback of the video during the long jump is performed in the 2D playback mode and the L / R mode while the capacity of the read buffer to be secured in the playback device 102 is minimized.
- the size of each data block can be designed to be feasible with both. The same applies to the depth mode.
- 2D playback-dedicated block (L3 + L4) 2D copy data is divided into two 3D playback-dedicated blocks L3 SS and L4 SS .
- the duplicated data may be divided into three or more 3D playback dedicated blocks.
- FIG. 71 (a) is a schematic diagram showing a third example of the physical arrangement of data block groups recorded before and after the layer boundary LB of the BD-ROM disc 101.
- this arrangement is referred to as “arrangement 3”.
- 71 (a) is compared with FIG. 70 (a).
- Arrangement 3 is different from Arrangement 2 in that 2D playback-only block (L2 + L3) 2D can be accessed as a single 2D extent EXT2D [1]. It is different.
- 2D playback-only block (L2 + L3) 2D matches the entire LD SS + L3 SS of the 3D playback-only block located immediately after the layer boundary LB in bit units.
- the arrangement 3 is the same as the arrangement 2, and therefore the description of the arrangement 2 is used for the detailed description thereof.
- FIG. 71 (b) shows a playback path 7110 in 2D playback mode, playback path 7120 in L / R mode, and playback in depth mode for the data block group shown in FIG. 71 (a).
- 7 is a schematic diagram showing a path 7130.
- the playback device 102 in the 2D playback mode plays back the file 2D241. Therefore, as indicated by the playback path 7110 in the 2D playback mode, first, the last base-view data block L1 in the first 3D extent block 7101 is read as the first 2D extent EXT2D [0]. Next, the 2D playback-dedicated block (L2 + L3) 2D immediately after that is continuously read out as the second 2D extent EXT2D [1]. At the layer boundary LB immediately after that, a long jump JLY occurs, and the eight data blocks D2, R2, L2 SS , D3, R3, L3 SS , D4, R4 located at the tip of the second 3D extent block 7102 Reading is skipped. Subsequently, the third base-view data block L4 in the second 3D extent block 7102 is read as the third 2D extent EXT2D [2].
- the playback device 102 in the L / R mode plays back the first file SS 244A. Accordingly, as indicated by the playback path 7102 in the L / R mode, first, the pair R1 + L1 of the first right-view data block R1 and the immediately following base-view data block L1 is defined as the first 3D extent EXTSS [0]. Read continuously. Immediately thereafter, a long jump JLY occurs, and reading of the 2D playback-dedicated block (L2 + L3) 2D and the first depth map data block D3 in the second 3D extent block 7102 is skipped.
- the first right-view data block R2 in the second 3D extent block 7102 and the 3D playback-only block L2 SS immediately after it are successively read out as the second 3D extent EXTSS [1].
- the reading of the depth map data block D3 immediately after that is skipped by the first jump JLR1 .
- the next right-view data block R3 and the 3D playback-dedicated block L3 SS immediately after it are successively read out as the third 3D extent EXTSS [2], and the depth map data block immediately after that is read out.
- Reading D4 is skipped by the second jump JLR2 .
- the next right-view data block R4 and the immediately subsequent base-view data block L4 are successively read out as the fourth 3D extent EXTSS [3].
- the playback path 7120 in the playback path 7110 and the L / R mode in the 2D playback mode are separated before and after the arrangement 3 in the long jump J LY. Therefore, the size S ext2D [1] of the 2D extent EXT2D [1] located immediately before the layer boundary LB and the size S ext2 [1] of the right-view data block R2 immediately before it are separately as follows: Can be determined. The same applies to the depth mode.
- the sum of the sizes of the 2D extents EXT2D [0] and EXT2D [1] S ext2D [0] + S ext2D [1] is the size S ext1 [0] of the base-view data block L1 and the 2D playback-only block (L2 + L3) 2D It is equal to the sum S ext1 [0] + S ext2D [1] with the size S ext2D [1]. Therefore, in order to realize seamless playback in the 2D playback mode, first, the sum S ext1 [0] + S ext2D [1] only needs to satisfy Expression (1).
- 2D reproduction-dedicated block (L2 + L3) 2D copy data is divided into two 3D reproduction-dedicated blocks L2 SS and L3 SS .
- the replicated data may be provided as a single 3D playback dedicated block, or may be divided into three or more 3D playback dedicated blocks.
- the 2D playback-dedicated block may be accessible as two or more extents of the file 2D.
- the adjacent base-view data block L1 and 2D playback-only block (L2 + L3) 2D may belong to different files 2D.
- Each data block shown in (a) of FIG. 72 is accessible as an extent of either file 2D or file DEP, except for 3D playback dedicated blocks L3 SS and L4 SS .
- the 2D pair and the first base-view data block L5 in the second 3D extent block 7202 are each a single 2D extent EXT2D [0], EXT2D [1], EXT2D [ 2] is accessible.
- the 3D extents EXTSS [0], EXTSS [1], and EXTSS [4] are the base view data except for the two 3D extents EXTSS [2] and EXTSS [3] that are arranged immediately before the layer boundary LB.
- the blocks L1, L2, and L5 are shared with the 2D extents EXT2D [0], EXT2D [1], and EXT2D [2].
- the block exclusively for 2D playback (L3 + L4) 2D can be accessed as part of the 2D extent EXT2D [1].
- the 3D playback dedicated blocks L3 SS and L4 SS are accessible as part of the 3D extents EXTSS [2] and EXTSS [3].
- FIG. 72 (b) shows a playback path 7210 in 2D playback mode, playback path 7220 in L / R mode, and playback in depth mode for the data block group shown in FIG. 72 (a).
- 6 is a schematic diagram showing a path 7230.
- the playback device 102 in the 2D playback mode plays back the file 2D241. Therefore, as indicated by the playback path 7210 in the 2D playback mode, the second base-view data block L1 from the last in the first 3D extent block 7201 is read as the first 2D extent EXT2D [0]. The reading of the depth map data block D2 and the right-view data block R2 immediately after that is skipped by the first jump J 2D 1. Next, the pair L2 + (L3 + L4) 2D of the last base-view data block L2 in the first 3D extent block 7201 and the immediately subsequent 2D playback-only block (L3 + L4) 2D is the second 2D extent EXT2D [ [1] is read continuously.
- the playback device 102 in the L / R mode plays back the first file SS 244A. Accordingly, as indicated by the playback path 7220 in the L / R mode, first, the pair R1 + L1 of the first right-view data block R1 and the immediately following base-view data block L1 is defined as the first 3D extent EXTSS [0]. Reading is continuously performed, and reading of the depth map data block D2 immediately after that is skipped by the first jump JLR1 . Next, the second right-view data block R2 and the base view data block L2 immediately after the second right-view data block R2 are successively read out as the second 3D extent EXTSS [1].
- the 2D playback dedicated block (L3 + L4) 2D is read, but the reading of the 3D playback dedicated blocks L3 SS and L4 SS is skipped.
- the 2D playback block (L3 + L4) 2D is skipped, but the 3D playback blocks L3 SS and L4 SS are read out.
- the 2D playback-dedicated block (L3 + L4) 2D and the entire 3D playback-dedicated block L3 SS + L4 SS match in bit units, so that the left-view video frame to be played back is the same in any playback mode.
- each size S of the right-view data block R2 and the base-view data block L2 located immediately before the 2D playback dedicated block (L3 + L4) 2D ext2 [1] and S ext1 [1] need only satisfy the expressions (3) and (2).
- the maximum jump time T jump_max to be substituted as the jump time T jump-3D on the right side of them is the 2D playback-only block (L3 + L4) 2D from the jump distance of the second jump J EX in the table of FIG. It is only necessary to correspond to the number of sectors excluding the size of.
- each data block R2, L2 is assumed to be “2D playback dedicated block (L3 + L4) 2D is removed immediately after them, and depth map data block D3 immediately after that is continuous” Is substantially equal to the minimum extent size of Next, 2D playback-dedicated blocks (L3 + L4)
- the sizes of the right-view data block R3 and the 3D playback-dedicated block L3 SS located immediately after 2D need only satisfy Expressions (3) and (2).
- the maximum jump time T jump_max of the third jump J LR 3 may be substituted for the right side thereof as the jump time T jump-3D .
- the size S ext2D [1] S ext1 [1] + S 2D of the 2D extent EXT2D [1] is kept constant,
- the size S ext1 [1] of the base-view data block L2 can be further reduced.
- the size S ext2 [1] of the right-view data block R2 can also be limited to be smaller.
- the seamless playback of the video during the long jump JLY is performed in the 2D playback mode and the L / R while keeping the capacity of the read buffer to be secured in the playback device 102 to the minimum necessary.
- the size of each data block can be designed so that it can be implemented in both modes. The same applies to the depth mode.
- 73A is accumulated in the first read buffer 4021 during the data block read period according to the reproduction path 7220 in the L / R mode shown in FIG. 72B. It is a graph which shows the change of data amount DA1.
- the last base-view data block L2 in the first 3D extent block 7201 starts to be read.
- the first base-view data block L5 in the second 3D extent block 7202 starts to be read.
- the maximum value DR1 of the data amount that can be read from the first read buffer 4021 from the first time TA to the second time TB is given by the following equation (15):
- jump times T jump-EX , T jump [2], and T jump-LY represent the jump times of the second jump J LR 2, the third jump J LR 3, and the long jump J LY , respectively.
- the right-view extent sizes S ext2 [2] and S ext2 [4] are the 2D playback-only block (L3 + L4), the right-view data block R3 located immediately after 2D , and the second 3D extent Each size with the first right-view data block R5 in the block 7202 is represented. Note that the sizes of the data blocks D4, R4, and L4 SS located immediately before the layer boundary LB are regarded as 0 for the purpose of obtaining the maximum value that can be assumed as the necessary buffer margin.
- the minimum value DI1 of the data amount that can be accumulated in the first read buffer 4021 from the first time TA to the second time TB is given by the following equation (16):
- the base view extent sizes S ext1 [1] and S ext1 [2] are respectively the last base view data block L2 in the first 3D extent block 7201 and the 2D playback-only block (L3 + L4). ) Each size with the 3D playback-dedicated block L3 SS located immediately after 2D .
- the buffer margin amount UL1 is at least equal to the maximum read amount DR1 of the data amount that can be read from the first read buffer 4021 from the first time TA to the second time TB, and the first read ⁇ Any difference from the minimum value DI1 of the data amount that can be stored in the buffer 4021 may be used. That is, the buffer margin amount UL1 is expressed by the following equation (17):
- 73B is accumulated in the second read buffer 4022 during the data block read period according to the reproduction path 7220 in the L / R mode shown in FIG. 72B. It is a graph which shows the change of data amount DA2.
- the last right-view data block R2 in the first 3D extent block 7201 starts to be read.
- the first right-view data block R5 in the second 3D extent block 7202 starts to be read.
- the buffer margin UL2 is stored at least in the second read buffer 4022 during the same period as the maximum amount of data that can be read from the second read buffer 4022 from the third time TC to the fourth time TD. It is sufficient that the difference is between the minimum value of the data amount that can be performed. Accordingly, since each size of the right-view data blocks R2 and R3 satisfies the expression (3), the buffer margin UL2 may be a value satisfying at least the following expression (19):
- the buffer margins UL1 and UL2 of the read buffers 4021 and 4022 may be values satisfying at least the following expressions (20) and (21):
- the jump times T jump-EX and T jump are the 2D playback-only block (L3 + L4), the jump J EX for skipping 2D reading, and the right-view data block R4 located immediately before the layer boundary LB, respectively.
- Each jump time of jump J LD 3 for skipping reading is represented.
- FIG. 74 defines the third 3D extent block 7401, the file 2D # 27410 and the file SS # 27420 that share the base-view data block therein, and the playback paths of the files 241, 244A, 7410, and 7420.
- FIG. 3 is a schematic diagram showing playlist files 221, 222, 7430, and 7440 to be played.
- the first base-view data block Lx in the third 3D extent block 7401 is a 2D playback-only block (L3 + L4). From the rear end of 2D , the long jump J LY specified according to the capability of the 2D playback device It is recorded at a distance less than or equal to the maximum jump distance S jump_max . Further, the tip of the third 3D extent block 7401 is a distance that is less than or equal to the maximum jump distance S jump_max of the long jump J LY defined in accordance with the capability of the 3D playback device from the rear end of the first 3D extent block 7201. Is recorded.
- the sizes of the two types of dependent-view data blocks Dx and Rx located at the beginning of the third 3D extent block 7401 are 2D playback-dedicated blocks (L3 + L4) 2D in equations (4) and (2), respectively. It is set so as not to contradict the size of the 3D playback-only block L3 SS located immediately after.
- FIG. 75A is a schematic diagram showing a fifth example of the physical arrangement of data block groups recorded before and after the layer boundary LB of the BD-ROM disc 101.
- this arrangement is referred to as “arrangement 5”.
- 75 (a) is compared with FIG. 71 (a).
- Arrangement 5 is different from Arrangement 3 in that data blocks in an interleaved arrangement including 3D playback-only blocks L2 SS , L3 SS , and L4 SS are played back in 2D.
- 3D playback dedicated blocks L2 SS , L3 SS , and L4 SS are provided as depth map data blocks D2, D3, D4, and a right-view data block. Along with D2, R3, and R4, they are recorded in an interleaved arrangement. These data blocks are data blocks D2, R2, and L2 located at the rear end of the first 3D extent block 7501 and data blocks D5 and R5 located at the front end of the second 3D extent block 7502. , The content of each stream data is continuous in L5. Between the 3D playback block L4 SS and the layer boundary LB, a 2D playback block (L2 + L3 + L4) 2D is arranged. The 3D playback dedicated blocks L2 SS , L3 SS , and L4 SS match the 3D playback dedicated blocks L2 SS , L3 SS , and L4 SS on a bit-by-bit basis.
- 3D extents EXTSS [1], EXTSS [2], and EXTSS [3] that include the 3D playback dedicated blocks L2 SS , L3 SS , and L4 SS
- the 3D extents EXTSS [0] and EXTSS [4] are respectively
- the base-view data blocks L1 and L5 are shared with the 2D extents EXT2D [0] and EXT2D [2].
- the block exclusively for 2D playback (L2 + L3 + L4) 2D can be accessed as a single 2D extent EXT2D [1].
- 3D playback-only block L2 SS, L3 SS, L4 SS is 3D extent EXTSS [1], EXTSS [2 ], is accessible as part of EXTSS [3].
- FIG. 75 (b) shows a playback path 7510 in 2D playback mode, playback path 7520 in L / R mode, and playback in depth mode for the data block group shown in FIG. 75 (a).
- 7 is a schematic diagram showing a path 7530.
- the playback device 102 in the 2D playback mode plays back the file 2D241. Therefore, as shown by the playback path 7510 in the 2D playback mode, first, the last base-view data block L1 in the first 3D extent block 7501 is read as the first 2D extent EXT2D [0], and immediately thereafter. Eight data blocks D2, R2, L2 SS, D3 , R3, L3 SS, D4, R4, L4 SS of reading is skipped by jumping J 2D 1. Next, the 2D playback-only block (L2 + L3 + L4) 2D immediately before the layer boundary LB is continuously read as the second 2D extent EXT2D [1].
- the playback device 102 in the L / R mode plays back the first file SS 244A. Therefore, as indicated by the playback path 7520 in the L / R mode, first, the pair R1 + L1 of the first right-view data block R1 and the immediately following base-view data block L1 is the first 3D extent EXTSS [0]. Reading is continuously performed, and reading of the depth map data block D2 immediately after that is skipped by the first jump JLR1 . Next, the second right-view data block R2 and the 3D playback dedicated block L2 SS immediately after the second right-view data block R2 are successively read out as the second 3D extent EXTSS [1], and the depth map data Reading block D3 is skipped by the second jump J JR 2.
- 2D playback dedicated blocks (L2 + L3 + L4) 2D are read, but reading of the 3D playback dedicated blocks L2 SS , L3 SS and L4 SS is skipped.
- 2D playback dedicated blocks (L2 + L3 + L4) 2D reading is skipped, but 3D playback dedicated blocks L2 SS , L3 SS and L4 SS are read out.
- 2D playback-only block (L2 + L3 + L4) 2D and 3D playback-only block L2 SS + L3 SS + L4 SS match in bit units, so the left-view video frame played back in any playback mode is equal.
- the playback path 7520 in the playback path 7510 and the L / R mode in the 2D playback mode in the previous arrangement 5 in long jump J LY are separated. Therefore, the 2D playback-only block (L2 + L3 + L4) 2D size, that is, the size S ext2D [1] of the 2D extent EXT2D [1], and the size of the last right-view data block R1 in the first 3D extent block 7501 S ext2 [0] can be determined separately as follows. The same applies to the depth mode.
- Block dedicated for 2D playback (L2 + L3 + L4) 2D and the last base-view data block L1 in the first 3D extent block 7501 belong to different 2D extents EXT2D [0] and EXT2D [1]. Therefore, in order to realize seamless playback in the 2D playback mode, first, the 2D playback-dedicated block (L2 + L3 + L4) 2D size S ext2D [1] only needs to satisfy Expression (1).
- the maximum jump time T jump_max of the jump J 2D 1 may be substituted for the right side as the jump time T jump ⁇ 2D .
- each size S ext2 of the last right-view data block R1 and the base-view data block L1 in the first 3D extent block 7501 is used. [0] and S ext1 [0] need only satisfy the expressions (3) and (2).
- the maximum jump time T jump_max of the first jump J JR 1 may be substituted for the right side thereof as the jump time T jump-3D .
- the sizes of the data blocks R2, L2 SS , R3, and L3 SS located immediately after the first 3D extent block 7501 need only satisfy the expressions (3) and (2).
- the size of the next right-view extent S ext2 [n + 1] on the right side of the equation (2) is immediately after the 3D playback-dedicated block L3 SS .
- the size of each data block R3, L3 SS is substantially equal to the minimum extent size when it is assumed that “the second 3D extent block 7502 is continuous immediately after them”.
- the sizes of the data blocks D4, R4, and L4 SS located immediately before the layer boundary LB may not satisfy the expressions (2) to (5).
- the maximum jump distance S jump_max of the long jump J LY in which the number of sectors from the rear end of the 3D playback dedicated block L4 SS to the front end of the next 3D extent EXTSS [4] is defined in accordance with the capability of the 3D playback device. The following is sufficient.
- the size of the last base-view data block L1 in the first 3D extent block 7501 can be designed independently of the size of the 2D playback-dedicated block (L2 + L3 + L4) 2D . Accordingly, the size S ext1 [0] of the base-view data block L1 can be further reduced while the 2D playback-dedicated block (L2 + L3 + L4) 2D size S ext2D [1] is maintained constant. Along with this, the size S ext2 [0] of the right-view data block R1 can be limited to a smaller value.
- the entire L2 SS + L3 SS + L4 SS of 3D playback-only block is consistent with 2D playback-only block (L3 + L4) 2D is bit-for-bit, 2D reproduction dedicated block (L2 + L3 + L4) Expansion of 2D size, each 3D
- the size of the right-view data block R2, R3, R4 located immediately before the reproduction-only blocks L2 SS , L3 SS , L4 SS is enlarged.
- the 3D playback-only blocks for one 2D playback-only block (L2 + L3 + L4) 2D is divided into three L2 SS, L3 SS, L4 SS , each size is shown in (a) of FIG. 67 It can be made sufficiently smaller than the size of the right-view data block R3 located immediately before the existing layer boundary LB.
- the seamless playback of the video during the long jump J LY is performed in the 2D playback mode and the L / R while keeping the capacity of the read buffer to be secured in the playback device 102 to the minimum necessary.
- the size of each data block can be designed so that it can be implemented in both modes. The same applies to the depth mode.
- 76A is accumulated in the first read buffer 4021 during the data block read period according to the reproduction path 7520 in the L / R mode shown in FIG. 75B. It is a graph which shows the change of data amount DA1.
- the second 3D playback-dedicated block L3 SS starts to be read.
- the first base-view data block L5 in the second 3D extent block 7502 starts to be read.
- the maximum data amount DR1 that can be read from the first read buffer 4021 from the first time TE to the second time TF is given by the following equation (22):
- jump times T jump and T jump-LY represent the jump times of the third jump J LR 3 and the long jump J LY , respectively.
- the right-view extent size S ext2 [4] represents the size of the first right-view data block R5 in the second 3D extent block 7502. Note that the sizes of the data blocks D4, R4, and L4 SS located immediately before the layer boundary LB are regarded as 0 for the purpose of obtaining the maximum value that can be assumed as the necessary buffer margin.
- the minimum value DI1 of the data amount that can be accumulated in the first read buffer 4021 from the first time TE to the second time TF is given by the following equation (23):
- the size S ext1 [2] of the base view extent represents the size of the second 3D playback-dedicated block L3 SS .
- the buffer margin amount UL1 is at least equal to the maximum read amount DR1 of the data amount that can be read from the first read buffer 4021 from the first time TE to the second time TF, and the first read ⁇ Any difference from the minimum value DI1 of the data amount that can be stored in the buffer 4021 may be used. That is, the buffer margin amount UL1 is expressed by the following equation (24):
- the buffer margin amount UL1 may be a value satisfying at least the following expression (25):
- FIG. 76B is stored in the second read buffer 4022 during the data block read period according to the reproduction path 7520 in the L / R mode shown in FIG. 75B. It is a graph which shows the change of data amount DA2.
- the right-view data block R3 located immediately before the second 3D playback-dedicated block L3 SS starts to be read.
- the first right-view data block R5 in the second 3D extent block 7502 starts to be read.
- the buffer margin UL2 is stored at least in the second read buffer 4022 during the same period as the maximum amount of data that can be read from the second read buffer 4022 from the third time TG to the fourth time TH. It is sufficient that the difference is between the minimum value of the data amount that can be performed. Accordingly, since the size of the right-view data block R3 satisfies the equation (3), the buffer margin amount UL2 may be a value satisfying at least the following equation (26):
- the buffer margins UL1 and UL2 of the read buffers 4021 and 4022 may be values satisfying at least the following expressions (27) and (28):
- the jump time T jump represents the jump time of the jump J LD 3 for skipping reading of the right-view data block R4 located immediately before the layer boundary LB.
- 2D playback-dedicated blocks (L2 + L3 + L4) 2D copy data is divided into three 3D playback-dedicated blocks L2 SS , L3 SS , and L4 SS .
- the duplicate data may be provided as one or two 3D playback dedicated blocks, or may be divided into four or more 3D playback dedicated blocks.
- the 2D playback-dedicated block may be accessible as two or more extents of the file 2D.
- the base view data block may belong to a different file 2D between the two 3D extent blocks 7501 and 7502.
- the two 3D extent blocks 7501 and 7502 belong to different files SS.
- Arrangement 6 77 (a) is a schematic diagram showing a sixth example of the physical arrangement of data block groups recorded before and after the layer boundary LB of the BD-ROM disc 101.
- FIG. Hereinafter, this arrangement is referred to as “arrangement 6”.
- 77 (a) is compared with FIG. 72 (a).
- Arrangement 6 is different from Arrangement 4 in the right-view data block and the depth map located immediately before each of the 3D playback dedicated blocks L3 SS and L4 SS. -The difference is that the order of the R3 + D3 and R4 + D4 pairs with the data block is reversed. Since the arrangement 6 is the same as the arrangement 4 with respect to other features, the description of the arrangement 4 is used for the detailed description thereof.
- each R1 + L1, R2 + D2, R5 + L5 pair of adjacent right-view data block and base-view data block in each 3D extent block 7501 and 7502 is a single 3D extent EXTSS [0] of the first file SS244A. , EXTSS [1], EXTSS [6].
- the 3D extents EXTSS [0], EXTSS [1], and EXTSS [6] respectively convert the base view data blocks L1, L2, and L5 into the 2D extents EXT2D [0], EXT2D [1], and EXT2D [2]. Share with.
- the right-view data blocks R3, R4 and the 3D playback-only blocks L3 SS , L4 SS in the interleaved arrangement immediately before the layer boundary LB are respectively a single 3D extent EXTSS [2] of the first file SS 244A, Accessible as EXTSS [3], EXTSS [4], EXTSS [5].
- the 2D playback dedicated block (L3 + L4) 2D can be accessed as a single 2D extent EXT2D [1].
- FIG. 77 (b) shows a playback path 7710 in 2D playback mode, playback path 7720 in L / R mode, and playback in depth mode for the data block group shown in FIG. 77 (a).
- 7 is a schematic diagram showing a path 7730.
- the playback device 102 in the 2D playback mode plays back the file 2D241. Accordingly, as indicated by the playback path 7710 in the 2D playback mode, the second base-view data block L1 from the last in the first 3D extent block 7701 is first read as the first 2D extent EXT2D [0]. The reading of the depth map data block D2 and the right-view data block R2 immediately after that is skipped by the first jump J 2D 1. Next, the pair L2 + (L3 + L4) 2D of the last base-view data block L2 in the first 3D extent block 7701 and the immediately following 2D playback-only block (L3 + L4) 2D is the second 2D extent EXT2D [ [1] is read continuously.
- the playback device 102 in the L / R mode plays back the first file SS 244A. Therefore, as indicated by the playback path 7720 in the L / R mode, the pair R1 + L1 of the first right-view data block R1 and the immediately subsequent base-view data block L1 is the first 3D extent EXTSS [0]. Reading is continuously performed, and reading of the depth map data block D2 immediately after that is skipped by the first jump JLR1 . Next, the second right-view data block R2 and the base view data block L2 immediately after the second right-view data block R2 are successively read out as the second 3D extent EXTSS [1]. (L3 + L4) 2D reading is skipped by the second jump JEX .
- right-view data block R3 are read as the third 3D extent EXTSS [2], reading of the immediately following depth map data block D3 is skipped by the third jump J LR 3. Further, the 3D playback-dedicated block L3 SS immediately after that is read as the fourth 3D extent EXTSS [3], and the next right-view data block R4 is read as the fifth 3D extent EXTSS [4]. The reading of the depth map data block D4 immediately after that is skipped by the fourth jump JLR4 . The 3D playback dedicated block L4 SS immediately after that is read as the sixth 3D extent EXTSS [5].
- each size S of the right-view data block R2 and the base-view data block L2 located immediately before the 2D playback dedicated block (L3 + L4) 2D ext2 [1] and S ext1 [1] need only satisfy the expressions (3) and (2).
- the zero sector transition time T jump-0 may be substituted for the right side of them as the jump time T jump-3D .
- each data block R2, L2 is assumed to be “2D playback-only block (L3 + L4) 2D is removed immediately after them and right-view data block R3 immediately after that is continuous” Is substantially equal to the minimum extent size of Next, 2D playback-only block (L3 + L4)
- the size of the right-view data block R3 and the 3D playback-only block L3 SS located immediately after 2D is expressed by the depth map data in equations (5) and (4). What is necessary is just to fill the block replaced with the right-view data block.
- the size of the next right-view extent S ext2 [n + 1] is not the size of the right-view data block R4, but the first light in the second 3D extent block 7702.
- the size of the view data block R5 is substituted. That is, the size of each data block R3, L3 SS is substantially equal to the minimum extent size when it is assumed that “the second 3D extent block 7702 is continuous immediately after them”. Accordingly, the sizes of the data blocks R4, D4, and L4 SS located immediately before the layer boundary LB may not satisfy the equations (2) to (5).
- the maximum jump distance S jump_max of the long jump J LY in which the number of sectors from the rear end of the 3D playback dedicated block L4 SS to the front end of the next 3D extent EXTSS [4] is defined in accordance with the capability of the 3D playback device. The following is sufficient.
- the size S ext2D [1] S ext1 [1] + S 2D of the 2D extent EXT2D [1] is kept constant,
- the size S ext1 [1] of the base-view data block L2 can be further reduced.
- the size S ext2 [1] of the right-view data block R2 can also be limited to be smaller.
- the 2D playback dedicated block (L3 + L4) 2D size S 2D enlargement is 3D each.
- the size of the right-view data blocks R3 and R4 located immediately before the reproduction-only blocks L3 SS and L4 SS is enlarged.
- each size is the layer shown in FIG. 67 (a). It can be made sufficiently smaller than the size of the right-view data block R3 located immediately before the boundary LB.
- the seamless playback of the video during the long jump J LY is performed in the 2D playback mode and the L / R while keeping the capacity of the read buffer to be secured in the playback device 102 to the minimum necessary.
- the size of each data block can be designed so that it can be implemented in both modes. The same applies to the depth mode.
- FIG. 78 (a) is accumulated in the first read buffer 4021 during the data block read period according to the reproduction path 7720 in the L / R mode shown in FIG. 77 (b). It is a graph which shows the change of data amount DA1.
- the last base-view data block L2 in the first 3D extent block 7701 starts to be read.
- the first base-view data block L5 in the second 3D extent block 7702 starts to be read.
- the maximum data amount DR1 that can be read from the first read buffer 4021 from the first time TI to the second time TJ is given by the following equation (29):
- the minimum value DI1 of the data amount that can be accumulated in the first read buffer 4021 from the first time TI to the second time TJ is given by the following equation (30):
- the base view extent sizes S ext1 [1] and S ext1 [2] are respectively the last base view data block L2 in the first 3D extent block 7701 and the 2D playback-only block (L3 + L4). ) Represents each size with the 3D playback dedicated block L3 SS located immediately after 2D .
- the buffer margin amount UL1 is at least equal to the maximum read amount DR1 of the data amount that can be read from the first read buffer 4021 from the first time TI to the second time TJ in the same period. Any difference from the minimum value DI1 of the data amount that can be stored in the buffer 4021 may be used. That is, the buffer margin amount UL1 is expressed by the following equation (31):
- the depth map data block is replaced with the right view data block in Expression (4). Therefore, both the second term and the third term of the formula (31) are 0 or less. Therefore, the buffer margin UL1 may be at least a value satisfying the following expression (32):
- FIG. 78B is accumulated in the second read buffer 4022 during the data block read period according to the reproduction path 7720 in the L / R mode shown in FIG. 77B. It is a graph which shows the change of data amount DA2.
- the last right-view data block R2 in the first 3D extent block 7701 starts to be read.
- the first right-view data block R5 in the second 3D extent block 7702 starts to be read.
- the buffer margin amount UL2 is stored in the second read buffer 4022 at the maximum value of the data amount that can be read from the second read buffer 4022 at least from the third time TK to the fourth time TL. It is sufficient that the difference is between the minimum value of the data amount that can be performed. Accordingly, each size of the right-view data blocks R2 and R3 satisfies the expression (5) in which the depth map data block is replaced with the right-view data block. Therefore, the buffer margin UL2 is at least: Any value satisfying the following expression (33) may be used:
- the buffer margins UL1 and UL2 of the read buffers 4021 and 4022 may be values satisfying at least the following expressions (34) and (35):
- the buffer margins UL1 and UL2 in the depth mode are smaller in the arrangement 6 than in the arrangement 4. Therefore, as apparent from the equations (12) to (14) of the modification [N], the minimum capacity of the read buffers 4021 and 4022 can be further reduced in the depth mode.
- 2D playback-dedicated block (L3 + L4) 2D copy data is divided into two 3D playback-dedicated blocks L3 SS and L4 SS .
- the replicated data may be provided as a single 3D playback dedicated block, or may be divided into three or more 3D playback dedicated blocks.
- the 2D playback-dedicated block may be accessible as two or more extents of the file 2D.
- the base-view data block may belong to a different file 2D between the two 3D extent blocks 7701 and 7702.
- the two 3D extent blocks 7701 and 7702 belong to different files SS.
- [P] Extent size conditional expression using extent ATC time In Expressions (2) to (5), the extents of the base view extent and the dependent view extent are located behind them. Limited by size. However, from the viewpoint of use in the authoring process, it is desirable that the conditions for the size of each extent are expressed in a form that does not depend on the sizes of other extents. Therefore, the expressions (2) to (5) are re-expressed as a conditional expression using the extent ATC time as follows.
- the minimum value of these extent ATC times is set as the minimum extent ATC time minT ext
- the maximum value is set as the maximum extent ATC time maxT ext : minT ext ⁇ T ext [n] ⁇ maxT ext .
- the sizes S ext1 [n], S ext2 [n], and S ext3 [n] of the nth extents EXT1 [n], EXT2 [n], and EXT3 [n] are expressed by the following equations (36) and (37 ), Limited to the range of (38): CEIL (R ext1 [n] ⁇ minT ext / 8) ⁇ S ext1 [n] ⁇ CEIL (R ext1 [n] ⁇ maxT ext / 8), (36) CEIL (R ext2 [n] ⁇ minT ext / 8) ⁇ S ext2 [n] ⁇ CEIL (R ext2 [n] ⁇ maxT ext / 8), (37) CEIL (R ext3 [n] ⁇ minT ext / 8) ⁇ S ext3 [n] ⁇ CEIL (R ext3 [n] ⁇ maxT ext / 8).
- the maximum value maxEXTk is referred to as “maximum extent size”.
- the minimum extent ATC time minT ext is calculated as follows using the minimum extent size minEXTk and the maximum extent size maxEXTk.
- FIG. 79 is a schematic diagram showing the interleaved arrangement of extent groups 7901 assumed in the calculation of the minimum extent size and the playback paths 7920 and 7930 in 3D playback mode for them.
- the sizes of the nth depth map extent EXT3 [n], right-view extent EXT2 [n], and base-view extent EXT1 [n] are the minimum extent sizes minEXT3, minEXT2, and minEXT1. equal.
- the sizes of the (n + 1) th extents EXT3 [n + 1], EXT2 [n + 1], and EXT1 [n + 1] are equal to the maximum extent sizes maxEXT3, maxEXT2, and maxEXT1.
- the reproduction path 7920 in the L / R mode and the reproduction path 7930 in the depth mode for the extent group 7901 are those shown in FIGS. 59 (c) and 60 (c) 5920 and 6020, respectively. It is the same.
- Equation (3) Since the size of the nth base-view extent EXT1 [1] is equal to the minimum extent size minEXT1, the minimum extent ATC time minT ext satisfies the following equation (39) from Equations (2) and (36):
- S ext2 [n + 1] of the (n + 1) th right-view extent EXT2 [n + 1] is equal to the maximum extent size maxEXT2:
- the base view transfer rate R ext1 [n] does not exceed the maximum value R max1 : R ext1 [n] ⁇ R max1 .
- equation (4) is similarly modified instead of equation (2), it can be seen that the minimum extent ATC time minT ext further satisfies the following equation (41):
- the size of the nth right-view extent EXT2 [n] is equal to the minimum extent size minEXT2. Furthermore, the right-view transfer rate R ext2 [n] does not exceed the maximum value R max2 , and the base-view transfer rate R ext1 [n] does not exceed the maximum value R max1 : R ext2 [n] ⁇ R max2 , R ext1 [ n] ⁇ R max1 . Therefore, from the equations (3) and (37), the minimum extent ATC time minT ext satisfies the following equation (42):
- equation (5) is used instead of equation (3), the minimum extent ATC time minT ext satisfies the following equation (43):
- the minimum extent ATC time minT ext is calculated as the maximum value in each right side of the equations (40)-(43).
- the zero sector transition time T jump-0 , the jump time T jump-3D , and the extent ATC time fluctuation range Tm can be limited to a predetermined value.
- the jump time T jump-3D may be evaluated using the maximum jump distance MAX_EXTJUMP3D.
- the minimum extent ATC time minT ext can be substantially determined only by a constant such as the maximum value R max of the average transfer time. Therefore, the condition for the extent size expressed by the equations (36) to (38) is advantageous for use in the authoring process.
- a data block that does not satisfy the condition that “the extent ATC time is equal to or longer than the minimum extent ATC time” may occur.
- the minimum extent ATC time and the maximum extent ATC time are both 2 seconds, and the ATC time of the entire multiplexed stream data is 11 seconds.
- the multiplexed stream data is divided into data blocks having an extent ATC time of 2 seconds in order from the top, finally, a data block having an extent ATC time of 1 second remains. Even if such remaining data blocks occur, they can be placed immediately before the layer boundary LB in placement 4-6 as described above.
- the remaining data blocks described above require a jump in addition to a long jump on the playback path in the 3D playback mode.
- Buffer margins UL1 and UL2 increase. Therefore, in order to further reduce the minimum capacity of the read buffers 4021 and 4022, it is desirable that the extent ATC time of all the data blocks is equal to or longer than the minimum extent ATC time.
- the following conditions are set for the maximum extent ATC time so that the size of the data block group located at the rear end of the multiplexed stream data is equal to or larger than the minimum extent size.
- FIG. 80A is a schematic diagram showing a state in which multiplexed stream data is divided into data blocks EXT [0] ⁇ EXT [n ⁇ 1] (n ⁇ 1) of the minimum extent ATC time minT ext in order from the beginning.
- FIG. 80 (b) is a schematic diagram showing the multiplexed stream data after the extension. Referring to FIG. 80B, all extent ATC times of the extended data blocks are longer than the minimum extent ATC time minT ext . Further, the extent ATC time of the last data block EXT [n] shown in FIG. 80A is at most equal to the minimum extent ATC time minT ext . Accordingly, the maximum extent ATC time maxT ext is set to at least the maximum value of the extent ATC time after extension. Equation (44) represents the condition.
- correspondence between the maximum extent ATC time maxT ext and multiplexed stream data entire ATC time T DR is appropriately set in accordance with the jump capacity or the like of the reproducing apparatus.
- limits the seamless multiplexed stream data entire ATC time to be connected to the T DR 30 seconds or more may be limited maximum extent ATC time maxT ext 2.15 seconds.
- the extent ATC time of the last data block group of the multiplexed stream data can always be set to be equal to or longer than the minimum extent ATC time.
- the buffer margins UL1 and UL2 required for the 3D playback device can be further reduced.
- the actual average transfer rates R ext1 , R ext2 , R ext3 are generally lower than their respective maximum values R max1 , R max2 , R max3 . Therefore, the actual data block sizes R ext1 ⁇ T ext , R ext2 ⁇ T ext , R ext3 ⁇ T ext are the expected values R max1 ⁇ T ext , R max2 ⁇ T ext , R Generally smaller than max3 ⁇ T ext . Therefore, reading of the next data block is started before the extent ATC time T ext elapses from the start of reading of each data block. That is, the data amounts DA1 and DA2 stored in the read buffers 4021 and 4022 are actually different from those shown in FIGS.
- the accumulated data amounts DA1 and DA2 increase by a predetermined amount each time one pair of data blocks of the base view and the dependent view is read. As a result, a certain number of data blocks are continuously read into the read buffers 4021 and 4022, thereby ensuring the buffer margin amounts UL1 and UL2.
- FIG. 81 (a) is a schematic diagram showing the correspondence between the 3D extent block 8110 and the playback path 8120 in the L / R mode.
- each pair of adjacent right-view data block Rk and base-view data block Lk is read out as one 3D extent, that is, a dependent-view extent and a base-view extent pair. .
- This extent size S ext1 [k] is generally smaller than the product of the maximum base view transfer rate R max1 and the extent ATC time T ext [k]: S ext1 [k] ⁇ R max1 ⁇ T ext [k ].
- FIG. 81 (b) is a graph showing a change in the accumulated data amount DA1 of the first read buffer 4021 when the 3D extent block 8110 is read according to the playback path 8120 in the L / R mode.
- the thin solid line graph shows changes when the average transfer rates R ext1 [k], R ext2 [k], and R ext3 [k] are equal to the maximum values R max1 , R max2 , and R max3 , respectively.
- the thick solid line graph shows the change when the transfer rate R ext1 [0] of the first base-view extent L0 is lower than the maximum value R max1 .
- the dependent view transfer rates R ext2 [k] and R ext3 [k] are equal to the maximum values R max2 and R max3 , respectively.
- the dependent view extent size R ext2 [k] ⁇ T ext [k] and R ext3 [k] ⁇ T ext [k] are the maximum possible values R max2 ⁇ T ext [k], R Equal to max3 ⁇ T ext [k].
- each dependent- view extent D1 and R1 is the same value for both graphs R max2 ⁇ T ext [1], R max3 ⁇ T ext [1] It is. Therefore, the time ⁇ T from the peak of the accumulated data amount DA1 to the start of reading of the next base-view extent L1 is common to both graphs.
- the thick solid line graph differs from the thin solid line graph by the time ⁇ Tb earlier than the extent ATC time T ext elapses from the start of reading the first base view extent L0, and the next base view extent L1. Reading is started.
- FIG. 81 (c) shows the change in the accumulated data amount DA2 in the second read buffer 4022 when the accumulated data amount DA1 in the first read buffer 4021 indicates the change shown in FIG. 81 (b). It is a graph to show.
- the thin solid line graph shows changes when the average transfer rates R ext1 [k], R ext2 [k], and R ext3 [k] are equal to the maximum values R max1 , R max2 , and R max3 , respectively.
- the thick solid line graph shows the change when the transfer rate R ext1 [0] of the first base-view extent L0 is lower than the maximum value R max1 .
- the dependent view transfer rates R ext2 [k] and R ext3 [k] are equal to the maximum values R max2 and R max3 , respectively.
- the next right view is earlier than the thin solid line graph by the time ⁇ Tb, that is, by the time ⁇ Tb before the extent ATC time T ext elapses from the start of reading the first right view extent R0.
- -Reading of extent R1 is started. Therefore, the value DM21 of the accumulated data amount DA2 at that time increases by the increment DM2 [0] from the value DM20 at the start of reading of the first right-view extent R0.
- the time ⁇ T from the peak of the accumulated data amount DA1 to the start of reading of the next base-view extent L1 is shortened by the same time ⁇ Td.
- DM3 [k] R ext1 [k] ⁇ ⁇ (R ext1 [k] ⁇ R max1 ) + (R ext3 [k] ⁇ R max3 ) ⁇ ⁇ T ext [k] / R ud ⁇ 3D
- DM4 [k] R ext3 [k] ⁇ ⁇ (R ext1 [k] ⁇ R max1 ) + (R ext3 [k] ⁇ R max3 ) ⁇ ⁇ T ext [k] / R ud ⁇ 3D .
- the base view transfer rate R ext1 [k] is equal to the average value R ext1 ⁇ av and the dependent view transfer rate R ext2 [k ], R ext3 [k] is equal to the average values R ext2 ⁇ av and R ext3 ⁇ av .
- 82 (a) and 82 (b) show read buffers 4021 and 4022 when a series of 3D extent blocks satisfying equations (50) to (53) are read by the playback device 102 in the L / R mode.
- 5 is a graph showing changes in accumulated data amounts DA1 and DA2. Referring to FIGS. 82A and 82B, the effect of adding the margin time T margin to the right side of the equations (50) to (53) can be interpreted as follows.
- each right-view data block A value assumed as a jump time necessary from the start of reading to the start of reading of the next right-view data block is longer than the actual value by the margin time T margin . Therefore, for the purpose of preventing underflow of the second read buffer 4022 during the jump time, the size of each right-view data block is the amount of data read from the second read buffer 4022 during the margin time T margin . Only extra. As a result, each time one right-view data block is read, the accumulated data amount DA2 of the second read buffer 4022 increases by the product of the right-view transfer rate R ext2 and the margin time T margin . Similarly, each time one base-view data block is read, the accumulated data amount DA1 of the first read buffer 4021 increases by the product of the base-view transfer rate R ext1 and the margin time T margin .
- the effect of the margin time T margin added implicitly through the size of other data blocks can be expressed as follows:
- the value assumed as the time required to read the data block into the second read buffer 4022 is longer than the actual value by the margin time T margin .
- the value assumed as the length of the period is longer than the actual value by the margin time T margin .
- the accumulated data amount DA1 of the first read buffer 4021 increases by the product of the base-view transfer rate R ext1 and the margin time T margin .
- the accumulated data amount DA2 of the second read buffer 4022 increases by the product of the right-view transfer rate R ext2 and the margin time T margin .
- the 3D extent block Buffer allowance UL1 and UL2 can be secured in each read buffer 4021 and 4022 by reading the entire data:
- the base view transfer rate R ext1 is equal to the average value R ext1 ⁇ av and the dependent view transfer rates R ext2 and R ext3 are the average value. Equivalent to R ext2 ⁇ av and R ext3 ⁇ av . Furthermore, the extent ATC time T ext of each data block is equal to the average value T ext ⁇ av .
- Method ⁇ III the buffer margin amounts UL1 and UL2 are secured at the start of playback of the AV stream file. For example, when the playback device in the L / R mode starts playback, the extent is read from the second read buffer 4022 until the entire first right-view extent EXT2 [0] is read into the second read buffer 4022. The data is not transferred to the decoder 4023. In the method ⁇ III >>, the second read buffer 4022 to the system target decoder 4023 until the sufficient amount of data is accumulated in the first read buffer 4021 from the first base-view extent EXT1 [0]. Transfer does not start. As a result, buffer margin amounts UL1 and UL2 are accumulated in the read buffers 4021 and 4022, respectively.
- the depth map transfer rate R ext3-av is generally lower than the right view transfer rate R ext2-av , so the total Tsum of the extent ATC time for the entire 3D extent block
- the condition for can also be expressed as:
- the playback device 102 in 2D playback mode reads in the same manner as the above methods ⁇ I >> and ⁇ II >> as shown below.
- a buffer margin may be maintained in the buffer 3621.
- 83 (a) is a schematic diagram showing the correspondence between the 3D extent block 8310 and the playback path 8320 in the 2D playback mode.
- each base-view data block Lk is read as one 2D extent.
- FIG. 83 (b) is a graph showing a change in the accumulated data amount DA of the read buffer 3621 when the 3D extent block 8310 is read according to the playback path 8320 in the 2D playback mode.
- the thin solid line graph shows the change when the average transfer rate R ext2D [k] is equal to the maximum value R max2D .
- the thick solid line graph shows the change when the transfer rate R ext2D [0] of the first 2D extent L0 is lower than the maximum value R max2D .
- the accumulated data amount DA at that time is substantially equal to the value DM10 at the start of reading.
- the time required for the entire leading 2D extent L0 to be read from the BD-ROM disc 101 to the read buffer 3621 is shorter by the time difference ⁇ T than the time in the thin solid line graph. Accordingly, in the thick solid line graph, the accumulated data amount DA reaches the peak earlier by the time ⁇ T than in the thin solid line graph.
- a thick solid line graph starts reading the next 2D extent L1 earlier by the time ⁇ T than the extent ATC time T ext elapses from the start of reading the first 2D extent L0.
- the value DM1 of the accumulated data amount DA at that time increases by an increment DM [0] from the value DM0 at the start of reading of the first 2D extent L0.
- 83 (c) is a graph showing a change in the accumulated data amount DA of the read buffer 3621 when the entire 3D extent block 8310 shown in FIG. 83 (a) is read.
- the accumulated data amount DA of the read buffer 3621 increases each time one 2D extent Lk is read. Therefore, a sufficient buffer margin can be accumulated in the read buffer 3621 by reading a sufficient number of 2D extents from the 3D extent block 8310 prior to layer switching and reading of a BD-J object file or the like. it can.
- the extent ATC time Tsum of the entire 3D extent block necessary for storing the buffer margin amount is expressed by the following equation, for example.
- FIG. 84A is a schematic diagram showing a case where a BD-J object file reading process is performed during a period in which 3D video is played back from the 3D extent block 8401 according to the playback path 8420 in the L / R mode. It is.
- the playback device 102 in the L / R mode reads a data block group from the 3D extent block 8401 according to the playback path 8420.
- buffer margins UL1 and UL2 are stored in the read buffers 4201 and 4202 while these data block groups are read.
- a first long jump J BDJ 1 from the reproduction path 8420 to the recording area 8402 of the BD-J object file occurs.
- the BD-J object file is read from the recording area 8402.
- a second long jump J BDJ 2 from the recording area 8402 to the reproduction path 8420 occurs.
- the playback process of the 3D extent block 8401 is resumed from the location where the first long jump J BDJ 1 occurs.
- the buffer margin amount UL1 may be equal to or larger than the data amount read from the first read buffer 4021 from the start of the first long jump J BDJ 1 to the end of the second long jump J BDJ 2. Therefore, the conditions to be satisfied by the buffer margin UL1 are the size S JAVA of the BD-J object file to be read, the jump time T jump of each long jump J BDJ 1 and J BDJ 2, and the entire 3D extent block 8401. Using the average value R ext1 ⁇ av of the base view transfer rate of
- the maximum values R max1 and R max2 of the average transfer rates R ext1 and R ext2 are respectively the system rates for the file 2D and the file DEP referring to the 3D extent block 8401, that is, the recording rate R of TS packets belonging to each file.
- TS1 , R TS2 equal to 192/188 times:
- Expression (57) is obtained in the same manner as Expression (49).
- Playback device 102 in 3D playback mode whether it can guarantee that ending the process of reading the BD-J object file within the above time T R, may be represented by a specific flag.
- the application program can determine whether or not to read the BD-J object file while reproducing the 3D video with reference to this flag.
- the system rate R TS1 + R TS2 for the file SS referring to the 3D extent block 8301 is 60 Mbps
- the sum of the average transfer rates R AV1 + R AV2 for the 3D extent block 8301 is 50 Mbps
- the playback device 102 can use the above flag when it can be guaranteed that the reading process of the BD-J object file will be completed within 20 seconds. Turn on. Otherwise, the playback device 102 turns off the above flag.
- FIG. 84 (b) is a schematic diagram showing a case where a BD-J object file is read out during a period in which 2D video is played back from the 3D extent block 8401 according to the playback path 8410 in 2D playback mode. is there.
- the playback device 102 in 2D playback mode reads a data block group from the 3D extent block 8401 according to the playback path 8410.
- the buffer margin amount UL1 is accumulated in the read buffer 3621 while these data block groups are read.
- the BD-J object file is read from the recording area 8402.
- a second long jump J BDJ 2 from the recording area 8402 to the reproduction path 8410 occurs.
- the playback process of the 3D extent block 8401 is resumed from the location where the first long jump J BDJ 1 occurs.
- the conditions to be satisfied by the buffer margin UL1 are the size S JAVA of the BD-J object file to be read, the jump time T jump of each long jump J BDJ 1 and J BDJ 2, and the entire 3D extent block 8401.
- the average transfer rate R ext2D ⁇ av is expressed by the following formula (58):
- the reading speed R ud-2D of the BD-ROM drive 3601 is, for example, 54 Mbps.
- the jump time T jump has a maximum jump time T jump — max 1000 msec and a time required for error correction processing 20 msec. The sum is equal to 1020 ms.
- Expression (59) is obtained in the same manner as Expression (57).
- Playback device 102 in 2D playback mode whether it can guarantee that ending the process of reading the BD-J object file within the above time T R, may be represented by a specific flag.
- the application program can determine whether or not to read the BD-J object file while reproducing the 2D video with reference to this flag. For example, a 45Mbps system rate R TS for the file 2D referencing the 3D extent block 8401, if the average transfer rate R AV for 3D extent block 8401 is 35 Mbps, and the above-mentioned time T R is 20 seconds Is assumed.
- the playback apparatus 102 turns on the above flag when it can be guaranteed that the reading process of the BD-J object file is always finished within 20 seconds. . Otherwise, the playback device 102 turns off the above flag.
- a clip information file may be provided for the file SS.
- the file is advantageous for use in special reproduction such as dive reproduction.
- FIG. 85A is a schematic diagram showing (k + 1) source packets SP # 0, SP # 1, SP # 2,..., SP # k to be included in one 3D extent.
- FIG. 85 (a) Then, the rectangular length AT1 representing each source packet SP # 0, SP # 1, SP # 2,..., SP # k represents the ATC time of the source packet.
- the ATC time AT1 is the time required for the source packet to be transferred from one of the read buffers 4021 and 4022 to the system target decoder 4023 in the 3D playback mode playback processing system shown in FIG. be equivalent to.
- the minimum extent ATC time minT ext is equal to the sum of the ATC times of a source packet group of 6 KB, for example.
- FIG. 85 (b) is a schematic diagram showing a state in which the source packets SP # 0-SP # k are arranged in the order of ATS in the ATC time axis direction.
- the leading positions ATS0 to ATSk of the rectangles representing the source packets SP # 0 to SP # k represent the ATS values of the source packets.
- an empty area is detected between source packets SP # 0-SP # k.
- the time ATS0 + AT1 at which the transfer of SP # 0 from the read buffer 4021 or 4022 to the system target decoder 4023 is completed, and the time ATS1 at which the transfer of SP # 1 is started. There is a gap.
- SP # 1 and SP # 2 The same applies to SP # 1 and SP # 2. Furthermore, SP a # k from the read buffer 4021 or 4022 and the time atsk + AT1 which finishes transferred to the system target decoder 4023, and time ATS0 + minT ext minimum extent ATC time minT ext from time ATS0 indicated by the ATS of SP # 0 has elapsed The space is vacant.
- FIG. 85 (c) is a schematic diagram showing a state in which a NULL packet is inserted in the empty area shown in FIG. 85 (b).
- a NULL packet is further inserted into the empty area detected from between the source packets SP # 0-SP # k.
- the total size of the source packets SP # 0-SP # k and the NULL packet matches 6 KB. They are multiplexed into one 3D extent. Thus, the size of the 3D extent is adjusted to 6 KB.
- FIG. 86A is a schematic diagram showing a reproduction path of multiplexed stream data corresponding to multi-angle.
- three types of stream data L, R, and D of a base view, a right view, and a depth map are multiplexed in the multiplexed stream data.
- the stream data Ak, Bk, and Ck of each angle are divided into portions where the reproduction time is equal to the angle change interval.
- Each portion Ak, Bk, and Ck is further multiplexed with stream data of a base view, a right view, and a depth map.
- the reproduction target can be switched among the stream data Ak, Bk, and Ck for each angle in accordance with the user operation or the instruction of the application program.
- FIG. 86 (b) is a schematic diagram showing a data block group 8601 recorded on the BD-ROM disc and a playback path 8602 in the L / R mode for them.
- the data block group 8601 includes stream data L, R, D, Ak, Bk, and Ck shown in FIG.
- stream data Ak, Bk, and Ck for each angle are recorded in an interleaved arrangement. Yes.
- the right-view and base-view data blocks R and L are read, and the reading of the depth map data block D is skipped by a jump.
- the data blocks A0, B1,..., Cn of the selected stream data Ak, Bk, Ck for each angle are read, and reading of the other data blocks is skipped by jump.
- FIG. 86 (c) is a schematic diagram showing 3D extent blocks constituting stream data Ak, Bk, and Ck for each angle.
- stream data Ak, Bk, and Ck of each angle is composed of three types of data blocks L, R, and D: a base view, a right view, and a depth map. .
- L, R, and D are further recorded in an interleaved arrangement.
- the right-view and base-view data blocks from the stream data Ak, Bk, Ck selected by angle from the selected data A0, B1,. R and L are read. On the other hand, reading of other data blocks is skipped by a jump.
- the arrangement of 3D extent blocks that make up the stream data Ak, Bk, and Ck of each angle includes the following three types.
- FIG. 87A is a schematic diagram showing a first 3D extent block 8701 and three types of playback paths 8710, 8720, and 8730 corresponding thereto.
- each playback path 8710, 8720, 8730 represents the 2D playback mode, L / R mode, and depth mode.
- the stream data Ak, Bk, and Ck of each angle are composed of three data blocks L, R, and D.
- the playback time per data block is equal to the angle change interval. Therefore, the angle change interval is small.
- it is necessary to secure a buffer margin necessary for jumping by reading one data block. As a result, the average transfer rate R extk (k 1, 2, 3) of each data block must be kept low.
- FIG. 87 (b) is a schematic diagram showing a second 3D extent block 8702 and three types of playback paths 8711, 8721, 8731 corresponding thereto.
- the sum of the sizes of the base view data block L and the block exclusively for 2D playback L2D is the base view data block L shown in FIG.
- the buffer margin required for the jump may be ensured by reading two data blocks.
- the first right-view and base-view data block pair R1, L, the next right-view data block R2, and the 3D playback-only block LSS are read. .
- FIG. 87 (c) is a schematic diagram showing a third 3D extent block 8703 and three types of playback paths 8712, 8722, and 8732 corresponding thereto.
- FIG. 87 (b) shows that the 2D playback-dedicated block L 2D is located last and the playback path 8712 in the 2D playback mode passes only through the 2D playback-only block L 2D . The arrangement is different.
- the size of the 2D playback-dedicated block L 2D must be twice the size of the base view data block L shown in FIG. 87 (a).
- the buffer margin required for the jump may be ensured by reading these two data blocks. For example, in the playback path 8722 in the L / R mode, the pair of the first right-view data block R1 and the 3D playback-dedicated block LSS 1 and the next right-view data block R2 and the 3D playback-only block A pair with L SS 2 is read.
- 2D reproduction-only block L 2D is positioned at the end of the stream data Ak, Bk, Ck for each angle. Therefore, since the jump distance within each angle change interval is short in the 3D playback mode, the average transfer rate R extk of each data block is maintained higher than the value in the arrangement shown in FIG. 87 (b). be able to.
- each stream data of the base view, the right view, and the depth map may be stored in a single multiplexed stream data.
- the recording rate must be limited to a system rate range that can be reproduced by the 2D reproducing apparatus.
- the number of stream data (TS) to be transferred to the system target decoder differs between the multiplexed stream data and the multiplexed stream data of other 3D video. Therefore, each play item information (PI) may include a flag indicating the number of TSs to be reproduced.
- the multiplexed stream data can be switched in one playlist file by using the flag.
- the flag indicates 2TS.
- the flag indicates 1 TS.
- the 3D playback device can switch the setting of the system target decoder in accordance with the value of the flag.
- the flag may be expressed by a connection condition (CC) value. For example, when CC indicates “7”, it indicates a transition from 2TS to 1TS, and when “8” indicates a transition from 1TS to 2TS.
- Embodiment 2 a recording medium recording apparatus and a recording method according to the first embodiment of the present invention will be described.
- the recording device is a so-called authoring device.
- the authoring device is usually installed in a production studio for distributing movie content and used by authoring staff.
- the recording device first converts the movie content into a digital stream of a compression encoding method in accordance with the MPEG standard, that is, an AV stream file.
- the recording device then generates a scenario.
- the scenario is information that defines the playback method of each title included in the movie content, and specifically includes the dynamic scenario information and the static scenario information.
- the recording device then generates a volume image or update kit for the BD-ROM disc from the above digital stream and scenario.
- the recording apparatus records the volume image on the recording medium using the extent arrangement according to the first embodiment.
- FIG. 88 is a block diagram showing the internal configuration of the recording apparatus.
- the recording apparatus includes a video encoder 8801, a material production unit 8802, a scenario generation unit 8803, a BD program production unit 8804, a multiplexing processing unit 8805, a format processing unit 8806, and a database unit 8807.
- the database unit 8807 is a non-volatile storage device built in the recording device, and in particular a hard disk drive (HDD).
- the database unit 8807 may be an HDD externally attached to the recording device, or may be a non-volatile semiconductor memory device built in or externally attached to the recording device.
- the video encoder 8801 receives video data such as uncompressed bitmap data from the authoring staff, and compresses it using a compression encoding method such as MPEG-4 AVC or MPEG-2. As a result, the main video data is converted into a primary video stream, and the sub-video data is converted into a secondary video stream. In particular, 3D video data is converted into a base-view video stream and a dependent-view video stream.
- Video encoder 8801 converts the left-view video stream into a base-view video stream by predictive coding between its own pictures as shown in FIG. , By converting to a dependent-view video stream by predictive coding between the picture of the base-view video stream as well as its own picture. Note that the right-view video stream may be converted into a base-view video stream. In addition, the left-view video stream may be converted to a dependent-view video stream.
- Each video stream 8811 after conversion is stored in the database unit 8807.
- the video encoder 8801 further detects a motion vector of each image between the left video and the right video in the process of predictive coding between pictures, and calculates depth information of each image in the 3D video from them. .
- the calculated depth information of each image is organized into frame depth information 8810 and stored in the database unit 8807.
- FIG. 89A and 89B are schematic views showing a left video picture and a right video picture used for displaying one scene of 3D video, and FIG. 89C shows those pictures by the video encoder 8801. It is a schematic diagram which shows the depth information calculated from FIG.
- Video encoder 8801 first compresses each picture using the redundancy between the left and right pictures. At that time, the video encoder 8801 compares the left and right pictures before compression for each 8 ⁇ 8 or 16 ⁇ 16 pixel matrix, that is, for each macroblock, and detects a motion vector of each image between both pictures. Specifically, as shown in FIGS. 89A and 89B, first, the left video picture 8901 and the right video picture 8902 are each divided into macroblock 8903 matrices. Next, image data is compared between both pictures 8901 and 8902 for each macroblock 8903, and a motion vector of each image is detected from the result.
- the area representing the “house” image 8904 is substantially equal between both pictures 8901 and 8902. Therefore, no motion vector is detected from these areas.
- the area representing the “sphere” image 8905 differs substantially between the pictures 8901 and 8902. Accordingly, a motion vector representing the displacement of the “sphere” image 8905 is detected from these regions.
- the video encoder 8801 uses the detected motion vector for compression of the pictures 8901 and 8902, and also for binocular parallax calculation of the video represented by the image data 8904 and 8905. From the binocular parallax obtained in this way, the video encoder 8801 further calculates the “depth” of each image, such as “house” and “sphere” images 8904 and 8905. Information representing the depth of each image is arranged in a matrix 8906 having the same size as the macroblock matrix of each picture 8901 and 8902, as shown in FIG. 89 (c), for example. The frame depth information 8810 shown in FIG. 88 includes this matrix 8906.
- the block 8907 in the matrix 8906 has a one-to-one correspondence with the macroblock 8903 in each picture 8901 and 8902.
- Each block 8907 represents the depth of the image represented by the corresponding macro block 8903, for example, with a depth of 8 bits.
- the depth of the “sphere” image 8905 is recorded in each block in the region 8908 of the matrix 8906.
- the area 8908 corresponds to the entire area in each picture 8901 and 8902 representing the image 8905.
- the material production unit 8802 creates elementary streams other than the video stream, for example, an audio stream 8812, a PG stream 8813, and an IG stream 8814, and stores them in the database unit 8807.
- the material production unit 8802 receives uncompressed LPCM audio data from the authoring staff, encodes it with a compression encoding method such as AC-3, and converts it into an audio stream 8812.
- the material production unit 8802 receives a caption information file from the authoring staff and creates a PG stream 8813 accordingly.
- the caption information file defines image data representing captions, display timing of the captions, and visual effects such as fade-in / fade-out to be added to the captions.
- the material production unit 8802 further receives bitmap data and a menu file from the authoring staff, and creates an IG stream 8814 according to them.
- Bitmap data represents a menu image.
- the menu file defines the state transition of each button arranged in the menu and the visual effect to be applied to each button.
- the scenario generation unit 8803 creates BD-ROM scenario data 8815 according to an instruction received from the authoring staff via the GUI, and stores it in the database unit 8807.
- the BD-ROM scenario data 8815 defines a playback method of each elementary stream 8811-8814 stored in the database unit 8807.
- the BD-ROM scenario data 8815 includes an index file 211, a movie object file 212, and a playlist file 221-223 among the files shown in FIG.
- the scenario generation unit 8803 further creates a parameter file 8816 and sends it to the multiplexing processing unit 8805.
- the parameter file 8816 defines stream data to be multiplexed in each of the main TS and sub-TS from the elementary streams 8811-8814 stored in the database unit 8807.
- the BD program production unit 8804 provides a programming environment for BD-J objects and Java application programs to the authoring staff.
- the BD program creation unit 8804 receives a request from the user through the GUI, and creates a source code of each program according to the request.
- the BD program creation unit 8804 further creates a BD-J object file 251 from the BD-J object, and compresses the Java application program into the JAR file 261. Those files 251 and 261 are sent to the format processing unit 8806.
- the BD-J object stores graphics data for GUI in the program execution units 3634 and 4034 shown in FIGS.
- the data is sent to the system target decoders 3622 and 4023.
- the BD-J object further causes the system target decoders 3622 and 4023 to process the graphics data as image plane data.
- the BD program creation unit 8804 may set an offset value for the image plane data in the BD-J object using the frame depth information 8810 stored in the database unit 8807.
- the multiplexing processing unit 8805 multiplexes each elementary stream 8811-8814 stored in the database unit 8807 into an MPEG2-TS stream file according to the parameter file 8816. Specifically, as shown in FIG. 4, each elementary stream 8811-8814 is converted into a source packet sequence, and the source packets in each sequence are combined into one sequence to form one multiplexed stream data. . In this way, the main TS and the sub TS are created.
- the multiplexing processing unit 8805 creates a 2D clip information file and a dependent view / clip information file by the following procedure.
- the entry map 2030 shown in FIG. 21 is generated for each of the file 2D and the file DEP.
- the extent starting point 2320 shown in FIG. 23 is created using the entry map of each file.
- the stream attribute information shown in FIG. 20 is extracted from each elementary stream to be multiplexed in each of the main TS and sub-TS.
- a combination of an entry map, 3D metadata, and stream attribute information is associated with clip information.
- the format processing unit 8806 includes BD-ROM scenario data 8815 stored in the database unit 8807, a program file group such as a BD-J object file produced by the BD program production unit 8804, and a multiplexing processing unit 8805.
- the BD-ROM disk image 8820 having the directory structure shown in FIG. 2 is created from the multiplexed stream data and the clip information file generated by.
- UDF is used as a file system.
- the format processing unit 8806 creates an entry map and a 3D meta data included in each of the 2D clip information file and the dependent view clip information file when creating the file entries of the file 2D, the file DEP, and the file SS.
- the SPN between each entry point and each extent start point is used to create each allocation descriptor.
- an allocation descriptor is created so that an interleaved arrangement as shown in FIG. 15 is represented.
- each base-view data block is shared by the file SS and the file 2D
- each dependent-view data block is shared by the file SS and the file DEP.
- the allocation descriptor may be created so that, for example, any one of the arrangements 1-6 is expressed at a place where a long jump is necessary.
- a part of the base view data block is referred to by the allocation descriptor in the file 2D as a 2D playback-only block
- a part of the duplicate data is referred to by the allocation descriptor of the file SS as a 3D playback-only block.
- each size of the extents of the base view and the dependent view is designed to satisfy the expressions (1) to (5), and based on this, the value of the logical address to be represented by each allocation descriptor is determined. .
- the format processing unit 8806 uses the frame depth information 8810 stored in the database unit 8807 to convert the offset table shown in FIG. 22A into the secondary video stream 8811 and the PG stream 8813. , And IG stream 8814.
- the format processing unit 8806 further stores the offset table in the 3D metadata of the 2D clip information file.
- the arrangement of the image data in the left and right video frames is automatically adjusted so that the 3D video represented by each stream is not displayed in the same viewing direction as the 3D video represented by the other streams.
- the offset value for each video frame is automatically adjusted so that the depths of the 3D video represented by each stream do not overlap each other.
- the BD-ROM disc image 8820 generated by the format processing unit 8806 is then converted into BD-ROM press data. Further, this data is recorded on the master of the BD-ROM disc. By using this master for the pressing process, mass production of the BD-ROM disc 101 according to the first embodiment of the present invention can be realized.
- FIG. 90 is a functional block diagram of the integrated circuit 3 according to the third embodiment of the present invention.
- the integrated circuit 3 is mounted on the playback device 102 according to the first embodiment.
- the playback device 102 includes a medium interface (IF) unit 1, a memory unit 2, and an output terminal 10 in addition to the integrated circuit 3.
- IF medium interface
- the medium IF unit 1 receives or reads data from the external medium ME and transfers it to the integrated circuit 3.
- the data has the same structure as the data on the BD-ROM disc 101 according to the first embodiment.
- the types of media ME include disk recording media such as optical disks and hard disks, semiconductor memories such as SD cards and USB memories, broadcast waves such as CATV, and networks such as Ethernet (registered trademark), wireless LAN, and wireless public lines.
- the medium IF unit 1 includes a disk drive, a card IF, a CAN tuner, a Si tuner, and a network IF according to the type of the medium ME.
- the memory unit 2 temporarily stores data received or read from the medium ME by the medium IF unit 1 and data being processed by the integrated circuit 3.
- SDRAM Synchronous Dynamic Random Access Memory
- the memory unit 2 is a single memory element.
- the memory unit 2 may include a plurality of memory elements.
- the integrated circuit 3 is a system LSI, and performs video / audio processing on the data transferred from the medium IF unit 1.
- the integrated circuit 3 includes a main control unit 6, a stream processing unit 5, a signal processing unit 7, a memory control unit 9, and an AV output unit 8.
- the main control unit 6 includes a processor core and a program memory.
- the processor core has a timer function and an interrupt function.
- the program memory stores basic software such as an OS.
- the processor core controls the entire integrated circuit 3 in accordance with a program stored in a program memory or the like.
- the stream processing unit 5 receives the data transferred from the medium ME via the medium IF unit 1 under the control of the main control unit 6.
- the stream processing unit 5 further stores the received data in the memory unit 2 through the data bus in the integrated circuit 3.
- the stream processing unit 5 separates video data and audio data from the received data.
- the data received from the medium ME includes data having the structure according to the first embodiment.
- the “video data” includes a primary video stream, a secondary video stream, a PG stream, and an IG stream.
- “Audio data” includes a primary audio stream and a secondary audio stream.
- the main view data and the subview data are each divided into a plurality of extents, which are alternately arranged.
- the stream processing unit 5 receives the data of the structure, it extracts the main view data from the data and stores it in the first area in the memory unit 2 according to the control of the main control unit 6, and stores the subview data. Extracted and stored in the second area in the memory unit 2.
- the main view data includes a left-view video stream
- the sub-view data includes a right-view video stream.
- the combination of the main view and the sub view may be a combination of 2D video and its depth map.
- the first area and the second area in the memory unit 2 are logically divided areas of a single memory element. In addition, each area may be included in a physically different memory element.
- the video data and audio data separated by the stream processing unit 5 are each compressed by encoding.
- Types of video data encoding methods include MPEG-2, MPEG-4 AVC, MPEG4-MVC, SMPTE VC-1, and the like.
- MPEG-4 AVC uses CAVLC (Context-Adaptive Variable Length Coding) and CABAC (Context-Adaptive Binary Arithmetic Coding) as coding methods for pictures. It has been adopted.
- Types of audio data encoding methods include Dolby AC-3, Dolby Digital Plus, MLP, DTS, DTS-HD, and linear PCM.
- the signal processing unit 7 decodes the video data and the audio data by a method suitable for each encoding method.
- the signal processing unit 7 corresponds to, for example, various decoders shown in FIG.
- the signal processing unit 7 encodes a picture included in the main view data (hereinafter referred to as a main view picture) and a picture included in the sub view data (hereinafter referred to as a sub view picture).
- the decoding method of the picture is selected according to CAVLC / CABAC.
- CABAC CABAC
- the signal processing unit 7 does not use the B picture as a reference picture when decoding a corresponding main view picture that is an I picture or a P picture among a plurality of subview pictures.
- the signal processing unit 7 refers to the header of the main view picture but does not refer to the header of the sub view picture when determining the decoding method according to the encoding method of each main view picture. Conversely, when the signal processing unit 7 determines a decoding method in accordance with the encoding scheme of each subview picture, the signal processing unit 7 refers to the header of the subview picture but does not refer to the header of the main view picture.
- the memory control unit 9 arbitrates access to the memory unit 2 from each functional block 5-8 in the integrated circuit 3.
- the AV output unit 8 processes the video data and audio data decoded by the signal processing unit 7 into appropriate formats under the control of the main control unit 6, and displays the display device 103 through the individual output terminals 10. And its built-in speaker.
- the types of processing include video data superimposition processing, format conversion of each data, mixing of audio data, and the like.
- FIG. 91 is a functional block diagram showing a typical configuration of the stream processing unit 5.
- the stream processing unit 5 includes a device / stream IF unit 51, a demultiplexing unit 52, and a switching unit 53.
- the device stream IF unit 51 is an interface for transferring data between the medium IF unit 1 and other functional blocks 6-9 in the integrated circuit 3.
- the device stream IF unit 51 includes SATA (Serial Advanced Technology Attachment), ATAPI (Advanced Technology Attachment Packet) Interface, or PATA (Parallel Advanced Technology Attachment).
- SATA Serial Advanced Technology Attachment
- ATAPI Advanced Technology Attachment Packet
- PATA Parallel Advanced Technology Attachment
- the medium ME is a semiconductor memory such as an SD card and a USB memory
- the device stream IF unit 51 includes a card IF.
- the device stream IF unit 51 includes a tuner IF.
- the device stream IF unit 51 When the medium ME is a network such as Ethernet (registered trademark), a wireless LAN, and a wireless public line, the device stream IF unit 51 includes a network IF.
- the device stream IF unit 51 may implement part of the function instead of the medium IF unit 1.
- the device stream IF unit 51 may be omitted.
- the demultiplexing unit 52 receives the data transferred from the medium ME to the memory unit 2 from the memory control unit 9, and separates the video data and the audio data from the data.
- each extent included in the data having the structure according to the first embodiment is composed of source packets such as a video stream, an audio stream, a PG stream, and an IG stream, as shown in FIG. .
- the subview data may not include an audio stream.
- Demultiplexer 52 reads PID from each source packet in accordance with the PID, fractionating source packets in the TS packets A TS of voice and TS packets V TS video system.
- the sorted TS packets V TS and A TS are directly or once stored in the memory unit 2 and then transferred to the signal processing unit 7.
- the demultiplexing unit 52 corresponds to, for example, the source / depacketizers 4111 and 4112 and the PID filters 4113 and 4114 shown in FIG.
- the switching unit 53 switches the output destination according to the type of data received by the device stream IF unit 51. For example, when the device stream IF unit 51 receives main view data, the storage destination of the data is switched to the first area of the memory unit 2. On the other hand, when the device stream IF unit 51 receives the subview data, the storage destination of the data is switched to the second area of the memory unit 2.
- the switching unit 53 is, for example, a DMAC (Direct Memory Access Controller).
- FIG. 92 is a schematic diagram showing the structure around the switching unit 53 in that case.
- the DMAC 53 transmits the data received by the device stream IF unit 51 and the storage destination address of the data to the memory control unit 9 under the control of the main control unit 6. Specifically, when the device stream IF unit 51 receives the main view data MD, the DMAC 53 transmits the address 1AD1 together with the main view data MD.
- “address 1” AD1 is data indicating the head address AD1 of the first storage area 21 in the memory unit 2.
- the DMAC 53 transmits the address 2AD2 together with the subview data SD.
- address 2 AD2 is data indicating the start address AD2 of the second storage area 22 in the memory unit 2.
- the DMAC 53 switches its output destination, particularly the storage destination in the memory unit 2, depending on the type of data received by the device stream IF unit 51.
- the memory control unit 9 stores the main view data MD and the subview data SD received from the DMAC 53 in the areas 21 and 22 in the memory unit 2 indicated by the simultaneously received addresses AD1 and AD2, respectively.
- the main control unit 6 uses the extent start point in the clip information file for the switching control of the storage destination by the switching unit 53.
- the clip information file is received before any of the main view data MD and the subview data SD, and is stored in the memory unit 2.
- the main control unit 6 recognizes that the data received by the device stream IF unit 51 is the main view data MD using the file base.
- the main control unit 6 uses the file DEP to recognize that the data received by the device stream IF unit 51 is subview data.
- the main control unit 6 further sends a control signal CS to the switching unit 53 in accordance with the recognized result to switch the data storage destination.
- the switching unit 53 may be controlled by a dedicated control circuit different from the main control unit 6.
- the stream processing unit 5 may further include a cryptographic engine unit, a secure management unit, and a controller for direct memory access in addition to the functional blocks 51, 52, and 53 shown in FIG.
- the cryptographic engine unit decrypts the encrypted data, the key data, and the like received by the device stream IF unit 51.
- the secure management unit holds a secret key and uses it to perform execution control such as a device authentication protocol between the medium ME and the playback device 102.
- the storage destination is switched depending on whether the data is the main view data MD or the subview data SD. It is done.
- the main view data It may be divided into MD and subview data SD.
- FIG. 93 is a functional block diagram showing a typical configuration of the AV output unit 8.
- the AV output unit 8 includes an image superimposing unit 81, a video output format converting unit 82, and an audio / video output IF unit 83.
- the image superimposing unit 81 superimposes the video data VP, PG, and IG decoded by the signal processing unit 7 on each other. Specifically, the image superimposing unit 81 first receives the processed left-view or right-view video plane data VP from the video output format conversion unit 82, and the decoded PG plane from the signal processing unit 7. Receives data PG and IG plane data IG. Next, the image superimposing unit 81 superimposes the PG plane data PG and the IG plane data IG on the video plane data VP in units of pictures.
- the image superimposing unit 81 corresponds to, for example, the plane adding unit 4024 shown in FIGS.
- the video output format conversion unit 82 receives the decoded video plane data VP from the signal processing unit 7 and receives the video data VP / PG / IG after superimposition from the image superimposing unit 81.
- the video output format converter 82 further performs various processes on the video data VP and VP / PG / IG as necessary.
- the types of processing include resizing processing, IP conversion processing, noise reduction processing, and frame rate conversion processing.
- the resizing process is a process for enlarging / reducing the size of an image.
- the IP conversion process is a process of converting the scanning method between the progressive method and the interlace method.
- the noise reduction process is a process for removing noise from the video.
- the frame rate conversion process is a process for converting the frame rate.
- the video output format conversion unit 82 sends the processed video plane data VP to the image superimposing unit 81, or sends the processed video data VS to the audio / video output IF unit 83.
- the audio / video output IF unit 83 receives the video data VS from the video output format conversion unit 82, and receives the decoded audio data AS from the signal processing unit 7.
- the audio / video output IF unit 83 further performs processing such as encoding according to the data transmission format on the received data VS and AS.
- processing such as encoding according to the data transmission format on the received data VS and AS.
- a part of the audio / video output IF unit 83 may be provided outside the integrated circuit 3.
- FIG. 94 is a schematic diagram showing details of a portion related to data output of the playback device 102 including the AV output unit 8.
- the audio / video output IF unit 83 includes an analog video output IF unit 83a, a digital video / audio output IF unit 83b, and an analog / audio output IF unit 83c.
- the integrated circuit 3 and the playback device 102 can support data transmission methods of a plurality of types of video data and audio data as described below.
- the analog video output IF unit 83a receives the video data VS from the video output format conversion unit 82, converts / encodes the data VS into analog video signal format data VD, and outputs the data.
- the analog video output IF unit 83a includes, for example, a composite video encoder, an S video signal (Y / C separation) encoder, a component video signal encoder corresponding to any of NTSC, PAL, and SECAM. Includes a D / A converter (DAC).
- the digital video / audio output IF unit 83b receives the decoded audio data AS from the signal processing unit 7 and the video data VS from the video output format conversion unit 82.
- the digital video / audio output IF unit 83b further encrypts the data AS and VS by integrating them. Thereafter, the digital video / audio output IF unit 83b encodes the encrypted data SVA in accordance with the data transmission standard and outputs the encoded data.
- the digital video / audio output IF unit 83b corresponds to, for example, HDMI (High-Definition Multimedia InterFace).
- the analog audio output IF unit 83c receives the decoded audio data AS from the signal processing unit 7, converts it into analog audio data AD by D / A conversion, and outputs it.
- the analog audio output IF unit 83c corresponds to, for example, an audio DAC.
- the transmission format of the above-mentioned video data and audio data can be switched according to the type of the data receiving device / data input terminal of the display device 103 / speaker 103A, and can also be switched by the user's selection. . Furthermore, the playback device 102 can transmit the data of the same content in parallel not only in a single transmission format but also in a plurality of transmission formats.
- the AV output unit 8 may further include a graphics engine unit in addition to the functional blocks 81, 82, and 83 shown in FIGS.
- the graphics engine unit performs graphics processing such as filter processing, screen synthesis processing, curve drawing processing, and 3D display processing on the data decoded by the signal processing unit 7.
- the integrated circuit 3 incorporates the functional blocks shown in FIGS. 90, 91, 93, and 94. However, this is not essential, and some functional blocks may be externally attached to the integrated circuit 3.
- the memory unit 2 may be built in the integrated circuit 3.
- the main control unit 6 and the signal processing unit 7 do not have to be completely separated functional blocks. For example, the main control unit 6 may perform part of the processing of the signal processing unit 7.
- FIG. 95 is a schematic diagram showing examples (a) and (b) of the topology of the control bus and data bus in the integrated circuit 3.
- both the control bus 11 and the data bus 12 are arranged so that each functional block 5-9 is directly connected to all other functional blocks.
- the data bus 13 may be arranged so that each functional block 5-8 is directly connected only to the memory control unit 9. In this case, each functional block 5-8 transfers data to another functional block via the memory control unit 9 and the memory unit 2.
- the integrated circuit 3 may be a multichip module instead of an LSI mounted on a single chip. In that case, since the plurality of chips constituting the integrated circuit 3 are sealed in one package, the integrated circuit 3 is apparently a single LSI.
- the integrated circuit 3 may be configured using an FPGA (Field Programmable Gate Array) or a reconfigurable processor.
- An FPGA is an LSI that can be programmed after manufacture.
- the reconfigurable processor is an LSI capable of reconfiguring connections between internal circuit cells and setting of each circuit cell.
- FIG. 96 is a flowchart of the reproduction processing by the reproduction device 102 using the integrated circuit 3.
- the reproduction process is started when the medium IF unit 1 is connected to the medium ME so as to be able to receive data, such as when an optical disk is inserted into the disk drive.
- the playback device 102 receives and decodes data from the medium ME. Thereafter, the playback device 102 outputs the decoded data as a video signal and an audio signal.
- step S1 the medium IF unit 1 receives or reads data from the medium ME and transfers it to the stream processing unit 5. Thereafter, the process proceeds to step S2.
- step S2 the stream processing unit 5 separates the data received or read in step S1 into video data and audio data. Thereafter, the process proceeds to step S3.
- step S3 the signal processing unit 7 decodes each data separated by the stream processing unit 5 in step S2 by a method suitable for the encoding method. Thereafter, the process proceeds to step S4.
- step S4 the AV output unit 8 performs a superimposition process on the video data decoded by the signal processing unit 7 in step S3. Thereafter, the process proceeds to step S5.
- step S5 the AV output unit 8 outputs the video data and audio data processed in step S2-4. Thereafter, the process proceeds to step S6.
- step S6 the main control unit 6 determines whether or not the reproduction process should be continued. If data to be newly received or read from the medium ME is left by the medium IF unit 1, the process is repeated from step S1. On the other hand, when the medium IF unit 1 finishes receiving or reading data from the medium ME due to the removal of the optical disk from the disk drive or the instruction to stop playback from the user, the processing ends.
- FIG. 97 is a flowchart showing details of each step S1-6 shown in FIG. Each step S101-110 shown in FIG. 97 is performed under the control of the main control unit 6.
- Step S101 mainly corresponds to the details of Step S1
- Steps S102 to 104 mainly correspond to the details of Step S2
- Step S105 mainly corresponds to the details of Step S3
- Steps S106 to 108 mainly correspond to Step S4.
- Steps S109 and S110 mainly correspond to the details of Step S5.
- step S101 the device stream IF unit 51 receives data necessary for reproduction of the data, such as a playlist file and a clip information file, from the medium ME through the medium IF unit 1 before the data to be reproduced. Or read out.
- the device stream IF unit 51 further stores the data in the memory unit 2 via the memory control unit 9. Thereafter, the process proceeds to step S102.
- step S102 the main control unit 6 identifies the encoding methods of the video data and audio data stored in the medium ME from the stream attribute information included in the clip information file.
- the main control unit 6 further initializes the signal processing unit 7 so that a decoding process corresponding to the identified encoding method can be executed. Thereafter, the process proceeds to step S103.
- step S103 the device stream IF unit 51 receives or reads out video data and audio data to be reproduced from the medium ME through the medium IF unit 1. In particular, these data are received or read in extent units.
- the device stream IF unit 51 further stores these data in the memory unit 2 via the switching unit 53 and the memory control unit 9.
- the main control unit 6 controls the switching unit 53 to switch the storage destination of the data to the first area in the memory unit 2.
- the main control unit 6 controls the switching unit 53 to switch the storage destination of the data to the second area in the memory unit 2. Thereafter, the process proceeds to step S104.
- step S104 the data stored in the memory unit 2 is transferred to the demultiplexing unit 52 in the stream processing unit 5.
- the demultiplexing unit 52 first reads the PID from each source packet constituting the data.
- the demultiplexing unit 52 identifies whether the TS packet included in the source packet is video data or audio data according to the PID.
- the demultiplexing unit 52 further transfers each TS packet to a corresponding decoder in the signal processing unit 7 according to the identification result. Thereafter, the process proceeds to step S105.
- step S105 each decoder in the signal processing unit 7 decodes the transferred TS packet by an appropriate method. Thereafter, the process proceeds to step S106.
- step S106 each picture of the left-view video stream and the right-view video stream decoded by the signal processing unit 7 is sent to the video output format conversion unit 82.
- the video output format conversion unit 82 resizes these pictures in accordance with the resolution of the display device 103. Thereafter, the process proceeds to step S107.
- step S107 the image superimposing unit 81 receives the video plane data composed of the picture resized in step S106 from the video output format converting unit 82.
- the image superimposing unit 81 receives the decoded PG plane data and IG plane data from the signal processing unit 7. The image superimposing unit 81 further superimposes those plane data. Thereafter, the process proceeds to step S108.
- step S108 the video output format conversion unit 82 receives the plane data superimposed in step S107 from the image superimposing unit 81.
- the video output format conversion unit 82 further performs IP conversion on the plane data. Thereafter, the process proceeds to step S109.
- step S109 the audio / video output IF unit 83 receives the video data subjected to the IP conversion in step S108 from the video output format conversion unit 82, and the decoded audio data from the signal processing unit 7. receive.
- the audio / video output IF unit 83 further performs encoding processing, D / A conversion, and the like on the data according to the data output method by the display device 103 / speaker 103A or the data transmission method to each.
- the video data and the audio data are converted into an analog output format or a digital output format, respectively.
- the video system data in the analog output format includes a composite video signal, an S video signal, a component video signal, and the like.
- the digital output format video / audio data includes HDMI and the like.
- step S110 the audio / video output IF unit 83 transmits the video data and audio data processed in step S109 to the display device 103 / speaker 103A. Thereafter, the process proceeds to step S6. In addition, said step is used about step S6.
- the result may be temporarily stored in the memory unit 2 each time data is processed. Further, the resizing process and the IP converting process by the video output format converting unit 82 in steps S106 and S108 may be omitted as necessary. Furthermore, in addition to or instead of these processes, other processes such as a noise reduction process and a frame rate conversion process may be performed. Further, the processing procedure may be changed for possible ones.
- 3D video playback methods are roughly divided into two methods: a method using holography technology and a method using parallax video.
- the feature of the method using the holography technology is that by giving almost the same information as the optical information given to human vision from a real three-dimensional object to the viewer's vision, the object in the image is given to the viewer. It is in the point which shows in three dimensions.
- the technology of using this method for displaying moving images has been established theoretically.
- a computer capable of processing enormous operations in real time, which is necessary for displaying the moving image, and a display device with an ultra-high resolution of several thousand per mm are still very difficult to realize with current technology. difficult. Therefore, at present, there is almost no prospect of commercializing this method for commercial use.
Abstract
Description
図1は、本発明の実施形態1による記録媒体を使用するホームシアター・システムを示す模式図である。このホームシアター・システムは、視差映像を用いた3D映像(立体視映像)の再生方式を採用し、特に表示方式として継時分離方式を採用している(詳細は<補足>参照)。図1を参照するに、このホームシアター・システムは記録媒体101を再生対象とし、再生装置102、表示装置103、シャッター眼鏡104、及びリモコン105を含む。
図2は、BD-ROMディスク101上のデータ構造を示す模式図である。図2を参照するに、BD-ROMディスク101上のデータ記録領域の最内周部にはBCA(Burst Cutting Area)201が設けられている。BCAに対してはBD-ROMドライブ121によるアクセスのみが許可され、アプリケーション・プログラムによるアクセスは禁止される。それにより、BCA201は著作権保護技術に利用される。BCA201よりも外側のデータ記録領域では内周から外周へ向けてトラックが螺旋状に延びている。図2にはトラック202が模式的に横方向に引き伸ばされて描かれている。その左側はディスク101の内周部を表し、右側は外周部を表す。図2に示されているように、トラック202は内周から順に、リードイン領域202A、ボリューム領域202B、及びリードアウト領域202Cを含む。リードイン領域202AはBCA201のすぐ外周側に設けられている。リードイン領域202Aは、ボリューム領域202Bに記録されたデータのサイズ及び物理アドレス等、BD-ROMドライブ121によるボリューム領域202Bへのアクセスに必要な情報を含む。リードアウト領域202Cはデータ記録領域の最外周部に設けられ、ボリューム領域202Bの終端を示す。ボリューム領域202Bは、映像及び音声等のアプリケーション・データを含む。
図2は更に、BD-ROMディスク101のボリューム領域202Bに格納されたデータのディレクトリ/ファイル構造を示す。図2を参照するに、このディレクトリ/ファイル構造では、ルート(ROOT)ディレクトリ203の直下にBDムービー(BDMV:BD Movie)ディレクトリ210が置かれている。BDMVディレクトリ210の直下には、インデックス・ファイル(index.bdmv)211とムービーオブジェクト・ファイル(MovieObject.bdmv)212とが置かれている。
図3の(a)は、BD-ROMディスク101上のメインTSに多重化されたエレメンタリ・ストリームの一覧表である。メインTSはMPEG-2トランスポート・ストリーム(TS)形式のデジタル・ストリームであり、図2に示されているファイル2D241に含まれる。図3の(a)を参照するに、メインTSはプライマリ・ビデオ・ストリーム301とプライマリ・オーディオ・ストリーム302A、302Bとを含む。メインTSはその他に、プレゼンテーション・グラフィックス(PG)ストリーム303A、303B、インタラクティブ・グラフィックス(IG)ストリーム304、セカンダリ・オーディオ・ストリーム305、及びセカンダリ・ビデオ・ストリーム306を含んでもよい。
ビデオ・ストリームに含まれる各ピクチャは1フレーム又は1フィールドを表し、MPEG-2又はMPEG-4 AVC等の動画圧縮符号化方式によって圧縮されている。その圧縮には、ピクチャの空間方向及び時間方向での冗長性が利用される。ここで、空間方向での冗長性のみを利用するピクチャの符号化を「ピクチャ内符号化」という。一方、時間方向での冗長性、すなわち、表示順序の連続する複数のピクチャ間でのデータの近似性を利用するピクチャの符号化を「ピクチャ間予測符号化」という。ピクチャ間予測符号化では、まず符号化対象のピクチャに対して、表示時間が前又は後である別のピクチャが参照ピクチャとして設定される。次に、符号化対象のピクチャとその参照ピクチャとの間で動きベクトルが検出され、それを利用して参照ピクチャに対する動き補償が行われる。更に、動き補償によって得られたピクチャと符号化対象のピクチャとの間の差分値が求められ、その差分値から空間方向での冗長性が除去される。こうして、各ピクチャのデータ量が圧縮される。
3D映像のシームレス再生には、ベースビュー・ビデオ・ストリームとディペンデントビュー・ビデオ・ストリームとのBD-ROMディスク101上での物理的な配置が重要である。ここで、「シームレス再生」とは、多重化ストリーム・データから映像と音声とを途切れさせることなく滑らかに再生することをいう。
再生装置102は、BD-ROMディスク101から3D映像をシームレスに再生するには、メインTSとサブTSとをパラレルに処理しなければならない。しかし、その処理に利用可能なリード・バッファの容量は一般に限られている。特に、BD-ROMディスク101からリード・バッファへ連続して読み込むことのできるデータ量には限界がある。従って、再生装置102はメインTSとサブTSとを、エクステントATC時間の等しい部分の対に分割して読み出さねばならない。
図17の(a)は、インターリーブ配置で記録されたディペンデントビュー・データ・ブロック群D[0]、D[1]、D[2]とベースビュー・データ・ブロック群B[0]、B[1]、B[2]との各エクステントATC時間の一例を示す模式図である。図17の(a)を参照するに、各ディペンデントビュー・データ・ブロックD[n](n=0、1、2)とその直後のベースビュー・データ・ブロックB[n]との対ではエクステントATC時間が等しい。例えば先頭のデータ・ブロックの対D[0]、B[0]ではエクステントATC時間が共に1秒に等しい。従って、各データ・ブロックD[0]、B[0]が再生装置102内のリード・バッファに読み込まれたとき、その中の全てのTSパケットが、同じ1秒間でリード・バッファからシステム・ターゲット・デコーダへ送られる。同様に、二番目のデータ・ブロックの対D[1]、B[1]ではエクステントATC時間が共に0.7秒に等しいので、同じ0.7秒間で、各データ・ブロック内の全てのTSパケットがリード・バッファからシステム・ターゲット・デコーダへ送られる。
多重化ストリーム・データに属する各データ・ブロックは、BD-ROMディスク101のファイルシステムでは、ファイル2D又はファイルDEP内の一つのエクステントとしてアクセス可能である。すなわち、各データ・ブロックの論理アドレスは、ファイル2D又はファイルDEPのファイル・エントリから知ることができる(詳細は<補足>参照)。
図18は、図15に示されているデータ・ブロック群に対する2D再生モードでの再生経路1801、L/Rモードでの再生経路1802、及びデプス・モードでの再生経路1803を示す模式図である。
AVストリーム・ファイルに含まれるTSパケットの種類には、図3に示されているエレメンタリ・ストリームから変換されたもの以外にも、PAT(Program Association Table)、PMT(Program Map Table)、及びPCR(Program Clock Reference)がある。PCR、PMT、及びPATは欧州デジタル放送規格で定められたものであり、本来は、一つの番組を構成するパーシャル・トランスポート・ストリームを規定する役割を持つ。PCR、PMT、及びPATを利用することで、AVストリーム・ファイルもそのパーシャル・トランスポート・ストリームと同様に規定される。具体的には、PATは、同じAVストリーム・ファイルに含まれるPMTのPIDを示す。PAT自身のPIDは0である。PMTは、同じAVストリーム・ファイルに含まれる、映像・音声・字幕等を表す各エレメンタリ・ストリームのPIDとその属性情報とを含む。PMTは更に、そのAVストリーム・ファイルに関する各種のディスクリプタ(記述子ともいう。)を含む。ディスクリプタには特に、そのAVストリーム・ファイルのコピーの許可/禁止を示すコピー・コントロール情報が含まれる。PCRは、自身に割り当てられたATSに対応させるべきSTC(System Time Clock)の値を示す情報を含む。ここで、「STC」は、再生装置102内のデコーダによって、PTS及びDTSの基準として利用されるクロックである。そのデコーダはPCRを利用して、ATCにSTCを同期させる。
図20は、第1クリップ情報ファイル(01000.clpi)、すなわち2Dクリップ情報ファイル231のデータ構造を示す模式図である。ディペンデントビュー・クリップ情報ファイル(02000.clpi、03000.clpi)232、233も同様なデータ構造を持つ。以下では、まず、クリップ情報ファイル全般に共通するデータ構造を2Dクリップ情報ファイル231のデータ構造を例に説明する。その後、2Dクリップ情報ファイルとディペンデントビュー・クリップ情報ファイルとのデータ構造上の相違点について説明する。
図21の(a)は、エントリ・マップ2030のデータ構造を示す模式図である。図21の(a)を参照するに、エントリ・マップ2030はテーブル2100を含む。テーブル2100は、メインTSに多重化されたビデオ・ストリームと同数であり、各ビデオ・ストリームに一つずつ割り当てられている。図21の(a)では各テーブル2100が割り当て先のビデオ・ストリームのPIDで区別されている。各テーブル2100はエントリ・マップ・ヘッダ2101とエントリ・ポイント2102とを含む。エントリ・マップ・ヘッダ2101は、そのテーブル2100に対応付けられたPIDと、そのテーブル2100に含まれるエントリ・ポイント2102の総数とを含む。エントリ・ポイント2102は、PTS2103とソースパケット番号(SPN)2104との対を個別に異なるエントリ・ポイントID(EP_ID)2105に対応付ける。PTS2103は、エントリ・マップ・ヘッダ2101の示すPIDのビデオ・ストリームに含まれるいずれかのIピクチャのPTSに等しい。SPN2104は、そのIピクチャが格納されたソースパケット群の先頭のSPNに等しい。「SPN」とは、一つのAVストリーム・ファイルに属するソースパケット群に、先頭から順に割り当てられた通し番号をいう。SPNはそのAVストリーム・ファイル内での各ソースパケットのアドレスとして利用される。2Dクリップ情報ファイル231内のエントリ・マップ2130では、SPNは、ファイル2D241に属するソースパケット群、すなわちメインTSを構成するソースパケット群に割り当てられた番号を意味する。従って、エントリ・ポイント2102は、ファイル2D241に含まれる各IピクチャのPTSとアドレス、すなわちSPNとの間の対応関係を表す。
図22の(a)はオフセット・テーブル2041のデータ構造を示す模式図である。オフセット・テーブル2041は、3D再生モードの再生装置102によるクロッピング処理に利用される情報である。「クロッピング処理」とは、2D映像を表すデータから、レフトビューとライトビューとを表すプレーン・データの対を生成する処理をいう。「プレーン・データ」とは画素データの二次元配列を意味し、その配列のサイズは映像フレームの解像度に等しい。一組の画素データは色座標値とα値との組み合わせから成る。色座標値はRGB値又はYCrCb値で表される。クロッピング処理の対象には、メインTS内のPGストリーム、IGストリーム、及びセカンダリ・ビデオ・ストリームのそれぞれから生成されるプレーン・データ、並びに、BD-Jオブジェクトに従って生成されるイメージ・プレーン・データが含まれる。クロッピング処理はプレーン・データ内での各画素データの位置を水平方向に変化させる。従って、クロッピング処理によって得られるプレーン・データの対ではレフトビューとライトビューとの各表示位置が元の2D映像の表示位置から左右にずれている。それらの変位が視聴者に両眼視差として知覚されることにより、レフトビューとライトビューとの対がその視聴者には一つの3D映像として見える。
図23の(a)は、エクステント起点2042のデータ構造を示す模式図である。図23の(a)を参照するに、「エクステント起点(Extent_Start_Point)」2042はベースビュー・エクステントID(EXT1_ID)2311とSPN2312とを含む。EXT1_ID2311は、第1ファイルSS(01000.ssif)244Aに属する各ベースビュー・データ・ブロックに、先頭から順に割り当てられた通し番号である。SPN2312は各EXT1_ID2311に一つずつ割り当てられ、そのEXT1_ID2311で識別されるベースビュー・データ・ブロックの先端に位置するソースパケットのSPNに等しい。ここで、そのSPNは、第1ファイルSS244Aに属するベースビュー・データ・ブロック群に含まれる各ソースパケットに、先頭から順に割り当てられた通し番号である。
図23の(c)は、L/Rモードの再生装置102によって第1ファイルSS244Aから抽出されたベースビュー・データ・ブロックL1、L2、…を表す模式図である。図23の(c)を参照するに、エクステント起点2042の示すSPN2312は、各ベースビュー・データ・ブロックの先端に位置するソースパケットのSPNに等しい。それらのベースビュー・データ・ブロック群2330のように、エクステント起点を利用して一つのファイルSSから抽出されるベースビュー・データ・ブロック群を「ファイル・ベース」という。更に、ファイル・ベースに含まれるベースビュー・データ・ブロックを「ベースビュー・エクステント」という。各ベースビュー・エクステントは、図23の(c)に示されているように、2Dクリップ情報ファイル内のエクステント起点によって参照される。
ディペンデントビュー・クリップ情報ファイルは、図20-23に示されている2Dクリップ情報ファイルとデータ構造が同様である。従って、以下の説明では、ディペンデントビュー・クリップ情報ファイルと2Dクリップ情報ファイルとの間の相違点に触れ、同様な点についての説明は上記の説明を援用する。
図26は、2Dプレイリスト・ファイルのデータ構造を示す模式図である。図2に示されている第1プレイリスト・ファイル(00001.mpls)221はこのデータ構造を持つ。図26を参照するに、2Dプレイリスト・ファイル221はメインパス2601と二つのサブパス2602、2603とを含む。
コネクション・コンディション2704は例えば“1”、“5”、“6”の三種類の値を取り得る。コネクション・コンディション2704が“1”であるとき、PI#Nによって規定されるファイル2D241の部分から再生される映像は、直前のPI#(N-1)によって規定されるファイル2D241の部分から再生される映像とは必ずしもシームレスに接続されなくてもよい。一方、コネクション・コンディション2704が“5”又は“6”であるとき、それら両方の映像が必ずシームレスに接続されなければならない。
図27を再び参照するに、STNテーブル2705はストリーム登録情報の配列である。「ストリーム登録情報」とは、再生開始時刻2702から再生終了時刻2703までの間にメインTSから再生対象として選択可能なエレメンタリ・ストリームを個別に示す情報である。ストリーム番号(STN)2706はストリーム登録情報に個別に割り当てられた通し番号であり、再生装置102によって各エレメンタリ・ストリームの識別に利用される。STN2706は更に、同じ種類のエレメンタリ・ストリームの間では選択の優先順位を表す。ストリーム登録情報はストリーム・エントリ2709とストリーム属性情報2710と含む。ストリーム・エントリ2709はストリーム・パス情報2707とストリーム識別情報2708とを含む。ストリーム・パス情報2707は、選択対象のエレメンタリ・ストリームが属するファイル2Dを示す情報である。例えばストリーム・パス情報2707が“メインパス”を示すとき、そのファイル2Dは、参照クリップ情報2701の示す2Dクリップ情報ファイルに対応するものである。一方、ストリーム・パス情報2707が“サブパスID=1”を示すとき、選択対象のエレメンタリ・ストリームが属するファイル2Dは、サブパスID=1のサブパスに含まれるSUB_PIの参照クリップ情報が示す2Dクリップ情報ファイルに対応するものである。そのSUB_PIの規定する再生開始時刻又は再生終了時刻のいずれかは、STNテーブル2705を含むPIの規定する再生開始時刻2702から再生終了時刻2703までの期間に含まれる。ストリーム識別情報2708は、ストリーム・パス情報2707によって特定されるファイル2Dに多重化されているエレメンタリ・ストリームのPIDを示す。このPIDの示すエレメンタリ・ストリームが再生開始時刻2702から再生終了時刻2703までの間に選択可能である。ストリーム属性情報2710は各エレメンタリ・ストリームの属性情報を表す。例えば、オーディオ・ストリーム、PGストリーム、及びIGストリームの各属性情報は言語の種類を示す。
図29は、2Dプレイリスト・ファイル(00001.mpls)221の示すPTSと、ファイル2D(01000.m2ts)241から再生される部分との間の対応関係を示す模式図である。図29を参照するに、2Dプレイリスト・ファイル221のメインパス2601では、PI#1は、再生開始時刻IN1を示すPTS#1と、再生終了時刻OUT1を示すPTS#2とを規定する。PI#1の参照クリップ情報2701は2Dクリップ情報ファイル(01000.clpi)231を示す。再生装置102は2Dプレイリスト・ファイル221に従って2D映像を再生するとき、まずPI#1からPTS#1、#2を読み出す。再生装置102は次に、2Dクリップ情報ファイル231のエントリ・マップを参照して、PTS#1、#2に対応するファイル2D241内のSPN#1、#2を検索する。再生装置102は続いて、SPN#1、#2から、それぞれに対応するセクタ数を算定する。再生装置102は更にそれらのセクタ数とファイル2D241のファイル・エントリとを利用して、再生対象の2Dエクステント群EXT2D[0]、…、EXT2D[n]が記録されたセクタ群P1の先端のLBN#1と後端のLBN#2とを特定する。セクタ数の算定とLBNの特定とは、図21の(b)、(c)を用いて説明したとおりである。再生装置102は最後に、LBN#1からLBN#2までの範囲をBD-ROMドライブ121に指定する。それにより、その範囲のセクタ群P1から、2Dエクステント群EXT2D[0]、…、EXT2D[n]に属するソースパケット群が読み出される。同様に、PI#2の示すPTS#3、#4の対は、まず2Dクリップ情報ファイル231のエントリ・マップを利用してSPN#3、#4の対に変換される。次にファイル2D241のファイル・エントリを利用してSPN#3、#4の対がLBN#3、#4の対に変換される。更に、LBN#3からLBN#4までの範囲のセクタ群P2から、2Dエクステント群に属するソースパケット群が読み出される。PI#3の示すPTS#5、#6の対からSPN#5、#6の対への変換、SPN#5、#6の対からLBN#5、#6の対への変換、及びLBN#5からLBN#6までの範囲のセクタ群P3からのソースパケット群の読み出しも同様である。こうして、再生装置102は2Dプレイリスト・ファイル221のメインパス2601に従ってファイル2D241から2D映像を再生できる。
図30は、3Dプレイリスト・ファイルのデータ構造を示す模式図である。図2に示されている第2プレイリスト・ファイル(00002.mpls)222はこのデータ構造を持つ。第2プレイリスト・ファイル(00003.mpls)223も同様である。図30を参照するに、3Dプレイリスト・ファイル222は、メインパス3001、サブパス3002、及び拡張データ3003を含む。
図33は、3Dプレイリスト・ファイル(00002.mpls)222の示すPTSと、第1ファイルSS(01000.ssif)244Aから再生される部分との間の対応関係を示す模式図である。図33を参照するに、3Dプレイリスト・ファイル222のメインパス3001では、PI#1は、再生開始時刻IN1を示すPTS#1と、再生終了時刻OUT1を示すPTS#2とを規定する。PI#1の参照クリップ情報は2Dクリップ情報ファイル(01000.clpi)231を示す。一方、サブパス・タイプが「3D・L/R」を示すサブパス3002では、SUB_PI#1が、PI#1と同じPTS#1、#2を規定する。SUB_PI#1の参照クリップ情報はライトビュー・クリップ情報ファイル(02000.clpi)232を示す。
図34は、図2に示されているインデックス・ファイル(index.bdmv)211内のインデックス・テーブル3410を示す模式図である。図34を参照するに、インデックス・テーブル3410は、「ファーストプレイ」3401、「トップメニュー」3402、及び「タイトルk」3403(k=1、2、…、n:nは1以上の整数)という項目を含む。各項目にはムービーオブジェクトMVO-2D、MVO-3D、…、又はBD-JオブジェクトBDJO-2D、BDJO-3D、…のいずれかが対応付けられている。ユーザの操作又はアプリケーション・プログラムによってタイトル又はメニューが呼び出される度に、再生装置102の制御部はインデックス・テーブル3410の対応する項目を参照する。制御部は更に、その項目に対応付けられているオブジェクトをBD-ROMディスク101から呼び出し、それに従って様々な処理を実行する。具体的には、項目「ファーストプレイ」3401には、ディスク101がBD-ROMドライブ121へ挿入された時に呼び出されるべきオブジェクトが指定されている。項目「トップメニュー」3402には、例えばユーザの操作で「メニューに戻れ」というコマンドが入力された時に表示装置103にメニューを表示させるためのオブジェクトが指定されている。項目「タイトルk」3403には、ディスク101上のコンテンツを構成するタイトルが個別に割り当てられている。例えばユーザの操作によって再生対象のタイトルが指定されたとき、そのタイトルが割り当てられている項目「タイトルk」には、そのタイトルに対応するAVストリーム・ファイルから映像を再生するためのオブジェクトが指定されている。
図35は、3D映像のタイトルが選択されたときに行われる、再生対象のプレイリスト・ファイルの選択処理のフローチャートである。図34に示されているインデックス・テーブル3410では、項目「タイトル3」が参照されたときはムービーオブジェクトMVO-3Dに従ってその選択処理が実行され、項目「タイトル4」が参照されたときは、BD-JオブジェクトBDJO-3Dに規定されたJavaアプリケーション・プログラムに従ってその選択処理が実行される。
2D再生モードの再生装置102はBD-ROMディスク101から2D映像コンテンツを再生するとき、2D再生装置として動作する。図36は、2D再生装置3600の機能ブロック図である。図36を参照するに、2D再生装置3600は、BD-ROMドライブ3601、再生部3602、及び制御部3603を含む。再生部3602は、リード・バッファ3621、システム・ターゲット・デコーダ3622、及びプレーン加算部3623を含む。制御部3603は、動的シナリオ・メモリ3631、静的シナリオ・メモリ3632、ユーザイベント処理部3633、プログラム実行部3634、再生制御部3635、プレーヤ変数記憶部3636、及びデコーダ・ドライバ3637を含む。再生部3602と制御部3603とは互いに異なる集積回路に実装されている。その他に、両者が単一の集積回路に統合されていてもよい。
SPRM(1) : プライマリ・オーディオ・ストリーム番号
SPRM(2) : 字幕ストリーム番号
SPRM(3) : アングル番号
SPRM(4) : タイトル番号
SPRM(5) : チャプタ番号
SPRM(6) : プログラム番号
SPRM(7) : セル番号
SPRM(8) : 選択キー情報
SPRM(9) : ナビゲーション・タイマー
SPRM(10) : 再生時刻情報
SPRM(11) : カラオケ用ミキシングモード
SPRM(12) : パレンタル用国情報
SPRM(13) : パレンタル・レベル
SPRM(14) : プレーヤ設定値(ビデオ)
SPRM(15) : プレーヤ設定値(オーディオ)
SPRM(16) : オーディオ・ストリーム用言語コード
SPRM(17) : オーディオ・ストリーム用言語コード(拡張)
SPRM(18) : 字幕ストリーム用言語コード
SPRM(19) : 字幕ストリーム用言語コード(拡張)
SPRM(20) : プレーヤ・リージョン・コード
SPRM(21) : セカンダリ・ビデオ・ストリーム番号
SPRM(22) : セカンダリ・オーディオ・ストリーム番号
SPRM(23) : 再生状態
SPRM(24) : 予備
SPRM(25) : 予備
SPRM(26) : 予備
SPRM(27) : 予備
SPRM(28) : 予備
SPRM(29) : 予備
SPRM(30) : 予備
SPRM(31) : 予備
SPRM(10)は、復号処理中のピクチャのPTSを示し、そのピクチャが復号されて主映像プレーン・メモリに書き込まれる度に更新される。従って、SPRM(10)を参照すれば、現在の再生時点を知ることができる。
図38は、システム・ターゲット・デコーダ3622の機能ブロック図である。図38を参照するに、システム・ターゲット・デコーダ3622は、ソース・デパケタイザ3810、ATCカウンタ3820、第1の27MHzクロック3830、PIDフィルタ3840、STCカウンタ(STC1)3850、第2の27MHzクロック3860、主映像デコーダ3870、副映像デコーダ3871、PGデコーダ3872、IGデコーダ3873、主音声デコーダ3874、副音声デコーダ3875、イメージ・プロセッサ3880、主映像プレーン・メモリ3890、副映像プレーン・メモリ3891、PGプレーン・メモリ3892、IGプレーン・メモリ3893、イメージ・プレーン・メモリ3894、及び音声ミキサ3895を含む。
図39の(a)は、プライマリ・ビデオ・ストリームの復号処理において、デコーダ・ドライバ3637とDEC3804とによって処理されるデータの流れを示す模式図である。図39の(a)を参照するに、プライマリ・ビデオ・ストリームから一枚のピクチャを復号する処理は主に次の五種類のステップA-Eから成る。
3D再生モードの再生装置102はBD-ROMディスク101から3D映像コンテンツを再生するとき、3D再生装置として動作する。その構成の基本部分は、図36-39に示されている2D再生装置の構成と同様である。従って、以下では2D再生装置の構成からの拡張部分及び変更部分について説明し、基本部分の詳細についての説明は上記の2D再生装置についての説明を援用する。また、2Dプレイリスト・ファイルに従った2D映像の再生処理、すなわち2Dプレイリスト再生処理に利用される構成は2D再生装置の構成と同様である。従って、その詳細についての説明も上記の2D再生装置についての説明を援用する。以下の説明では、3Dプレイリスト・ファイルに従った3D映像の再生処理、すなわち3Dプレイリスト再生処理を想定する。
図41は、システム・ターゲット・デコーダ4023の機能ブロック図である。図41に示されている構成要素は、図38に示されている2D再生装置のもの3622とは次の二点で異なる:(1)リード・バッファから各デコーダへの入力系統が二重化されている点、並びに、(2)主映像デコーダは3D再生モードに対応可能であり、副映像デコーダ、PGデコーダ、及びIGデコーダは2プレーン・モードに対応可能である点。すなわち、それらの映像デコーダはいずれも、ベースビュー・ストリームとディペンデントビュー・ストリームとを交互に復号できる。一方、主音声デコーダ、副音声デコーダ、音声ミキサ、イメージ・プロセッサ、及び各プレーン・メモリは、図38に示されている2D再生装置のものと同様である。従って、以下では、図41に示されている構成要素のうち、図38に示されているものとは異なるものについて説明し、同様なものの詳細についての説明は図38についての説明を援用する。更に、各映像デコーダはいずれも同様な構造を持つので、以下では主映像デコーダ4115の構造について説明する。同様な説明は他の映像デコーダの構造についても成立する。
図42の(a)は、ベースビューとディペンデントビューとのプライマリ・ビデオ・ストリームの対の復号処理において、デコーダ・ドライバ4037とDEC4104とによって処理されるデータの流れを示す模式図である。図42の(a)を参照するに、プライマリ・ビデオ・ストリームの対から一対のピクチャを復号する処理は次の五種類のステップA-Eを含む。
図43はプレーン加算部4024の機能ブロック図である。図43を参照するに、プレーン加算部4024は、視差映像生成部4310、スイッチ4320、四つのクロッピング処理部4331-4334、及び四つの加算部4341-4344を含む。
[A] 図9に示されているベースビュー・ビデオ・ストリームのVAU931とディペンデントビュー・ビデオ・ストリームのVAU932とが同じ3D・VAUに属するとき、シーケンス・ヘッダ931Bとサブシーケンス・ヘッダ932Bとが一致し、ピクチャ・ヘッダ931C、932Cが一致し、又は、圧縮ピクチャ・データ931E、932E内のスライス・ヘッダが一致してもよい。図10に示されているVAU941、942についても同様である。その場合、図42の(b)に示されているピクチャの復号処理では、ディペンデントビュー・ピクチャの復号方法が直前のベースビュー・ピクチャの復号方法と同一に設定されればよい。従って、デコーダ・ドライバ4037は、図42の(b)に示されている二番目と四番目とのステップDD2、D4のように、ディペンデントビュー・ピクチャに関するステップDを省略できる。その結果、デコーダ・ドライバ4037は復号処理に対する負担を更に軽減できる。
図10に示されているように、VAUはシーケンス終端コード941G、942Gを含んでもよい。シーケンス終端コードは前述のとおり、ビデオ・シーケンスの後端を示す。再生装置102内の映像デコーダはシーケンス終端コードを検出したとき、それに応じて、STCをリセットする等の初期化処理を行う。従って、シーケンス終端コードを利用すれば、プレイリスト・ファイルを利用しなくても、映像デコーダに復号対象のストリーム・データからビデオ・シーケンスの境界を検知させることができる。
本発明の実施形態1によるBD-ROMディスク101では、ベースビューとディペンデントビューとのデータ・ブロック群が、図15、24に示されているとおり、インターリーブ配置を形成している。インターリーブ配置は2D映像と3D映像とのいずれのシームレス再生にも有利である。それらのシームレス再生を更に確実に実現するには、各データ・ブロックのサイズは、再生装置102の性能に基づく以下の条件を満たせばよい。
図55は、2D再生モードの再生装置102内の再生処理系統を示す模式図である。図55を参照するに、その再生処理系統は、図36に示されているBD-ROMドライブ3601、リード・バッファ3621、及びシステム・ターゲット・デコーダ3622を含む。BD-ROMドライブ3601はBD-ROMディスク101から2Dエクステントを読み出し、読み出し速度Rud-2Dでリード・バッファ3621へ転送する。システム・ターゲット・デコーダ3622は、リード・バッファ3621内に蓄積された各2Dエクステントからソースパケットを平均転送速度Rext2Dで読み出し、映像データVDと音声データADとに復号する。
図58は、3D再生モードの再生装置102内の再生処理系統を示す模式図である。図58を参照するに、その再生処理系統は、図40に示されている要素のうち、BD-ROMドライブ4001、スイッチ4020、一対のリード・バッファ4021、4022、及びシステム・ターゲット・デコーダ4023を含む。BD-ROMドライブ4001はBD-ROMディスク101から3Dエクステントを読み出し、読み出し速度Rud-3Dでスイッチ4020へ転送する。スイッチ4020は各3Dエクステントをベースビュー・エクステントとディペンデントビュー・エクステントとに分離する。ベースビュー・エクステントは第1リード・バッファ4021へ格納され、ディペンデントビュー・エクステントは第2リード・バッファ4022へ格納される。第2リード・バッファ4022内の蓄積データは、L/Rモードではライトビュー・エクステントであり、デプス・モードではデプスマップ・エクステントである。システム・ターゲット・デコーダ4023は、第1リード・バッファ4021内に蓄積された各ベースビュー・エクステントからソースパケットを第1平均転送速度Rext1で読み出す。L/Rモードのシステム・ターゲット・デコーダ4023は、第2リード・バッファ4022内に蓄積された各ライトビュー・エクステントからソースパケットを第2平均転送速度Rext2で読み出す。デプス・モードのシステム・ターゲット・デコーダ4023は、第2リード・バッファ4022内に蓄積された各デプスマップ・エクステントからソースパケットを第3平均転送速度Rext3で読み出す。システム・ターゲット・デコーダ4023は更に、読み出されたベースビュー・エクステントとディペンデントビュー・エクステントとの対を映像データVDと音声データADとに復号する。
図59の(a)、(b)は、L/Rモードでの動作中、各リード・バッファ4021、4022に蓄積されるデータ量DA1、DA2の変化を示すグラフである。図59の(c)は、再生対象のデータ・ブロック群5910とL/Rモードでの再生経路5920との間の対応関係を示す模式図である。図59の(c)を参照するに、そのデータ・ブロック群5910は、図56の(b)に示されているもの5610と同様なインターリーブ配置のデータ・ブロック群Dk、Rk、Lk(k=…、n-1、n、n+1、n+2、…)である。再生経路5920に従い、隣接するライトビュー・データ・ブロックRkとベースビュー・データ・ブロックLkとの各対が一つの3DエクステントEXTSS[k]として一括して読み出される。その後、スイッチ4020によってその3DエクステントEXTSS[k]からライトビュー・エクステントとベースビュー・エクステントとが分離され、各リード・バッファ4021、4022に蓄積される。
図60の(a)、(b)は、デプス・モードでの動作中、各リード・バッファ4021、4022に蓄積されるデータ量DA1、DA2の変化を示すグラフである。図60の(c)は、再生対象のデータ・ブロック群6010とデプス・モードでの再生経路6020との間の対応関係を示す模式図である。図60の(c)を参照するに、そのデータ・ブロック群6010は、図56の(c)に示されているもの5610と同様なインターリーブ配置のデータ・ブロック群Dk、Rk、Lkで構成されている。再生経路6020に従い、デプスマップ・データ・ブロックDkとベースビュー・データ・ブロックDkとがそれぞれ、一つの3Dエクステントとして読み出される。図56の場合と同様、(n-1)対の3Dエクステントが既に読み込まれ、かつ整数nが1より十分に大きい場合を想定する。その場合、両リード・バッファ4021、4022の蓄積データ量DA1、DA2は既にそれぞれのバッファ余裕量UL1、UL2以上に維持されている。
3D映像の再生にL/Rモードのみが利用されるときは、図56の配置からデプスマップ・データ・ブロックが除去されてもよい。すなわち、ベースビュー・データ・ブロックB[n](n=0、1、2、…)とディペンデントビュー・データ・ブロックD[n]との二種類が、図24に示されているインターリーブ配置でBD-ROMディスク上に記録されていてもよい。この配置についても同様に、映像のシームレス再生に必要なデータ・ブロックのサイズに対する条件が求められる。
CEIL(Sext3[2]/2048)+G1≦MAX_EXTJUMP3D、
CEIL(Sext2[2]/2048)+G1≦MAX_EXTJUMP3D、
CEIL(Sext3[3]/2048)+G2≦MAX_EXTJUMP3D、
CEIL(Sext2[3]/2048)+G2≦MAX_EXTJUMP3D。
CEIL(Sext3[2]/2048)+G1≦MAX_JUMP(Sext3[2])、
CEIL(Sext2[2]/2048)+G1≦MAX_JUMP(Sext2[2])、
CEIL(Sext3[3]/2048)+G2≦MAX_JUMP(Sext3[3])、
CEIL(Sext2[3]/2048)+G2≦MAX_JUMP(Sext2[3])。
図59、60の各(a)、(b)に示されている各リード・バッファ4021、4022の蓄積データ量DA1、DA2の下限値UL1、UL2はそれぞれのバッファ余裕量を表す。「バッファ余裕量」とは、インターリーブ配置のデータ・ブロック群の読み出し期間中、各リード・バッファに維持されるべき蓄積データ量の下限値をいう。バッファ余裕量は、ロングジャンプ中での各リード・バッファのアンダーフローを防止可能な量に設定される。
図59、60の各(c)に示されている一連のデータ・ブロック群からの再生処理について、各リード・バッファ4021、4022に必要な容量の最小値は以下のように計算される。
BD-ROMディスク101が記録層を複数含むとき、メインTSとサブTSとは層境界を越えて二つの記録層に記録されてもよい。その場合、メインTSとサブTSとの読み出し中にロングジャンプが生じる。
図68の(a)は、BD-ROMディスク101の層境界LBの前後に記録されたデータ・ブロック群の物理的な配置の第1例を示す模式図である。以下、この配置を「配置1」という。図68の(a)を参照するに、層境界LBの前には第1の3Dエクステント・ブロック6801が記録され、層境界LBの後には第2の3Dエクステント・ブロック6802が記録されている。各3Dエクステント・ブロック6801、6802は、図67の(a)に示されているもの6701、6702と同様である。配置1では更に、第1の3Dエクステント・ブロック6801の後端L2と層境界LBとの間に一つのベースビュー・データ・ブロックL32Dが配置されている。そのベースビュー・データ・ブロックL32Dは、第2の3Dエクステント・ブロック6802内の先端のベースビュー・データ・ブロックL3SSとビット単位(bit-for-bit)で一致する。以下、前者L32Dを「2D再生専用ブロック」といい、後者L3SSを「3D再生専用ブロック」という。
3D映像の再生にL/Rモードのみが利用されるとき、上記の配置1からデプスマップ・データ・ブロックが除去されてもよい。図69は、図68の(a)に示されている配置1からデプスマップ・データ・ブロックを除去したものを示す模式図である。図69を参照するに、層境界LBの前に位置する第1の3Dエクステント・ブロック6901では、ディペンデントビュー・データ・ブロック群…、D[0]、D[1]とベースビュー・データ・ブロック群…、B[0]、B[1]とがインターリーブ配置で記録されている。一方、層境界LBの後に位置する第2の3Dエクステント・ブロック6902では、ディペンデントビュー・データ・ブロック群D[2]、D[3]、…とベースビュー・データ・ブロック群B[2]SS、B[3]、…がインターリーブ配置で記録されている。更に、第1の3Dエクステント・ブロック6901の後端B[1]と層境界LBとの間に2D再生専用ブロックB[2]2Dが配置され、第2の3Dエクステント・ブロック6902の先端には3D再生専用ブロックB[2]SSが配置されている。それらのデータ・ブロックB[2]2D、B[2]SSはビット単位で一致する。
図70の(a)は、BD-ROMディスク101の層境界LBの前後に記録されたデータ・ブロック群の物理的な配置の第2例を示す模式図である。以下、この配置を「配置2」という。図70の(a)を図68の(a)と比較するに、配置2は配置1とは、第2の3Dエクステント・ブロック7002の先端に二個の3D再生専用ブロックL3SS、L4SSが設けられている点で異なる。3D再生専用ブロックの全体L3SS+L4SSは、層境界LBの直前に位置する2D再生専用ブロック(L3+L4)2Dとビット単位で一致する。その他の特徴については配置2は配置1と同様であるので、その詳細についての説明は配置1についての説明を援用する。
図71の(a)は、BD-ROMディスク101の層境界LBの前後に記録されたデータ・ブロック群の物理的な配置の第3例を示す模式図である。以下、この配置を「配置3」という。図71の(a)を図70の(a)と比較するに、配置3は配置2とは、2D再生専用ブロック(L2+L3)2Dが単一の2DエクステントEXT2D[1]としてアクセス可能である点で異なる。2D再生専用ブロック(L2+L3)2Dは、層境界LBの直後に位置する3D再生専用ブロックの全体L2SS+L3SSとビット単位で一致する。その他の特徴については配置3は配置2と同様であるので、その詳細についての説明は配置2についての説明を援用する。
図72の(a)は、BD-ROMディスク101の層境界LBの前後に記録されたデータ・ブロック群の物理的な配置の第4例を示す模式図である。以下、この配置を「配置4」という。図72の(a)を図70の(a)と比較するに、配置4は配置2とは、3D再生専用ブロックL3SS、L4SSを含むインターリーブ配置のデータ・ブロック群が層境界LBの直前に配置されている点で異なる。その他の特徴については配置4は配置2と同様であるので、その詳細についての説明は配置2についての説明を援用する。
図75の(a)は、BD-ROMディスク101の層境界LBの前後に記録されたデータ・ブロック群の物理的な配置の第5例を示す模式図である。以下、この配置を「配置5」という。図75の(a)を図71の(a)と比較するに、配置5は配置3とは、3D再生専用ブロックL2SS、L3SS、L4SSを含むインターリーブ配置のデータ・ブロック群が2D再生専用ブロック(L2+L3+L4)2Dの直前に配置されている点で異なる。その他の特徴については配置5は配置3と同様であるので、その詳細についての説明は配置3についての説明を援用する。
図77の(a)は、BD-ROMディスク101の層境界LBの前後に記録されたデータ・ブロック群の物理的な配置の第6例を示す模式図である。以下、この配置を「配置6」という。図77の(a)を図72の(a)と比較するに、配置6は配置4とは、各3D再生専用ブロックL3SS、L4SSの直前に位置するライトビュー・データ・ブロックとデプスマップ・データ・ブロックとの対R3+D3、R4+D4の順序が逆である点で異なる。その他の特徴については配置6は配置4と同様であるので、その詳細についての説明は配置4についての説明を援用する。
式(2)-(5)では、ベースビュー・エクステントとディペンデントビュー・エクステントとの各サイズが、それよりも後方に位置するエクステントのサイズで制限される。しかし、オーサリング工程での利用という観点からは、各エクステントのサイズに対する条件が、他のエクステントのサイズには依存しない形で表現されていることが望ましい。従って、式(2)-(5)は、以下のように、エクステントATC時間を利用した条件式に表現し直される。
CEIL(Rext1[n]×minText/8)≦Sext1[n]≦CEIL(Rext1[n]×maxText/8)、 (36)
CEIL(Rext2[n]×minText/8)≦Sext2[n]≦CEIL(Rext2[n]×maxText/8)、 (37)
CEIL(Rext3[n]×minText/8)≦Sext3[n]≦CEIL(Rext3[n]×maxText/8)。 (38)
すなわち、平均転送速度Rextk[n](k=1、2、3)と最小エクステントATC時間minTextとの積が最小エクステント・サイズminEXTkに等しい:minEXTk=Rextk[n]×minText。一方、平均転送速度Rextk[n]は最高値Rmaxkまで想定可能であるので、各エクステントのサイズSextk[n]の想定可能な最大値maxEXTkは、平均転送速度の最高値Rmaxkと最大エクステントATC時間maxTextとの積に等しい:maxEXTk=Rmaxk×maxText=Rmaxk×(minText+Tm)(k=1、2、3)。以下、この最大値maxEXTkを「最大エクステント・サイズ」という。最小エクステントATC時間minTextは最小エクステント・サイズminEXTkと最大エクステント・サイズmaxEXTkとを利用して、以下のように算定される。
データ・ブロック群の配置4-6において、3D再生モードで読み出されるデータ・ブロック群の中で層境界LBの直前に配置された三つのデータ・ブロックD4、R4、L4SSの各サイズは式(2)-(5)を満たさないでよいとした。これは次の理由に因る:変形例[P]で述べたように、最小エクステント・サイズを「エクステントの平均転送速度Rextk×最小エクステントATC時間minText」(k=1,2,3)で定義し、最大エクステント・サイズを「エクステントの平均転送速度Rextk×最大エクステントATC時間maxText」で定義する。その場合、コンテンツの再生時間によっては、「エクステントATC時間が最小エクステントATC時間以上である」という条件を満たさないデータ・ブロックが生じ得る。例えば、最小エクステントATC時間と最大エクステントATC時間とをいずれも2秒間であり、多重化ストリーム・データ全体のATC時間が11秒間である場合を想定する。この場合、その多重化ストリーム・データを先頭から順に、エクステントATC時間が2秒であるデータ・ブロックに区切っていくと、最後に、エクステントATC時間が1秒であるデータ・ブロックが残る。そのような残りのデータ・ブロックが生じても、配置4-6ではそれらを上記のように層境界LBの直前に配置することができる。
maxText≧minText×[TDR/(TDR-minText)]。 (44)
式(44)の意味は次のとおりである。図80の(a)は、多重化ストリーム・データを先頭から順に最小エクステントATC時間minTextのデータ・ブロックEXT[0]-EXT[n-1](n≧1)に分割した状態を示す模式図である。図80の(a)を参照するに、最後のデータ・ブロックEXT[n]のエクステントATC時間は最小エクステントATC時間minTextに満たない。その場合、最後のデータ・ブロックEXT[n]のエクステントATC時間を、その他のデータ・ブロックEXT[0]-EXT[n-1]に等分配して各エクステントATC時間を最小エクステントATC時間minTextよりも延長する。図80の(b)は、その延長後の多重化ストリーム・データを示す模式図である。図80の(b)を参照するに、延長後の各データ・ブロックのエクステントATC時間は全て、最小エクステントATC時間minTextよりも長い。更に、図80の(a)に示されている最後のデータ・ブロックEXT[n]のエクステントATC時間は最大で最小エクステントATC時間minTextに等しい。従って、最大エクステントATC時間maxTextは、少なくともその延長後のエクステントATC時間の最大値に設定される。式(44)はその条件を表す。
バッファ余裕量UL1、UL2を確保するための方法としては、以下の三つ≪I≫、≪II≫、≪III≫が望ましい。
方法≪I≫では、各バッファ余裕量UL1、UL2は以下に述べるように確保される。まず、各データ・ブロックの設計では「エクステントATC時間Textが最小エクステントATC時間minText以上である」という条件が課される。ここで、最小エクステントATC時間minTextは、式(40)-(43)に示されているとおり、平均転送速度Rext1、Rext2、Rext3がそれぞれの最高値Rmax1、Rmax2、Rmax3に等しい場合での値である。しかし、実際の平均転送速度Rext1、Rext2、Rext3はそれぞれの最高値Rmax1、Rmax2、Rmax3よりも一般に低い。従って、実際のデータ・ブロックのサイズRext1×Text、Rext2×Text、Rext3×Textは、上記の条件下で想定される値Rmax1×Text、Rmax2×Text、Rmax3×Textよりも一般に小さい。それ故、各データ・ブロックの読み出し開始からエクステントATC時間Textが経過する前に、次のデータ・ブロックの読み出しが開始される。すなわち、各リード・バッファ4021、4022の蓄積データ量DA1、DA2は実際には、図59、60の(a)、(b)に示されているものとは一般に異なり、読み出し開始時の値まで戻る前に再び増加する。こうして、各蓄積データ量DA1、DA2は、ベースビューとディペンデントビューとのデータ・ブロックの対が一つ読み出されるごとに所定量ずつ増える。その結果、ある程度の数のデータ・ブロックが各リード・バッファ4021、4022に連続して読み込まれることにより、各バッファ余裕量UL1、UL2が確保される。
DM1[k]=Rext1[k]×(ΔTb+ΔTd)
=Rext1[k]×{(Rext1[k]-Rmax1)+(Rext2[k]-Rmax2)}×Text[k]/Rud-3D、 (45)
DM2[k]=Rext2[k]×(ΔTb+ΔTd)
=Rext2[k]×{(Rext1[k]-Rmax1)+(Rext2[k]-Rmax2)}×Text[k]/Rud-3D。
L/Rモードでは、各3DエクステントEXTSS[k]からベースビュー・エクステントLkとライトビュー・エクステントRkとが各リード・バッファ4021、4022に読み込まれるごとに各蓄積データ量DA1、DA2は増分DM1[k]、DM2[k]ずつ増える。デプス・モードでも同様に、ベースビュー・エクステントLkとデプスマップ・エクステントDkとが各リード・バッファ4021、4022に読み込まれるごとに各蓄積データ量DA1、DA2は増分DM3[k]、DM4[k]ずつ増える。ここで、増分DM3[k]、DM4[k]は次式(47)、(48)で表される:
DM3[k]=Rext1[k]×{(Rext1[k]-Rmax1)+(Rext3[k]-Rmax3)}×Text[k]/Rud-3D、 (47)
DM4[k]=Rext3[k]×{(Rext1[k]-Rmax1)+(Rext3[k]-Rmax3)}×Text[k]/Rud-3D。
従って、3Dエクステント・ブロック8110全体でのエクステントATC時間の合計Tsum=Text[0]+Text[1]+Text[2]+…が次式(49)を満たすとき、その3Dエクステント・ブロック8110の全体の読み出しによって各リード・バッファ4021、4022にバッファ余裕量UL1、UL2を確保することができる:
方法≪II≫では、各バッファ余裕量UL1、UL2は以下に述べるように確保される。まず、一連の3Dエクステント・ブロック内の各データ・ブロックのサイズは、式(2)-(5)の右辺にマージン時間Tmarginを追加した次式(50)-(53)を満たす:
方法≪III≫では、各バッファ余裕量UL1、UL2はAVストリーム・ファイルの再生開始時に確保される。例えばL/Rモードの再生装置は再生開始時、先頭のライトビュー・エクステントEXT2[0]の全体を第2リード・バッファ4022に読み込むまで、そのエクステントを第2リード・バッファ4022からシステム・ターゲット・デコーダ4023へは転送しない。方法≪III≫では更に、先頭のベースビュー・エクステントEXT1[0]から第1リード・バッファ4021に十分なデータ量が蓄積されるまで、第2リード・バッファ4022からシステム・ターゲット・デコーダ4023への転送が開始されない。その結果、バッファ余裕量UL1、UL2が各リード・バッファ4021、4022に蓄積される。
上記の実施形態では、例えば図68に示されている配置1のように、層境界LBの直前等、ロングジャンプが必要な位置の直前に十分なサイズの2Dエクステントが配置されている。それにより、ロングジャンプの直前にリード・バッファ3621に十分なデータ量が蓄積されるので、2D映像をシームレスに再生することができる。一方、ロングジャンプは、多重化ストリーム・データの再生中に、BD-Jオブジェクト・ファイル等、多重化ストリーム・データとは異なるファイルの読み出し処理が割り込まれたときにも生じる。それらのロングジャンプに関わらず、2D映像をシームレスに再生することを目的として、2D再生モードの再生装置102は、以下に示すように、上記の方法≪I≫、≪II≫と同様にしてリード・バッファ3621にバッファ余裕量を維持してもよい。
3Dエクステント・ブロックから映像が再生されている期間に、BD-Jオブジェクト・ファイルの読み出し処理が割り込まれる場合がある。その場合、再生装置102は、以下のようにして、割り込み処理中でのリード・バッファのアンダーフローを防止する。
では、各ソースパケットSP#0、SP#1、SP#2、…、SP#kを表す矩形の長さAT1は、そのソースパケットのATC時間を表す。そのATC時間AT1は、図58に示されている3D再生モードの再生処理系統において、そのソースパケットがいずれかのリード・バッファ4021、4022からシステム・ターゲット・デコーダ4023へ転送されるのに要する時間に等しい。ソースパケットSP#0-SP#kから3Dエクステントを形成するときはまず、図85の(a)に示されているとおり、それらのATC時間の合計を最小エクステントATC時間minText以下に設計する。ここで、最小エクステントATC時間minTextは例えば6KBのソースパケット群のATC時間の合計に等しい。
図86の(a)は、マルチアングルに対応する多重化ストリーム・データの再生経路を示す模式図である。図86の(a)を参照するに、その多重化ストリーム・データには、ベースビュー、ライトビュー、及びデプスマップの三種類のストリーム・データL、R、Dが多重化されている。例えばL/Rモードではベースビューとライトビューとのストリーム・データL、Rがパラレルに再生される。更に、マルチアングルでの再生期間TANGで再生される部分にはアングル別のストリーム・データAk、Bk、Ckが多重化されている(k=0、1、2、…、n)。各アングルのストリーム・データAk、Bk、Ckは、再生時間がアングルチェンジ間隔に等しい部分に分割されている。各部分Ak、Bk、Ckには更に、ベースビュー、ライトビュー、及びデプスマップの各ストリーム・データが多重化されている。マルチアングル期間TANGでは、ユーザの操作又はアプリケーション・プログラムの指示に応じて、アングル別のストリーム・データAk、Bk、Ckの間で再生対象を切り換えることができる。
以下、本発明の実施形態2として、本発明の実施形態1による記録媒体の記録装置及び記録方法について説明する。
図90は、本発明の実施形態3による集積回路3の機能ブロック図である。図90を参照するに、集積回路3は実施形態1による再生装置102に実装される。ここで、再生装置102は、集積回路3の他に、媒体インタフェース(IF)部1、メモリ部2、及び出力端子10を含む。
図96は、集積回路3を利用した再生装置102による再生処理のフローチャートである。その再生処理は、光ディスクがディスクドライブに挿入される等、媒体IF部1が媒体MEにデータ受信可能に接続されたときに開始される。その再生処理では、再生装置102は媒体MEからデータを受信して復号する。その後、再生装置102は復号後のデータを映像信号及び音声信号として出力する。
≪3D映像の再生方法の原理≫
3D映像の再生方法は、ホログラフィ技術を用いる方法と、視差映像を用いる方法との2つに大別される。
BD-ROMディスク101のファイルシステムとしてUDFが利用されるとき、図2に示されているボリューム領域202Bは、一般に複数のディレクトリ、ファイルセット記述子、及び終端記述子のそれぞれが記録された領域を含む。「ディレクトリ」は、同じディレクトリを構成するデータ群である。「ファイルセット記述子」は、ルートディレクトリのファイル・エントリが記録されているセクタのLBNを示す。「終端記述子」はファイルセット記述子の記録領域の終端を示す。
本発明の実施形態1による記録媒体は、光ディスクの他、例えばSDメモリカードを含む可搬性半導体メモリ装置等、パッケージメディアとして利用可能なリムーバブルメディア全般を含む。また、実施形態1の説明では、予めデータが記録された光ディスク、すなわち、BD-ROM又はDVD-ROM等の既存の読み出し専用の光ディスクが例に挙げられている。しかし、本発明の実施形態はそれらに限定されない。例えば放送で、又はネットワーク経由で配信された3D映像のコンテンツを端末装置によって、BD-RE又はDVD-RAM等の既存の書き込み可能な光ディスクへ書き込むときに、実施形態1によるエクステントの配置が利用されてもよい。ここで、その端末装置は、再生装置に組み込まれていても、再生装置とは別の装置であってもよい。
本発明の実施形態1による記録媒体として、光ディスクに代えて半導体メモリカードを用いたときにおける、再生装置のデータ読み出し部について説明する。
ここで、以降の補足事項の前提として、BD-ROMディスクに記録されているデータの著作権を保護するための仕組みについて説明する。
電子配信を利用して本発明の実施形態1による再生装置へ3D映像のAVストリーム・ファイル等のデータ(以下、配信データという。)を伝達し、更にその再生装置にその配信データを半導体メモリカードに記録させる処理について、以下説明する。尚、以下の動作は、上記の再生装置に代えて、その処理に特化した端末装置によって行われてもよい。また、記録先の半導体メモリカードがSDメモリカードである場合を想定する。
本発明の実施形態2では、AVストリーム・ファイル及びプレイリスト・ファイルは、オーサリングシステムにおけるプリレコーディング技術によってBD-ROMディスクに記録されてユーザに供給されることを前提とした。しかし、AVストリーム・ファイル及びプレイリスト・ファイルは、リアルタイム・レコーディングによって、BD-REディスク、BD-Rディスク、ハードディスク、又は半導体メモリカード等の書き込み可能な記録媒体(以下、BD-REディスク等と略す。)に記録されてユーザに供給されるものであってもよい。その場合、AVストリーム・ファイルは、アナログ入力信号を記録装置がリアルタイムで復号することによって得られたトランスポート・ストリームであってもよい。その他に、記録装置がデジタル入力したトランスポート・ストリームをパーシャル化することで得られるトランスポート・ストリームであってもよい。
本発明の実施形態1による再生装置は更に、マネージド・コピーによってBD-ROMディスク101上のデジタル・ストリームを他の記録媒体へ書き込んでもよい。「マネージド・コピー」とは、BD-ROMディスク等の読み出し専用記録媒体から書き込み可能な記録媒体へ、デジタル・ストリーム、プレイリスト・ファイル、クリップ情報ファイル、及びアプリケーション・プログラムをコピーすることを、サーバとの通信による認証が成功した場合にのみ許可するための技術をいう。その書き込み可能な記録媒体は、BD-R、BD-RE、DVD-R、DVD-RW、及びDVD-RAM等の書き込み可能な光ディスク、ハードディスク、並びに、SDメモリカード、メモリースティック(登録商標)、コンパクトフラッシュ(登録商標)、スマートメディア(登録商標)、及びマルチメディアカード(登録商標)等の可搬性半導体メモリ装置を含む。マネージド・コピーは、読み出し専用記録媒体に記録されたデータのバックアップ回数の制限、及びバックアップ処理に対する課金を可能にする。
本発明の実施形態1によるデータ構造のうち、「所定型の情報が複数存在する」という繰り返し構造は、for文に制御変数の初期値と繰り返し条件とを記述することによって定義される。また、「所定の条件が成立するときに所定の情報が定義される」というデータ構造は、if文にその条件と、その条件の成立時に設定されるべき変数とを記述することによって定義される。このように、実施形態1によるデータ構造は高級プログラミング言語によって記述される。従って、そのデータ構造は、「構文解析」、「最適化」、「資源割付」、及び「コード生成」といったコンパイラによる翻訳過程を経て、コンピュータによって読み取り可能なコードに変換され、記録媒体に記録される。高級プログラミング言語での記述により、そのデータ構造は、オブジェクト指向言語におけるクラス構造体のメソッド以外の部分、具体的には、そのクラス構造体における配列型のメンバー変数として扱われ、プログラムの一部を成す。すなわち、そのデータ構造は、プログラムと実質的に同等である。従って、そのデータ構造はコンピュータ関連の発明として保護を受けるべきである。
プレイリスト・ファイルとAVストリーム・ファイルとが記録媒体に記録されるとき、その記録媒体には再生プログラムが実行形式のファイルとして記録される。再生プログラムはコンピュータに、プレイリスト・ファイルに従ってAVストリーム・ファイルを再生させる。再生プログラムは記録媒体からコンピュータ内のメモリ装置にロードされた後、そのコンピュータによって実行される。そのロード処理はコンパイル処理又はリンク処理を含む。それらの処理により、再生プログラムはメモリ装置内では複数のセクションに分割される。それらのセクションは、textセクション、dataセクション、bssセクション、及びstackセクションを含む。textセクションは、再生プログラムのコード列、変数の初期値、及び書き換え不可のデータを含む。dataセクションは、初期値を持つ変数、及び書き換え可能なデータを含む。dataセクションは特に、記録媒体上に記録された、随時アクセスされるファイルを含む。bssセクションは、初期値を持たない変数を含む。bssセクション内のデータは、textセクション内のコードの示す命令に応じて参照される。コンパイル処理又はリンク処理では、コンピュータ内のRAMにbssセクション用の領域が確保される。stackセクションは、必要に応じて一時的に確保されるメモリ領域である。再生プログラムによる各処理ではローカル変数が一時的に使用される。stackセクションはそれらのローカル変数を含む。プログラムの実行が開始されるとき、bssセクション内の変数はゼロで初期化され、stackセクションには必要なメモリ領域が確保される。
702 ライトビュー・ビデオ・ストリーム
710-719 ベースビュー・ピクチャ
720-729 ディペンデントビュー・ピクチャ
731、732 GOP
Claims (8)
- 平面視映像の再生に利用されるメインビュー・ストリーム、及び、前記メインビュー・ストリームと組み合わされて立体視映像の再生に利用されるサブビュー・ストリームが記録された記録媒体であって、
前記メインビュー・ストリームは複数のメインビュー・ピクチャを含み、
前記サブビュー・ストリームは複数のサブビュー・ピクチャを含み、
前記複数のメインビュー・ピクチャと前記複数のサブビュー・ピクチャとは一対一に対応し、
前記複数のサブビュー・ピクチャのうち、対応するメインビュー・ピクチャがIピクチャとPピクチャとのいずれかであるサブビュー・ピクチャの圧縮には、Bピクチャが参照ピクチャとして利用されていない、
記録媒体。 - 平面視映像の再生に利用されるメインビュー・ストリーム、及び、前記メインビュー・ストリームと組み合わされて立体視映像の再生に利用されるサブビュー・ストリームが記録された記録媒体であって、
前記サブビュー・ストリームは、前記メインビュー・ストリームを参照して符号化されており、
前記メインビュー・ストリームは複数のメインビュー・ピクチャと少なくとも一つのメインビュー・ピクチャ・ヘッダとを含み、
前記サブビュー・ストリームは複数のサブビュー・ピクチャと少なくとも一つのサブビュー・ピクチャ・ヘッダとを含み、
前記メインビュー・ピクチャ・ヘッダは、メインビュー・ピクチャの符号化方式を示す情報を含み、
前記サブビュー・ピクチャ・ヘッダは、サブビュー・ピクチャの符号化方式を示す情報を含み、
各メインビュー・ピクチャは、前記メインビュー・ピクチャ・ヘッダを参照するが、前記サブビュー・ピクチャ・ヘッダを参照せず、
各サブビュー・ピクチャは、前記サブビュー・ピクチャ・ヘッダを参照するが、前記メインビュー・ピクチャ・ヘッダを参照しない、
記録媒体。 - 記録媒体から映像を再生するための再生装置であって、
平面視映像の再生に利用されるメインビュー・ストリーム、及び、前記メインビュー・ストリームと組み合わされて立体視映像の再生に利用されるサブビュー・ストリームを前記記録媒体から読み出す読み出し部、及び、
前記読み出し部によって読み出されたストリーム・データから圧縮ピクチャを抽出して復号する復号部、
を備え、
前記復号部は、
前記メインビュー・ストリームに含まれる複数のメインビュー・ピクチャのそれぞれの復号方法を当該メインビュー・ピクチャの符号化方式に合わせて選択し、
前記サブビュー・ストリームに含まれ、かつ、前記複数のメインビュー・ピクチャと一対一に対応する複数のサブビュー・ピクチャのそれぞれの復号方法を当該サブビュー・ピクチャの符号化方式に合わせて選択し、
前記複数のサブビュー・ピクチャのうち、対応するメインビュー・ピクチャがIピクチャとPピクチャとのいずれかであるサブビュー・ピクチャの復号には、Bピクチャを参照ピクチャとして利用しない、
再生装置。 - 記録媒体から映像を再生するための再生装置であって、
平面視映像の再生に利用されるメインビュー・ストリーム、及び、前記メインビュー・ストリームと組み合わされて立体視映像の再生に利用されるサブビュー・ストリームを前記記録媒体から読み出す読み出し部、及び、
前記読み出し部によって読み出されたストリーム・データから圧縮ピクチャを抽出して復号する復号部、
を備え、
前記復号部は、
前記メインビュー・ストリームに含まれるメインビュー・ピクチャ・ヘッダを参照するが、前記サブビュー・ストリームに含まれるサブビュー・ピクチャ・ヘッダを参照することなく、前記メインビュー・ストリームに含まれる複数のメインビュー・ピクチャのそれぞれの符号化方式を決定し、当該符号化方式に合わせて当該メインビュー・ピクチャの復号方法を選択し、
前記サブビュー・ピクチャ・ヘッダを参照するが、前記メインビュー・ピクチャ・ヘッダを参照することなく、前記サブビュー・ストリームに含まれる複数のサブビュー・ピクチャのそれぞれの符号化方式を決定し、当該符号化方式に合わせて当該サブビュー・ピクチャの復号方法を選択する、
再生装置。 - 平面視映像の再生に利用されるメインビュー・ストリーム、及び、前記メインビュー・ストリームと組み合わされて立体視映像の再生に利用されるサブビュー・ストリームから映像を再生するための再生装置であって、
前記メインビュー・ストリームと前記サブビュー・ストリームとから圧縮ピクチャを抽出し、前記圧縮ピクチャに含まれるヘッダを解析し、かつ前記圧縮ピクチャを復号する復号部、及び、
前記復号部によって解析された前記圧縮ピクチャのヘッダから前記圧縮ピクチャの復号方法を決定して前記復号部に指示する制御部、
を備え、
前記制御部が、前記メインビュー・ストリームに含まれる圧縮ピクチャのヘッダから当該圧縮ピクチャの復号方法を決定する間に、前記復号部は、前記サブビュー・ストリームに含まれる圧縮ピクチャのヘッダ解析と復号とのいずれかを行い、
前記制御部が、前記サブビュー・ストリームに含まれる圧縮ピクチャのヘッダから当該圧縮ピクチャの復号方法を決定する間に、前記復号部は、前記メインビュー・ストリームに含まれる圧縮ピクチャの復号を行う、
再生装置。 - 平面視映像の再生に利用されるメインビュー・ストリーム、及び、前記メインビュー・ストリームと組み合わされて立体視映像の再生に利用されるサブビュー・ストリーム、を含むストリーム・データに対して映像・音声信号処理を行う半導体集積回路であって、
前記メインビュー・ストリームは複数のメインビュー・ピクチャを含み、
前記サブビュー・ストリームは複数のサブビュー・ピクチャを含み、
前記複数のメインビュー・ピクチャと前記複数のサブビュー・ピクチャとは一対一に対応し、
前記ストリーム・データにおいて、前記メインビュー・ストリームは複数のメインビュー・データ群に分割され、前記サブビュー・ストリームは複数のサブビュー・データ群に分割され、前記複数のメインビュー・データ群と前記複数のサブビュー・データ群とは交互に配置されており、
前記複数のメインビュー・データ群の各々と前記複数のサブビュー・データ群の各々とは映像系データを含み、
前記複数のメインビュー・データ群と前記複数のサブビュー・データ群との少なくともいずれかは音声系データを含み、
前記半導体集積回路は、
前記半導体集積回路の制御を行う主制御部と、
前記ストリーム・データを受信し、前記半導体集積回路の内部もしくは外部に設けられたメモリに一旦格納した後、前記映像系データと前記音声系データとに多重分離するストリーム処理部と、
前記音声系データと前記映像系データとをそれぞれ復号する信号処理部と、
復号された前記映像系データと前記音声系データとを出力するAV出力部と
を備えており、
前記ストリーム処理部は、受信した前記ストリーム・データの格納先を前記メモリ内の第1の領域と第2の領域との間で切り替える切替部を備えており、
前記主制御部は前記切替部を制御して、前記複数のメインビュー・データ群に属しているデータを前記第1の領域に格納させ、前記サブビュー・データ群に属しているデータを前記第2の領域に格納させ、
前記信号処理部は、前記複数のメインビュー・ピクチャのそれぞれの復号方法を当該メインビュー・ピクチャの符号化方式に合わせて選択し、前記複数のメインビュー・ピクチャと一対一に対応する複数のサブビュー・ピクチャのそれぞれの復号方法を当該サブビュー・ピクチャの符号化方式に合わせて選択し、前記複数のサブビュー・ピクチャのうち、対応するメインビュー・ピクチャがIピクチャとPピクチャとのいずれかであるサブビュー・ピクチャの復号には、Bピクチャを参照ピクチャとして利用しない
ことを特徴とする半導体集積回路。 - 平面視映像の再生に利用されるメインビュー・ストリーム、及び、前記メインビュー・ストリームと組み合わされて立体視映像の再生に利用されるサブビュー・ストリーム、を含むストリーム・データに対して映像・音声信号処理を行う半導体集積回路であって、
前記ストリーム・データにおいて、前記メインビュー・ストリームは複数のメインビュー・データ群に分割され、前記サブビュー・ストリームは複数のサブビュー・データ群に分割され、前記複数のメインビュー・データ群と前記複数のサブビュー・データ群とは交互に配置されており、
前記複数のメインビュー・データ群の各々と前記複数のサブビュー・データ群の各々とは映像系データを含み、
前記複数のメインビュー・データ群と前記複数のサブビュー・データ群との少なくともいずれかは音声系データを含み、
前記メインビュー・ストリームは複数のメインビュー・ピクチャと少なくとも一つのメインビュー・ピクチャ・ヘッダとを含み、
前記サブビュー・ストリームは複数のサブビュー・ピクチャと少なくとも一つのサブビュー・ピクチャ・ヘッダとを含み、
前記メインビュー・ピクチャ・ヘッダは、メインビュー・ピクチャの符号化方式を示す情報を含み、
前記サブビュー・ピクチャ・ヘッダは、サブビュー・ピクチャの符号化方式を示す情報を含み、
前記半導体集積回路は、
前記半導体集積回路の制御を行う主制御部と、
前記ストリーム・データを受信し、前記半導体集積回路の内部もしくは外部に設けられたメモリに一旦格納した後、前記映像系データと前記音声系データとに多重分離するストリーム処理部と、
前記音声系データと前記映像系データとをそれぞれ復号する信号処理部と、
復号された前記映像系データと前記音声系データとを出力するAV出力部と
を備えており、
前記ストリーム処理部は、受信した前記ストリーム・データの格納先を前記メモリ内の第1の領域と第2の領域との間で切り替える切替部を備えており、
前記主制御部は前記切替部を制御して、前記複数のメインビュー・データ群に属しているデータを前記第1の領域に格納させ、前記サブビュー・データ群に属しているデータを前記第2の領域に格納させ、
前記信号処理部は、前記メインビュー・ピクチャ・ヘッダを参照するが、前記サブビュー・ピクチャ・ヘッダを参照することなく、前記複数のメインビュー・ピクチャのそれぞれの符号化方式を決定し、当該符号化方式に合わせて当該メインビュー・ピクチャの復号方法を選択し、
前記信号処理部は、前記サブビュー・ピクチャ・ヘッダを参照するが、前記メインビュー・ピクチャ・ヘッダを参照することなく、前記複数のサブビュー・ピクチャのそれぞれの符号化方式を決定し、当該符号化方式に合わせて当該サブビュー・ピクチャの復号方法を選択する
ことを特徴とする半導体集積回路。 - 平面視映像の再生に利用されるメインビュー・ストリーム、及び、前記メインビュー・ストリームと組み合わされて立体視映像の再生に利用されるサブビュー・ストリームから映像を再生するための再生装置に搭載される集積回路であって、
前記メインビュー・ストリームと前記サブビュー・ストリームとから圧縮ピクチャを抽出し、前記圧縮ピクチャに含まれるヘッダを解析し、かつ前記圧縮ピクチャを復号する復号部、及び、
前記復号部によって解析された前記圧縮ピクチャのヘッダから前記圧縮ピクチャの復号方法を決定して前記復号部に指示する制御部、
を備え、
前記制御部が、前記メインビュー・ストリームに含まれる圧縮ピクチャのヘッダから当該圧縮ピクチャの復号方法を決定する間に、前記復号部は、前記サブビュー・ストリームに含まれる圧縮ピクチャのヘッダ解析と復号とのいずれかを行い、
前記制御部が、前記サブビュー・ストリームに含まれる圧縮ピクチャのヘッダから当該圧縮ピクチャの復号方法を決定する間に、前記復号部は、前記メインビュー・ストリームに含まれる圧縮ピクチャの復号を行う、
集積回路。
Priority Applications (7)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
RU2011103190/08A RU2011103190A (ru) | 2009-02-27 | 2010-02-26 | Носитель записи, устройство воспроизведения и интегральная схема |
US13/056,029 US20110149049A1 (en) | 2009-02-27 | 2010-02-26 | Recording medium, reproduction device, and integrated circuit |
JP2011501522A JPWO2010098134A1 (ja) | 2009-02-27 | 2010-02-26 | 記録媒体、再生装置、及び集積回路 |
BRPI1004210A BRPI1004210A2 (pt) | 2009-02-27 | 2010-02-26 | meio de gravação, dispositivo e reprodução, e circuito integrado |
MX2011001210A MX2011001210A (es) | 2009-02-27 | 2010-02-26 | Medio de grabacion, dispositivo de reproduccion, y circuito integrado. |
CN2010800023094A CN102124748A (zh) | 2009-02-27 | 2010-02-26 | 记录介质、再生装置及集成电路 |
EP10746017A EP2403259A4 (en) | 2009-02-27 | 2010-02-26 | RECORDING MEDIUM, PLAYING DEVICE AND INTEGRATED CIRCUIT |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009-047174 | 2009-02-27 | ||
JP2009047174 | 2009-02-27 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010098134A1 true WO2010098134A1 (ja) | 2010-09-02 |
Family
ID=42665347
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2010/001339 WO2010098134A1 (ja) | 2009-02-27 | 2010-02-26 | 記録媒体、再生装置、及び集積回路 |
Country Status (9)
Country | Link |
---|---|
US (1) | US20110149049A1 (ja) |
EP (1) | EP2403259A4 (ja) |
JP (1) | JPWO2010098134A1 (ja) |
KR (1) | KR20110132546A (ja) |
CN (1) | CN102124748A (ja) |
BR (1) | BRPI1004210A2 (ja) |
MX (1) | MX2011001210A (ja) |
RU (1) | RU2011103190A (ja) |
WO (1) | WO2010098134A1 (ja) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010263612A (ja) * | 2009-04-07 | 2010-11-18 | Sony Corp | 情報処理装置、情報処理方法、再生装置、再生方法、およびプログラム |
JP2012138927A (ja) * | 2009-04-07 | 2012-07-19 | Sony Corp | 再生装置、再生方法、および記録方法 |
JP2012186544A (ja) * | 2011-03-03 | 2012-09-27 | Nippon Telegr & Teleph Corp <Ntt> | ステレオ動画像符号化方法、装置およびプログラム |
EP2613531A1 (en) * | 2010-09-03 | 2013-07-10 | Sony Corporation | Encoding device and encoding method, as well as decoding device and decoding method |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5568465B2 (ja) | 2008-09-18 | 2014-08-06 | パナソニック株式会社 | 画像復号装置、画像符号化装置、画像復号方法、画像符号化方法およびプログラム |
US9351028B2 (en) * | 2011-07-14 | 2016-05-24 | Qualcomm Incorporated | Wireless 3D streaming server |
US9813350B2 (en) * | 2012-01-31 | 2017-11-07 | Sharp Kabushiki Kaisha | Generation device, reproduction device, data structure, generation method, reproduction method, control program, and recording medium |
US9924200B2 (en) | 2013-01-24 | 2018-03-20 | Microsoft Technology Licensing, Llc | Adaptive noise reduction engine for streaming video |
TW201528775A (zh) | 2014-01-02 | 2015-07-16 | Ind Tech Res Inst | 景深圖校正方法及系統 |
US20150253974A1 (en) | 2014-03-07 | 2015-09-10 | Sony Corporation | Control of large screen display using wireless portable computer interfacing with display controller |
CN110955733A (zh) * | 2020-01-02 | 2020-04-03 | 北京同有飞骥科技股份有限公司 | 分布式系统的数据均衡方法及系统 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11191895A (ja) * | 1996-12-04 | 1999-07-13 | Matsushita Electric Ind Co Ltd | 高解像度および立体映像記録用光ディスク、光ディスク再生装置、および光ディスク記録装置 |
WO2006072992A1 (ja) * | 2005-01-07 | 2006-07-13 | Fujitsu Limited | 圧縮符号化装置、伸張復号化装置 |
JP3935507B2 (ja) | 1996-02-28 | 2007-06-27 | 松下電器産業株式会社 | 高解像度および立体映像記録用光ディスク、光ディスク再生装置、光ディスク記録装置 |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2208950A1 (en) * | 1996-07-03 | 1998-01-03 | Xuemin Chen | Rate control for stereoscopic digital video encoding |
JPH10243419A (ja) * | 1997-02-26 | 1998-09-11 | Toshiba Corp | 立体視画像符号化・復号化方法及び装置 |
WO1999012348A1 (en) * | 1997-08-29 | 1999-03-11 | Matsushita Electric Industrial Co., Ltd. | Optical disc for recording high resolution and normal image, optical disc player, optical disc recorder, and playback control information generator |
JP2001054140A (ja) * | 1999-08-11 | 2001-02-23 | Sukurudo Enterprise Kk | ステレオ映像帯域圧縮符号化方法および復号化方法ならびに記録媒体 |
JP4541537B2 (ja) * | 2000-12-28 | 2010-09-08 | パナソニック株式会社 | 描画装置 |
US7489362B2 (en) * | 2003-03-04 | 2009-02-10 | Broadcom Corporation | Television functionality on a chip |
US20070247477A1 (en) * | 2006-04-21 | 2007-10-25 | Lowry Gregory N | Method and apparatus for processing, displaying and viewing stereoscopic 3D images |
JP2009135686A (ja) * | 2007-11-29 | 2009-06-18 | Mitsubishi Electric Corp | 立体映像記録方法、立体映像記録媒体、立体映像再生方法、立体映像記録装置、立体映像再生装置 |
CN102273210B (zh) * | 2008-12-02 | 2014-08-13 | Lg电子株式会社 | 3d字幕显示方法和实现该方法的3d显示装置 |
-
2010
- 2010-02-26 US US13/056,029 patent/US20110149049A1/en not_active Abandoned
- 2010-02-26 EP EP10746017A patent/EP2403259A4/en not_active Withdrawn
- 2010-02-26 BR BRPI1004210A patent/BRPI1004210A2/pt not_active IP Right Cessation
- 2010-02-26 RU RU2011103190/08A patent/RU2011103190A/ru unknown
- 2010-02-26 CN CN2010800023094A patent/CN102124748A/zh active Pending
- 2010-02-26 KR KR1020117002408A patent/KR20110132546A/ko not_active Application Discontinuation
- 2010-02-26 JP JP2011501522A patent/JPWO2010098134A1/ja active Pending
- 2010-02-26 WO PCT/JP2010/001339 patent/WO2010098134A1/ja active Application Filing
- 2010-02-26 MX MX2011001210A patent/MX2011001210A/es not_active Application Discontinuation
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3935507B2 (ja) | 1996-02-28 | 2007-06-27 | 松下電器産業株式会社 | 高解像度および立体映像記録用光ディスク、光ディスク再生装置、光ディスク記録装置 |
JPH11191895A (ja) * | 1996-12-04 | 1999-07-13 | Matsushita Electric Ind Co Ltd | 高解像度および立体映像記録用光ディスク、光ディスク再生装置、および光ディスク記録装置 |
WO2006072992A1 (ja) * | 2005-01-07 | 2006-07-13 | Fujitsu Limited | 圧縮符号化装置、伸張復号化装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2403259A4 |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2010263612A (ja) * | 2009-04-07 | 2010-11-18 | Sony Corp | 情報処理装置、情報処理方法、再生装置、再生方法、およびプログラム |
JP2012138927A (ja) * | 2009-04-07 | 2012-07-19 | Sony Corp | 再生装置、再生方法、および記録方法 |
US8582953B2 (en) | 2009-04-07 | 2013-11-12 | Sony Corporation | Information processing device, information processing method, playing device, playing method, and program |
US9781402B2 (en) | 2009-04-07 | 2017-10-03 | Sony Corporation | Information processing device, information processing method, playing device, playing method, and program |
EP2613531A1 (en) * | 2010-09-03 | 2013-07-10 | Sony Corporation | Encoding device and encoding method, as well as decoding device and decoding method |
EP2613531A4 (en) * | 2010-09-03 | 2014-08-06 | Sony Corp | DEVICE AND ENCODING METHOD, AND DEVICE, AND DECODING METHOD |
US9667941B2 (en) | 2010-09-03 | 2017-05-30 | Sony Corporation | Encoding device, encoding method, decoding device, and decoding method |
JP2012186544A (ja) * | 2011-03-03 | 2012-09-27 | Nippon Telegr & Teleph Corp <Ntt> | ステレオ動画像符号化方法、装置およびプログラム |
Also Published As
Publication number | Publication date |
---|---|
RU2011103190A (ru) | 2013-04-10 |
BRPI1004210A2 (pt) | 2016-02-23 |
US20110149049A1 (en) | 2011-06-23 |
EP2403259A1 (en) | 2012-01-04 |
EP2403259A4 (en) | 2013-03-27 |
KR20110132546A (ko) | 2011-12-08 |
JPWO2010098134A1 (ja) | 2012-08-30 |
MX2011001210A (es) | 2011-03-04 |
CN102124748A (zh) | 2011-07-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4642939B2 (ja) | 記録媒体、再生装置、及び集積回路 | |
JP4676579B2 (ja) | 記録媒体、再生装置、及び集積回路 | |
WO2010100875A1 (ja) | 記録媒体、再生装置、及び集積回路 | |
JP5551654B2 (ja) | 半導体集積回路 | |
JP4654327B2 (ja) | 記録媒体、及び再生装置 | |
WO2010089995A1 (ja) | 記録媒体、再生装置、及び集積回路 | |
US8045844B2 (en) | Recording medium, playback apparatus, and integrated circuit | |
JP5491414B2 (ja) | 記録媒体、再生装置、及び集積回路 | |
WO2010095440A1 (ja) | 記録媒体、再生装置、及び集積回路 | |
JP5385217B2 (ja) | 記録媒体、再生装置、及び集積回路 | |
WO2010098134A1 (ja) | 記録媒体、再生装置、及び集積回路 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201080002309.4 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10746017 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011501522 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010746017 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 422/KOLNP/2011 Country of ref document: IN |
|
ENP | Entry into the national phase |
Ref document number: 20117002408 Country of ref document: KR Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2011/001210 Country of ref document: MX |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13056029 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011103190 Country of ref document: RU |
|
ENP | Entry into the national phase |
Ref document number: PI1004210 Country of ref document: BR Kind code of ref document: A2 Effective date: 20110131 |