WO2010052857A1 - 再生装置、再生方法、再生プログラム、及び集積回路 - Google Patents
再生装置、再生方法、再生プログラム、及び集積回路 Download PDFInfo
- Publication number
- WO2010052857A1 WO2010052857A1 PCT/JP2009/005713 JP2009005713W WO2010052857A1 WO 2010052857 A1 WO2010052857 A1 WO 2010052857A1 JP 2009005713 W JP2009005713 W JP 2009005713W WO 2010052857 A1 WO2010052857 A1 WO 2010052857A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- playback
- image data
- video
- unit
- application program
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 88
- 230000015654 memory Effects 0.000 claims abstract description 163
- 230000008859 change Effects 0.000 claims abstract description 20
- 238000012545 processing Methods 0.000 claims description 105
- 230000006870 function Effects 0.000 claims description 33
- 238000009877 rendering Methods 0.000 claims description 23
- 238000003780 insertion Methods 0.000 claims description 7
- 230000037431 insertion Effects 0.000 claims description 7
- 238000004364 calculation method Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 73
- 238000010586 diagram Methods 0.000 description 50
- 238000001094 photothermal spectroscopy Methods 0.000 description 37
- 238000009826 distribution Methods 0.000 description 33
- 238000007726 management method Methods 0.000 description 31
- 239000004065 semiconductor Substances 0.000 description 29
- 238000003860 storage Methods 0.000 description 21
- 230000005540 biological transmission Effects 0.000 description 20
- 239000008186 active pharmaceutical agent Substances 0.000 description 18
- 239000000872 buffer Substances 0.000 description 18
- 230000003287 optical effect Effects 0.000 description 15
- 230000004044 response Effects 0.000 description 15
- 238000001514 detection method Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 10
- 239000000284 extract Substances 0.000 description 10
- 230000002452 interceptive effect Effects 0.000 description 9
- 230000003068 static effect Effects 0.000 description 9
- 239000004973 liquid crystal related substance Substances 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 230000005236 sound signal Effects 0.000 description 6
- 238000012546 transfer Methods 0.000 description 6
- 230000006835 compression Effects 0.000 description 5
- 238000007906 compression Methods 0.000 description 5
- 238000006073 displacement reaction Methods 0.000 description 5
- 238000003491 array Methods 0.000 description 4
- 239000011521 glass Substances 0.000 description 4
- 101000823103 Equus caballus Alpha-1-antiproteinase 4 Proteins 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 238000003825 pressing Methods 0.000 description 3
- 238000003786 synthesis reaction Methods 0.000 description 3
- 230000007704 transition Effects 0.000 description 3
- 102100028505 6-pyruvoyl tetrahydrobiopterin synthase Human genes 0.000 description 2
- 230000004913 activation Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 239000002131 composite material Substances 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000007257 malfunction Effects 0.000 description 2
- 239000000047 product Substances 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 102100036727 Deformed epidermal autoregulatory factor 1 homolog Human genes 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000003139 buffering effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000001824 photoionisation detection Methods 0.000 description 1
- 230000002250 progressing effect Effects 0.000 description 1
- 230000001172 regenerating effect Effects 0.000 description 1
- 238000013468 resource allocation Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000003892 spreading Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
- G11B20/0021—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
- G11B20/0021—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
- G11B20/00217—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier the cryptographic key used for encryption and/or decryption of contents recorded on or reproduced from the record carrier being read from a specific source
- G11B20/00246—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier the cryptographic key used for encryption and/or decryption of contents recorded on or reproduced from the record carrier being read from a specific source wherein the key is obtained from a local device, e.g. device key initially stored by the player or by the recorder
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
- G11B20/0021—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
- G11B20/00217—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier the cryptographic key used for encryption and/or decryption of contents recorded on or reproduced from the record carrier being read from a specific source
- G11B20/00253—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier the cryptographic key used for encryption and/or decryption of contents recorded on or reproduced from the record carrier being read from a specific source wherein the key is stored on the record carrier
- G11B20/00362—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier the cryptographic key used for encryption and/or decryption of contents recorded on or reproduced from the record carrier being read from a specific source wherein the key is stored on the record carrier the key being obtained from a media key block [MKB]
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/00086—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy
- G11B20/0021—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier
- G11B20/00485—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier characterised by a specific kind of data which is encrypted and recorded on and/or reproduced from the record carrier
- G11B20/00492—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier characterised by a specific kind of data which is encrypted and recorded on and/or reproduced from the record carrier wherein content or user data is encrypted
- G11B20/00528—Circuits for prevention of unauthorised reproduction or copying, e.g. piracy involving encryption or decryption of contents recorded on or reproduced from a record carrier characterised by a specific kind of data which is encrypted and recorded on and/or reproduced from the record carrier wherein content or user data is encrypted wherein each title is encrypted with a separate encryption key for each title, e.g. title key for movie, song or data file
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
- G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
- G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
- G11B27/327—Table of contents
- G11B27/329—Table of contents on a disc [VTOC]
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/34—Indicating arrangements
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/20—Disc-shaped record carriers
- G11B2220/21—Disc-shaped record carriers characterised in that the disc is of read-only, rewritable, or recordable type
- G11B2220/213—Read-only discs
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B2220/00—Record carriers by type
- G11B2220/20—Disc-shaped record carriers
- G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
- G11B2220/2537—Optical discs
- G11B2220/2541—Blu-ray discs; Blue laser DVR discs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/84—Television signal recording using optical recording
Definitions
- the present invention relates to a stereoscopic video reproduction technique, and more particularly, to a technique for superimposing and displaying a graphics video on a stereoscopic video.
- BD read-only Blu-ray Disc
- the content on the BD-ROM disc is composed of at least one title.
- the “title” is expressed by a combination of an application program, a video / audio stream, and image data.
- the image data represents graphics video such as subtitles and graphics user interface (GUI), and background video.
- GUI graphics user interface
- the resolution of the video stream varies from a standard image quality of 720 ⁇ 480 according to the NTSC standard to a high image quality of up to 1920 ⁇ 1080.
- the BD-ROM playback device reads an application program corresponding to the title from the BD-ROM disc and executes it.
- the application program causes the playback device to select one suitable for the playback environment from among the image data, and writes it to a different plane memory for video, graphics, and background.
- the data held in each plane memory, that is, the plane is processed in parallel and then combined into a single video frame.
- the BD-ROM playback device can reproduce appropriate video / audio on various display devices (see, for example, Patent Document 1).
- an application program when a playback device can be connected to an external network such as the Internet, an application program can cause the playback device to download new digital content from the external network.
- contents include content added to the contents on the BD-ROM disc such as privilege video and subtitles, and interactive contents such as a browser screen and a game.
- the application program further causes the playback device to display the subtitles downloaded from the external network overlaid on the playback video from the BD-ROM disc, and the browser screen downloaded from the external network on the same screen as the video Can be displayed together.
- These functions are called “BD-Live” (registered trademark). With the widespread use of BD-ROM playback devices, user interest in the BD-Live function is increasing.
- the spread of the BD-ROM playback device further increases the possibility of spreading the display technology of stereoscopic video (also referred to as three-dimensional (3D) video) to each home.
- Stereoscopic video display technology is considered promising as the next generation display technology, and its development is rapidly progressing.
- the display technology basically uses the fact that “a person perceives the three-dimensional shape and depth of an object from binocular parallax” (see, for example, Patent Documents 1-3 and Non-Patent Document 1). Specifically, first, two video frames, that is, a left-view video frame and a right-view video frame are prepared for one scene. Between these frames, the horizontal position and orientation of the same subject are slightly different.
- the left-view video frame is projected to the viewer's left eye, and almost simultaneously, the right-view video frame is projected to the right eye.
- the viewer perceives the three-dimensional shape and depth of the subject from slight displacement and posture change of the subject between frames seen by each eye, that is, binocular parallax.
- the stereoscopic image display technique requires two frames for each scene. Accordingly, a stereoscopic video has a larger amount of data per display time than a planar video (also referred to as a two-dimensional (2D) video). Therefore, a BD-ROM disc and a BD-ROM playback device are advantageous for the stereoscopic image display technology.
- each plane memory has a capacity that can cope with a high image quality of 1920 ⁇ 1080.
- an image data area is provided in a memory device built in the BD-ROM playback device. In the image data area, image data read from the BD-ROM disc is stored in a decoded state. The image data stored in the image data area is written in different plane memories, for example, for the interactive screen and the background.
- a cache area is provided in the built-in memory device. The cache area stores image data downloaded from the external network.
- the BD-ROM playback device requires a large capacity memory for storing and processing image data. Therefore, when a stereoscopic video display function is added to the BD-ROM playback device, additional capacity such as the capacity of the plane memory to be added is required to suppress the increase in the manufacturing cost of the playback device as much as possible. It is desirable to reduce the memory capacity as much as possible.
- the memory area for storing the image data may be changed dynamically.
- the cache area used for the BD-Live function can be used for holding the left and right image planes.
- both the memory area for storing image data and the cache area are fixed in accordance with the hardware environment such as the presence or absence of connection to an external network.
- application programs belonging to each title are designed on the premise of static allocation of memory areas.
- an application program that uses the BD-Live function requires a cache area having a capacity equal to a fixed value. Therefore, if the memory area is changed while these application programs are running, the image data downloaded from the external network by the application program may be written to a memory area other than the cache area. Sex occurs.
- An object of the present invention is to solve the above-described problems, and in particular, to provide a playback device capable of playing back digital content with a higher stereoscopic effect of graphics images without increasing the memory capacity. It is in.
- a playback device includes a reading unit, a virtual machine unit, a memory unit, a playback unit, and a management unit.
- the reading unit reads an application program, image data, a video stream, and an application management file from the recording medium.
- the virtual machine unit executes the application program.
- the memory unit includes an image data area for storing the image data.
- the reproduction unit reproduces video data from the image data and the video stream according to the application program.
- the management unit instructs the virtual machine unit to start and end the application program, and instructs the memory unit to change the image data area.
- the management unit instructs the memory unit to change the image data area, it is compulsory even if the application program is specified in the virtual machine unit and the continuation of the execution is specified in the application management file. To finish.
- the playback device changes the image data area after forcibly terminating the application program read from the recording medium.
- the image data area can be dynamically changed while reliably preventing malfunction of the application program.
- the image data area can be reduced, and the free area generated thereby can be used to hold both the left-view and right-view image planes.
- the above-described playback apparatus can play back digital content with a higher stereoscopic effect of graphics video without increasing the memory capacity.
- FIG. 2 is a schematic diagram showing a data structure on a BD-ROM disc 100 according to Embodiment 1 of the present invention.
- (A) is a schematic diagram showing the data structure of a BD-J object
- (b) is a schematic diagram showing the life cycle of six types of application programs A1-A5 and A11.
- State transition diagram showing states 1-4 of the playback device according to the first embodiment of the present invention Schematic diagram showing the data structure of the JAR file 237A shown in FIG.
- FIG. 13 Schematic diagram showing the data structure of the 3D metadata 1103 shown in FIG. Schematic diagram showing the data structure of the second playlist file 233B shown in FIG. Schematic diagram showing the data structure of the play item information 1400 shown in FIG. Schematic diagram showing playlist information 1301 shown in FIG. 13 and AV clips CL1, CL2, and CL4 to be played according to the playlist information 1301.
- the block diagram which shows the hardware constitutions of the reproducing
- FIG. 19 is a schematic diagram showing image planes stored in the offset mode and the two-plane mode in the IG plane memory area 1911 shown in FIG. Functional block diagram of state 1 of adder 1807 shown in FIG. Functional block diagram in state 2 of the adder 1807 shown in FIG.
- the schematic diagram which shows the cropping process with respect to PG plane GP by the 2nd cropping processor 2212 shown by FIG.
- FIG. 1 is a schematic diagram showing a home theater system including a playback device according to Embodiment 1 of the present invention.
- the home theater system includes a recording medium 100, a playback device 110, a display device 120, shutter glasses 130, and a remote controller 140.
- the recording medium 100 is a BD-ROM disc.
- the recording medium 100 may be another portable recording medium, for example, a semiconductor memory device such as an optical disk, a magneto-optical disk, a flexible disk, a removable hard disk drive (HDD), or an SD memory card using another method such as a DVD. Good.
- the BD-ROM disc 100 stores 3D video movie content.
- the movie content includes a left-view and right-view video stream pair.
- the playback device 110 is equipped with a BD-ROM drive 111.
- the BD-ROM drive 111 is an optical disk drive conforming to the BD-ROM system.
- the playback apparatus 110 reads movie content from the BD-ROM disc 100 using the BD-ROM drive 111.
- the playback device 110 further decodes the movie content into video data / audio data.
- the video data is a video frame of either a left view or a right view. Including only.
- both the playback device 110 and the display device 120 are capable of displaying 3D video, the video data includes both left-view and right-view video frames.
- the playback device 110 is connected to the display device 120 via an HDMI (High-Definition Multimedia Interface) cable 112.
- the playback device 110 converts the video data / audio data into an HDMI video signal / audio signal and transmits it to the display device 120 through the HDMI cable 112.
- the playback device 110 exchanges CEC messages with the display device 120 through the HDMI cable 112. Thereby, the playback device 110 inquires of the display device 120 whether or not the display device 120 can support the display of 3D video.
- the playback device 110 is connected to an external network 150 such as the Internet, and can communicate with the server device 160 through the external network 150.
- the playback device 110 is compatible with the BD-Live function. That is, the playback device 110 can download new content from the server device 160 and play it back.
- the new content includes content added to the movie content on the BD-ROM disc 100 and interactive content.
- the additional content includes sub-audio, subtitles, and application programs to be added to the movie content, and privileged video related to the movie content.
- Interactive content includes browser screens and games.
- the playback device 110 displays the video of the additional content such as captions superimposed on the video played from the BD-ROM disc 100, or displays the video of the interactive content such as a browser screen on the same screen as the video. it can.
- the display device 120 is a liquid crystal display.
- the display device 120 may be another type of flat panel display or projector such as a plasma display and an organic EL display.
- the display device 120 reproduces the video on the screen 121 according to the video signal, and generates sound from the built-in speaker according to the audio signal.
- both the playback device 110 and the display device 120 can support 3D video display, the left-view video frame and the right-view video frame are alternately displayed on the screen 121.
- the display device 120 When the display device 120 can support 3D video display, the display device 120 further includes a left / right signal transmission unit 122.
- the left / right signal transmitting unit 122 transmits the left / right signal LR to the shutter glasses 130 by infrared rays or wirelessly.
- the left / right signal LR indicates which video frame of left view or right view is currently displayed on the screen.
- the display device 120 identifies both video frames from the control signal accompanying the video signal, and changes the left / right signal LR to the left / right signal transmission unit 122 in synchronization with the switching thereof.
- the shutter glasses 130 include two liquid crystal display panels 131L and 131R and a left / right signal receiving unit 132.
- the liquid crystal display panels 131L and 131R constitute left and right lens portions.
- the left / right signal receiving unit 132 receives the left / right signal LR, and sends a signal to the left and right liquid crystal display panels 131L and 131R according to the change.
- Each of the liquid crystal display panels 131L and 131R transmits or blocks light uniformly in its entirety according to the signal.
- the left / right signal LR indicates a left-view video frame
- the left-eye liquid crystal display panel 131L transmits light
- the right-eye liquid crystal display panel 131R blocks light.
- the left and right signal LR indicates the display of a right view video frame.
- the two liquid crystal display panels 131L and 131R alternately transmit light in synchronization with the switching of the frames.
- the left-view video frame appears only in the viewer's left eye
- the right-view video frame appears only in the right eye.
- the viewer perceives the difference between frames appearing in each eye as binocular parallax for one virtual solid. That is, the viewer sees the two frames as one virtual solid.
- the remote control 140 includes an operation unit and a transmission unit.
- the operation unit includes a plurality of buttons. Each button is associated with each function of the playback device 110 or the display device 120, such as turning on / off the power source or starting / stopping playback of video from the BD-ROM disc 100.
- the operation unit detects pressing of each button by the user, and passes a signal specifying the button to the transmission unit.
- the transmission unit transmits the signal to the playback device 110 or the display device 120 as an infrared or wireless signal IR. Thereby, the user can remotely control the playback device 110 or the display device 120.
- FIG. 2 is a schematic diagram showing a data structure on the BD-ROM disc 100.
- a BCA (BursturCutting Area) 201 is provided at the innermost periphery of the data recording area on the BD-ROM disc 100. Access to the BCA 201 is permitted only by the BD-ROM drive 111, and access by the application program is prohibited. Thereby, the BCA 201 is used for copyright protection technology.
- a track 202 extends spirally from the inside of the disk 100 to the outside. In FIG. 2, the track 202 is depicted as being virtually stretched in the horizontal direction.
- the left side of the track 202 represents the inside of the disc 100, and the right side represents the outside.
- the track 202 includes a lead-in area 211, a volume area 212, and a lead-out area 213 in order from the inside of the disk 100.
- the lead-in area 211 is provided just outside the BCA 201.
- the lead-in area 211 includes information necessary for accessing the volume area 212, such as the size and physical address of data recorded in the volume area 212.
- the lead-out area 213 is provided on the outermost side of the data recording area and indicates the end of the volume area 212.
- the volume area 212 includes application data such as video and audio.
- the volume area 212 is divided into small areas called “sectors”. Each sector is assigned a serial number in order from the top of the volume area 212. This serial number is called a logical address (or logical block number). Reading data from the BD-ROM disc 100 is executed by designating the logical address of the sector in which the data is stored. Thus, the volume area 212 can be accessed in units of sectors. Further, in the BD-ROM disc 100, the logical address is substantially equal to the physical address. That is, the physical address is substantially continuous in the area where the logical address is continuous. Accordingly, the BD-ROM drive 111 can continuously read data from sectors having consecutive logical addresses without causing the optical pickup to seek.
- the file system for the volume area 212 employs UDF (Universal Disc Format).
- the file system may be ISO 9660.
- the data recorded in the volume area 212 is expressed in a directory / file format. That is, these data can be accessed in directory units or file units.
- FIG. 2 further shows a directory / file structure 214 on the BD-ROM disc 100.
- a BD movie (BDMV: BD Movie) directory 230 and a certificate (CERTIFICATE) directory 240 are placed immediately below a root (ROOT) directory 220.
- the BDMV directory 230 stores the content main body.
- the CERTIFICATE directory 240 stores information necessary for authenticating the content.
- index file (index.bdmv) 231 and a movie object file (MovieObject.bdmv) 232 are placed immediately below the BDMV directory 230.
- the index file 231 is information for managing the entire contents recorded on the BD-ROM disc 100.
- the movie object file 232 generally includes a plurality of movie objects.
- the “movie object” includes a command group for causing the playback device 110 to execute playback processing similar to playback processing by a general DVD player.
- the movie object file 232 particularly includes a movie object that causes the playback device 110 to perform playback processing of 2D video, and a movie object that causes playback processing of 3D video to be performed.
- the BDMV directory 230 further includes a playlist (PLAYLIST) directory 233, a clip information (CLIPINF) directory 234, a stream (STREAM) directory 235, a BD-J object (BDJO: BD Java (registered trademark)) directory 236, and a Java archive. (JAR: Java Archive) directory 237 is included.
- AV (Audio Vidual) stream files (01000.m2ts) 235A and (02000.m2ts) 235B are placed.
- An “AV stream file” is an entity of video content and represents video, audio, subtitles, and the like.
- AV stream file types include 2D AV stream files, left-view AV stream files, and right-view AV stream files.
- the “2D AV stream file” means an AV stream file that can be used independently for playback of 2D video.
- the “left view AV stream file” means an AV stream file representing a left view of 3D video.
- the “right view AV stream file” means an AV stream file representing a right view of 3D video.
- the left-view AV stream file and the right-view AV stream file are used as a pair for displaying 3D video.
- the first AV stream file (01000.m2ts) 235A is a 2D AV stream file and a left-view AV stream file.
- the second AV stream file (02000.m2ts) 235B is a right-view AV stream file, and is used for playback of 3D video in combination with the first AV stream file 235A.
- clip information files (01000.clpi) 234A and (02000.clpi) 234B are placed.
- the “clip information file” is associated with an AV stream file on a one-to-one basis, and mainly represents a correspondence relationship between a video display time represented by the AV stream file and a logical address in the AV stream file.
- Types of clip information files include 2D clip information files, left-view clip information files, and right-view clip information files, and 2D AV stream files, left-view AV stream files, and right-view AVs, respectively.
- Associated with a stream file In the example shown in FIG.
- the first clip information file (01000.clpi) 234A is a 2D clip information file and a left-view clip information file
- the first AV stream file (01000.m2ts) 235A is associated with.
- the second clip information file (02000.clpi) 234B is a right-view clip information file and is associated with the second AV stream file (02000.m2ts) 235B.
- playlist files (00001.mpls) 233A and (00002.mpls) 233B are placed.
- the “playlist file” defines the playback path of the AV stream file, that is, the part to be decoded of the AV stream file and the decoding order thereof.
- “2D playlist file” refers to a playlist file that defines the playback path of a 2D AV stream file.
- the “3D playlist file” refers to a playlist file that defines a playback path of a pair of a left view AV stream file and a right view AV stream file.
- the first playlist file (00001.mpls) 233A is a 2D playlist file
- the second playlist file (00002.mpls) 233B is a 3D playlist file. is there.
- BD-J object files (xxxxx.bdjo) 236A and (yyyyy.bdjo) 236B are placed.
- the “BD-J object file” includes only one BD-J object.
- the “BD-J object” is a bytecode program, and defines an application program to be executed by the Java virtual machine installed in the playback device 110 and the timing of the execution. The application program causes the playback device 110 to execute title playback processing and graphics video rendering processing.
- the BD-J object in the first BD-J object file (xxxxx.bdjo) 236A causes the playback device 110 to perform 2D video playback processing.
- the BD-J object in the second BD-J object file (yyyy.bdjo) 236B causes the playback device 110 to perform 3D video playback processing.
- JAR files (xxxxx.jar) 237A and (yyyyy.jar) 237B are placed in the JAR directory 237.
- the “JAR file” generally includes a plurality of execution target application programs indicated by the BD-J object.
- An application certificate file (app.discroot.crt) 241 is placed directly under the CERTIFICATE directory 240.
- the application certificate file 241 is unique to the provider of the content recorded on the BD-ROM disc 100.
- the “application certificate file” is a so-called digital certificate and is used for authentication of an application program.
- the application certificate file 241 is used for signature verification of the application program. In signature verification, the presence or absence of falsification of an application program is confirmed, and the supplier is authenticated. By verifying the signature, only the application program permitted by the content provider can be started in the Java virtual machine, or the access right to each memory device in the playback device 110 can be selectively given to the application program. it can.
- the index file 231 includes information necessary for recognition of the BD-ROM disc 100.
- the index file 231 is first read and used for recognition of the BD-ROM disc 100 by the control unit of the playback device 110.
- the index file 231 further includes an index table.
- the index table defines the correspondence between titles constituting the content and movie objects or BD-J objects.
- FIG. 3 is a schematic diagram showing the index table 310 in the index file 231.
- Each item is associated with one of movie objects MVO-2D, MVO-3D,..., Or BD-J objects BDJO-2D, BDJO-3D,.
- each item is associated with various events by the control unit of the playback device 110.
- the “event” includes, for example, insertion / removal of a disk in the BD-ROM drive 111, operation of the remote controller 140 by the user, and a request by an application program.
- the control unit of the playback device 110 refers to the index table 310 and calls the object indicated by the item corresponding to the event from the BD-ROM disc 100.
- the control unit further performs various processes according to the called object.
- an object to be called when the disc 100 is inserted into the BD-ROM drive 111 is assigned.
- the object causes the playback device 110 to execute, for example, processing for displaying a warning message for the viewer and a logo of the content provider.
- the item “top menu” 302 is assigned an object to be called when a command “return to menu” is input by a user operation, for example.
- the object causes the playback device 110 to execute menu display processing.
- title k” 303 an object is individually assigned to each title constituting the main body of the content on the disc 100 such as a main part of a movie. The object is called, for example, when the title is designated as a playback target by a user operation, and causes the playback device 110 to perform playback processing of the AV stream file belonging to the title.
- both the item “title 1” and the item “title 2” are assigned to the title of the 2D video.
- the first movie object MVO-2D associated with the item “title 1” includes a group of instructions related to 2D video playback processing using the first playlist file 233A.
- the first playlist file 233A is read from the disc 100 in accordance with each command in the first movie object MVO-2D, and the playback path defined in the first playlist file 233A is read.
- a 2D video playback process is executed along the line.
- the first BD-J object BDJO-2D associated with the item “title 2” designates an application program related to 2D video reproduction processing using the first playlist file 233A.
- the application program is executed in accordance with the first BD-J object BDJO-2D.
- the first playlist file 233A is read from the disc 100, and 2D video playback processing is executed along the playback path defined therein.
- the item “title 3” and the item “title 4” are assigned to the title of the 3D video.
- the second movie object MVO-3D associated with the item “title 3” uses the second playlist file 233B in addition to the command group related to the playback processing of 2D video using the first playlist file 233A. And a group of instructions related to 3D video playback processing.
- the second BD-J object BDJO-3D associated with the item “title 4” is added to the second playlist file 233B in addition to the application program related to the 2D video playback processing using the first playlist file 233A. Specifies an application program related to 3D video playback processing using.
- the playback device 110 calls the second movie object MVO-3D with reference to the item “title 3”. Accordingly, the playback device 110 first performs the following three types of discrimination processing: (1) whether or not the playback device 110 itself supports playback of 3D video, and (2) the user selects playback of 3D video. And (3) whether or not the display device 120 is compatible with 3D video playback. Next, the playback device 110 selects one of the playlist files 233A-B according to the determination result, and executes playback processing of 3D video according to the playback path defined there.
- the playback device 110 calls the second BD-J object BDJO-3D with reference to the item “title 4”, the playback device 110 executes various application programs according to the object. Thereby, the playback device 110 performs the above-described determination, playlist file selection according to the result, and playback of 3D video along the playback path.
- the movie object file 232 generally includes a plurality of movie objects. Each movie object includes a sequence of navigation commands.
- the navigation command is a control command for causing the playback apparatus to execute playback processing similar to playback processing by a general DVD player.
- Types of navigation commands include, for example, an instruction to read a playlist file corresponding to a title, an instruction to reproduce an AV stream file indicated by the playlist file, and an instruction to transition to another title.
- the navigation command is written in an interpreted language and is decoded by an interpreter incorporated in the playback apparatus, that is, a job control program, and causes the control unit to execute a desired job.
- a navigation command consists of an opcode and an operand.
- the opcode indicates the content of an operation to be performed by the playback device, such as title branching, playback, and computation.
- the operand indicates identification information of the operation target such as a title number.
- the control unit of the playback device 110 calls each movie object in accordance with a user operation, and executes navigation commands included in the movie object in the order of columns. As a result, the playback device 110 first displays a menu on the display device 120 and allows the user to select a command, as in a general DVD player. Next, in accordance with the selected command, the playback device 110 dynamically changes the progress of the video to be played back, such as starting / stopping playback of a title and switching to another title.
- the operation mode of the playback apparatus 110 according to the movie object is referred to as an HDMV (High Definition Movie) mode.
- BD-J object files 236A and 236B describe BD-J objects in a compiler type language such as Java language.
- the control unit of the playback device 110 calls the BD-J object in response to a user operation or an application program request.
- the BD-J object is interpreted by the Java platform installed in the control unit.
- the control unit further causes the Java virtual machine to execute various application programs according to the BD-J object.
- the playback device 110 dynamically changes the progress of the playback video of the title, or causes the display device 120 to display the graphics video independently of the title video.
- the operation mode of the playback device 110 according to the BD-J object is referred to as a BD-J mode.
- FIG. 4 is a schematic diagram showing images displayed on the screen 121 of the display device 120 in each of the HDMV mode and the BD-J mode.
- FIG. 4A shows one scene of a playback video in the HDMV mode.
- the playback video in the HDMV mode displays the content main body video recorded on the BD-ROM disc 100, for example, the video of the main part of the movie, on the entire screen 121, similar to the video played from the DVD.
- FIG. 4B shows one scene of a playback video in the BD-J mode.
- a graphics video can be drawn on the Java virtual machine in the playback device 110 in conjunction with the video of the content body.
- the main movie SCN the title TL of the movie
- BG and pop-up menu PPM can be displayed simultaneously.
- the BD-Live function can be used. That is, the application program can cause the playback device 110 to download additional content such as subtitles and interactive content such as a browser screen from the server device 160 on the network 150. The application program can further cause the playback device 110 to display the downloaded content together with the video of the content body recorded on the BD-ROM disc 100 as shown in FIG. it can.
- the graphics video is converted to 3D video in the Java virtual machine in addition to the 3D video of the content body.
- There are two types of processing for reproducing a graphics video as a 3D video a 2-plane mode and an offset mode.
- the “2 plane mode” both left view and right view image data are prepared separately, and the left view and right view image planes are prepared in the same manner as the video stream of the content body. Individually drawn by a Java virtual machine.
- the playback device 110 In the “offset mode”, the playback device 110 generates a pair of left-view and right-view image planes from image data representing normal 2D video.
- FIG. 5 is a schematic diagram showing an example of generating the left view 502L and the right view 502R from the 2D video 501 in the offset mode.
- the 2D video 501 includes a disk 511 and a caption 513 in the background 512.
- the playback device 110 processes the image data representing the 2D video 501 and moves the display positions of the respective parts in the 2D video 501 to the left and right. Thereby, a left view 502L and a right view 502R are generated from the 2D video image 501.
- the display position of the disc 521L in the left view 502L moves to the right by the offset value S1 from the display position of the disc 511 in the 2D video 501.
- the display position of the disk 521R in the light view 502R moves to the left by the offset value S1.
- the display position of the subtitle 523L in the left view 502L is moved to the right by the offset value S3 from the display position of the subtitle 513 in the 2D video 501, and the display position of the subtitle 523R in the right view 502R is left by the offset value S3.
- the disc 531 and the caption 533 are both seen in front of the screen 503 for the viewer.
- the display position of the background 522L in the left view 502L moves to the left by the offset value S2 from the display position of the background 512 in the 2D video 501, and the display position of the background 522R in the right view 502R moves to the right by the offset value S2. Moving. In that case, the viewer can see the background 532 behind the screen 503.
- FIG. 6A is a schematic diagram showing the data structure of a BD-J object.
- the BD-J object includes an application management table 610 and an image playback state value 620.
- the application management table 610 is a list of application programs to be executed and their execution times, that is, life cycles. Referring to FIG. 6A, the application management table 610 includes a plurality of combinations of application identifiers 611, control codes 612, and application detailed information 613.
- the application identifier 611 indicates the file name of the JAR file that includes the application program to be executed.
- the control code 612 indicates the activation mode of the application program specified by the application identifier 611. There are two types of start-up modes: Auto Start and Present. “Auto start” indicates that the application program is automatically started together with the start of reproduction of the title. “Present” indicates that an application program is activated in response to a call from another application program.
- the detailed application information 613 includes an application name 631, binding information 632, and an icon locator 633.
- the application name 631 indicates the name of the application program to be executed.
- the binding information 632 indicates the life cycle of the application program indicated by the application name 631.
- the icon locator 633 indicates an address in the JAR file of icon data to be associated with the application program indicated by the application name 631.
- FIG. 6 is a schematic diagram showing the life cycle of six types of application programs A1-A5, A11.
- the playback device 110 first plays back the first title TL1 from the first disc D1 during the period from time T1 to time T2, and then continues during the period from time T2 to time T3. Play the second title TL2.
- the first disk D1 is removed from the playback device 110.
- the playback device 110 plays back the third title TL3 from the second disc D2 in a period after time T4.
- One title-bound application program A1, A2, A3 is executed one by one during the playback period of each title TL1, TL2, TL3.
- each application program A1-A3 coincides with the playback period of each title TL1-TL3.
- another title bound application program A11 is also executed.
- the application program A11 is activated in response to a call CL from the auto-start application program A1 being executed during the same period because the activation mode is present.
- the application program A11 is title bound, it ends at the same time as the end of the reproduction period of the first title TL1.
- the disc bound application program A4 is further executed.
- the application program A11 is continuously executed even when the first title TL1 is switched to the second title TL2 at time T2. However, since the application program A11 is disk bound, the application program A11 ends when the first disk D1 is removed from the playback device 110 at time T3.
- the disk unbound application program A5 is executed from time T1 to time T4. This application program A5 is continuously executed both when the first disc D1 is taken out from the playback device 110 at time T3 and when the second disc D2 is inserted into the playback device 110 at time T4.
- the image playback state value 620 is a setting state of the playback device 110 regarding the playback processing of image data, and represents what should be realized in the playback period of the title associated with the BD-J object.
- the setting state of the playback device 110 such as memory area allocation, is changed according to the image playback state value 620 indicated by the BD-J object.
- states There are four types of states from state 1 to state 4 in the setting state of the reproducing apparatus 110 relating to image data reproduction processing.
- the image playback state value 620 can take four kinds of integer values from 0 to 3: When the image playback state value 620 is equal to 0, 1, 2, 3, the playback device 110 during the playback period of the title. Are set to state 1, state 2, state 3, and state 4.
- FIG. 7 is a state transition diagram showing states 1-4. Referring to FIG. 7, among the states 1 to 4, the combinations of the offset mode, the 2-plane mode, and the BD-Live function that are permitted or prohibited by the application program are different.
- both 2-plane mode and offset mode are permitted for 3D video playback processing from the image data.
- BD-Live function is permitted, a cache area for holding image data such as a browser screen is limited.
- state 4 as in state 3, 3D video playback processing from the video stream and 3D video playback processing from either the 2-plane mode or the offset mode from the image data are permitted.
- the BD-Live function is prohibited.
- FIG. 8 is a schematic diagram showing the data structure of the JAR file 237A.
- the JAR file 237A is a Java archive file.
- the Java archive file is specialized for Java in the ZIP format according to the specifications described in http://java.sun.com/j2se/1.4.2/docs/guide/jar/jar.html It has been made. Therefore, the contents of the Java archive file can be confirmed by commercially available ZIP development software.
- a directory / file group 800 having the structure shown in FIG. 8 is compressed in the JAR file 237A.
- These directory / file groups 800 are expanded by the Java virtual machine from the JAR file 237A into a heap area (also referred to as work memory) in the Java virtual machine.
- a classes directory 810 and an image directory 820 are placed immediately below the ROOT directory 801.
- a class file (aaa.class) 811 is placed in the class directory 810.
- the “class file” 811 includes an xlet program.
- the xlet program is the main body of the application program, and its name is described in the application management table 410 in the BD-J object.
- the xlet program is a bytecode program written in a compiler type language such as Java language, like the BD-J object.
- the types of xlet programs include those that cause the Java virtual machine to execute title reproduction processing and those that cause the Java virtual machine to execute graphics video rendering processing.
- image data to be used for the GUI by the application program is placed.
- image data include a JPEG file (menu.jpg) 821 and a PNG file (menu.png) 822.
- These image data represent GUI graphic parts such as menus, and are equivalent to those used in European digital broadcasting terminals (DVB-MHP).
- image data include in particular those representing the left view and right view of each graphic component.
- AV stream files 235A and 235B are MPEG-2 transport stream (TS) format digital streams. Generally, a plurality of elementary streams are multiplexed in each AV stream file 235A, 235B.
- (A) and (b) of FIG. 9 are schematic diagrams showing elementary streams multiplexed in the first AV stream file 235A and the second AV stream file 235B, respectively.
- the first AV stream file 235A includes a left-view video stream 901L, primary audio streams 902A and 902B, presentation graphics (PG) streams 903A and 903B, interactive graphics (IG) ) Stream 904, secondary video stream 905, and secondary audio stream 906.
- the second AV stream file 235B includes a right-view video stream 901R.
- the left-view video stream 901L and the right-view video stream 901R are both primary video streams, and represent the left view and the right view of the main video of the movie, respectively.
- the main video means a main video of content such as a main video of a movie, and is displayed on the entire screen in the HDMV mode.
- the secondary video stream 905 represents a sub-picture of a movie.
- the sub-picture means a picture that is displayed on the screen at the same time as the main picture by using a picture-in-picture method, such as a picture that is displayed on a small screen in the main picture.
- Each video stream is encoded by a moving image compression encoding method such as MPEG-2, MPEG-4 AVC, or SMPTE VC-1.
- the left-view video stream 901L is compressed by predictive coding between its own pictures.
- the right-view video stream 901R is compressed by a prediction code between the pictures in the left-view video stream 901L in addition to the self-picture.
- Primary audio streams 902A and 902B represent the main audio of a movie.
- the language or audio output format differs between the two primary audio streams 902A and 902B.
- Secondary audio stream 906 represents the sub audio to be mixed with the main audio.
- Each audio stream is AC-3, Dolby Digital Plus (Dolby Digital Plus: “Dolby Digital” is a registered trademark), MLP, DTS (Digital Theater System: registered trademark), DTS-HD, or linear PCM ( It is encoded by a method such as Pulse (Code Modulation).
- PG streams 903A and 903B represent movie subtitle graphics.
- the subtitle language is different between the two PG streams 903A and 903B.
- the IG stream 904 represents a graphic part for GUI and its arrangement.
- the IG stream 404 is mainly used to construct an interactive screen on the screen 131 of the display device 120 in the HDMV mode.
- Elementary streams 901-906 are identified by packet ID (PID).
- PID packet ID
- the hexadecimal value 0x1011 is assigned as the PID to the left-view video stream 901L
- 0x1012 is assigned as the PID to the right-view video stream 901R.
- the primary audio streams 902A and 902B are assigned any value from 0x1100 to 0x111F as the PID.
- Any value from 0x1200 to 0x121F is assigned as the PID to the PG streams 903A and 903B.
- Any value from 0x1400 to 0x141F is assigned to the IG stream 904 as the PID.
- the secondary video streams 905A and 905B are assigned any value from 0x1B00 to 0x1B1F as the PID.
- the secondary audio stream 906 is assigned any value from 0x1A00 to 0x1A1F as the PID.
- FIG. 10 is a schematic diagram showing the arrangement of the packets of the elementary streams 1001, 1004, 1007, and 1010 multiplexed in the first AV stream file 235A.
- Each of the video stream 1001, the audio stream 1004, the PG stream 1007, and the IG stream 1010 is first converted into a PES (Packetized Elementary Stream) packet sequence 1002, 1005, 1008, 1011, and then a TS packet sequence 1003, Converted to 1006, 1009, 1012. Subsequently, a header is individually added to each TS packet to generate a source packet 1013. Finally, each source packet 1013 is multiplexed into one stream by time division.
- the first AV stream file 235A is configured.
- the source packets 1013 are numbered in order from the top in the first AV stream file 235A. This number is called a source packet number (SPN).
- SPN is used as the address of each source packet 1013 in the first AV clip file 235A.
- a TS packet sequence 1003 is obtained from the video stream 1001 as follows. First, a sequence of video frames 1001A constituting the video stream 1001 is converted into a sequence of PES packets 1002. Here, each video frame 1001A is encoded into one picture by the moving image compression encoding method. Further, the column of the video frame 1001A is divided into a plurality of GOPs (Group Of Pictures). Each PES packet 1002 includes a PES header and a PES payload. Each video frame 1001A is compressed into one picture by the above encoding method and stored in each PES payload.
- GOPs Group Of Pictures
- each PES packet 1002 is generally converted into a plurality of TS packets 1003.
- a TS packet 1003 is a fixed-length packet and includes a TS header and a TS payload.
- the TS header includes the PID of the video stream stored in the corresponding TS payload.
- Each PES packet is generally divided and stored in a plurality of TS payloads. The structure of such a TS packet is the same for other elementary streams.
- the types of TS packets included in the AV stream file include, in addition to those converted from the elementary stream shown in FIG. 9, PAT (Program Association Table), PMT (Program Map Table), and PCR ( Program Clock Reference).
- PCR, PMT, and PAT are defined in the European digital broadcasting standard, and originally have a role of defining a partial transport stream constituting one program.
- the AV stream file is also defined in the same manner as the partial transport stream.
- PAT indicates the PID of the PMT included in the same AV stream file.
- the PID of the PAT itself is 0.
- the PMT includes the PID of each elementary stream representing video / audio / subtitles and the attribute information included in the same AV stream file.
- the attribute information includes identification information of the codec used for compression of the elementary stream, and the frame rate and aspect ratio of the elementary stream.
- the PMT further includes various descriptors (also referred to as descriptors) regarding the AV stream file.
- the descriptor includes copy control information indicating permission / prohibition of copying of the AV stream file.
- the PCR includes information indicating the value of STC (System Time Clock) that should correspond to the ATS of the packet.
- STC is a clock used as a reference for PTS and DTS in the decoder.
- the decoder uses PCR to synchronize the STC with ATC (Arrival Time Clock), which is the ATS standard.
- AV clip The part that can be played seamlessly in one AV stream file is called “AV clip”. In each AV clip, seamless reproduction is ensured over the entire display time because the PTS of data stored in the source packet is continuous.
- FIG. 11 is a schematic diagram showing the data structure of the first clip information file (01000.clpi) 234A.
- the first clip information file 234A includes stream attribute information 1101, an entry map 1102, and 3D metadata 1103.
- the second clip information file 234B has the same data structure as the first clip information file 234A except for the 3D metadata 1103.
- the stream attribute information 1101 is a correspondence table between the PID 1111 of each elementary stream included in the first AV stream file 235A and the attribute information 1112, as shown in FIG. Items included in the attribute information 1112 are different for each of the video stream, the audio stream, the PG stream, and the IG stream.
- the attribute information associated with PID0x1011 of the left-view video stream includes the type of codec used for compression of the video stream, the resolution of each picture constituting the video stream, the aspect ratio, and the frame Includes rate.
- the attribute information associated with PID 0x1101 of the primary audio stream includes the type of codec used for compression of the audio stream, the number of channels included in the audio stream, the language, and the sampling frequency.
- the attribute information 1112 is used by the playback device 110 to initialize the decoder.
- the codec type, resolution, aspect ratio, and frame rate all match.
- the entry map 1102 includes a different table 1121 for each video stream in the first AV stream file 235A.
- Each table 1211 is associated with a PID of a different video stream.
- Each table 1211 includes a plurality of entry points 1122.
- Each entry point 1122 includes a pair of PTS and SPN.
- the PTS is equal to the PTS of the first picture of any GOP included in the allocated video stream, that is, the I picture.
- the SPN of the same entry point 1122 is equal to the first SPN of the source packet group storing the I picture.
- the playback device 110 can specify the SPN in the first AV stream file 235A corresponding to the scene at an arbitrary time point during the playback period of the video from the video stream. Particularly in special playback such as fast forward playback and rewind playback, the playback device 110 selectively extracts and decodes source packets from the SPN of each entry point 1122. Thereby, the I picture is selectively reproduced. In this way, the playback device 110 can efficiently process special playback without analyzing the first AV stream file 235A itself.
- the entry map includes a plurality of entry points for the right-view video stream.
- Each entry point includes a pair of PTS and SPN.
- the PTS is equal to the PTS of the first picture of any GOP included in the right-view video stream, that is, the P picture.
- the SPN of the same entry point is equal to the top SPN of the source packet group in which the P picture is stored.
- the PTS of each entry point is further equal to the PTS of each entry point for the left-view video stream indicated by the first clip information file 234A.
- the playback device can immediately acquire the first SPN of the source packet group to be played back from the corresponding entry point. In this way, the response speed of processing that requires random access to the video stream, such as dive playback, can be improved also in playback of 3D video.
- FIG. 12 is a schematic diagram showing the data structure of the 3D metadata 1103.
- the 3D metadata 1103 is used for the cropping process for the PG streams 903A and 903B and the IG stream 904 multiplexed in the first AV stream file 235A shown in FIG.
- “Cropping processing” refers to processing for giving a sense of depth to 2D video played back from each stream.
- a pair of a left view and a right view is generated by displacing each 2D video image in the horizontal direction.
- the amount of displacement at that time corresponds to the binocular parallax necessary to give the 2D image a sense of depth.
- the 3D metadata 1103 includes a value representing the amount of displacement by the number of pixels, that is, an “offset value”.
- Each table 1201 generally describes a plurality of pairs of PTSs 1202 and offset values 1203, that is, offset entries 1204.
- the PTS 1202 is equal to the PTS of one picture included in the PG stream 903A and the IG stream 904.
- An offset value 1203 represents an offset value for a picture to which the PTS 1202 is assigned.
- the offset value 1203 may be a negative value.
- the valid section of each offset entry 1204 is from the PTS of the offset entry to the PTS of the next offset entry. In the example of FIG.
- the PTS of the first offset entry is 180000
- the PTS of the second offset entry is 270000
- the PTS of the third offset entry is 360000.
- the offset value “+5” of the first offset entry is valid in the STC range of 180,000 to 270000
- the offset value “+3” of the second offset entry is the STC value of 270000 to 360000. Valid in range.
- FIG. 13 is a schematic diagram showing the data structure of the second playlist file 233B.
- the second playlist file 233B includes playlist information 1301.
- the playlist information 1301 includes main path information 1310 and sub path information 1320 and 1330.
- the main path information 1310 includes at least one piece of play item information 1311, 1312, 1313,.
- Each play item information 1311-1313 defines a playback section of the first AV stream file 235A, that is, a portion to be played back continuously.
- the play item information 1311-1313 is further assigned serial numbers # 1, # 2, # 3,... In the order of playback in the playback section.
- Each of the sub-path information 1320 and 1330 is assigned a unique identifier, that is, sub-path IDs “# 1” and “# 2”.
- FIG. 14 is a schematic diagram showing the data structure of play item information 1400.
- the play item information 1400 includes reference clip information 1401, a playback start time 1402, a playback end time 1403, and a stream selection table 1404.
- the sub play item information also has a similar data structure except for the stream selection table.
- the reference clip information 1401 is information for identifying a clip information file to be used for conversion from PTS to SPN.
- the reproduction start time 1402 and the reproduction end time 1403 indicate the PTSs at the beginning and the end of the AV clip to be decoded.
- the playback device 110 refers to the entry map from the clip information file indicated by the reference clip information 1401, and acquires SPNs corresponding to the playback start time 1402 and playback end time 1403, respectively. As a result, the playback device 110 identifies an AV clip to be read from the AV stream file, and performs playback processing on the AV clip.
- the stream selection table 1404 represents a list of elementary streams that can be selected from AV clips by the decoder in the playback apparatus 110 between the playback start time 1402 and the playback end time 1403.
- the stream selection table 1404 includes a plurality of stream entries 1410, 1420,. Each stream entry 1410, 1420 includes a stream selection number 1411, stream path information 1412, and stream identification information 1413.
- the stream identification information 1413 indicates PIDs of elementary streams that can be selected between the reproduction start time 1502 and the reproduction end time 1503.
- the stream selection number 1411 is a serial number of the stream entry 1410 and is used by the playback device 110 to identify the elementary stream to be selected.
- the playback section indicated by the sub play item information is included between the playback start time 1402 and the playback end time 1403.
- the second playlist file 233B is a 3D playlist file
- the stream entries 1410 and 1420 also record attribute information of each elementary stream.
- the attribute information of the video stream indicates the resolution and the frame rate
- the attribute information of the audio stream, the PG stream, and the IG stream indicates the language type.
- FIG. 15 is a schematic diagram showing the playlist information 1301 shown in FIG. 13 and the AV clips CL1, CL2, and CL4 to be reproduced according to the playlist information 1301.
- the three time axes MP, SP1, and SP2 shown in FIG. 15 represent the playback time of the video stream that is played back according to the main path information 1310, the subpath information # 11320, and the subpath information # 21330, respectively.
- the play item information 1311-1313 is referred to in the order of serial numbers # 1-3.
- an entry point including a PTS equal to the reproduction start time IN1 is searched from the entry map of the first clip information file 234A indicated by the reference clip information 1401.
- the SPN of the entry point is specified as the start address SP1.
- the SPN of the entry point including the PTS equal to the reproduction end time OUT1 is specified as the end address EP1.
- the portion from the start address SP1 to the end address EP1 of the first AV stream file 235A, that is, the first AV clip CL1 is specified as the playback target.
- both the playback device 110 and the display device 120 are selected from the elementary streams registered in the stream selection table 1404 of the play item information # 11311 using the stream attribute information 1101 of the first clip information file 234A. Can be played back. Further, the detected elementary stream having the smallest stream selection number 1411 is selected, and the PID described in the stream identification information 1413 in the stream entry 1410 indicated by the stream selection number 1411 is stored in the playback device 110. Set to the decoder.
- the source packet having the PID in the first AV clip CL1 is decoded.
- play item information # 21312, # 31313,... are sequentially referred to, and in playback sections PI2, PI3,... From each playback start time to playback end time, the AV clips belonging to the first AV stream file 235A are used. The source packet is decoded.
- the playback device 110 refers to the sub play item information 1321-1323 in the sub path information # 11320 in the order of the serial numbers # 1-3 in parallel with the playback processing according to the main path information 1310.
- the sub play item information 1321-1323 has a one-to-one correspondence with the play item information 1311-1313.
- the reproduction start time and the reproduction end time are common to the sub play item information 1321-1323 and the corresponding play item information 1311-1313.
- sub play item information # 113132 when sub play item information # 113132 is referred to, first, an entry point including a PTS equal to the reproduction start time IN1 is searched from the entry map of the second clip information file 234B indicated by the reference clip information. Next, the SPN of the entry point is specified as the start address SP2. Similarly, the SPN of the entry point including the PTS equal to the reproduction end time OUT1 is specified as the end address EP2. Thus, in the playback section PI1 from the playback start time IN1 to the playback end time OUT1, the portion from the start address SP2 to the end address EP2 of the second AV stream file 235B, that is, the second AV clip CL2 is specified as the playback target.
- a reproducible one is detected.
- the detected elementary stream having the smallest stream selection number is selected, and the PID described in the stream identification information in the stream entry indicated by the stream selection number is set in the decoder in the playback apparatus 110. Is done.
- the source packet having the PID in the second AV clip CL2 is decoded by the decoder.
- the decoding process is performed in parallel with the decoding process of the source packet from the first AV clip CL1.
- the sub play item information # 21322, # 31323,... are sequentially referred to, and the second AV stream file 235B is combined with the playback sections PI2, PI3,... Of the corresponding playitem information # 21312, # 31313,.
- the source packet is decoded from the AV clip belonging to.
- the sub play item information # 21 included in the sub path information # 21330 is included.
- the sub play item information # 11331 is detected from the condition that “the playback section SPI4 from the playback start time IN4 to the playback end time OUT4 is included in the playback section PI1 of the playitem information # 1”.
- the start address SP4 and the end address EP4 of the fourth AV clip CL4 from the reproduction section SPI4 of the sub play item information # 11331 are the same as the first AV clip CL1 is identified from the reproduction section PI1 of the playitem information # 11311. Are identified.
- the source packet is decoded from the fourth AV clip CL4 in addition to the first AV clip CL1 and the second AV clip CL2.
- the main path information 1310 defines the playback path of the first AV stream file 235A as a permutation of the play item information 1311-1313
- the sub path information # 11320 is the second AV stream file.
- the playback path of 235B is defined as a permutation of the sub play item information 1321-1323.
- the 3D playlist file defines the playback path of the AV stream file in the left view and the right view by a combination of the main path information and the sub path information.
- the playlist file may further include sub path information such as sub path information # 21330 shown in FIG.
- the sub path information defines another reproduction path of the AV stream file to be reproduced together with the reproduction path of the AV stream file defined by the main path information 1310, or another reproduction path of the AV stream file.
- the first playlist file 233A has the same data structure as the second playlist file 233B, except that it does not include subpath information that defines the playback path of the right-view AV stream file.
- FIG. 16 is a block diagram showing a hardware configuration of the playback device 110.
- the playback device 110 includes a BD-ROM drive 111, a local storage 1610, an operation unit 1620, a network interface 1630, a bus 1640, a control unit 1650, a playback unit 1660, and an HDMI transmission unit 1670.
- the BD-ROM drive 111, the local storage 1610, the operation unit 1620, and the network interface 1630 can communicate with the control unit 1650 and the playback unit 1660 through the bus 1640. Further, the control unit 1650 and the playback unit 1660 can communicate with each other through a bus 1640.
- the control unit 1650 and the reproduction unit 1660 are mounted on different integrated circuits. In addition, both may be integrated into a single integrated circuit.
- the BD-ROM disc 100 can be inserted into BD-ROM drive 111.
- the BD-ROM drive 111 reads data from the disk 100 in response to an instruction from the control unit 1650.
- the BD-ROM drive 111 includes an optical pickup, that is, an optical head.
- the optical head includes a semiconductor laser, a collimator lens, a beam splitter, an objective lens, a condenser lens, and a photodetector.
- the light beam emitted from the semiconductor laser passes through the collimator lens, the beam splitter, and the objective lens in order, and is collected on the recording layer of the BD-ROM disc 100.
- the collected light beam is reflected / diffracted by the recording layer.
- the reflected / diffracted light is collected on a photodetector through an objective lens, a beam splitter, and a condenser lens.
- the photodetector generates a reproduction signal having a level corresponding to the amount of collected light.
- data recorded on the disc 100 is demodulated from the reproduced signal.
- the BD-ROM drive 111 reads data from the volume area 212 of the disk 100 and transfers it to the local storage 1610, the control unit 1650, or the playback unit 1660.
- the local storage 1610 is a rewritable storage device built in the playback device 110.
- the local storage 1610 includes a card reader / writer 1611 and an HDD 1612.
- the card reader / writer 1611 can insert a memory card 1600 therein, and can read / write data from / to the memory card 1600.
- the HDD 1612 is built in the playback device 100.
- the HDD 1612 may be portable.
- an external HDD may be connected to the bus 1640 through a predetermined interface and used as the local storage 1610.
- the local storage 1610 stores additional content or a browser screen downloaded from the server device 160 on the external network 150 by the BD-Live function.
- the local storage 1610 may store parameters and tables used by the control unit 1650.
- the operation unit 1620 detects various events and notifies the control unit 1650 of the contents of the events. For example, the operation unit 1620 receives a command transmitted from the remote controller 140 by radio such as infrared rays, decodes the content of the command, and notifies the control unit 1650 of the command. The operation unit 1620 further detects pressing of a button such as playback start / stop / fast forward / rewind provided on the front panel of the playback device 110, interprets the operation content that means the press, and controls the control unit 1650. Notify In addition, the operation unit 1620 detects the insertion / extraction of the BD-ROM disc 100 in the BD-ROM drive 111 and notifies the control unit 1650 of it.
- a button such as playback start / stop / fast forward / rewind provided on the front panel of the playback device 110
- the network interface 1630 connects the external network 150 and the bus 1640 so that they can communicate with each other.
- the control unit 1650 can communicate with the server device 160 on the external network 150 through the network interface 1630.
- the communication function is used for the BD-Live function.
- the control unit 1650 is a microcomputer system, and includes a CPU 1651, a ROM 1652, and a RAM 1653. They are connected to each other by an internal bus 1654.
- the ROM 1652 stores a program for controlling the basic operation of the playback device 110, that is, firmware.
- the firmware includes a device driver for each element 111, 1610-1660 connected to the bus 1640.
- the CPU 1651 reads the firmware from the ROM 1652 and executes it when the power is turned on, for example. Thereby, each element 111, 1610-1660 is initialized, and the execution environment of the Java platform, that is, the BD-J object is prepared.
- the RAM 1653 provides a work area for the CPU 1651.
- the control unit 1650 uses the combination of these elements 1651 to 1653 to execute firmware and an application program, and controls other elements according to them.
- control unit 1650 reads a desired title from the content recorded on the BD-ROM disc 100 or the local storage 1610 and causes the playback unit 1660 to play it back. Specifically, the control unit 1650 first reads out playlist information corresponding to the title to be played, that is, current playlist information from the BD-ROM disc 100 or the local storage 1610. The control unit 1650 selects an AV clip to be reproduced, that is, a current AV clip according to the current playlist information. Next, the control unit 1650 causes the BD-ROM drive 111 or the local storage 1610 to supply the current AV clip to the playback unit 1660.
- the control unit 1650 in the BD-J mode, the control unit 1650 generates GUI graphic parts such as menus as image data in JPEG format or PNG format in accordance with the application program, and supplies them to the playback unit 1660.
- the control unit 1650 realizes the BD-Live function according to the application program. That is, the control unit 1650 downloads image data such as a browser screen from the server device 160 on the network 150 through the network interface 1630 and supplies the image data to the playback unit 1660.
- the playback unit 1660 reads the current AV clip from the BD-ROM drive 111 or the local storage 1610 in accordance with an instruction from the control unit 1650.
- the playback unit 1660 further separates and decodes an elementary stream of a specific PID from the AV clip.
- the PID is designated in advance by the control unit 1650.
- a video plane is generated from the video stream
- an audio data AD is generated from the audio stream
- a PG plane is generated from the PG stream
- an IG plane is generated from the IG stream.
- the playback unit 1660 synthesizes each plane into one video frame.
- the image data supplied from the control unit 1650 is further combined with a video frame.
- the playback unit 1660 forms video data VD from the video frame after the synthesis processing, and sends it to the HDMI transmission unit 1670 together with the audio data AD.
- the HDMI transmission unit 1670 is connected to the display device 120 via the HDMI cable 112.
- the HDMI transmission unit 1670 receives the video data VD from the reproduction unit 1660 and converts it into a video signal in the HDMI format. In particular, both left-view and right-view video frames are multiplexed in the video signal in a time division manner.
- the HDMI transmission unit 1670 receives the audio data AD from the reproduction unit 1660 and converts it into an audio signal in the HDMI format.
- the HDMI transmission unit 1670 further multiplexes the converted video signal and audio signal with the synchronization signal and accompanying data, and transmits the multiplexed signal to the display device 120 through the HDMI cable 112.
- the HDMI transmission unit 1670 encrypts transmission data using a protocol compliant with HDCP (High-bandwidth Digital Content Protection) and performs mutual authentication with the display device 120.
- the HDMI transmission unit 1670 may be incorporated in the playback unit 1660.
- the audio signal may be sent to an amplifier or a speaker externally attached to the display device 120 such as a surround system, separately from the video signal.
- FIG. 17 is a functional block diagram of the control unit 1650.
- the control unit 1650 includes a bus interface 1701, a user operation detection module 1702, a virtual file system 1703, and a reproduction control unit 1704.
- the control unit 1650 implements each functional unit 1701-1704 by executing firmware incorporated therein.
- the bus interface 1701 connects the functional units in the control unit 1650 through the bus 1640 to the elements 111, 1610-1640, and 1660 shown in FIG.
- the bus interface 1701 reads scenario information to be played back, that is, current scenario information DS and SS, from the BD-ROM drive 111 in accordance with an instruction from the virtual file system 1703 and passes it to the playback control unit 1704.
- the scenario information includes dynamic scenario information DS and static scenario information SS.
- the dynamic scenario information DS includes a movie object file, a BD-J object file, and a JAR file.
- the static scenario information SS includes a playlist file and a clip information file.
- the user operation detection module 1702 receives the notification INT from the operation unit 1620, and identifies the type of event such as the content of the operation by the user from the notification INT.
- the user operation detection module 1702 further sends an operation signal UO indicating the type of the event to the reproduction control unit 1704.
- the types of events include, for example, buttons for insertion / extraction of the BD-ROM disc 100 in the BD-ROM drive 111 and playback start / stop / fast forward / rewind on the remote control 140 or the front panel of the playback device 110. The pressing of is included.
- the virtual file system 1703 manages file access to the BD-ROM disc 100 and the local storage 1610 by the playback control unit 1704.
- the virtual file system 1703 constructs a virtual package from the content on the BD-ROM disc 100 and the additional content in the local storage 1610.
- the “virtual package” refers to a directory / file structure similar to the directory / file structure 214 on the BD-ROM disc 100 shown in FIG.
- the application program accesses the BD-ROM disk 100 and the local storage 1610 through the virtual file system 1703. Thereby, it is possible to treat the content recorded in the content as content on the same virtual package without distinguishing from each other.
- the virtual file system 1703 further reads the index file IF from the virtual package and passes it to the playback control unit 1704 in response to the command COM from the playback control unit 1704. Thereafter, the virtual file system 1703 manages file access to the virtual package in accordance with the command COM from the playback control unit 1704 and the operation signal UO from the user operation detection module 1702. For example, the virtual file system 1703 reads out the current scenario information DS and SS from the virtual package and passes them to the reproduction control unit 1704. In addition, the virtual file system 1703 causes the BD-ROM drive 111 or the local storage 1610 to supply the current AV clip to the playback unit 1660 in accordance with the command COM from the playback control unit 1704.
- the playback control unit 1704 executes the firmware to prepare an execution environment for the application program, and further reads and executes the application program from the dynamic scenario information DS in that environment. Thereby, the playback control unit 1704 controls each element in the playback device 110 according to the application program.
- the playback control unit 1704 includes a dynamic scenario memory 1741, a static scenario memory 1742, a mode management module 1743, an HDMV module 1744, a BD-J module 1745, and an AV playback library 1746.
- Both the dynamic scenario memory 1741 and the static scenario memory 1742 are buffer memories built in the control unit 1650. As the buffer memories 1741 and 1742, different areas of the RAM 1653 are used. In addition, the buffer memories 1741 and 1742 may be independent memory elements.
- the dynamic scenario memory 1741 holds the current dynamic scenario information DS
- the static scenario memory 1742 holds the current static scenario information SS.
- the mode management module 1743 receives the index file IF from the virtual file system 1703 and holds it.
- the mode management module 1743 further uses the index file IF to control the switching of the operation mode of the playback apparatus 110 when the title is switched. Specifically, the mode management module 1743 first selects one item from the index table in the index file IF in accordance with the operation signal UO from the user operation detection module 1702. When a movie object is specified for the item, the mode management module 1743 assigns the current dynamic scenario information DS to the HDMV module 1744. Thereby, the operation mode of the playback device 110 shifts to the HDMV mode.
- the mode management module 1743 assigns the current dynamic scenario information DS to the BD-J module 1745. Thereby, the operation mode of the playback device 110 shifts to the BD-J mode.
- the mode management module 1743 is activated when the operation signal UO from the user operation detection module 1702 indicates switching of the operation mode or when the HDMV module 1744 or the BD-J module 1745 is requested to switch the operation mode.
- the allocation destination of the dynamic scenario information DS is switched between the two modules 1744 and 1745.
- the mode management module 1743 includes a dispatcher 1743A.
- the dispatcher 1743A receives the operation signal UO from the user operation detection module 1702, selects one suitable for the current operation mode, and passes it to the module 1744 or 1745 to which the dynamic scenario information DS is assigned. For example, when the operation signal UO indicates fast forward playback / rewind playback, the dispatcher 1743A passes the operation signal UO to the HDMV module 1744 in the HDMV mode and to the BD-J module 1745 in the BD-J mode.
- the dispatcher 1743A sends an instruction COM to the virtual file system 1703 through the AV playback library 1746, and the index file IF Instruct reading.
- the index file IF read according to the instruction is held in the mode management module 1743.
- the HDMV module 1744 is a virtual DVD player, and controls the playback processing of titles from the BD-ROM disc 100 in the same manner as playback processing by a general DVD player. Specifically, the HDMV module 1744 reads a movie object from the dynamic scenario information DS in the dynamic scenario memory 1741, and executes navigation commands included therein in the order of arrangement. Thereby, the HDMV module 1744 instructs the AV playback library 1746 in order of the processing indicated by each navigation command.
- the BD-J module 1745 is a Java platform, and particularly includes an application manager 1745A and a virtual machine 1745B.
- the BD-J module 1745 reads a BD-J object from the dynamic scenario information DS in the dynamic scenario memory 1741 in response to an instruction from the mode management module 1743.
- the application manager 1745A instructs the virtual machine 1745B to start or end the application program according to the application management table 410 in the BD-J object.
- the virtual machine 1745B is a Java virtual machine and incorporates a work memory 1745C.
- One area of the RAM 1653 is used as the work memory 1745C.
- the virtual machine 1745B reads a JAR file including the application program from the dynamic scenario information DS and expands it in the work memory 1745C.
- the virtual machine 1745B further reads and executes the xlet program to be activated from the class file expanded in the work memory 1745C.
- each method included in the xlet program is converted into a native code for the CPU 1651 and passed to the AV playback library 1746.
- processing according to the application program is instructed to the AV playback library 1746.
- the virtual machine 1745B when instructed by the application manager 1745A to terminate the application program, executes the termination process of the application program, or forcibly, the xlet program that is the main body of the application program Is deleted from the work memory 1745C.
- Processing by the application program includes BD-Live processing and graphics processing in addition to title playback processing.
- the virtual machine 1745B causes the network interface 1630 to download additional content from the server device 160 to the local storage 1610 or download a browser screen to the playback unit 1660 according to the application program.
- the virtual machine 1745B In the graphics processing, the virtual machine 1745B generates image data GD according to the application program.
- the image data GD represents a graphic image such as a GUI graphic part such as a menu, a background, and an animation image.
- a JPEG file 821 or a PNG file 822 expanded from the JAR file in the dynamic scenario information DS into the work memory 1745C is used.
- the BD-J module 1745 further sends the image data GD to the reproduction unit 1660 through the bus interface 1701 and the bus 1640 in accordance with the application program.
- the virtual machine 1745B first generates both left view and right view image data GD and passes them to the reproduction unit 1660. Next, the virtual machine 1745B sends a drawing command to the playback unit 1660 at an appropriate timing. As a result, the virtual machine 1745B uses the playback unit 1660 so that the left-view image data GD is combined with the left-view video frame and the right-view image data GD is combined with the right-view video frame. Control.
- the virtual machine 1745B passes the offset value together with the image data GD representing the normal 2D video to the reproduction unit 1660. Based on the offset value, the playback unit 1660 generates left view and right view image data from the image data GD, and synthesizes the left view and right view video frames.
- the BD-J module 1745 Every time the BD-J module 1745 reads a BD-J object from the dynamic scenario information DS, the BD-J module 1745 compares the image playback state value 620 indicated by the BD-J object with the current image playback state value.
- the current image playback state value is held by the AV playback library 1746.
- the BD-J module 1745 changes the setting state of the playback device 110 according to the image playback state value 620 indicated by the BD-J object. Specifically:
- the BD-J module 1745 prohibits the 3D video playback process itself for the application program. In particular, both the offset mode and the 2-plane mode are prohibited. On the other hand, the BD-J module 1745 permits BD-Live processing to the application program.
- the BD-J module 1745 prohibits the application program from 2-plane mode, while playing back 3D video from the video stream, offset mode, and BD. -Allow Live processing.
- the BD-J module 1745 performs playback processing of 3D video from the video stream, 2-plane mode, offset mode, and BD-Live processing for the application program. to approve.
- the cache area that can be used for BD-Live processing is limited.
- the BD-J module 1745 permits the application program to play back 3D video from the video stream, the 2 plane mode, and the offset mode. On the other hand, the BD-J module 1745 prohibits the application program from performing BD-Live processing, that is, connection to the external network 150.
- the BD-J module 1745 uses the application manager 1745A to forcibly terminate all application programs in the virtual machine 1745B. . That is, as indicated by the dashed arrow in FIG. 7, when the playback device 110 switches the setting state between the state 1 and the state 2, the BD-J module 1745 sends an application program to the virtual machine 1745B. It does not have to be terminated. On the other hand, as indicated by solid arrows in FIG. 7, the playback device 110 sets the set state between the state 1 and the state 3, between the state 1 and the state 4, and between the state 2 and the state 3.
- the BD-J module 1745 causes the virtual machine 1745B to forcibly terminate the application program.
- the application programs to be terminated are all regardless of title bound, disc bound, and disc unbound. Accordingly, the xlet program and the parameters used by the xlet program are all deleted from the work memory 1745C.
- the BD-J module 1745 causes the playback unit 1660 to change the memory area for storing image data.
- the BD-J module 1745 causes the playback unit 1660 to reserve or release a cache area for BD-Live processing. In the cache area, image data such as a browser screen downloaded from the server device 160 on the external network 150 is held.
- the BD-J module 1745 designates either the offset mode or the 2-plane mode for the playback unit 1660 for the playback processing of the image data in accordance with the image playback state value 620 indicated by the BD-J object. Specifically, when the image playback state value 620 indicates state 2, the BD-J module 1745 designates the offset mode to the playback unit 1660. On the other hand, when the image playback state value 620 indicates state 3 or state 4, the BD-J module 1745 designates the playback unit 1660 which is selected by the application program between the offset mode and the 2-plane mode. To do.
- the BD-J module 1745 stores the original image reproduction state with the image reproduction state value 620 in the AV reproduction library 1746. Update the value.
- the AV playback library 1746 instructs AV playback processing or playlist playback processing in accordance with an instruction from the HDMV module 1744 or the BD-J module 1745.
- the “AV playback process” is a basic process as an optical disk playback apparatus, and follows a playback process performed by a general DVD player and CD player. Specifically, the AV playback process includes start and stop of playback process, pause and release, release of still image function, fast forward and rewind, audio switching, subtitle switching, and angle switching.
- “playlist playback processing” mainly refers to title playback processing in accordance with the static scenario information SS.
- the AV playback library 1746 selects the current AV clip according to the current playlist information, and causes the virtual file system 1703 to supply the current AV clip to the playback unit 1660.
- the play list reproduction process includes a virtual package construction process and a scenario information DS and SS transfer process from the virtual package to each scenario memory 1741 and 1742.
- Functions necessary for AV playback processing and playlist playback processing are implemented in the AV playback library 1746 as an application program interface (API).
- the AV playback library 1746 sends an instruction COM to the BD-ROM drive 111, the local storage 1610, the playback unit 1660, and the like through the virtual file system 1703 by executing an API corresponding to the instructed processing.
- the AV playback library 1746 causes each element to execute the instructed process.
- the AV playback library 1746 reads the 3D metadata 1103 from the clip information file in the static scenario information SS and sends it to the playback unit 1660.
- AV playback library 1746 includes a register 1746A.
- the register 1746A stores a parameter that represents the current setting state of the playback device 110 and the display device 120, a parameter that represents a state that can be set for each device, and a parameter that represents the initial setting of each device.
- the parameters representing the current setting state include stream selection numbers of audio streams and PG streams to be decoded, identifiers of current playlist information and play item information, and current image playback state values. .
- the parameters representing the states that can be set include the type of audio / caption language that can be selected and the type of encoding method of audio data.
- the AV playback library 1746 refers to the register 1746A according to an instruction from the HDMV module 1744 or the BD-J module 1745. Thereby, from the elementary streams registered in the stream selection table of each play item information, those that can be played back by both the playback device 110 and the display device 120 are detected. The AV playback library 1746 further selects the detected elementary stream having the smallest stream selection number and stores the stream selection number in the register 1746A. At the same time, among the attributes of the elementary stream indicated by the stream selection number, the encoding format, language type, etc. are read from the stream attribute information in the clip information file and stored in the register 1746A. The AV playback library 1746 further designates the PID of the selected elementary stream to the playback unit 1660. At that time, the AV playback library 1746 transfers information necessary for decoding the selected elementary stream, such as the type of encoding format, from the register 1746A to the playback unit 1660.
- FIG. 18 is a functional block diagram of the playback unit 1660.
- the playback unit 1660 includes a bus interface 1801, a pair of track buffers 1802A and 1802B, a pair of demultiplexers 1803A and 1803B, a primary video decoder 1804A, a secondary video decoder 1804B, and a PG decoder. 1804C, IG decoder 1804D, primary audio decoder 1804E, secondary audio decoder 1804F, image decoder 1804G, rendering engine 1805, primary video plane memory 1806A, secondary video plane memory 1806B, image A memory 1810, an adder 1807, and a mixer 1808 are included.
- the image memory 1810 includes a PG plane memory 1806C, an IG plane memory 1806D, a background (BG) plane memory 1806E, and an image data area 1811. These functional units are mounted on a single chip. In addition, some functional units may be mounted on different chips.
- the bus interface 1801 connects each functional unit in the playback unit 1660 through the bus 1640 to the BD-ROM drive 111, the local storage 1610, and the control unit 1650 so that they can communicate with each other.
- the bus interface 1801 transfers the current AV clips MCL and SCL from the BD-ROM drive 111 or the local storage 1610 to the track buffers 1802A and 1802B in accordance with instructions from the virtual file system 1703.
- the AV clip defined by the main path information (hereinafter referred to as main path AV clip) MCL is sent to the first track buffer 1802A and is defined by the sub path information (hereinafter referred to as sub path AV clip).
- SCL is sent to the second track buffer 1802B.
- the pair of track buffers 1802A and 1802B are first-in first-out (FIFO) memories built in the playback unit 1660.
- the track buffers 1802A and 1802B read AV clips MCL and SCL from the bus interface 1801 and temporarily hold them.
- the first demultiplexer 1803A receives the PID of the elementary stream to be decoded from the main path AV clip MCL from the AV playback library 1746. On the other hand, the first demultiplexer 1803A reads the main path AV clip MCL from the first track buffer 1802A in units of source packets, and extracts TS packets from each source packet. The first demultiplexer 1804A further reads the PID from the TS header of the TS packet and compares it with the PID of the elementary stream to be decoded. When the two match, the first demultiplexer 1804A extracts the TS packet.
- the PES packet is restored from the TS packets collected in this way, and is sent to one of the six types of decoders 1804A-F according to the PID of the elementary stream to be decoded. For example, when the PID of the TS packet is 0x1011, the PES packet restored from the TS packet is sent to the primary video decoder 1804A. When the PID is any of 0x1B00 to 0x1B1F, the PES packet is sent to the secondary video decoder 1804B. When the PID is any of 0x1100 to 0x111F, the PES packet is sent to the primary audio decoder 1804E.
- the PES packet is sent to the secondary audio decoder 1804F. If the PID is any of 0x1200 to 0x121F, the PES packet is sent to the PG decoder 1804C. If the PID is any of 0x1400 to 0x141F, the PES packet is sent to the IG decoder 1804D.
- the second demultiplexer 1803B receives from the AV playback library 1746 the PID of the elementary stream to be decoded from the sub-path AV clip SCL.
- the second demultiplexer 1803B reads the sub-path AV clip SCL from the second track buffer 1802B in units of source packets, and extracts TS packets from each source packet.
- the second demultiplexer 1803B further restores the PES packet from the TS packet having the same PID as the PID of the elementary stream to be decoded, and to one of the six types of decoders 1804A-F according to the PID. Send it out.
- the PES packet restored from the TS packet is sent to the primary video decoder 1804A.
- each AV clip MCL, SCL generally includes information to be used as dynamic scenario information by an application program.
- information includes, for example, information related to GUI graphic parts such as navigation buttons (Navigation Buttons) included in the IG stream.
- GUI graphic parts such as navigation buttons (Navigation Buttons) included in the IG stream.
- the primary video decoder 1804A receives the PES packet of the left-view video stream from the first demultiplexer 1803A, and receives the PES packet of the right-view video stream from the second demultiplexer 1803B. Those PES packets are stored in a buffer memory in the primary video decoder 1804A. In parallel, the primary video decoder 1804A reads the PES packet from its buffer memory, removes the PES header, extracts the picture from the remaining PES payload, and decodes it. The primary video decoder 1804A further writes an uncompressed picture to the primary video plane memory 1806A at the time indicated by the PTS described in the PES header. In the 3D video playback process, the primary video decoder 1804A alternately decodes the left view and right view pictures and writes them to the primary video plane memory 1806A.
- the secondary video decoder 1804B includes the same configuration as the primary video decoder 1804A. Using the configuration, the secondary video decoder 1804B receives the PES packet of the secondary video stream from each demultiplexer 1803A, 1803B, extracts a picture from the PES packet, and decodes it. The secondary video decoder 1804B further writes an uncompressed picture in the secondary video plane memory 1806B at the time indicated by the PTS described in the PES packet.
- the PG decoder 1804C receives the PES packet of the PG stream from each of the demultiplexers 1803A and 1803B, extracts the image data from the PES packet, and decodes it. Further, the PG decoder 1804C writes uncompressed image data, that is, a PG plane to the PG plane memory 1806C at the time indicated by the PTS described in the PES packet.
- the IG decoder 1804D receives the PES packet of the IG stream from each of the demultiplexers 1803A and 1803B, extracts the image data from the PES packet, and decodes it.
- the IG decoder 1804D further writes uncompressed image data, that is, the IG plane into the IG plane memory 1806D at the time indicated by the PTS described in the PES packet.
- the IG decoder 1804D is used in the HDMV mode and is not used in the BD-J mode.
- the primary audio decoder 1804E receives the PES packets of the primary audio stream from the demultiplexers 1803A and 1803B and stores them in the internal buffer memory. In parallel, the primary audio decoder 1804E reads the PES packet from its buffer memory and removes the PES header from the PES packet. The primary audio decoder 1804E further extracts LPCM audio data from the remaining PES payload and decodes it. Subsequently, the primary audio decoder 174E sends uncompressed audio data to the mixer 1808 at the time indicated by the PTS described in the PES packet.
- the secondary audio decoder 1804F includes the same configuration as the primary video decoder 1804E.
- the secondary audio decoder 1804F receives the PES packet of the secondary audio stream from each of the demultiplexers 1803A and 1803B using the configuration, extracts the LPCM audio data from the PES packet, and decodes it.
- the secondary audio decoder 1804F further sends uncompressed audio data to the mixer 1808 at the time indicated by the PTS described in the PES packet.
- the image decoder 1804G receives the image data GD from the BD-J module 1745 in the control unit 1650 and decodes it. The image decoder 1804G further writes uncompressed image data into the image data area 1811. Further, in the BD-Live processing, the image decoder 1804G uses a part of the image data area 1811 as a cache area. The image decoder 1804G decodes image data such as a browser screen downloaded from the server device 160, and stores it in its cache area. In particular, both the current image data and the immediately preceding image data are stored in the cache area.
- Each video plane memory 1806A, 1806B is an area secured in a memory element built in the playback unit 1660 and includes a two-dimensional array.
- the size of the array is equal to the resolution of the video frame.
- Each element of the array stores a set of pixel data.
- Pixel data consists of a combination of color coordinate values and alpha values (opacity).
- the color coordinate value is represented by an RGB value or a YCrCb value. Therefore, one video plane can be stored in the array.
- two two-dimensional arrays of the same size are secured in the primary video plane memory 1806A. The left-view video plane is written in one of these arrays, and the right-view video plane is written in the other.
- the image memory 1810 is an area secured in a memory element built in the playback unit 1660. A part of the area is allocated to each of the PG plane memory 1806C, the IG plane memory 1806D, and the BG plane memory 1806E, and the remaining area is allocated to the image data area 1811.
- Each plane memory 1806C, 1806D, 1806E includes two two-dimensional arrays of the same size. Each element of the array stores a set of pixel data. Pixel data consists of a combination of color coordinate values and alpha values. The color coordinate value is represented by an RGB value or a YCrCb value.
- each of the plane memories 1806C, 1806D, and 1806E while the current plane is held in one of the two arrays, the next plane is written to the other. As a result, so-called double buffering can be realized, and flickering can be suppressed in video reproduced from each plane.
- the capacity of the area to be allocated to the IG plane memory 1806D is instructed by the BD-J module 1745, and is changed in particular according to the image reproduction state value 620 indicated by the BD-J object. Specifically, in the state 3 and the state 4 shown in FIG. 7, the capacity of the IG plane memory 1806D is set to double the value in the state 1 and the state 2.
- the rendering engine 1805 includes an API for graphics processing such as Java 2D or OPEN-GL.
- the rendering engine 1805 is specifically used for graphics processing by the BD-J module 1745.
- the BD-J module 1745 first transfers the image data GD to the image data area 1811.
- the BD-J module 1745 then sends instructions to the rendering engine 1805 according to the application program.
- the rendering engine 1805 performs graphics processing such as ⁇ composition (Porter-Duff calculation) on the image data GD in the image data area 1811 in accordance with the instruction.
- ⁇ composition Portable-Duff calculation
- the rendering engine 1805 further writes the image plane to the IG plane memory 1806D and writes the BG plane to the BG plane memory 1806E. Further, when 3D video playback processing in the 2-plane mode is instructed by the BD-J module 1745, the rendering engine 1805 generates both left-view and right-view image planes from the image data GD. And write them to the IG plane memory 1806D.
- the adder 1807 combines the plane written in each plane memory 1806A-E as it is into one video frame.
- the adding unit 1807 first performs a cropping process on at least one of the PG plane, the IG plane, the image plane, and the BG plane. Generate a pair.
- the adding unit 1807 determines a plane to be subjected to the cropping process in accordance with an instruction from the BD-J module 1745.
- the offset value indicated by the 3D metadata 1103 is used.
- the offset value passed from the BD-J module 1745 is used.
- the adder 1807 combines the left-view video plane, the left-view PG plane, the left-view IG plane or the image plane, and the left-view BG plane into a single left-view video frame. Synthesize.
- the adding unit 1807 combines the right-view planes into a single right-view video frame.
- the adder 1807 matches the timing of synthesizing the image plane with the video frame to the timing indicated by the drawing command from the BD-J module 1745. Thereby, each plane of the left view is correctly combined with the left view video frame, and each plane of the right view is correctly combined with the right view video frame.
- Each video frame thus correctly synthesized is converted into video data VD by the adder 1807 and sent to the HDMI transmitter 1670.
- the mixer 1808 superimposes uncompressed audio data received from each of the primary audio decoder 1804E and the secondary audio decoder 1804F to create synthesized audio data AD.
- the mixer 1808 further transmits the audio data AD to the HDMI transmission unit 1670.
- FIG. 19 is a schematic diagram showing an example of an IG plane memory area, a PG plane memory area, a BG plane memory area, and an image data area secured in the image memory 1810.
- the total capacity of the image memory 1810 is 81.5 MB.
- the BD-J module 1745 allocates 16 MB to the IG plane memory area 1901, and the PG plane memory area 1902 and the BG plane memory 2 MB is allocated to the area 1903 and the remaining 61.5 MB is allocated to the image data area 1904.
- the BD-J module 1745 further secures a BD-Live cache area 1905 in the 16 MB area of the image data area 1904.
- the BD-J module 1745 allocates 32 MB to the IG plane memory area 1911, and PG plane memory area 1912 and BG plane memory. 2 MB is allocated to the area 1913 and the remaining 45.5 MB is allocated to the image data area 1914.
- the 2-plane mode has a richer expressiveness than the offset mode, the state 3 and the state 4 can express the surface irregularities and the curved surface of the menu more realistically than the state 2, for example. .
- the BD-J module 1745 first releases the cache area 1905 from the image data area 1904, for example, when the setting state of the playback device 110 is switched from state 2 to state 4. Next, the BD-J module 1745 allocates the free area generated by the release to the IG plane memory area 1911. Thus, the capacity of the IG plane memory area is doubled from 16 MB to 32 MB. Thus, a 2-plane mode is available. However, since the cache area 1905 disappears, the BD-Live function by network connection cannot be used. On the contrary, when the setting state of the playback device 110 is switched from the state 4 to the state 2, the 16 MB area is first released from the 32 MB IG plane memory area 1911.
- a free area generated by the release is allocated to the image data area 1904 and secured as a cache area 1905.
- the BD-Live function by network connection can be used.
- the capacity of the IG plane memory area is halved from 32 MB to 16 MB, the 2-plane mode cannot be used.
- the switching between the state 1 and the state 4, the switching between the state 1 and the state 3, and the switching between the state 2 and the state 3 release and secure the 16 MB cache area, and the image data area and the IG plane.
- a 16 MB area is exchanged with the memory area.
- the BD-J module 1745 has a BD-Live in a part of the 45.5 MB image data area 1914. Allocate a cache area for use. However, the capacity of the cache area is limited to be smaller than the capacity 16 MB of the cache area 1905 in the state 1 or the state 2. Further, since the cache area is secured, the remaining part of the image data area 1914 is smaller than 45.5 MB. Therefore, in switching between the state 3 and another state, the capacities of the image data area and the cache area are changed.
- an application program that can operate with an image data area smaller than 45.5 MB and a cache area smaller than 16 MB can realize the BD-Live function and uses the 32 MB IG plane memory area 1911. 2 plane mode can be executed.
- the application program can display both the GUI screen constructed by itself and the browser screen downloaded from the external network on the display device 120 at the same time. The feeling can be further improved.
- the playback device 110 causes the application program to dynamically switch between the four states 1-4. Thereby, the playback device 110 can selectively use the two-plane mode and the BD-Live function for the application program while maintaining the total capacity of the image memory constant. Further, the playback apparatus 110 can simultaneously use the BD-Live function and the two-plane mode for an application program that can operate in the image data area and the cache area whose capacity is reduced.
- FIG. 20 is a schematic diagram showing image planes stored in the IG plane memory area 1911 in each of the offset mode and the 2-plane mode.
- the rendering engine 1805 writes two 1920 ⁇ 1080 image planes in the IG plane memory area 1911. One of them is the left view image plane 2003, and the other is the right view image plane 2004.
- the rendering engine 1805 logically concatenates the two image planes 2003 and 2004 in the horizontal direction so that the number of pixels in the horizontal direction is double, that is, an image plane of 3840 ⁇ 1080. Compose 2002 and give it a handle. Accordingly, the rendering engine 1805 causes the application program to operate the left view image plane 2003 and the right view image plane 2004 as the left half and the right half of the single image plane 2002. For example, when an instruction from the BD-J module 1745 indicates drawing to the left half of the image plane 2002, the rendering engine 1805 writes the left view image plane 2003 to the IG plane memory area 1911.
- the rendering engine 1805 when the instruction from the BD-J module 1745 indicates drawing on the right half of the image plane 2002, the rendering engine 1805 writes the right-view image plane 2004 into the IG plane memory area 1911. Further, when the instruction from the BD-J module 1745 indicates drawing to the entire image plane 2002, the rendering engine 1805 converts both the left view image plane 2003 and the right view image plane 2004 to the IG plane. -You may write in the memory area 1911. Thus, the rendering engine 1805 allows the application program to manipulate the image plane with a single handle, regardless of whether it is in offset mode or 2-plane mode.
- FIG. 21 is a functional block diagram of the adder 1807 in state 1, that is, 2D video playback processing.
- the adding unit 1807 includes four adders 2101 to 2104.
- the first adder 2101 synthesizes the secondary video plane 2111 with the primary video plane 2110 and sends it to the second adder 2102.
- the second adder 2102 synthesizes the BG plane 2112 with the video plane received from the first adder 2101 and sends it to the third adder 2103.
- the third adder 2103 combines the PG plane 2113 with the video plane received from the second adder 2102 and sends it to the fourth adder 2104.
- Fourth adder 2104 combines image plane or IG plane 2114 with the video plane received from third adder 2103.
- the fourth adder 2104 further converts the combined video plane into video data VD as one video frame, and sends it to the HDMI transmission unit 1670.
- FIG. 22 is a functional block diagram of the adder 1807 in state 2.
- the adder 1807 includes a switch 2200, three adders 2201-2203, and three cropping processors 2211-2213.
- the BD-J mode is assumed for convenience. The same explanation applies to the HDMV mode.
- the switch 2200 sends the left-view video plane 2220 and the right-view video plane 2221 to the first adder 2201 in the order of PTS.
- the switch 2200 transmits the left-view video plane 2220 before the right-view video plane 2221.
- the secondary video plane has two types of a left view and a right view, they are alternately read into the adding unit 1807 by a similar switch, and are switched from the switch 2200. Composite to the outgoing video plane.
- the first adder 2201 alternately receives the left-view video plane 2220 and the right-view video plane 2221 from the switch 2200.
- the first cropping processor 2211 alternately receives the left view and right view BG planes.
- the first adder 2201 combines the left view BG plane with the left view video plane 2220 and combines the right view BG plane with the right view video plane 2221.
- the combined video planes are alternately sent to the second adder 2202.
- the second adder 2202 receives the left-view video plane and the right-view video plane alternately from the first adder 2201.
- the second cropping processor 2212 alternately receives the left view and right view PG planes.
- the second adder 2202 combines the left view PG plane with the left view video plane and the right view PG plane with the right view video plane.
- the combined video planes are alternately sent to the third adder 2203.
- the third adder 2203 receives the left-view video plane and the right-view video plane alternately from the second adder 2202.
- the third cropping processor 2213 receives the image planes of the left view and the right view alternately.
- the third adder 2203 synthesizes the left-view image plane with the left-view video plane and synthesizes the right-view image plane with the right-view video plane.
- the third adder 2203 further converts the combined video plane into video data VD as one video frame, and sends it to the HDMI transmission unit 1670.
- the first cropping unit 2211 performs a cropping process on the BG plane 2222 using the offset value passed from the BD-J module 1745. As a result, the BG plane 2222 is alternately converted into a left view BG plane and a right view BG plane.
- the second cropping processor 2212 performs a cropping process on the PG plane 2223 using the offset value indicated by the 3D metadata 1103. Thereby, the PG plane 2223 is alternately converted into a left view PG plane and a right view PG plane.
- the third cropping processor 2213 performs the cropping process on the image plane 2224 using the offset value passed from the BD-J module 1745. As a result, the image plane 2224 is alternately converted into a left-view image plane and a right-view image plane.
- FIG. 23 is a schematic diagram showing a cropping process for the PG plane GP by the second cropping processor 2212.
- the PG plane GP includes a graphics element ST representing a caption “I love you”.
- the ⁇ value is set to 0, that is, it is transparent.
- the second cropping processor 2212 accesses the primary video decoder 1804E to determine whether the video plane to be synthesized with the PG plane GPL represents a left view or a right view.
- the second cropping processor 2212 displaces the graphics element ST in the PG plane GP in the horizontal direction by the number of pixels PX.
- the number of pixels PX is equal to the offset value 1203.
- the direction of displacement varies depending on the result of discrimination.
- the video plane to be synthesized represents a left view
- the offset value 1203 is positive
- the graphics element ST is displaced to the right, and if it is negative, it is displaced to the left.
- a transparent band B1L having a width equal to the number of pixels PX is added to the left side of the original PG plane GP, and the transparent band B1R having the same width is added to the original PG plane. Removed from the right edge of the GP. Thereby, the original PG plane GP is rewritten to the left view PG plane LGP.
- the distance DL between the left end of the left view PG plane LGP and the graphics element ST is longer by the number of pixels PX than the distance D0 between the left end of the original PG plane GP and the graphics element ST. That is, the position of the graphics element ST moves to the right from the original position. The opposite is true when the offset value 1203 is negative.
- the graphics element ST is displaced to the left if the offset value 1203 is positive, and to the right if the offset value 1203 is negative.
- the transparent band B2L having a width equal to the number of pixels PX is removed from the left end portion of the original PG plane GP, and the transparent band B2R having the same width is removed from the original PG.
- the original PG plane GP is rewritten to the right view PG plane RGP.
- the distance DR between the left end of the right-view PG plane RGP and the graphics element ST is shorter than the distance D0 between the left end of the original PG plane GP and the graphics element ST by the number of pixels PX. That is, the position of the graphics element ST moves to the left from the original position. The opposite is true when the offset value 1203 is negative.
- the second cropping processor 2212 generates a left-view PG plane LGP and a right-view PG plane RGP from one PG plane GP, and alternately sends them to the second adder 2202. Between them, the horizontal position of the graphics element ST differs by twice the number of pixels PX, that is, twice the offset value 1203. By perceiving this displacement as binocular parallax, the viewer sees the subtitle “I love you” at a different depth from the screen.
- the first cropping processor 2211 performs cropping processing on the BG plane 2222 in the same manner, and the third cropping processor 2213 performs cropping processing on the image plane 2224 in the same manner.
- FIG. 24 is a functional block diagram of the adding unit 1807 in the state 3 and the state 4.
- the adding unit 1807 includes two mode switches 2411 and 2412 in addition to the functional units shown in FIG.
- the first mode switch 2411 switches the transmission destination of the left-view image plane 2420 between the offset mode and the 2-plane mode in accordance with the instruction from the BD-J module 1745.
- the first mode switch 2411 sends the left-view image plane 2420 to the third cropping processor 2213. Accordingly, a left-view and right-view image plane pair is generated from the left-view image plane 2420.
- the first mode switch 2411 sends the left view image plane 2420 to the second mode switch 2412.
- the second mode switch 2412 sends the left-view image plane 2420 and the right-view image plane 2421 alternately to the third adder 2203 in conjunction with the switch 2200.
- second mode switch 2412 sends a left-view image plane 2420
- switch 2200 sends a right-view video plane 2221
- the second mode switch 2412 sends out the right-view image plane 2421. Accordingly, the third adder 2203 can correctly combine the video plane and the image plane.
- FIG. 25 is a flowchart of the switching process of the setting state of the playback device 110 by the BD-J module 1745.
- a title switching process when a new BD-ROM disc is inserted into the BD-ROM drive 111 is assumed.
- the title switching process performed in response to a user operation or an application program request while the BD-ROM disc 100 is still inserted in the BD-ROM drive 111 is the same.
- Step S2501 The operation unit 1620 detects the insertion of the BD-ROM disc 100 into the BD-ROM drive 111, and sends a notification INT indicating that to the user operation detection module 1702.
- the user operation detection module 1702 sends an operation signal UO to the mode management module 1743 in response to the notification INT.
- the dispatcher 1743A requests the virtual file system 1703 to read the index file IF through the AV playback library 1746 in response to the operation signal UO.
- the mode management module 1743 refers to the item “first play” 301 in the index table in the index file IF and identifies the object specified by the item.
- the object is a BD-J object.
- the mode management module 1743 sends an instruction to the virtual file system 1703 through the AV playback library 1746 to transfer the BD-J object to the dynamic scenario memory 1741.
- the mode management module 1743 assigns the current dynamic scenario information DS to the BD-J module 1745.
- the BD-J module 1745 reads the BD-J object from the dynamic scenario information DS in the dynamic scenario memory 1741.
- Step S2502 The BD-J module 1745 reads the current image playback state value from the AV playback library 1746 and compares it with the image playback state value 620 indicated by the BD-J object. When the two compared image reproduction state values match, or when their combination indicates switching between state 1 and state 2, the process proceeds to step S2503. When the combination of the two compared image reproduction state values indicates other than switching between state 1 and state 2, the process proceeds to step S2504.
- Step S2503 The setting state of the playback device 110 requested by the BD-J object and the setting state before the BD-ROM disc 100 is inserted are equal to each other, or the combination of the state 1 and the state 2 is equal. Therefore, the BD-J module 1745 does not change the area in the image memory 1810. On the other hand, when the BD-J object requests to switch between the state 1 and the state 2, the BD-J module 1745 performs 2D video playback processing and 3D video playback from the video stream in response to the request. Any one of the processes is designated to the playback device 110. Thereafter, the BD-J object 1745 performs title reproduction processing as usual.
- the application manager 1745A instructs the virtual machine 1745B to start or end the application program according to the application management table 410 in the BD-J object.
- the application manager 1745A determines whether or not to continue its execution.
- the virtual machine 1745B starts or terminates the application program in accordance with an instruction from the application manager 1745A.
- the BD-J module 1745 executes the reproduction process of the title corresponding to the item “first play” 303 according to the application program.
- Step S2504 The two compared image reproduction state values indicate other than the combination of state 1 and state 2. Accordingly, the BD-J module 1745 uses the application manager 1745A to forcibly terminate all application programs in the virtual machine 1745B. Thereafter, processing proceeds to step S2505.
- Step S2505 The BD-J module 1745 causes the playback unit 1660 to change each area in the image memory 1810. Specifically, the two compared image reproduction state values are switched from state 1 to state 3, from state 2 to state 3, from state 1 to state 4, or from state 2 to state 4. As shown in FIG. 19, the BD-J module 1745 first releases the BD-Live cache area 1905 from the image data area 1904, as shown in FIG. Next, the BD-J module 1745 allocates the free area generated by the release to the IG plane memory area 1911 and doubles the capacity of the IG plane memory area.
- the BD-J module 1745 first uses half of the IG plane memory area 1911. release. Next, the BD-J module 1745 allocates a free area generated by the release to the image data area 1904 and secures it as a cache area 1905 for BD-Live. Further, when the two image playback state values indicate switching between the state 3 and the state 4, the BD-J module 1745 reserves or releases a cache area for BD-Live processing in the image data area 1911. Thereafter, processing proceeds to step S2506.
- Step S2506 The BD-J module 1745 causes the AV playback library 1746 to update the current image playback state value to the image playback state value 620 indicated by the BD-J object. Thereafter, processing proceeds to step S2507.
- Step S2507 The BD-J module 1745 switches the setting state of the playback device 110 to that requested by the BD-J object. Thereafter, the BD-J module 1745 performs the title reproduction process as usual. That is, the application manager 1745A instructs the virtual machine 1745B to start or end the application program according to the application management table 410 in the BD-J object. In particular, when there is a disk unbound application program that is forcibly terminated in step S2504, the application manager 1745A determines whether or not its execution should be resumed. The virtual machine 1745B starts or terminates the application program in accordance with an instruction from the application manager 1745A. Thereby, the BD-J module 1745 executes the reproduction process of the title corresponding to the item “first play” 303 according to the application program.
- the BD-J module 1745 switches the setting state of the playback device 110 according to the different image playback state value.
- the state 1 and the state 3, the state 1 and the state 4, the state 2 and the state 3, or the state 2 and the state 4 are switched, the BD-Live is stored in the image memory 1810 as shown in FIG.
- the cache area 1905 is released or secured, and a part of the area is exchanged between the image data area and the IG plane memory area.
- the state 3 and the state 4 are switched, the capacities of the BD-Live cache area and the image data area are changed in the image memory 1810.
- disc-bound or disc-unbound application programs generally do not end with title switching. Accordingly, there remains a risk that these application programs will misaccess the area in the image memory after switching the title as the area before switching.
- the BD-J module 1745 compares the image playback state value 620 indicated by the BD-J object with the current value. To do. Furthermore, when the two compared image playback state values indicate a combination other than the combination of state 1 and state 2, the BD-J module 1745 uses the application manager 1745A to force all the application programs to the virtual machine 1745B. Terminate. Thereby, when the area in the image memory 1810 needs to be changed, all application programs are terminated prior to that. Therefore, there is no risk that the application program misaccesses the area after the change as a pre-change area.
- the playback apparatus 110 can cause the application program to selectively use the 2-plane mode and the BD-Live function without causing malfunction.
- the playback device 110 can play back digital content with a higher stereoscopic effect of graphics images without increasing the capacity of the image memory.
- Embodiment 1 of the present invention when both left-view and right-view image data exist, the left-view image data is used in the offset mode.
- right-view image data may be used instead of the left-view image data.
- the adding unit 1807 alternately sends a pair of video frames of the left view and the right view after synthesis.
- the adder 1807 uses a built-in buffer memory to further convert the left-view and right-view video frame pairs into one video. -You may combine it into a frame.
- the adding unit 1807 temporarily stores and holds the previously synthesized left view video plane in its buffer memory. Subsequently, the adder 1807 combines the right-view video plane and further combines it with the left-view video plane held in the buffer memory.
- each video plane is divided into strip-like small areas elongated in the vertical direction, and the small areas are alternately arranged in the horizontal direction to be reconstructed into one frame.
- the playback device according to the first embodiment of the present invention can be applied to a display device that uses a lenticular lens to display 3D video.
- the adder 1807 can switch between the offset mode and the 2-plane mode using the two mode switches 2411 and 2412. Realize.
- the 3D video reproduction process from the image data may be limited to the 2-plane mode only.
- state 3 and state 4 can be divided into two states specialized for each mode. Good. For example, with the setting of the original state 3, the state where the playback processing of 3D video from the image data is fixed to the offset mode is “state 3”, and the state where the playback processing is fixed to the 2-plane mode is “state 5”. Good. In that case, the image reproduction state value increases to six types. Furthermore, switching between the offset mode and the two-plane mode is possible only by switching the title.
- the adding unit 1807 switches between the offset mode and the 2-plane mode according to the instruction of the BD-J module 1745.
- the register 1746A in the AV playback library 1746 may be used as follows: First, a flag is set in the register 1746A. Next, when the BD-J module 1745 designates the offset mode, the flag is turned off, and when the two-plane mode is designated, the flag is turned on. On the other hand, the adding unit 1807 operates in the offset mode when the flag is off, and operates in the 2-plane mode when the flag is on.
- the BD-J module 1745 may cause the rendering engine 1805 to copy the left-view image plane to the right-view image plane prior to that.
- the rendering engine 1805 may cause the rendering engine 1805 to copy the left-view image plane to the right-view image plane prior to that.
- Embodiment 1 of the present invention 3D video playback processing from either the BG plane or the PG plane is performed in the offset mode.
- the application program causes the BD-J module 1745 to generate both left view and right view BG planes so that 3D video playback processing from the BG plane is performed in the 2-plane mode. Also good. Further, by reproducing both the left view and right view PG streams in the AV stream file, 3D video playback processing from the PG plane may be performed in the 2-plane mode. As a result, it is possible to further improve the expressiveness of the stereoscopic effect for the graphics image of the background and the caption.
- the BD-J module 1745 may skip steps S2502 to S2504 in the steps shown in FIG.
- the BD-Live cache area is limited to be smaller than in state 1 and state 2. Accordingly, when switching from state 1 or state 2 to state 3 is necessary in accordance with the switching of the title, the BD-J module 1745 may display a warning screen on the display device 120 before the switching. Thereby, the playback device 110 can warn the viewer in advance of the danger that the response of the BD-Live process will be reduced.
- the playback apparatus can allow an application program to select an HDMV mode or a BD-J mode according to a built-in memory resource during 3D video playback processing. Except for this point, the playback apparatus according to the second embodiment has the same configuration and function as the playback apparatus according to the first embodiment. Accordingly, in the following description, of the playback device according to the second embodiment, a changed part and an extended portion from the playback device according to the first embodiment will be described. For the same parts as those of the playback apparatus according to the first embodiment, the description of the first embodiment is cited.
- the playback device according to Embodiment 2 of the present invention is classified into two types, a low-priced version and a normal version, depending on the size of the built-in memory resource.
- “Inexpensive playback device” refers to a playback device that can execute 3D video playback processing only in the HDMV mode because it has relatively small memory resources. In the HDMV mode, unlike the BD-J mode, only the 3D video of the content main body on the BD-ROM disc 100 can be played back, and the interactive content graphics video such as a pop-up menu cannot be played back.
- the “normal version playback device” is a playback device that has sufficient memory resources and can execute 3D video playback processing in either the HDMV mode or the BD-J mode.
- the BD-J module 1745 notifies the application program read from the BD-ROM disc 100 when the title is switched whether the built-in playback device is the low-cost version or the normal version. Can do.
- FIG. 26 is a flowchart of event processing by an application program. This event processing is started when the user operation detection module 1702 receives a notification from the operation unit 1620.
- Step S2601 The user operation detection module 1702 identifies the event type indicated by the notification from the operation unit 1620, and sends an operation signal indicating the event type to the mode management module 1743.
- the dispatcher 1743A passes the operation signal to the BD-J module 1745.
- the BD-J module 1745 decodes the operation signal and notifies the application program of the content.
- the application program determines whether or not the content indicates a 3D video playback request by the user. If the determination is negative, the process proceeds to step S2602. If the determination is affirmative, the process proceeds to step S2603.
- Step S2602 Since the user's operation is not a 3D video playback request, the application program performs normal event processing.
- Step S2603 Since the user's operation is a 3D video playback request, the application program inquires of the BD-J module 1745 whether or not the playback device is an inexpensive version. When the answer to the inquiry is negative, the process proceeds to step S2604, and when the answer is affirmative, the process proceeds to step S2605.
- Step S2604 Since the playback device is a normal version, 3D video playback processing can also be executed in the BD-J mode. Therefore, the application program starts 3D video playback processing in the BD-J mode.
- Step S2605 Since the playback device is a low-priced version, 3D video playback processing can be executed only in the HDMV mode. Therefore, the application program causes the BD-J module 1745 to switch the title of the BD-J mode to the title of the HDMV mode. By the switching of the title, the main subject of the reproduction process shifts from the BD-J module 1745 to the HDMV module 1744.
- the 2D video playback process by the 1BD-J object BDJO-2D associated with the item “title 2” is changed to the second movie object MVO associated with the item “title 3”. -Shift to 3D video playback processing in 3D.
- the title returns to the original BD-J mode title
- the main player of the playback process returns from the HDMV module 1744 to the BD-J module 1745.
- the playback apparatus surely causes the application program read from the BD-ROM disc 100 to execute 3D video playback processing, regardless of whether it is a low-priced version or a normal version. be able to. Thereby, it is possible to reduce the burden on the authoring of the application program.
- the volume area 122 shown in FIG. 2 includes a directory area, a file set descriptor recording area, and a terminal descriptor recording area.
- the “file set descriptor” indicates a logical block number (LBN) of a sector in which a file entry of the root directory is recorded in the directory area.
- the “end descriptor” indicates the end of the file set descriptor.
- Each directory area has a common data structure.
- Each directory area includes, in particular, recording areas for file entries, directory files, and subordinate files.
- “File entry” includes a descriptor tag, an ICB tag, and an allocation descriptor.
- “Descriptor tag” indicates that the data including the descriptor tag is a file entry. For example, when the value of the descriptor tag is “261”, the data is a file entry.
- the “ICB tag” indicates attribute information of the file entry itself.
- the “allocation descriptor” indicates the LBN of the sector in which the directory file belonging to the same directory area is recorded.
- “Directory file” includes a file identification descriptor of a lower directory and a file identification descriptor of a lower file.
- the “file identifier descriptor of the lower directory” is information for accessing the lower directory directly under the directory recorded in the directory area.
- This file identification descriptor includes, in particular, identification information of the subordinate directory, the length of the directory name, the file entry address, and the directory name itself.
- the file entry address indicates the LBN of the sector in which the file entry of the lower directory is recorded.
- the “file identifier descriptor of the lower file” is information for accessing the lower file immediately under the directory recorded in the directory area.
- This file identification descriptor includes the identification information of the lower file, the length of the file name, the file entry address, and the file name itself.
- the file entry address indicates the LBN of the file entry of the lower file.
- “Subordinate file” includes the file entry and substance of the subordinate file immediately under the directory recorded in the directory area.
- the “file entry” includes a descriptor tag, an ICB tag, and an allocation descriptor.
- “Descriptor tag” indicates that the data including the descriptor tag is a file entry.
- the “ICB tag” indicates attribute information of the file entry itself.
- the “allocation descriptor” indicates the arrangement of each extent constituting the entity of the lower file.
- “extent” means a data string in which logical addresses are continuous. One allocation descriptor is provided for each extent. Therefore, when the subordinate file is divided into a plurality of extents, the file entry includes a plurality of allocation descriptors.
- the allocation descriptor includes the size and LBN of each extent.
- the upper 2 bits of the allocation descriptor indicate whether or not an extent is actually recorded in the sector of the LBN. That is, when the upper 2 bits are “0”, it indicates that the extent has been allocated and recorded for the sector, and when it is “1”, the extent has been allocated to the sector. Indicates unrecorded.
- the allocation descriptor of the file entry of each file the logical address of each extent constituting the file can be known.
- the recording medium according to the embodiment of the present invention includes not only an optical disk but also all removable media that can be used as a package medium, such as a portable semiconductor memory device including an SD memory card.
- a portable semiconductor memory device including an SD memory card.
- an optical disk on which data is recorded in advance that is, an existing read-only optical disk such as a BD-ROM or a DVD-ROM is taken as an example.
- the recording medium according to the embodiment of the present invention is not limited thereto.
- 3D video content distributed via broadcast or network is written on an existing writable optical disc such as a BD-RE or DVD-RAM by a terminal device, and may be used as a recording medium according to the embodiment.
- the terminal device may be incorporated in the playback device or may be a device different from the playback device.
- a data reading unit of a reproducing apparatus when a semiconductor memory card is used as a recording medium according to an embodiment of the present invention instead of an optical disk will be described.
- the portion of the playback device that reads data from the optical disc is configured by, for example, an optical disc drive.
- the portion for reading data from the semiconductor memory card is constituted by a dedicated interface (I / F). More specifically, a card slot is provided in the playback device, and the above I / F is mounted therein. When the semiconductor memory card is inserted into the card slot, the semiconductor memory card is electrically connected to the playback device through the I / F. Further, data is read from the semiconductor memory card to the playback device through the I / F.
- Some data recorded on the BD-ROM disc may be encrypted, for example, from the viewpoint of copyright protection or improvement of data confidentiality.
- the encrypted data includes, for example, a video stream, an audio stream, or other stream. In that case, the encrypted data is decrypted as follows.
- the playback apparatus stores in advance a part of data necessary for generating a “key” for decrypting encrypted data on the BD-ROM disc, that is, a device key.
- a device key On the other hand, in the BD-ROM disc, another part of the data necessary for generating the “key”, that is, the MKB (media key block) and the encrypted data of the “key” itself, that is, the encrypted title key are stored. And are recorded.
- the device key, MKB, and encrypted title key are associated with each other, and further associated with a specific identifier written in the BCA 201 on the BD-ROM disc 100 shown in FIG. Yes. If the combination of the device key, MKB, encrypted title key, and volume ID is not correct, the encrypted data cannot be decrypted.
- the above-mentioned “key”, that is, the title key is generated only when these combinations are correct. Specifically, first, the encrypted title key is decrypted using the device key, MKB, and volume ID. Only when the title key can be derived thereby, the encrypted data can be decrypted using the title key as the “key”.
- the playback device Even if the playback device tries to play back the encrypted data on the BD-ROM disc, for example, the device key previously associated with the encrypted title key, MKB, and volume ID on the BD-ROM disc is stored in the playback device. If it is not stored, the encrypted data cannot be reproduced. This is because the key necessary for decrypting the encrypted data, ie, the title key, cannot be derived unless the encrypted title key is decrypted with the correct combination of the MKB, device key, and volume ID.
- the protected stream is encrypted with the title key and recorded on the BD-ROM disc.
- a key is generated from a combination of the MKB, device key, and volume ID, and the title key is encrypted with the key and converted into an encrypted title key.
- the MKB, the volume ID, and the encrypted title key are recorded on the BD-ROM disc.
- the encrypted video stream and / or audio stream can be decrypted by the decoder only from the BD-ROM disc with the playback apparatus having the device key used for generating the key. In this way, the copyright of the data recorded on the BD-ROM disc can be protected.
- the above-described mechanism for protecting the copyright of data on a BD-ROM disc can be applied to other than the BD-ROM disc.
- the present invention can be applied to a readable / writable semiconductor memory device, particularly a portable semiconductor memory card such as an SD card.
- Distribution data Data such as an AV stream file of 3D video (hereinafter referred to as distribution data) is transmitted to the playback apparatus according to the embodiment of the present invention using electronic distribution, and the distribution data is further transferred to the playback apparatus to the semiconductor memory card.
- the recording process will be described below. The following operation may be performed by a terminal device specialized for the processing instead of the above-described playback device. Further, it is assumed that the recording destination semiconductor memory card is an SD memory card.
- the playback device has a card slot. An SD memory card is inserted in the card slot. In this state, the playback device first sends a transmission request for distribution data to a distribution server on the network. At this time, the playback device reads the identification information from the SD memory card, and sends the identification information together with the transmission request to the distribution server.
- the identification information of the SD memory card is, for example, an identification number unique to the SD memory card, more specifically, a serial number of the SD memory card. This identification information is used as the volume ID described above.
- Distribution data is stored in the distribution server.
- data that needs to be protected by encryption such as a video stream and / or an audio stream, is encrypted using a predetermined title key.
- the encrypted data can be decrypted with the same title key.
- the distribution server holds a device key as a secret key shared with the playback device.
- the distribution server further holds a common MKB with the SD memory card.
- the distribution server receives the distribution data transmission request and the SD memory card identification information from the playback device, the distribution server first generates a key from the device key, MKB, and the identification information, and encrypts the title key with the key. To generate an encrypted title key.
- the distribution server generates public key information.
- the public key information includes, for example, the above-described MKB, encrypted title key, signature information, SD memory card identification number, and device list.
- the signature information includes, for example, a hash value of public key information.
- the device list is a list of devices that should be invalidated, that is, devices that have a risk of illegally reproducing encrypted data in distribution data. In the list, for example, a device key of the playback device, an identification number of the playback device, an identification number of various parts such as a decoder built in the playback device, or a function (program) is specified.
- the distribution server further sends distribution data and public key information to the playback device.
- the playback device receives them and records them on the SD memory card through the dedicated I / F in the card slot.
- the encrypted data is decrypted using, for example, public key information as follows.
- the following three types of checks (1) to (3) are performed as public key information authentication. Note that they may be performed in any order.
- the playback device stops the decryption process of the encrypted data. Conversely, when all the results of the above checks (1) to (3) are positive, the playback device recognizes the validity of the public key information and uses the identification information of the device key, MKB, and SD memory card. Then, the encrypted title key in the public key information is decrypted into the title key. The playback device further uses the title key to decrypt the encrypted data into, for example, a video stream and / or an audio stream.
- the above mechanism has the following advantages. If the playback device, parts, and functions (programs) that are at risk of unauthorized use are already known at the time of electronic distribution, these identification information is listed in the device list and distributed as part of public key information. The On the other hand, the playback device that has requested distribution data must always check the identification information in the device list against the identification information of the playback device and its components. As a result, if the playback device or its parts are shown in the device list, even if the combination of the SD memory card identification number, MKB, encrypted title key, and device key is correct, the playback device Public key information cannot be used to decrypt encrypted data in distribution data. Thus, unauthorized use of distribution data can be effectively suppressed.
- the identification information of the semiconductor memory card is stored in a recording area having a particularly high confidentiality among the recording areas in the semiconductor memory card. This is because in the unlikely event that the identification information, for example, the serial number of an SD memory card is tampered with illegally, illegal copying of the SD memory card can be easily performed. That is, if there are a plurality of semiconductor memory cards having the same identification information as a result of the falsification, the above-mentioned check (1) makes it impossible to distinguish between a genuine product and an illegally copied product. Therefore, the identification information of the semiconductor memory card must be recorded in a highly confidential recording area and protected from unauthorized tampering.
- means for configuring such a highly confidential recording area in the semiconductor memory card are as follows. First, another recording area (hereinafter referred to as a second recording area) that is electrically separated from a normal data recording area (hereinafter referred to as a first recording area) is provided. Next, a control circuit dedicated to access to the second recording area is provided in the semiconductor memory card. Thereby, the second recording area can be accessed only through the control circuit. For example, only the encrypted data is recorded in the second recording area, and a circuit for decrypting the encrypted data is incorporated only in the control circuit. As a result, access to data in the second recording area is not possible unless the control circuit decrypts the data. In addition, the address of each data in the second recording area may be held only in the control circuit. In that case, the address of the data in the second recording area can be specified only by the control circuit.
- the application program operating on the playback device acquires data from the distribution server using electronic distribution and records it on the semiconductor memory card
- the following processing is performed.
- the application program issues an access request to the identification information of the semiconductor memory card recorded in the second recording area to the control circuit via the memory card I / F.
- the control circuit first reads the identification information from the second recording area.
- the control circuit sends the identification information to the application program via the memory card I / F.
- the application program sends a transmission request for distribution data together with the identification information to the distribution server.
- the application program further records the public key information and the distribution data received from the distribution server in response to the request in the first recording area in the semiconductor memory card via the memory card I / F.
- the above application program preferably checks whether or not the application program itself has been tampered with before issuing the above access request to the control circuit in the semiconductor memory card.
- the control circuit in the semiconductor memory card For example, X.
- a digital certificate compliant with 509 may be used.
- the distribution data may be recorded in the first recording area in the semiconductor memory card, and access to the distribution data may not be controlled by the control circuit in the semiconductor memory card.
- the AV stream file and the playlist file are recorded on the BD-ROM disc by the pre-recording technology in the authoring system and supplied to the user.
- AV stream files and playlist files are recorded on a writable recording medium such as a BD-RE disc, a BD-R disc, a hard disk, or a semiconductor memory card (hereinafter referred to as a BD-RE disc or the like) by real-time recording. May be recorded and supplied to the user.
- the AV stream file may be a transport stream obtained by the recording device decoding the analog input signal in real time.
- a transport stream obtained by partializing a transport stream digitally input by the recording apparatus may be used.
- a recording device that performs real-time recording includes a video encoder, an audio encoder, a multiplexer, and a source packetizer.
- the video encoder encodes the video signal and converts it into a video stream.
- the audio encoder encodes the audio signal and converts it into an audio stream.
- the multiplexer multiplexes the video stream and the audio stream and converts them into a digital stream in the MPEG2-TS format.
- the source packetizer converts TS packets in the MPEG2-TS format digital stream into source packets.
- the recording device stores each source packet in an AV stream file and writes it on a BD-RE disc or the like.
- the control unit of the recording apparatus In parallel with the AV stream file writing process, the control unit of the recording apparatus generates a clip information file and a playlist file on the memory and writes them on the BD-RE disc or the like. Specifically, when a recording process is requested by the user, the control unit first generates a clip information file in accordance with the AV stream file and writes it on a BD-RE disc or the like. In that case, every time the head of one GOP in the video stream is detected from the transport stream received from the outside, or each time one GOP in the video stream is generated by the video encoder, The control unit obtains the PTS of the I picture located at the head of the GOP and the SPN of the source packet storing the head of the GOP.
- the control unit further adds the pair of PTS and SPN as one entry point to the entry map of the clip information file.
- an “is_angle_change flag” is added to the entry point.
- the is_angle_change flag is set to “ON” when the head of the GOP is an IDR picture, and is set to “OFF” when the head of the GOP is not an IDR picture.
- stream attribute information is further set according to the attribute of the stream to be recorded.
- the playback apparatus may further write the digital stream on the BD-ROM disc to another recording medium by managed copy.
- “Managed copy” means copying a digital stream, a playlist file, a clip information file, and an application program from a read-only recording medium such as a BD-ROM disc to a writable recording medium. This is a technology for permitting only when authentication by communication with is successful.
- the writable recording media are BD-R, BD-RE, DVD-R, DVD-RW, DVD-RAM and other writable optical disks, hard disks, SD memory cards, Memory Stick (registered trademark), and compact. Including portable semiconductor memory devices such as flash (registered trademark), smart media (registered trademark), and multimedia card (registered trademark).
- Managed copy makes it possible to limit the number of backups of data recorded on a read-only recording medium and to charge for backup processing.
- Transcode refers to processing for adapting a digital stream recorded on a copy source disc to an application format of a copy destination recording medium.
- Transcode includes, for example, a process of converting from MPEG2-TS format to MPEG2 program stream format, and a process of re-encoding by reducing the bit rate assigned to each of the video stream and the audio stream.
- an AV stream file, a clip information file, and a playlist file must be generated by the above-described real-time recording.
- the repetition structure “a plurality of information of a predetermined type exists” is defined by describing the initial value of the control variable and the repetition condition in the for statement.
- the data structure “predetermined information is defined when a predetermined condition is satisfied” is defined by describing the condition and a variable to be set when the condition is satisfied in an if statement. .
- the data structure according to the embodiment is described in a high-level programming language. Therefore, the data structure is converted into a computer-readable code through a translation process by a compiler such as “syntactic analysis”, “optimization”, “resource allocation”, and “code generation”, and recorded on a recording medium.
- the data structure is handled as a part other than the method of the class structure in the object-oriented language, specifically, as an array type member variable in the class structure, and a part of the program is handled. Make it. That is, the data structure is substantially equivalent to the program. Therefore, the data structure should be protected as a computer related invention.
- a reproduction program is recorded on the recording medium as an executable file.
- the reproduction program causes the computer to reproduce the AV stream file according to the playlist file.
- the reproduction program is loaded from a recording medium into a memory device in the computer and then executed by the computer.
- the load process includes a compile process or a link process.
- the reproduction program is divided into a plurality of sections in the memory device. These sections include a text section, a data section, a bss section, and a stack section.
- the text section includes a playback program code string, initial values of variables, and non-rewritable data.
- the data section includes variables having initial values and rewritable data.
- the data section includes, in particular, files that are recorded on the recording medium and accessed from time to time.
- the bss section includes a variable having no initial value.
- the data in the bss section is referred to according to the instruction indicated by the code in the text section.
- an area for the bss section is secured in the RAM in the computer.
- the stack section is a memory area that is temporarily reserved as necessary. Local variables are temporarily used in each process by the playback program. The stack section contains those local variables. When execution of the program is started, variables in the bss section are initialized with zeros, and a necessary memory area is secured in the stack section.
- the playlist file and the clip information file have already been converted into a computer-readable code on the recording medium. Therefore, these files are managed as “non-rewritable data” in the text section or “files accessed at any time” in the data section when the playback program is executed. That is, the playlist file and the clip information file are incorporated in the constituent elements when the playback program is executed. Therefore, the playlist file and the clip information file play a role in the playback program beyond simple data presentation.
- the playback device includes middleware, a system LSI, and other hardware.
- the playback apparatus further includes an interface to the middleware, an interface between the middleware and the system LSI, an interface between the middleware and other hardware, and a user interface. These elements cooperate with each other when incorporated in the playback device. Thereby, a function unique to each element is provided to the playback device.
- the interface to the middleware and the interface between the middleware and the system LSI By appropriately defining the interface to the middleware and the interface between the middleware and the system LSI, the development of the user interface, the middleware, and the system LSI in the playback device can be performed independently, in parallel, and efficiently. Can proceed well. It should be noted that for any interface, such appropriate definitions are generally diverse.
- the present invention relates to a stereoscopic video reproduction technique, and as described above, the image data area is changed after the application program is forcibly terminated.
- the present invention is clearly industrially applicable.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
- Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
1901 状態1/2でのIGプレーン・メモリ領域
1902 状態1/2でのPGプレーン・メモリ領域
1903 状態1/2でのBGプレーン・メモリ領域
1904 状態1/2でのイメージ・データ領域
1905 状態1/2でのBD-Live用キャッシュ領域
1911 状態3/4でのIGプレーン・メモリ領域
1912 状態3/4でのPGプレーン・メモリ領域
1913 状態3/4でのBGプレーン・メモリ領域
1914 状態3/4でのイメージ・データ領域
Claims (9)
- 記録媒体から、アプリケーション・プログラム、イメージ・データ、ビデオ・ストリーム、及びアプリケーション管理ファイルを読み出す読み出し部、
前記アプリケーション・プログラムを実行する仮想マシン部、
前記イメージ・データを格納するためのイメージ・データ領域を含むメモリ部、
前記アプリケーション・プログラムに従って前記イメージ・データと前記ビデオ・ストリームとから映像データを再生する再生部、並びに、
前記アプリケーション管理ファイルに従って、前記仮想マシン部に対しては前記アプリケーション・プログラムの起動と終了とを指示し、前記メモリ部に対しては前記イメージ・データ領域の変更を指示する機能部であって、前記メモリ部に対して前記イメージ・データ領域の変更を指示するとき、その前に前記仮想マシン部に前記アプリケーション・プログラムを、前記アプリケーション管理ファイル上ではその実行の継続が規定されていても強制的に終了させる管理部、
を備えた再生装置。 - 前記イメージ・データ領域に前記イメージ・データを展開するイメージ・デコーダ、及び、
前記イメージ・データに対するグラフィックス処理に関する演算を行うレンダリング・エンジン、
を更に備え、
前記管理部は前記アプリケーション・プログラムに従って、前記イメージ・デコーダには前記イメージ・データの展開を指示し、前記レンダリング・エンジンには前記演算を指示する、
請求項1に記載の再生装置。 - 前記記録媒体が前記読み出し部から取り出された後も前記仮想マシン部が前記アプリケーション・プログラムを継続して実行しているとき、前記読み出し部が新たな記録媒体の挿入を検出した場合、前記管理部は前記読み出し部に前記新たな記録媒体から新たなアプリケーション管理ファイルを読み出させ、前記新たなアプリケーション管理ファイルに従って前記イメージ・データ領域の変更を指示する、
請求項1に記載の再生装置。 - 外部ネットワーク上のサーバ装置からブラウザ画面のデータをダウンロードするネットワーク・インタフェース部、
を更に備え、
前記再生部は、前記記録媒体から再生される映像にブラウザ画面を組み合わせるライブ再生モードを備え、
前記イメージ・データ領域の変更は、現時点とその直前とのブラウザ画面のデータを一時記憶するためのキャッシュ領域を前記イメージ・データ領域の中に確保すること、又は前記イメージ・データ領域から開放することを含む、
請求項1に記載の再生装置。 - 前記イメージ・データが3Dメニューのレフトビュー・イメージ・データとライトビュー・イメージ・データとを含むとき、前記イメージ・データ領域の変更は、前記キャッシュ領域を前記イメージ・データ領域から開放すること、及び、それによって生じた空き領域を前記レフトビュー・イメージ・データと前記ライトビュー・イメージ・データとの格納に利用することを含む、請求項4に記載の再生装置。
- 前記管理部は前記アプリケーション・プログラムに従って、
前記3Dメニューを再生すべきか否かの指示をユーザから受け付け、
前記3Dメニューの再生が指示されたとき、前記仮想マシン部に前記メモリ部の容量を確認させ、
前記メモリ部の容量が所定の閾値よりも大きいときは、前記メモリ部に対して、前記キャッシュ領域の開放、及び、前記レフトビュー・イメージ・データと前記ライトビュー・イメージ・データとの格納での前記空き領域の利用を指示し、
前記メモリ部の容量が前記閾値よりも小さいときは、前記3Dメニューの再生を禁止する、
請求項5に記載の再生装置。 - 読み出し部が記録媒体から、アプリケーション・プログラム、イメージ・データ、ビデオ・ストリーム、及びアプリケーション管理ファイルを読み出すステップ、
メモリ部が前記イメージ・データをイメージ・データ領域に格納するステップ、
管理部が前記アプリケーション管理ファイルに従って、仮想マシン部に前記アプリケーション・プログラムを実行させるステップ、
再生部が前記アプリケーション・プログラムに従って前記イメージ・データと前記ビデオ・ストリームとから映像データを再生するステップ、
前記管理部が前記アプリケーション・プログラムを、前記アプリケーション管理ファイル上ではその実行の継続が規定されていても強制的に終了させるステップ、並びに、
前記アプリケーション・プログラムが終了した後、前記管理部が前記メモリ部に前記イメージ・データ領域を変更させるステップ、
を含む再生方法。 - 読み出し部が記録媒体から、アプリケーション・プログラム、イメージ・データ、ビデオ・ストリーム、及びアプリケーション管理ファイルを読み出すステップ、
メモリ部が前記イメージ・データをイメージ・データ領域に格納するステップ、
管理部が前記アプリケーション管理ファイルに従って、仮想マシン部に前記アプリケーション・プログラムを実行させるステップ、
再生部が前記アプリケーション・プログラムに従って前記イメージ・データと前記ビデオ・ストリームとから映像データを再生するステップ、
前記管理部が前記アプリケーション・プログラムを、前記アプリケーション管理ファイル上ではその実行の継続が規定されていても強制的に終了させるステップ、並びに、
前記アプリケーション・プログラムが終了した後、前記管理部が前記メモリ部に前記イメージ・データ領域を変更させるステップ、
を再生装置に実行させるプログラム。 - 記録媒体からイメージ・データとビデオ・ストリームとを読み出す読み出し部、及び、
前記イメージ・データと前記ビデオ・ストリームとから映像データを再生する再生部、
を備えた再生装置に実装される集積回路であって、
前記読み出し部によって前記記録媒体から読み出されたアプリケーション・プログラムを実行する仮想マシン部、
前記イメージ・データを格納するためのイメージ・データ領域を含むメモリ部、及び、
前記読み出し部によって前記記録媒体から読み出されたアプリケーション管理ファイルを参照し、前記アプリケーション管理ファイルに従って、前記仮想マシン部に対しては前記アプリケーション・プログラムの起動と終了とを指示し、前記メモリ部に対しては前記イメージ・データ領域の変更を指示する機能部であって、前記メモリ部に対して前記イメージ・データ領域の変更を指示するとき、その前に前記仮想マシン部に前記アプリケーション・プログラムを、前記アプリケーション管理ファイル上ではその実行の継続が規定されていても強制的に終了させる管理部、
を備えた集積回路。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010536659A JP5368470B2 (ja) | 2008-11-06 | 2009-10-28 | 再生装置、再生方法、再生プログラム、及び集積回路 |
CN2009801072184A CN101960862A (zh) | 2008-11-06 | 2009-10-28 | 再现装置、再现方法、再现程序及集成电路 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11184008P | 2008-11-06 | 2008-11-06 | |
US61/111,840 | 2008-11-06 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010052857A1 true WO2010052857A1 (ja) | 2010-05-14 |
Family
ID=42152670
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2009/005713 WO2010052857A1 (ja) | 2008-11-06 | 2009-10-28 | 再生装置、再生方法、再生プログラム、及び集積回路 |
Country Status (4)
Country | Link |
---|---|
US (1) | US8165458B2 (ja) |
JP (1) | JP5368470B2 (ja) |
CN (1) | CN101960862A (ja) |
WO (1) | WO2010052857A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011239406A (ja) * | 2009-05-25 | 2011-11-24 | Panasonic Corp | 記録媒体、再生装置、再生方法、プログラム |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2380105A1 (en) * | 2002-04-09 | 2003-10-09 | Nicholas Routhier | Process and system for encoding and playback of stereoscopic video sequences |
BRPI0922046A2 (pt) * | 2008-11-18 | 2019-09-24 | Panasonic Corp | dispositivo de reprodução, método de reprodução e programa para reprodução estereoscópica |
KR20110095128A (ko) * | 2008-11-18 | 2011-08-24 | 파나소닉 주식회사 | 특수재생을 고려한 재생장치, 집적회로, 재생방법 |
US8335425B2 (en) * | 2008-11-18 | 2012-12-18 | Panasonic Corporation | Playback apparatus, playback method, and program for performing stereoscopic playback |
JP4984181B2 (ja) * | 2009-06-22 | 2012-07-25 | ソニー株式会社 | 再生装置および再生方法 |
GB0921831D0 (en) | 2009-12-14 | 2010-01-27 | British Telecomm | Graphical data delivery |
KR101570960B1 (ko) * | 2009-12-21 | 2015-11-27 | 삼성전자 주식회사 | 디스플레이장치 |
GB201000738D0 (en) * | 2010-01-18 | 2010-03-03 | British Telecomm | Graphical data processing |
JP5505637B2 (ja) * | 2010-06-24 | 2014-05-28 | ソニー株式会社 | 立体表示装置および立体表示装置の表示方法 |
EP2590171A4 (en) * | 2010-07-01 | 2017-05-10 | Panasonic Intellectual Property Management Co., Ltd. | Reproducing device, recording medium, reproducing method, and program |
WO2012011525A1 (ja) * | 2010-07-21 | 2012-01-26 | 株式会社プランネット・アソシエイツ | 三次元ビデオストリームへの映像変換方法 |
EP2498494A1 (en) * | 2011-03-11 | 2012-09-12 | Thomson Licensing | Decoder and method at the decoder for synchronizing the rendering of contents received through different networks |
AU2015204359B2 (en) * | 2011-03-11 | 2017-01-19 | Interdigital Madison Patent Holdings | Decoder and method at the decoder for synchronizing the rendering of contents received through different networks |
WO2012127627A1 (ja) * | 2011-03-22 | 2012-09-27 | 富士通株式会社 | 情報装置、画面切替え方法、及び画面切替えプログラム |
TWI450538B (zh) * | 2011-03-22 | 2014-08-21 | 多媒體串流資料解密系統與方法 | |
EP2506263A1 (en) * | 2011-03-31 | 2012-10-03 | Thomson Licensing | Stereoscopic scene graph for defining 3D- and 2D-compatible graphical objects |
JP4996762B1 (ja) | 2011-08-31 | 2012-08-08 | 株式会社東芝 | 電子機器およびコンテンツ転送方法 |
CN102725736B (zh) * | 2011-12-31 | 2014-03-12 | 华为技术有限公司 | 基于虚拟化技术的图形显示方法及系统 |
US9189067B2 (en) | 2013-01-12 | 2015-11-17 | Neal Joseph Edelstein | Media distribution system |
US8520018B1 (en) * | 2013-01-12 | 2013-08-27 | Hooked Digital Media | Media distribution system |
CN103561062B (zh) * | 2013-10-18 | 2017-04-05 | 北京奇虎科技有限公司 | 应用执行方法、设备和系统 |
US20160307603A1 (en) * | 2015-04-15 | 2016-10-20 | Sony Corporation | Information processing device, information recording medium, information processing method, and program |
WO2020166236A1 (ja) * | 2019-02-13 | 2020-08-20 | パナソニックIpマネジメント株式会社 | 作業効率評価方法、作業効率評価装置、及びプログラム |
CN118098294B (zh) * | 2024-02-28 | 2024-09-24 | 北京中科艺杺科技有限公司 | 一种外接式同录主机触发及显示设备 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2005036555A1 (ja) * | 2003-10-10 | 2005-04-21 | Matsushita Electric Industrial Co., Ltd. | 記録媒体、再生装置、プログラム、再生方法 |
WO2009157159A1 (ja) * | 2008-06-24 | 2009-12-30 | パナソニック株式会社 | 記録媒体、再生装置、集積回路、再生方法、プログラム |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2418089A1 (en) * | 2000-08-04 | 2002-02-14 | Dynamic Digital Depth Research Pty Ltd. | Image conversion and encoding technique |
CN101404173B (zh) * | 2003-10-10 | 2012-05-23 | 松下电器产业株式会社 | 再现装置、记录方法、以及再现方法 |
KR20050049924A (ko) * | 2003-11-24 | 2005-05-27 | 엘지전자 주식회사 | 고밀도 광디스크의 플레이리스트 구성방법, 관리방법 및재생방법과 기록재생장치 |
TW200602945A (en) * | 2004-05-11 | 2006-01-16 | Matsushita Electric Ind Co Ltd | Reproducer, program, and reproducing method |
EP1699048A4 (en) * | 2004-06-03 | 2009-01-28 | Panasonic Corp | PLAYBACK DEVICE AND PROGRAM |
BRPI0517651A (pt) * | 2004-11-08 | 2008-10-14 | Lg Electronics Inc | método e aparelho para reproduzir dados de meio de gravação, método para atualizar dados de armazenagem local, método para formar pacote virtual |
US20080036854A1 (en) * | 2006-08-08 | 2008-02-14 | Texas Instruments Incorporated | Method and system of communicating and rendering stereoscopic and dual-view images |
-
2009
- 2009-10-28 JP JP2010536659A patent/JP5368470B2/ja not_active Expired - Fee Related
- 2009-10-28 WO PCT/JP2009/005713 patent/WO2010052857A1/ja active Application Filing
- 2009-10-28 CN CN2009801072184A patent/CN101960862A/zh active Pending
- 2009-10-29 US US12/608,574 patent/US8165458B2/en not_active Expired - Fee Related
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2005036555A1 (ja) * | 2003-10-10 | 2005-04-21 | Matsushita Electric Industrial Co., Ltd. | 記録媒体、再生装置、プログラム、再生方法 |
WO2009157159A1 (ja) * | 2008-06-24 | 2009-12-30 | パナソニック株式会社 | 記録媒体、再生装置、集積回路、再生方法、プログラム |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011239406A (ja) * | 2009-05-25 | 2011-11-24 | Panasonic Corp | 記録媒体、再生装置、再生方法、プログラム |
Also Published As
Publication number | Publication date |
---|---|
JP5368470B2 (ja) | 2013-12-18 |
JPWO2010052857A1 (ja) | 2012-04-05 |
US20100150529A1 (en) | 2010-06-17 |
US8165458B2 (en) | 2012-04-24 |
CN101960862A (zh) | 2011-01-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5368470B2 (ja) | 再生装置、再生方法、再生プログラム、及び集積回路 | |
JP5351353B1 (ja) | 記録媒体、再生装置、及び集積回路 | |
JP5491437B2 (ja) | 3d映像を再生するための再生装置 | |
JP5291026B2 (ja) | 3d映像を再生する再生装置、および配信装置 | |
JP5457299B2 (ja) | 記録媒体、再生装置、及び集積回路 | |
JP5497679B2 (ja) | 半導体集積回路 | |
WO2010038409A1 (ja) | 再生装置、記録媒体、及び集積回路 | |
JP5491414B2 (ja) | 記録媒体、再生装置、及び集積回路 | |
US20120062711A1 (en) | Recording medium, playback device, system lsi, playback method, glasses, and display device for 3d images | |
WO2010143439A1 (ja) | 再生装置、集積回路、記録媒体 | |
WO2010113454A1 (ja) | 記録媒体、再生装置、及び集積回路 | |
WO2010076846A1 (ja) | 記録媒体、再生装置、及び集積回路 | |
KR20110126518A (ko) | 기록매체, 재생장치 및 집적회로 | |
WO2010032403A1 (ja) | 映像コンテンツを立体視再生する再生装置、再生方法、および再生プログラム | |
US20110235988A1 (en) | Recording medium, reproduction device, integrated circuit, reproduction method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200980107218.4 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09824558 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010536659 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 3094/KOLNP/2010 Country of ref document: IN |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09824558 Country of ref document: EP Kind code of ref document: A1 |