JP2011028791A - Reproducing device, reproducing method, program, and recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a format of a video for 3D display suitable for the 3D display of a sub-image. <P>SOLUTION: A subtitle generation section 41 outputs to a 3D display data generation part 36 the subtitle data on the presently displayed subtitle for the left eye as the subtitle data for the right eye, and outputs to the 3D display data generation part 36 the subtitle data on the presently displayed subtitle for the right eye as the subtitle data for the left eye, based on an LR replacement command which is control information for replacing subtitle data for the left eye and subtitle data for the right eye, which are to be used to 3D-display subtitles. The 3D display data generation part 36 causes a display part 51 to display the subtitle for the right eye based on the subtitle data for the right eye and causes the display part 51 to display the subtitle for the left eye based on the subtitle data for the left eye. This invention can be applied to e.g. a reproducing device which reproduces a disk for 3D display. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a playback device, a playback method, a program, and a recording medium, and in particular, a playback device, a playback method, and a playback method capable of providing a 3D display video format suitable for 3D display of a sub-image. And a program and a recording medium.

  There are various types of displays (hereinafter referred to as 3D displays) having a 3D (3 Dimensional) image display function. There are various types of video formats for 3D display (hereinafter referred to as 3D video formats).

  As a 3D video format, a method using three or more viewpoint images (multi-views), specifically, a 3D video format using a two-dimensional image and a depth image suitable for a so-called lenticular 3D display, for example. (For example, refer nonpatent literature 1).

PHILIPS Inc. HP> Home> 3D Solutions> About "Search March 26, 2009" "http://www.business-sites.philips.com/3dsolutions/about/Index.html"

  However, there is currently no 3D video format suitable for 3D display of sub-images such as subtitles and menu buttons used on the menu screen.

  The present invention has been made in view of such a situation, and is intended to provide a 3D video format suitable for 3D display of a sub-image.

  The playback device according to the first aspect of the present invention provides L image data that is image data of an L image for left eye and R image data that is image data of an R image for right eye used for 3D (3 Dimensional) display of a sub-image. When reproducing data having a data structure including LR exchange control information, which is control information for exchanging images, the L image data of the displayed L image is used as the R image data according to the LR exchange control information. An output unit that outputs the R image data of the R image being displayed as the L image data, and causes the display unit to display the R image based on the R image data output by the output unit. And a display control means for displaying the L image on the display unit based on the L image data.

  The playback method and program according to the first aspect of the present invention correspond to the playback apparatus according to the first aspect of the present invention described above.

  In the playback apparatus, playback method, and program according to the first aspect of the present invention, L image data that is image data of an L image for the left eye used for 3D (3 Dimensional) display of a sub-image and an R image for the right eye are used. When reproducing data having a data structure including LR exchange control information that is control information for exchanging R image data that is image data, the L image data of the displayed L image is R according to the LR exchange control information. In addition to being output as image data, the R image data of the currently displayed R image is output as L image data, the R image is displayed on the display unit based on the output R image data, and the L image data is displayed based on the L image data. An image is displayed on the display unit.

  The recording medium according to the first aspect of the present invention includes L image data that is image data of an L image for left eye and R image data that is image data of an R image for right eye used for 3D (3 Dimensional) display of a sub-image. Is a recording medium on which data having a data structure including LR exchange control information, which is control information for exchanging the data, is recorded.

  In the data structure of data recorded on the recording medium according to the first aspect of the present invention, L image data that is image data of an L image for the left eye used for 3D (3 Dimensional) display of a sub-image, and data for the right eye LR exchange control information that is control information for exchanging R image data that is image data of an R image is included.

  The playback device according to the second aspect of the present invention provides a shift direction between the left-eye L image and the right-eye R image used for 3D (3 Dimensional) display of the sub-image with respect to the sub-image for 2D (2 Dimensional) display. When reproducing data having a data structure including offset change control information for changing the offset direction to be represented, according to the offset change control information, the L image being displayed is shifted in a direction opposite to the shift direction with respect to the sub-image. The image data of the image obtained as a result of shifting the sub-image is set as L image data that is the image data of the L image, the L image is displayed on the display unit based on the L image data, and the R image being displayed The image data of the image obtained as a result of shifting the sub-image in the direction opposite to the shift direction of the sub-image with respect to the sub-image, And a display control means for displaying the R image on the display unit based on the R image data.

  The reproduction method and program according to the second aspect of the present invention correspond to the reproduction apparatus according to the second aspect of the present invention described above.

  In the playback apparatus, playback method, and program according to the second aspect of the present invention, the left-eye L image and right-eye image used for 3D (3 Dimensional) display of the sub-image with respect to the sub-image for 2D (2 Dimensional) display When reproducing data having a data structure including offset change control information for changing the offset direction indicating the shift direction of the R image, the opposite direction to the shift direction of the currently displayed L image with respect to the sub-image is determined according to the offset change control information. The image data of the image obtained as a result of shifting the sub-image in the direction is L image data that is the image data of the L image. The L image is displayed on the display unit based on the L image data, and the R being displayed is displayed. R image data in which image data of an image obtained as a result of shifting the sub-image in the direction opposite to the shift direction of the image with respect to the sub-image is R-image data. The R image is displayed on the display unit based on the R image data.

  The recording medium according to the second aspect of the present invention provides a shift direction between the left-eye L image and the right-eye R image used for 3D (3 Dimensional) display of the sub-image with respect to the sub-image for 2D (2 Dimensional) display. It is a recording medium on which data having a data structure including offset change control information for changing the offset direction to be expressed is recorded.

  In the data structure of data recorded on the recording medium according to the second aspect of the present invention, the shift direction of the left-eye L image and the right-eye R image used for 3D display of the sub-image with respect to the sub-image is represented. Offset change control information for changing the offset direction is included.

  According to the present invention, 3D display of a sub-image can be performed. In addition, a 3D video format suitable for 3D display of sub-images can be provided.

It is a figure which shows the structural example of 1st Embodiment of the disk to which this invention is applied. It is a figure which shows the detailed structural example of an index file. It is a figure which shows the structural example of the display set of caption data. It is a figure which shows the structural example of the display set of menu data. FIG. 2 is a block diagram illustrating a configuration example of a playback device that plays back the disc of FIG. 1. FIG. 6 is a block diagram illustrating a detailed configuration example of a caption generation unit in FIG. 5. It is a figure explaining the production | generation of 3D subtitle data. It is a figure which shows the example of 3D display of a caption. It is a flowchart explaining the 3D subtitle reproduction | regeneration processing by the reproducing | regenerating apparatus at the time of movie object execution. It is a flowchart explaining the caption offset flag change process by the reproducing | regenerating apparatus at the time of movie object execution. It is a figure which shows the other example of 3D display of a caption. It is a figure which shows the other example of application of an offset flag change command. It is a figure which shows the example of a display of a direction change button. It is a figure which shows the functional structural example of the reproducing | regenerating apparatus at the time of BD-J object execution. 10 is a flowchart for describing graphics display processing by the playback device when executing a BD-J object. It is a flowchart explaining the offset direction change process by the reproducing | regenerating apparatus at the time of BD-J object execution. It is a figure which shows the structural example of the epoch of the caption data in 2nd Embodiment of the disk to which this invention is applied. FIG. 18 is a block diagram illustrating a configuration example of a playback device that plays back the disc of FIG. 17. FIG. 19 is a block diagram illustrating a detailed configuration example of a caption generation unit in FIG. 18. It is a figure explaining the display of the 3D subtitle by the display part 51 of FIG. It is a figure explaining the change of 3D display of a subtitle by LR exchange command. It is a flowchart explaining the 3D subtitle reproduction processing by the reproduction device when executing a movie object. It is a flowchart explaining the detail of the caption production | generation process of FIG.22 S116. It is a flowchart explaining the subtitle display direction change process by the reproducing | regenerating apparatus at the time of execution of a movie object. It is a figure which shows the other example of application of LR exchange command. It is a figure which shows the functional structural example of the reproducing | regenerating apparatus at the time of BD-J object execution. It is a block diagram which shows the detailed structural example of a BD-J graphics production | generation part. 10 is a flowchart for describing graphics display processing by the playback device when executing a BD-J object. 14 is a flowchart for describing display direction change processing by a playback device when executing a BD-J object.

<First embodiment>
[Configuration Example of Disc First Embodiment]
FIG. 1 is a diagram showing a configuration example of a first embodiment of a disk to which the present invention is applied.

  The disc 11 in FIG. 1 is configured by a BD-ROM (Blue-ray Disc-Read Only Memory) or the like, and an index file (index.bdmv) and a movie object file (MovieObject.bdmv) are recorded on the disc 11. . In addition, a playlist file (PLAYLIST / XXXXX.mpls), a clip information file (CLIPINF / XXXXX.clpi), and a stream file (STREAM / XXXXX.m2ts) are also recorded on the disc 11. Further, a BD-J (Blu-ray Disc Java (registered trademark)) object file (BDJO / XXXXX.bdjo), a related file (JAR / XXXXX.jar), and the like are also recorded on the disc 11. X is an arbitrary number from 0 to 9.

  As shown in FIG. 2, the index file describes, for example, a list of title numbers recorded on the disk 11 and the types and numbers of objects executed corresponding to the title numbers.

  The title number is not only an integer value given in order from 1, but also “First Play” corresponding to an object executed when the disc 11 is inserted into the playback device, and executed when the top menu screen is displayed. A “Top Menu” corresponding to the object is also described. There are two types of objects: a movie object (MovieObject) and a BD-J object (BD-J Object).

  In the example of FIG. 2, “MovieObject # 1”, “MovieObject # 2”, and “MovieObject # M” correspond to “First Play”, “Top menu”, and “Title # N”, respectively, in the index file. is described. Also, “BD-J Object # 1” is described corresponding to “Title # 1”.

  MovieObject # i and BD-J Object # i indicate that the object type is a movie object and a BD-J object, respectively, and the object number is i. Title # i indicates that the title number is i. Such an index file is also called an index table.

  A plurality of movie objects are described in the movie object file, and a program called HDMV (High Definition Movie) navigation command is described in the movie object. A playback device that plays back the disk 11 sequentially executes the navigation commands. In the following, navigation commands are referred to as commands unless it is necessary to distinguish them.

  A playlist file is a file that is played back only by a movie object or a BD-J object, and describes information about an AV stream (details will be described later) played back by one command described in these objects.

  Specifically, the playlist file is composed of a plurality of play items. Each play item describes information specifying a clip information file corresponding to an AV stream to be played back and time information indicating a playback section of the AV stream.

  The AV stream is recorded on the disk 11 as a stream file. The AV stream is a video for 2D display of a main image such as a movie encoded according to MPEG2, MPEG-4 AVC (Advanced Video Coding), VC1, etc., and multiplexed according to ISO13818-2. Data, corresponding audio data, subtitle data for displaying 2D subtitles, and menu data TS (Transport Stream) packets for displaying 2D menu buttons.

  The PES packet of the AV stream is composed of a PES packet header and a segment. In the PES packet header, PTS (Presentation Time Stamp) indicating the display time, DTS (Decoding Time Stamp), and the like are described.

  Segments included in the PES packet of caption data include PCS (Presentation Composition Segment), WDS (Window Definition Segment), PDS (Palette Definition Segment), ODS (Object Definition Segment), or END (End of Display Set Segment). is there. The segment included in the PES packet of the menu data includes ICS (Interactive Composition Segment), PDS, ODS, or END. A segment of subtitle data or menu data for one screen is called a display set. Details of the display set will be described with reference to FIGS. 3 and 4 to be described later.

  The clip information file describes a map that associates the time information described in the playlist file with the packet number of the AV stream. Therefore, the playback device can recognize the packet number of the AV stream to be played back corresponding to each play item by referring to the clip information file.

  The stream file is an AV stream file. In the BD-J object file, a plurality of BD-J applications are described. A playback device that plays the disc 11 activates the BD-J application.

[Configuration example of display set]
FIG. 3 is a diagram illustrating a configuration example of a display set of subtitle data recorded on the disc 11, and FIG. 4 is a diagram illustrating a configuration example of a display set of menu data.

  As shown in FIG. 3, the display set of subtitle data is composed of PCS, WDS, PDS, ODS, and END, which are subtitle segments for one screen.

  In the PCS of the caption data, an ID (hereinafter referred to as a sub-image ID) assigned to the caption corresponding to each ODS, offset information (details will be described later) for displaying the caption in 3D, and the like are described. In the WDS of caption data, information indicating a structure such as a window position and size indicating a caption display range, an ID unique to the window (hereinafter referred to as a window ID), and the like are described. The PDS of caption data describes information on colors that can be used as caption colors. In the ODS of the caption data, information indicating the shape of the caption is described. END of caption data is a segment indicating the end of the display set.

  As shown in FIG. 4, the display set of menu data is composed of ICS, PDS, ODS, and END, which are menu button segments for one screen.

  Menu control information such as a command executed by operating a menu button is described in the menu data ICS. Further, the ICS describes button information such as offset information for displaying the menu button in 3D and an ID (hereinafter referred to as a button ID) unique to the menu button corresponding to each ODS.

  Information on colors that can be used as menu button colors is described in the PDS of the menu data. In the example shown in FIG. 4, since there are two types of color information that can be used as menu button colors for one screen, two types of PDS (PDS # 1, PDS # 2) are arranged in the display set. Yes.

  Information indicating the shape of the menu button is described in the ODS of the menu data. The menu button END is a segment indicating the end of the display set.

  In this embodiment, offset information is described in PCS and ICS, but the description location of offset information is not limited to this. For example, the offset information may be described in a playlist file.

  An epoch is composed of an arbitrary number of display sets as described above. The playback device continuously displays subtitles and menu buttons corresponding to one epoch, and after temporarily interrupting the display, displays the subtitles and menu buttons corresponding to the next epoch. That is, an epoch is a unit of a display set of subtitles and menu buttons that can be displayed continuously.

  The offset information will be described below.

  In order to show a 3D image to a user, it is necessary to show one image of two images separated by a predetermined distance in a predetermined direction and to display the other image to the right eye.

  However, the video data, caption data, and menu data recorded on the disc 11 are data for 2D display, and the playback device cannot display both left-eye and right-eye images. Therefore, in order to enable 3D display of the image, the direction information indicating the combination of the shift direction of the left-eye image and the right-eye image with respect to the image for 2D display and the offset value (offset_value) indicating the shift amount are used as the offset information. Described.

  The left-eye offset direction and the right-eye offset direction are opposite directions. The offset value is expressed by the number of pixels, for example.

  Further, it is assumed that the direction information of the offset information included in the PCS or ICS set when the movie object is executed is represented as an offset flag separately from the offset value. For example, the offset flag is 0 when representing a combination of offset directions corresponding to a 3D image in a direction protruding from the display surface, and 1 when representing a combination of offset directions corresponding to a 3D image retracted with respect to the display surface. It becomes.

  On the other hand, it is assumed that the direction information of the offset information set when executing the BD-J object is represented by the positive / negative of the offset value. For example, a positive offset value represents a combination of offset directions corresponding to a 3D image in a direction protruding from the display surface, and a negative offset value is an offset direction corresponding to a 3D image retracted from the display surface. Represents a combination.

[Example of playback device configuration]
FIG. 5 is a block diagram illustrating a configuration example of the playback device 20 that plays back the disk 11 described above.

  5 includes an input unit 21, a control unit 22, a playback unit 23, a storage unit 24, a communication unit 25, and a drive 26.

  The input unit 21 includes a keyboard, a mouse, a microphone, and the like. The input unit 21 receives a command from the user and supplies it to the control unit 22. The control unit 22 controls the playback unit 23 according to a command from the input unit 21 by executing a predetermined program.

  The playback unit 23 includes a drive 31, a read buffer 32, a PID filter 33, a video generation unit 34, a caption / menu generation unit 35, a 3D display data generation unit 36, a BD-J graphics generation unit 37, and an audio generation unit 38. Composed.

  The drive 31 drives the loaded disk 11 according to the control of the control unit 22. As a result, the drive 31 reads the index file, movie object file, BD-J object file, playlist file, clip information file, stream file, and the like recorded on the disc 11. The drive 31 supplies the read index file, movie object file, BD-J object file, playlist file, clip information file, and the like to the control unit 22. The drive 31 supplies the read stream file AV stream to the read buffer 32.

  The read buffer 32 holds the AV stream supplied from the drive 31 or reads the held AV stream and supplies it to the PID filter 33 under the control of the control unit 22.

  The PID filter 33 extracts video data, subtitle data, menu data, and audio data packets from the AV stream based on the packet ID (PID) of each packet of the AV stream from the read buffer 32. The PID is a unique ID for each type of data constituting the packet, and is added to the packet.

  The PID filter 33 extracts PES packets from the extracted video data, caption data, menu data, and audio data packets, respectively. Then, the PID filter 33 supplies the PES packet of the video data to the video generation unit 34 and supplies the PES packet of the caption data and the menu data to the caption / menu generation unit 35. Further, the PID filter 33 supplies the PES packet of the audio data to the audio generation unit 38.

  The video generation unit 34 decodes the PES packet of the video data supplied from the PID filter 33 and supplies the resulting video data to the 3D display data generation unit 36. In addition, the video generation unit 34 supplies predetermined offset information to the 3D display data generation unit 36.

  The caption / menu generation unit 35 includes a caption generation unit 41 and a menu generation unit 42. The caption generation unit 41 decodes the PES packet of the caption data supplied from the PID filter 33 when the movie object is executed, and the 3D display data generation unit displays the caption data obtained as a result and the offset information included in the PCS of the PES packet. 36. Details of the caption generation unit 41 will be described with reference to FIG.

  The menu generation unit 42 decodes the PES packet of the menu data supplied from the PID filter 33 when the movie object is executed, and obtains the menu data obtained as a result and the offset information included in the ICS of the PES packet as a 3D display data generation unit. 36.

  Based on the video data and offset information supplied from the video generation unit 34, the 3D display data generation unit 36 converts the left-eye video data and the right-eye video data as 3D video data for displaying the main image in 3D. Generate.

  Specifically, the 3D display data generation unit 36 converts video data of an image obtained by shifting the main image corresponding to the video data supplied from the video generation unit 34 by a predetermined offset value in a predetermined offset direction. Video data and video data for the left eye.

  Based on the caption data and offset information supplied from the caption / menu generation unit 35, the 3D display data generation unit 36 converts the caption data for the left eye and the caption data for the right eye, and the caption into 3D, in the same manner as the 3D video data. Generated as 3D subtitle data for display. Further, the 3D display data generation unit 36 converts the menu data for the left eye and the menu data for the right eye into the menu based on the menu data and the offset information supplied from the caption / menu generation unit 35, as in the 3D video data. The button is generated as 3D menu data for 3D display.

  In addition, the 3D display data generation unit 36 synthesizes 3D video data, 3D caption data, and 3D menu data for each of the left and right eye data. Specifically, the 3D display data generation unit 36 generates left-eye display data by combining the left-eye video data, the left-eye caption data, and the left-eye menu data. In addition, the 3D display data generation unit 36 combines the right-eye video data, the right-eye caption data, and the right-eye menu data to generate right-eye display data.

  Further, the 3D display data generation unit 36 is supplied from the BD-J graphics generation unit 37 based on the graphics data for displaying 2D BD-J graphics such as a menu button and offset information. Similar to the data, left-eye graphics data and right-eye graphics data are generated as 3D graphics data for 3D display of BD-J graphics.

  The 3D display data generation unit 36 synthesizes 3D video data and 3D graphics data for each of the left and right eye data, uses the left eye synthesis result as display data for the left eye, and uses the synthesis result for the right eye as the right eye. Display data. Then, the 3D display data generation unit 36 supplies the display data for the left eye and the display data for the right eye to the display unit 51 as 3D display data, and causes the display unit 51 to display the image for the left eye and the image for the right eye.

  The BD-J graphics generation unit 37 generates graphics data according to control from the control unit 22 when executing the BD-J object. Then, the BD-J graphics generation unit 37 supplies the graphics data and offset information supplied from the control unit 22 to the 3D display data generation unit 36.

  The audio generation unit 38 decodes the PES packet of the audio data supplied from the PID filter 33 and supplies the audio data obtained as a result to the speaker 52.

  The display unit 51 is configured by a 3D display or the like. The display unit 51 displays an image for the left eye and an image for the right eye based on the 3D display data supplied from the 3D display data generation unit 36. As a result, the user can see the 3D image.

  The speaker 52 outputs sound corresponding to the audio data supplied from the audio generation unit 38.

  The storage unit 24 includes a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk, and the like. The storage unit 24 stores a program executed by the control unit 22, information generated by processing by the control unit 22, and the like. The communication unit 25 is configured with a network card or the like.

  The program executed by the control unit 22 can be stored in the ROM of the storage unit 24, or is recorded on the hard disk of the storage unit 24 or the removable medium 53 attached to the drive 26, and the storage unit It can also be executed by being loaded into 24 RAMs.

  Examples of the removable medium 53 include a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, and a semiconductor memory.

  The program executed by the control unit 22 is downloaded from the removable medium 53 as described above to the playback device 20, downloaded to the playback device 20 via a communication network or a broadcast network, and stored in the hard disk of the storage unit 24. Can be installed. That is, for example, the program is wirelessly transferred from the download site to the playback device 20 via a digital satellite broadcasting artificial satellite, or wired to the playback device 20 via a network such as a LAN (Local Area Network) or the Internet. Can be transferred.

[Detailed configuration example of subtitle generator]
FIG. 6 is a block diagram illustrating a detailed configuration example of the caption generation unit 41 in FIG. 5.

  6 includes an encoded data buffer 61, a stream graphics generation unit 62, an object buffer 63, a graphics plane 64, a CLUT (Color Look Up Table) 65, a composition buffer 66, and a control unit 67. Composed.

  The encoded data buffer 61 holds a segment of the PES packet of caption data supplied from the PID filter 33 in FIG. The encoded data buffer 61 supplies the PCS, WDS, and ODS to the stream graphics generation unit 62 based on the DTS included in the PES packet header of the PES packet of the caption data. The encoded data buffer 61 immediately supplies the PDS of the caption data supplied from the PID filter 33 to the stream graphics generation unit 62.

  The stream graphics generation unit 62 decodes the ODS supplied from the encoded data buffer 61, and supplies uncompressed caption data (run-length data) composed of index colors obtained as a result to the object buffer 63 as a caption object. To do. Further, the stream graphics generation unit 62 supplies the PDS, PCS, and WDS supplied from the encoded data buffer 61 to the composition buffer 66.

  The object buffer 63 holds the caption object supplied from the stream graphics generation unit 62.

  The graphics plane 64 holds a caption object for one screen supplied from the object buffer 63. In response to an instruction from the control unit 67, the graphics plane 64 reads out the retained caption object and supplies it to the CLUT 65.

  The CLUT 65 stores a table in which index colors are associated with Y, Cr, and Cb values based on the PDS supplied from the control unit 67. The CLUT 65 converts the index color of the caption object supplied from the graphics plane 64 into image data composed of Y, Cr, and Cb values based on the stored table. Then, the CLUT 65 outputs the image data of the caption object as caption data to the 3D display data generation unit 36 (FIG. 5).

  The composition buffer 66 holds PDS, PCS, and WDS supplied from the stream graphics generation unit 62.

  The control unit 67 reads the offset information included in the PCS from the composition buffer 66 and sets it as offset information used for generating 3D subtitle data. Moreover, the control part 67 controls each part according to control from the control part 22 (FIG. 5). For example, the control unit 67 is currently set by control according to a navigation command (hereinafter referred to as an offset flag change command) for changing the offset flag described in the movie object from the control unit 22 (FIG. 5). Change the offset flag of the offset information.

  Further, the control unit 67 supplies the currently set offset information to the 3D display data generation unit 36. The control unit 67 instructs the graphics plane 64 to transfer the caption object to the CLUT 65 at a timing based on the PTS included in the PES packet header. Further, the control unit 67 reads the PDS from the composition buffer 66 and supplies it to the CLUT 65.

[Detailed configuration example of menu generator]
Since the menu generation unit 42 is configured in the same manner as the caption generation unit 41 in FIG. 6 except that the processing target is not caption data but menu data, the illustration is omitted.

  The encoded data buffer of the menu generation unit 42 holds a segment of the PES packet of menu data, and the composition buffer holds ICS and PDS. The stream graphics generation unit decodes the ODS of the menu data, and supplies the uncompressed menu data composed of the index colors to the object buffer as a menu object to be held.

  The graphics plane reads the menu object held in the object buffer 63 and holds the menu object for one screen. The CLUT converts the menu object read from the graphics plane into image data and outputs it to the 3D display data generation unit 36 as menu data.

[Description of 3D caption data generation]
FIG. 7 is a diagram for describing generation of 3D subtitle data by the 3D display data generation unit 36.

  As shown on the left side of FIG. 7, when the caption corresponding to the caption data output from the caption generation unit 41 is a star, for example, as shown in the upper right of FIG. 7, the center extending in the vertical direction of the star Star-shaped subtitle data shifted by an offset value in the right direction with respect to the line C is generated as subtitle data for the left eye. Further, as shown in the lower right of FIG. 7, the star-shaped caption data obtained by shifting the star shape corresponding to the caption data output from the caption generation unit 41 to the left of the center line C by the offset value is It is generated as caption data for use.

  Based on the left-eye caption data and right-eye caption data generated as described above, the display unit 51 displays the star shape shown in the upper right of FIG. 7 as an image of the left-eye caption. The star shape shown in the lower right is displayed as a subtitle image for the right eye. As a result, the user can view, for example, a 3D star shape protruding from the display surface as shown in FIG.

[Description of processing of playback device when executing movie object]
FIG. 9 is a flowchart for explaining 3D subtitle playback processing by the playback device 20 when a movie object is executed. This 3D subtitle reproduction process is started, for example, when the control unit 22 executes a command for reproducing a playlist described in a movie object.

  In step S <b> 11 of FIG. 9, the drive 31 reads a playlist file from the disc 11 and supplies it to the control unit 22 in response to a command from the control unit 22.

  In step S <b> 12, the drive 31 reads an AV stream corresponding to the clip information file specified in the playlist from the disk 11 in response to a command from the control unit 22 based on the playlist, and supplies the AV stream to the read buffer 32.

  In step S <b> 13, the read buffer 32 holds the AV stream supplied from the drive 31. The read buffer 32 reads the held AV stream and supplies it to the PID filter 33.

  In step S 14, the PID filter 33 extracts a PES packet of caption data from the AV stream based on the PID of each packet of the AV stream from the read buffer 32, and supplies the PES packet to the caption / menu generation unit 35.

  In step S <b> 15, the encoded data buffer 61 (FIG. 6) of the caption generation unit 41 holds a segment of the PES packet of caption data supplied from the PID filter 33.

  In step S <b> 16, the encoded data buffer 61 reads the held segment and supplies the segment to the stream graphics generation unit 62.

  In step S <b> 17, the stream graphics generation unit 62 supplies the PCS, PDS, and WDS of the segments supplied from the encoded data buffer 61 to the composition buffer 66 and holds them.

  In step S <b> 18, the control unit 67 sets the object information included in the PCS held in the composition buffer 66 as offset information used for generating the 3D subtitle data, and outputs it to the 3D display data generation unit 36.

  In step S <b> 19, the stream graphics generation unit 62 decodes the ODS among the segments supplied from the encoded data buffer 61, and supplies the caption object obtained as a result to the object buffer 63.

  In step S <b> 20, the object buffer 63 holds the caption object supplied from the stream graphics generation unit 62. The object buffer 63 supplies the stored caption object to the graphics plane 64.

  In step S <b> 21, the graphics plane 64 holds a subtitle object for one screen supplied from the object buffer 63. In step S <b> 22, the graphics plane 64 reads out the subtitle object for one screen held in response to an instruction from the control unit 67, and supplies it to the CLUT 65.

  In step S23, the CLUT 65 converts the index color of the caption object supplied from the graphics plane 64 into image data composed of Y, Cr, and Cb values based on the stored table. Then, the CLUT 65 outputs the image data as caption data to the 3D display data generation unit 36.

  In step S <b> 24, the 3D display data generation unit 36 generates 3D caption data from the caption data supplied from the CLUT 65 based on the offset information supplied from the control unit 67. This 3D subtitle data is combined with 3D video data and 3D menu data and supplied to the display unit 51 as 3D display data. As a result, 3D subtitles are displayed on the display unit 51 as one of the sub-images of the 3D main image corresponding to the 3D video data.

  The 3D menu playback process is performed in the same manner as the 3D caption playback process of FIG. 9 except that the processing target is not the caption data but the menu data, and the description thereof will be omitted.

  FIG. 10 is a flowchart for explaining subtitle offset flag change processing by the playback device 20 when a movie object is executed. This caption offset flag changing process is started, for example, when the control unit 22 executes an offset flag changing command (offset changing control information).

  In step S <b> 61 of FIG. 10, the control unit 67 determines whether or not the offset flag of the currently set offset information is 1 in response to a command from the control unit 22. If it is determined in step S61 that the currently set offset flag is 1, the control unit 67 changes the currently set offset flag to 0 in step S62. Then, the process proceeds to step S64.

  On the other hand, if it is determined in step S61 that the currently set offset flag is 0, in step S63, the control unit 67 changes the currently set offset flag to 1 in accordance with control from the control unit 22. . Then, the process proceeds to step S64.

  In step S64, the control unit 67 outputs offset information including the changed offset flag to the 3D display data generation unit 36.

  In step S <b> 65, the 3D display data generation unit 36 generates 3D caption data from the caption data supplied from the CLUT 65 based on the offset information supplied from the control unit 67.

  As a result, the position in the direction perpendicular to the display surface of the 3D caption displayed on the display unit 51 (hereinafter referred to as the depth direction) is the opposite position to the display surface. That is, the 3D subtitle displayed so as to jump out of the display surface is displayed so as to be retracted with respect to the display surface, and the 3D subtitle displayed so as to be retracted with respect to the display surface is displayed on the display surface. It is displayed to jump out.

  For example, before the subtitle offset flag changing process of FIG. 10, as shown in FIG. 8, the star shape as a 3D subtitle displayed so as to pop out from the display surface is changed after the subtitle offset direction changing process, As shown in FIG. 11, it is displayed so as to retract with respect to the display surface.

  The menu offset flag changing process is performed in the same manner as the caption offset flag changing process of FIG. 10 except that the processing target is not the caption data but the menu data, and thus the description thereof is omitted.

[Other examples of offset flag change command]
FIG. 12 is a diagram illustrating another application example of the offset flag change command.

  As shown in FIG. 12, the offset flag change command may be applied to menu control information included in the ICS of the menu data.

  In this case, as shown in FIG. 13, a direction change button 81 that is a menu button corresponding to the offset flag change command is displayed on the display unit 51. The user can cause the playback device 20 to perform the subtitle offset flag change process and the menu offset flag change process by operating the direction change button 81 using the input unit 21 while the subtitles and menu buttons are displayed.

  Specifically, the control unit 22 acquires a command corresponding to an operation on the direction change button 81 by the user from the input unit 21, supplies the command to the control unit 67, and controls execution of a command corresponding to the direction change button 81. Command to unit 67. The control unit 67 changes the offset flag included in the currently set offset information in accordance with the command.

  As described above, in the playback apparatus 20, the image data of the 2D display sub-image shifted in the direction opposite to the offset direction of the sub-image for the left eye being displayed according to the offset flag change command is the sub-image data for the left eye. Based on the left-eye sub-image data, the left-eye sub-image is displayed, and the image data of the 2D display sub-image shifted in the direction opposite to the offset direction of the currently displayed right-eye sub-image. Are sub-image data for the right eye, and the sub-image for the right eye is displayed based on the sub-image data for the right eye. Accordingly, the position of the 3D sub-image displayed on the display unit 51 with respect to the display surface in the depth direction can be reversed. Therefore, it can be said that the video format of the disk 11 including the offset flag change command is a 3D video format suitable for 3D display of the sub-image.

  Also, the playback device 20 changes the offset direction of the left-eye sub-image and the right-eye sub-image by changing the offset flag, and thus the 3D sub-image displayed on the display unit 51 is changed. The position with respect to the display surface in the depth direction can be easily reversed.

  On the other hand, when the position of the 3D sub-image is reversed with respect to the display surface in the depth direction by giving the amount of change of the offset information with a command, the amount of change of the offset value is the offset value set before the change. And requires a large number of bits.

  For example, when the currently set offset value is 63 and the offset flag is 1, the offset value change amount is 126, and the offset flag indicating the offset direction change direction is 0. Therefore, in order to express the change amount of the offset value, it is necessary to assign 7 bits to the change amount of the offset value.

  However, it is difficult to assign a large number of bits to the change amount of the offset value. For example, the number of bits assigned to the change amount of the offset value is 6 bits, and the number of bits assigned in the offset direction is 1 bit. , 126 is not represented by 6 bits, and the position of the 3D sub-image with respect to the display surface in the depth direction cannot be reversed.

[Functional configuration example of a playback device when executing a BD-J object]
FIG. 14 is a diagram illustrating a functional configuration example of the playback device 20 when executing a BD-J object.

  The hardware 91 includes, for example, the input unit 21, the reproduction unit 23, the storage unit 24, the communication unit 25, and the drive 26 illustrated in FIG. A part of the reproducing unit 23 may be realized by software.

  The system firmware 92, OS (Operating System) 93, Java VM (Virtual Machine) 94, and BD-J application 95 are programs executed by the control unit 22.

  When the disk 11 is mounted on the hardware 91, the system firmware 92 controls the hardware 91 to read the index file from the disk 11. The system firmware 92 stores the index file in the hardware 91.

  Further, the system firmware 92 reads the index file from the hardware 91, and recognizes the type and number of the BD-J object corresponding to the title number to be reproduced, which is described in the index file.

  The system firmware 92 controls the hardware 91 based on the number of the BD-J object corresponding to the title number to be played back, reads the playback target BD-J object from the disk 11, and stores it in the hardware 91. . The system firmware 92 recognizes the BD-J application 95 to be executed based on the BD-J object, and then activates the Java VM 94. Then, the system firmware 92 deploys the BD-J application 95 on the Java VM 94.

  Note that the Java VM 94 may be activated after the disk 11 is mounted on the hardware 91 and before the BD-J application 95 to be executed is recognized. The system firmware 92 implements a function called by the OS 93.

  Based on the function notified by the Java VM 94, the OS 93 calls the function to the system firmware 92 corresponding to the function.

  The Java VM 94 interprets a function corresponding to a BD-J API (Application Program Interface) called by the BD-J application 95 and notifies the OS 93. For example, the Java VM 94 generates and displays graphics data called by the BD-J application 95 and corresponds to a BD-J API (hereinafter referred to as a generation display API) for displaying BD-J graphics. Interpret the function and notify the OS93 of the generation display function.

  The Java VM 94 is a public void change Offset Sign () (hereinafter referred to as an offset direction change API) that is a BD-J API called by the BD-J application 95 to change the offset direction of BD-J graphics. ), And notifies the OS 93 of the offset direction change function.

  The BD-J application 95 calls the BD-J API defined in the Java VM 94 with respect to the Java VM 94. For example, the BD-J application 95 (generation control information) calls the generation display API for the Java VM 94. Further, the BD-J application 95 (offset change control information) calls the offset direction change API to the Java VM 94.

[Description of playback device processing during BD-J object execution]
FIG. 15 is a flowchart for explaining graphics display processing by the playback device 20 when executing a BD-J object. This graphics display processing is started, for example, when the system firmware 92 generates graphics data and develops a BD-J application 95 for displaying BD-J graphics on the Java VM 94.

  In step S81 of FIG. 15, the BD-J application 95 calls the BD-J API for setting offset information (hereinafter referred to as offset information setting API) to the Java VM 94. Thereby, the Java VM 94 interprets the offset information setting function as a function corresponding to the offset information setting API, and notifies the OS 93. Then, the OS 93 calls the offset information setting function to the system firmware 92 corresponding to the offset information setting function.

  In step S82, the system firmware 92 controls the BD-J graphics generation unit 37 of the hardware 91 to set offset information. The BD-J graphics generation unit 37 supplies the offset information to the 3D display data generation unit 36.

  In step S83, the BD-J application 95 calls the generation display API to the Java VM 94. As a result, the Java VM 94 interprets the generation display function as a function corresponding to the generation display API, and notifies the OS 93. Then, the OS 93 calls the generation display function to the system firmware 92 corresponding to the generation display function.

  In step S <b> 84, the BD-J graphics generation unit 37 of the hardware 91 generates graphics data under the control of the system firmware 92 and supplies the graphics data to the 3D display data generation unit 36.

  In step S85, the 3D display data generation unit 36 of the hardware 91 converts 3D graphics data from the graphics data based on the offset information supplied from the BD-J graphics generation unit 37 under the control of the system firmware 92. Generate. This 3D graphics data is combined with 3D video data and 3D menu data and supplied to the display unit 51 as 3D display data. As a result, 3D BD-J graphics are displayed on the display unit 51 as one of the sub-images of the 3D main image corresponding to the 3D video data.

  FIG. 16 is a flowchart for explaining offset direction change processing by the playback device 20 when executing a BD-J object. This offset direction changing process is started, for example, when the BD-J application 95 calls the offset direction changing API to the Java VM 94.

  In step S101 of FIG. 16, the system firmware 92 generates BD-J graphics of the hardware 91 in response to the offset direction change function call by the OS 93 corresponding to the offset direction change API call by the BD-J application 95. The unit 37 is controlled to invert the sign of the offset value of the currently set offset information. That is, the BD-J graphics generation unit 37 changes the offset direction of the currently set offset information. Then, the BD-J graphics generation unit 37 supplies offset information including the changed offset direction to the 3D display data generation unit 36.

  In step S102, the 3D display data generation unit 36 of the hardware 91 updates the 3D graphics data based on the offset information supplied from the BD-J graphics generation unit 37.

  Accordingly, the position in the depth direction of the 3D BD-J graphics displayed on the display unit 51 is opposite to the display surface. That is, the 3D BD-J graphics that were displayed so as to pop out of the display surface are displayed so as to be retracted with respect to the display surface, and the 3D BD-J that is displayed so as to be retracted with respect to the display surface. J graphics are displayed so as to pop out of the display surface.

  As described above, in the playback device 20, in accordance with the BD-J application 95 that reads the offset direction change API, the BD-J for 2D display shifted in the direction opposite to the offset direction of the BD-J graphics for the left eye being displayed. The image data of J graphics is the left-eye graphics data, the left-eye BD-J graphics are displayed based on the left-eye graphics data, and the right-eye BD-J graphics being displayed The image data of BD-J graphics for 2D display shifted in the direction opposite to the offset direction of the graphics is used as the graphics data for the right eye, and the BD-J graphics for the right eye based on the graphics data for the right eye Is displayed. Therefore, the position of the 3D BD-J graphics displayed on the display unit 51 with respect to the display surface in the depth direction can be reversed. Therefore, it can be said that the video format of the disc 11 including the BD-J application 95 that reads the offset direction change API is a 3D video format suitable for 3D display of BD-J graphics.

  Further, the playback device 20 changes the offset direction of the BD-J graphics for the left eye and the offset direction of the BD-J graphics for the right eye by changing the sign of the offset value. Therefore, for example, in response to a call to the BD-J API for reading the offset information being currently set, the system firmware 92 causes the hardware 91 to read the offset information being currently set to call the offset information setting API. Accordingly, the 3D BD-J graphics displayed on the display unit 51 with respect to the display surface in the depth direction are compared with the case where the inverted offset value of the read offset information is set. The position can be easily reversed.

<Second Embodiment>
[Configuration example of epoch in the second embodiment of the disk]
FIG. 17 is a diagram showing a configuration example of epochs of caption data in the second embodiment of the disc to which the present invention is applied.

  The disc 501 in FIG. 17 mainly records two AV streams, a left-eye AV stream and a right-eye AV stream used for 3D display of the main image and the sub-image. Is different. As shown in FIG. 17, the epoch structures of the AV stream for the left eye and the AV stream for the right eye that are reproduced simultaneously are the same. That is, the number of display sets for the left-eye epoch and the number of display sets for the right-eye epoch that are simultaneously played back are the same.

  Also, between the left-eye display set and the right-eye display set that are played back simultaneously, the PTS of each segment is the same. Thereby, the display timing of the subtitle for the left eye and the subtitle for the right eye can be made simultaneously.

  The PTS included in the PES packet header of the PCS is obtained based on the decoding time of the ODS corresponding to the PCS, the time required for drawing the subtitle corresponding to the ODS, and the time required for drawing the window. Therefore, between the left-eye display set and the right-eye display set that are played back simultaneously, the vertical and horizontal sizes of the subtitles corresponding to the ODS with the same sub-image ID and the vertical and horizontal sizes of the windows with the same window ID are the same. is there. As a result, the PTS included in the PES packet header of the PCS can be synchronized between the left-eye display set and the right-eye display set without any contradiction.

  Further, the sub-image ID and the window ID are the same between the left-eye display set and the right-eye display set that are reproduced simultaneously. As a result, images corresponding to the same subtitle are displayed at the same time, so that the user can view the 3D subtitle.

  Further, between the left-eye display set and the right-eye display set that are played back simultaneously, the number of segments excluding ODS is the same, and the DTS of each segment is the same. Note that the shapes of subtitles corresponding to the same sub-image ID may be different. Also, the PDS may be different.

  Since the epoch structure of the menu data and the relationship between the left-eye display set and the right-eye display set that are played back simultaneously are the same except that the PCS replaces the ICS, the description thereof is omitted.

  However, if the menu button is animated at a constant frame rate when selected by the user, the animation frame rate of the menu button for the left eye and the menu button for the right eye needs to be the same. Therefore, the field for determining the frame rate of the animation included in the ICS is the same between the display set for the left eye and the display set for the right eye corresponding to such a menu button. Thereby, the menu button for the left eye and the menu button for the right eye are always correspondingly animated at a constant frame rate, so that the user can see the 3D menu button animated at a constant frame rate. .

  Also, when an animation called slide-in, etc., called effects is performed at the start of displaying the menu button, etc., the number of frames and the interval of the animation need to be the same for the menu button for the left eye and the menu button for the right eye. is there. Therefore, between the left-eye display set and the right-eye display set corresponding to such a menu button, the fields describing the number of frames and the interval of the animation at the time of the effect included in the ICS are the same. Thereby, the menu button for the left eye and the menu button for the right eye are always effected correspondingly, so that the user can see the 3D menu button to be effected.

[Example of playback device configuration]
FIG. 18 is a block diagram showing a configuration example of a playback apparatus 510 that plays back the above-described disc 501.

  Of the configurations shown in FIG. 18, configurations the same as the configurations in FIG. 5 are denoted with the same reference numerals. The overlapping description will be omitted as appropriate.

  The configuration of the playback apparatus 510 in FIG. 18 is mainly that a control unit 511 is provided instead of the control unit 22 and a playback unit 512 is provided instead of the playback unit 23. And different. The configuration of the playback unit 512 includes a PID filter 33, a video generation unit 34, a subtitle / menu generation unit 35, a 3D display data generation unit 36, and a BD-J graphics generation unit 37, respectively. 5 is different from the configuration of FIG. 5 in that a section 522, a caption / menu generation section 523, a 3D display data generation section 524, and a BD-J graphics generation section 525 are provided.

  The control unit 511 controls the playback unit 512 according to a command from the input unit 21 by executing a predetermined program. For example, the control unit 511 controls the drive 31 of the playback unit 512 to read an index file, movie object file, BD-J object file, playlist file, clip information file, stream file, and the like from the disc 501.

  Further, the control unit 511 recognizes the packet having the packet number of the AV stream for the left eye and the AV stream for the right eye to be reproduced based on the read clip information file. Then, the control unit 511 controls the drive 31 to read out the left-eye AV stream and the right-eye AV stream that are composed of the packets.

  Based on the PID of each packet of the left-eye AV stream from the read buffer 32, the PID filter 521 extracts the left-eye video data and the left-eye caption data PES packet from the left-eye AV stream, respectively. The PID filter 521 extracts the left-eye menu data and the audio data PES packet from the left-eye AV stream based on the PID of each packet of the left-eye AV stream.

  The PID filter 521 also extracts PES packets of right-eye video data and right-eye caption data from the right-eye AV stream based on the PID of each packet of the right-eye AV stream from the read buffer 32, respectively. . Further, the PID filter 521 extracts a PES packet of menu data for the right eye from the AV stream for the right eye based on the PID of each packet of the AV stream for the right eye.

  The video generation unit 522 decodes the PES packet of the video data for the left eye and the PES packet of the video data for the right eye supplied from the PID filter 521. Then, the video generation unit 522 supplies the left-eye video data and the right-eye video data obtained as a result of the decoding to the 3D display data generation unit 524 as 3D video data.

  The caption / menu generation unit 523 includes a caption generation unit 531 and a menu generation unit 532. The caption generation unit 531 decodes the left-eye caption data and the right-eye caption data supplied from the PID filter 521 when the movie object is executed. Then, the caption generation unit 531 supplies the left-eye caption data and the right-eye caption data obtained as a result of the decoding to the 3D display data generation unit 524 as 3D caption data.

  The menu generation unit 532 decodes the left-eye menu data and the right-eye menu data PES packet supplied from the PID filter 521 when the movie object is executed. Then, the menu generation unit 532 supplies the left-eye menu data and the right-eye menu data obtained as a result of the decoding to the 3D display data generation unit 524 as 3D menu data.

  The 3D display data generation unit 524 outputs the 3D video data supplied from the video generation unit 522 and the 3D subtitle data and 3D menu data supplied from the subtitle / menu generation unit 523 for each data for the left and right eyes. Combine and generate 3D display data. In addition, the 3D display data generation unit 524 combines the 3D video data supplied from the video generation unit 522 and the graphics data supplied from the BD-J graphics generation unit 525 for each data for the left and right eyes. 3D display data is generated. Then, the 3D display data generation unit 524 supplies the 3D display data to the display unit 51 and causes the display unit 51 to display a left-eye image and a right-eye image.

  The BD-J graphics generation unit 525 generates left-eye and right-eye graphics data according to control from the control unit 511 when executing the BD-J object. Then, the BD-J graphics generation unit 525 supplies the left-eye graphics data and the right-eye graphics data to the 3D display data generation unit 524 as 3D graphics data.

[Detailed configuration example of subtitle generator]
FIG. 19 is a block diagram illustrating a detailed configuration example of the caption generation unit 531 of FIG.

  19, the caption generation unit 531 includes an acquisition unit 540, a right-eye decoder 541-1, a left-eye decoder 541-2, a right-eye graphics plane 542-1, a left-eye graphics plane 542-2, a CLUT 543-1, And CLUT 543-2.

  The acquisition unit 540 is supplied with right-eye caption data and left-eye caption data from the PID filter 521 of FIG. The acquisition unit 540 inputs the right-eye caption data supplied from the PID filter 521 to the right-eye decoder 541-1 and inputs the left-eye caption data to the left-eye decoder 541-2.

  Further, the acquisition unit 540 controls the right-eye by control according to a navigation command (hereinafter referred to as an LR exchange command) for replacing the left-eye caption data and the right-eye caption data from the control unit 511 (FIG. 18). The caption data input to the decoder 541-1 and the left-eye decoder 541-2 are switched.

  The right-eye decoder 541-1 includes an encoded data buffer 561-1, a stream graphics generation unit 562-1, an object buffer 563-1, a composition buffer 564-1, and a control unit 565-1.

  The encoded data buffer 561-1 holds a segment of the PES packet of caption data supplied from the acquisition unit 540. The encoded data buffer 561-1 reads the held segment and supplies it to the stream graphics generation unit 562-1.

  The stream graphics generation unit 562-1 decodes the ODS among the segments supplied from the encoded data buffer 561-1. Then, the stream graphics generation unit 562-1 supplies the uncompressed caption data including the index color obtained as a result to the object buffer 563-1 as a caption object. Also, the stream graphics generation unit 562-1 supplies the PDS, PCS, and WDS of the segments supplied from the encoded data buffer 561-1 to the composition buffer 564-1.

  The object buffer 563-1 holds the caption object supplied from the stream graphics generation unit 562-1. The object buffer 563-1 deletes the held caption object in units of epochs. Further, the object buffer 563-1 reads out the subtitle object held in accordance with the control from the control unit 565-1, and supplies it to the graphics plane for right eye 542-1.

  The composition buffer 564-1 holds the PDS, PCS, and WDS supplied from the stream graphics generation unit 562-1.

  The control unit 565-1 monitors the storage state of the caption object for one screen by the right-eye graphics plane 542-1 and notifies the control unit 565-2 of the completion of storage of the caption object for one screen. The control unit 565-1 instructs transfer to the right-eye graphics plane 542-1 based on the PTS included in the PES packet header or the notification of the completion of storage of the caption object from the control unit 565-2. Further, the control unit 565-1 reads the PDS from the composition buffer 564 and supplies it to the CLUT 543-1.

  Moreover, the control part 565-1 controls each part according to the instruction | command from the control part 511 (FIG. 18).

  The right-eye graphics plane 542-1 holds the caption object for one screen supplied from the object buffer 563-1 as the caption object for the right eye. The right-eye graphics plane 542-1 erases the subtitle object for the right eye that is held in units of epochs. Also, the right-eye graphics plane 542-1 reads the stored right-eye caption object and supplies the read right-eye caption object to the CLUT 543-1 in response to a transfer instruction from the control unit 565-1.

  The CLUT 543-1 stores a table in which index colors are associated with Y, Cr, and Cb values based on the PDS supplied from the control unit 565-1. The CLUT 543-1 converts the index color of the right-eye caption object supplied from the right-eye graphics plane 542-1 into image data including Y, Cr, and Cb values based on the stored table. Then, the CLUT 543-1 supplies the image data to the 3D display data generation unit 524 (FIG. 18) as subtitle data for the right eye.

  The left-eye decoder 541-2, the left-eye graphics plane 542-2, and the CLUT 543-2 are configured similarly to the right-eye decoder 541-1, the right-eye graphics plane 542-1, and the CLUT 543-1, respectively.

  That is, the left-eye decoder 541-2 includes an encoded data buffer 561-2, a stream graphics generation unit 562-2, an object buffer 563-2, a composition buffer 564-2, and a control unit 565-2. . The left-eye decoder 541-2 decodes the ODS of the caption data supplied from the acquisition unit 540, and outputs the caption object obtained as a result.

  The caption object is a left-eye caption object held in the left-eye graphics plane 542-2 as a left-eye caption object, and the right-eye caption object for one screen held in the right-eye graphics plane 542-1. Read simultaneously with reading. Then, the read caption object for the left eye for one screen is converted into image data by the CLUT 543-2 and supplied to the 3D display data generation unit 524 (FIG. 18) as the caption data for the left eye.

  As described above, the caption generation unit 531 clears the object buffer 563-1, the object buffer 563-2, the right-eye graphics plane 542-1, and the left-eye graphics plane 542-2 in units of epochs. However, in the disc 501, since the number of display sets constituting the epoch is the same for the right-eye AV stream and the left-eye AV stream, only one of the right-eye caption and the left-eye caption is displayed. Never stop. As a result, subtitles can always be displayed in 3D.

  Hereinafter, when it is not necessary to particularly distinguish the encoded data buffer 561-1 and the encoded data buffer 561-2, they are collectively referred to as an encoded data buffer 561. The same applies to the stream graphics generation unit 562, the object buffer 563, the composition buffer 564, the control unit 565, and the CLUT 543.

[Description of 3D subtitle display]
FIG. 20 is a diagram illustrating the display of 3D subtitles by the display unit 51 of FIG.

  As shown on the left side of FIG. 20, the 3D display data generation unit 524 includes the left-eye display data obtained as a result of combining the left-eye data including the left-eye caption data from the caption generation unit 531, and the right-eye display data. Display data for the right eye obtained as a result of combining the data for the right eye including the caption data is supplied to the display unit 51. Thereby, for example, as shown on the right side of FIG. 20, the right-eye caption and the left-eye caption are simultaneously displayed on the display unit 51.

[Description of change in 3D display of subtitles by LR exchange command]
FIG. 21 is a diagram for explaining a change in 3D display of captions according to an LR exchange command (LR exchange control information).

  As shown in FIG. 21A, the caption object corresponding to the caption data for the right eye recorded on the disc 501 is held in the graphics plane for the right eye 542-1 as the caption object for the right eye, and the graphics plane for the left eye 542- 2, when the caption object corresponding to the caption data for the left eye recorded on the disc 501 is held as the caption object for the left eye, the user 601 selects the caption for the right eye displayed on the display unit 51 as the right eye And see the subtitles for the left eye with the left eye. Thereby, as shown in FIG. 21A, the user 601 can view 3D subtitles positioned in a direction protruding from the display surface of the display unit 51, for example.

  On the other hand, when the LR exchange command is executed, as shown in FIG. 21B, the caption object corresponding to the caption data for the left eye recorded on the disc 501 on the graphics plane 542-1 for the right eye is used for the right eye. The caption object corresponding to the caption data for the right eye recorded on the disc 501 in the left-eye graphics plane 542-1 is retained as the caption object for the left eye.

  Therefore, the user 601 corresponds to the subtitle data for the right eye recorded on the disc 501 by viewing the subtitle for the left eye corresponding to the subtitle data for the left eye recorded on the disc 501 with the right eye on the display unit 51. Watch the subtitles for the right eye with the left eye. Thereby, as shown in FIG. 21B, the user 601 can view, for example, 3D subtitles positioned in the retracted direction with respect to the display surface of the display unit 51.

  As described above, when the LR exchange command is executed, the position of the 3D caption in the depth direction is opposite to the display surface.

[Detailed configuration example of menu generator]
The menu generation unit 532 is configured in the same manner as the subtitle generation unit 531 of FIG. 19 except that the processing target is not caption data but menu data, and thus illustration is omitted.

[Description of playback device processing when executing movie object]
FIG. 22 is a flowchart for describing 3D subtitle playback processing by the playback device 510 when a movie object is executed. This 3D subtitle reproduction process is started when, for example, the control unit 511 executes a command for reproducing a playlist described in a movie object.

  In step S <b> 111 of FIG. 22, the drive 31 reads a playlist file from the disc 501 and supplies the playlist file to the control unit 511 in response to a command from the control unit 511.

  In step S112, the drive 31 reads the right-eye and left-eye AV streams corresponding to the clip information file specified in the playlist from the disc 501 in response to a command from the control unit 511 based on the playlist. Then, the drive 31 supplies the right-eye and left-eye AV streams to the read buffer 32.

  In step S <b> 113, the read buffer 32 holds the right-eye and left-eye AV streams supplied from the drive 31. The read buffer 32 reads the right-eye and left-eye AV streams that it holds and supplies them to the PID filter 521.

  In step S114, the PID filter 521 extracts the PES packets of the right-eye and left-eye caption data of the AV stream based on the PIDs of the right-eye and left-eye AV streams from the read buffer 32, and This is supplied to the caption / menu generation unit 523.

  In step S115, the acquisition unit 540 (FIG. 19) of the caption generation unit 531 inputs the right-eye caption data supplied from the PID filter 521 to the right-eye decoder 541-1 and the left-eye caption data as the left-eye decoder. Input to 541-2.

  In step S116, the caption generation unit 531 performs 3D caption generation processing. Details of the 3D subtitle generation processing will be described with reference to FIG.

  FIG. 23 is a flowchart illustrating details of the caption generation processing in step S116 of FIG.

  In step S131, the encoded data buffer 561 (FIG. 19) of the right-eye decoder 541-1 and the left-eye decoder 541-2 of the caption generation unit 531 is a segment in the PES packet of the caption data supplied from the acquisition unit 540. Hold.

  In step S132, the encoded data buffer 561 reads the held segment and supplies the segment to the stream graphics generation unit 562.

  In step S133, the stream graphics generation unit 562 supplies the PCS, PDS, and WDS supplied from the encoded data buffer 561 to the composition buffer 564 and holds them.

  In step S134, the stream graphics generation unit 562 decodes the ODS of the segments supplied from the encoded data buffer 561, and supplies the caption object obtained as a result to the object buffer 563.

  In step S135, the object buffer 563 holds the caption object supplied from the stream graphics generation unit 562.

  In step S136, the object buffer 563-1 supplies the retained subtitle object to the left-eye graphics plane 542-1 for retention. Also, the object buffer 563-2 supplies the retained subtitle object to the graphics plane for right eye 542-2 and causes it to be retained.

  In step S137, the control unit 565 determines whether or not the storage of the caption object for one screen is completed on both the right-eye graphics plane 542-1 and the left-eye graphics plane 542-2.

  If it is determined in step S137 that storage of the caption object for one screen is not completed in both the right-eye graphics plane 542-1 and the left-eye graphics plane 542-2, the control unit 565 displays one screen. Wait until the subtitle object has been stored.

  On the other hand, when it is determined in step S137 that the storage of the caption object for one screen is completed in both the right-eye graphics plane 542-1 and the left-eye graphics plane 542-2, the control unit 565 in step S138. Instructs the object buffer 563 to transfer. As a result, the right-eye caption object for one screen held in the right-eye graphics plane 542-1 is transferred to the CLUT 543-1, and at the same time, one screen held in the left-eye graphics plane 542-2. Minute left-eye caption object is transferred to CLUT 543-2.

  In step S139, the CLUT 543-1 converts the right-eye caption object supplied from the right-eye graphics plane 542-1 into image data, and the CLUT 543-2 is supplied from the left-eye graphics plane 542-2. Convert the caption object for the left eye into image data.

  In step S140, the CLUT 543-1 outputs the right-eye caption data obtained as a result of the conversion in step S139 to the 3D display data generation unit 524, and the CLUT 543-2 obtains the left-eye caption data obtained as a result of the conversion in step S139. The data is output to the 3D display data generation unit 524. Then, the process returns to step S116 in FIG. 22 and ends.

  The 3D menu reproduction process is performed in the same manner as the 3D subtitle reproduction process in FIG. 22 except that the processing target is not the caption data but the menu data, and thus the description thereof is omitted.

  FIG. 24 is a flowchart for explaining subtitle display direction changing processing by the playback device 510 when a movie object is executed. This subtitle display direction changing process is started, for example, when the control unit 511 executes an LR exchange command.

  In step S151 of FIG. 24, the acquisition unit 540 (FIG. 19) uses the subtitle data of the subtitle currently displayed as the subtitle for the right eye supplied from the PID filter 521 for the left eye in response to a command from the control unit 511. Input to the decoder 541-2 and input the caption data of the caption displayed as the caption for the left eye to the decoder 541-1 for the right eye.

  In step S152, the caption generation unit 531 performs the 3D caption generation process of FIG. 23, and ends the process.

  The menu display direction changing process is performed in the same manner as the subtitle display direction changing process of FIG. 24 except that the processing target is not the caption data but the menu data, and thus description thereof is omitted.

  In the caption generation unit 531, the caption data input to the right-eye decoder 541-1 and the caption data input to the left-eye decoder 541-2 are exchanged when the LR exchange command is executed. The caption data output from the decoder 541-1 and the left-eye decoder 541-2 may be exchanged. Furthermore, the caption data output from the CLUT 543-1 and the caption data output from the CLUT 543-2 may be exchanged.

[Other application examples of LR exchange command]
FIG. 25 is a diagram illustrating another application example of the LR exchange command.

  As shown in FIG. 25, the LR exchange command may be applied as menu control information included in the ICS of the menu data for the left eye.

  In this case, as shown in FIG. 13, a direction change button 81 that is a menu button corresponding to the LR exchange command is displayed on the display unit 51. The user can cause the playback apparatus 510 to perform the subtitle display direction change process and the menu display direction change process by operating the direction change button 81 using the input unit 21 while the subtitles and menu buttons are being displayed.

  Specifically, the control unit 511 acquires a command corresponding to an operation on the direction change button 81 by the user from the input unit 21 and supplies the command to the control unit 565, and controls execution of the command corresponding to the direction change button 81. Command to unit 565. The control unit 565 controls the acquisition unit 540 in accordance with the command to exchange the caption data input to the right-eye decoder 541-1 and the caption data input to the left-eye decoder 541-2.

  In FIG. 25, the LR exchange command is described in the ICS of the menu data for the left eye, but the LR exchange command may be described in the menu data for the right eye. Further, the LR exchange command may be described in both left-eye menu data and right-eye menu data.

  As described above, according to the LR exchange command, the playback device 510 outputs the image data of the left-eye sub-image being displayed to the 3D display data generation unit 524 as the right-eye sub-image data, and also displays the currently-displayed sub-image data. The image data of the sub-image for the right eye is output to the 3D display data generation unit 524 as the sub-image data for the left eye, and the sub-image for the right eye is displayed based on the sub-image data for the right eye. A sub-image for the left eye is displayed based on the data. Accordingly, the position of the 3D sub-image displayed on the display unit 51 with respect to the display surface in the depth direction can be reversed. Therefore, it can be said that the video format of the disc 501 including the LR exchange command is a 3D video format suitable for 3D display of the sub-image.

[Functional configuration example of a playback device when executing a BD-J object]
FIG. 26 is a diagram illustrating a functional configuration example of the playback device 510 when executing a BD-J object.

  The hardware 701 is realized by, for example, the input unit 21, the reproduction unit 512, the storage unit 24, the communication unit 25, and the drive 26 illustrated in FIG. A part of the reproduction unit 512 may be realized by software.

  Further, the system firmware 702, the OS 703, the Java VM 704, and the BD-J application 705 are programs executed by the control unit 511.

  When the disk 501 is mounted on the hardware 701, the system firmware 702 controls the hardware 701 and reads an index file from the disk 501. Then, the system firmware 702 stores the index file in the hardware 701.

  Further, the system firmware 702 reads the index file from the hardware 701, and recognizes the type and number of the BD-J object corresponding to the title number to be reproduced, which is described in the index file.

  The system firmware 702 controls the hardware 701 based on the number of the BD-J object corresponding to the title number to be played, reads the BD-J object to be played from the disc 501, and stores it in the hardware 701. . The system firmware 702 activates the Java VM 704 after recognizing the BD-J application 705 to be executed based on the BD-J object. Then, the system firmware 702 expands the BD-J application 705 on the Java VM 704.

  Note that the Java VM 704 may be activated after the disk 501 is mounted on the hardware 701 and before the BD-J application 705 to be executed is recognized. Further, the system firmware 702 realizes a function called by the OS 703.

  Based on the function notified by the Java VM 704, the OS 703 calls the function to the system firmware 702 corresponding to the function.

  The Java VM 704 interprets the function corresponding to the BD-J API called by the BD-J application 705 and notifies the OS 703. For example, the Java VM 704 interprets the generation display function corresponding to the generation display API called by the BD-J application 705 and notifies the OS 703 of the display function.

  In addition, the Java VM 704 calls a public void Exchange LR () (hereinafter referred to as LR exchange API), which is a BD-J API called by the BD-J application 705 to change the display direction of BD-J graphics. The corresponding LR exchange function is interpreted, and the LR exchange function is notified to the OS 703.

  The BD-J application 705 calls the BD-J API defined in the Java VM 704 with respect to the Java VM 704. For example, the BD-J application 705 (generation control information) calls the generation display API for the Java VM 704. The BD-J application 705 (LR exchange control information) calls the LR exchange API to the Java VM 704.

[Detailed configuration example of BD-J graphics generator]
FIG. 27 is a block diagram illustrating a detailed configuration example of the BD-J graphics generation unit 525.

  The BD-J graphics generation unit 525 includes a graphics generation unit 711, a right-eye graphics plane 712, a graphics generation unit 713, and a left-eye graphics plane 714.

  The graphics generation unit 711 generates predetermined right-eye graphics data according to the control of the system firmware 702 when the BD-J application 705 calls the generation display API. The graphics generation unit 711 also displays the BD-J graphics currently displayed as the left-eye BD-J graphics according to the control of the system firmware 702 when the BD-J application 705 calls the LR exchange API. -J Generate graphics data for graphics. Then, the graphics generation unit 711 supplies the generated graphics data to the right-eye graphics plane 712.

  The right-eye graphics plane 712 holds the graphics data supplied from the graphics generation unit 711 in units of one screen as right-eye graphics data. The right-eye graphics plane 712 supplies the retained right-eye graphics data for one screen to the 3D display data generation unit 524.

  The graphics generation unit 713 generates predetermined left-eye graphics data according to the control of the system firmware 702 when the generation display API is called by the BD-J application 705. The graphics generation unit 713 also displays the BD-J graphics currently displayed as the right-eye BD-J graphics according to the control of the system firmware 702 when the BD-J application 705 calls the LR exchange API. -J Generate graphics data for graphics. Then, the graphics generation unit 713 supplies the generated graphics data to the left-eye graphics plane 714.

  The left-eye graphics plane 714 holds the graphics data supplied from the graphics generation unit 713 in units of one screen as left-eye graphics data. The left-eye graphics plane 714 supplies the retained left-eye graphics data for one screen to the 3D display data generation unit 524.

[Description of playback device processing during BD-J object execution]
FIG. 28 is a flowchart for describing graphics display processing by the playback device 510 when executing a BD-J object. This graphics display processing is started, for example, when the system firmware 702 generates graphics data and develops a BD-J application 705 for displaying BD-J graphics on the Java VM 704.

  In step S171 in FIG. 28, the BD-J application 705 calls the generation display API to the Java VM 704. Accordingly, the Java VM 704 interprets the generation display function as a function corresponding to the generation display API, and notifies the OS 703. Then, the OS 703 calls the generation display function to the system firmware 702 corresponding to the generation display function.

  In step S172, the graphics generation unit 711 (FIG. 27) generates predetermined right-eye graphics data under the control of the system firmware 702, and supplies it to the right-eye graphics plane 712.

  In step S 173, the graphics generation unit 713 generates predetermined left-eye graphics data under the control of the system firmware 702, and supplies the left-eye graphics plane 714.

  In step S174, the right-eye graphics plane 712 holds predetermined right-eye graphics data from the graphics generation unit 711 in units of one screen as right-eye graphics data. The left-eye graphics plane 714 holds predetermined left-eye graphics data from the graphics generation unit 713 as left-eye graphics data in units of one screen.

  In step S175, the right-eye graphics plane 712 outputs the retained right-eye graphics data for one screen to the 3D display data generation unit 524, and the left-eye graphics plane 714 retains 1 The left-eye graphics data for the screen is output to the 3D display data generation unit 524. Then, the process ends.

  FIG. 29 is a flowchart for explaining display direction change processing by the playback device 510 when executing a BD-J object. This display direction changing process is started, for example, when the BD-J application 705 calls the LR exchange API to the Java VM 704.

  In step S191 in FIG. 29, the graphics generation unit 711 controls the BD-J application 705 to call the LR exchange API, and the BD-J graphics currently displayed as the BD-J graphics for the left eye are controlled by the system firmware 702. -J graphics data is generated and supplied to the right-eye graphics plane 712.

  In step S192, the graphics generation unit 713 controls the system firmware 702 corresponding to the call of the LR exchange API by the BD-J application 705 to display the BD-J graphics currently displayed as the right-eye BD-J graphics. Graphics data is generated and supplied to the left-eye graphics plane 714.

  In step S193, the right-eye graphics plane 712 holds the left-eye graphics data from the graphics generation unit 711 in units of one screen as right-eye graphics data. The left-eye graphics plane 714 holds the right-eye graphics data from the graphics generation unit 713 as left-eye graphics data in units of one screen.

  In step S194, the right-eye graphics plane 712 outputs the retained right-eye graphics data for one screen to the 3D display data generation unit 524, and the left-eye graphics plane 714 retains 1 The left-eye graphics data for the screen is output to the 3D display data generation unit 524.

  Accordingly, the position in the depth direction of the 3D BD-J graphics displayed on the display unit 51 is opposite to the display surface. That is, the 3D BD-J graphics that were displayed so as to pop out of the display surface are displayed so as to be retracted with respect to the display surface, and the 3D BD-J that is displayed so as to be retracted with respect to the display surface. J graphics are displayed so as to pop out of the display surface.

  As described above, according to the BD-J application 705 for reading out the LR exchange API, the playback device 510 converts the left-eye BD-J graphics image data being displayed as graphics data for the right eye into a 3D display data generation unit. The image data of the right-eye BD-J graphics being displayed is output to the 3D display data generation unit 524 as the left-eye graphics data, and the right-eye is displayed based on the right-eye graphics data. BD-J graphics for the left eye are displayed, and BD-J graphics for the left eye are displayed based on the graphics data for the left eye. Therefore, the position of the 3D BD-J graphics displayed on the display unit 51 with respect to the display surface in the depth direction can be reversed. Therefore, it can be said that the video format of the disc 501 including the LR exchange command is a 3D video format suitable for 3D display of BD-J graphics.

  In the BD-J graphics generation unit 525 described above, when the LR exchange API is called, the graphics data generated by the graphics generation unit 711 and the graphics data generated by the graphics generation unit 713 are exchanged. However, the graphics data output from the right-eye graphics plane 712 and the graphics data output from the left-eye graphics plane 714 may be exchanged.

  Further, the LR exchange command and the LR exchange API are applied to a playback device that generates left-eye and right-eye sub-image data from one sub-image data recorded on the disc based on the offset information. Also good. In this case, the playback device exchanges the left-eye and right-eye sub-image data generated from one sub-image data, thereby reversing the position in the depth direction of the 3D sub-image with respect to the display surface. .

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the order, but is not necessarily performed in chronological order, either in parallel or individually. The process to be executed is also included.

  The embodiments of the present invention are not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention.

  11 disc, 20 playback device, 36 3D display data generation unit, 37 BD-J graphics generation unit, 501 disc, 510 playback device, 523 subtitle / menu generation unit, 524 3D display data generation unit, 525 BD-J graphics Generation unit, 540 acquisition unit, 542-1 right-eye graphics plane, 542-2 left-eye graphics plane

Claims (14)

LR exchange control that is control information for exchanging L image data that is image data of an L image for left eye and R image data that is image data of an R image for right eye used for 3D (3 Dimensional) display of a sub-image When playing back data with a data structure that includes information,
Output means for outputting the L image data of the L image being displayed as the R image data and outputting the R image data of the R image being displayed as the L image data in accordance with the LR exchange control information When,
A display device comprising: display control means for displaying the R image on a display unit based on the R image data output by the output means, and displaying the L image on the display unit based on the L image data. The playback apparatus according to claim 1, wherein the data is data having a data structure further including the L image data and the R image data. The data further includes generation control information which is control information for generating the L image data and the R image data,
The playback device
The playback device according to claim 1, further comprising: generating means for generating the L image data and the R image data according to the generation control information. The playback device
Holding means for holding the L image data and the R image data;
In accordance with the LR exchange control information, the L image data of the displayed L image is input to the holding unit as the R image data, and the R image data of the displayed R image is used as the L image data. Input means for inputting to the holding means, and
The playback apparatus according to claim 1, wherein the output unit outputs the R image data and the L image data held in the holding unit as they are. The playback device
Holding means for holding the L image data of the L image being displayed and the R image data of the R image;
The output means outputs the L image data held in the holding means as the R image data in accordance with the LR exchange control information, and the R image data held in the holding means is the L image. The playback device according to claim 1, wherein the playback device outputs the data. LR exchange control that is control information for exchanging L image data that is image data of an L image for left eye and R image data that is image data of an R image for right eye used for 3D (3 Dimensional) display of a sub-image A playback device that plays back data having a data structure including information,
According to the LR exchange control information, the L image data of the L image being displayed is output as the R image data, and the R image data of the R image being displayed is output as the L image data,
A reproduction method comprising the steps of: displaying the R image on a display unit based on the output R image data; and displaying the L image on the display unit based on the L image data. LR exchange control that is control information for exchanging L image data that is image data of an L image for left eye and R image data that is image data of an R image for right eye used for 3D (3 Dimensional) display of a sub-image A computer that executes control to reproduce data having a data structure including information,
According to the LR exchange control information, the L image data of the L image being displayed is output as the R image data, and the R image data of the R image being displayed is output as the L image data,
A program for executing a control process including a step of displaying the R image on a display unit based on the output R image data and displaying the L image on the display unit based on the L image data. LR exchange control that is control information for exchanging L image data that is image data of an L image for left eye and R image data that is image data of an R image for right eye used for 3D (3 Dimensional) display of a sub-image A recording medium on which data having a data structure including information is recorded. Offset change control information for changing the offset direction indicating the shift direction of the left-eye L image and the right-eye R image used for 3D (3 Dimensional) display of the sub-image with respect to the sub-image for 2D (2 Dimensional) display When playing back data with a data structure that includes
In accordance with the offset change control information, image data of an image obtained as a result of shifting the sub-image in a direction opposite to the shift direction of the L image being displayed with respect to the sub-image is L image data that is image data of the L image. Based on the L image data, the L image is displayed on the display unit, and image data of an image obtained as a result of shifting the sub image in a direction opposite to the shift direction of the R image being displayed with respect to the sub image is displayed. A display control means for displaying R image data on the display unit based on the R image data. The playback device according to claim 9, wherein the data is data having a data structure further including image data of the sub-image. The data further includes generation control information that is control information for generating image data of the sub-image,
The playback device
The playback device according to claim 9, further comprising: generation means for generating image data of the sub-image according to the generation control information. Offset change control information for changing the offset direction indicating the shift direction of the left-eye L image and the right-eye R image used for 3D (3 Dimensional) display of the sub-image with respect to the sub-image for 2D (2 Dimensional) display A playback device that plays back data having a data structure including
In accordance with the offset change control information, image data of an image obtained as a result of shifting the sub-image in a direction opposite to the shift direction of the L image being displayed with respect to the sub-image is L image data that is image data of the L image. Based on the L image data, the L image is displayed on the display unit, and image data of an image obtained as a result of shifting the sub image in a direction opposite to the shift direction of the R image being displayed with respect to the sub image is displayed. And R image data which is image data of the R image, and displaying the R image on the display unit based on the R image data. Offset change control information for changing the offset direction indicating the shift direction of the left-eye L image and the right-eye R image used for 3D (3 Dimensional) display of the sub-image with respect to the sub-image for 2D (2 Dimensional) display A computer that executes control to reproduce data having a data structure including:
In accordance with the offset change control information, image data of an image obtained as a result of shifting the sub-image in a direction opposite to the shift direction of the L image being displayed with respect to the sub-image is L image data that is image data of the L image. Based on the L image data, the L image is displayed on the display unit, and image data of an image obtained as a result of shifting the sub image in a direction opposite to the shift direction of the R image being displayed with respect to the sub image is displayed. Is R image data which is image data of the R image, and a program for executing a control process including a step of displaying the R image on the display unit based on the R image data. Offset change control information for changing the offset direction indicating the shift direction of the left-eye L image and the right-eye R image used for 3D (3 Dimensional) display of the sub-image with respect to the sub-image for 2D (2 Dimensional) display A recording medium on which data with a data structure is recorded.

Images