JP2013118539A - Reproduction method and device, and recording method and device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem that an inconsistency is generated in data as a 3D content and reproduction output cannot be performed normally since only 2D content part is updated when the 3D content which has been edited in 2D is reproduced in 3D.SOLUTION: When there is inconsistency as 3D content in information recorded on a recording medium, extent start position information of a dependent-view stream in clip information is corrected and reproduced so as to be consistent with the extent start position information of a base view stream.

Description

  The present invention relates to a reproducing method / apparatus and a recording method / apparatus.

  There exists a thing of patent document 1 as background art of this invention.

In this publication, as a problem, “to provide a recording medium that can be guaranteed to be played back by both the 3D playback device and the 2D playback device”.
As a solution,
“A recording medium according to the present invention is a recording medium on which playlist information and a stream file are recorded, wherein the playlist information includes one or more pieces of playback section information, and the playback section information includes video Including file reference information designating the stream file storing the stream, wherein the stream file is an interleaved transport stream file and a normal format transport stream file, and the interleaved transport stream file includes: Each of a plurality of divided parts obtained by dividing the transport stream storing the left-view video stream and a plurality of divided parts obtained by dividing the transport stream storing the right-view video stream It is configured by being alternately arranged, and is specified by the same identification number as the file reference information and an extension indicating that the file is interleaved. The transport stream file in the normal format is the left-view video stream. And the right-view video stream, which stores a base-view video stream that can be played back independently, the same identification number as the file reference information, and an extension indicating that it is in a normal format Characterized by. "
It is described.

Japanese Patent No. 47333772

  The above prior art describes a 3D video data recording structure that guarantees playback on a playback device for planar video (referred to as 2D video) with respect to recording and playback of stereoscopic video (referred to as 3D video). doing. However, in the above prior art, regarding the playlist and AV clip, when the content is 3D, the fact that the result edited in the 2D editing environment is reflected in 3D is not particularly taken into consideration.

  When a device having a 2D playback function also has a 2D editing function, only a data portion that can be recognized as 2D content among the 3D content recorded on the recording medium is to be edited. Since the data portion that cannot be recognized as 2D content is not recognized as an object to be edited, there is a possibility that when the edited recording medium is played back on a 3D playback device, display output cannot be correctly performed due to data mismatch. there were.

  The present invention has been made in view of the above points, and provides a playback method / apparatus and recording method / apparatus that can correctly display and output 3D content in which a data portion as 2D content is edited on a 3D playback apparatus. The purpose is to provide.

  The above object is solved by the invention described in the claims.

According to the present invention, it is possible to provide a playback method / apparatus and a recording method / apparatus that can correctly display and output 3D content in which a data portion as 2D content is edited on a 3D playback device.
Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

Example of schematic diagram of directory structure and file structure. The example of the schematic diagram which showed the structure of the playlist file. The example of the schematic diagram which showed the structure of user interface application information. The example of the schematic diagram which showed the structure of the time zone. The example of the schematic diagram which showed the structure of playlist information. The example of the schematic diagram which showed the structure of play item. The example of the schematic diagram which showed the structure of bridge sequence information. The example of the schematic diagram which showed the structure of the sub play item. The example of the schematic diagram which showed the structure of the MPEG-2 transport stream. The example of the schematic diagram of the recording device which showed the implementation system. The example of the schematic diagram of the reproducing | regenerating apparatus which showed the implementation system. The example of the schematic diagram of a real play list. The example of the schematic diagram which showed an example of the production | generation of a real play list. The example of the schematic diagram which showed an example of the division | segmentation of a real play list. The example of the schematic diagram which showed an example of the division | segmentation of a real play list. The example of the schematic diagram which showed an example of the connection of a real play list. The example of the schematic diagram which showed an example of the connection of a real play list. The example of the schematic diagram which showed an example of the deletion of a real play list. The example of the schematic diagram which showed an example of the partial deletion of the head part of a real play list. The example of the schematic diagram which showed an example of the partial deletion of the head part of a real play list. The example of the schematic diagram which showed an example of the partial deletion of the intermediate part of a real play list. The example of the schematic diagram which showed an example of the partial deletion of the intermediate part of a real play list. The example of the schematic diagram which showed an example (non-seamless connection of two play items) of an assembly edit. The example of the schematic diagram which showed an example (non-seamless connection of two play items) of an assembly edit. The example of the schematic diagram which showed an example (seamless connection of two play items) of an assembly edit. The example of the schematic diagram which showed an example (seamless connection of two play items) of an assembly edit. The example of the schematic diagram of the recording device which showed the implementation system. The example of the schematic diagram of the recording / reproducing part of the recording device which showed the implementation system. The example of the schematic diagram of the video decoding conversion part of the recording device which showed the implementation system. The example of the process of the recording / reproducing apparatus and display apparatus which showed the implementation system. The example of the process of the recording / reproducing apparatus and display apparatus which showed the implementation system. The example of the schematic diagram which displayed the content list on the display apparatus. The example of the process of the recording / reproducing apparatus and display apparatus which showed the implementation system. Example of schematic diagram of directory structure and file structure. The example of the schematic diagram which showed the structure of stream number information. The example of the schematic diagram which showed the structure of 3D stream number information. The flowchart which showed the recording method of the management information when recording 3D content. The flowchart which showed the update method of the management information when editing 3D content in 2D editing environment. The flowchart which showed the update method of the management information when the 3D content edited in 2D editing environment is loaded by 3D reproducing | regenerating apparatus or 3D editing environment. The flowchart which showed the management method when editing 3D content in 3D editing environment. The example of the figure which showed typically the relationship between an AV stream file and an SSIF file. The figure which showed another example of the structure of a playlist file. The figure which showed another example of the structure of play list information. The figure which showed an example of the structure of a subpath. An example in the case of showing the playback order of 3D content. An example of the schematic diagram which showed the structure of the clip information file. The figure which showed an example of the structure of extent start information. An example showing the correspondence between an AV stream file and an extent. Another example of a flowchart showing a method for updating management information when 3D content edited in a 2D editing environment is loaded in a 3D playback device or 3D editing environment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is an example of a schematic diagram of a directory structure and a file structure showing an implementation method of the present invention.

  Reference numeral 101 denotes a root directory, which includes at least the BDAV directory 102. Reference numeral 102 denotes a BDAV directory, which includes a PLAYLIST directory 121, a CLIPINF directory 122, a STREAM directory 123, and a BACKUP directory 131.

  The root directory 101 includes external BDAV directories such as a BDAV1 directory 103, a BDAV2 directory 104, and a BDAVn directory 105. Here, n in the BDAVn directory 105 is a natural number continuous from 1 corresponding to the number of external BDAV directories. For example, when four external BDAV directories exist under the root directory 101, n is 4, and the directory names are BDAV1, BDAV2, BDAV3, and BDAV4, respectively.

The PLAYLIST directory 121 includes management files such as real playlist files 141 and 142 and a virtual playlist 143.
The CLIPINF directory 122 includes management files such as clip information files 144 and 145.
The STREAM directory 123 includes stream files such as stream files 146 and 147.

info. The bdav file 111 is a file that stores general information, and is stored in the BDAV directory.
menu. The tidx file 112 stores menu thumbnail header information.
menu. The tdt1 file 113 stores menu thumbnail picture data. menu. The tdt2 file 114 is a similar file.
mark. The tidx file 115 stores mark thumbnail header information.
mark. The tdt1 file 116 stores mark thumbnail picture data. mark. The tdt2 file 117 is a similar file.

01001. The rpls file 141 includes information regarding the real play list. One rpls file is generated for one real play list. 02002. The rpls file 141 is a similar file.
99999. The vpls file 143 includes information regarding the virtual playlist. One vpls file is generated for one virtual playlist.
01000. The clpi file 144 is a clip information file and includes clip information related to an AV stream file (clip AV stream file, bridge clip AV stream file). 02000. The clpi file 145 is a similar file.
01000. The m2ts file 146 is an AV stream file and includes an MPEG-2 transport stream. 02000. The m2ts file 147 is a similar file.
Clip information file zzzzz. clpi and the AV stream file zzzzz. The file name “zzzzz” of m2ts is a 5-digit integer, and the same 5-digit integer is assigned to the associated clip information file and AV stream file.
Note that the clip information file zzzzz. clpi and the AV stream file zzzzz. A set of m2ts is called a clip.
Thus, the playlist is a file stored in the PLAYLIST directory.

  Hereinafter, the real playlist file and the virtual playlist file will be described in detail. Both the real playlist and the virtual playlist are composed of data described below.

FIG. 2 is an example of a diagram showing the structure of a playlist file.
Reference numeral 201 denotes a type identifier that stores information indicating a playlist file. For example, it is possible to identify a playlist file by setting a value of “PLAYLIST” in ASCII code.
Reference numeral 202 denotes a version number, which is a number indicating the version of the playlist file.
203 is a play list information start address, and a value indicating the relative start position of the play list information in the play list file in bytes is set. The head starts from 0.
Reference numeral 204 denotes a playlist mark information start address, and a value indicating the relative start position of the playlist mark information in the playlist file in bytes is set. The head starts from 0.
205 is a manufacturer-specific data start address, and a value indicating the relative start position of the manufacturer-specific data information in the playlist file in bytes is set. The head starts from 0. If this value is set to 0, there is no manufacturer-specific data information.
Reference numeral 206 denotes user interface application information having a data structure as shown in FIG.
Reference numeral 207 denotes play list information, which has a data structure as shown in FIG.
208 is play list mark information.
Reference numeral 209 denotes manufacturer-specific data.
Reference numeral 210 denotes 3D stream number information having a data structure as shown in FIG.

FIG. 3 is an example of a diagram illustrating a structure of user interface application information. Stores parameters for the playlist user interface app.
301 is a length, which indicates the length from immediately after this field to the end of the user interface application information.
321 is a 3D flag, and if 1 is set, it indicates that the content included in the playlist includes 3D (stereoscopic) content. If 0 is set, it indicates that 3D content is not included.
Reference numeral 322 denotes a 3D type, which indicates a 3D system of content included in a playlist in combination with the 3D flag 321. First, a case where 1 is set in the 3D flag 321 will be described. At this time, if 00 is set in the 3D type 322, it indicates that the content included in the playlist is a side-by-side format. If 01 is set in the 3D type 322, it indicates that the content included in the playlist is the top-and-bottom method. If 10 is set in the 3D type 322, it indicates that the content included in the playlist is the frame packing method. If 11 is set in the 3D type 322, it indicates that the content included in the playlist is another 3D system. Next, a case where 0 is set in the 3D flag 321 will be described. In this case, regardless of the value set in the 3D type 322, it indicates that 3D content is not included.
Reference numeral 302 denotes a character code that defines the character code used in the channel name 314, the playlist name 316, and the playlist details 318. This also applies to the character code of the mark name in the playlist mark information. For example, 1 is set to Japanese, 16 is set to ASCII code, and 32 is set to Unicode.
Reference numeral 303 denotes a reproduction protection flag. If 1 is set, play list information such as a play list name and thumbnail and a play list are not reproduced and displayed to the user. If authentication by entering the PIN is successful, it will be played. If 0 is set, playback is possible even if the password is not entered.
304 is a recording protection flag. If 1 is set, playlist information other than the recording protection flag must not be changed and deleted. If 0 is set, the user can freely change or delete. If 1 is set, the recording device should reconfirm with the user before the user deletes, edits or overwrites the playlist information. There are cases where a real playlist in which the recording protection flag is set to 0 and a virtual playlist in which the recording protection flag is set to 1 share the same part of the clip. In this case, if the user intends to delete the real playlist, the recording apparatus should reconfirm the user before deleting the real playlist.
305 is a played flag, and if 1 is set, it indicates that this play list has been played at least once. If 0 is set, it indicates that it has never been played.
Reference numeral 306 denotes an edited flag. If 0 is set, the original data at the time of recording is stored without being changed. If 1 is set, a change has been added. It shows that.
A time zone 307 has a data structure as shown in FIG.
Reference numeral 308 denotes a recording date and time, which includes date and time information when the playlist is recorded. Shown in local time. The year, month, day, hour, minute, and second are represented by a 4-bit BCD (Binary Coded Decimal). The first four digits are the four digits of the year.
Reference numeral 309 denotes a playlist length, which indicates the length of the playlist in units of time. This is calculated | required by the sum total of the reproduction time of the play item contained in a play list. The play item playback time is the time from IN time to OUT time. Units are rounded up to the second. Hour, minute, and second are represented by 4 bits and 1 digit BCD.
Reference numeral 310 denotes a manufacturer ID, which indicates the manufacturer of the recording apparatus that last updated the playlist.
Reference numeral 311 denotes a manufacturer model code, which indicates the model number of the recording device that last updated the playlist.
Reference numeral 312 denotes a channel number, which is a broadcast channel number or service number selected by the user when the playlist is recorded. In the case of a playlist in which two or more playlists are combined, this value is representative. Indicates the value of. The value is 999 or less. It is invalid when 0xFFFF is set.
Reference numeral 313 denotes a channel name length, which indicates the byte length of the channel name. The value is 20 or less.
Reference numeral 314 denotes a channel name, which indicates the broadcast channel name or service name selected when the user recorded the playlist. The length from the left end of this field to the byte length indicated by the channel name length 313 is valid.
Reference numeral 315 denotes a playlist name length, which indicates the byte length of the playlist name. The value is 255 or less.
Reference numeral 316 denotes a playlist name including the playlist name. The length from the left end of this field to the byte length indicated by the playlist name length 315 is valid.
Reference numeral 317 denotes a play list detail length, which indicates the byte length of the play list details. It becomes a value of 1200 or less.
Reference numeral 318 denotes playlist details including detailed text information of the playlist. From the left end of this field to the byte length indicated by the play list detailed length 317 is effective.
Reference numeral 323 denotes a 3D synchronization flag, which indicates that when the 3D content is edited by an editing machine capable of editing in 2D, the edited content needs to be reflected in the 3D content management information.

  For example, when the 3D content is a stream encoded by MPEG4-MVC (Multi View Coding) and is composed of two of a base view and a dependent view, the base view stream is 2D. It is compatible with the MPEG4-AVC stream that is a stream. Therefore, in an environment where MPEG4-AVC can be edited, an MPEG4-MVC base view stream can be edited.

  Further, the management information of the stream is managed by being divided into a 2D compatible part and a 3D specific part. In an editing environment corresponding to only 2D, only the 2D compatible part can be edited. In an editing environment that also supports 3D, 2D compatible parts and 3D specific parts can be edited.

FIG. 4 is an example of a schematic diagram showing the structure of the time zone.
401 is padding for alignment.
Reference numeral 402 denotes a daylight saving time flag. When it is set to 0, it indicates standard time, and when it is set to 1, it indicates daylight saving time.
A time zone code 403 indicates a positive number if 0 is set, and a negative number if 1 is set.
Reference numeral 404 denotes a time zone value, which indicates an absolute value of a time difference from UTC (coordinated universal time). The unit is time (= 60 minutes). If 15 is set, the time zone value is invalid, and the daylight saving time flag, time zone code, and 30 minute flag are invalid.
Reference numeral 405 denotes a 30-minute flag. If 1 is set, the time zone value indicates that an additional difference time of 30 minutes is further provided as an absolute value. If 0 is set, the time zone value indicates that there is no additional time.

FIG. 5 is an example of a diagram showing the structure of playlist information.
Reference numeral 501 denotes a length indicating the length from immediately after this field to the end of the playlist information.
Reference numeral 502 denotes a playlist CPI type, which is a type of an access point referred to from an IN time or an OUT time in a play item, and is also an access point type of a mark time stamp in a playlist mark. If 1 is set, it indicates that each access point in the playlist information indicates the display time in the AV stream file, which is called EP_map type playlist information. If 2 is set, it represents the arrival time and is called TU_map type playlist information.
Reference numeral 503 denotes the number of play items, which indicates the number of play items in the play list. The play item ID is an integer starting from 0. Entries of play items in the playlist are sorted in the display order.
Reference numeral 504 denotes the number of sub play items, which indicates the number of sub play items in the play list.
Reference numeral 505 denotes a play item having a data structure as shown in FIG.
Reference numeral 506 denotes a sub play item having a data structure as shown in FIG.

FIG. 6 is an example of a diagram illustrating the structure of a play item.
Reference numeral 601 denotes a length, which indicates the length from immediately after this field to the end of the play item information.
Reference numeral 602 denotes a clip information file name indicating the name of the clip information file of the clip used in the play item information. This field is zzzzzz. A 5-digit number zzzzz of the file name clpi is shown. Expressed as a character string of ACSII code. The clip stream type field in the clip information file indicates a clip AV stream file (MPEG-2 transport stream).
Reference numeral 603 denotes clip CODEC information, and this field has a value indicating “M2TS” of the ASCII code. All play items in the playlist information have the same value of the clip CODEC information “MTS”. If the playlist CPI type in the playlist information is set to 1 and the clip CODEC information is set to “M2TS”, each clip used in the playlist file has EP_map in the CPI information. . If the playlist CPI type in the playlist information is set to 2 and the clip CODEC information is set to “M2TS”, each clip used in the playlist file has TU_map in the CPI information. .
Reference numeral 604 denotes a connection condition, which indicates a connection condition between the IN time of the current play item and the OUT time of the immediately preceding play item. Any value from 1 to 6 is indicated. If the play item is the first play item in the playlist, the connection condition field is invalid and 1 is set.
Reference numeral 605 denotes STC information, which indicates the STC_ID of the STC sequence including the presentation unit of the current play item if the CPI type in the CPI information of the clip information file is EP_map. The clip referred to by the clip information file name of the current play item has the STC sequence. The value of STC_ID is defined in the clip sequence information.
Reference numeral 606 denotes an IN time indicating the IN time of the current play item, that is, the display start time of the current play item. The meaning of the IN time differs depending on the CPI type in the CPI of the clip information file referred to by the clip information file name.
Reference numeral 607 denotes the OUT time, which indicates the OUT time of the current play item, that is, the display end time of the current play item. The meaning of the OUT time differs depending on the CPI type in the CPI of the clip information file referred to by the clip information file name.

In the case of EP_map, the IN time and the OUT time indicate display times based on the STC time of the clip used for the play item. It is measured in units of 45 kHz clock. For example, the presentation unit is represented by the upper 32 bits of a 33-bit PTS with 90 kHz accuracy. Further, the system time discontinuity is not included between the IN time and the OUT time. Further, the OUT time indicates a time earlier than the IN time. However, when wrapping around, the IN time is greater than the OUT time.
In the case of TU_map, it indicates the same TU_time_base time as the ATC sequence of the clip referenced by the clip information file name of the play item. Furthermore, IN time and OUT time are measured with a 45 kHz clock. Furthermore, the OUT time is greater than the IN time.
Reference numeral 608 denotes bridge sequence information, which will be described in detail with reference to FIG.

FIG. 7 is an example of a diagram illustrating the structure of the bridge sequence information.
A bridge sequence information file name 701 indicates the name of the clip information file of the bridge clip used in the bridge sequence information. This field includes a 5-digit numerical value (corresponding to the file name zzzzz) described in ASCII code. The clip stream type in the clip information of the clip information file is a bridge clip AV stream (MPEG-2 transport stream).
Reference numeral 702 denotes clip CODEC information having an ASCII code value “M2TS” and indicating that the playlist file uses the MPEG-2 transport stream. The bridge clip used in the bridge sequence information has EP_map in CPI.
Reference numeral 621 denotes multi-angle information indicating that multi-angle entry information is included. The multi-angle entry information includes the number of angles, the clip file name of each angle, clip CODEC information, and STC information.
Reference numeral 622 denotes user operation suppression information, which includes information indicating restrictions on user operations during reproduction of the play item. User operations include chapter search, time search, fast forward, rewind, stop, pause, pause release, cursor movement, menu display, button selection, voice selection, angle selection, subtitle display, and the like.
Reference numeral 623 denotes a random access flag, which indicates that playback from the middle of the play item is prohibited during special playback.
Reference numeral 624 denotes still image information, which indicates that the last video is held in a state where the still image is displayed at the end of play item reproduction.
Reference numeral 625 denotes stream number information, which will be described in detail with reference to FIG.

FIG. 35 is an example of a diagram showing the structure of stream number information.
The stream number information is information indicating the stream number of the elementary stream included in the play item. The elementary stream includes a main video stream, a main audio stream, a subtitle stream, a menu stream, a sub video stream, and a sub audio stream.
Reference numeral 3501 denotes a length indicating the length of the stream number information.
Reference numeral 3502 denotes the number of main image information, which indicates the number of main image information included in the stream number information.
Reference numeral 3503 denotes the number of main audio information, which indicates the number of main audio information included in the stream number information.
Reference numeral 3504 denotes the number of text subtitle information, which indicates the number of text subtitle information included in the stream number information.
Reference numeral 3505 denotes the number of menu graphic information, which indicates the number of menu graphic information included in the stream number information.
Reference numeral 3506 denotes the number of sub-image information, which indicates the number of sub-image information included in the stream number information.
Reference numeral 3507 denotes the number of sub audio information, which indicates the number of sub audio information included in the stream number information.
Reference numeral 3508 denotes the number of two-screen information, which indicates the number of two-screen information included in the stream number information.
Reference numeral 3509 denotes main image information, which has as many main image stream entries and attributes as the number of main image information 3502.
Reference numeral 3510 denotes main audio information, which has as many main audio stream entries and attributes as the number of main audio information 3503.
Reference numeral 3511 denotes text subtitle information, which has as many text subtitle stream entries and attributes as the number of text subtitle information 3504.
Reference numeral 3512 denotes menu graphic information which has as many menu graphic stream entries and attributes as the number of menu graphic information 3505.
Reference numeral 3513 denotes sub-image information, which has as many sub-image stream entries and attributes as the number of sub-image information 3506.
Reference numeral 3514 denotes sub audio information, which has as many sub audio stream entries and attributes as the number of sub audio information 3507.
Reference numeral 3515 denotes two-screen information, which has the same number of entries and attributes as the two-screen information 3508.
The entry includes information such as PID. The attribute includes information such as a video format, an audio format, a frame rate, a sampling rate, and a language.

FIG. 36 is an example of a diagram illustrating a structure of 3D stream number information.
3601 is a length and indicates the length of the 3D stream number information.
3602 is a 3D time stamp and indicates the latest time when the 3D stream number information is updated.
3603 is 2D stream number information, and is stream number information having the structure shown in FIG. When first recorded, a copy of the stream number information 625 is recorded.
Reference numeral 3604 denotes main image 3D information, which is information related to the main image 3D stream that becomes a 3D stream in combination with the main image stream indicated by the main image information 3509. Have the number shown in.
3605 is text subtitle 3D information, which is information about a text subtitle 3D stream that becomes a 3D stream in combination with the text subtitle stream indicated by the text subtitle information 3511. Have the number shown in.
Reference numeral 3606 denotes menu graphic 3D information, which is information related to the menu graphic 3D stream that becomes a 3D stream in combination with the menu graphic stream indicated by the menu graphic information 3512. Have the number shown in.
Reference numeral 3607 denotes sub-image 3D information, which is information related to the sub-image 3D stream that becomes a 3D stream in combination with the sub-image stream indicated by the sub-image information 3513. Have the number shown in.
Reference numeral 3608 denotes two-screen 3D information, which is information regarding a two-screen 3D stream that becomes a 3D stream in combination with the two-screen stream indicated by the two-screen information 3515. Have the number shown in.

FIG. 8 is an example of a diagram showing the structure of a sub play item.
Reference numeral 801 denotes a length, which is a byte length from immediately after this field to the end of the sub play item.
Reference numeral 802 denotes a clip information file name, which indicates the name of the clip information file of the clip used in the sub play item. This field has a 5-digit number corresponding to zzzzz of the clip name as an ASCII code. The clip stream type in the clip information of the clip information file indicates “clip AV stream (MPEG-2 transport stream)”.
Reference numeral 803 denotes clip CODEC information, which has a value of “M2TS” as an ASCII code and indicates that an MPEG-2 transport stream is used in a playlist file. The clip used in the sub play item has EP_map in the CPI.
Reference numeral 804 denotes a sub play item type, which indicates the type of sub path used in the sub play item, but only a value of 1 is set. A clip AV stream of an after-recording audio stream is used.
Reference numeral 805 denotes an STC_ID, which indicates an STC_ID corresponding to the STC sequence of the clip indicated by the clip information file name referenced by the sub play item. Both the sub play item IN time and the sub play item OUT time of the sub play item indicate a presentation unit in the same STC sequence referenced by the STC_ID.
Reference numeral 806 denotes a sub play item IN time, which has a display start time of the sub play item. The sub play item IN time is a display time measured with 45 kHz accuracy from the STC of the clip used in the sub play item.
Reference numeral 807 denotes a sub play item OUT time, a sub play item OUT time, and a display end time of the sub play item. The sub play item OUT time is a display time measured with an accuracy of 45 kHz from the STC of the clip used in the sub play item. The sub play item OUT time indicates a time earlier than the sub play item IN time, and when the STC wraps around between the sub play item IN time and the sub play item OUT time, the sub play item IN time is the sub play item IN time. It becomes larger than OUT time. Both the sub play item IN time and the sub play item OUT time indicate the display time of the section between the display start time and the display end time corresponding to the STC sequence referenced by the STC_ID of the sub play item.
Reference numeral 808 denotes a synchronous play item ID, which indicates the play item ID of the play item in the playlist. This play item includes a sub play item, and the sub play item is one whose reproduction starts within the reproduction time of the play item. The play item ID is determined by a play list in the play list.
Reference numeral 809 denotes a synchronous play item start PTS, which indicates a display time in the play item pointed to by the synchronous play item ID. The sub play item starts its own display when the display time of the play item reaches the synchronous play item start PTS. The synchronized play item start PTS is a display time measured with a 45 kHz clock of the play item pointed to by the synchronized play item ID.

FIG. 34 is an example of a schematic diagram of a directory structure and a file structure showing another implementation method of the present invention.
Reference numeral 3401 denotes a root directory, which includes a BDMV directory 3402. Reference numeral 3402 denotes a BDMV directory, which includes a PLAYLIST directory 3421, a CLIPINF directory 3422, a STREAM directory 3423, and an AUXDATA 3431.
The PLAYLIST directory 3421 includes playlists 3441, 3442, 3443.

The CLIPINF directory 3422 includes clip information files 3444 and 3445.
The STREAM directory 3423 includes stream files 3444 and 3445 and an SSIF directory 3450, and the SSIF directory 3450 includes a stream file interleaved for 3D content such as the SSIF file 3451.

AUXDATA 3431 is a directory for storing font files and the like.
index. The bdmv file 3411 is a file storing overall information.
The MovieObject file 3412 is a file that stores title objects.
00001. The mpls file 3441 includes information on a playlist. 00002. mpls files 3442, 00003. The mpls file 3443 is a similar file.
01000. The clpi file 3444 is a clip information file and includes clip information related to the AV stream file. 02000. The clpi file 3445 is a similar file.
01000. The m2ts file 3446 is an AV stream file and includes an MPEG-2 transport stream. 02000. The m2ts file 3447 is a similar file.
In the case where these AV streams are, for example, streams encoded by the above-described MPEG4-MVC as 3D content, 01000. m2ts file 3446 is a base view stream, 02000. The m2ts file 3447 corresponds to the dependent view stream. The MPEG4-MVC stream is an interleaved format, 01000. It is specified as a sif file 3451.

  FIG. 41 is a diagram schematically showing the relationship between the AV stream file and the SSIF file. AV stream files 4101 and 4102 correspond to the above 3446 and 3447, and SSIF file 4103 corresponds to the above 3451. 01000. base view stream. The m2ts file 4101 is arranged on a recording medium as a series of data indicated by extents B [0] to B [n] as a continuous recording area (extent). Similarly, the dependent view stream 02000. The m2ts file 4102 is arranged as data of a series indicated by extents D [0] to D [n]. 01000. The sif file 4103 is an interleaved format of these extents and can be specified as an MPEG4-MVC stream. Since the base view stream is compatible with the MPEG4-AVC stream, 01000. By configuring so as to read the m2ts file 4101, it is possible to reproduce even a device having only a 2D reproduction function.

Clip information file zzzzz. clpi and the AV stream file zzzzz. The file name “zzzzz” of m2ts is a 5-digit integer, and the same 5-digit integer is assigned to the associated clip information file and AV stream file.
Note that the clip information file zzzzz. clpi and the AV stream file zzzzz. A set of m2ts is called a clip.
Also, zzzzz. The file name “zzzzz” of the ssif file is the AV stream file zzzz. The same 5-digit integer as m2ts is assigned.

FIG. 42 is a diagram showing another example of the structure of the playlist file.
Reference numeral 4201 denotes a type identifier, which stores information indicating a playlist file. For example, it is possible to identify a playlist file by setting a value of “MPLS” in ASCII code.
Reference numeral 4202 denotes a version number, which is a number indicating the version of the playlist file.
4203 is a play list information start address, and a value indicating the relative start position of the play list information in the play list file in bytes is set. The head starts from 0.
4204 is a playlist mark information start address, and a value indicating the relative start position of the playlist mark information in the playlist file in bytes is set. The head starts from 0.
Reference numeral 4205 denotes a 3D subpath information start address, and a value indicating the relative start position of the 3D subpath information in the playlist file in bytes is set. The head starts from 0. If this value is set to 0, there is no 3D subpath information.
Reference numeral 4206 denotes application information, which corresponds to the user interface application information 206 described above.
Reference numeral 4207 denotes play list information, which has a data structure as shown in FIG.
Reference numeral 4208 denotes playlist mark information.
4209 is 3D sub-path information, and the structure will be described later.

FIG. 43 is a diagram showing another example of the structure of playlist information.
Reference numeral 4301 denotes a length, which indicates the length from immediately after this field to the end of the playlist information.
Reference numeral 4302 denotes the number of play items, which indicates the number of play items in the play list. The play item ID is an integer starting from 0. Entries of play items in the playlist are sorted in the display order.
Reference numeral 4303 denotes the number of sub-passes, which indicates the number of sub-passes in the playlist.
Reference numeral 4304 denotes a play item, which corresponds to 505 described above.
Reference numeral 4305 denotes a sub path having a data structure as shown in FIG.

FIG. 44 is a diagram illustrating an example of a subpath structure. The aforementioned 3D subpath information 4209 can have a plurality of similar subpath structures.
4401 is a length, which indicates the length from immediately after this field to the end of the subpath.
Reference numeral 4402 denotes a sub-path type, which indicates a sub-path type in which the above-mentioned play item is used as a main path and playback is performed in parallel therewith. This value indicates what the contents of the sub path are, for example, whether it is a secondary video for Picture in Picture or a video of a dependent view for 3D playback. At the same time, whether the sub path is reproduced in synchronization with the main path or reproduced asynchronously is also shown.
Reference numeral 4403 denotes a repeat flag, which indicates whether or not to reproduce the subpath repeatedly.
Reference numeral 4404 denotes the number of sub play items, which indicates the number of sub play items in the sub path.
Reference numeral 4405 denotes a sub play item, which corresponds to the above-described 506.

The structure of the main path and sub path in the playlist will be described with reference to FIG.
FIG. 45 is an example of a case where the playback order of 3D content is shown. A base view stream clip is designated as a play item as a main path, and a sub-path type 4402 is a video by a dependent view stream. This shows a case where a dependent view stream clip is specified as a sub path.
The playback content of the main path is indicated by, for example, play item [0] to play item [2]. In this case, the reproduction content of the sub path is indicated by sub play item [0] to sub play item [2]. As 3D content, play item [n] and sub play item [n] have a one-to-one correspondence, and as described in the description of FIGS. 7 and 8, sub play item IN time 806 and sub play item OUT time 807 Indicates the same playback period in synchronization with the IN time 606 and OUT time 607 of the play item.
In the device having only the 2D playback function, the sub path in this case is ignored, and only the play item based on the base view stream of the main path is played back.

Next, the recording operation will be described with reference to FIGS.
FIG. 9 is an example of a diagram illustrating the structure of an MPEG-2 transport stream.
The AV stream file has an MPEG-2 transport stream structure. The MPEG-2 transport stream includes a natural number of aligned units 901. The aligned unit 901 has a size of 6144 bytes (= 2048 × 3 bytes). The aligned unit 901 starts from the first byte of the source packet 902. The length of the source packet 902 is 192 bytes. One source packet includes a TP extra header 903 and a transport packet 904. The length of the TP extra header 903 is four times, and the length of the transport packet 904 is 188 bytes. One aligned unit 901 is composed of 32 source packets 902. The last aligned unit 901 in the MPEG-2 transport stream is composed of 32 source packets 902. Therefore, the MPEG-2 transport stream is terminated at the end of the aligned unit 901. If the last aligned unit 901 is not filled with the input transport stream, the remaining bytes are filled with the transport packet with PID = 0x1FFF, that is, the source packet of the null packet.
The transport packet 904 is defined by ISO / IEC 13818-1.
The TP extra header 903 includes copy permission information 905 and an arrival time stamp 906. The copy permission information 905 includes content protection information of the related transport packet 904. The arrival time stamp 906 is set with an arrival time stamp value to be described later.

FIG. 10 is an example of a schematic diagram of a recording apparatus showing an embodiment of the present invention.
Reference numeral 1001 denotes an antenna which inputs a digital broadcast wave.
Reference numeral 1002 denotes a tuner that receives a digital broadcast wave input from the antenna 1001.
Reference numeral 1003 denotes a DEMUX that separates a digital broadcast wave (full TS (Transport Stream)) received by the tuner 1002 into elementary streams as necessary.
A data selector 1004 selects a necessary stream from the elementary streams separated by the DEMUX 1003 as necessary.
Reference numeral 1005 denotes a REMUX, which multiplexes the stream sent from the data selector into the MPEG-2 transport stream again as necessary to make a partial TS (Transport Stream).
A transcoder 1006 converts the format of the TS audio stream or video stream input from the REMUX 1005 as necessary.
Reference numeral 1011 denotes a video input for inputting an analog video signal.
Reference numeral 1012 denotes A / D conversion, which converts analog data input from the video input 1011 into digital data.
Reference numeral 1021 denotes an audio input for inputting an analog audio signal.
Reference numeral 1022 denotes A / D conversion, which converts analog data input from the audio input 1021 into digital data.
Reference numeral 1013 denotes an encoder which encodes the video data and audio data digitized by the A / D conversions 1012 and 1022 into an MPEG-2 transport stream.
Reference numeral 1014 denotes a selector which switches and inputs a stream sent from the transcoder 1006 or the encoder 1013.
Reference numeral 1032 denotes a PLL, which has a frequency of 27 MHz, and is synchronized with a PCR (Program Clock Reference) of the input MPEG-2 transport stream.
Reference numeral 1033 denotes a counter, which is a binary counter that counts pulse signals having a frequency of 27 MHz. The count value i at time i is passed to the packetizer 1034 as arrival time clock (i).
Reference numeral 1034 denotes a packetizer, which adds a TP extra header to all transport packets and generates a source packet stream and an aligned unit. The generated source packet stream is transferred to the write buffer 1035 at the maximum transfer rate RMAX. The packetizer 1034 has a small buffer inside and averages the bit rate of the stream. Although the peak rate of digital broadcasting may exceed RMAX, the transfer rate to the write buffer 1035 is guaranteed to be RMAX or less by an internal buffer.

The arrival time stamp is the time when the first byte of the source packet arrives at the packetizer 1034. The arrival time stamp (k) is a sample value of the arrival time clock (k). (See the formula below)

Arrival time stamp (k) = Arrival time clock (k)% (2 to the 30th power)

The maximum difference between the arrival time stamps of two consecutive packets is (2 to the 30th power minus 1) / 27000000 seconds (= approximately 40 seconds).
When the difference exceeds this value, the arrival time stamp is changed so as to be the maximum value. The recording apparatus needs to assume such a case. When an MPEG-2 transport stream player, which will be described later, outputs a transport stream according to arrival time stamps, the PCR accuracy of the output transport stream is defined by ISO / IEC13818-9.

  A buffer 1035 is a write buffer for writing the source packet transferred from the packetizer 1034 to the drive 1036.

The TS recording rate defined in the clip information of the AV stream file determines the value of RMAX. This RMAX is calculated as follows.

RMAX = TS recording rate x 192/188

The unit of TS recording rate is byte / second.
When the maximum recording rate RUD of the drive and the buffer 1035 is not empty, the recording rate to the drive 1036 is RUD, and when the buffer 1035 is a shell, the recording rate to the drive 1036 is zero. Buffer 1035 does not overflow.

Reference numeral 1036 denotes a drive which writes a stream input from the write buffer 1035 to a recording medium such as an optical disk at the maximum recording rate RUD.
A CPU 1041 controls recording of the entire recording apparatus. Each block in the recording apparatus is connected to the CPU bus indicated by a broken line, and exchanges and controls data.
A memory 1042 is used as a work memory for the CPU 1041, a buffer for the encoder, and the like.
For example, when recording 3D content in the MPEG4-MVC format, it is possible to record while determining the file structure in the form of configuring the SSIF directory described above according to the packet ID.

Next, an operation during reproduction will be described with reference to FIG.
FIG. 11 is an example of a schematic diagram of a playback apparatus showing an embodiment of the present invention.
Reference numeral 1101 denotes a drive that reads an MPEG-2 transport stream from a recording medium such as an optical disk and transfers it to the buffer 1102.
A buffer 1102 buffers the MPEG-2 transport stream read from the drive 1101.
Reference numeral 1103 denotes a depacketizer that separates the MPEG-2 transport stream input from the buffer 1102 into a TP extra header and a transport packet, and synchronizes the arrival time stamp with the arrival time clock input from the counter 1104. The transport packet is output. First, the initial value of the arrival time clock is passed to the counter 1104.
Reference numeral 1104 denotes a counter which starts from the initial value received from the depacketizer 1103, counts a 27 MHz pulse signal from the X-tal 1105, and passes an arrival time clock to the depacketizer 1103.
Reference numeral 1105 denotes an X-tal, which generates a 27 MHz pulse signal.
Reference numeral 1111 denotes a selector which switches the transport packet input from the depacketizer 1103 for each type and passes it to the corresponding decoder.
Reference numeral 1121 denotes an audio decoder, which decodes the audio packet input from the selector 1111 and passes it to the mixer 1122.
Reference numeral 1122 denotes a mixer, which performs mixing such as volume setting of multi-channel audio at a designated rate as necessary.
Reference numeral 1131 denotes a video decoder, which decodes the video packet input from the selector 1111 and passes it to the video plane 1132.
Reference numeral 1132 denotes a video plane, which is a plane buffer for expanding and displaying the picture data decoded by the video decoder 1131.
When playing back 3D content, the video plane 1132 is configured to have two sheets for the right eye and the left eye, and the video packets distributed by the selector are passed to the respective video planes for the left eye and the right eye. For example, in the case of 3D content in the MPEG4-AVC format, the video packet of the base view stream is passed to the video plane for the left eye, and the video packet of the dependent view stream is input to the video plane for the right eye.
Reference numeral 1141 denotes a graphic decoder, which decodes the graphic packet input from the selector 1111 and passes it to the graphic plane 1142.
Reference numeral 1142 denotes a graphic plane, which is a plane buffer for developing graphic data input from the graphic decoder 1141.
Reference numeral 1143 denotes a CLUT (Color Look Up Table) which refers to RGB data and alpha blend data corresponding to each pixel of the graphic plane 1142.
Reference numeral 1151 denotes an output unit that multiplexes input audio / video / graphic data and outputs the multiplexed audio / video / graphic data from the playback apparatus to the outside in an analog format such as YCbCr or a digital format such as HDMI.
Reference numeral 1161 denotes a CPU, which controls playback control of the entire playback device. Each block in the recording apparatus is connected to the CPU bus indicated by a broken line, and exchanges and controls data.
Reference numeral 1162 denotes a memory, which is used as a work memory of the CPU 1161 and a decoder buffer.

FIG. 12 is an example of a schematic diagram of a real playlist and a virtual playlist showing one implementation method of the present invention.
Reference numeral 1201 denotes a first real play list which refers to the play item 1211.
1202 is the second real play list, which refers to the play item 1212 and the play item 1213.
Reference numeral 1211 denotes a first play item that refers to the clip 1203.
Reference numeral 1212 denotes a second play item that refers to the clip 1204.
Reference numeral 1213 denotes a third play item, which refers to the clip 1205.
Reference numeral 1203 denotes a first clip.
Reference numeral 1204 denotes a second clip.
1205 is a third clip.
Reference numeral 1231 denotes a fourth play item, which refers to a part of the clip 1203.
Reference numeral 1232 denotes a fifth play item that refers to a part of the clip 1204.
Reference numeral 1233 denotes a sixth play item that refers to a part of the clip 1204 and a part of the bridge clip 1208.
Reference numeral 1234 denotes a seventh play item, which refers to a part of the bridge clip 1208 and a part of the clip 1205.
Reference numeral 1206 denotes a first virtual play list, which refers to the play item 1231 and the play item 1232.
Reference numeral 1207 denotes a second virtual play list, which refers to the play item 1233 and the play item 1234.
Reference numeral 1208 denotes a first bridge clip, which is re-encoded from the data at the end of the clip 1204 and the data at the top of the clip 1205.

The playlist will be described.
The playlist is for allowing the user to easily edit the playback time of the clip to be played back. For example, cut and paste editing can be performed without moving, copying, or deleting a clip file entity (including partial movement, partial copying, and partial deletion). A playlist is a collection of a series of playback sections in a clip called play items, and a play item is represented by a set of in and out points. The IN point and OUT point are time information indicating the position of the clip on the time axis. Therefore, it can be said that the playlist is a collection of play items. The In point means the playback start position of the playback section, and the Out point means the playback end position of the playback section. There are two types of playlists: real playlists and virtual playlists.

The real playlist will be described.
The real play list is used for the clip AV stream file and is not used for the bridge clip AV stream file. The real playlist refers to a certain part of the clip.
By referring to the real playlist, the data space on the disc is consumed by the size of the reference clip (a part thereof), and when the real playlist is deleted, the reference clip (a part thereof) is deleted. .

The virtual playlist will be described.
The real play list is used for both the clip AV stream file and the bridge clip AV stream file. A virtual playlist has no data entity when used in a clip AV stream file, but has a data entity when used in a bridge clip AV stream file. When a virtual playlist that does not use the bridge clip AV stream file is deleted, the clip does not change.
On the other hand, if a virtual playlist that uses a bridge clip AV stream file is deleted, the clip AV stream file and its associated clip information file do not change, but the bridge clip AV stream file and its associated clip information file Is deleted.
The clip is a management unit for performing internal control of the playback apparatus or recording apparatus, and is not displayed on the user interface. Only the playlist is shown to the user.

The following playlist operations are available.
The following are examples of operations related to the real playlist.
(1) Generation of Real Playlist The real playlist generated when the first broadcasted program is recorded is a real playlist that refers to the entire recorded clip.
FIG. 13 is an example of a diagram illustrating an example of generating a real play list.
A real play list 1301 refers to the play item 1311. At the time of new recording, it is generated as one playlist file.
Reference numeral 1311 denotes a play item, which refers to the clip 1303.
Reference numeral 1303 denotes a clip, which is generated as one clip information file and one AV stream file at the time of new recording.

(2) Splitting a real playlist When a single real playlist is split into two real playlists, the clips themselves do not change.
FIG. 14 and FIG. 15 are examples of diagrams showing an example of real play list division.
A real play list 1401 refers to the clip 1403 via a play item (not shown).
Reference numeral 1403 denotes a clip.
Reference numeral 1421 denotes a division point, which shows an example in which the vicinity of the center of the real play list 1401 is divided.
Reference numeral 1511 denotes a real play list, which refers to a part of the clip 1503 (a part corresponding to the left of the dividing point 1521) via a play item (not shown).
Reference numeral 1503 denotes a clip, which is the same as the clip 1403.
A real play list 1512 refers to a part of the clip 1503 (a part corresponding to the right side of the dividing point 1521) via a play item (not shown).

(3) Concatenation of real playlists When two real playlists are concatenated into a new real playlist, the clips themselves do not change.
FIG. 16 and FIG. 17 are examples of diagrams showing an example of real playlist connection.
Reference numeral 1611 denotes a real play list which refers to a clip 1601 via a play item (not shown).
Reference numeral 1601 denotes a clip.
A real play list 1612 refers to the clip 1602 via a play item (not shown).
Reference numeral 1602 denotes a clip.
Reference numeral 1701 denotes a clip, which is the same as the clip 1601.
Reference numeral 1702 denotes a clip, which is the same as the clip 1602.
Reference numeral 1721 denotes a real play list, which refers to a clip 1701 and a clip 1702 via a play item (not shown).

(4) Deleting the entire real playlist When deleting an entire real playlist, the referenced range of the reference destination clip is deleted.
FIG. 18 is an example of a diagram illustrating an example of deleting a real play list.
A real play list 1801 refers to a clip 1803 via a play item (not shown).
Reference numeral 1803 denotes a clip.

(5) Deleting a part of a real playlist When deleting a part of a clip referenced by a real playlist, change the play item to leave the necessary part, but the part that is no longer referenced in the clip Deleted.

19 and 20 are examples of diagrams showing an example of partial deletion of the top part of the real play list.
Reference numeral 1901 denotes a real play list which refers to the play item 1911.
Reference numeral 1911 denotes a play item, which refers to the clip 1903.
Reference numeral 1903 denotes a clip.
A real play list 2021 refers to the play item 2031.
Reference numeral 2041 denotes a deletion range, and shows an example in which a part corresponding to the left side of the real play list 1901 is partially deleted.
Reference numeral 2031 denotes a play item, which refers to the clip 2023.
Reference numeral 2023 denotes a clip.
When the intermediate part of the clip AV stream is edited and deleted, the remaining part is linked to one clip file.

21 and 22 are examples of diagrams showing an example of partial deletion of the intermediate part of the real play list.
Reference numeral 2101 denotes a real play list, which refers to the clip 2121 via a play item (not shown).
Reference numeral 2121 denotes a clip.
Reference numeral 2141 denotes a deletion range, which shows an example in which a part corresponding to the intermediate area of the real play list 2101 is partially deleted (= deletion by deletion).
Reference numeral 2211 denotes a real play list, which refers to the clip 2231 via a play item (not shown).
Reference numeral 2231 denotes a clip.

The followings are related to the operation of the virtual playlist.
(1) Assemble Edit As shown in FIGS. 23 to 26, a play item that the user wants to reproduce can be generated and linked to another play item using a virtual play list.
By generating a bridge clip file, it is possible to realize smooth connection playback at a connection point. In order to seamlessly connect and play back MPEG video streams, it is a common practice to re-encode a very small number of pictures near the connection point to form bridge clips.
This process eliminates the need to change the original clip AV stream file and its clip information file.

FIG. 23 and FIG. 24 are examples of diagrams showing an example of assemble editing (non-seamless connection of two play items).
A real play list 2301 refers to the clip 2303 via a play item (not shown).
Reference numeral 2303 denotes a clip.
2302 is a real play list, and refers to the clip 2304 via a play item (not shown).
Reference numeral 2304 denotes a clip.
Reference numeral 2341 denotes an IN point, which is the IN time of the play item 2431 registered in the virtual play list.
Reference numeral 2342 denotes an OUT point, which is the OUT time of the play item 2431 registered in the virtual play list.
Reference numeral 2343 denotes an IN point, which is the IN time of the play item 2432 registered in the virtual play list.
Reference numeral 2344 denotes an OUT point, which is the OUT time of the play item 2432 registered in the virtual play list.
Reference numeral 2406 denotes a virtual play list, which refers to the play item 2431 and the play item 2432.
Reference numeral 2431 denotes a play item, which refers to a part of the real play list 2401.
Reference numeral 2432 denotes a play item, which refers to a part of the real play list 2402.
Reference numeral 2403 denotes a clip, which is the same as the clip 2303.
Reference numeral 2404 denotes a clip, which is the same as the clip 2304.

25 and 26 are examples of diagrams showing an example of assembly editing (seamless connection of two play items).
A real play list 2501 refers to a clip 2503 via a play item (not shown).
Reference numeral 2503 denotes a clip.
A real play list 2502 refers to a clip 2504 via a play item (not shown).
Reference numeral 2504 denotes a clip.
Reference numeral 2541 denotes an IN point, which is the IN time of the play item 2631 registered in the virtual play list.
Reference numeral 2542 denotes an OUT point, which is the OUT time of the play item 2631 registered in the virtual play list.
Reference numeral 2543 denotes an IN point, which is the IN time of the play item 2632 to be registered in the virtual play list.
Reference numeral 2544 denotes an OUT point, which is the OUT time of the play item 2632 to be registered in the virtual play list.
Reference numeral 2606 denotes a virtual play list, which refers to the play item 2631 and the play item 2632.
Reference numeral 2631 denotes a play item, which refers to a part of the real play list 2601.
Reference numeral 2632 denotes a play item, which refers to a part of the real play list 2602.
Reference numeral 2603 denotes a clip, which is the same as the clip 2503.
Reference numeral 2604 denotes a clip, which is the same as the clip 2504.
Reference numeral 2605 denotes a bridge clip. By generating the bridge clip, it is possible to realize smooth connection reproduction at the connection point.

(2) Re-editing the virtual playlist By adding or inserting a play item to the virtual playlist, or deleting a play item in the virtual playlist, the IN point of the play item in the virtual playlist, or An editing method of changing the OUT point can be considered.
When the IN point and OUT point referring to the bridge clip are changed by the user operation, the recording device warns the user that the existing bridge clip is deleted and a new bridge clip needs to be generated. A process of executing such a process after confirmation of the user is conceivable.

(3) Deleting a virtual playlist Deleting an entire virtual playlist
(4) Post-record editing with a virtual playlist It is possible to record additional audio (= post-recording) for a virtual playlist. The added audio can be added as a sub path.

The following operations are common to the virtual playlist and the real playlist.
(1) Changing the playlist playback order This is realized by changing the playlist table that defines the playlist playback order. This operation does not change the clip itself.

Next, the operation in the recording / reproducing apparatus will be described.
FIG. 27 is an example of a hardware configuration diagram illustrating a configuration example of the recording / reproducing apparatus.
2704 is a recording / reproducing device, 2703 is an antenna that receives a broadcast signal transmitted from a transmitting device via a broadcast transmission network such as a radio (satellite, ground), cable, etc., 2721 is a CPU (Central Processing) that controls the entire recording / reproducing device. Unit), 2722 is a general-purpose bus for transmitting control and information between the CPU 2721 and each part in the recording / reproducing apparatus, and 2723 is a broadcast transmitted from the transmission apparatus via a broadcast transmission network such as radio (satellite, ground), cable, etc. A tuner that receives a signal, selects a specific frequency, performs demodulation, error correction processing, and the like, and outputs a multiplexed packet such as an MPEG2-Transport Stream (hereinafter also referred to as “TS”), 2724 is a tuner 2723 A descrambler 2725 for decoding the scramble of the broadcast signal input from the network terminal 2756 is connected to a network external to the device. A network interface (I / F) 2726 for transmitting / receiving information to / from the network 2755 and transmitting / receiving various information and MPEG2-TS between the Internet and the recording / reproducing apparatus, is a main component such as a removable HDD, a disk-type recording medium, a flash memory, etc. A recording medium 2750 is, for example, an HDD (Hard Disk Drive) or flash memory built in the recording / reproducing apparatus, or a secondary recording medium such as a removable HDD, a disk-type recording medium, or a flash memory, 2727 is a main recording medium 2726 and A recording / reproducing unit that controls the sub-recording medium 2750 and controls data recording on the main recording medium 2726 and sub-recording medium 2750 and data reproduction from the main recording medium 2726 and sub-recording medium 2750, 2729 is MPEG2-TS, etc. Data multiplexed in the format A demultiplexing unit that separates data such as video ES (Elementary Stream), audio ES, program information, subtitle information, graphic data, or multiplexes data such as video ES and audio ES into a format such as MPEG2-TS. is there. An ES is each of compressed and encoded image / sound data.

  A video decoding conversion unit 2730 decodes the video ES into video data or converts the video ES into a video ES of another format. 2731 decodes the audio ES into audio data and outputs it from the audio output 2742, or the audio ES. The audio decoding conversion unit 2732 converts the video data decoded by the video decoding unit 2730 into 2D according to the instruction of the CPU. Conversion processing for converting 2D video data to 3D, processing for superimposing a display such as 2D or 3D OSD (On Screen Display) created by the CPU 2721 on the video data, or predetermined processing such as HDMI The video data after processing is output to the video signal output unit 2741, and the video data after processing is converted. A video conversion processing unit 2733 that outputs a synchronization signal and a control signal (used for device control) corresponding to the mat from the video signal output unit 2741 and the control signal output unit 2743, and an operation input (for example, IR ( Infrared Radiation) signal is received from a remote controller, and a device control signal (for example, IR) generated by the CPU 2721 and the video conversion processing unit 2732 is transmitted from the device control signal transmission unit 2744. A control signal transmission / reception unit, 2734 has a counter inside, a timer for holding the current time, 2746 is a digital input / output terminal that performs necessary processing such as encryption on the TS reconfigured by the demultiplexing unit TS output from 2757 to the outside, or received from the outside via the digital input / output terminal 2757 A high-speed digital I / F such as a serial interface or an IP interface that decodes TS and inputs it to the demultiplexing unit 2729 is shown. The recording / reproducing apparatus is mainly configured by these devices.

FIG. 28 is an example of a hardware configuration diagram illustrating a detailed configuration example of the recording / reproducing unit 2727 in FIG. 27 in the recording / reproducing apparatus.
Reference numeral 2827 denotes the recording / reproducing unit 2727 in FIG.
Reference numeral 2821 denotes the CPU 2721 in FIG.
Reference numeral 2811 denotes the demultiplexing unit 2711 in FIG.
Reference numeral 2825 denotes a network I / F 2725 in FIG.
Reference numeral 2826 denotes the main recording medium 2726 in FIG.
Reference numeral 2850 denotes the secondary recording medium 2750 in FIG.
Reference numeral 2860 denotes a PLL having a frequency of 27 MHz and is synchronized with MPEG-2TS PCR (Program Clock Reference) input from the demultiplexing unit 2829.
An encryption unit 2861 performs encryption such as Advanced Encryption System (AES) on the MPEG-2TS input from the demultiplexing unit 2829.
Reference numeral 2862 denotes a counter that counts a 27 MHz pulse signal input from the PLL.
2863 divides the MPEG2-TS input from the encryption unit 2861 into fixed-length data, adds a header including an arrival time stamp generated based on the count value input from the counter 2862, and has a fixed length. It is a packetizer that outputs as a packet.
Reference numeral 2864 denotes a write buffer that temporarily stores packets input from the packetizer 2863. Further, it is a write buffer that temporarily stores data downloaded from the network via the network I / F 2825. Furthermore, it is also a read buffer that temporarily stores reproduction data input from the storage I / F 2865.
Reference numeral 2865 denotes a storage I / F, which transfers data to the main recording medium 2826 and the sub recording medium 2850 via the buffer 2865. A data bus such as a SATA (Serial ATA) bus is connected to the main recording medium 2826 and the sub recording medium 2850, and data is transferred using the SATA protocol or the like.
Reference numerals 2866 and 2868 denote depacketizers that separate the MPEG-2 transport stream input from the buffer 2864 into TP extra headers and transport packets, and synchronize the arrival time stamp with the arrival time clock input from the counter 2872. And output a transport packet.
Reference numerals 2867 and 2869 denote decryption units which decrypt the encrypted transport packet.
Reference numeral 2870 denotes X-tal, which generates a 27 MHz pulse signal.
Reference numerals 2871 and 2872 denote counters which start from the initial values received from the depacketizers 2866 and 2868, count the 27 MHz pulse signal from the X-tal 2870, and pass the arrival time clock to the depacketizers 2866 and 2868.
Although not shown in FIG. 28, data input / output to / from the high-speed digital I / F 2746 in FIG. 27 is similar to the network I / F 2825, and digital data input from the high-speed digital I / F 2746 is buffered 2864. The digital data recorded on the main recording medium 2826 and the sub-recording medium 2850 and reproduced from the main recording medium 2826 and the sub-recording medium 2850 are temporarily stored in the buffer 2864, and the high-speed digital I Output from / F2746.

FIG. 29 is an example of a hardware configuration diagram illustrating a detailed configuration example of the video decoding conversion unit 2730 in FIG. 27 in the recording / reproducing apparatus.
Reference numeral 2921 denotes the CPU unit 2721 in FIG.
Reference numeral 2949 denotes the memory 2749 in FIG.
Reference numeral 2929 denotes the demultiplexing unit 2729 in FIG.
Reference numeral 2932 denotes the video conversion processing unit 2732 in FIG.
Reference numeral 2930 denotes the video decoding conversion unit 2730 in FIG.
Reference numeral 2980 denotes a switching unit, which has a function of a PID filter that distributes and transfers a transport packet input from the demultiplexing unit 2929 to a set block according to the PID.
Reference numerals 2981, 2984, 2987, 2991, and 2995 are buffers, and temporarily buffer transport packets input / output to / from the switching unit 2980.
Reference numeral 2982 denotes a main decoder which decodes transport packets of a code-compressed video stream input via the buffer 2981.
Reference numeral 2983 denotes a video plane, which is a display plane buffer for expanding the video data decoded by the main decoder 2982.
Reference numeral 2985 denotes a sub-decoder for decoding transport packets of a code-compressed video stream input via the buffer 2984.
Reference numeral 2986 denotes a video plane, which is a display plane buffer for expanding the video data decoded by the sub-decoder 2985.
Reference numeral 2988 denotes a graphic decoder which decodes a transport packet of graphic data input via the buffer 2987.
Reference numeral 2989 denotes a graphic plane which is a plane buffer for developing graphic data decoded and drawn by the graphic decoder 2988.
Reference numeral 2990 denotes a CLUT, which performs conversion processing for replacing graphic data expanded on the graphic plane 2989 with display data.
Reference numeral 2992 denotes a caption decoder, which decodes a transport packet of caption data input via the buffer 2991.
Reference numeral 2993 denotes a subtitle plane, which is a plane buffer for developing graphic data decoded and drawn by the subtitle decoder 2992.
Reference numeral 2994 denotes a CLUT, which performs conversion processing to replace the caption data expanded on the caption plane 2993 with display data.
2996 is a transcoder, which transcodes a transport packet of a code-compressed video stream input via a buffer 2995 into a video stream of another format or other bit rate, and outputs it to the buffer 2995 again. To do.
Data output from the video planes 2983 and 2986 and CLUTs 2990 and 2994 are transferred to the video conversion processing unit 2932.

  The recording operation of this embodiment will be described.

  A state in which a channel to be recorded has been selected before starting recording is considered as an initial state.

  In this state, the digital broadcast wave received by the tuner 2723 via the antenna 2703 is descrambled by the descrambler 2724, separated into a video stream, audio stream, other graphic stream, subtitle stream, and the like by the demultiplexer 2729. To the decoder.

  The video decoding conversion unit 2730 decompresses the video stream, the video conversion processing unit 2732 converts the video data as necessary, and outputs control signals and video outputs from the output terminals 2732 and 2741.

  As described above, the output video output is displayed on the monitor display connected to the recording / reproducing apparatus, and can be viewed by the user.

  Next, the details of the process of starting the recording operation when the recording button is pressed by the user or when the recording apparatus starts recording at the scheduled recording start time will be described.

  When the user presses the recording button, a control signal indicating the start of recording is input from the user operation input unit 2745 and received by the control signal transmission / reception unit 2733. The received control signal is temporarily stored in the buffer 2749, interpreted by the CPU 2721, and controlled to start the recording operation.

  At the same time, the CPU 2721 notifies the user that the input from the user is normally accepted and recording starts using an OSD (On Screen Display) or the like.

  The CPU 2721 controls the demultiplexing unit 2729 to transfer the stream of the program instructed by the user to select and record to the recording / reproducing unit 2727.

  As shown in FIG. 28, the recording / playback unit 2827 performs encryption processing such as AES (Advanced Encryption System) on the stream data input from the demultiplexing unit 2829, and the packetizer 2863 uses the packetizer 2863. Packetization processing is performed and temporarily stored in the buffer 2864. Further, the pulse signal synchronized with the PLL 2860 is counted by the counter 2862 to the PCR of the stream input from the demultiplexing unit 2829, transferred to the packetizer 2863, and added to the transport packet as the arrival time clock of the TP extra header. .

  Packets accumulated in the buffer 2864 are recorded on a main recording medium 2826 such as a DVD or Blu-ray Disc (TM) by the storage I / F 2865. At this time, the video stream and the audio stream are recorded as an m2ts file with a file structure as shown in FIG. For example, the stream file name is “01000.m2ts”.

  Further, when the recording is completed, a clip information file, a real playlist file, info. A bdav file or the like is recorded on the main recording medium 2826. For example, the clip information file is “01000.clpi”, and the real playlist file is “01001.rpls”.

At the IN time 606 and OUT time 607 of the clip information file “01000.clpi”, the recording start time and recording end time of the stream file 146 are recorded, respectively.
“01000” is recorded in the clip information file 602 of the real play list file “01001.rpls”.

  When only one clip is recorded, “1” is recorded in the number of play items 503.

  In the mode in which the video stream and audio stream included in the broadcast wave are recorded as they are, the stream is transferred as it is from the demultiplexing unit 2729 to the recording / reproducing unit 2727 in FIG. In the case of recording in a format such as H.264 or Dolby Digital (TM), it is transferred from the demultiplexing unit 2729 to the video decoding conversion unit 2730, and the switching unit 2980 in the video decoding conversion unit 2730 shown in FIG. The data is stored in the buffer 2995, converted in format by the transcoder 2996, and returned to the demultiplexing unit 2729 in FIG. 27 via the buffer 2995 and the switching unit 2980. The returned stream data is transferred to the recording / reproducing unit 2727 and recorded on the main recording medium 2726 as described above.

  In addition to recording broadcast waves, content downloaded from a network may be recorded on the main recording medium 2726 and the sub recording medium 2750.

  When the recording / reproducing apparatus is connected to a network 2755 outside the apparatus through a network terminal 2756, a program (eg, JAVA (TM) program) included in the main recording medium 2726 is loaded, and the CPU 2721 executes the program. If the program is described to perform network access, it is possible to connect to a website specified in the program and download new content.

  The downloaded content is transferred to the recording / reproducing unit 2727 via the network I / F 2725 and recorded on the sub recording medium 2750.

  In some cases, digital data is input via the digital input / output 2757 by the digital I / F 2746 and recorded in the main recording medium 2726 or the sub recording medium 2750.

  If the digital input / output 2757 of the recording / reproducing device is USB (Universal Serial Bus) or IEEE 1394, a storage device having the same digital I / F, for example, a digital video camera, a digital still camera, an external HDD, or a USB flash memory And can input digital data.

  Alternatively, if the digital input / output 2757 is an SD card (TM) slot, digital data can be directly input from the SD card by inserting the SD card in which the content is recorded into this slot.

  For example, in the case of a video camera or a digital camera compatible with AVCHD (TM), a USB connection is made to the recording / playback apparatus from a built-in HDD, flash memory, or optical disk. The compressed digital data recorded in the H.264 format can be input and recorded in the main recording medium 2726 and the sub recording medium 2750.

  Whether the recorded content is 3D from the SI information included in the broadcast wave, the program information on the Internet, or the content information input by the user using a remote controller, etc., and whether the 3D format of the recorded content is the side-by-side format A top-and-bottom method, a frame packing method, or another method can be determined.

  Whether a 3D or a 3D method is recorded in a real play list file generated when recording content. At this time, the 3D flag 321 and the 3D type 322 are recorded.

  A processing flow for recording the 3D type 322 will be described with reference to FIG.

  When the broadcast is received by the recording / reproducing apparatus, information indicating 3D or 2D is acquired from the program information included in the received broadcast data (step 3301). If it is 2D (step 3302), 000 is recorded as a value to be set for the 3D type 322 (step 3303).

  Thereafter, an AV stream is recorded (step 3304), and a play list is recorded (step 3312). If it is 3D instead of 2D (step 3302), it is determined whether it is a 1080p24Hz frame pack (step 3305). If it is a 1080p24 Hz frame pack (step 3305), 100 is recorded as a value to be set in the 3D type 322 (step 3306). If it is not a 1080p24Hz frame pack (step 3305), it is determined whether it is 720p60Hz top and bottom (step 3307). If it is 720p60 Hz top and bottom (step 3307), 010 is recorded as a value to be set in the 3D type 322 (step 3308). Thereafter, an AV stream is recorded (step 3304), and a play list is recorded (step 3312). If it is not 720p60Hz top and bottom (step 3307), it is determined whether it is 1080i60Hz side by side (step 3309). If it is 1080i60 Hz side-by-side (step 3309), 110 is recorded as a value to be set in the 3D type 322 (step 3310).

  Thereafter, an AV stream is recorded (step 3304), and a play list is recorded (step 3312). If it is not 1080i60 Hz side-by-side (step 3309), a message that recording is impossible is displayed to the user (step 3311).

  As described above, the 3D type of the content can be correctly recorded, and when the recording is impossible, the user can be notified that the recording is impossible.

  The reproduction operation of this embodiment will be described.

When the optical disk as the main recording medium 2726 in FIG. 27 is loaded into the recording / reproducing unit 2727, the recording / reproducing unit 2727 notifies the insertion of the disk, and the CPU 2721 instructs the recording / reproducing unit 2727 to access the disk. Execute confirmation of NO.
Thereafter, a list of contents recorded on the disc is read, and the contents list is displayed on a display connected to the recording / reproducing apparatus.

  FIG. 32 shows an example of a content list recorded by the user.

  FIG. 32 is an example of a schematic diagram of a screen displaying a list of programs recorded by the user on the disc.

  Reference numeral 3201 denotes a title display section of this screen. The screen shows a list of recorded programs.

  Reference numeral 3202 denotes a page number display unit. The recorded program list has one page in total, and the first page is displayed.

  Reference numeral 3203 denotes a display unit for displaying the total number of contents and the total content recording time. In this case, 10 programs are recorded in total, and the total time is 4 hours and 15 minutes.

  Reference numeral 3204 denotes a scroll up button. By performing an operation of pressing this button using a cursor or the like by a user operation such as a remote control, the recorded programs displayed in a list are scrolled up.

  Reference numeral 3205 denotes a scroll down button. Performs the reverse operation of the scroll up button.

  Reference numeral 3211 denotes an information display section of the recorded program 1. In this example, the recording date and time is from 12:00 to 13:00 on September 30, the broadcast channel is BS11 channel, the program name is “golf lesson”, the program is 3D content, It is displayed that the recording mode is the TS mode.

  Reference numeral 3212 denotes an information display section of the recorded program 2.

  Reference numeral 3213 denotes an information display section of the recorded program 3.

  Reference numeral 3214 denotes an information display section of the recorded program 4.

  Reference numeral 3215 denotes an information display section of the recorded program 5.

  Reference numeral 3216 denotes an information display section of the recorded program 6.

  Reference numeral 3221 denotes a playback function menu list. By selecting this menu list, it is possible to continuously play back recorded programs.

  Reference numeral 3231 denotes a selection frame, which is used to indicate an item selected when the user selects an item from items displayed on the screen using a user interface such as a remote controller. In this case, the “reproduction function” is selected.

  Reference numeral 3222 denotes a delete function menu list. By selecting this menu list, the recorded program can be deleted.

  Reference numeral 3223 denotes a dubbing function menu list. By selecting this menu list, a recorded program can be dubbed.

  Reference numeral 3224 denotes a conversion function menu list. By selecting this menu list, the recorded program can be converted.

  Reference numeral 3225 denotes a menu list of editing functions. By selecting this menu list, the recorded program can be locked for deletion.

  Reference numeral 3227 denotes a menu list of display functions. By selecting this menu list, a list of recorded programs can be displayed.

  In FIG. 32, the target program is selected from the displayed recorded programs 3211 to 3216 with a remote controller or the like, and the “playback function” is selected to start playback.

  Alternatively, when the disc is inserted into the recording / reproducing apparatus, automatic reproduction such as executing the first play or resuming the reproduction from the position where the previous reproduction was completed can be performed.

  In resume play, resume point list information in which the disc ID and final playback position are paired is stored in the nonvolatile memory in the device when the disc is ejected, and the disc of the inserted disc is inserted when the disc is inserted. When the ID is recognized, the resume point list is referred to, and if there is a matching disc ID, the corresponding final playback position is determined as the playback restart position, jumping to that position and starting playback. It is feasible.

  Alternatively, info. By registering the file name of the playlist to be resumed in the resume playlist file name of the bdav file 111, the info. This can be realized by reading the bdav file 111 and reproducing the playlist file recorded in the resume playlist file name.

  In addition to first play and resume play, the recorded program list display function of the recording / playback apparatus can be used to select a scene or content that the user wants to play from a thumbnail list displayed there. .

  For example, when the playlist file 141 (01001.rpls) of FIG. 1 is reproduced, first, the playlist information start address 203 is read out from the playlist file structure of FIG. 2, and the playlist information is stored. Get the offset on the file. Next, when the playlist information is read from the position where the offset is seeked from the top of the playlist file, the playlist information shown in FIG. 5 is obtained. Among these structures, the play item 505 has the structure shown in FIG. 6, and the clip information file name to be reproduced can be known by referring to the clip information file 602. For example, if “01000” is recorded in the clip information file 602, it can be understood that the clip information file 144 (01000.rpls) and the stream file (01000.rpls) may be read. Further, referring to the IN time 606 and the OUT time 607, the reproduction start position and the reproduction end position of the clip to be reproduced can be known. By repeating this as many times as recorded in the number of play items 503, it is possible to acquire which part of which clip should be reproduced in order.

  Also, information such as the 3D flag 321 and 3D type 322, recording date and time 308, channel number 312 and playlist name 316 recorded in the playlist file, bit rate, image resolution, and CODEC recorded in the clip information file are recorded. By reading various information such as information, it is possible to acquire not only the video / audio data itself but also various attribute information. The acquired attribute information is subjected to graphic processing by the video conversion processing unit 2732 according to an instruction from the CPU 2721, converted into image data, superimposed on the main image output from the video decoding conversion unit 2730, and video output 2741. Can be transmitted to the display or notified to the user.

  Alternatively, information such as the 3D flag 321 and the 3D type 322 is encoded into a control signal by the video conversion processing unit 2732 and output from the control signal 2743 in accordance with an instruction from the CPU 2721.

  The control signal output from the control signal 2743 and the video signal output from the video output 2741 are connected to the outside of the recording / playback apparatus as signals compliant with a digital video transmission standard (for example, HDMI standard or DisplayPort standard). Is output to the display.

  The display can correctly display the video signal output from the video output 2741 by receiving the control signal output from the control signal 2743 and setting the display mode according to the control signal.

  An example of processing of the recording / reproducing apparatus and the display in the present embodiment will be described.

  The recording / reproducing apparatus can recognize display specifications and performance by acquiring display information from an externally connected display via a control signal 2743 and interpreting the information in accordance with an instruction from the CPU 2721. For example, whether the display is compatible with 3D display, which of the 3D systems is compatible with the display, and the like.

  The recording / reproducing apparatus can determine whether or not 3D content can be correctly displayed by comparing the display information acquired and interpreted as described above with information such as the 3D flag 321 and the 3D type 322. If the 3D display cannot be performed correctly, the user can be informed accordingly.

  For example, if the 3D flag 321 recorded in the playlist file of the content to be played is 1 and the 3D type 322 is 10, and the connected display is a display that supports only side-by-side stereoscopic display, The content that is being attempted is 3D content recorded by the frame packing method, and the display to be displayed is incompatible with the display of the frame packing method. Therefore, a message such as “This display cannot be stereoscopically displayed on this display” can be displayed on the display to notify the user.

  FIG. 30 is an example of a timing chart showing the processing of the recording / playback apparatus and the display.

  When a disc to be played back is inserted into the recording / playback apparatus (step 3001), information about the content is read from the disc (step 3002). Information related to content includes information related to 3D such as the 3D flag 321 and the 3D type 322. On the other hand, the display device (display) transmits 3D information 3004 supported by the display device to the recording / playback device via the digital I / F connected to the display device (display) (step 3003). ).

  The recording / reproducing apparatus collates the 3D system information 3004 sent from the display device with the 3D information of the content acquired in step 3002, and determines whether it can be displayed without conversion or whether conversion is necessary (step 3005). If conversion is necessary, it is determined whether the recording / playback apparatus can perform conversion (step 3006). If conversion is possible, the 2D / 3D system information 3008 of the content to be transmitted is notified to the display device (step 3007), and the display device receives the 2D / 3D system information 3008 sent from the recording / playback device, A display mode is set (step 3009). If conversion is impossible, the recording / reproducing apparatus notifies the user that display is impossible. At this time, the notification may be displayed on the display device by OSD. In this case, the 3D content is not transmitted to the display device.

  After setting the display mode (step 3009), the display device returns normal completion information 3011 to the recording / playback device (step 3010), and the recording / playback device converts the 3D content and displays the converted content 3013. Transmit to the device (step 3012).

  The processing flow of 3D type 322 playback will be described with reference to FIG.

  When playing back the content recorded by the recording / playback apparatus, the play list is played back (step 3101). Information indicating the 3D method is acquired from the 3D type information 322 included in the playlist (step 3102). If it is 000 (step 3103), it is determined that the content is 2D content, and the AV stream is reproduced (step 3104).

If it is not 000 (step 3103), it is determined whether it is 100 (step 3105). If 100 (step 3105), it is determined that the frame pack is a 1080p24Hz frame pack, and it is confirmed whether the 1080p24Hz framepack is included in the 3D format supported by the display device (step 3106). If it is included, it is determined that display is possible (step 3106), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If it is not included, it is determined that display is impossible (step 3106), and it is confirmed whether the recording / playback apparatus supports the conversion function of 1080p24Hz frame pack content (step 3110). If it is compatible (step 3110), the AV stream is converted (step 3111), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104).
If not supported (step 3110), a message indicating that reproduction is impossible is displayed to the user (step 3112).

If not 100 (step 3105), it is determined whether it is 010 (step 3108). If it is 010 (step 3108), it is determined that the top and bottom is 720p60Hz, and it is confirmed whether or not the 720p60Hz top and bottom is included in the 3D system supported by the display device (step 3106). If it is included, it is determined that display is possible (step 3106), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If it is not included, it is determined that display is impossible (step 3106), and it is confirmed whether or not the recording / playback apparatus supports the function of converting 720p60Hz top and bottom content (step 3110). If it is compatible (step 3110), the AV stream is converted (step 3111), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104).
If not supported (step 3110), a message indicating that reproduction is impossible is displayed to the user (step 3112).

If it is not 010 (step 3108), it is determined whether it is 110 (step 3109). If it is 110 (step 3109), it is determined that it is 1080i60Hz side-by-side, and it is confirmed whether 1080i60Hz side-by-side is included in the 3D system supported by the display device (step 3106). If it is included, it is determined that display is possible (step 3106), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104). If it is not included, it is determined that display is impossible (step 3106), and it is confirmed whether the recording / playback apparatus supports the conversion function of 1080i60Hz side-by-side content (step 3110). If it is compatible (step 3110), the AV stream is converted (step 3111), 3D information is transmitted (step 3107), and the AV stream is reproduced (step 3104).
If not supported (step 3110), a message indicating that reproduction is impossible is displayed to the user (step 3112).

  As described above, the 3D type of the content can be correctly played back, and if the playback is impossible, the user can be notified that playback is impossible.

  The details of the process of reading desired data from the AV stream file and displaying it on the display will be described with reference to FIG.

  The AV stream file read from the main recording medium 2726 is separated into elementary streams by the demultiplexing unit 2729 via the recording / reproducing unit 2727, the video stream to the video decoding conversion unit 2730, and the audio stream to audio decoding. The data is transferred to the conversion unit 2731.

  The video stream is decoded by the video decoding conversion unit 2730 and output from the video output 2741 via the video conversion processing unit 2732.

  The audio stream is decoded by the audio decoding conversion unit 2731 and output from the audio output 2742.

  Details of the recording / reproducing unit 2727 will be described with reference to FIG.

  The audio / video stream data of the AV stream file recorded on the main recording medium 2826 is read by the designated length from the designated sector in response to the read request command from the storage I / F 2865 and exceeds a certain amount in the buffer 2864. Accumulated.

  The stream data stored in the buffer 2864 is read in units of TS packets in response to a request from the depacketizer 2866, and the depacketizer 2866 resolves the packet and analyzes the arrival time stamp in the header. Then, the arrival time stamp and the clock information supplied from the counter 2872 are compared, and the packet is transferred to the decoding unit 2867 at a correct interval. The decryption unit 2867 decrypts the packet encryption and sends it to the demultiplexing unit 2829.

  On the other hand, the same processing is performed for a path from the buffer 2864 to the packetizer 2868 and the decoding unit 2869. As a result, it is possible to perform stream processing of two systems at the same time, and it is possible to realize a function that superimposes a sub image on a main image, such as a Picture in Picture function, a Pop Up Menu function, and the like.

  It is also possible to simultaneously process the AV stream file read from the main recording medium 2826 and the AV stream file read from the sub recording medium 2850 at the same time.

With reference to FIGS. 37 to 40, an example of a management method will be described in which, when 3D content is edited in a 2D editing environment, the editing result can be correctly reflected in 3D.
FIG. 37 is a flowchart showing a management information recording method for recording 3D content.
When 3D content is recorded (step 3701), stream number information 625 and 3D stream number information 210 of the recorded 3D content are recorded in the playlist (steps 3702 and 3703). Further, the edited flag 306 is set to 0 (step 3704), and the 3D synchronization flag 323 is set to 1 (step 3705). Finally, the 3D time stamp 3602 is updated (step 3706), and the time stamp of the playlist file is updated (step 3707).
As a result, the 3D time stamp 3602 and the time stamp of the playlist file have the same value. A 3D synchronization flag 323 indicates a 2D / 3D synchronization state. Furthermore, the 2D stream number information 3603 of the stream number information 625 and the 3D stream number information 210 has the same contents.

FIG. 38 is a flowchart showing a method for updating management information when editing 3D content in a 2D editing environment.
When an editing operation for changing the stream number information is performed on the recorded 3D content in the 2D editing environment (step 3801), the stream number information 625 is updated (step 3802), and the edited flag 306 is set. 1 is set (step 3803), and the 3D synchronization flag is set to 0 (step 3804). Further, the time stamp of the file is updated (step 3805).
Thus, the 3D time stamp 3602 and the time stamp of the playlist file have different values. A 3D synchronization flag 323 indicates a 2D / 3D asynchronous state. Furthermore, the 2D stream number information 3603 of the stream number information 625 and the 3D stream number information 210 has different contents.
Editing that changes the stream number information includes 3D / 2D conversion of the main image stream, 3D / 2D conversion of the text subtitle stream, and the like.

FIG. 39 is a flowchart showing a method for updating management information when 3D content edited in a 2D editing environment is loaded in a 3D playback device or 3D editing environment.
When 3D content edited in the 2D editing environment is loaded in the 3D editing environment, the edited flag of the playlist file is checked to determine whether editing has been performed (step 3901). If it has been edited, it is confirmed whether or not the 3D stream number information of the playlist file exists, and it is determined whether or not it is 3D content (step 3902). If it is 3D content, the 3D synchronization flag of the playlist file is confirmed, and it is determined whether or not the management information of the 2D compatible part and the 3D specific part is synchronized (step 3903). If not synchronized, the 3D time stamp 3602 is compared with the time stamp of the playlist file to determine whether they are the same, and it is determined whether the content edited in the 2D editing environment needs to be reflected in the 3D specific part. (Step 3904).

Alternatively, the 2D stream number information 3603 of the stream number information 625 and the 3D stream number information 210 may be compared, and if they are different, it may be determined that the content edited in the 2D editing environment needs to be reflected in the 3D specific part. Is possible.
If it is determined that reflection is necessary (step 3904), the 3D stream information 210 is updated (step 3905). Then, the 3D synchronization flag is set to 1 (step 3905), the 3D time stamp is updated (step 3907), and the time stamp of the playlist file is updated (step 3908).
As a result, it is possible to reproduce the 3D content in a state where the edited content executed in the 2D editing environment is correctly reflected.

  In the case of a 3D playback device, instead of updating the file from step 3905 to step 3908, the management information is updated on the memory in the playback device, and this is used during playback to rewrite the file on the recording medium. Even if it is not possible, it can be reproduced in 3D correctly according to the editing contents of 2D.

  FIG. 49 shows a method of updating management information when 3D content edited in the 2D editing environment is loaded in the 3D playback device or 3D editing environment when the playlist file has the structure shown in FIG. It is the shown flowchart.

  When 3D content edited in the 2D editing environment is loaded in the 3D editing environment, the edited flag of the playlist file is checked to determine whether editing has been performed (step 4901). If it has been edited, it is checked whether 3D subpath information of the playlist file exists (whether the subpath type indicates 3D) or not, and it is determined whether the playlist file is 3D content (step 4902). If it is 3D content, the 3D synchronization flag of the playlist file is confirmed, and it is determined whether or not the management information of the 2D compatible part and the 3D specific part is synchronized (step 4903). If not synchronized, the 3D sub-path information is updated (step 4904). Then, the 3D synchronization flag is set to 1 (step 3905), and the 3D time stamp is updated (step 4905).

  As a specific operation of step 4904, there is an inconsistent playback period between the play item IN time 606 and OUT time 607 and the sub play item IN time 806 and sub play item OUT time 807 in FIG. Therefore, the sub play item IN time 806 and the sub play item OUT time 807 are corrected to match the IN time 606 and OUT time 607 of the play item. Since there is a possibility that all the play items as the main path have been deleted or divided into a plurality of parts, in that case, the structure of the sub play items is corrected so as to be consistent.

  With the above operation, it is possible to reproduce the 3D content in a state in which the edited content executed in the 2D editing environment is correctly reflected.

  In the case of a 3D playback device, instead of updating the files in steps 4904 and 4905, the management information is updated on the memory in the playback device, and this is used during playback to rewrite the file on the recording medium. Even if it is not possible, it is possible to reproduce correctly in 3D according to the edited contents of 2D, as described above.

  FIG. 40 is a flowchart showing a management method when editing 3D content in the 3D editing environment.

  When an editing operation for changing the stream number information is performed on the recorded 3D content in the 3D editing environment (step 4001), the stream number information 625 is updated (step 4002), and the 3D stream number information 210 is updated. (Step 4003), the 3D time stamp 3602 is updated (step 4004), the edited flag 306 is set to 1 (step 4005), and the 3D synchronization flag 323 is set to 1 (step 4006). Further, the time stamp of the file is updated (step 4007).

  As a result, the 3D time stamp 3602 and the time stamp of the playlist file have the same value. A 3D synchronization flag 323 indicates a 2D / 3D synchronization state. Furthermore, the 2D stream number information 3603 of the stream number information 625 and the 3D stream number information 210 has the same contents.

  As described above, according to the present embodiment, when there is inconsistency as 3D content in the data to be reproduced, the sub play item IN time and the sub play of the sub path of the dependent view stream for 3D in the playlist information are included. By correcting the item OUT time so that it matches the IN time and OUT time of the edited play item of the main path, the edited content by the 2D device can be reflected and correct 3D playback output can be performed.

  Another embodiment will be described.

FIG. 46 is an example of a schematic diagram showing the structure of a clip information file.
Reference numeral 4601 denotes a type identification, in which information indicating clip information is set.
Reference numeral 4602 denotes a version number indicating the version of the clip information file.
4603 is a sequence information start address, and a value indicating the relative start position of the sequence information in the clip information file in bytes is set.
4604 is a program information start address, and a value indicating the relative start position of the program information in the clip information file in bytes is set.
4605 is a feature point information start address, and a value indicating the relative start position of the feature point information in the clip information file in bytes is set.
Reference numeral 4606 denotes a mark information start address, and a value indicating the relative start position of the mark information in the clip information file in units of bytes is set.
Reference numeral 4607 denotes an extent start information start address, and a value indicating the relative start position of the extent start information in the clip information file in bytes is set.
Reference numeral 4608 denotes an edited flag. If 0 is set, the original data at the time of recording is stored without being changed. If 1 is set, a change is added. It shows that.
Reference numeral 4609 denotes clip information, which indicates basic information as a clip, such as a stream type and what kind of main path or sub path is used.
Reference numeral 4610 denotes sequence information, which is information for identifying the ATC or STC of the stream file.
Reference numeral 4611 denotes program information, which indicates information on a packet sequence that constitutes a stream file.
4612 is feature point information indicating the relationship between time information and position information of a stream file.
Reference numeral 4613 denotes mark information, which indicates the mark information of the clip.
4614 is a 3D time stamp and indicates the latest time when the extent start information is updated.
Reference numeral 4615 denotes extent start information, which indicates the arrangement of a base view stream and a dependent view stream when the 3D content is an MPEG4-MVC stream. The left eye stream and the right eye stream of the 3D content are separately provided. It is used to read out and input to each decoding processing system.

FIG. 47 is a diagram showing an example of the structure of extent start information 4615.
4701 is a length, which indicates the length from immediately after this field to the end of the extent start information.
4702 is the number of extent start positions, and indicates the number of extent start positions included in the extent start information.
Reference numeral 4703 denotes an extent start position, which indicates the start position of each extent of the base view stream and the dependent view stream by the number of packets from the head.

  FIG. 48 shows the base view stream 01000. m2ts and the dependent view stream 02000. m2ts, and 01000. which is an interleaved stream. It is an example which showed the correspondence of the extent for every ssif file. The extent start position 4703 is 01000. m2ts file and 01000. Each extent start position from the beginning of each m2ts file is shown.

  An example in which 3D content recorded based on the data structure is edited in a 2D editing environment will be described. In the 2D editing environment, only data portions that can be recognized as 2D content are subject to editing. For example, in the data structure in FIG. 48, 01000. recognized as an MPEG4-AVC stream of 2D content. A case where the extent B [1] of the m2ts file is partially deleted can be considered. When the edited data is played back on a device capable of 3D playback, if the sub-path is corrected at the playlist information level based on the above-described embodiment, 3D content can be played back, but extent B in FIG. Since only the extent D [1] of the dependent view stream corresponding to [1] remains, there is a possibility that the 3D content is not consistent at the AV stream file level.

  In the present embodiment, the extents are clearly indicated with the same length for the sake of simplicity. However, the present invention is not limited to this, and only the base view stream is used in the 2D editing environment even when the lengths are different for the extents. If edited, inconsistency with the corresponding dependent view stream may occur.

  As a method for dealing with this problem, the “edited flag”, “3D time stamp”, and “2D compatible part management information” as shown in FIG. 4608 ”,“ 3D timestamp 4614 ”, and“ extent start information 4615 ”are stored in the clip information file, and editing in 2D is performed based on these management information when editing in the 2D editing environment or loading in the 3D environment. The content can be reflected in 3D.

  The processing flow can be explained by replacing the description in the playlist with the information in the clip information file. That is, the stream number information 625 in FIGS. 37 to 40 is omitted, and the 3D stream number information is replaced with the extent start information 4615, or the 3D subpath information in FIG. 49 is replaced with the extent start information 4615. Become.

  Specifically, for example, when extent B [1] has been deleted by 2D editing as described with reference to FIG. 48 described above, extent D [1] of the corresponding dependent view stream is deleted. In accordance with this, 02000. The extent start position 4703 of the clip information file corresponding to the m2ts file is corrected.

  Note that in the case of a 3D playback device, the extent itself as an AV stream is not deleted, and only the modification of the extent start position 4703 of the clip information file is updated on the memory in the playback device, thereby temporarily matching. It is possible to perform reproduction.

  As described above, according to the present embodiment, when there is inconsistency as 3D content in data to be reproduced, the extent start information of the 3D dependent view stream in the clip information is used as the extent of the edited base view stream. Thus, the correct 3D playback output can be performed reflecting the 2D editing content.

  In addition, this invention is not limited to an above-described Example, Various modifications are included. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

  Each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor. Information such as programs, tables, and files for realizing each function should be stored in a recording device such as a memory, a hard disk, or a solid state drive (SSD), or a recording medium such as an IC card, SD card (TM), or DVD. Can do.

  Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

  In addition, although the configuration in which the determination by the 3D synchronization flag, the determination by the time stamp comparison, and the determination by the stream number information comparison are performed continuously is shown, it can be realized by a configuration in which only one or two of them are combined. And has the same effect.

301 ... Length 302 ... Character code 303 ... Reproduction protection flag 304 ... Recording protection flag 305 ... Reproduced flag 306 ... Edited flag 307 ... Time zone 308 ... Recording date and time 309 ... Playlist length 310 ... Maker ID
311 ... Model code 312 ... Channel number 313 ... Channel name length 314 ... Channel name 315 ... Playlist name length 316 ... Playlist name 317 ... Play list detail length 318 ... Play list details 321 ... 3D flag 322 ... 3D type 323 ... 3D synchronization flag

Claims (4)

A reproduction method for reproducing information recorded on a recording medium,
In the recording medium, an AV stream and management information of the AV stream are recorded,
The management information includes clip information that defines the arrangement of the AV stream,
The clip information includes extent start position information of the AV stream,
The AV stream includes a base view stream and a dependent view stream as 3D content,
When the data in the management information indicates inconsistency as 3D content in the AV stream, the extent start position information of the dependent view stream in the clip information is matched with the extent start position information of the base view stream. So that you can remove
A playback method, wherein the 3D content is played back. A playback device for playing back information recorded on a recording medium,
A reproducing unit for reproducing information from the recording medium;
It has a control unit that controls the whole playback unit,
In the recording medium, an AV stream and management information of the AV stream are recorded,
The management information includes clip information that defines the arrangement of the AV stream,
The clip information includes extent start position information of the AV stream,
The AV stream includes a base view stream and a dependent view stream as 3D content,
The controller is
When the data in the management information indicates inconsistency as 3D content in the AV stream, the extent start position information of the dependent view stream in the clip information is matched with the extent start position information of the base view stream. Control the playback unit to correct so that
A playback apparatus for playing back the 3D content. A recording method for recording information on a recording medium,
Recording an AV stream;
Recording the management information of the AV stream,
The management information includes clip information that defines the arrangement of the AV stream,
The clip information includes extent start position information of the AV stream,
The AV stream includes a base view stream and a dependent view stream as 3D content,
When the data in the management information indicates inconsistency as 3D content in the AV stream, the extent start position information of the dependent view stream in the clip information is matched with the extent start position information of the base view stream. Update the management information by modifying it so that
Modifying the AV stream to match the dependent view stream with the management information;
A recording method comprising: recording the management information and the AV stream on the recording medium. A recording device for recording information on a recording medium,
An AV stream, and a recording unit for recording the management information of the AV stream on the recording medium;
A control unit for controlling the recording unit;
The management information includes clip information that defines the arrangement of the AV stream,
The clip information includes extent start position information of the AV stream,
The AV stream includes a base view stream and a dependent view stream as 3D content,
The controller is
When the data in the management information indicates inconsistency as 3D content in the AV stream, the extent start position information of the dependent view stream in the clip information is matched with the extent start position information of the base view stream. Update the management information by modifying it so that
Modifying the AV stream to match the dependent view stream with the management information;
A recording apparatus that controls the recording unit to record the management information and the AV stream on the recording medium.

Images