JP2007128641A - Information processing device, information processing method and program, recording medium, and data structure - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To process data having a structure that promptly determines read addresses of video and sub reproduction information such as a sub title, which is synchronously reproduced with the video, during random access. <P>SOLUTION: An EP_map showing a correspondence between a PTS and an address, and a ClipMark showing each of reproducing sections of a sub title are created from AV stream data in which video and a sub title are multiplexed, and recorded separately from an AV stream file. In the EP_map for video, the PTS for reproduction time of an I picture of a video and an initial address in stream data of the corresponding I picture are described. In the EP_map for sub title, the PTS showing reproduction start time of a sub title, and information showing an initial address and an ending address in stream data of the corresponding sub title are described. In ClipMark, PTS showing reproduction start time of each reproduction section and duration of the section are described. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program for recording video and associated data such as subtitles and graphics on a recording medium such as a DVD, and reading and reproducing the data from such a recording medium. , A recording medium, and a data structure.

  As a DVD video format, a video signal such as a movie and a subtitle (caption) signal accompanying it can be recorded separately. The video signal is encoded into an MPEG2 (Moving Picture Experts Group 2) video stream, and the subtitle signal encodes a bit-mapped signal into data called a sub picture. The MPEG2 video stream and the subpicture are multiplexed on the MPEG2 program stream and recorded on a DVD disc. The video and the subtitle accompanying it are played back synchronously based on PTS (Presentation Time Stamp). Further, even when random access is made to an arbitrary playback time during playback of a DVD video, the video at that time and a sub-picture (subtitle) that is played back synchronously can be read out.

  A conventional DVD video program stream has a structure in units of VOBU (Video Object Unit), and the structure of such conventional DVD data is described in, for example, Patent Document 1 below. FIG. 14A and FIG. 14B are schematic views showing the structure of a conventional DVD video program stream. A DVD video program stream is managed in units of VOBS (Video Object Set), and this is a unit of, for example, one movie. This VOBS is composed of a plurality of Video Objects (VOB). This VOB is a unit in which each data is recorded as a group on the disc. This VOB is composed of a plurality of cells, and this is a unit such as one scene or one cut in a movie, for example. Furthermore, this Cell is composed of a plurality of VOBUs (Video Object Units) shown in FIG. 14 (a). This VOBU is a unit of 0.4 to 1.2 seconds in a moving image, and one or more in the MPEG2 format is included in this VOBU. GOP (Group of Picture) is included.

  The VOBU has a navigation pack (N_PCK) shown in FIG. 14B which is a pack having management information of this VOBU, and this navigation pack is arranged at the head of each VOBU. The navigation pack has VOBU_SRI (VOBU Search Information) and SP_SYNCA, and VOBU_SRI has the start address of the VOBU to be played back N seconds (N is an integer) before and after the playback time of the VOBU containing the VOBU_SRI. Further, SP_SYNCA has address information of a sub-picture that is reproduced in synchronization with the VOBU video including the SP_SYNCA. When playing back a movie or the like, the navigation pack can be read in advance and played back based on the management information indicated by the navigation pack.

  In the DVD video having such a configuration, the read operation of the video at the time of random access and the subtitle reproduced in synchronization therewith is as follows.

  That is, first, the VOBU address of the video access point is determined by referring to VOBU_SRI of a certain navigation pack.

  Next, the navigation pack at the VOBU address is read from the disk. Then, the host CPU of the player (playback apparatus) analyzes SP_SYNCA of the navigation pack, and determines the access point address of the subtitle. Finally, the subtitle at the access point address is read from the disc.

JP-A-10-271444

  However, in the case of such a conventional DVD video, since the subtitle address information is embedded in the MPEG program stream, it takes time to read the subtitle during random access. That is, when determining the subtitle read address, the stream data is read from the disc, the data is analyzed by the host CPU of the player, and then the subtitle access point address is determined. There is a problem that it takes time to read the data.

  The present invention has been proposed in view of such a conventional problem, and at the time of random access, a process for quickly determining a read address of sub-reproduction information such as a video and a sub-title reproduced in synchronism with the video is quickly performed. It is an object of the present invention to provide an information processing apparatus, an information processing method and program for recording / reproducing data having a structure capable of recording, a recording medium on which such data is recorded, and a data structure.

  In order to achieve the above-described object, an information processing apparatus according to the present invention, from stream data having packetized video information, and sub-reproduction information packetized and reproduced simultaneously with reproduction of the video information, Attached information creating means for creating attached information related to the video information and the sub-playback information, and a recording means for recording the stream data on a recording medium together with the attached information created by the attached information creating means. The information creating means includes a first ID added to the video information packet, a presentation time stamp indicating a playback start time of each intra-frame encoded image at the video information access point, and an address in the stream data. And information indicating the addresses where each intra-coded image starts and ends A sub-playback information table in which a second ID added to the sub-playback information packet and an address of the sub-playback information to be played back simultaneously with the video information at the access point are described. It is characterized by creating.

  The information processing apparatus according to the present invention provides the video information together with stream data including packetized and recorded video information and packetized and recorded sub-reproduction information that is reproduced simultaneously with reproduction of the video information. Corresponding to the first ID added to the packet, the presentation time stamp indicating the reproduction start time at the access point of the video information, and the address in the stream data, and the start and end of each intra-frame encoded image A video table having information indicating an address to be played, a second ID added to the packet of the sub reproduction information, an address of the sub reproduction information reproduced simultaneously with the video information at the access point, and the sub reproduction information A sub-reproduction information table in which each reproduction section is recorded is recorded on a recording medium A playback means for playing back video information and sub-playback information of a presentation time stamp at a randomly accessed position; and a control means for controlling the playback means with reference to the video table and the sub-playback information table. The control means reproduces the sub reproduction information including the presentation time stamp of the randomly accessed position within the reproduction section of the sub reproduction information table, and at a time close to the presentation time stamp of the sub reproduction information. The reproducing means is controlled to acquire certain address information and reproduce at least information from the position where the intra-frame coded image starts to the position where it ends.

  According to the present invention, the table can be referred to without decoding the stream data, and the address of the sub reproduction information can be easily obtained, so that the processing of reading and reproducing the sub reproduction information is speeded up. be able to.

  In addition, since the video table and the sub playback information table are recorded separately from the stream data, the random access playback includes the presentation time at the position randomly accessed from the sub playback information table. The secondary reproduction information can be specified and its address can be obtained, and the address of the randomly accessed video can be obtained from the video table and reproduced quickly.

  Hereinafter, specific embodiments to which the present invention is applied will be described in detail with reference to the drawings. In this embodiment, the present invention is applied to a recording apparatus for recording a DVD video and an information processing apparatus as a reproducing apparatus for reproducing a DVD recorded by the recording apparatus.

  FIG. 1 is a block diagram showing an information processing apparatus according to this embodiment. As shown in FIG. 1, an information processing apparatus 1 that records data on a recording medium encodes an input analog video signal and analog audio signal, and an encoded video stream (V) and an encoded audio stream ( A) that generates A), and a subtitle signal (sub-playback information) that is sub-playback information such as a subtitle (caption) that is played back in synchronization with the playback of the video signal and for which playback time can be arbitrarily set for each data. Are encoded, and a subtitle encoder 3 that generates an encoded subtitle stream (S), and the encoded video stream (V), encoded audio stream (A), and encoded subtitle stream (S) are multiplexed. The multiplexer 4 for generating the AV stream and temporarily storing the AV stream from the multiplexer A buffer 5, a host control unit 6 that creates EP_map, which will be described later, as Clip Information, which is additional information related to video and sub-playback information, from the AV stream, and an ECC encoder (encoding) that performs ECC (error correction) processing of the AV stream ) 7, a modulator 8 that modulates the AV stream, and a recording unit (driver) 9 that records the AV stream and attached information such as EP_map on a recording medium.

  The encoded video stream (V) generated by the AV encoder 2 is, for example, a video stream encoded by the MPEG2 system, and the encoded audio stream is, for example, an audio stream encoded by the MPEG1 system or Dolby An audio stream encoded by the AC3 system.

  Further, the subtitle encoded by the subtitle encoder 3 is reproduced in synchronization with the video signal and has, for example, a caption, a still image, or a graphic displayed superimposed on the video signal having different reproduction periods. It is shown. The subtitle signal encodes a bit-mapped signal into data called a sub picture.

  The multiplexer (multiplexer) 4 generates a multiplexed stream that is multiplexed based on the input system information from the input video stream, audio stream, and sub-picture. That is, the above-described MPEG2 video stream and sub-picture are multiplexed into, for example, an MPEG2 transport stream or an MPEG2 program stream.

  Then, the buffer 5 or the like makes this multiplexed stream an AV stream made up of source packets described later in a predetermined format according to the application format of the recording medium on which the stream is recorded.

  The control unit 6 analyzes the AV stream and creates attached information including a video table described later regarding the encoded video stream and a sub-playback information table regarding the encoded subtitle stream.

  Specifically, the attached information includes information related to the encoding information of the AV stream, for example, the start time of each intra-frame encoded image (hereinafter referred to as I picture) that is an access point in the AV stream. A video table (hereinafter referred to as video EP_map) in which a correspondence relationship between a presentation time stamp (Presentation Time Stamp (PTS)) and information indicating an address at which each I picture starts is described, and video information at the access point For example, a sub-reproduction information table in which addresses of sub-reproduction information to be reproduced synchronously are described. The sub-playback information table describes the correspondence between the presentation time indicating the start time of each subtitle (subtitle data for one page) in the AV stream and the address at which each subtitle starts and ends. An address search table (hereinafter referred to as “EP_map for subtitle”) and a sub-reproduction information reproduction table (hereinafter referred to as “ClipMark”) indicating a reproduction section of each subtitle in the AV stream are included.

  The recording unit 9 includes an AV stream file that has been subjected to predetermined processing by the ECC (error correction) encoder 7 and the modulation unit 8, and attached information (Clip Information) such as EP_map that describes the file, as well as the AV stream. Predetermined processing is performed by the ECC encoder 7 and the modulation unit 8 and recording is performed on a recording medium.

  Here, data recorded on the above-described recording medium will be described in detail. In this embodiment, a video and a subtitle are multiplexed to form one AV stream, and this AV stream and its attached information are recorded in separate files. As described above, the attached information includes EP_map and ClipMark for video and subtitle.

  The EP_map for video and subtitle includes the presentation time PTS indicating the start time of each I picture and each subtitle in the AV stream, and the address of the minimum access unit (source packet) at which it starts and ends. It is a table in which the correspondence relationship is described. ClipMark is a table in which the reproduction start time (presentation time) of each subtile in the AV stream and the duration (time period from when one subtitle is displayed on the screen until it disappears) are described. It is.

  When performing random access playback, the information processing apparatus according to the present embodiment uses Clip Information (EP_map and ClipMark) having such information, and reads the subtitle read address displayed in synchronization with the video at the random access time. Data is recorded and / or reproduced in order to quickly determine data.

  First, an application format on the recording medium will be described. FIG. 2 is a diagram showing a simplified structure of the application format on the recording medium in the present embodiment. The application format has two layers consisting of PlayList and Clip for AV stream management.

  The user can refer to only the PlayList layer, and can reproduce and edit data such as video and audio using the PlayList of the PlayList layer. On the other hand, the Clip layer is used when the player reproduces the AV stream specified by the PlayList. Here, a pair of one AV stream and the attached information of the AV stream is set as one object, and is managed in a unit called Clip. The AV stream file described above is called a Clip AV stream file, and its attached information is called a Clip Information file, and is separately recorded on a recording medium. Such a data structure is described in Japanese Patent Application No. 2001-91830 filed earlier by the present inventors. Here, in this embodiment, the video and the subtitle are multiplexed to form one Clip AV stream.

  In general, a data file used in a computer or the like is handled as a byte sequence, but the content of a Clip AV stream file is expanded on the time axis, and a PlayList mainly includes time points (PTS) for access points in the Clip. specify. When the PlayList indicates an access point into the Clip by a time stamp (PTS), the Clip Information file is useful for finding address information where decoding of the stream should be started in the Clip AV stream file.

  A PlayList is a collection of playback sections in a Clip, and one playback section in a Clip is called a PlayItem, which is represented by a pair of IN point and OUT point on the time axis. Therefore, PlayList is a collection of PlayItems.

  There are two types of PlayList. One is Real PlayList, and the other is Virtual PlayList. The Real PlayList is considered to share the stream portion of the Clip that it refers to. That is, the Real PlayList occupies the data capacity corresponding to the stream portion of the clip that is referenced in the disc. When an AV stream is recorded as a new clip, a Real PlayList that refers to the reproducible range of the entire clip is automatically created. When a part of the playback range of the Real PlayList is erased, the data of the clip stream part to which it refers is also erased. The Virtual PlayList is regarded as not sharing Clip data. Even if the Virtual PlayList is changed or deleted, the Clip does not change anything. In the following description, Real PlayList and Virtual PlayList are simply referred to as PlayList.

  Next, an AV stream on the recording medium in the present embodiment will be described. FIG. 3 is a diagram showing the data structure of the AV stream in the present embodiment. The AV stream 100 in the present embodiment has a BDAV MPEG2 transport stream structure. The BDAV MPEG2 transport stream is composed of an integer number of Aligned units 101n. The size of the aligned unit 101n is 6144 bytes (2048 × 3 bytes). One Aligned unit is composed of 32 source packets 1021 to 10232, and starts from the first byte of the source packet 1021.

  Each source packet 102n is 192 bytes long. One source packet includes a TP_extra_header 103a and a transport packet 103b. The TP_extra_header 103a is 4 bytes long, and the transport packet 103b is 188 bytes long. This source packet 102n is the minimum access unit. Data indicating one I picture and one subtitle is composed of a plurality of source packets.

  Next, the Clip Information file will be described. As described above, in the information recording apparatus 1 according to the present embodiment, the video and the subtitle are multiplexed to form one Clip AV stream, and this Clip AV stream and its Clip Information file are recorded in separate files. The Clip Information file has EP_map and ClipMark.

  First, EP_map of the Clip Information file will be described. FIG. 4 is a diagram for explaining the relationship between the EP_map and the Clip AV stream. As shown in FIG. 4, EP_map is useful for finding address information to start decoding a stream in a Clip AV stream file when an access point in the Clip is designated by a time stamp (PTS). . That is, EP_map is a table indicating addresses corresponding to the IN point and OUT point on the time axis indicated by the above-described PlayList, and is used to convert a presentation time stamp PTS such as PlayList into an address corresponding thereto. The Thereby, it is possible to select and read out the corresponding data from the Clip AV stream. As described above, EP_map types include video and subtitle.

  5A and 5B are diagrams for explaining the structure of the video EP_map. FIG. 5A is a diagram for explaining the position of the presentation time PST in the Clip AV stream. FIG. 5B is a diagram for explaining the structure of the video EP_map. FIG. 5C is a diagram showing an enlarged part of the Clip AV stream shown in FIG. 5, and FIG. 5C shows the data structure of the video EP_map.

  The video EP_map includes the presentation time PTS (PTS_EP_start) of each I picture in the Clip AV stream, information indicating the start position address of the I picture (SPN_EP_start), and information indicating the end position address of the I picture ( Subtitle_end_position_offset). Since the data indicating one I picture is composed of a plurality of source packets as described above, the video EP_map has a plurality of sources constituting one I picture as information indicating the address of the I picture. An address indicating the source packet at the head of the packet and information indicating the address of the source packet in which the final data of the I picture is recorded are described.

  Here, a source packet number (SPN) can be used as an address expression. This source packet number SPN is obtained by assigning a series of numbers to all source packets in the Clip AV stream. The source packet number SPN is the source packet number SPN = 0 (zero) for the first source packet in the Clip AV stream, the source packet number SPN = 1 for the next source packet, and thereafter for each subsequent packet. The source packet number SPN is incremented by one. Therefore, the source packet number SPN is described as SPN_EP_start of the video EP_map.

  Further, I_end_position_offset is information indicating the data amount from the source packet having the first data of each I picture to the source packet having the final data of the I picture, and thereby the address of the source packet where the final data exists. Can be specified.

  That is, as shown in FIG. 6, when reading data of a certain I picture, reading is started from SPN_EP_start which is the first source packet in which the I picture is described, and the amount of data indicated by I_end_position_offset is read. Good.

  Although the video EP_map has been described here, the Clip Information file includes an EP_map for audio streams in addition to the EP_map for video. As described in the above Japanese Patent Application No. 2001-158972, for example, EP_map_type and the like are provided in EP_map, and this EP_map_type is distinguished by describing the type of EP_map for video or audio or for a subtitle described later. can do. Here, when the Clip includes one or more video streams, an EP_map for the video stream is used. Further, when the Clip does not include a video stream and includes one or more audio streams, an EP_map for the audio stream is used.

  Next, the subtitle EP_map will be described. FIG. 7 is a diagram illustrating the structure of the subtitle EP_map. FIG. 7A illustrates the position of the presentation time PST in the Clip AV stream, and FIG. 7B illustrates FIG. FIG. 7C is a diagram showing an enlarged part of the Clip AV stream shown in FIG. 7, and FIG. 7C shows the data structure of the subtitle EP_map.

  The EP_map for subtitle is information (Subtitle_end_position_offset) indicating a presentation time PTS (PTS_EP_start) of each subtitle (subtitle data for one page) included in the Clip AV stream, an address (SPN_EP_start) at which the subtitle starts, and an end address. Is a table in which are described. That is, as described above, since one subtitle is composed of a plurality of source packets, the subtitle EP_map is a plurality of sources constituting one subtitle as information indicating addresses at the start position and end position of the subtitle. The source packet number at the head of the packet and information indicating the address of the source packet in which the final data of the subtitle is described are described.

  Subtitle_end_position_offset is information indicating the amount of data from the source packet having the first data of each subtitle to the source packet having the final data of the subtitle. Thus, the address of the source packet where the final data exists (source packet number) SPN) can be specified.

  That is, as in the case of video, as shown in FIG. 8, when data of a certain subtitle is read, reading is started from SPN_EP_start which is the first source packet in which the subtitle is described, and the amount indicated by Subtitle_end_position_offset Read the data.

  Next, ClipMark of the Clip Information file will be described. FIG. 9 is a diagram for explaining the relationship between ClipMarks and Clip AV streams. As shown in FIG. 9, this ClipMark indicates the playback time (section) of each subtile in the Clip AV stream. Here, the reproduction time is a time interval (duration) from when a subtitle is displayed on the screen until it disappears from the screen. Specifically, this ClipMark indicates the time (Subtitle_start_time) at which playback of each subtile on the time axis of the presentation time PTS of the Clip AV stream starts and the playback time (duration) (duration). When performing random access playback in a playback device to be described later, the above-described video EP_map, subtitle EP_map, and ClipMark are used to determine the read address of the subtitle displayed in synchronization with the video at the random access time, and playback can do.

  In this embodiment, the subtitle EP_map and ClipMark are created as separate files. However, the subtitle EP_map may have the above-described ClipMark information indicating the subtitle playback section. Good.

  Next, the recording operation of the information recording apparatus shown in FIG. 1 for recording such data will be described. FIG. 10 is a flowchart showing a recording operation method of the information recording apparatus. As shown in FIG. 10, first, video data and audio data are input to the AV encoder 2 and encoded (step S1). Further, the subtitle data is input to the subtitle encoder 3 and encoded (step S2). The encoded video stream (V) and encoded audio stream (A) generated by the AV encoder 2 and the encoded subtitle stream (S) generated by the subtitle encoder 3 are supplied to the multiplexer 4 and multiplexed. Then, it is packetized and an AV stream is created (step S3). That is, the multiplexed stream is packetized according to the application format of the recording medium on which the stream is recorded, and an AV stream composed of source packets is generated.

  The generated AV stream is supplied to the host control unit 6, and the control unit 6 analyzes the AV stream and creates an EP_map and a ClipMark for the AV stream (step S4). That is, in the transport stream, the presentation time PTS of each I picture, the address (source packet number) at which the I picture starts and the address at which the I picture ends are detected, and the data is tabulated for video. Create EP_map. Also, in the transport stream, the presentation time PTS of each subtitle and its subtitle are detected as the start address (source packet number) and the address at which the subtitle ends, and these data are tabulated to create a subtitle EP_map. . Furthermore, a ClipMark is created by tabulating the presentation time PTS and display time (duration) of the display start time of each subtitle.

  The AV stream file is subjected to predetermined processing by the ECC encoder 7 and the modulation unit 8 and then recorded on a recording medium (media) by the recording unit 9. Similarly, the EP_map and ClipMark generated by the control unit 6 are subjected to predetermined processing by the ECC encoder 7 and the modulation unit 8 and then recorded on the recording medium by the recording unit 9 (step S5).

  Next, an information reproducing apparatus for reading and reproducing data from a medium in which such a Clip AV stream file, Clip Information file, and PlayList are recorded will be described.

  FIG. 11 is a block diagram showing an information processing apparatus that reproduces data from a recording medium on which the above-described stream data and associated information are recorded. As shown in FIG. 10, the information processing apparatus 10 as a playback apparatus includes a reading unit (drive) 11 that reads data from a recording medium 28, a demodulator 12 that demodulates the read data, and an ECC decoding process. ECC decoder (decoder) 13, AV stream buffer 14, demultiplexer 15 that performs demultiplex processing, and encoded video stream (V) and encoded audio stream (A) are supplied from demultiplexer 15. An AV decoder 16 for decoding these, a subtitle decoder 17 for receiving the encoded subtitle stream (S) from the demultiplexer 15, and a display processor 18 for outputting and displaying the decoded video and audio data. , EP_map and ClipMark are supplied, and the control unit 1 controls the display of the display processor Composed of a.

  The control unit 19 refers to the video EP_map, the subtitle EP_map, and the ClipMark, and controls the reading of the reading unit 11 and the output of the display processor 18. That is, when random access is made, the subtitle including the presentation time stamp at the random access position in the playback section of each subtitle of ClipMark and the past I picture closest to the random access position are read and played back. This is what is controlled.

  Next, the reproducing operation of this reproducing apparatus will be described. First, the reading unit 11 reads EP_map and ClipMark data from a recording medium (media) such as a DVD. The EP_map and ClipMark data are subjected to predetermined processing by the demodulator 12 and the ECC decoder 13 and input to the host control unit 19.

  Next, the control unit 19 acquires a random access time. This random access time is instructed by a user from an interface (not shown), for example. And the control part 19 acquires the value of subtitle_start_time of the subtitle displayed synchronizing with the video of random access time based on ClipMark. That is, referring to the ClipMark, a presentation time stamp PTS (subtitle_start_time) indicating the start time of a subtitle included in the playback section among a plurality of playback sections in which the presentation time stamp PTS indicating the random access time is indicated in the ClipMark. get.

  Next, the control unit 19 uses the subtitle EP_map, the source packet number (SPN_EP_start) that is the start address of the subpicture where the value of the subtitle presentation time PTS (PTS_EP_start) is the value of the subtitle_start_time, and the subtitle of the subtitle. Acquire the data amount (Subtitle_end_position_offset). Further, the control unit 19 uses the video EP_map to indicate the start address of the I picture where the value of the presentation time stamp PTS (PTS_EP_start) of the I picture is the time closest to the presentation time stamp indicating the random access time. Get the source packet number (SPN_EP_start). Here, it is assumed that the I picture at the nearest past time is read.

  Next, the control unit 19 reads out the subtitle data specified by SPN_EP_start of the subtitle EP_map and Subtitle_end_position_offset from the Clip AV stream recorded on the recording medium. The read subtitle data is decoded by the subtitle decoder 17 and input to the display processor 18.

  Also, the Clip AV stream data is read from the address specified by SPN_EP_start having the time closest to the random access time selected with reference to the video EP_map. The read data is decoded by the AV decoder 16 and input to the display processor 18. Then, the display processor 18 starts reproduction by superimposing the decoded subtitle data on the video data at the specified random access time.

  Although the video signal has been described here, an audio EP_map can be created for the audio signal as described above, and can be reproduced in synchronization with the video by referring to the EP_map.

  Next, a method for performing random access playback using EP_map and ClipMark of Clip Information will be described in more detail. FIG. 12 is a flowchart showing a random access playback method. FIG. 13 is a schematic diagram showing the positional relationship on the stream data of addresses described in EP_map and ClipMark. Here, a method of referring to the video and subtitle EP_map and ClipMark in the case of random access at time pts_i on the video presentation time will be described.

  As shown in FIGS. 12 and 13, first, a subtitle displayed in synchronization with the video at the random access time pts_i is specified using ClipMark (step S21). That is, with reference to ClipMark, the subtitle in the duration is searched at the target time pts_i, and the subtitle whose time pts_i is included in the duration is selected. Here, for example, when the playback start time of any subtitle of ClipMark is Subtitle_start_time = pts_s and the duration is duration = x, the subtitle satisfying the condition pts_s ≦ pts_i ≦ pts_s + x is known as the target subtitle. Select a subtitle to fill. Here, for example, it is assumed that the subtitle ASub is selected as a target subtitle that satisfies the above conditions.

  Next, referring to the EP_map for subtitles, the value of the presentation time PTS_EP_start indicating the subtitle playback start time is the same as the subtitle ASub selected by the above ClipMark Subtitle_start_time = pts_s, that is, the subtitle ASub having PTS_EP_start = pts_s A source packet number SPN_EP_start (ASub) indicating the start address of the subtitle ASub and information Subtitle_end_position_offset (ASub) indicating the address where the subtitle ASub ends are acquired (step S22).

  Furthermore, referring to the video EP_map, SPN_EP_start (AVideo), which is the past time closest to the random access time pts_i, is selected for the presentation time PTS_EP_start indicating the playback start time of each I picture (step S23).

  Then, the subtitle ASub data specified by SPN_EP_start (ASub) and Subtitle_end_position_offset (ASub) corresponding to PTS_EP_start = pts_i selected in step 22 is read from the Clip AV stream (step S24). That is, data of the amount of Subtitle_end_position_offset (ASub) is read from the address indicated by SPN_EP_start (ASub).

  Next, it jumps to the address specified by SPN_EP_start (AVideo) where the predetermined I picture determined in step 23 starts (step S25), and reads the data of the Clip AV stream from the jump destination address (step S26). Thus, the subtitle (ASub) read in step 24 is superimposed on the I picture video (AVideo) of the past time closest to the random access time pts_i to start reproduction (step S27).

  In the present embodiment, video and subtitles are multiplexed to form one Clip AV stream, and this Clip AV stream and its associated information, Clip Information file, are recorded in separate files. This Clip Information file has an EP_map and a ClipMark. The EP_map is a correspondence between the presentation time stamp PTS (PTS_EP_start) of each I picture in the Clip AV stream and information (SPN_EP_start) indicating the address at which the picture starts. (EPN map for video) and information indicating the presentation time stamp PTS (PTS_EP_start) of each subtitle (subtitle data for one page) and the start and end addresses of the subtitle in the Clip AV stream (SPN_EP_start) , Subtitle_end_position_offset) and a table (EP_map for subtitle) describing the correspondence, and ClipMark includes a time (Subtitle_start_time) at which playback of each subtile in the Clip AV stream starts, a playback time (duration), and It is a table in which the correspondence of is described.

  Then, the attached information such as the subtitle address information is not embedded in the stream as in the prior art, but the attached information is recorded in a file different from the stream, thereby speeding up the process of reading the stream data. In other words, by creating the EP_map and ClipMark for subtitles as auxiliary information for subtitles that are played back synchronously with the video, only this auxiliary information can be read out first, and thus EP_map and ClipMark that are the auxiliary information are used. Thus, at the time of random access, the process of determining the readout address of the video and the subtitle to be reproduced in synchronization with the video can be performed easily and quickly.

  In the present embodiment, the subtitle has been described as an example. However, the present invention is not limited to this. In general, data (sub-reproduction information) in which the reproduction time is not constant for each data in a Clip AV stream (data The time interval from when it is displayed on the screen until it disappears from the screen can also be applied to data that is not constant for each data). For example, the present invention can be applied to still images used for continuous reproduction of still images (so-called slide show), graphic data displayed superimposed on video, and the like.

  It should be noted that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present invention. For example, the recording medium is distributed to provide a program to the user separately from the main body of the apparatus, for example, a magnetic disk such as a flexible disk on which the program is recorded, such as a CD-ROM (Compact Disk-Read Only Memory) And an optical disc such as a DVD (Digital Versatile Disk), a magneto-optical disc such as an MD (Mini-Disk), or a package medium such as a semiconductor memory, or provided in a state of being pre-installed in the apparatus main body. For example, it is composed of a ROM in which a program is recorded, a hard disk, or the like.

  In the above-described embodiment, the hardware configuration has been described. However, the present invention is not limited to this, and arbitrary processing may be realized by causing a CPU (Central Processing Unit) to execute a computer program. Is possible. In this case, the computer program can be provided by being recorded on a recording medium, or can be provided by being transmitted via the Internet or another transmission medium.

  As described above in detail, the information processing apparatus according to the embodiment of the present invention uses the video information and the video information and the sub-reproduction information that is reproduced in synchronization with the reproduction of the video information, from the stream data. Attached information creating means for creating attached information related to the sub-reproduction information, and a recording means for recording the stream data on a recording medium together with the attached information created by the attached information creating means, the attached information creating means, A video table describing a correspondence relationship between a presentation time stamp indicating a reproduction start time of the video information at an access point and an address in the stream data, and the video information reproduced in synchronization with the video information at the access point Create a secondary playback information table that describes the secondary playback information address. Therefore, a table for sub-reproduction information indicating the correspondence between the presentation time stamp (PTS) and its address is created from the stream data, and this is recorded separately from the stream data, so the table does not have to be decoded. Since the address of the sub reproduction information can be easily obtained, the reading and reproduction processing of the sub reproduction information is speeded up.

  Further, the information processing apparatus according to the embodiment of the present invention relates to the video information and the sub reproduction information from stream data having at least video information and sub reproduction information reproduced in synchronization with reproduction of the video information. Attached information creating means for creating attached information, a recording means for recording the stream data on a recording medium together with the attached information created by the attached information creating means, and a presentation time at a position randomly accessed from the recording medium Reproducing means for reproducing the video information and sub-reproduction information of the stamp, and control means for controlling the reproducing means with reference to the attached information, wherein the attached information creating means starts reproduction at the access point of the video information The presentation time stamp indicating the time and the address in the above stream data A video table in which the response relationship is described, and a sub-playback information table in which the address of the sub-playback information to be played back in synchronization with the video information at the access point and each playback section of the sub-playback information are described The control means refers to the video table and the sub-playback information playback table, and searches for sub-playback information including the presentation time stamp of the randomly accessed position within the playback section of the sub-playback information table. In addition, since the reproduction means is controlled to reproduce the sub reproduction information together with the video information at the access point, only the auxiliary information can be read in advance by recording the auxiliary information of the stream data separately from the stream data. For example, when performing random access playback, the desired secondary playback information from the secondary playback information table It acquires the address specified, also, the address of the random access video can be obtained from the video table, thus processing for random access reproduction is faster.

1 is a block diagram illustrating a recording apparatus according to an embodiment of the present invention. It is a figure which simplifies and shows the structure of the application format on the recording medium in embodiment of this invention. It is a figure which shows the data structure of the AV stream in embodiment of this invention. It is a figure explaining the relationship between EP_map and Clip AV stream. FIG. 2 is a diagram for explaining the structure of a video EP_map, where (a) is a diagram for explaining the position of a presentation time PST in a Clip AV stream, and (b) is an enlarged view of a part of the Clip AV stream shown in (a). (C) is a diagram showing the data structure of the video EP_map. It is a schematic diagram which shows the relationship between SPN_EP_start and I_end_position_offset in video EP_map. FIG. 6 is a diagram for explaining the structure of a subtitle EP_map, where (a) is a diagram for explaining the position of a presentation time PST in a Clip AV stream, and (b) is an enlarged view of a part of the Clip AV stream shown in (a). (C) is a diagram showing the data structure of the subtitle EP_map. It is a schematic diagram which shows the relationship between SPN_EP_start and Subtitle_end_position_offset in EP_map for subtitles. It is a figure explaining the relationship between ClipMark and a Clip AV stream. It is a flowchart which shows the recording operation method of an information recording device. It is a block diagram which shows the information reproduction apparatus in embodiment of this invention. It is a flowchart which shows the random access reproduction | regeneration method. It is a schematic diagram which shows the positional relationship on the stream data of the address described in EP_map and ClipMark. It is a schematic diagram which shows the structure of the program stream of the conventional DVD video.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,10 Information processing apparatus, 10 Information processing apparatus, 2 AV encoder, 3 Subtitle encoder, 4 Multiplexer, 5 Buffer, 6,19 Control part, 19 Control part, 7 ECC encoder, 8 Modulation part, 11 Reading part, 12 Demodulation 13 ECC decoder 14 Buffer 15 Demultiplexer 16 AV decoder 17 Subtitle decoder 18 Display processor 27 Recording unit 28 Recording medium

Claims (14)

Ancillary information creating means for creating adjunct information related to the video information and the sub-playback information from stream data having packetized video information and sub-playback information packetized and played back simultaneously with the playback of the video information When,
Recording means for recording the stream data on a recording medium together with the attached information created by the attached information creating means,
The attached information creation means is
Correspondence relationship between the first ID added to the video information packet, the presentation time stamp indicating the reproduction start time of each intra-frame encoded image at the video information access point, and the address in the stream data, and A video table having information indicating addresses at which each intra-frame coded image starts and ends;
Creating a second reproduction information table in which a second ID added to the packet of the sub reproduction information and an address of the sub reproduction information reproduced at the same time as the video information at the access point are described; Information processing apparatus.   The sub reproduction information table includes a sub reproduction information address search table in which a correspondence relationship between a presentation time stamp indicating a reproduction start time of the sub reproduction information and an address in the stream data is described. Item 6. The information processing apparatus according to Item 1.   The sub reproduction information table is a sub reproduction information reproduction in which a correspondence relationship between a presentation time stamp indicating a reproduction start time of the sub reproduction information and a presentation time stamp indicating a duration or a reproduction end time of the sub reproduction information is described. The information processing apparatus according to claim 1, further comprising a table.   3. The information processing apparatus according to claim 2, wherein the sub reproduction information address search table includes information indicating an address at which each sub reproduction information starts and ends.   2. The information processing apparatus according to claim 1, wherein the sub-playback information is a subtitle, a still image, or a graphic displayed superimposed on the video information. Attached information related to the video information and the sub reproduction information is obtained from the stream data including the video information recorded in a packet form and the sub reproduction information reproduced at the same time as the video information is reproduced and packetized. Attached information creation process to create,
A recording step of recording the stream data on a recording medium together with the attached information created in the attached information creating step,
In the attached information creation process,
The correspondence between the first ID added to the video information packet, the presentation time stamp indicating the reproduction start time at the access point of the video information, and the address in the stream data, and each intra-frame encoded image are A video table with information indicating the start and end addresses;
A second ID added to the sub reproduction information packet and a sub reproduction information table in which an address of the sub reproduction information reproduced at the same time as the video information at the access point is described are created. Information processing method.   The sub reproduction information table includes a sub reproduction information address search table in which a correspondence relationship between a presentation time stamp indicating a reproduction start time of the sub reproduction information and an address in the stream data is described. The information processing method according to claim 6.   The sub reproduction information table includes sub reproduction information in which a correspondence relationship between a presentation time stamp indicating a reproduction start time of the sub reproduction information and a presentation time stamp indicating a duration or a reproduction end time of the sub reproduction information is described. The information processing method according to claim 6, further comprising a reproduction table. A program for causing a computer to execute a predetermined operation,
Attached information related to the video information and the sub-playback information from the stream data having the packetized video information and the packetized sub-playback information that is played back simultaneously with the playback of the video information. Attached information creation process to create,
A recording step of recording the stream data on a recording medium together with the attached information created in the attached information creating step,
In the attached information creation process,
The correspondence between the first ID added to the video information packet, the presentation time stamp indicating the reproduction start time at the access point of the video information, and the address in the stream data, and each intra-frame encoded image are A video table with information indicating the start and end addresses;
Creating a second reproduction information table in which a second ID added to the packet of the sub reproduction information and an address of the sub reproduction information reproduced at the same time as the video information at the access point are described; Program to do. Along with stream data having packetized and recorded video information and packetized and recorded sub-playback information that is played back simultaneously with the playback of the video information, the first information added to the video information packet Corresponding relationship between the ID, the presentation time stamp indicating the reproduction start time at the access point of the video information, and the address in the stream data, and information for information indicating the address at which each intra-frame encoded image starts and ends A table, a second ID added to the packet of the sub-playback information, an address of the sub-playback information played back simultaneously with the video information at the access point, and a sub-section describing each playback section of the sub-playback information Random access from the recording medium on which the playback information table is recorded Reproducing means for reproducing the video information and sub playback information presentation time stamp of,
Control means for controlling the reproduction means with reference to the video table and the sub-reproduction information table,
The control means reproduces the sub reproduction information including the presentation time stamp of the randomly accessed position within the reproduction section of the sub reproduction information table and is close to the presentation time stamp of the sub reproduction information. An information processing apparatus for acquiring address information and controlling the reproduction means to reproduce at least information from a position where the intra-frame coded image starts to a position where it ends. Along with stream data having packetized and recorded video information and packetized and recorded sub-playback information that is played back simultaneously with the playback of the video information, the first information added to the video information packet Corresponding relationship between the ID, the presentation time stamp indicating the reproduction start time at the access point of the video information, and the address in the stream data, and information for information indicating the address at which each intra-frame encoded image starts and ends A table, a second ID added to the packet of the sub-playback information, an address of the sub-playback information played back simultaneously with the video information at the access point, and a sub-section describing each playback section of the sub-playback information Random access from the recording medium on which the playback information table is recorded A reproduction step of reproducing the video information and sub playback information presentation time stamp of
A control step of controlling the playback operation with reference to the video table and the sub-playback information table,
In the control step, sub-playback information including the presentation time stamp at the randomly accessed position in the playback section of the sub-playback information table is played back, and the time is close to the presentation time stamp of the sub-playback information. An information processing method comprising: acquiring address information, and controlling the reproduction operation so as to reproduce at least information from a position where the intra-coded image starts to an end position. A program for causing a computer to execute a predetermined operation,
Along with stream data having packetized and recorded video information and packetized and recorded sub-playback information that is played back simultaneously with the playback of the video information, the first information added to the video information packet Corresponding relationship between the ID, the presentation time stamp indicating the reproduction start time at the access point of the video information, and the address in the stream data, and information for information indicating the address at which each intra-frame encoded image starts and ends A table, a second ID added to the packet of the sub-playback information, an address of the sub-playback information played back simultaneously with the video information at the access point, and a sub-section describing each playback section of the sub-playback information Random access from the recording medium on which the playback information table is recorded A reproduction step of reproducing the video information and sub playback information presentation time stamp of
A control step of controlling the playback operation with reference to the video table and the sub-playback information table,
In the control step, sub-playback information including the presentation time stamp at the randomly accessed position in the playback section of the sub-playback information table is played back, and the time is close to the presentation time stamp of the sub-playback information. A program for acquiring address information and controlling the reproduction operation so as to reproduce at least information from a position where the intra-frame coded image starts to a position where it ends. Along with stream data having packetized and recorded video information and packetized and recorded sub-playback information that is played back simultaneously with the playback of the video information,
The correspondence between the first ID added to the video information packet, the presentation time stamp indicating the reproduction start time at the access point of the video information, and the address in the stream data, and each intra-frame encoded image are A video table in which information indicating start and end addresses is described;
The second ID added to the packet of the sub reproduction information and the sub reproduction information table describing the address of the sub reproduction information reproduced at the same time as the video information at the access point are recorded. A characteristic recording medium. A playback device that plays back a stream in which at least video information and sub-playback information are packetized has a data structure that enables random access to the stream data,
A correspondence relationship between a first ID added to the packet of the video information, a presentation time stamp indicating a reproduction start time at the access point of the packetized video information, and position information in the packetized stream data; And a video table in which information indicating addresses at which start and end of an intra-frame encoded image is required, which is necessary to obtain at least a picture to be displayed when the playback device performs random access, and ,
Correspondence between the second ID added to the packet of the sub reproduction information, the presentation time stamp indicating the reproduction start time at the access point of the sub reproduction information packetized, and the position information in the packetized stream data A data structure consisting of a sub-reproduction information table describing the relationship.

Images