WO2003085977A1

WO2003085977A1 - Information recording medium, information recording device and method, information reproducing device and method, information recording/reproducing device and method, computer program for control of recording or reproduction, and data structure including control signal

Info

Publication number: WO2003085977A1
Application number: PCT/JP2003/004452
Authority: WO
Inventors: Takeshi Koda; Nobuyuki Takakuwa; Tohru Kanegae; Masanori Nakahara; Takao Sawabe; Yasuko Fukuda; Akira Imamura
Original assignee: Pioneer Corporation
Priority date: 2002-04-08
Filing date: 2003-04-08
Publication date: 2003-10-16
Also published as: JP2003304496A; AU2003236338A1

Abstract

A whole stream comprising partial streams each of which is composed of content information including still picture information is multiply recorded in units of a packet on an information recording medium. The information recording medium contains a file where object data composed of packets each of which holds pieces of content information is stored and a file where information defining a object data reproduction sequence is stored. The object data includes still picture information and still picture control information for controlling the reproduction of the same. The still picture information is recorded in a partial stream different from the partial stream where the corresponding still picture control information is recorded.

Description

Specification

Information recording medium, information recording device and method, information reproducing device and method, information recording and reproducing device and method, computer program for recording or reproducing control, and data structure including control signal

The present invention relates to an information recording medium such as a high-density optical disk capable of recording various types of information such as main video, audio, sub-video, and reproduction control information at a high density, an information recording apparatus for recording information on the information recording medium, and Method, information reproducing apparatus and method for reproducing information from the information recording medium, information recording / reproducing apparatus and method capable of both recording and reproduction, computer program for recording or reproduction control, and reproduction control The invention relates to the technical field of data structures containing control signals. Background art

DVDs have become popular as optical discs on which various information such as main video, audio, sub-video, and playback control information are recorded. According to the DVD standard, the main video information (video data), audio information (audio data), and sub-picture information (sub-picture data) are each packetized together with playback control information (navigation data) to achieve high efficiency. It is multiplex-recorded on the disc in the program stream format of the MPEG2 (Moving Picture Experts Grouphase 2) standard, which is an encoding technology. Among these, the main video information contains data compressed according to the MPEG video format (ISO13818-2) for one stream in one program stream. On the other hand, audio information is recorded in multiple formats (ie, linear PCM, AC-3 and MPEG audio, etc.), and up to eight streams can exist in one program stream. The sub-picture information is defined by a bit map and is recorded by compression in a run-length format, and up to 32 streams can exist in one program stream. In this way, in the case of DVD, the adoption of the program stream format allows the selection of multiple streams of selectable audio information (for example, one movie, one stream of main video information). In addition to teleo audio or surround audio, original English audio, Japanese dubbed audio, ... and other streams, and multiple streams of selectable sub-picture information (for example, Japanese subtitles, English) Subtitles,… etc.) are multiplex-recorded. On the other hand, the transport stream format of the MPEG 2 standard has been standardized, which is suitable for data transmission. According to this transport stream format, a plurality of elementary streams are transmitted simultaneously. For example, a plurality of programs or programs, such as a large number of satellite digital broadcast television channels, are multiplexed in a time-division manner and transmitted simultaneously on one satellite wave. Disclosure of the invention

However, in the above-described DVD, only one stream of main video can be multiplex-recorded together with audio information and sub-video information of a plurality of streams, and the main video of a plurality of streams cannot be multiplex-recorded. In other words, a DVD that performs recording in conformity with the MPEG 2 program stream format can essentially multiplex-record a plurality of programs or programs simultaneously transmitted in the above-described MPEG 2 transport stream format. There is a problem that there is no.

Further, even if a disc having a high transfer rate and a large recording capacity or a high density recording capable of simultaneously recording a plurality of programs or a plurality of programs transmitted in the MPEG-2 transport stream format, Frequently recording and reproducing a huge amount of still image information such as bitmap data along the reproduction time axis is not appropriate from the viewpoint of data efficiency. In particular, if only a broadcast is received in real time and displayed and output via a tuner, the display processing of such still image information is relatively simple, but the still image information is used as a discretionary stream as one of the elementary streams. After being recorded in the, it is subject to special playback such as time search and chapter search by the user or interactive playback. For this reason, the load on the reproduction and display processing of still image information and the like consisting of bitmap data having a huge data amount sometimes becomes extremely large. In order to deal with this, hardware performance etc. must be specified exclusively for processing the still image information. With respect to the power that would require significant enhancement or still image information, there would be technical problems such as reduced image quality or limited special or interactive playback.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-described problems, and allows still image information having a relatively large data amount to be multiplex-recorded together with moving image information, audio information, and the like. Information recording medium, information recording apparatus and method, information recording apparatus and method, information recording and reproducing apparatus and method, computer program for recording or reproduction control, and control for reproduction control while reproducing the still image information It is an object to provide a data structure including a signal.

In order to solve the above problems, the information recording medium of the present invention has a structure in which an entire stream including a plurality of partial streams each composed of a series of content information is stored in physically accessible units. An information recording medium that is multiplex-recorded in a packet unit, and is a logically accessible unit, and stores object data including a plurality of packets each including a packet for storing a fragment of the content information. The multiplexing includes: an object data file to be stored; a reproduction sequence information file that stores reproduction sequence information that defines a reproduction sequence of the object data; and reproduction control information for controlling reproduction of the object data. Defining the correspondence between a plurality of buckets to be created and the plurality of partial streams. An object information file that stores correspondence definition information, wherein the entire stream includes a partial stream composed of still image information, which is one of the content information, and the plurality of partial streams. And further includes another partial stream composed of still image control information for controlling the display of the still image information.

According to the information recording medium of the present invention, for example, an entire stream such as at least a part of an MPEG-2 transport stream includes a plurality of partial streams such as an elementary stream. The partial stream is composed of a series of contents that can be reproduced by the information reproducing apparatus, such as video information or sub-video information (for example, video data or sub-picture data) or audio information (for example, audio data). Be composed. That is, in this application, one “partial stream” The “system” refers to a single data array or information array such as a video stream, an audio stream, a sub-picture stream, etc., which form a series of contents, such as an elementary stream. On the other hand, in the present application, one “whole stream” refers to a data array or information array in which a plurality of partial streams are bundled. The entire stream may be an MPEG-2 transport stream composed of m elementary streams (where m is a natural number of 2 or more) and n (n , N is a natural number of 2 or more and less than m). A data array or an information array formed by bundling the elementary streams may be used. Then, in the present invention, the entire stream includes at least one partial stream (for example, a sub-picture stream) composed of still image information and still image control information.

The entire stream configured as described above is multiplex-recorded on the information recording medium in units of packets (for example, TS packets described later), which are units physically accessible by the information reproducing apparatus. . Here, the object data file is a unit logically accessible by the information reproducing apparatus and stores object data composed of a plurality of packets each storing a fragment of content information. The reproduction sequence information file stores reproduction sequence information (for example, play list information) that specifies a reproduction sequence of the object data stored in the object data file. The object information file includes correspondence definition information that defines the correspondence between a plurality of multiplexed packets and a plurality of partial streams (for example, an ES map table described later and an ES_PID (ES Bucket ID), ES address information, or AU table.

Therefore, at the time of reproduction, one or more desired partial streams of the entire stream can be selectively reproduced based on the correspondence definition information. At this time, the reproduction is scheduled based on the reproduction sequence information. Can be executed in accordance with the reproduced sequence. Unlike the object data file, the various information stored in the object information file and the reproduction sequence information file are not multiplexed on the information recording medium in the unit of the packet. Therefore, based on the reproduction control information and the reproduction sequence information, the object in the information reproducing apparatus is determined. Data can be reproduced relatively easily.

In the present invention, in particular, the whole stream includes a partial stream composed of still image information (for example, a sub-picture stream for still image information). And a partial stream (for example, a sub-picture stream for still image control information). Therefore, at the time of reproduction, the still image information on one partial stream is obtained by the still image control information on a separate partial stream (that is, stored in a packet constituting a separate partial stream). Display can be controlled. Further, the same still image information on one partial stream can be displayed and controlled in different formats by a plurality of still image control information on a plurality of separate partial streams. In other words, different display is possible by reusing the same still image information, so that the amount of data required to execute still image display as a whole can be reduced, and the structure of recorded data can be simplified. It is also possible to achieve. Alternatively, different display is possible by using the same still image control information for a plurality of pieces of still image information.

In this way, as in the conventional case, the still image information and its control information are read every time the still image information composed of, for example, bitmap data or JPEG data is displayed, and the information is discarded when the display is completed. Compared with the technology of reading out still image information and its control information, the data processing load for displaying a still image can be reduced and the data use efficiency can be improved.

As a result of the above, for example, the still picture information included as the sub-picture stream in the transport stream of MPEG2 can be appropriately reproduced together with other main video information and audio information, or alone. At this time, even when performing special playback such as time search, chapter search, fast forward, and rewind, that is, when starting playback from an arbitrary time, a relatively large data amount such as a bitmap or JPEG The image information can be efficiently reproduced together with the moving image information and the audio information in any case, and the increase in the load in the reproducing process is effectively suppressed.

In one aspect of the information recording medium of the present invention, the entire stream is composed of a plurality of pieces of still image control information for performing different display controls on the same still image information as the other partial stream. Includes multiple partial streams. According to this aspect, at the time of reproduction, a desired or specific one is selected from a plurality of partial streams for controlling a still image in response to, for example, a selection operation or a conditional branch by the user. The same still image information on a partial stream for still image information can be displayed and controlled in different formats by a plurality of pieces of still image control information on a plurality of separate partial streams.

In another aspect of the information recording medium of the present invention, the correspondence definition information includes at least a part of a serial number of a bucket constituting each partial stream and a display start time corresponding to the serial number. Address information for each of the plurality of partial streams. With this configuration, at the time of reproduction, the position of the packet in the object data file can be specified based on the serial number of the packet and the display start time thereof, and the desired partial stream can be appropriately reproduced. At this time, by sharing the address information between the partial stream for the still image information and the corresponding partial stream for the still image control information, the data amount of the address information is increased. Can be suppressed.

Alternatively, in another aspect of the information recording medium of the present invention, the packet related to the one partial stream is a still image information set including the still image information and further includes structure information indicating the structure thereof. The packet relating to the other partial stream includes a packet for storing each fragment of the still image information set, and the packet relating to the other partial stream is a still image information set including the still image control information, and is structural information indicating the structure thereof. And a packet for storing the fragments of the still image information set further including ·

According to this aspect, the packet related to the partial stream for still image information includes a packet that stores a still image information set including still image information and structure information. On the other hand, the packet relating to the partial stream for still image control information includes a packet storing a still image information set including still image control information and structural information. Here, the “still image information set” has a predetermined structure in which the data amount is variable or fixed, including one or both of the still image information and the still image control information and the structure information indicating the structure. This is an information set. Therefore, at the time of reproduction, if first access is made to the structural information having an identifier or the like in the object data file, for example, the still image information or the still image control information included in the still image information set including this structural information is accessed according to the content. Can be obtained. More specifically, one still image information set is composed of multiple or multiple packets. Even if the still image information set is identified by, for example, specifying the address of the first packet in which the identifier of the structural information or the like is arranged (for example, by counting the packets in the structure). The address of the still image information and still image control information included in the image can be specified. As a result, the display control of the still image information in the still image information set on one partial stream can be performed based on the still image control information in the still image information set on another partial stream.

In the aspect according to the still image information set, the packet storing the structure information may be placed at the top of a plurality of buckets according to the still image information set. With such a configuration, the structure of the still image information set can be specified by searching for and reading the first packet of the still image information set in the object data file during reproduction. This makes it possible to easily specify a bucket that stores the still image information and the still image control information that make up the still image information set.

If the amount of information in the structure information is smaller than the packet, the entire structure information and a part of the still image information or the still image control information may be stored in the same first packet. Alternatively, the structure may be such that only the structure information is stored in one head packet. Alternatively, if the amount of information in the structure information is large compared to the packet, the structure information may be configured to be stored in a plurality of packets. In the aspect according to the still image information set, the structure information includes an identifier of the still image information, a data length of the still image control information, a data length of the still image information, and a recording position of the still image information. At least the identifier may be included in the indicated location information. With this configuration, each still image information set is searched for in the object data file by searching for an “identifier” of the still image information set, for example, by first narrowing down to an entry section specified at the time of reproduction as described later. Can be found relatively quickly and easily. In particular, for a still image information set including still image control information, it is possible to specify how many packets storing this information are arranged based on the data length of the still image control information. On the other hand, for a still image information set including still image information, it is possible to specify how many buckets storing this information are arranged based on the data length of the still image information. As described above, according to the data length of the still image information and the data length of the still image control information as the structure information, one still image information set includes Even if the packet is divided into a number of packets, it is possible to specify the addresses of all the packets in the still image information set by specifying the address of the first packet. In other words, the amount of data in the correspondence definition information, particularly the address information of the packet, to be stored in the object information file can be reduced.

As the “position information indicating the recording position of the still image information”, in the case of the still image information set including the still image control information, the position information indicating the recording position of the still image information to be display-controlled ( For example, an entry section) may be used. On the other hand, in the case of a still image information set including still image information, the position information of the still image information is unnecessary because the still image information itself is included. In this case, for example, information indicating that the position information is invalid is described.

In addition, by setting the data length of the still image information to “0” or a predetermined value indicating invalidity, it is possible to indicate that the still image information set is a still image information set including still image control information. Good. Alternatively, a still image information set including still image information may be indicated by setting the data length of the still image control information to “0” or a predetermined value indicating invalidity.

In the aspect including the still image information set, the correspondence definition information includes at least a part of a serial number of a bucket constituting each partial stream and a display start time corresponding to the serial number. Address information for each of the plurality of partial streams.

With this configuration, at the time of reproduction, the position of the packet in the object data file can be specified based on the serial number of the packet and the display start time, and the desired partial stream can be appropriately reproduced.

When the correspondence definition information has address information as described above, the correspondence definition information is, for the one partial stream, the position in the address information among a plurality of packets constituting the one partial stream. It is determined whether or not the first packet of the still image information set including the still image information exists in one section of the entry specified by only two packets adjacent to each other. Flag may be included.

With this configuration, at the time of playback, the corresponding definition information is By reference, the address information is not directly specified, but a section of the entry where they exist is specified instead. Then, after the entry section in which the still image information exists is specified, the multiplexed packet of the object file 內, which is in the specified entry section, is searched for. Still image information can be found easily and quickly (for example, by finding its header, identifier, etc.).

Here, between two packets is not described as between two consecutive numbers related to the two packets, but as between the display start times of the still image information related to the two packets. Is preferred. With such a description, even if some packets are removed by the editing work and the serial numbers of the packets are shifted from the beginning, there is no difference between the display times. However, in an environment where such editing work or the like can be ignored, the space between two packets may be described as between two consecutive numbers related to the two packets.

When the correspondence definition information includes address information, the correspondence definition information includes, for the other partial stream, still image information including the still image control information in the entry section. A flag may be included to indicate whether the first bucket in the set exists.

With this configuration, at the time of playback, the address information is not directly specified by referring to the corresponding definition information for the still image control information. Instead, the entry section in which they exist is determined. Specified. Then, after the section of the entry where the still image control information exists is specified, the multiplexed packets in the object file that are actually in the specified entry section are searched for. By doing so, the still image control information can be searched out easily and quickly (for example, by finding its header, identifier, etc.).

When the correspondence definition information includes address information as described above, and when the content information includes video information based on the MPEG-2 standard, the address information includes a serial number of a packet related to an I picture and a And a display start time corresponding to the display start time.

With this configuration, during playback, the serial number of the packet related to the I picture is Based on this, the address of the packet can be specified, and the I picture can be reproduced based on the display start time corresponding to the address. Further, based on the I picture, a B picture and a P picture can be reproduced, and when there is audio information corresponding to such video information, the audio information can be reproduced. In other words, it is possible to access packets related to I-pictures, and it is also possible to access packets related to video information and audio information related to the accessed I-pictures. Will be reproducible. At this time, in particular, since it is not necessary to describe the address information of the packet relating to the B picture and the P picture and the address information of the bucket relating to the corresponding audio information, the amount of information to be recorded on the information recording medium as a whole is not necessary. Reduction can be achieved.

In another aspect of the information recording medium of the present invention, the still image control information includes information indicating a display start time of a still image displayed based on the still image information and a display time of the still image.

According to this aspect, based on the display start time and the information indicating the display time of the still image included in the still image control information, the still image reproduction using the corresponding still image information is performed according to the intention of the maker. Can be executed for a desired time.

In the information recording medium of the present invention, the correspondence definition information may further include table information indicating, for each content information, a packet identification number uniquely assigned to a plurality of packets multiplexed at the same time. . With such a configuration, desired content information can be obtained at any playback time by referring to table information (for example, an ES map table or ES address information described later) indicating a packet identification number for each content information. You can quickly identify which bucket is being handled. As a result, a desired partial stream can be reproduced.

In order to solve the above-mentioned problems, the information recording apparatus of the present invention physically stores, on an information recording medium, an entire stream including a plurality of partial streams each composed of content information forming a series of contents. An information recording apparatus for performing multiplex recording in packet units, which are accessible units, and a plurality of packets including packets each storing a fragment of the content information as well as a logically accessible unit. First recording means for recording an object data file for storing object data comprising: a reproduction sequence for defining a reproduction sequence of the object data; Second recording means for recording a reproduction sequence information file for storing reproduction information, and the plurality of multiplexed buckets and the plurality of partial streams as reproduction control information for controlling reproduction of the object data. And a third recording unit that records an object information file that stores correspondence definition information that defines correspondence relations among the content information, wherein the entire stream includes still image information that is one of the content information. One of the plurality of partial streams as one of the plurality of partial streams, and in addition to this, another partial stream composed of still image control information for controlling the display of the still image information. Including.

According to the information recording apparatus of the present invention, for example, an object data file for storing object data is recorded by first recording means such as a system controller, an encoder, a TS object generator described below, and an optical pickup. A reproduction sequence information file for storing reproduction sequence information is recorded by a second recording means such as a system controller, an encoder, a TS object generator, and an optical pickup, which will be described later. Object information that stores, as reproduction control information, corresponding definition information that defines a correspondence between a plurality of multiplexed buckets and a plurality of content information by a third recording unit such as a photo generator or an optical pickup. Record a file. The whole stream includes one partial stream composed of still image information, and further includes another partial stream composed of still image control information. Accordingly, various types of content information including bitmap and still image information such as JPEG, such as at least a part of the transport stream of MPEG2, are multiplex-recorded on the above-described information recording medium of the present invention. it can.

Incidentally, the information recording apparatus of the present invention can also adopt various aspects in correspondence with the various aspects of the information recording medium of the present invention described above.

In order to solve the above-mentioned problems, the information recording method of the present invention physically stores an entire stream including a plurality of partial streams each composed of a series of content information on an information recording medium. An information recording method for multiplexing recording in bucket units, which are accessible units, comprising a plurality of buckets including buckets each storing a fragment of the content information as well as a logically accessible unit. From A first recording step of recording an object data file storing object data, a second recording step of recording a reproduction sequence information file storing reproduction sequence information defining a reproduction sequence of the object data, r As playback control information for controlling the playback of the cut data, an object information file storing correspondence definition information defining the correspondence between the plurality of multiplexed buckets and the plurality of partial streams is provided. A third recording step of recording, wherein the entire stream includes one partial stream composed of still image information that is 3 of the content information as one of the plurality of partial streams, In addition to the above, other information including still image control information for controlling the display of the still image information is provided. Further comprising a part stream-.

According to the information recording method of the present invention, an object data file storing object data is recorded in a first recording step, and a reproduction sequence information file storing reproduction sequence information is recorded in a second recording step. In the third recording step, an object information file storing correspondence definition information defining correspondence between a plurality of multiplexed packets and a plurality of partial streams is recorded as reproduction control information. The whole stream includes one partial stream composed of still image information, and further includes another partial stream composed of still image control information. Accordingly, various types of content information including still image information such as bitmaps and JPEG data, such as at least a part of the transport stream of MPEG2, can be multiplex-recorded on the above-described information recording medium of the present invention.

Incidentally, the information recording method of the present invention can also adopt various aspects in correspondence with the various aspects of the information recording medium of the present invention described above.

In order to solve the above problems, an information reproducing apparatus of the present invention is an information reproducing apparatus for reproducing the recorded content information from the information recording medium of the present invention (including various aspects thereof), Reading means for physically reading information from the information recording medium; and information read by the reading means based on the reproduction control information and the reproduction sequence information contained in the information read by the reading means. Reproducing means for reproducing the included object data.

According to the information reproducing apparatus of the present invention, the optical pickup, the reading means such as a demodulator, Information is physically read from the information recording medium in packet units or the like. Then, based on reproduction control information and reproduction sequence information included in the read information, object data included in the read information is reproduced by reproduction means such as a system controller, a demultiplexer, and a decoder. Therefore, the content information multiplex-recorded on the information recording medium of the present invention can be appropriately reproduced as a series of content information. At this time, in particular, still image information such as bitmaps and JPEGs, which have a relatively large data amount, can be efficiently played back, and an increase in the load in the playback processing is effectively suppressed.

Incidentally, in response to the various aspects of the information recording medium of the present invention described above, the information reproducing apparatus of the present invention can also adopt various aspects.

In one aspect of the information reproducing apparatus of the present invention, the reproducing means includes at least one of the still image information read from the one partial stream and the still image control information read from the other partial stream. One is temporarily stored in a buffer, and display control for the still image information is executed based on the still image control information.

According to this aspect, it is possible to control the display of the same still image information in different formats by using a plurality of pieces of still image control information, and to control the display of a plurality of different pieces of still image information by using the same still image control information. It becomes possible to execute suitably.

In order to solve the above-mentioned problems, an information reproducing method according to the present invention is an information reproducing method for reproducing the recorded content information from the above-described information recording medium (including various aspects thereof), A reading step of physically reading the information from the information recording medium; and, based on the reproduction control information and the reproduction sequence information included in the information read in the reading step, included in the information read in the reading step. Reproducing the object data to be reproduced.

According to the information reproducing apparatus of the present invention, in the reading step, information is physically read from the information recording medium in packet units or the like. Then, in the reproduction step, the object data included in the read information is reproduced based on the reproduction control information and the reproduction sequence information included in the read information. Therefore, the content information multiplex-recorded on the information recording medium of the present invention can be appropriately reproduced as a series of content information. In particular, bitmaps and JPEs with relatively large data Still image information such as G can be played back efficiently, and the increase in the burden of playback processing is effectively suppressed.

Incidentally, the information reproducing method of the present invention can also adopt various aspects in correspondence with the various aspects of the information recording medium of the present invention described above.

In order to solve the above-mentioned problems, an information recording / reproducing apparatus of the present invention records the content information on the information recording medium of the present invention (including various aspects thereof) and reproduces the recorded content information. An information recording / reproducing apparatus, comprising: first recording means for recording the object data file; second recording means for recording the reproduction sequence information file; and third recording means for recording the object information file. Reading means for physically reading information from the information recording medium; and information read by the reading means based on the reproduction control information and the reproduction sequence information contained in the information read by the reading means. Reproducing means for reproducing the contained object data.

According to the information recording / reproducing apparatus of the present invention, similarly to the above-described information recording apparatus of the present invention, the first recording means records the object data file, and the second recording means records the reproduction sequence information file. Record, and record the object information file by the third recording means. Thereafter, similarly to the above-described information reproducing apparatus of the present invention, information is physically read from the information recording medium by the reading means, and the reproduction control information and the reproduction sequence information included in the read information are read by the reproducing means. The object data included in the read information is reproduced based on the information. Accordingly, various types of content information including still image information such as bitmaps and JPEG, such as at least a part of the MPEG-2 transport stream, can be multiplex-recorded on the above-described information recording medium of the present invention. The multiplex-recorded content information can be properly reproduced, including still image reproduction.

Incidentally, the information recording / reproducing apparatus of the present invention can also adopt various aspects in correspondence with the various aspects of the information recording medium of the present invention described above.

In order to solve the above problems, an information recording / reproducing method of the present invention records the content information on the information recording medium of the present invention (including various aspects thereof) and reproduces the recorded content information. An information recording / reproducing method, comprising: Data file, a second recording step of recording the reproduction sequence information file, a third recording step of recording the object information file, and physically reading information from the information recording medium. A reading step, and, based on the reproduction control information and the reproduction sequence information included in the information read in the reading step, generating the object data included in the information read in the reading step. And a regeneration step.

According to the information recording / reproducing method of the present invention, similarly to the above-described information recording method of the present invention, an object data file is recorded in a first recording step, and a reproduction sequence information file is recorded in a second recording step. Record, and record the object information file in the third recording step. Thereafter, similarly to the above-described information reproducing method of the present invention, the reading step physically reads the information from the information recording medium, and the reproducing step executes the reproduction control information and the reproduction sequence information included in the read information. The object data included in the read information is reproduced based on the information. Therefore, various types of content information including still image information such as bitmaps and JPEG, such as at least a part of the MPEG-2 transport stream, can be multiplex-recorded on the above-described information recording medium of the present invention. The multiplex-recorded content information can be properly reproduced, including still image reproduction.

Incidentally, in response to the various aspects of the information recording medium of the present invention described above, the information recording / reproducing method of the present invention can also adopt various aspects.

In order to solve the above-mentioned problems, a recording control computer program of the present invention is a recording control computer program for controlling a computer provided in the above-described information recording apparatus of the present invention (including its various aspects). Wherein the computer functions as at least a part of the first recording unit, the second recording unit, and the third recording unit.

According to the recording control computer program of the present invention, the computer program is read from a recording medium such as a ROM, a CD-ROM, a DVD-ROM, or a hard disk that stores the computer program, and executed by the computer. If the computer program is executed after being downloaded to the computer via the communication means, the above-described information recording apparatus according to the present invention is provided. Can be realized relatively easily.

In order to solve the above-described problems, a computer program for reproduction control of the present invention is a computer for reproduction control for controlling a computer provided in the above-described information reproducing apparatus of the present invention (including various aspects thereof). A program, which causes the computer to function as at least a part of the reproducing unit.

According to the computer program for reproduction control of the present invention, if the computer program is read from a recording medium such as a ROM, a CD-ROM, a DVD-ROM, or a hard disk that stores the computer program and executed by the computer, Alternatively, if the computer program is executed after being downloaded to a computer via communication means, the above-described information reproducing apparatus according to the present invention can be realized relatively easily.

In order to solve the above-mentioned problems, a computer program for recording / reproducing control according to the present invention is a computer program for controlling a computer provided in the information recording / reproducing apparatus of the present invention (including its various aspects). And causing the computer to function as at least a part of the first recording unit, the second recording unit, the third recording unit, and the reproducing unit.

According to the recording / reproduction control computer program of the present invention, the computer program can be read and executed from a recording medium such as a ROM, a CD-ROM, a DVD-ROM, or a hard disk that stores the computer program. Alternatively, if the computer program is executed after being downloaded to a computer via the communication means, the above-described information recording / reproducing apparatus according to the present invention can be realized relatively easily.

In order to solve the above-mentioned problems, the data structure including the control signal of the present invention is capable of physically accessing an entire stream including a plurality of partial streams each composed of a series of content information. That is multiplexed and recorded in packet units, which are logical units, and that stores logically accessible object data that is composed of a plurality of buckets including packets that respectively store fragments of the content information. Playback data file and a playback sequence information file that stores playback sequence information that defines the playback sequence of the object data. Object information that stores, as reproduction control information for controlling reproduction of the object data, correspondence definition information that defines a correspondence between the plurality of multiplexed buckets and the plurality of partial streams. File, and the whole stream includes one partial stream composed of still image information as one of the content information as one of the plurality of partial streams. And further includes another partial stream composed of still image control information for controlling the display of the still image information.

According to the data structure including the control signal of the present invention, as in the case of the above-described information recording medium of the present invention, a still image such as a bit map or a JPEG is compliant with the transport stream of MPEG2, for example. Complex content information including information can be multiplex-recorded and played back including still image playback.

Incidentally, the data structure including the control signal of the present invention can also adopt various aspects, corresponding to the various aspects of the information recording medium of the present invention described above.

A first program storage device of the present invention is a program storage device that can be read by a computer provided in an information recording device, in order to solve the above-mentioned problem. It explicitly embodies a computer program capable of executing the program.

A second program storage device according to the present invention is a program storage device readable by a computer provided in an information reproducing device, in order to solve the above-mentioned problem. It explicitly embodies a computer program capable of executing the program.

A third program storage device of the present invention is a program storage device that can be read by a computer provided in an information recording / reproducing device in order to solve the above-mentioned problem. Explicitly embody a computer program capable of executing the reproduction method.

According to the first, second, or third program storage device of the present invention, the computer program is read into a computer from a program storage device such as a ROM, a CD-ROM, a DVD-ROM, or a hard disk that stores the computer program. Or execute the computer program via communication means. If the program is executed after being downloaded to a computer, the above-described information recording method, information reproducing method, or information recording / reproducing method according to the present invention can be realized relatively easily. A computer data signal embodied by the first transmission wave according to the present invention is a series of computer data signals for causing a computer provided in an information recording apparatus to execute the information recording method according to the present invention. Indicates an instruction.

A computer data signal embodied by the second transmission wave according to the present invention is a series of computer data signals for causing a computer provided in an information reproducing apparatus to execute the information reproducing method according to the present invention. Indicates an instruction.

A computer data signal embodied by the third transmission wave according to the present invention is configured to cause a computer provided in an information recording / reproducing apparatus to execute the above-described information recording / reproducing method of the present invention in order to solve the above-mentioned problems. Here is a simple sequence of instructions.

According to the computer data signal embodied by the first, second or third transmission wave of the present invention, the computer program is downloaded to a computer by a computer data signal via a computer network or the like, and is executed. For example, the above-described information recording method, information reproducing method, or information recording / reproducing method according to the present invention can be realized relatively easily.

The operation and other advantages of the present invention will become more apparent from the embodiments explained below. BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 shows the basic structure of an optical disk as an embodiment of the information recording medium of the present invention. The upper part is a schematic plan view of an optical disk having a plurality of areas, and the lower part corresponding thereto is shown in FIG. FIG. 4 is a schematic conceptual view of an area structure in the radial direction. Fig. 2 shows a schematic conceptual diagram of the conventional MPEG 2 program stream (Fig. 2 (a)) and a schematic conceptual diagram of the MPEG 2 transport stream used in this embodiment (Fig. 2 (b)). It is.

FIG. 3 is a diagram schematically illustrating a data structure recorded on the optical disc of the present embodiment.

Fig. 4 schematically shows the details of the data structure in each object shown in Fig. 3. FIG.

FIG. 5 shows that the elementary stream for the upper program # 1 and the elementary stream for the middle program # 2 in this embodiment are multiplexed, and the transport stream for these two programs is multiplexed. FIG. 3 is a diagram conceptually showing how is configured with the horizontal axis as a time axis.

FIG. 6 conceptually shows an image of a TS packet multiplexed in one transport stream in the present embodiment as a bucket arrangement along time.

FIG. 7 is a diagram schematically illustrating a logical configuration of data on an optical disc in the embodiment, focusing on development from a logical hierarchy to an object hierarchy or a physical hierarchy.

FIG. 8 is a block diagram of the information recording / reproducing apparatus according to the embodiment of the present invention.

FIG. 9 is a flowchart showing a recording operation (No. 1) of the information recording / reproducing apparatus in the present embodiment.

FIG. 10 is a flowchart showing a recording operation (No. 2) of the information recording / reproducing apparatus in the present embodiment.

FIG. 11 is a flowchart showing a recording operation (part 3) of the information recording / reproducing apparatus in the present embodiment.

FIG. 12 is a flowchart showing a recording operation (part 4) of the information recording / reproducing apparatus in the present embodiment.

FIG. 13 is a flowchart showing a reproducing operation of the information recording / reproducing apparatus in the present embodiment.

FIG. 14 is a conceptual diagram showing an example of a data structure in EST address information related to a video stream constructed in an ES map table in object information in the embodiment.

FIG. 15 is a conceptual diagram schematically showing an example of the position of the TS bucket registered in the ES address information of the video stream on the TS object with respect to the time axis.

FIG. 16 shows the contents of SP data, SP control information, and structure information according to the first method of acquiring SP data and SP control information in the embodiment. It is a conceptual diagram.

FIG. 17 is a diagram illustrating a subpicture structure according to the embodiment.

FIG. 18 is a conceptual diagram showing the packet arrangement conditions employed in the first acquisition method on the time axis of the TS object.

FIG. 19 is a conceptual diagram showing an acquisition procedure in the first acquisition method.

FIG. 20 is a conceptual diagram showing the data structure (SP data identification flag) of the ES address information relating to the sub-picture stream (stream for SPD) in the TS object # shown in FIG.

FIG. 21 is a conceptual diagram showing a data structure (SCP identification flag) of the ES address information related to the sub-picture stream (SCP stream) in the TS object shown in FIG.

FIG. 22 is a conceptual diagram showing the structure information, the SP control information, and the contents of the SP data according to the second method of acquiring the SP data and the SP control information in the embodiment.

FIG. 23 is a conceptual diagram showing an acquisition procedure in the second acquisition method.

FIG. 24 is a conceptual diagram showing a specific example of the structure information and the SP control information according to the second acquisition method.

FIG. 25 is a conceptual diagram showing a form in which a new sub-picture is formed by applying SP control information to SP data in a specific example of still image playback control according to the embodiment.

FIG. 26 is a conceptual diagram showing a form in which a subframe is cut out from SP data in a specific example of still image playback control.

FIG. 27 is a conceptual diagram showing the data structure of the AU and PU when sub-picture data and a plurality of SP control information are provided separately in separate streams in a specific example of still image playback control. It is.

FIG. 28 is a conceptual diagram showing the relationship between an SPD stream and a plurality of SCP streams in a specific example of still image playback control.

FIG. 29 is a conceptual diagram showing one display mode in which a sub-frame is cut out from a sub-picture and displayed in a specific example of still image reproduction control. FIG. 30 is a conceptual diagram showing another display mode in which a sub-frame is cut out from a sub-picture and displayed in a specific example of reproduction control of a still image.

FIG. 31 is a diagram conceptually showing the entire access flow at the time of reproduction in relation to the logical structure of the optical disc in the present embodiment.

FIG. 32 is a diagram schematically illustrating a specific example of the data configuration of the disk information file in a specific example according to the present embodiment.

FIG. 33 is a diagram schematically illustrating a specific example of the data configuration of the title information table included in the disk information file in a specific example according to the present embodiment.

FIG. 34 is a diagram schematically illustrating a specific example of a data configuration in a playlist information table constructed in a playlist information file in a specific example according to the present embodiment.

FIG. 35 is a diagram schematically showing a specific example of a data configuration in an AU table constructed in an object information file and an ES map table associated therewith in one specific example according to the present embodiment. BEST MODE FOR CARRYING OUT THE INVENTION

(Information recording medium)

An embodiment of the information recording medium of the present invention will be described with reference to FIGS. In this embodiment, the information recording medium of the present invention is applied to an optical disk of a type capable of recording (writing) and reproducing (reading).

First, the basic structure of the optical disc of the present embodiment will be described with reference to FIG. FIG. 1 is a schematic plan view showing the structure of an optical disk having a plurality of areas on the upper side, and the area structure in the radial direction is shown on the lower side in association with a conceptual diagram.

As shown in FIG. 1, the optical disc 100 can be recorded by various recording methods, such as a magneto-optical method and a phase change method, which can record (write) plural times or only once. Like the DVD, on the recording surface of the disc body with a diameter of about 12 cm, the lead-in area 104, the data area 106 and the lead-out from the inner circumference to the outer circumference centered on the center hole 102. An area 108 is provided. And In each area, for example, a group track and a land track are provided alternately in a spiral or concentric manner centering on the center hole 102, and this group track may be coupled. Prepits may be formed on one or both of the tracks. The present invention is not particularly limited to an optical disk having such three areas.

Next, the configuration of the transport stream (TS) recorded on the optical disc of the present embodiment will be described with reference to FIG. Here, Fig. 2 (a) schematically shows the structure of an MPEG 2 program stream in a conventional DVD for comparison, and Fig. 2 (b) shows the MPEG 2 transport stream (TS). This is a diagram schematically showing the configuration of the present invention.

In Fig. 2 (a), one program stream includes only one video stream for video data as main video information along the time axis t, and further, an audio stream for audio data as audio information. And a maximum of 32 Suppose Streams for sub-picture data as sub-picture information. That is, the video data multiplexed at an arbitrary time tX relates to only one video stream. For example, a plurality of video streams corresponding to a plurality of television programs or a plurality of movies are simultaneously transmitted. It cannot be included in the program stream. In order to multiplex and transmit or record TV programs with video, at least one video stream is required for each TV program, so a DVD with only one video stream does not exist. In the program stream format, it is not possible to multiplex and transmit or record multiple TV programs.

In FIG. 2 (b), one transport stream (TS) includes a plurality of video streams as elementary streams (ES) for video data as main video information. It contains multiple audio streams as elementary streams (ES) for audio data as audio information, and multiple sub-picture streams as elementary streams (ES) for sub-picture data as sub-picture information. Comprising. That is, the video data multiplexed at an arbitrary time tX relates to a plurality of video streams. A plurality of video streams corresponding to a television program or a plurality of movies can be simultaneously included in the transport stream. In the transport stream format in which a plurality of video streams exist, a plurality of television programs and the like can be multiplexed and transmitted or recorded. However, in the digital broadcasting that adopts the current transport stream, the sub-picture stream is not transmitted.

In FIG. 2 (a) and FIG. 2 (b), the video stream, the audio stream, and the sub-picture stream are arranged in this order from the top for convenience of description, but the packet is arranged in this order as described later. It does not correspond to the order of multiplexing in units. In the transport stream, conceptually, for example, one program corresponds to a group of one video stream, two audio streams, and two sub-picture streams.

The optical disc 100 of the present embodiment described above multiplexes the transport stream (TS) including a plurality of elementary streams (ES) within the limitation of the recording rate. It is configured to be recordable, that is, to be able to record a plurality of programs or programs simultaneously.

Next, the structure of data recorded on the optical disc 100 will be described with reference to FIGS. Here, FIG. 3 schematically shows the data structure recorded on the optical disk 100, and FIG. 4 schematically shows the details of the data structure in each object shown in FIG. It is shown.

In the following description, a “title” is a playback unit that continuously executes a plurality of “playlists” ′. For example, a logically large unit of one movie, one TV program, etc. It is a unit you have. A “playlist” is a file storing information necessary for reproducing an “object”, and is a plurality of “items” each storing information regarding a reproduction range of an object for accessing the object. It is configured. More specifically, each item describes “IN point information” indicating the start address of the object and “OUT point information” indicating the end address. Each of the “IN point information” and “OUT point information” may directly indicate an address, or a time or a time on a reproduction time axis. For example, the address may be indicated indirectly. The “object” is the entity information of the content constituting the transport stream of the MPEG2 described above. In FIG. 3, the optical disc 100 has four logical structures: a disc information file 110, a play (P) list information file 120, an object information file 130, and an object data file 140. And a file system 105 for managing these files. Although FIG. 3 does not directly show the physical data arrangement on the optical disc 100, the arrangement order shown in FIG. 3 must be recorded so as to correspond to the arrangement order shown in FIG. That is, it is also possible to record the file system 105 etc. in the data recording area 106 following the lead-in area 104, and further record the object data file 140 etc. in the data recording area 106. . Even without the lead-in area 104 and the lead-out area 108 shown in FIG. 1, the file structure shown in FIG. 3 can be constructed.

The disc information file 110 is a file for storing comprehensive information on the entire optical disc 100, and includes the disc general information 112, the title information table 114, and other information 118. Store. The disc total information 112 stores, for example, the total number of titles in the optical disc 100 and the like. The title information table 114 stores, as logical information, the type of each title (for example, sequential playback type, branch type, etc.) and the play (P) list number that constitutes each title for each title. I do.

The play list information file 120 stores a play (P) list information table 122 indicating the logical configuration of each play list, which is composed of play (P) list general information 122 and , A play (P) list pointer 124, a plurality of play (P) lists 126 (P lists #l to #n), and other information 128. This playlist information table 122 stores logical information of each playlist 126 in order of playlist number. In other words, the storage order of each playlist 1 26 is the playlist number. In the title information table 114 described above, it is also possible to refer to the same playlist 126 from a plurality of titles. That is, even when the title #n and the title #m use the same playlist #p, The playlist #p in the playlist information table 12 1 may be configured to point to the title information table 1 14.

The object information file 130 stores the storage location (that is, the logical address to be reproduced) in the object data file 140 for each item included in each playlist 126, and the reproduction of the item. Various attribute information is stored. In the present embodiment, in particular, the object information file 130 contains a plurality of AU (associate unit) information 1332 I (AU # 1 to AU # q) described in detail later. Table 13 1, ES (elementary stream) map table 134, and other information 1 38 are stored.

The object data file 140 contains the transport stream (TS) 另 U TS object 14 2 (TS # 1 object to TS #s object), that is, the entity data of the content that is actually played back. , Store multiple.

The four types of files described with reference to FIG. 3 can be further divided into a plurality of files and stored, and all of them can be managed by the file system 105. For example, the object data file 140 can be divided into a plurality of object data files # 1, # 2,....

As shown in FIG. 4, the TS object 142 shown in FIG. 3, which is a logically reproducible unit, is divided into a plurality of aligned units 143 each having a data amount of, for example, 6 kB. Become. The beginning of the aligned unit 144 coincides with the beginning of the TS object 142 (aligned). Each aligned unit 144 is further subdivided into a plurality of source packets 144 each having a data amount of 192 B. The source packet 144 is a physically reproducible unit, and at least video data, audio data, and sub-picture data of the data on the optical disc 100 are multiplexed in this unit, ie, a packet unit. Other information may be multiplexed in the same manner. Each source packet 144 has a data amount of 4 B, and controls the reproduction of a packet arrival time stamp or the like indicating a reproduction start time of a TS (Transport Stream) packet on the reproduction time axis. Control information 1 4 5 and TS packet 1 4 having a data amount of 1 8 8 B 6 and. The TS bucket 146 has a packet header 146a at the beginning thereof and has a bucket payload as a subsequent substantial data portion, and the video data is packetized to form a `` video packet ''. The audio data is packetized into an “audio packet”, or the sub-picture data is packetized into a “sub-picture packet” or other data. Toy dani.

Next, referring to FIGS. 5 and 6, video data, audio data, sub-picture data, etc. in the transport stream format as shown in FIG. 2 (b) are used for the TS packet 14 shown in FIG. The point of multiplex recording on the optical disc 100 will be described with reference to FIG. Here, Fig. 5 shows that the elementary stream (ES) for the upper program # 1 (PG1) and the elementary stream (ES) for the middle program # 2 (PG2) are multiplexed. Fig. 6 conceptually shows how the transport stream (TS) for these two programs (PG 1 & 2) is constructed using the horizontal axis as the time axis. It conceptually shows the image of TS packets multiplexed in one transport stream (TS) as a packet sequence along time.

As shown in Fig. 5, the elementary stream for program # 1 (upper part) is composed of, for example, a TS packet 146 in which video data for program # 1 is packetized on the time axis (horizontal axis). On the other hand, they are arranged discretely. The elementary stream (middle) for program # 2 is, for example, a TS packet 146 in which video data for program # 2 is packetized and arranged discretely with respect to the time axis (horizontal axis). I get it. Then, these TS packets 146 are multiplexed to construct a transport stream (lower) for these two programs. Although omitted in FIG. 5 for convenience of explanation, as shown in FIG. 2 (b), audio data is actually packetized as an elementary stream for program # 1. Elementary stream consisting of a TS bucket that has been divided into sub-picture streams consisting of TS buckets in which sub-picture data is packetized. In addition to these elements, an element stream for program # 2 is also provided. An element consisting of a TS bucket in which audio data is bucketed as a tally stream. A sub-picture stream composed of a mental stream and a TS bucket in which sub-picture data is bucketed may be similarly multiplexed.

As shown in FIG. 6, in the present embodiment, one TS stream is constructed from a large number of TS packets 146 multiplexed in this way. Then, a large number of TS buckets 146 are multiplexed and recorded on the optical disc 100 with information of a packet arrival time stamp and the like 145 added in such a multiplexed form. In FIG. 6, j (j = 1, 2,...) Constitutes a program for TS packet 1 46 consisting of data that constitutes program # i (i = l, 2, 3). The number indicating the order of each stream to be performed is indicated by "E1ement (i0j)", and this (i0j) is the identification number of the TS packet 146 for each elementary stream. It is the bucket ID. This packet ID is unique among a plurality of TS packets 146 multiplexed at the same time so that even if a plurality of TS buckets 146 are multiplexed at the same time, they can be distinguished from each other. Value has been assigned.

In FIG. 6, the PAT (program association table) and the PMT (program map table) are also packetized and multiplexed in units of TS packets 146. Among these, the PAT stores a table indicating bucket IDs of a plurality of PMTs. In particular, the MPEG2 standard specifies that a PAT is given (0000) as a predetermined packet ID as shown in FIG. That is, among a large number of packets multiplexed at the same time, a TS packet 146 having a PAT packet is detected as a TS packet 146 having a packet ID of (0000). It is configured to be. The PMT stores, for one or a plurality of programs, a table indicating a bucket ID for each elementary stream constituting each program. An arbitrary bucket ID can be given to the PMT, and these bucket IDs are indicated by the PAT that can detect the packet ID as (00 0) as described above. Therefore, of the many packets multiplexed at the same time, the TS packet 146 whose PMT is packetized (that is, the packet IDs (100), (200), (200) in FIG. 6) The TS packet 146) to which 300) is assigned is configured to be detected by PAT.

When the transport stream as shown in Fig. 6 is transmitted digitally, By referring to the PAT and PMT configured in this way, the tuner can extract the element corresponding to the desired elementary stream from the multiplexed bucket and demodulate it. .

In the present embodiment, such a PAT or PMT packet is included as the TS packet 146 stored in the TS object 142 shown in FIG. That is, when the transport stream as shown in FIG. 6 is transmitted, there is obtained a great advantage that the data can be recorded on the optical disc 100 as it is.

Further, in the present embodiment, the PAT or PMT recorded in this manner is not referred to when the optical disc 100 is reproduced, and instead, the AU table 13 1 and the ES shown in FIG. By referring to the map table 134, more efficient reproduction is possible, and complicated multi-vision reproduction can be dealt with. For this reason, in the present embodiment, for example, the correspondence between the elementary stream and the packet obtained by referring to the PAT and PMT at the time of demodulation and recording is described by the AU table 13 1 and the ES map table 13 4 It is stored in the object information file 130 in the form of and without bucketing or multiplexing.

Next, the logical configuration of data on the optical disc 100 will be described with reference to FIG. Here, FIG. 7 schematically shows the logical configuration of data on the optical disc 100, focusing on the development from the logical layer to the object layer or the entity layer. In FIG. 7, one or a plurality of titles 200, which are logically large groups such as one movie and one television program, are recorded on the optical disc 100, for example. Each title 200 is logically composed of one or more playlists 126. Within each title 200, a plurality of playlists may have a sequential structure or a branch structure.

In the case of a simple logical configuration, one title 200 is composed of one playlist 126. It is also possible to refer to one playlist 126 from a plurality of titles 200.

Each play list 126 is logically composed of a plurality of items (play items) 204. In each play list 126, the plurality of items 204 may have a sequential structure or a branch structure. Also, one key It is also possible to refer to item 204 from a plurality of playlists 126. The playback range of the TS object 142 is logically designated by the above-mentioned IN point information and OUT point information described in the item 204. Then, by referring to the object information 130d for the playback range logically specified, the playback range of the TS object 142 is physically specified finally through the file system. Is done. Here, the object information 134 d is attribute information of the TS object 142, and TS objects 14 such as ES address information 134 d required for data search in the TS object 142. 2 includes various information for reproducing (the ES map table 134 shown in FIG. 3 includes a plurality of such ES address information 134d).

When the TS object 142 is reproduced by the information recording / reproducing apparatus described later, the physical address to be reproduced in the TS object 142 is obtained from the item 204 and the object information 130. Then, the reproduction of the desired elementary stream is executed.

As described above, in this embodiment, the IN point information and the OUT point information described in the item 204 and the ES map table 13 4 of the object information 130 d (see FIG. 3) are described. According to the dress information 134d, the logical hierarchy in the reproduction sequence is associated with the object hierarchy, and the elementary stream can be reproduced.

As described above in detail, in the present embodiment, multiplex recording is performed on the optical disc 100 in units of TS packets 146, whereby a large number of element leases as shown in FIG. The transport stream including the stream can be multiplex-recorded on the optical disc 100. According to the present embodiment, when a digital broadcast is recorded on the optical disk 100, a plurality of programs or a plurality of programs can be recorded simultaneously within the limit of the recording rate. A method of multiplexing and recording a plurality of programs or a plurality of programs on 42 is adopted. Hereinafter, an embodiment of an information recording / reproducing apparatus capable of executing such a recording process will be described.

(Information recording / reproducing device) Next, an embodiment of the information recording / reproducing apparatus of the present invention will be described with reference to FIGS. FIG. 8 is a block diagram of the information recording / reproducing apparatus, and FIGS. 9 to 13 are flowcharts showing the operation.

In FIG. 8, an information recording / reproducing device 500 is roughly divided into a reproducing system and a recording system, and is capable of recording information on the optical disk 100 described above and reproducing the information recorded thereon. It is configured to be possible. In this embodiment, the information recording / reproducing device 500 is for recording / reproducing as described above. However, basically, the embodiment of the recording device of the present invention can be constituted from its recording system part. First, an embodiment of the information reproducing apparatus of the present invention can be constructed from the reproducing system.

The information recording / reproducing device 500 includes an optical pickup 502, a servo unit 503, a spindle motor 504, a demodulator 506, a demultiplexer 508, a video decoder 511, and an audio decoder 5. 1, 2, sub-picture decoder 5 13, adder 5 14, system controller 5 20, memory 530, memory 540, modulator 606, formatter 608, TS object generator 6 1 0, video encoder 6 11, audio encoder 6 12, and sub-picture encoder 6 13. The system controller 520 includes a file (Fi 1 e) system Z logical structure data generator 52 1 and a file (File) system / logical structure data reader 52 2. Further, a memory 530 and a user interface 720 for inputting user information such as title information are connected to the system controller 520.

Among these components, demodulator 506, demultiplexer 508, video decoder 511, audio decoder 511, sub-picture decoder 513 and adder 514, and memory 540 Thus, a reproducing system is generally configured. On the other hand, among these constitutional elements, the modulator 6 0 6, the formatter 6 0 8, TS object producing formation unit 6 1 0, video encoder 61 1, the audio encoder 6 1 2 and Sabupi puncturing encoder ₆ 1 3 Generally, a recording system is configured. The optical pickup 502, the servo unit 503, the spindle motor 504, the system controller 520 and the memory 530, and a user interface 7 for performing user input of title information and the like. 20 is generally shared by both the reproduction system and the recording system. Further, for the recording system, a TS object data source 700, a video data source 711, an audio data source 71 2, and a sub-picture data source 7 13 are prepared. The file system logical structure data generator 521 provided in the system controller 520 is mainly used in the recording system, and the file system logical structure reader 522 is mainly used in the reproducing system. Can be

The optical pickup 502 irradiates the optical disk 100 with an optical beam LB such as a laser beam at a first power as a reading light at the time of reproduction and at a second power as a writing light at the time of recording. Irradiation is performed with modulation. During playback and recording, the servo unit 503 performs control such as focusing and tracking in the optical pickup 502 under the control of the control signal Sc1 output from the system controller 52. The spindle motor is operated in the spindle motor 504. The spindle motor 504 is configured to rotate the optical disc 100 at a predetermined speed while receiving spindle servo by the servo unit 503.

(i) Configuration and operation of recording system:

Next, with reference to FIG. 8 to FIG. 12, a specific configuration and operation of each component constituting the recording system in the information recording / reproducing apparatus 500 will be described for each case.

(i-1) When using a created TS object:

This case will be described with reference to FIGS.

In FIG. 8, a TS object data source 700 is composed of a recording storage such as a video tape or a memory, and stores the TS object data D1. In FIG. 9, first, information of each title logically configured on the optical disc 100 using the TS object data D 1 (for example, the configuration of the playlist) is transmitted from the user interface 720. The information is input to the system controller 520 as a user input I2 such as title information. Then, the system controller 520 fetches a user input I2 such as title information from the user interface 720 (step S2l: Yes and step S22). At this time, in the user interface 720, control by the control signal Sc4 from the system controller 520 is performed. In response to this, it is possible to perform input processing according to the contents to be recorded, such as selection via the title menu screen. If the user input has already been executed (step S21: No), these processes are omitted.

Next, the TS object data source 700 is controlled by the control signal Sc8 instructing data reading from the system controller 520, and outputs the TS object data D1. Then, the system controller 520 fetches the TS object data D1 from the TS object source 700 (step S23), and uses the TS analysis function in the file system logical structure data generator 521 to execute the process. For example, based on the PAT, PMT, and the like bucketed together with the video data as described above, analysis of the data array (for example, recording data length, etc.) in the TS object data D1, and the configuration of each elementary stream ( For example, an ES—PID (elementary stream packet identification number) is understood (described later) (step S24).

Subsequently, the system controller 520 determines the file system / logical structure based on the user input 12 such as the captured title information and the data array of the TS object data D1 and the analysis result of each elementary stream. The data generator 521 generates the logical information file data D4 as the disk information file 110, the playlist information file 120, the object information file 130, and the file system 105 (see FIG. 3). ) Is created (step S25). The memory 530 is used when creating such logical information file data D4.

It should be noted that, naturally, various variations such as preparing a data array of the TS object data D1 and data on the configuration information of each elementary stream are conceivable, but these are also within the scope of the present embodiment. is there.

In FIG. 8, a formatter 608 is a device that performs a data array format for storing both the TS object data D 1 and the logical information file data D 4 on the optical disc 100. More specifically, the formatter 608 includes a switch Sw 1 and a switch Sw 2, and is subjected to switching control by a switch control signal Sc 5 from the system controller 520, to thereby generate a TS object. When the data D1 is formatted, connect the switch Sw1 to the The switch Sw 2 is connected to the ① side to output TS object data D 1 from the TS object data source 700. The transmission control of the TS object data D1 is performed by a control signal Sc8 from the system controller 520. On the other hand, when the logical information file data D4 is formatted, the formatter 608 is controlled by the switch control signal Sc5 from the system controller 520 to switch the switch Sw2 to the ② side. It is configured to connect and output logical information file data D4.

In step S26 in FIG. 9, the switching control by the formatter 608 configured in this way allows (i) the logical information file from the file system / logical structure data generator 521 in step S25. The data D4 or (ii) TS object data D1 from the TS object data source 700 is output via the formatter 608 (step S26).

The selected output from the formatter 608 is sent to the modulator 606 as disc image data D 5, modulated by the modulator 606, and sent to the optical disk 100 via the optical pickup 502. (Step S27). The disk recording control at this time is also executed by the system controller 520.

If both the logical information file data D4 generated in step S25 and the corresponding TS object data D1 have not been recorded, the process returns to step S26 to continue recording. (Step S28: No). The recording order of the logical information file data D4 and the corresponding TS object data D1 may be either earlier or later.

On the other hand, if both of them have been recorded, it is determined whether or not to end recording on the optical disk 100 based on the presence or absence of an end command (step S29). 29: No) Return to step S21 and continue the recording process. On the other hand, if the recording should be terminated (step S29: Yes), a series of recording processing is terminated.

As described above, the information recording / reproducing device 500 performs the recording process when using the created TS object.

In the example shown in FIG. 9, the logical information file data D4 is created in step S25. After that, in step S26, the data output of the logical information file data D4 and the corresponding TS object data D1 is executed, but before step S25, the TS object data D1 is output. It is also possible to execute output and recording on the optical disc 100, and to generate or record the logical information file data D4 after this recording or concurrently with this recording.

(i-2) When receiving and recording a transport stream being broadcast: This case will be described with reference to FIGS. In FIG. 10, the same steps as those in FIG. 9 are denoted by the same step numbers, and the description thereof is omitted as appropriate.

In this case as well, almost the same processing is performed as in the above-mentioned "when a created TS object is used". Therefore, the following description focuses on the differences.

When receiving and recording the transport stream being broadcast, the TS object data source 700 is composed of, for example, a receiver (set-top box) that receives the digital broadcast being broadcast. D1 is received and transmitted to the formatter 608 in real time (step S41). At the same time, reception information D3 including program configuration information decrypted at the time of reception and ES-PID information described later (that is, data corresponding to data transmitted through the interface between the receiver and the system controller 520). ) Is taken into the system controller 520 and stored in the memory 530 (step S444).

On the other hand, the TS object data D1 output to the formatter 608 is output to the modulator 606 by the switching control of the formatter 608 (step S42), and is recorded on the optical disc 100. (Step S43).

In parallel with these, the file system / logical structure generator 52 is used by using the program configuration information and the ES_PID information contained in the reception information D3 which is fetched at the time of reception and stored in the memory 530. The logical information file data D4 is created by step 1 (step S24 and step S25). After the recording of the series of TS object data D1, the logical information file data D4 is additionally recorded on the optical disc 100 (steps S46 and S47). The processing in steps S24 and S25 may also be performed after the end of step S43. Further, if necessary (for example, when editing a part of the title), the user input 12 such as the title information from the user interface 720 is stored in the program stored in the memory 530. The logical information file data D4 may be created by the system controller 520 by adding it to the configuration information and ES-PID information, and this may be additionally recorded on the optical disk 100.

As described above, the information recording / reproducing device 500 performs the recording process when the transport stream being broadcast is received and recorded in real time. If all received data at the time of broadcasting is stored in the archive device and used as the TS object source 700, the same processing as in the above-mentioned "when using a created TS object" is performed. Is enough.

(i-13) When recording video, audio and sub-picture data: This case will be described with reference to FIGS. 8 and 11. In FIG. 11, the same steps as those in FIG. 9 are denoted by the same step numbers, and the description thereof is omitted as appropriate.

When recording separately prepared video data, audio data, and sub-picture data, the video data source 711, the audio data source 712, and the sub-picture data source 713 are each, for example, a video tape. And video and video data DV, audio data DA, and sub-picture data DS.

These data sources receive video data DV, audio data DA and sub-picture data DS under the control of a control signal Sc8 for instructing data read from the system controller 520, respectively. 11, and transmitted to the audio encoder 612 and the sub-picture encoder 613 (step S61). Then, a predetermined type of encoding process is executed by the video encoder 611, the audio encoder 612, and the sub-picture encoder 613 (step S62).

Under the control of the control signal Sc6 from the system controller 520, the TS object generator 610 converts the data thus encoded into TS object data forming a transport stream ( Step S63). At this time, the data arrangement information of each TS object data (for example, recording data length, etc.) and the configuration information of each elementary stream (for example, ES-PID described later) are transmitted from the TS object generator 610 to the information I. The data is sent to the system controller 520 as 6 and stored in the memory 530 (step S66).

On the other hand, the TS object data generated by the TS object generator 610 is sent to the switch SW1 of the formatter 608 at the ② side. That is, when the TS object data from the TS object generator 610 is formatted, the formatter 608 is subjected to switching control by the switch control signal Sc 5 from the system controller 520, and the switch Sw 1 Is set to the ② side and the switch Sw 2 is connected to the 当該 side to output the TS object data (step S64). Subsequently, the TS object data is recorded on the optical disc 100 via the modulator 606 (step S65).

In parallel with these, the file system / logical structure generator 52 is used by using the data arrangement information of each TS object data and the configuration information of each elementary stream, which are loaded into the memory 530 as information I 6. The logical information file data D4 is created by 1 (step S24 and step S25). After the recording of the series of TS object data D2, this is additionally recorded on the optical disk 100 (steps S67 and S68). Note that the processing in steps S24 and S25 may be performed after the end of step S65.

Further, when necessary (for example, when editing a part of a title), the user input I2 such as title information from the user interface 720 is stored in these memories 530. By adding the information, the file system logical structure generator 5 21 may create logical information file data D 4, which may be additionally recorded on the optical disc 100.

As described above, the information recording / reproducing device 500 performs a recording process when recording separately prepared video data, audio data, and sub-picture data.

Note that this recording process can also be applied when recording any content owned by the user. (i-4) When recording data by authoring:

This case will be described with reference to FIGS. In FIG. 12, the same steps as those in FIG. 9 are denoted by the same step numbers, and the description thereof is omitted as appropriate.

In this case, by combining the recording processes in the above three cases, the authoring system generates a TS object, generates logical information file data, and the like in advance (step S81), and then executes the formatter. The processing up to the switching control performed in step 608 is completed (step S82). Then, the information obtained by this operation is sent as disc image data D5 to the modulator 606 provided before and after the disc mastering machine (step S83), and the master machine uses this mastering machine. Creation is performed (step S84).

In this embodiment, in particular, in the configuration and operation of the (i) recording system described above, in any case (i-11) to (i-4), the still picture is included in the sub-picture data. Data relating to image information and its control information (for example, SP data, SP control information, their structure information or a header, which will be described later) are multiplex-recorded on the optical disc 100. Further, data (SP data identification flag, SCP identification flag, etc.) relating to the control information of the still image is generated in the generation of the logical information file data in step S25, and the object is generated via the formatter 608. It is recorded in a part of the information file 130 (see FIG. 3) or the like in a form associated with the still image information (for example, in a table format associated with “entry section” described later).

(ii) Configuration and operation of playback system:

Next, with reference to FIG. 8 and FIG. 13, a specific configuration of each component constituting the reproducing system of the information recording / reproducing device 500 and an operation thereof will be described.

In FIG. 8, a user interface 720 inputs a title to be reproduced from the optical disc 100 and reproduction conditions thereof to the system controller as a user input I2 such as title information. At this time, the user interface 720 receives the control by the control signal Sc4 from the system controller 520, and responds to the content to be reproduced, for example, selection via the title menu screen. Input processing is enabled. In response to this, the system controller 520 controls the disk reproduction for the optical disk 100, and the optical pickup 502 sends the read signal S7 to the demodulator 506.

The demodulator 506 demodulates the recording signal recorded on the optical disc 100 from the read signal S7 and outputs it as demodulated data D8. Logical information file data as an unmultiplexed information portion included in the demodulated data D8 (that is, the file system 105, disk information file 110, and P list information file 1 shown in FIG. 3). 20 and the object information file 130) are supplied to the system controller 520. On the basis of the logical information file data, the system controller 520 executes various reproduction controls such as a reproduction address determination process and a control of the optical pickup 502.

On the other hand, the TS object data as the multiplexed information portion included in the demodulated data D8 is controlled by the control signal Sc2 from the demanoreplexer 508 and the system controller 520. To demultiplex. Here, when access to the reproduction position address is completed by the reproduction control of the system controller 520, the control signal Sc2 is transmitted so as to start the demultipletus.

From the demultiplexer 508, a video packet, an audio packet, and a sub-picture packet are transmitted, respectively, to the video decoder 511, the audio decoder 511, and the sub-picture decoder 513. Supplied. Then, the video data DV, the audio data DA and the sub-picture data DS are respectively decoded. Note that the PAT or PMT bucket included in the transport stream shown in FIG. 6 is included as a part of the demodulated data D8, but discarded by the demultiplexer 508. Is done.

The adder 514 is decoded by the video decoder 511 and the sub-picture decoder 513, respectively, under the control of the control signal Sc3 instructing the mixing from the system controller 520. The video data DV and the sub-picture data DS are mixed or superimposed at a predetermined timing. The result is output as a video output from the information recording / reproducing device 500 to, for example, a television monitor. You.

On the other hand, the audio data DA decoded by the audio decoder 512 is output from the information recording / reproducing device 500 as an audio output, for example, to an external speaker.

Here, a specific example of the reproduction processing routine by the system controller 520 will be described with reference to FIG.

In Fig. 13, in the initial state, recognition of the optical disk 100 by the playback system and recognition of the volume structure and file structure by the file system 105 (see Fig. 3) have already been performed by the system controller 5 It is assumed that the operation has been completed by the logical structure reader 52 2 of the file system. Here, the processing flow after acquiring the total number of titles from the disc total information 112 in the disc information file 110 and selecting one of the titles will be described.

First, a title is selected by the user interface 720 (step S 11), and the reading result of the file system / logical structure reader 522 is used to determine the playback sequence by the system controller 520. Acquisition of information is performed. Specifically, processing of the logical hierarchy (that is, acquisition of information indicating a playlist structure and information of each item constituting the playlist structure (see FIG. 7)) is performed (step S12). Thereby, the reproduction target is determined (step S13).

Subsequently, an object information file 130 relating to the TS object to be reproduced is obtained. In the present embodiment, in particular, AU (associate unit) information 132 I and PU (presentation unit) information 302 (described later in FIG. 35), which will be described later, are also included in the object information. The information is acquired as information stored in the file 130 (step S14). Based on the acquired information, the above-described logical hierarchy is associated with the object hierarchy (see FIG. 7).

Subsequently, based on the information obtained in step S14, the object to be played back and the playback address are determined (step S15), and the processing of the object hierarchy is started, that is, the playback is actually started. Start (step S16).

During playback, a "scene switch" command input corresponding to switching of PU 302 in AU 132 based on AU information 1321 and PU information 310 as described later is performed. Is monitored (step S17). If there is a command input of "scene switching" (step S17: Yes), the process returns to step SI5, and the processes in steps S15 to S17 are repeatedly executed. On the other hand, if there is no command input of “scene switching” (step S17: No), it is determined whether there is a command input to end the reproduction process (step S18). Here, if there is no command input for terminating (Step S18: No), the process returns to Step S11 and repeats the processes in Steps S11 to S18. On the other hand, if there is a command input for terminating (step S18: Yes :), a series of reproduction processing ends. In the present embodiment, in particular, the sub-picture data decoded by the sub-picture decoder 5 13 in step S 16 of FIGS. 8 and 13 is temporarily stored in the memory 54 機 functioning as a buffer. Then, as described below, at least one of the SP data (still image data) and the SP control information (still image control data) included in the temporarily stored sub-picture data is transmitted to the system controller 5. It is read under the control of the control signal S c5 from 20. Then, by applying the SP control information to the SP data, a still image is displayed as part or all of the video output.

Note that the SP control information may be configured to be temporarily stored in a dedicated area of the memory 530 (that is, only the SP data is temporarily stored in the memory 540). . Alternatively, such a memory 540 can be constructed using a part of the memory 530.

(How to get SP data and SP control information)

Next, a method for acquiring SP data and SP control information in the present embodiment will be described. This acquisition method is mainly performed by the information recording / reproducing device 500 (see FIG. 8) based on the ES address information in the object information and the SP data and SP control information in the sub-picture structure. It is what is performed.

(A) First acquisition method of SP data and SP control information

With reference to FIGS. 14 to 21, a description will be given of a first method of obtaining SP data and SP control information, and the associated playback control of a still image. Here, Fig. 14 relates to the video stream built in the ES map table in the object information. Table 15 shows an example of the data structure in the ES address information. Figure 15 shows an example of the position of the TS packet registered in the ES address information of the video stream on the TS object. (Middle, horizontal direction). Fig. 16 shows the SP data and SP control information and the contents of the structural information in a table according to the first acquisition method, and Fig. 17 shows three types of these three data or information. Fig. 3 schematically shows a sub-picture structure. Fig. 18 schematically shows the arrangement conditions of the first packet of I picture, SP data, and SP control information used in the first acquisition method on the time axis of the TS object. The acquisition procedure in the first acquisition method is schematically shown in Fig. 20. Fig. 20 shows the elementary stream for SP data (hereinafter referred to as "SPD stream" as appropriate) constructed in the ES map table. The data structure of such ES address information is shown in a table, and Fig. 21 shows the elementary stream for SP control information (hereinafter referred to as "SCP stream" as appropriate) constructed in the ES map table. The data structure in the ES address information is shown in a table.

The ES (elementary stream) address information of the video stream shown in FIG. 14 is based on the ES address information 134 d (see FIG. 7) in the ES map template 134 shown in FIG. Described as part. Here, the video stream is an elementary stream of index # 14 shown in the ES map table of FIG. 35 described later in detail.

As shown in FIG. 14, as the contents of the ES address information, only for packets that satisfy a predetermined condition on the video stream, the packet numbers q, r, s, t, u,... (For example, TS object) ), And the corresponding display start times T14_0, T14_1, T14_1, T14_2, T14-3, ... Is described.

As shown in FIG. 15, in the present embodiment, a packet that satisfies a predetermined condition is defined as the first bucket of an I-picture based on the MPEG2 standard, and the packet numbers and display start times corresponding to these packets are determined. Are described as ES address information shown in FIG. This is because MPEG decoding can be started if the recording position of the I picture can be specified by the address information. Then, as shown in FIG. 15, in this embodiment, the TS address information is specified by two adjacent packets in the arrangement of only buckets whose recording position is specified by the ES address information. Each section on the object is defined as "one section". For example, a section in which ES address information is specified by adjacent packets q and r is set as an entry section # 0, and a section specified by a packet r and a packet s is set as entry section # 1. In addition, the SP data and SP control information on the sub-stream corresponding to the video stream (that is, displayed simultaneously or in parallel with the video stream) and the still image are referred to as one entry section defined as above. It describes their existence depending on whether they are within the range or not. The stream for SCP here is the elementary stream of index number # 17 shown in the ES map table of Fig. 35 described later in detail, and the stream for SPD is index number # 18. Elementary stream. Therefore, in the index # 17 and # 18 of the ES map table, the index number information of the elementary stream used as the entry section is 1 3 4 e (according to the present embodiment, "index number = 1 6 ") is described.

As shown in FIG. 16 (a), in this embodiment, the data or information related to the still image recorded on the SCP stream is the SP data 7 13 (FIG. 1) on the SPD stream. 6 (b)), SP control information 7 12 which constitutes an example of still image control information for display control of the sub-picture structure, and structural information (header) relating to the sub-picture structure which forms one sub-picture structure together with SP control information ) 7 1 1 and two data or information. -As shown in FIG. 16 (b), in this embodiment, the data or information related to the still image recorded on the SPD stream is composed of SP data 713 which constitutes an example of still image information. It also includes two data or information, that is, structure information (header) 711 about the sub-picture structure that forms one sub-picture structure.

Then, as a combination of these three data, the structural information 7 11, the SP control information 7 12 and the SP data 7 13, the structural information 7 11 1 shown in FIG. SP control information 71 2 and sub-picture structure 70 1 including all the components of SP data 7 13, structural information 71 1 shown in Fig. 17 (b) and SP control information 7 12 There is a sub-picture structure 702 including a sub-picture structure 702 and a sub-picture structure 703 including the structural information 711 and SP data 713 shown in FIG. 17C. By the way, in the case of DVD, only the type shown in Fig. 17 (a) is defined.

Here, particularly in this embodiment, mainly, the SP data 711 (see FIG. 16 (b)) of the sub-picture structure 703 (FIG. 17 (c)) 內 recorded on the SPD stream is mainly shown. By applying the SP control information 712 (see Fig. 16 (a)) in the subpicture structure 720 (Fig. 17 (b)) recorded on the SCP stream, Is performed. That is, the SP data 711 and the SP control information 712 acting on the SP data 711 are recorded on mutually different elementary streams, thereby performing efficient reproduction control. Furthermore, by applying a plurality of SP control information 712 on multiple SCP streams to SP data 713 on one SPD stream, more efficient playback control is achieved. It performs

However, in addition to such playback control of still images, the SP data 7 13 in the sub-picture structure 70 1 (Fig. 17 (a)) recorded on other sub-picture streams is Similarly, the reproduction control of a still image may be performed by applying the SP control information 712 in the sub-picture structure 701 (FIG. 17 (a)). Alternatively, the SP data 7 13 in the sub-picture structure 7 0 1 (Fig. 17 (a)) recorded on the other sub-picture stream is compared with the sub-picture structure 7 recorded on the SCP stream. The playback control of the still image may be performed by applying the SP control information 7 12 (see FIG. 16 (a)) in 0 2 (FIG. 17 (b)).

As described above, in the present embodiment, various examples of the “still image information set” according to the present invention are respectively configured from the sub-picture structures shown in FIGS. 17 (a) to 17 (c). . As shown in FIGS. 17 (a) to 17 (c), in this embodiment, normally, the SP control information 7 12 and the SP data 7 13 are composed of a plurality of TS packets 1 4 6 It is divided into. The structure information 7 1 1 is the top of the sub picture structure 70 1 to 703 The head part of the SP control information 712 (Fig. 17 (a) and (b)) or the head part of the SP data 713, which is stored in the packet and follows, is also included in the structure information 711. Stored in the stored first packet.

In the present embodiment, the TS packet 146 in which the head of the SP control information 712 in such a sub-picture structure 702 is stored is called “SCP”. The TS packet 146 in which the head of the SP data 713 in the subpicture structure 703 is stored is called “SPD”. In the present application, “the sub-picture structure is arranged or belongs in the entry section” as shown in FIG. 15 means the sub-picture structures 71 1 and 70 0 shown in FIGS. 17 (a) and (b). 2 means that the header containing the SCP (that is, the packet that stores the structure information) is recorded in the entry section, and the sub-picture structure shown in Fig. 17 (c). Means that the header including the SPD is recorded in the entry section.

As shown in FIG. 16A, the structure information 711 in the sub-picture structure 702 has an “SP data identifier”. In this case, the SP data identifier identifies SP data 713 included in another sub-picture structure on which the SP control information 712 included in the sub-picture structure 702 operates.

The structure information 711 in the sub-picture structure 702 further has information indicating “data length of SP control information”. Based on this, at the time of reproduction, it is specified to which packet the sub-picture structure 702 continues from the beginning of the structure information 7111.

The structure information 7 11 in the sub-picture structure 702 further includes “SP data position information”. At the time of reproduction, based on this, an entry section of the SP data 7 13 on which the SP control information 7 12 operates is specified. As the position information of such SP data, the approximate position is described using the entry section shown in FIG. As a result, the SP data 711 can be specified by searching for the SPD in the entry section, so even if the SP picture does not have the SP data 713 as in the sub-picture structure 702, it does. The SP control information 7 1 2 can be made to act on the scheduled SP data. However, as the position information of SP data, S The packet number of the PD may be directly described.

The SP control information 712 in the sub-picture structure 720 has information indicating the display start time of the acting SP data and the display time of the SP data. At the time of playback, this causes the SP data on which the SP control information 7 12 acts to be played back for a predetermined time on the playback time axis, and a still image is displayed.

As shown in FIG. 16 (b), the structure information 711 in the sub-picture structure 703 has "SP data identifier". In this case, the SP data identifier identifies SP data 713 included in the sub-picture structure.

The structure information 711 in the sub-picture structure 703 further has information indicating "data length of SP data". Based on this, at the time of reproduction, it is specified to which packet the subpicture structure 703 continues from the head of the structure information 7111.

The SP data 713 in the sub-picture structure 703 has, for example, run-length-encoded bitmap data format or JPEG format image data. For example, each pixel has 8-bit color information data and 8-bit transparency information data. The SP data representing one still image is packetized and multiplexed into a plurality of TS packets 146 (see FIG. 4).

The structure information 711 of the sub-picture structure 701 shown in FIG. 17 (a) is the same as the structure information 711 of the sub-picture structure 703. (See Fig. 16 (b)), and information (such as "data length of SP control information") similar to the structure information 71 1 in the sub-picture structure 720 (Fig. 1 6 (a)), and SP data 713 (see Fig. 16 (b)) in the sub-picture structure 703 and SP control information (see Fig. 16 (b) in the sub-picture structure 702). a) see).

In the present embodiment, as shown in FIGS. 14 and 15, the entry section is represented by using the display start time of the packet number of the first bucket constituting the entry section. For example, the entry section # 0 of the elementary lease stream with index # 14 is represented by "T140". In this way, if it is represented by the display start time, after recording Even if there is a shift in the packet serial number due to the lack of a packet due to editing or the like, the display start time does not need to be shifted, and the update of the ES address information as shown in Fig. 14 can be performed. It becomes unnecessary.

In this embodiment, in particular, the following conditions (hereinafter, referred to as “first arrangement conditions”) are set for the packet arrangement for the entry section defined as described above so that SCP and SPD can be easily and quickly acquired. ").

That is, compared with the “display start time” and “packet number” of entry point #i, a sub-picture containing SP control information 712 (which holds the display start time “TT”) The headers in the structures 70 1 to 70 3 are physically arranged as follows. Note that an entry point refers to a bucket whose position is specified by address information.

"Display start time of entry point #i"

K = T T K "Display start time of entry point # i + l"

When

`` Packet number of entry point # i J

<“The bucket number of the header of the sub-picture structure including SP control information”

<“Packet number of entry point # i + l”

According to such a first arrangement condition, the sub-picture structure 720 including the SP control information 7 12 necessary for the SP data 7 13 to be displayed during the playback of the entry section during the entry section is searched for in the entry section. Can be found. For example, in FIG. 14 and FIG. 15, when the display start time is equal to or more than T14−1 and smaller than T14−2, the subpicture structure 7 including the SP control information 7 1 2 in the entry section # 1 7 0 The bucket number of the header of 2 is recorded. On the other hand, SP data can be found from the “SP data recording position” (see FIG. 16) of the structural information 711 constituting the header as described above.

As shown in FIG. 18 in addition to the first arrangement condition, in the first acquisition method, the SCP (as described above, the first packet of the SP control information 7 12) also satisfies the following conditions (hereinafter, referred to as "The second arrangement condition").

"Packet number of SCP acting on i-th SP data" <“I + the packet number of the SCP acting on the first SP data”

That is, as shown in FIG. 18, a bucket arrangement that controls the SP data beyond the SCP of other SP control information is not allowed.

Note that, in FIG. 18, a dotted arrow coming out of the SCP indicates a relationship in which the SP control information starting from the SCP acts on the SP data to be controlled.

In the first acquisition method according to the present embodiment, under such first arrangement condition and second arrangement condition, acquisition of SP data and SP control information as illustrated in FIG. This is executed using address information as illustrated in FIG.

In Fig. 19, during playback, first, the display start PTS is given as the (0) th process, then the SCP is searched and read as the (1) th process, and then the SP data is read as the (2) th process. Next, the SP data is read as the (3) th processing, the SP data is read as the (4) th processing, and the reproduction is finally started as the (5) th processing. (The axis extending from left to right in the middle).

In order to acquire such a series of SP data and SP control information and to control the playback of a still image, the first acquisition method is particularly applicable to the entry stream defined by the video stream shown in Fig. 14. In the format corresponding to the section, describe the ES address information of the sub-picture stream as shown in Figs. 20 and 21 in the ES map table.

As shown in FIG. 20, the ES address information of the SPD stream among the sub-picture streams is the entry of the elementary stream indicated by the index number information 134 e (FIG. 35). Each section includes a 1-bit SP data identification flag indicating whether an SPD exists.

As shown in Fig. 21, the ES address information for the SCP stream in the sub-picture stream contains a 1-bit SCP identification flag that indicates whether an SCP is recorded for each entry section. Comprising.

Note that in FIGS. 20 and 21, “1” is set when there is a file, and “0” when it does not exist. And in the first acquisition method, as explained below, If the SCP does not exist at the display start time by another flag, it is checked whether it exists on the playback time axis in front (left side in Fig. 19).

In FIG. 19, at the time of playback, first, when the display start PTS in entry section # 3 is obtained (processing (0) in FIG. 19), the SCP identification flag of the ES address information included in the object information file is obtained. (See Fig. 21), and it is checked whether SCP exists in this entry section # 3. Then, in this example, since it is determined that the SCP does not exist, the SCP identification flag is further referred to, and a search for an SCP existing in another entry section located in the front on the reproduction time axis is searched. Thus, in this example, it is clear that the SCP to be read first exists in the entry section # 1.

Therefore, in FIG. 19, SCP data is searched for in the object data file in this entry section # 1 (process (1) in FIG. 19). More specifically, first, the ES packet information in FIG. 14 is referred to, the first packet of the entry section # 1 (“r” in this example) is obtained, and then the object data file is obtained. Within this, access to this first packet is executed. After that, the header (structure information 711) of the packet on the same sub-picture stream following this first packet is sequentially checked, and within the entry section # 1, the sub-picture structure 70 including the SCP is read. 2 will be found.

After that, the “SP data position” (see Fig. 16) recorded in the SP control information in the sub-picture structure including the acquired SCP is referred to, and the SP data that is the control target of this SP control information is referred to. (Entry section) is specified. Then, access to the SP data whose position is specified is executed (the (2) -th process in FIG. 19). For example, if the display start time T14-0 is described as the position of SP data (one entry section), first, the ES address information shown in Fig. 14 in the object information file The packet number "q" is obtained by reference. That is, in this example, it is found that the SPD to be read exists in the entry section # 0. After that, access to this first packet (packet number "q") is executed in the object data file. Next, the header (structure information) of the packet on the same sub-picture stream following this first packet 7 1 1) are checked sequentially, and a sub-picture structure 7 0 3 (SPD # 1 shown in Fig. 19) that includes SPD is found in the entry section # 0. become.

After that, the SP data in the subpicture structure including the acquired SPD is read (processing (3) in Fig. 19).

Thereafter, the SP data identification flag shown in FIG. 20 is referred to, from the entry section including the SPD obtained in the (3) th processing (here, entry section # 0) to the entry section including the display start time ( Here, up to entry section # 3), the SP data identification flag is "1", and the existence of a section including SPD is checked. If such an SPD exists temporarily, there is SP data that may be displayed after the display start time. In this example, since such an SPD exists in the entry section # 2, access is made to the sub-picture structure including the SPD, and the access is performed (step (4) in FIG. 19). ).

In the present application, even if the SP data does not need to be displayed at the arbitrary display start time with respect to the arbitrary display start time, the still data after the arbitrary display time on the reproduction time axis is displayed. SP data recorded before the arbitrary display start time, which needs to be read in advance in order to perform image display accurately and without interruption, is called "look-ahead SP data". That is, if the prefetched SP data must be read prior to the start of the reproduction, there is a possibility that the still image display may be interrupted after the display is started. However, after the pre-read SP data is pre-read, it may not be actually used for still image display. That is, here, if there is a possibility of being used for subsequent display according to the reproduction condition, it is treated as pre-read SP data, and the pre-read processing is performed.

Thereafter, display control based on the obtained SP control information is performed by the above processing, and reproduction of a still image corresponding to the SP data is started (processing (5) in FIG. 19). Here, for example, based on the display start time and display time (see Fig. 16) indicated by the SP control information, the still picture display by the subpicture corresponding to the SP data is performed for a fixed period! : It is done. Through the series of processing shown in Fig. 19, even when the display is started from an arbitrary display start time in special playback such as time search, chapter search, fast forward, and rewind, the display start time The still image that should be displayed is displayed faithfully, and the still image that should be originally displayed cannot be displayed or the still image is not interrupted.

As described above with reference to FIGS. 14 to 21, according to the first acquisition method of the SP data and the SP control information, a total of two bits are used for the two flags (FIGS. 20 and 21). Using the extremely small data amount of ES address information, it is possible to efficiently specify the recording position of SP data and SP control information. For example, if the ES address information related to the video stream as shown in FIG. 14 is 32 bits for each section of the entry, the sub-picture stream as shown in FIGS. 20 and 21 is used. In the ES address information according to the above, a small data amount of 1 Z 16 is sufficient.

(B) Second acquisition method of SP data and SP control information

With reference to FIGS. 22 to 24 and FIGS. 14, 15 and 21, the second acquisition method of SP data and SP control information and the associated playback control of a still image will be described. . Here, FIG. 22 shows a table of the contents of the structure information and SP control information according to the second acquisition method, and FIG. 23 schematically shows an acquisition procedure in the second acquisition method. . Further, FIG. 24 shows a specific example of the structure information and the SP content opening / closing information according to the second acquisition method.

In the first acquisition method described above, the first and second arrangement conditions described above are added. In the second acquisition method described below, the second arrangement condition described with reference to FIG. 18 is used. It is executed without adding. In particular, the SP data identification flag (see FIG. 20) in the first acquisition method described above is not constructed in the ES address information, and the SCP identification flag (ES address information) for the sub-picture stream is used. This is described only in Fig. 21). Then, instead of not describing the SP data identification flag in the ES address information in the object information file, the SP control information in the object data file describes information for identifying the prefetched SP data. It is.

As shown in FIG. 22, in the embodiment according to the second acquisition method, the sub-picture Data or information related to a still image recorded on the trim is configured to include structure information 71 1 and SP control information 71 2 ′. Among them, the content of the structural information 7 11 is the same as that of the first acquisition method shown in Fig. 16 (a).

The SP control information 712 ′ according to the second acquisition method includes information indicating a display start time of the applied SP data and a display time of the SP data. At the time of playback, the SP data on which the SP control information 7 1 ′ acts is played back for a predetermined time on the playback time axis, and a still image is displayed.

Further, the SP control information 712 ′ has the total number of prefetched SP data, the identifier of the prefetched SP data, and the position information (entry section) of the prefetched SP data. The “look-ahead SP data” here is defined based on the recording position of the SCP in the SP control information, in which the total number and the like are described, and is located backward on the playback time axis from the SCP in the SP control information. This refers to the SP data on which the SP control information with the recorded SCP acts, and the SP data is recorded ahead of the SCP in the SP control information. Therefore, in the following description of the second acquisition method, SP data that satisfies such a condition is simply referred to as “prefetch SP data”.

In the second acquisition method according to the present embodiment, the acquisition of the SP control information as illustrated in FIG. 22 is executed using the address information as illustrated in FIG. 21 similarly to the first acquisition method.

In FIG. 23, at the time of reproduction, first, the display start PTS is given as the (0) th processing, then the SCP in the forward entry section is searched and read as the (1) processing, and then as the (2) processing. Go to read SP data, then read the SCP in the backward entry section as the (3) th process, read the SP data as the (4) th process, and then read the SP data as the (5) th process Each process of reading the data and finally starting playback as the (6) process is shown graphically at the corresponding location on the time axis (the axis extending from left to right in the figure).

The second acquisition method differs from the first acquisition method in particular. If the SCP does not exist at the display start time according to the SCP identification flag shown in (1), it is first checked whether the SCP exists ahead on the playback time axis, and then the SCP backward on the playback time axis. It is checked whether it exists.

Note that Fig. 24 shows a specific example of SP control information 7 1 2 "with SCP # 2a located in entry section # 4 as the first bucket, as a specific example corresponding to Figs. 23 and 21. Content is illustrated.

In FIG. 23, during playback, first, when the display start PTS in entry section # 3 is obtained (processing (0) in FIG. 23), SCP identification of the ES address information included in the object information file is performed. The flag (see Fig. 21) is referenced to check whether SCP exists in this entry section # 3. In this example, since it is determined that the SCP does not exist, the SCP identification flag is further referred to, and first, a search is made for an SCP existing in another entry section located ahead in the reproduction time axis. Thus, in this example, it is clear that the SCP to be read first exists in the entry section # 1.

Therefore, in FIG. 23, the SCP data is searched for in the object data file in this entry section # 1 (process (1) in FIG. 23). More specifically, first, the ES packet information of FIG. 14 is referred to, the first packet of the entry section # 1 (in this example, "r") is obtained, and then, in the object data file, Access to the first packet is performed. After that, the header (structure information 711) of the packet on the same sub-picture stream following the first packet is sequentially checked, and within the entry section # 1, the sub-picture structure 702 including the SCP is checked. Will be found.

After that, the “SP data position” recorded in the SP control information in the obtained sub-picture structure including the SCP is referred to, and the position (entry section) of the SP data to be controlled by this SP control information is specified. You. Then, access to the SP data whose position is specified is executed (the (2) -th process in FIG. 23). For example, if the display start time T14-0 is described as the position (entry section) of the SP data, first, the ES address information shown in Fig. 14 is referred to in the object information file. The packet number "q" is obtained. Immediately That is, in this example, it is determined that the SPD to be read exists in the entry section # 0. Thereafter, access to this first packet (bucket number "q") is performed in the object data file. Subsequently, the header (structural information 711) of the packet on the same sub-picture stream following this first bucket is sequentially checked, and in the entry section # 0, the sub-picture including the SPD is checked. The structure 703 (the sub-picture structure 703 indicated by “SPD # 1” in FIG. 23) is to be found.

After that, the SP data in the sub-picture structure including the acquired SPD is read (No. (2) processing in Fig. 23).

Next, another entry section located backward on the playback time axis is searched for an SCP. Thus, in this example, it is clear that the SCP to be read first exists in the entry section # 4.

Therefore, in FIG. 23, the SCP data is searched for in the object data file in this entry section # 4 (the (3) -th processing in FIG. 23). More specifically, first, the first packet (in this example, "u") of entry section # 4 is obtained by referring to the ES address information in FIG. 14, and thereafter, in the object data file. The access to the first packet is executed. After that, the header (structural information 7 11) of the packet on the same sub-picture stream following this first packet is sequentially checked, and the sub-picture including SCP # 2a is included in the entry section # 4. The structure 702 is searched for, and the SP control information 712 "having the specific contents shown in Fig. 24 is obtained. Fig. 24 shows the specifics of the SP control information 712 for SCP # lb. The contents are typical.

After that, the “SP data position” (see Fig. 24) recorded in the SP control information in the obtained sub-picture structure containing SCP # 2a is referenced, and the SP data that is the control target of this SP control information is referred to. Location (entry section) is specified. Then, the access to the SP data whose position is specified is executed (the (4) th process in FIG. 23). For example, if the display start time T14-2 is described as the position of SP data (one entry section), first refer to the ES address information shown in Fig. 14 in the object information file. The bucket number "s" Is obtained. That is, in this example, it is found that the SPD to be read exists in the entry section # 2. After that, access to this first packet (packet number "s") is executed in the object data file. Subsequently, the header (structural information 711) of the packet on the same sub-picture stream following the first packet is sequentially checked, and in the entry section # 2, the sub-picture structure including the SPD is checked. 70 3 (the sub-picture structure indicated by “SPD # 2” in FIG. 23) will be searched for.

Then, the SP data in the sub-picture structure including the acquired SPD is read (No. (4) process in Fig. 23).

Then, based on the total number of prefetched SP data, identifiers, and location information (one entry section) described in the SP control information in the subpicture structure including SCP # 1 b acquired in the (4) th processing of Fig. 23 (See Fig. 24), the read-ahead SP data is read. For example, as shown in FIG. 24, the total number of prefetched SP data is “1”, the identifier is “# 1”, and the position information of the prefetched SP data “# 1” identified by this is: If it is T14_0, first, the ES address information in FIG. 14 is referred to, and the packet number q is obtained. Then, after accessing the packet with the packet number q, a subpicture or structure including SP data is searched for from a plurality of packets following this packet in the entry section # 0, and the prefetched SP data is searched. (Process (5) in Figure 23).

In this specific example, since the prefetched SP data # 1 has already been acquired in the (2) th process, the acquisition operation need not be performed again.

After that, the display control based on the obtained SP control information is performed by the above processing, and the reproduction of the still image corresponding to the SP data is started (the (6) th processing in FIG. 23). Here, for example, based on the display start time and the display time (see FIG. 22) indicated by the SP control information, a still image is displayed by a sub-picture corresponding to the SP data over a certain period.

By the series of processing shown in Fig. 23, even if the display is started from an arbitrary display start time in special playback such as time search, chapter search, fast forward, rewind, etc., it is originally displayed at the display start time The desired still image is displayed. There are no situations in which the still image that should be originally displayed cannot be displayed, or the still image is interrupted.

As described above with reference to FIGS. 22 to 24 and FIGS. 14, 15, and 21, according to the second acquisition method of SP data and SP control information, one flag is obtained. Thus, it is possible to efficiently specify the recording position of the SP control information by using the extremely small data amount of the ES address information of 1 bit (see Fig. 21). For example, if the ES address information relating to the video stream as shown in FIG. 14 is 32 bits per one section of the entry, the ES address information relating to the sub-picture stream as shown in FIG. 21 Is a small data amount of 1/3 2 is enough.

According to the first acquisition method and the second acquisition method in the present embodiment described above with reference to FIGS. 14 to 24, three types of sub-picture structures as shown in FIG. By adopting 0 1 to 7 03, it is not necessary to read the sub-picture structure including the SP data 7 13 to be controlled each time the display is controlled by the SP control information 12 during playback. . Conversely, the display and control of one SP data 7 13 can be controlled by SP control information recorded separately, and in particular, it is possible to apply a plurality of SP control information to the same SP data. . Alternatively, it is also possible to control the display of a plurality of SP data 711 by the same SP control information recorded separately therefrom.

In particular, in the present embodiment, the sub-picture structure 703 including the SP data 713 and the sub-picture structure 702 including the SP control information 712 acting on the sub-picture structure are formed by combining a plurality of sub-picture streams (ie, (SPD stream and SCP stream) are recorded separately, so SP data can be efficiently reproduced and controlled. Further, a plurality of streams for SCP are provided for one SPD stream so that a plurality of SP control information 712 can selectively act on the same SP data 713. Correspondence can also be made, which makes it possible to control playback of SP data more efficiently.

It should be noted that the sub-picture structure 701 or 703 including such SP data 713 and the sub-picture structure 702 including SP control information 712 acting on the SP data 710 include a plurality of elementary leases. For some of the trim, the same sub-picture May be recorded on the home page.

(Specific example of still image playback control using SP control information)

Next, in this embodiment, a specific example of the reproduction control of the still image by applying the SP control information to the SP data acquired as described above will be described with reference to FIGS. This will be described with reference to FIGS. This acquisition method is executed by the information recording / reproducing device 500 (see FIG. 8) based mainly on SP data and SP control information in a sub-picture structure.

Here, the SP data included in one sub-picture data structure 70 1 or 70 3 shown in FIG. 17 (a) or (c) recorded on one sub-stream is compared with the other SP data. The playback control using the SP control information contained in the multiple sub-picture structures 70 1 or 72 shown in Fig. 17 (a) or (b) recorded on the sub-picture stream is explained. Here, Fig. 25 shows schematically how a new still picture (sub-picture) is formed by applying SP control information to SP data, and Fig. 26 shows how to cut out a sub-frame from a sub-picture. Fig. 27 shows the data structure of the AU and PU when sub-picture data and multiple pieces of SP control information are divided into separate streams. Is shown in the table Fig. 28 schematically shows the relationship between the SPD stream and multiple SCP streams with respect to the playback time axis, and Fig. 29 and Fig. 30 show this relationship. It shows various display modes in which a sub-frame is cut out from a sub-picture and displayed using such SP data and SP control information.

The reproduction control in this specific example is based on the SP data acquired from one sub-picture stream in the same manner as the first or second acquisition method described above, and the first or second SP data acquired from another sub-picture stream. A plurality of SP control information acquired by the acquisition method are applied one after another to display a new still image. As shown in FIG. 25, in the reproduction control of the present specific example, for example, one sub-picture structure 70 1 or 70 3 (FIG. 17 Different sub-pictures for SP data in ( _a ) or (c)) The SP control information in the structure 70 1 or 70 2 (see FIG. 17 (a) or (b)) is actuated to display a new still picture, a subpicture 902. More specifically, the sub-picture 90 1 is cut out in the range of each of the sub-frames 90 3 a, 90 3 b, and 90 3 c, and further, on the display screen, the cut-out sub-frame 90 0 3a is rotated and placed at the lower right of the subpicture 902, subframe 903b is rotated and placed at the upper left, and a new subpicture is placed so that subframe 903c is placed at the lower left 9 02 is displayed.

The conditions such as the cut-out range of these sub-frames, the arrangement at the time of display, the enlargement / reduction, and the rotation are described in the SP control information 7 12. Therefore, by using one sub-picture structure 701 and making the SP control information 712 contained therein act on the SP data 713 contained therein as well, After the sub-picture 901 is displayed, a new sub-picture 902 is created by applying the SP control information 712 included in the other sub-picture structure 702 to this SP data 713. It can be displayed. Alternatively, by applying the SP control information 712 included in one sub-picture structure 702 to the SP data 713 included in another sub-picture structure 703, After the sub-picture 9 01 of the sub-picture 9 is displayed, the SP control information 7 12 included in the other sub-picture structure 7 0 2 is applied to this SP data 7 13 to generate a new sub-picture 9 02 can be displayed. Alternatively, by applying the SP control information 712 included in one sub-picture structure 701 to the SP data 713 included in another sub-picture structure 703, After displaying the sub-picture 9 01 of the sub-picture 9 1, the SP control information 7 12 included in the other sub-picture structure 7 0 1 is applied to this SP data 7 13, so that a new sub-picture 9 0 2 can be displayed. In addition, various combinations of SP data and SP control information acting on the SP data can be considered.

In any case, the reuse of bitmap data or SP data consisting of JPEG data, which has a large amount of data, makes it possible to save the limited recording capacity on the disc, and achieve more efficient playback and Display processing is also possible. In addition, in each case, video data recorded in other video streams It is also possible to superpose such a sub-picture 91 or 902 on a moving image or a main video based on.

As shown in FIG. 26, the extraction of the sub-frame 1903 from the sub-picture 1901 is performed when the sub-picture 1901 and the sub-frame 1903 are matched (FIG. 26 (a)). Sub-picture 1 Sub-frame 1 in any range smaller than 1

When 903 is specified (Fig. 26 (b)), one or more sub-frames 1 903 a, 1 903 b ... (Fig. 26 (c)), and subframes 1903a and 1903b-that overlap in one or more arbitrary ranges that are narrower than subpicture 190 (Fig. 2 6 (d)], one or more subframes 1903 a, 1

In the case of 90 3b ···· [Fig. 26 (e)], it can be described in the SPC control information in various forms, and clipping is performed.

In this specific example, AUs and PUs relating to SP data on the stream for SPD and SP control information on the stream for SCP, which are a plurality of SP control information respectively acting on the SP data. The data configuration of this is exemplified in FIG. 27, for example.

As shown in FIG. 27, the ES-PID of the stream for SPD and the ES-PID of a plurality of streams for SCP are different from each other, and are different from each other. AU (associate unit) # 1 is composed of two PU (presentation unit) # 1 and PU # 2. The elementary streams that make up PU # 1 are a video stream (Videol), a stream for SPD (SPD1), a stream for SCP (SCP1), and a stream for SCP (SCP2). Includes SCP stream (SCP 3). On the other hand, the elementary streams constituting PU # 2 include a video stream (Video 2), a stream for SPD (SPD 2), and a stream for SCP (SCP 4).

As a reproduction in such a data configuration, for example, if PU # 1 is selected according to a user operation, a video stream (Videol) and a stream for SPD (SPD1) are reproduced. It is targeted. Furthermore, regarding the SCP stream, three SCP streams identified as “SCP 1” to “SCP 3” in Fig. 27 are shown. The reproduction control by the selected one is executed. Alternatively, for example, if PU # 2 is selected according to a user operation, the video stream (Video 2) and the stream for SPD (SPD 2) are targeted for playback, and the stream for SCP (SCP 4) is also used. Reproduction control is executed.

In any case, the SP control information on the other SCP stream is applied to the SP data on the SPD stream, and the reproduction control is executed.

Here, especially when PU # 1 is selected, even if SP data on the same SPD stream is to be reproduced, different SP control information can be obtained by selecting different SCP streams. Will be applied, and different still images will be displayed.

More specifically, as shown in FIG. 28, when PU # 1 is selected, the time during the playback of the video stream (Videol) of “ES—PID = 200” At t 11, reading of SP data (SPD 1) on the SPD stream of “ES—PID = 201” is started, and the memory 5 of the information recording / reproducing device 500 (see FIG. 8) is started. Stored in 40. Then, the stored SP data is stored until the set end time or until the reading of the next sub-picture is started.

In Fig. 28, the stream for SCP (ES1 PID = 202) for SCP (SCP1) includes SCP #la at the timing of time t21, time t22, time t23, and time t24, respectively. , SCP #lb, SCP #lc and SCP #ld. SCP # 2a, SCP # 2b and SCP # 2c are placed in the SCP stream (SCP 2) of "ES_P ID = 2 0 3" at time t31, time t32 and time t33, respectively. It has been done. SCP # 3a, SCP # 3b, and SCP at the timing of time t41, time t42, time t43, and time t44, respectively, for the SCP stream (SCP 3) of "ES—PID = 204" # 3c and SCP # 3d are deployed.

Fig. 29 shows a still image displayed by applying the SP control information on multiple SCP streams configured as shown in Figs. 27 and 28 to the SP data on the SPD stream. An example of the display is shown. That is, when the SCP stream (SCP 1) is selected from these SCP streams, for example, the subpicture 2901 shown in FIG. 29A is cut out (in this case, The sub-frame is the same as the sub-picture), and as shown in Fig. 29 (b), the time series is obtained by the action of SP control information with each SCP # la, SCP # lb, SCP #lc and SCP # Id as the first bucket. The sub-picture 2901 is displayed as a moving image 2902b.

If the SCP stream (SCP 2) is selected from these SCP streams, for example, the sub-picture 2901 shown in Fig. 29 (a) is cut out, and the As shown in (c), due to the action of SP control information with each of SCP # 2a, SCP # 2b and SCP # 2c as the first bucket, the ) Is displayed as an image 290 2 c with a motion different from that of).

Alternatively, if the SCP stream (SCP 3) is selected from these SCP streams, for example, the sub-picture 2901 shown in Fig. 29 (a) is cut out and the As shown in Fig. 9 (d), the sub-pictures 291 are time-sequenced by the action of SP control information with each of SCP # 3a, SCP # 3b, SCP # 3c and SCP # 3d as the first packet. Figure 29 (3) ゃ An image 290 2d with a motion different from that of Figure 29 (c) is displayed.

The SP control information with each SCP as the first packet is interpreted by the file system / logical structure data reader 522 of the information recording / reproducing device 500 to determine the meaning of the operation, and the control signal S c By 5, the corresponding image is cut out from the memory 540, the enlargement / reduction, rotation, display position, etc. are specified, added to other video signals by the adder 514, and output as video output.

The SCP stream to be operated in the same PU is selected, for example, by the user inputting the title information of the information recording / reproducing device 500 / user input to the system controller 520 from the user interface of the user interface 720 during reproduction. It may be performed afterwards (see Fig. 8). Also, when creating discs for export to multiple countries, create multiple SCP streams that match the customs, languages, etc. of each country, and match each of the discs to be exported with the export country. To select the stream for SCP. For example, a method of separately writing an instruction for selection into the file may be considered. According to this method, a symbol indicating the exporting country can be written later on a common disk so that it can be shared as software corresponding to many countries.

Fig. 30 is displayed by applying the SP control information on multiple SCP streams configured as shown in Fig. 27 and Fig. 28 to the SP data on the SPD stream. 13 shows another example of still image display.

In the example of Fig. 30, the language of each country is recorded as the sub-picture 3901, and the sub-frame is included in each SP control information as indicated by reference numerals 3903a to 3903c. Specified by Which subframe 3903 is to be selected is described in each SP control information on each of the SCP streams.

FIG. 30 (a) shows a state in which a Japanese sub-frame 3903a is selected from the sub-pictures 3901 and is superimposed on a predetermined position of the display image. Similarly, Fig. 30 (b) shows the case where the English subframe 390 3b is selected, and Fig. 30 (c) shows the case where the German subframe 903c is selected. is there. The SCP stream to be selected can be determined, for example, by the user using the information recording / reproducing apparatus 500 type ^^ information / user input 720 interface user interface as described above. You can do this by typing (see Figure 8). In this example, for example, in an international exhibition hall, by letting the visitor select the language, there is no need to create video software for each language, which has a large economic and time effect.

(Access flow during playback)

Next, referring to FIG. 31, information recording / reproducing apparatus 50 using AU (association unit) information 132 and PU (presentation unit) information 302, which is one of the features of the present embodiment. The access flow at the time of reproduction in 0 will be described together with the logical structure of the optical disk 100. FIG. 31 conceptually shows the entire access flow at the time of reproduction in relation to the logical structure of the optical disk 100.

In FIG. 31, the logical structure of the optical disc 100 has three layers: a logical layer 401, an object layer 400, and a logical-object association layer 402 that associates these two layers with each other. Are roughly divided into Among them, the logical layer 401 is a layer for logically specifying various kinds of logical information for reproducing a desired title at the time of reproduction, a playlist to be reproduced (P list), and its constituent contents. . In the logical layer 410, disk information 110d indicating all titles 200, etc. on the optical disk # 0 is described in the disk information file 110 (see FIG. 3). The reproduction sequence information 120d of all contents on the optical disc 100 is described in the playlist information file 120 (see FIG. 3). More specifically, the configuration of one or more playlists 126 is described in each title 200 as the playback sequence information 120d, and each playlist 1206 is described. Describes the configuration of one or more items 204 (see FIG. 7). Then, at the time of access at the time of reproduction, the title 200 to be reproduced is specified by such a logical hierarchy 401, and the play list 126 corresponding to this is specified. Identify the corresponding item 204.

Subsequently, based on the information specified in the logical layer 401 as described above, the logical-object-association layer 402 specifies the combination and configuration of the TS object data 144d as the entity data. At the same time, it is a layer that specifies the attribute of the TS object data 140d to be reproduced and its physical storage address so that the address conversion from the logical layer 401 to the object layer 400 is performed. More specifically, in the logical object association hierarchy 402, the block of contents constituting each item 204 is classified into units of AU132, and each AU132 is assigned to PU302. Object information data 130d that is subdivided into units of 2 is described in the object information file 130 (see FIG. 3).

Here, “PU (presentation unit) 302” is a unit in which a plurality of elementary streams are associated with each other in units of playback switching. If there are three audio streams in this PU302, the user can freely switch between the three audio streams (for example, language-specific audio) while playing this vision. Become.

On the other hand, “AU (associate unit) 1 32” is a unit in which a plurality of elementary streams such as video streams in a TS object used in one title are collected. Or, it consists of a set of a plurality of PU302. More specific Is a unit in which an elementary stream packet ID (ES-PID) is indirectly collected for each TS object via the PU 302. The AU1332 corresponds to a set of a plurality of programs or a plurality of programs having a specific relationship with each other in consideration of content, such as a plurality of mutually switchable programs or a plurality of programs in multi-source broadcasting. I have. The PU 302 belonging to the same AU 132 forms a set of one or more elementary streams that respectively constitute a plurality of programs or a plurality of programs that can be switched mutually by a user operation during reproduction. Yes, it is.

Therefore, if the AU 132 to be reproduced is specified and the PU 302 belonging thereto is specified, the elementary stream to be reproduced is specified. That is, a desired elementary stream can be reproduced from the multiplex-recorded data from the optical disc 100 without using the PAT or PMT shown in FIG.

It should be noted that a more specific data structure of the AU information 1321 and the PU information 302I defining the AU132 and the PU302, respectively, will be described later with reference to FIG. explain.

The elementary stream that is actually reproduced here is specified or specified from the PU information 302 by ES-PID, which is a packet ID (see FIG. 6) of the elementary stream. At the same time, the information indicating the start time and end time of playback is converted into the address information of the elementary stream, so that the content in the specific area (or the specific time range) of the specific elementary stream is reproduced. Will be.

In this manner, in the logical-object association hierarchy 402, the address conversion from the logical address related to each item 204 to the physical address related to each PU 302 is executed.

Subsequently, the object layer 4003 is a physical layer for reproducing the actual TS object data 140d. In the object hierarchy 403, TS object data 140d is described in an object data file 140 (see FIG. 3). More specifically, TS packets 146 constituting a plurality of elementary lease streams (ES) are multiplexed for each time, and these are multiplexed on the time axis. By arranging along, multiple elementary streams are configured (see Fig. 5). The plurality of TS packets multiplexed at each time are associated with the PU 302 specified by the logical object association hierarchy 402 for each elementary stream. Note that associating a plurality of PUs 302 with one elementary stream (for example, an elementary stream related to the same audio data between a plurality of switchable programs or a plurality of programs) Can be commonly used, or the elementary stream related to the same sub-picture data can be commonly used).

As described above, in the object hierarchy 403, the actual object data is reproduced using the physical address obtained by the conversion in the logical object association hierarchy 402.

As described above, access to the optical disc 100 at the time of playback is executed by the three layers shown in FIG.

(Structure of each information file)

Next, referring to FIGS. 32 to 35, various information files constructed on the optical disc 100 of the present embodiment, that is, (1) the disc information file 110 described with reference to FIG. The data structures of (2) the playlist information file 120 and (3) the object information file 130 will be described with specific examples.

(1) Disk information file:

First, with reference to FIGS. 32 and 33, the disc information file 110 will be described in detail using a specific example. Here, FIG. 32 schematically shows a specific example of the data structure of the disk information file 110. FIG. 33 shows the title information table (table) 114 included therein. Fig. 3 schematically shows a specific example of a data configuration.

As shown in FIG. 32, in this specific example, the disk information file 110 stores disk general information 112, a title information table 114, and other information 118.

Among them, the disc total information 112 includes, for example, disc volume information indicating a serial number of a series composed of a plurality of optical discs 100 and total title number information. It is comprehensive disc information such as information.

The title information table 111 stores all the playlists that constitute each title, and other example information such as the chapter information in the title as information for each title. Title # 1 information, Title # 2 information,…. Here, “Title pointer information” is the storage address information of the title #n information, that is, as shown by the arrow in FIG. 32, the title # in the title information table 1 14 This is storage address information indicating the storage location of n information, and is described using a relative logical address. Then, the number of titles in the optical disc 100 are arranged in the order of titles as relative logical addresses. Note that the data amount of each of the stored address information may be a fixed byte or a variable byte.

The other information 118 is information on each title, such as the type of title, such as a sequential type or a branch type, and the total number of playlists.

For example, if the title simply consists of one playlist, the title information table 1 14 stored in the disc information file 110 shown in FIG. 32 (see FIG. 3) Is described as having relatively simple contents as shown in FIG.

(2) Playlist information file:

Next, with reference to FIG. 34, the playlist information file 120 will be described in detail using a specific example. Here, FIG. 34 schematically shows a specific example of the data configuration in the playlist information table (table) 121 constructed in the playlist information file 120.

As shown in FIG. 34, in this specific example, in the playlist information file 120, the playlist general information 122, the playlist pointer table 124, and the playlist The # 1 information table and the playlist # 2 information table 126 are stored as a playlist information table 122 (see FIG. 3).

Each veil may have a structure in which a required number of tables can be added. For example, if there are four play lists, the number of folds will increase to four. And the same is true for the item information table 1 29.

Among these, the playlist total information (P-list comprehensive information) 122 describes the size of the playlist table, other information, the total number of playlists, and the like. The play list pointer table (P list pointer table) 124 has an address force S at each play list writing position, and as shown by the arrow in FIG. 34, the corresponding play list information table 1 2 1 It is stored as a relative logical address within the.

The play list # 1 information table (P list # 1 information table) 1 26 contains general information on the play list # 1 and the item information table of the play list # 1 (P list Item information Tab). 1 e) Contains 1 2 9 and other information. The playlist # 2 information table 12.6 also describes the same type of information related to playlist # 2.

The “item information table (Item information table) 1 229” stores item information for all items constituting one program list. Here, the AU number in the AU (associate unit) table described in “Item # 1 (Item # 1 information)” or “Item # 2 (1 item # 2 information)” refers to the corresponding AU number. The address of the TS object used for reproducing the item and the information for specifying each elementary stream (that is, video stream, audio stream or sub-picture stream) in the TS object used for reproducing the item are stored. This is the number of the AU sent.

(3) Object information file:

Next, with reference to FIG. 35, the object information file 130 will be described in detail using a specific example. Here, Figure 35 shows the AU (associate unit) table 13 1 (see Figure 3) constructed in the object information file 130 and the ES (elementary lease stream) map associated with it. FIG. 9 schematically shows a specific example of the data configuration in table 134 (see FIG. 3).

As shown in FIG. 35, in this specific example, an object information table (object information table) is stored in the object information file 130. The object information table is shown in the AU table shown in the upper part of the figure. And an ES map table 134 shown in the lower part.

In the upper part of FIG. 35, the AU table 13 1 may have a structure capable of adding as many tables as necessary for each field (Fie 1 d). For example, if there are four AUs, the structure may be such that the number of folds increases to four.

The AU table 13 1 stores “AU table general information” in which the number of AUs, a pointer to each AU, and the like are described, and “other information” in another field (Fie 1 d). I have.

Then, in the AU table 131, AU information 1332I indicating ES staple index #m (E S_table Index #m) in each PU # m corresponding to each AU # n is expressed as: The index number (Index number = ー) of the corresponding ES map table 134 is described. Here, “AU” means a unit corresponding to a “program” in a television broadcast as described above (in particular, in the case of a “multi-vision” broadcast, a plurality of switchable “visions” is referred to as a “vision”). It is a unit of one), and contains one or more PUs as playback units. The “PU” is a set of mutually switchable elementary streams included in each AU as described above, and the ES table index corresponding to each PU by PU information 302 I. # Has been identified. For example, when a multi-view content is configured by an AU, a plurality of PUs are stored in the AU, and a plurality of elementary streams indicating packets constituting the content of each view are stored in each PU. Contains a pointer to the packet ID. This indicates the index number in the ES map table 134 described later.

In the present embodiment, the AU table 1331 indicates that the packet serial number (serial number) in the TS object 142 described above does not include the packet number when the packet is lost due to the editing process. Discontinuous information indicating a continuous state may be added. If such discontinuity information is used, when a packet loss occurs, the discontinuity state indicated by the discontinuity information can be taken into consideration without the need to newly assign a packet number (for the elementary stream). By counting the number of packets (starting from the specified packet), the address of the packet to be accessed can be specified. Such discontinuity information includes, for example, information indicating the start point of the discontinuity and the number of missing packets. this As described above, the discontinuity information is described collectively for a plurality of AUs in common, and is excellent in terms of saving recording capacity. In addition, such discontinuity information can be described inside and outside the object information file other than the AU table 13 1.

In the lower part of FIG. 35, the ES map table 134 has a field (Fie

1 d) Separately, ES map table general information (ES—maptab 1 e general information), multiple indexes #m (m = 1, 2, 2,...), And “other information” are stored. I have.

The “ES map table comprehensive information” describes the size of the ES map table, the total number of indexes, and the like.

“Index #tn” is the elementary stream packet ID (ES_P ID) of all elementary streams used for playback, and the corresponding index number and address of the elementary stream. It contains information.

In the present embodiment, in particular, when the elementary stream is the video stream of MPEG2 as described above, the TS bucket number at the head of the I picture is used as the address information, that is, the ES address information 134 d. Only the corresponding display time is described in the S and ES map tables 134, and the data amount is reduced (see Fig. 14). On the other hand, as for the ES address information 134d of the sub-picture stream, the index number information 134 e of the elementary stream used as the entry section is described, so that the SCP identification flag and the SP data identification flag correspond to one entry section. Each data is described, and the amount of data is further reduced (see Fig. 20 and Fig. 24).

With this configuration, the elementary stream packet ID (ES—PID) of the actual elementary stream can be obtained from the index number of ES map 134 specified in AU table 133. Becomes Also, since the address information of the elementary stream corresponding to the elementary stream packet ID can be obtained at the same time, the object data can be reproduced based on the information. According to the data structure of the optical disc 100 described above, even if a new title is added to the optical disc 100, it is useful because necessary information can be easily added. Conversely, even if certain information becomes unnecessary as a result of, for example, editing, it is only necessary to refer to that information, and there is no need to actually delete that information from the table. It is useful.

In FIG. 35, the ES—PID not referred to from the upper AU table 13 1 is also described for each index of the lower ES map table 13 4, but the ES_PID not referred to is referred to. Need not be described this way. However, if the ES_PID that is not referred to in this way is also described, creating a more versatile ES map table 13 4 will allow the content to be re-edited, for example, when re-authoring. In this case, there is an advantage that it is not necessary to rebuild the ES map table.

As described above in detail with reference to FIGS. 1 to 35, according to the present embodiment, still image data including bitmap data having a relatively large data amount is converted into video data or still image data as sub-picture data. Multiplex recording can be performed efficiently with audio data.

In addition, it is possible to output one sub-picture in various forms by controlling a plurality of image outputs of sub-picture data, and by holding the sub-picture, the same data can be expressed differently many times. It provides a very simple and versatile means for soft formation.

Furthermore, by utilizing the 1-bit flag information such as the SCP identification flag and the SP data identification flag, it is possible to efficiently perform the acquisition processing of the SP control information and the SP data and the reproduction control processing of the still image. In particular, since the amount of data required for this is small, the recording capacity on the optical disc 100 can be saved.

In the above embodiment, the optical disk 100 as an example of the information recording medium and the recorder or player according to the optical disk 100 as an example of the information reproducing / recording apparatus have been described. The present invention is not limited to a recorder or a player, but can be applied to other various information recording media compatible with high-density recording or a high transfer rate, and its recorder or player. As described above, according to the present invention, still image information having a relatively large data amount can be multiplex-recorded together with moving image information, audio information, and the like. Can be reproduced. In particular, by employing the still picture information set (for example, a sub-picture structure) according to the present invention, different still picture control information is applied to still picture information related to one sub-picture for display. This makes it possible to use the same still image information for many different expressions. As a result, recording capacity for a still image having a large data amount can be saved. Furthermore, by employing the control information identification flag (for example, SCP identification flag) and the still image information identification flag (for example, SP data identification flag) according to the present invention, the acquisition processing of the still image information and the reproduction control processing can be efficiently performed. By reducing the amount of data required for these processes, it is possible to save recording capacity as a whole.

The present invention is not limited to the above-described embodiments, but can be appropriately modified within the scope not contrary to the gist or idea of the invention, which can be read from the claims and the entire specification, and information accompanying such changes A recording medium, an information recording apparatus and method, an information reproducing apparatus and method, an information recording and reproducing apparatus and method, a computer program for controlling recording or reproduction, and a data structure including a control signal are also included in the technical scope of the present invention. That is. Industrial applicability

The information recording medium, the information recording apparatus and method, the information reproducing apparatus and method, the information recording / reproducing apparatus and method, the recording or reproducing control computer program, and the data structure including the control signal according to the present invention include, for example, It can be used for high-density optical discs such as DVDs that can record various information such as main video, audio, and sub-video for business or business use at high density, and can also be used for DVD players, DVD recorders, etc. is there. Further, for example, the present invention can be used for an information recording medium, an information recording / reproducing device, etc. mounted on various consumer or business computer devices or connectable to various computer devices.

Claims

The scope of the claims

1. An information recording medium in which an entire stream including a plurality of partial streams each composed of content information forming a series of contents is multiplex-recorded in a packet unit which is a physically accessible unit. And

An object data file that stores object data that is a logically accessible unit and includes a plurality of packets including packets that respectively store the pieces of the content information;

A playback sequence information file that stores playback sequence information that defines a playback sequence of the object data;

An object information file storing correspondence definition information defining correspondence between the plurality of multiplexed packets and the plurality of partial streams as reproduction control information for controlling reproduction of the object data;

With

The whole stream includes one partial stream composed of still image information that is one of the content information as one of the plurality of partial streams, and additionally displays the still image information. An information recording medium characterized by further comprising another partial stream composed of still image control information for controlling the information.

2. The whole stream includes, as the other partial stream, a plurality of partial streams each composed of a plurality of pieces of still image control information for performing different display control on the same still image information. The information recording medium according to claim 1, wherein:

3. The correspondence definition information includes address information including at least a part of a serial number of a packet constituting each partial stream and a display start time corresponding to the serial number, the plurality of partial streams. The information recording medium according to claim 1, which is provided separately.

4. The packet related to the one partial stream is a still image information set including the still image information and a fragment of the still image information set further including structure information indicating the structure. Includes packets to store,

The packet related to the other partial stream is a packet for storing a still image information set including the still image control information and a fragment of the still image information set further including structure information indicating the structure thereof. The information recording medium according to claim 1, wherein the information recording medium includes:

5. The information recording medium according to claim 4, wherein the packet storing the structure information is arranged at the top of a plurality of packets related to the still image information set. .

6. The structure information includes at least the identifier of the still image information identifier, the data length of the still image control information, the data length of the still image information, and position information indicating the recording position of the still image information. The information recording medium according to claim 4, characterized in that:

7. The correspondence definition information includes address information including at least a part of a serial number of a packet constituting each partial stream and a display start time corresponding to the serial number, the plurality of partial streams. The information recording medium according to claim 4, which is provided separately.

8. The correspondence definition information includes, for the one partial stream, a list of only the packets whose positions are specified by the address information among a plurality of buckets constituting the one partial stream. Claims characterized in that a flag indicating whether or not the first packet of the still image information set including the still image information is present in an entry section specified by two adjacent packets. An information recording medium according to paragraph 7.

9. The correspondence definition information includes, for the other partial stream, a flag indicating whether or not a head bucket of a still image information set including the still image control information exists in the entry section. 8. The information recording medium according to claim 7, comprising:

10. If the content information includes video information based on the Moving Picture Experts Group 2 (MPEG2) standard, the address information includes a serial number of a packet related to an I picture and 4. The information recording medium according to claim 3, wherein the information recording medium comprises a display start time corresponding to:

11. The still image control information according to claim 1, wherein the still image control information includes information indicating a display start time of a still image displayed based on the still image information and a display time of the still image. Information recording medium.

1 2. An entire stream including a plurality of partial streams each composed of a series of content information on an information recording medium is stored in units of packets that are physically accessible units. An information recording device for multiplex recording,

First recording means for recording an object data file that stores object data that is a logically accessible unit and that stores a plurality of packets including packets that respectively store the pieces of the content information,

Second recording means for recording a reproduction sequence information file storing reproduction sequence information defining a reproduction sequence of the object data;

As playback control information for controlling the playback of the object data, an object information file storing correspondence definition information defining correspondence between the plurality of multiplexed buckets and the plurality of partial streams is provided. A third means of recording and

The whole stream includes one partial stream composed of still image information that is one of the content information as one of the plurality of partial streams. The information recording apparatus according to claim 1, further comprising another partial stream including still image control information for controlling display of the still image information.

13 3. On the information recording medium, the entire stream including a plurality of partial streams each composed of a series of content information in units of packets that are physically accessible units. An information recording method for multiplex recording,

A first recording step of recording an object data file that stores object data that is a logically accessible unit and stores a plurality of packets including buckets that respectively store the pieces of content information,

A second recording step of recording a reproduction sequence information file storing reproduction sequence information defining a reproduction sequence of the object data;

As reproduction control information for controlling reproduction of the object data, an object information file storing correspondence definition information defining correspondence between the plurality of multiplexed buckets and the plurality of partial streams is provided. And a third recording step for recording.

The whole stream includes one partial stream composed of still image information, which is one of the content information, as one of the plurality of partial streams, and additionally displays the still image information. An information recording method characterized by further comprising another partial stream composed of still image control information for controlling the information.

14. An information reproducing apparatus that reproduces the recorded content information from the information recording medium according to claim 1.

Reading means for physically reading information from the information recording medium;

A reproducing unit for reproducing the object data included in the information read by the reading unit based on the reproduction control information and the reproduction sequence information included in the information read by the reading unit;

An information reproducing apparatus comprising:

15. The playback means includes a still image information read from the one partial stream. And temporarily storing at least one of the still image control information read from the other partial stream in a buffer, and performing display control on the still image information based on the still image control information. The information reproducing apparatus according to claim 14, wherein the information reproducing apparatus is characterized in that:

16. The recorded program from the information recording medium described in claim 1.

An information reproduction method for reproducing information,

A reading step of physically reading information from the information recording medium,

A reproducing step of reproducing, based on the reproduction control information and the reproduction sequence information included in the information read by the reading unit, the object data included in the information read by the reading unit;

An information reproducing method, comprising:

17. An information recording / reproducing apparatus that records the content information on the information recording medium according to claim 1 and reproduces the recorded content information.

First recording means for recording the object data file;

Second recording means for recording the reproduction sequence information file,

Third recording means for recording the object information file,

An information recording / reproducing apparatus comprising:

18. An information recording / reproducing method for recording the content information on the information recording medium according to claim 1 and reproducing the recorded content information,

A first recording step of recording the object data file;

A second recording step of recording the reproduction sequence information file,

A third recording step of recording the object information file; A reading step of physically reading information from the information recording medium; and a reading step included in the information read by the reading section based on the reproduction control information and the reproduction sequence information included in the information read by the reading section. The reproduction process for reproducing the object data

An information recording / reproducing method, comprising:

19. A recording control computer program for controlling a computer provided in the information recording apparatus according to claim 12, wherein the computer is a computer-readable storage medium storing the first recording means and the second recording means. And a computer program for recording control, which functions as at least a part of the third recording means.

20. A computer program for reproduction control for controlling a computer provided in the information reproducing apparatus according to claim 14, wherein the computer functions as at least a part of the reproducing means. A computer program for playback control, characterized in that:

21. A computer program for recording / reproducing control for controlling a computer provided in the information recording / reproducing apparatus according to claim 17, wherein the computer is the first recording means, the second recording. Means, functioning as at least a part of the third recording means and the reproducing means.

2 2. — An entire stream including a plurality of partial streams each composed of content information forming a series of content is multiplex-recorded in a packet unit which is a physically accessible unit.

An object data file that stores object data that is a logically accessible unit and includes a plurality of buckets including buckets that respectively store fragments of the content information;

The playback sequence information that defines the playback sequence of the object data is stored. A playback sequence information file to be stored,

With

The whole stream includes one partial stream composed of still image information that is one of the content information as one of the plurality of partial streams. A data structure including a control signal, further comprising another partial stream composed of still image control information for controlling display.