JPH09322131A - Device and method for forming system stream and storage medium for system stream - Google Patents

Abstract

PROBLEM TO BE SOLVED: To immediately display a sub video on the way of reproduction even in the case that a time enabling a midway reproduction is set with respect to a system stream within a substantial display period of a sub video stream. SOLUTION: When a chapter border time P is set with respect to a system stream within a display period of a sub video image by a data unit in the sub video stream, a system stream forming device is provided with a stream modification means that adds a new data unit SP2 including same picture element data as those of a data unit SP1 onto the sub video stream so as to obtain a modified stream of the sub video image in a way that the sub video image of the data unit is displayed at the midway reproduction from the chapter border time P and with a system processing means that multiplexes the modified stream of the sub video image and other data stream to obtain the system stream.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system stream creating apparatus, a system stream creating method and a system stream storage medium for creating a system stream by multiplexing, for example, video, audio and sub-video data streams.

[0002]

2. Description of the Related Art The MPEG2 system layer is one of the methods for multiplexing a plurality of data streams. This is to packetize video, audio, and private data streams and multiplex them into one data stream (system stream). Packetization of a data stream is a process of dividing each data stream into an appropriate length and adding additional information such as a header to each of these divided data. As the private stream, in many cases, data such as lyrics of a movie Ukaku or karaoke (hereinafter, referred to as sub-picture) is used. Next, details of the multiplexing of the data stream by the MPEG2 system layer will be described with reference to FIG.

In FIG. 1, (a) is a GOP (Group of
Pictures 2) MPEG2 whose bit rate changes for each
It is a video stream. (B) is a fixed bit rate audio stream. (C) is a sub-picture stream. In this sub-picture stream, data is generated for each sub-picture screen, and the unit (data required for one screen)
The bit amount is changing every time. T is the display period of this sub-picture. The system stream obtained by packetizing and multiplexing each of these streams has a configuration as shown in (d).

As shown in FIG. 7, such a system stream 126 is separated into a video input buffer 18, an audio input buffer 19 and a sub-video by a demultiplexer in the system decoder 17, respectively. The original video stream, audio stream, and sub-picture streams 130, 131, and 132 are returned via the video input buffer 20.

Incidentally, in reproducing such a system stream, the packet data S of the sub-picture is not always required.
The reproduction does not always start before the position of P1. For example, a pointer P that can be directly accessed, such as a chapter of a laser disk, is used as a sub-image packet data SP1.
It may be set within the original display period of. In such a case, there arises a problem that the sub-picture due to the sub-picture packet data SP1 is not displayed during the halfway reproduction from the pointer P.

[0006]

As described above, in reproducing a system stream in which the sub-picture stream and another data stream are multiplexed, a pointer that can be directly accessed within the original display period of the sub-picture stream is used. If it is set, there is a problem that the sub-video that should be originally displayed is not displayed during the halfway reproduction from the pointer.

The present invention is intended to solve such a problem. Even when a time point during which the system stream can be played back is set within the original display period of the sub-picture stream, the midway playback is possible. An object of the present invention is to provide a system stream creating device, a system stream creating method, and a system stream storage medium capable of instantly displaying sub-pictures during playback.

[0008]

In order to achieve this object, a system stream creating apparatus according to the present invention comprises:
As described in, in a system stream creation device that creates a system stream from a sub-picture stream in which a data unit including pixel data is arranged and another data stream, halfway playback is possible for the system stream to be created. If a time that allows mid-playback is set for the system stream within the sub-video display period by a data unit in the sub-video stream and setting means for arbitrarily setting the time, the data unit will be played during this mid-playback. Stream transformation means for additionally arranging a new data unit including pixel data identical to the pixel data of the data unit on the sub-picture stream so as to display the sub-picture, and a stream transformation means for obtaining a transformed stream of the sub-picture. Deformed stream and other data streams of sub-picture obtained by A stream characterized by comprising a stream multiplexing means for obtaining a system stream by multiplexing.

According to the system stream creating apparatus of the present invention, even when the time during which the system stream can be reproduced halfway is set within the display period of the sub-picture by a certain data unit in the sub-picture stream,
Since a new data unit containing the same pixel data as the pixel data of the data unit is additionally arranged on the sub-picture stream, the sub-picture is immediately reproduced based on the newly arranged new data unit at the time of midway reproduction. Can be displayed on.

In the system stream creating apparatus of the present invention, as described in claim 2, a data unit including pixel data and display control data for controlling display of the pixel data in time series is arranged. In the system stream creating apparatus for creating a system stream from the created sub-picture stream and another data stream, setting means for arbitrarily setting the time at which the system stream to be created can be played back midway, and If a midway playback time is set for the system stream within the sub video display period of a certain first data unit, the sub video of the first data unit can be displayed during this mid playback. The display control data of the first data unit is one of the display control data divided at the time. At the same time, a new second data unit including the same pixel data as the pixel data of the first data unit and the other display control data divided at the time point is additionally arranged on the sub-picture stream. Stream transformation means for obtaining a modified stream of the sub-picture, and stream multiplexing means for obtaining the system stream by multiplexing the modified stream of the sub-picture obtained by the stream modification means with another data stream. And

According to the system stream creating apparatus of the present invention, in the case where the midway reproduction possible time is set for the system stream within the display period of the sub-picture by the first data unit in the sub-picture stream. Also, each sub-picture data unit before and after the time is inserted,
Since the same pixel data and the display control data for controlling the display of the respective reproduction times for the pixel data are included, the sub video can be immediately displayed during the intermediate reproduction.

According to a third aspect of the present invention, there is provided the system stream creating apparatus according to the second aspect, wherein the stream transforming means is the first data unit in the sub-picture stream. Is added to the display control data after the update, the display end control data which means to end the display of the sub-picture of the first data unit at a time after the display time of the second data unit. To do.

According to the present invention, when the jump to another time occurs at the time when the reproduction is possible, the display of the sub-picture by the first data unit can be forcibly terminated.

The system stream creating method of the present invention is
A method for creating a system stream from a sub-picture stream in which a data unit including pixel data is arranged and another data stream as set forth in claim 4, wherein display of the sub-picture by a certain data unit in the sub-picture stream. If a time during which the system stream can be played back is set for the system stream within the period, a new data including the same pixel data as the pixel data of the data unit is displayed so that the sub-picture of the data unit can be displayed during this playback. A new data unit is additionally arranged on the sub-picture stream to obtain a modified stream of the sub-picture and a step of multiplexing the modified stream of the sub-picture and another data stream to obtain a system stream. And

According to the system stream creating method of the present invention, as in the case of the first aspect of the invention, the time at which the system stream can be reproduced halfway within the display period of the sub-picture by a certain data unit in the sub-picture stream. Even when is set, since a new data unit including the same pixel data as the pixel data of the data unit is additionally arranged on the sub-picture stream, during the halfway reproduction, the newly arranged new data unit is newly arranged. The sub-picture can be displayed immediately based on the data unit.

Further, in the system stream creating method of the present invention, as described in claim 5, a data unit including pixel data and display control data for controlling display of the pixel data in time series is arranged. In the method of creating a system stream from the generated sub-picture stream and another data stream, the time during which the system stream can be reproduced halfway within the sub-picture display period by the first data unit in the sub-picture stream is If set, the display control data of the first data unit is updated with one of the display control data divided at the time so that the sub-picture of the first data unit can be displayed during the midway reproduction. Both display control of the other divided by the same pixel data as the pixel data of the first data unit and the time point. And a new second data unit including a data stream is additionally arranged on the sub-picture stream to obtain a modified stream of the sub-picture, and a modified stream of the sub-picture and another data stream are multiplexed to form a system stream. And a step of obtaining

According to the system stream creating method of the present invention, similarly to the invention of claim 2, it is possible to perform halfway reproduction for the system stream within the display period of the sub-picture by the first data unit in the sub-picture stream. Even when different times are set, the sub-picture data units before and after the time include the same pixel data and display control data for controlling the display of the respective reproduction times for the pixel data. Since it includes the sub video, the sub video can be immediately displayed at the time of midway reproduction.

Further, according to the system stream creating method of the present invention, as described in claim 6, in the system stream creating method according to claim 5, the display after updating the first data unit in the sub-picture stream. It is characterized in that display end control data, which means to end the display of the sub-picture of the first data unit at a time after the display time of the second data unit, is added to the control data.

According to the present invention, similarly to the third aspect of the invention, when a jump to another time occurs at the time when the midway reproduction is possible, the display of the sub-picture by the first data unit is forcibly terminated. Can be made.

The system stream storage medium of the present invention is
A system stream storage medium in which a system stream configured by multiplexing a sub-picture stream in which a data unit including pixel data is arranged and another data stream are stored in the system stream storage medium according to claim 7. A plurality of sub-picture data units including the same pixel data are arranged before and after the time when the system stream can be reproduced halfway with respect to the system stream.

According to the present invention, even when the time during which the midstream reproduction is possible is set for the system stream within the display period of the sub video by a certain data unit in the sub video stream, the sub video is reproduced during the midway reproduction. Video can be displayed immediately. Further, as described in claim 8, the system stream storage medium of the present invention is a sub-picture stream in which a data unit including pixel data and display control data for controlling display of this pixel data in time series is arranged. In a system stream storage medium that stores a system stream that is configured by multiplexing a data stream and other data streams, each sub-picture data before and after a time point during which the system stream can be played back halfway in the system stream. It is characterized in that each unit includes the same pixel data and display control data for controlling the display of each reproduction time for the pixel data.

According to the system stream creating apparatus of the present invention, in the case where the midway reproduction possible time is set for the system stream within the display period of the sub-picture by the first data unit in the sub-picture stream. Also, the sub-picture can be displayed immediately during the mid-playback.

Further, as described in claim 9, the system stream storage medium according to the present invention is the system stream storage medium according to claim 8 in which the system stream in the system stream is played back halfway. The front data unit of each of the sub video data units before and after the possible time ends the display of the sub video at a time after the display time of the rear data unit of the sub video data unit. It is characterized by including the display end control data which means that.

According to the present invention, when a jump to another time occurs at a time when halfway reproduction is possible, the display of the sub-picture by the front data unit can be forcibly terminated.

[0025]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, modes for carrying out the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing the configuration of a system stream creation / recording apparatus according to an embodiment of the present invention. The sub-picture multiplexed by the system stream creation / recording apparatus of the present embodiment is, for example, a movie subtitle with a fixed character color, and the data required to display the one-screen subtitle is composed of only pixel data. Shall be done.

As shown in the figure, the system stream creation / recording apparatus of the present embodiment determines the chapter boundary time based on the display period information included in the sub-picture data packet and the chapter boundary time information provided from the outside. It has a stream transforming means 1 which additionally arranges a data packet of a sub-picture in the vicinity.

FIG. 2B shows this stream transforming means 1
3 shows an example of the sub-picture source stream 103 input to the. The sub-picture source stream 103 includes a data unit SP1 which is sub-picture pixel data having a display period of T1.

The stream transforming means 1 stores the input sub-picture data unit SP1 in the buffer 2 and outputs it as a stream 107. At this time, the display period information 104 in the data unit SP1 is read by the read control means 3. Further, chapter boundary time information 105 is input to the read control means 3 through the terminal 4.

The read control means 3 determines whether or not the chapter boundary time P indicated by the chapter boundary time information 105 exists within the display period T indicated by the display period information 104 of the sub-picture data unit SP1. Then, the read control means 3 sets the chapter boundary time P within the display period T.
If it is determined that the data unit SP1 stored in the buffer 2 is read, the data unit SP1 stored in the buffer 2 is read again at about the chapter boundary time P. As a result, in addition to the original sub-picture data unit SP1, a sub-picture transformation stream 107 in which a data unit SP2 having the same display content (same pixel data, etc.) is additionally arranged near the chapter boundary time.
Can be obtained. That is, this modified stream 1
2C, the original display period T is divided by the chapter boundary time P and two data units SP1 and SP2 having display periods T1 and T2 are arranged. There is.

The systemization means 5 uses the video stream 1
01, the audio stream 102, and the modified stream 107 of the sub-picture are loaded into the buffers 6, 7, and 8, respectively. The data of each stream is stored in each buffer 6, 7, 8
Are packetized into video packet data 108, audio packet data 109, and sub-picture packet data 110, which are input to the multiplexer 10. Then, in this multiplexer 10, the respective packet data 108, 109 and 110 are multiplexed under the control of the control means 9 and output to the recording device 11 as a system stream 115 having a configuration as shown in FIG. And is recorded on the disc 12 by the recording device 11.

As shown in FIG. 2, in the modified stream of the sub-picture of (C), immediately after the chapter boundary time P,
Since the sub-picture data unit SP2 having the same display content as the original sub-picture data unit SP1 is additionally arranged, the intermediate reproduction from the position of the chapter boundary time P of the system stream in (d) is also performed. , The sub-picture can be displayed until the end time of the original display period.

When the data unit of the sub-picture includes display control data such as display start time and end time, the data unit SP in the modified stream 107 of the sub-picture.
It is necessary to slightly change the contents of the display control data of 1 and SP2. In this case, the display control data can be changed by the read control unit 3 of the stream transformation unit 1 based on the display period information 104 and the chapter boundary time information 105 included in the source stream 103 of the sub-picture. is there.

Next, an embodiment in which the sub-picture is the lyrics of karaoke will be described.

In karaoke, since it is necessary to change the display color of the lyrics data over time, one data unit of the sub-picture is required to include color change information (display control data) together with pixel data. Further, this display control data includes information such as a change color and a color change area for each frame or field.
Therefore, such display control data needs to be divided before and after the chapter boundary time.

FIG. 3 is a diagram showing the structure of a system stream creation / recording apparatus in the case where display control data is present in the sub-picture data unit as described above.

FIG. 4A shows an example of the sub-picture source stream 103 input to the stream transforming means 1. This sub-picture source stream 103 has a display period of T
It includes a data unit SP1 including pixel data of sub-picture and display control data.

The stream transforming means 1 separates the input sub-picture source stream 103 into pixel data 117 and display control data 118 and stores them in respective buffers 13 and 14. After that, the read control means 3 reads the information 119 such as the pixel data amount in the data unit SP1 from the one buffer 13 and the information 120 such as the display period and the display control data amount from the other buffer 14.
Is read. Further, chapter boundary time information 105 is input to the read control means 3 through the terminal 4. The read control unit 3 determines whether the chapter boundary time P indicated by the chapter boundary time information 105 exists within the display period T indicated by the display period information 120 of the sub-picture data unit SP1. Then, when the read control means 3 determines that the chapter boundary time P exists within the display period T, the pixel data stored in the buffer 13 is read again at about the chapter boundary time P and stored in the buffer 14. The display control data 118 is divided and read. The division of the display control data 118 is performed at the chapter boundary time P. As a result, FIG.
4 and the display control data stream 124 as shown in FIG. 4C are obtained, and these streams 123 and 124 are combined using the combining means 15 to obtain the pixel data stream 123 shown in FIG. The modified stream 107 of the sub-picture as shown in (d) is obtained.

Here, the sub-picture data unit SP1 in the modified sub-picture stream 107 has the display control data 1 corresponding to the display period T1 together with the pixel data, and the sub-picture data unit SP2 together with the pixel data in the display period T2. It has corresponding display control data 2.
Therefore, even when the intermediate reproduction is performed from the position of the chapter boundary time P, the sub-picture can be correctly displayed immediately after the reproduction.

Further, the display control data 1 of the data unit SP1 of the sub-picture should be additionally described with data indicating that the display of the data unit SP1 is finished at a time after the time when the data unit SP2 becomes valid. By doing so, when a jump to another pointer occurs at the chapter boundary time P, the display of the data unit SP1 can be ended. During normal reproduction, this dummy display end command is ignored, so there is no problem.

The modified stream 107 of the sub-picture obtained by the stream modifying means 1 as described above is multiplexed with the systemizing means 5 together with the video stream 101 and the audio stream 102, and has a structure as shown in FIG. 4 (e). Is output to the recording device 11 and is recorded on the disk 12 by the recording device 11.

In the above embodiment, the sub-picture data unit is additionally arranged at the chapter boundary time, but the present invention is not limited to the usefulness only at the chapter boundary time. It is obvious that the sub-video data unit may be additionally arranged near any set time that the home user can directly access, such as a pointer for time search.

In the above embodiments, the apparatus for recording the system stream on the disk has been described. However, as shown in FIG. 5, the recording apparatus 11 records the created system stream 115 on the magnetic tape 16. You may

[0044]

As described above, according to the system stream creating apparatus, the system stream creating method, and the system stream storage medium of the present invention, the system stream is generated within the display period of the sub-picture by a certain data unit in the sub-picture stream. On the other hand, even when the time at which the intermediate reproduction is possible is set, the sub-picture can be immediately displayed during the intermediate reproduction.

[Brief description of drawings]

FIG. 1 is a block diagram showing the configuration of a system stream creation / recording apparatus according to an embodiment of the present invention.

FIG. 2 is a diagram showing the configuration of each stream in the process of creating a system stream by the system stream creating / recording apparatus of FIG.

FIG. 3 is a block diagram showing the configuration of a system stream creation / recording apparatus according to another embodiment of the present invention.

FIG. 4 is a diagram showing the configuration of each stream in the process of creating a system stream by the system stream creating and recording apparatus of FIG.

FIG. 5 is a block diagram showing still another embodiment of the present invention.

FIG. 6 is a diagram showing a conventional method of creating a system stream.

FIG. 7 is a block diagram showing the configuration of a system stream decoder.

[Explanation of symbols]

 1 ... Stream transformation means 2, 6, 7, 8, 13, 14 ... Buffer 3 ... Read control means 4 ... Chapter boundary time information input terminal 5 ... Systemization means 9 ... Control means 10 ... Multiplexer 11 ... Recording device 12 ... Disk 13 ... Pixel data buffer 14 ... Display control data buffer 15 ... Coupling means 16 ... Magnetic tape 17 ... System decoder 18 Video input buffer 19 Audio input buffer 20 Sub-picture input buffer 101 Video stream 102 Audio stream 103 Sub-picture stream 104 Data Display period information 105 in the unit ......... Chapter boundary time information 106 ... Control signal 107 ... Ream 108 ... Video packet data 109 ... Audio packet data 110 ... Sub-picture packet data 115 ... System stream 116 ... Recording signal 117 ... Pixel data 118 ... Display control data 119, 120 ... Data unit information 123 ... Pixel data stream 124 ... Display control data stream 126 ... System stream

Claims (9)

[Claims] 1. A system stream creating apparatus for creating a system stream from a sub-picture stream in which a data unit including pixel data is arranged and another data stream, and sets a time at which midway reproduction is possible for the system stream to be created. If a time during which the system stream can be played back is set within the display period of the sub-picture by a data unit in the sub-picture stream, which is arbitrarily set, the data is recorded during the mid-playback. Stream transformation means for additionally arranging a new data unit including pixel data identical to the pixel data of the data unit on the sub-picture stream so as to display the sub-picture of the unit, and obtaining a modified stream of the sub-picture; Sub-picture transformation stream obtained by this stream transformation means And a stream multiplexing unit that multiplexes the other data stream to obtain a system stream. 2. A system stream creation for creating a system stream from a sub-picture stream in which a data unit including pixel data and display control data for controlling display of this pixel data in time series is arranged and another data stream. In the apparatus, setting means for arbitrarily setting a time at which the system stream to be created can be played back midway, and the system stream is set within the display period of the sub-picture by a certain first data unit in the sub-picture stream. On the other hand, when a time during which the intermediate reproduction is possible is set, the display control data of the first data unit is set at the boundary of the time so that the sub-picture of the first data unit can be displayed during the intermediate reproduction. It is updated with one of the divided display control data, and the pixel data of the first data unit Stream modification means for additionally arranging a new second data unit including one pixel data and the other display control data divided at the time point on the sub-picture stream to obtain a sub-picture modification stream; A system stream creating apparatus comprising: a stream multiplexing unit that multiplexes a modified stream of sub-picture obtained by the stream modifying unit and the other data stream to obtain a system stream. 3. The system stream creating apparatus according to claim 2, wherein the stream transforming unit sets the display control data after the update of the first data unit in the sub-picture stream to the second data unit. A system stream creating apparatus, wherein display end control data, which means that the display of the sub-picture of the first data unit is ended at a time after the display time, is added. 4. A method of creating a system stream from a sub-picture stream in which a data unit including pixel data is arranged and another data stream, wherein the sub-picture is displayed within a sub-picture display period by a certain data unit in the sub-picture stream. When a time during which the system stream can be played back is set for the system stream, new data including the same pixel data as the pixel data of the data unit is displayed so that the sub-picture of the data unit can be displayed during the playback. A step of additionally arranging a unit on the sub-picture stream to obtain a modified stream of the sub-picture; and a step of multiplexing the modified stream of the sub-picture and the other data stream to obtain a system stream. How to create a system stream. 5. A method of creating a system stream from a sub-picture stream in which a data unit including pixel data and display control data for controlling display of the pixel data in time series is arranged, and another data stream, If a time during which the system stream can be played back is set within the display period of the sub-picture by a certain first data unit in the sub-picture stream, during the mid-playback, the first data unit of the first data unit The display control data of the first data unit is updated with one of the display control data divided at the time so that the sub-picture can be displayed, and the same pixel as the pixel data of the first data unit is displayed. The new second data unit including the data and the other display control data divided at the time is added to the sub-screen. System stream creation, comprising: a step of additionally arranging on the stream to obtain a modified stream of the sub-picture; and a step of multiplexing the modified stream of the sub-picture and the other data stream to obtain a system stream. Method. 6. The system stream creating method according to claim 5, wherein the display control data after updating the first data unit in the sub-picture stream includes a time after a display time of the second data unit. 2. A method for creating a system stream, characterized in that display end control data which means to end the display of the sub-picture of the first data unit is added. 7. A system stream storage medium in which a system stream configured by multiplexing a sub-picture stream in which a data unit including pixel data is arranged and another data stream is stored, wherein the system in the system stream is included. A system stream storage medium characterized in that a plurality of sub-picture data units including the same pixel data are arranged before and after a time point during which halfway reproduction is possible with respect to the stream. 8. A system stream configured by multiplexing a sub-picture stream in which a data unit including pixel data and display control data for controlling display of the pixel data in time series is arranged, and another data stream. In the system stream storage medium in which the sub-picture data units in the system stream before and after the time point during which the system stream can be reproduced are sandwiched are the same pixel data and the same pixel data respectively. And a display control data for controlling the display of the playback time of the system stream storage medium. 9. The system stream storage medium according to claim 8, wherein in the system stream, a front data unit of sub video data units before and after a time point during which the system stream can be reproduced halfway is sandwiched. Includes a display end control data which means to end the display of the sub-picture at a time after the display time of the rear data unit of the sub-picture data units. .