KR20010023520A - Optical disc for recording high resolution and normal image, optical disc player, optical disc recorder, and playback control information generator - Google Patents

Abstract

An optical disc on which a high resolution video signal is recorded and a system for reproducing the same are aimed at realizing compatibility with a conventional system for reproducing a normal resolution video. The first interleaved block 54 and the second interleaved block 55 are obtained by dividing a high resolution video signal into a main signal and an auxiliary signal by image separation means, and dividing each MPEG-encoded stream into frame groups of 1 GOP or more. Recording on the optical disc 1, the high resolution-capable reproducing apparatus reproduces both the first and second interleaved blocks to obtain a high resolution image. On the other hand, in the high quality non-compliant playback apparatus, only one of the first or second interleaved blocks is reproduced to obtain a normal resolution image.

Description

Optical disc for recording high resolution and normal image, optical disc player, optical disc recorder, and playback control information generator}

2. Description of the Related Art [0002] Conventionally, progressive recording methods called 480P and 720P have been studied as optical discs and playback apparatuses for recording high quality video. As a reproduction control method of an optical disc, a reproduction control method using one MPEC decoder is known.

Moreover, the 1st subject of the conventional system is described. When a conventional high definition image recording type optical disc is reproduced by a standard reproducing apparatus, normal images are not output. High-definition video recording optical discs cannot be played back unless they are high-definition playback devices. Therefore, it was necessary to produce two kinds of the same content. In other words, the conventional high-definition optical disc is not compatible with the normal image. Next, the purpose of the invention is described. It is a first object of the present invention to provide a high quality optical disc and a reproduction system with compatibility.

To clarify the definition of compatibility, it is precisely the compatibility of past monaural and stereo record relationships. In other words, a new stereoscopic optical disc or a high resolution disc of the present invention is output at a normal resolution in a conventional reproducing apparatus such as a DVD, and a high resolution image is output in a new reproducing apparatus using the present invention.

Next, the problem of the reproduction control method will be described as the second problem. The conventional reproduction control method is a method of reproducing one stream using one decoder. Therefore, a complicated system was required to seamlessly connect a sea signal without stopping two stream operations. A second object is to propose reproduction control for seamlessly connecting a plurality of streams in a simple order.

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an optical disc on which a quality image and a general image are recorded, and a recording / reproducing apparatus of the optical disc.

1 is a block diagram of a 720P / 480P hierarchical recording apparatus according to an embodiment of the present invention.

2 is a block diagram of a 480i / 480P / 720P 60 reproducing apparatus of the embodiment of the present invention.

3 is a block diagram of a 480P / 720P (24/60) playback apparatus according to an embodiment of the present invention.

4 is a block diagram of a horizontal synthesizing reproduction apparatus 720P output according to an embodiment of the present invention.

5 is a block diagram of a three-layer type optical disc recording apparatus of an embodiment of the present invention.

6 is a block diagram of a recording and reproducing apparatus of a reproduction control method of frame unit according to an embodiment of the present invention.

7 is a stream recording flowchart of the recording apparatus of the reproduction control information recording method of the embodiment of the present invention.

Fig. 8 is a comparison of the case where an optical disc of an embodiment of the present invention is reproduced by a conventional reproducing apparatus and when the optical disc is reproduced by the reproducing apparatus of the present invention.

9 is a relationship between recording time and capacity of an optical disc of an embodiment of the present invention.

Fig. 10 is a block diagram of a 480P playback mode of the hierarchical playback device of one embodiment of the present invention.

11 is a diagram showing a data structure of reproduction control information according to an embodiment of the present invention.

12 is a diagram showing a recording order of a plurality of streams and a reproduction order of a reproduction device of the recording device of one embodiment of the present invention.

13 is a flowchart for controlling playback of two streams based on playback control information in the playback apparatus of the embodiment of the present invention.

14 is a data structure diagram of the reproduction control information in the case where the time stamps of the streams of one embodiment of the present invention are continuous.

15 is a diagram showing a recording and reproducing stream of the recording and reproducing apparatus of the embodiment of the present invention.

Fig. 16 is a flowchart showing editing and reproduction control information in the recording apparatus of one embodiment of the present invention.

17 is an image identifier data structure diagram including the resolution of management information data of one embodiment of the present invention.

18 is a block diagram showing an MPEG decoder of another method of the playback apparatus of one embodiment of the present invention.

19 is a principle diagram of a multi-angle video division multiple recording method according to an embodiment of the present invention.

20 is a diagram illustrating a method of separating interpolation information in horizontal and vertical directions and recording the interpolated information in an interleaved block according to an embodiment of the present invention.

21 is a principle diagram of the MADM scheme of dividing into two horizontal directions according to one embodiment of the present invention.

Fig. 22 is a diagram showing image combining control of the playback apparatus of the embodiment of the present invention.

23 is a signal constellation diagram for outputting a progressive signal, an NTSC signal, and an HDT signal according to an embodiment of the present invention.

24 is a diagram illustrating a buffer for reproduction of progressive, stereoscopic, and wide signals according to an embodiment of the present invention.

Fig. 25 is a block diagram in the interlaced video signal output mode of the playback apparatus of the embodiment of the present invention.

FIG. 26 illustrates AV synchronization between a first decoder and a second decoder of an embodiment of the present invention. FIG.

This is a flowchart.

27 is a flowchart for controlling two buffer units in one embodiment of the present invention.

FIG. 28 is a timing diagram in which a data stream of one embodiment of the present invention is reproduced and output through a buffer decoding process of a decoder. FIG.

29 is a flowchart showing the detailed procedure of the reproduction processing of the program chain group by the system control unit M-9 according to the embodiment of the present invention.

30 is a block diagram showing a partial configuration of performing AV synchronization with respect to AV synchronization control 12-10 according to one embodiment of the present invention.

31 is a block diagram of a data complex processing unit according to an embodiment of the present invention.

32 is a diagram showing a signal format of an image identifier in one embodiment of the present invention.

Fig. 33 is a flowchart of the STC switching at the time of seamless connection in one embodiment of the present invention.

34 is a diagram showing processing of the horizontal filter circuit of one embodiment of the present invention.

35 is a block diagram of an optical disc reproducing apparatus according to an embodiment of the present invention.

36 is a block diagram of a video decoder according to an embodiment of the present invention.

37 is a diagram showing a data structure on an optical disc according to an embodiment of the present invention.

38 is a timing chart of video reproduction according to an embodiment of the present invention.

39 is a block diagram of an optical disc reproducing apparatus according to an embodiment of the present invention.

40 is a configuration diagram of an audio decoder according to an embodiment of the present invention.

FIG. 41 shows a data structure on an optical disc according to an embodiment of the present invention. FIG.

42 is a timing chart of audio and video reproduction according to an embodiment of the present invention.

43 is a diagram showing an optical disc reproducing apparatus according to an embodiment of the present invention.

44 is a block diagram of a video decoder according to an embodiment of the present invention.

45 is a timing chart of video reproduction according to an embodiment of the present invention.

46 is a block diagram of an optical disc reproducing apparatus according to an embodiment of the present invention.

47 is a configuration diagram of a video decoder according to an embodiment of the present invention.

48 is a diagram illustrating the configuration of a video decoder according to an embodiment of the present invention.

49 is a diagram illustrating the configuration of a video decoder according to an embodiment of the present invention.

50 is a block diagram of an optical disc reproducing apparatus according to an embodiment of the present invention.

51 is a configuration diagram of an audio decoder according to an embodiment of the present invention.

52 is a diagram showing a data structure on an optical disc according to an embodiment of the present invention.

53 is a timing chart of audio and video reproduction according to an embodiment of the present invention.

54 is a timing chart of audio reproduction and an operating frequency according to an embodiment of the present invention.

55 is a timing chart of voice reproduction and an operating frequency according to an embodiment of the present invention.

56 is a diagram showing the flow of a stream in a playback apparatus according to an embodiment of the present invention.

Fig. 57 is a flowchart showing the MPEG encoding and editing / reproduction control information generation and reproduction control procedures in the recording and reproducing apparatus according to the embodiment of the present invention.

58 is a block diagram of a recording and reproducing apparatus of a reproduction control method for each frame according to an embodiment of the present invention.

59 is a diagram illustrating an unnecessary frame deletion procedure according to an embodiment of the present invention.

60 is a block diagram of a mutual authentication type playback device and a TV monitor according to an embodiment of the present invention.

An optical disc reproducing apparatus of the present invention is an optical disc reproducing apparatus for reproducing a signal recorded on an optical disc, wherein the optical disc includes at least a first video stream representing a low frequency component of a video signal and a second video stream representing at least a high frequency component of the video signal; Recorded, wherein the first video stream includes a plurality of first interleaved units, the second video stream includes a plurality of second interleaved units, and each of the plurality of first interleaved units includes m1 (m1). Is an integer of 1 or more), and each of the plurality of second interleaved units includes m2 GOPs (m2 is an integer of 1 or more), and the optical disc reproducing apparatus includes the first image recorded on the optical disc. A plurality of first interleaving units for reproducing the stream and the second video stream, and the reproduced first video stream; Decomposed, and the decomposition unit for decomposing the second video stream, wherein the playback by the plurality of second interleave units to. Generating a first reproduction signal representing the low frequency component of the video signal by decoding the plurality of first interleaved units, and decoding the plurality of second interleaved units to display at least the high frequency component among the video signals. A decoder for generating a second playback signal, a synthesis section for generating the video signal by synthesizing the first playback signal and the second playback signal, the first playback signal, the second playback signal, and the video signal; An output unit for selectively outputting at least one of them is provided, thereby achieving the above object.

Each of the plurality of first interleaved units may correspond to first time information related to a reproduction time, and each of the plurality of second interleaved units may correspond to second time information related to a reproduction time.

The optical disc reproducing apparatus includes a reference time signal generation unit for generating a reference time signal, a first reproducing control unit for controlling a reproduction time of the first reproduction signal according to a difference between the reference time signal and the first time information; A second reproducing control unit controlling a reproducing time of the second reproducing signal according to a difference between the reference time signal and the second time information, and the reference time signal supplied to the first reproducing control unit and the second reproducing control unit; A correction section for correcting the reference time signal may also be provided so that the reference signal supplied to the reproduction control section exhibits substantially the same time.

The correction unit may correct the reference time signal based on audio reproduction time information indicating a time at which an audio signal to be output in synchronization with the video signal should be reproduced.

The reference section is based on at least one of first image reproduction time information indicating a time at which the first reproduction signal is to be reproduced and second image reproduction time information indicating a time at which the second reproduction signal is to be reproduced. The signal may be corrected.

The first playback control section skips the frame of the first playback signal or repeats playback to control the playback time of the first playback signal, and the second playback control section skips the frame of the second playback signal. Alternatively, the playback time of the second playback signal may be controlled by repeated playback.

At least one of the first time information and the second time information may include at least one of PTS, DTS, and SCR.

The first reproduction signal corresponds to the number of first pixels, the second reproduction signal corresponds to a second number of pixels larger than the number of the first pixels, and the combining unit receives the first reproduction signal and the second value. A converter for converting into a converted signal corresponding to the number of pixels is provided, and the video signal may be obtained by combining the converted signal and the second reproduction signal.

An identifier indicating the number of first pixels corresponding to the first reproduction signal is also recorded on the optical disc, and the converter may convert the first reproduction signal into the converted signal in accordance with the identifier.

The optical disc also has an identifier indicating the number of first pixels corresponding to the first reproduction signal, and the optical disc reproducing apparatus further includes a rotation control unit for controlling the rotation of the optical disc, and the rotation control unit is the identifier. The rotation of the optical disc may be controlled in accordance with this.

The optical disc also has an identifier indicating that the video signal is a coded progressive video signal of 24 to 30 frames per second, and the output unit is the first playback signal, the second playback signal and the video. A converter for converting at least one of the signals into a frame signal is provided, and the output unit may output a progressive video signal of 60 frames per second by outputting the frame signal in duplicate.

The optical disc reproducing apparatus further includes a buffer memory portion for storing the plurality of first interleaved units and the plurality of second interleaved units, wherein the capacity of the buffer memory portion is equal to or greater than the data amount of the GOP included in the second interleaved unit. It may be.

The capacity of the buffer memory section may be 1 MB or more.

In the optical disk of the present invention, at least a first video stream representing a low frequency component of a video signal and a second video stream representing at least a high frequency component of the video signal are recorded, and the first video stream includes a plurality of first interleaved units. The second video stream includes a plurality of second interleaving units, each of the plurality of first interleaving units includes m1 GOPs (m1 is an integer of 1 or more), and the plurality of second interleaving units Each of m 2 contains m GOPs (m 2 is an integer of 1 or more), thereby achieving the above object.

The first interleaved unit and the second interleaved unit may be configured such that one reproduction time of the plurality of first interleaved units and a corresponding reproduction time of the plurality of second interleaved units are substantially the same.

An optical disc recording apparatus of the present invention comprises a separating section for separating a video signal into a first video signal representing a low frequency component of the video signal and a second video signal representing at least a high frequency component of the video signal, and the first video signal. An encoder that generates a first video stream by encoding and encodes the second video signal to generate a second video stream, wherein the first video stream includes a plurality of first interleaved units; The video stream includes a plurality of second interleaved units, each of the plurality of first interleaved units includes m1 GOPs (m1 is an integer of 1 or more), and each of the plurality of second interleaved units has m2 (m2 is an integer of 1 or more), and includes an encoding unit. A selection output unit selectively outputting the plurality of first interleaving units included in the first video stream and the plurality of second interleaving units included in the second video stream, and a signal output from the selection output unit; A recording section for recording on an optical disc is provided, whereby the above object is achieved.

And the separating unit decodes the first video stream. A difference calculator for calculating the difference between the video signal and the signal output from the decoder may be provided, and the separation unit may output a signal output from the difference calculator as the second video signal.

The separating unit converts the video signal into a first converted signal corresponding to the number of second pixels smaller than the first pixel number corresponding to the video signal, and a signal output from the decoder from the decoder. And a second converter for converting the second converted signal corresponding to the first number of pixels larger than the second number of pixels corresponding to the output signal, wherein the separation unit converts the first converted signal as the first image signal. The difference calculator may calculate a difference between the video signal and the second converted signal.

The recording unit may further record an identifier on the optical disc indicating that the second video signal is a signal output from the difference calculator.

The recording unit may further record an identifier indicating the number of first pixels corresponding to the video signal on the optical disc.

The recording unit may further record an identifier indicating the number of second pixels corresponding to the first video signal on the optical disc.

An optical disc recording apparatus of the present invention is an input unit for inputting a coded first video stream corresponding to a first pixel number and a coded second video stream corresponding to a second pixel number different from the first pixel number. The first video stream includes a plurality of first interleaved units, the second video stream includes a plurality of second interleaved units, and each of the plurality of first interleaved units has m1 (m1 is an integer of 1 or more). An input unit including a GOP, wherein each of the plurality of second interleaved units includes m2 GOPs (m2 is an integer of 1 or more), the plurality of first interleaved units included in the first video stream, and the A selection output section for selectively outputting the plurality of second interleaved units included in a second video stream, and a recording section for recording a signal output from the selection output section on an optical disc; This accomplishes the above object.

An optical disc reproducing apparatus of the present invention is an optical disc reproducing apparatus for reproducing a signal recorded on an optical disc, wherein the optical disc includes at least a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs. It's recorded. Each of the plurality of first GOPs includes a plurality of pictures, and each of the second GOPs includes a plurality of pictures, and the optical disc reproducing apparatus includes the first video stream and the second image recorded on the optical disc. A reproduction unit for reproducing a stream, and a decoding unit for decoding the first video stream and the second video stream. An output unit for selectively outputting the decoded first video stream and the decoded second video stream according to reproduction control information, wherein the reproduction control information is included in the plurality of first GOPs included in the first video stream; A second picture included in a first second GOP among the plurality of second GOPs included in the second video stream, following the first picture included in the last first GOP among the first GOPs; The reproduction of the second picture different from the first picture is shown, thereby achieving the above object.

The decoding unit may start decoding the second video stream so that the decoding of the second picture is completed when the reproduction of the first picture is completed.

The reproduction control information includes information ts1 indicating the position of the first picture, information ts2 indicating the position of the second picture, and information tsG indicating the position of the first picture of the first second GOP. Wherein the decoding unit obtains a decode start position ta according to a calculation formula of ta = ts1- (ts2-tsG) and starts decoding of the second video stream based on the decode start position ta. .

The reproduction control information includes timing information indicating a timing at which decoding of the first second GOP is started such that the reproduction end time of the first picture and the reproduction start time of the second picture coincide, and the decoding unit includes the timing. Decoding of the second video stream may be started based on the information.

The decoding unit may omit decoding of a picture unnecessary for decoding the picture from the first picture of the first second GOP to the second picture.

The unnecessary picture may be a B picture.

The optical disc reproducing apparatus further includes a buffer memory section for storing the first video stream and the second video stream, and the capacity of the buffer memory section may be equal to or greater than the data amount of 1 GOP.

The reproduction control information is also recorded on the optical disc, and the reproduction unit may reproduce the reproduction control information recorded on the optical disc.

The optical disc is also recorded with an identifier indicating whether or not the reproduction control information is recorded on the optical disc, and the reproduction unit is provided with the optical disc when the identifier indicates that the reproduction control information is recorded on the optical disc. The recorded reproduction control information may be reproduced.

In the fast playback mode, the output unit may prohibit outputting the I picture included in the first second GOP when the second picture is not an I picture.

The output unit may prohibit outputting a part of the i picture included in the first second GOP based on the I picture reproduction prohibition information.

An apparatus for generating reproduction control information according to the present invention includes an input unit for inputting a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs, and the plurality of video streams included in the first video stream. A second picture included in a first second GOP among the plurality of second GOPs included in the second video stream, following the I picture included in the last first GOP among the first GOPs, and the first picture included in the first GOP. A generation section for generating reproduction control information indicating reproduction of a second picture different from the picture at the beginning of the second GOP is provided, thereby achieving the above object.

The reproduction control information may include information indicating the number of pictures from the head picture of the head second GOP to the second picture.

The reproduction control information may include information indicating a time when the first picture of the first second GOP is to be reproduced and a time when the second picture of the first second GOP is to be reproduced.

The reproduction control information may include timing information indicating timing of starting decoding of the first second GOP such that the reproduction end time of the first picture and the reproduction start time of the second picture coincide.

The timing information indicates a timing of starting decoding of the first second GOP when the picture unnecessary for decoding the picture from the first picture of the first second GOP to the second picture is not decoded. You may also

The unnecessary picture may be a B picture.

An optical disc recording apparatus of the present invention includes a generation unit for generating reproduction control information, an reproduction control on an optical disc on which a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs are recorded. A recording unit for recording information, wherein the reproduction control information is included in the second video stream following the first picture included in the last first GOP of the plurality of first GOPs included in the first video stream; A second picture included in a first second GOP among the plurality of second GOPs, which is to reproduce a second picture different from the first picture of the first second GOP, thereby achieving the above object. .

According to the reproduction control information, the optical disc recording apparatus of the present invention deletes unnecessary pictures for reproduction from a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs. An editing unit for editing the stream and the second video stream, and a recording unit for recording the edited first video stream and the edited second video stream on an optical disc, and the reproduction control information is included in the first video stream. A second picture included in a first second GOP among the plurality of second GOPs included in the second video stream, following a first picture included in a last first GOP among the plurality of first GOPs. The second picture different from the first picture of the first second GOP is reproduced, thereby achieving the above object.

The picture unnecessary for the reproduction may include a picture after the first picture in the first video stream and a picture before the second picture in the second video stream.

The picture unnecessary for the reproduction may further include a picture unnecessary for decoding the picture from the first picture of the first second GOP to the second picture in the second video stream.

The unnecessary picture may be a B picture.

The recording unit may record the edited first video stream and the edited second video stream in a continuous area on the optical disc.

The recording unit may record the reproduction control information on the optical disc.

The recording unit may record the reproduction control information on a recording medium other than the optical disc.

Below. Embodiments of the present invention will be described with reference to the drawings.

Example 1

(720P / 480P stair recording playback method)

A detailed hierarchical recording apparatus of two layers of 720P and 480P will be described with reference to FIG. Hereinafter, referring to FIG. 20, a method of dividing an HDTV signal into a plurality of signals and performing hierarchical recording will be described.

In the case of a movie, the input 720P signal is first a raw signal such as a movie production, and the video signal of 24 frames per second is added by the 3-2 pull-down unit 746, an extra frame from 60 frames / sec to 24 frames / sec. The 720P (24P) signal 703 is reduced. Typically, in the case of an image of 60 frames (60P) per second, 3-2 pull-down is bypassed. In addition, 60 frames / sec is approximated by 60P. The 720P video signal 703 of 1280x720 pixels is first dropped from the 720P / 480P down converter 704 by the vertical filter 705 in the number of lines in the vertical direction to 720x2 / 3 = 480, Next, the horizontal filter 706 drops it to 1280x9 / 16 = 720 pixels, and converts it to a 480P video signal 707 of 720x480 pixels. The 480P low resolution video signal is encoded by the 480P MPEG encoder 708, becomes a compressed MPEG signal, and is restored by the MPEG decoder 709 to the 480P video signal 710 again. This signal is magnified 3/2 times and 16/9 times by the vertical filter 712 and the horizontal filter 713 in the 480P / 720P up-converter 711, respectively, and is converted into a 720P high resolution video signal 714. do. The 720P video signal 703 that is the original image and the MPEG encoded / decoded 720P video signal 714 are differentially calculated by the arithmetic circuit 715 in the difference signal processing unit 720 to obtain the difference information 716.

The difference information 716 is encoded by a second MPEG encoder 717 of 720P, and becomes a video signal in a GOP unit composed of an intra frame (i picture) and a difference frame (P or B). In the multiplexing means 719, they are separated into second interleaved blocks 718a and 718b, etc. in GOP units of 1 GOP to nGOP. On the other hand, the MPEG stream of the basic signal encoded by the 480P first MPEG encoder 708 of the basic signal processing unit 721 becomes an MPEG stream of 480P GOP units. In the multiplexing means 719, the first interleave block 722a 722b, which are alternately inserted between the above-described second interleaved blocks 718a and 718b, i.e. interleaved, and the interleaved signals are recorded by the recording means 723 on a disc 724 such as a DVD. do. At this time, the hierarchical recording identifier 725 indicating the existence, start position, and end position of the hierarchical recording, or the specific interleaved block prohibiting reproduction of the second interleaved blocks 718a and 718b including the difference information in the conventional reproducing apparatus. The reproduction prohibition information 726 is also recorded. These identifiers are recorded in the entire management information 224 or in each VOB, as shown in FIG.

When the disc 724 is played back in the existing playback apparatus based on the DVD standard as shown in FIG. The interleaved blocks 722a and 722b are regarded as the first angle and reproduced. The reproduction signal is decoded by the MPEG data 727, and a video signal of NTSC or 480P (24 frames) is reproduced. Since specific interleaved block reproduction prohibition information 726, for example, an angle switch prohibition flag, is recorded as shown in Fig. 23 to prohibit reproduction of the recorded specific interleaved block of difference information, even if a user incorrectly operates the reproduction apparatus, Playback of the second angle, that is, the second interleaved unit, is prevented. That is, 720P difference information is automatically prevented from being reproduced in the existing DVD player. If the 720P difference information is reproduced incorrectly, this signal cannot be reproduced normally in the first MPEG decoder for 480i of the conventional reproducing apparatus, and thus malfunctions. However, this kind of trouble is avoided by the present invention. In this case, the connection information for the second interleaved block may be intentionally separated from the management information 224 called navigation information on the DVD standard disc.

This effect is also useful when the 720P signal itself is recorded in the second interleaved block. In this case, 720P signals are directly input to the MPEG encoder 717, as indicated by the arrows in the * table in FIG.

In this way, when the disc 724 of the present invention is reproduced with a conventional DVD player, an NTSC normal image quality signal equivalent to that of a conventional DVD disc is reproduced, and a conventional DVD such as a difference signal or a 720P signal is reproduced. Information that cannot be normally played back by the playback device is prevented from being incorrectly played back. In this way, bidirectional compatibility is realized.

Instead of the 720P signal, the 480P signal itself may be recorded in the second interleaved block. In this case, the conventional reproducing apparatus reproduces the first interleaved block, and therefore outputs 480i (NTSC), and the reproducing apparatus of the present invention reproduces one or both of 480i from the first interleaved block and 480P from the second interleaved block. Can be.

On the other hand, in the playback apparatus of the present invention, a basic signal is reproduced at the first interleaved blocks 722a and 722b, that is, at the first angle referred to in the DVD standard, and at the second interleaved blocks 718a and 718b and at the second angle in the DVD standard. The difference signal or the 720P signal is reproduced, and the 720P video signal 731 or 720P signal of the difference signal is reproduced by the 480P video signals 729 and 720b by the 480P MPEG decoder 728, respectively. The two video signals having different numbers of pixels are synthesized by the combining unit 732 or output as they are, and the original 720P and the image signal 733 are decoded and output.

As described above, when the hierarchical recording disc 724 of the present invention is reproduced by the reproducing apparatus of the present invention, a 720P video signal is output. In this way, HDTV signals such as 720P can be recorded while being compatible with the conventional playback apparatus.

When 480P itself is recorded in the second interleaved block, a signal of 480P, that is, a double density of NTSC, is reproduced.

Referring to FIG. 3, the operation of the more specific playback device of FIG. 8 will be described. Description of overlapping blocks is omitted.

In the disk 724, the multiplexing means 719 of Fig. 1 divides the basic signal and the differential signal into nGOP units, and then interleaves them, and alternately records them. This signal is separated into a first interleaved block 722a and a second interleaved block 718a by the separating unit 734 of the reproduction device of FIG. That is, separated into a basic signal and a difference signal, and stored in each of the first buffer memory 735 and the second buffer memory 736, each time information is extracted by the time information extraction unit 793, and the VTS. The synchronization unit 780 sets the first reference time information and the second reference time information to the first decoder 728 and the second decoder 730 so that the two signals are synchronized, thereby synchronizing the output signals of the two decoders. Has In this case, when the hierarchical recording identifier 725 is detected, the first reproduction signal, which is the decoded signal of the first stream, by the identification information processing unit 745 is the second reproduction, which is the basic signal of the low pixel and the decoded signal of the second stream. Recognizing that the signal is difference information between the high pixel signal and the basic signal, the synthesizer 732 gives an instruction to the up-converter 738 and an instruction for an addition operation to the combiner 732.

In the 480P MPEG decoder 728 and the MPEG decoder 730, they are decoded into a 480P 24 signal and a 720 (24 frame) signal, respectively. The decoded signal is 24 frames / second or 30 frames / second, but by outputting the same frame twice by 2-3 converters 737a and 737b, respectively, the 480P signal 729 of 60 frames / sec and the 720P signal of the difference are different. 731 is obtained. 480P signal 729 by 480P / 720P up-converter 738. Up-converted to the 720P signal 739 and added by the adder 740 to the 720P signal 731 of the difference information, so that the original 720P image 733 is decoded. As the calculation of the adder 740, for example, as shown in the figure, when each pixel is a and b, the operation of (a + b) / 2 is performed to decode the original 720P image 733. do. The operation of the combining unit 732 may be an operation other than (a + b) / 2.

In this case, the MPEG decoded signal is not converted into 60 frames by the 2-3 converters 737a and 737b, but is processed into 24 frames, and is synthesized by the 2-3 converter 741 into 24 to 60 frames after the synthesis process. I can convert it. In this case, since the data amount of the video signal is reduced by half, the processing capacity of the digital processing circuit can be halved.

1 and 3 have described a method of recording and reproducing a 24 frame signal of a 720P signal such as a movie in a hierarchical form, but this method is advantageous. For HDTV, although there are 1080i and 720P. As shown in Fig. 9, in the case of 1080i (24 frames) of a movie, as shown in the curve 742a, the capacity of the two-layer DVD is 8.5 Gb, so only 90 minutes of recording can be performed.

In contrast, in the case of 720P (24 frames), recording can be performed for 150 minutes as shown by the curve 742b. 480P (60 frames) can also be recorded for 150 minutes as shown by the curve 742c. In the case of a movie, it can be said that it is meaningless if it cannot be recorded for more than 120 minutes in one sheet. The 720P (24) / 480P hierarchical recording disc of the present invention has the effect that the HDTV software of a movie can be stored in one DVD disc.

Although FIG. 3 illustrates an example in which a disc in which 480P, which is basic information of 720P, is recorded in a first interleaved block and difference information between 720P and 480P is recorded in a second interleaved block, a disc in which a 720P signal is recorded as it is in a second interleaved block is illustrated. In the case of reproducing, the output of the second decoder 730 may be output as it is, as indicated by the * arrow in FIG. 3. This determination is performed by the identification information processing unit 743 based on the identifier. Also in this case, the equivalent effect of full compatibility is obtained. This method has a low recording efficiency, but has the effect of greatly simplifying the processing circuit for recording and reproducing, and has the effect of full compatibility.

60, an embodiment in the case where a decoder is mounted on the TV monitor 798 side will be described. Since the basic operation is the same as that of Fig. 3, only the other parts will be described. First, on the reproduction device 743a side, the signal before decoding is encrypted using the encryption key 799a with the encryption encoder 795, and the TV monitor 798 via the network 798 by the communication interface 796a. It is sent to the communication interface part 796b of the side. Prior to this operation, both mutual authentication units 794a and 794b communicate with each other to authenticate each other. This may be called a handshake. When mutual authentication is confirmed and it is judged that it is normal communication, mutual authentication parts 794a and 794b provide encryption keys 799a and 799b to the encryption encoder 795 and the encryption decoder 797, respectively, and a communication interface. Since the communication permission is granted to the units 796a and 796b, the encrypted data key is transmitted and received while the encrypted data key is released, and the first and second streams are the first decoder 728 and the second decoder 730. Are sent). The processing of this signal is by means of an identifier 744 which is conveyed separately. The identification information processing unit 745 determines. If the first stream is 480P and the second stream is a 720P differential signal as described above, a synthesis operation is performed with the up-converter to output the 720P signal to the TV monitor 798a. When receiving the identifier that the second stream is the difference signal of 480P, the two streams are synthesized to output the 480P signal. When the identifier of the stereoscopic signal is received, a stereoscopic signal obtained by temporally synthesizing the first stream with the left eye and the second stream with the right eye is output and displayed on the TV monitor 798a.

In this manner, even when two streams are encrypted, the effect of deciphering the original image by processing such as composition by the identifier 744 on the TV monitor side has the effect of security copyright of encryption authentication. It can be obtained without compromising the protective effect.

Next, a reproduction operation in the case of reproducing the disc 724a in which 480P (60 frames / second) is recorded in the reproduction apparatus of the present invention will be described with reference to FIG. In addition, description of the part which is common in FIG. 3 is abbreviate | omitted.

(Attachment Method Figure 19)

Here, the concept of the sum method will be described with reference to FIG. Since the video signal is divided into high and low bands in the vertical direction or the vertical direction and divided and recorded by each angle of the multi-angle, it is called a multi-angle video multiplexing system (MADM). As shown in FIG. 19, the sum calculating unit 141 and the difference calculating unit 143 divide the basic signal (sum signal) and the auxiliary signal (difference signal), and perform MPEG encoding and alternately write the interleaved blocks in units of 1 GOP. do. in this case. In the video, the amount of information can be reduced by 20% by converting the basic signal and the auxiliary signal 3-2 in synchronization. In addition, the basic signal is typically efficient by using " IBBPBBPBBPBBPBB " in which I frames 246, B frames 248, and P frames 247 are alternately as shown in the main GOP structure 244 during MPEG encoding. Is good. However, in the case of the difference signal, since it is a contour pattern, it is evident from the experiment that the configuration of only the I frame 246 and the P frame 247, such as "IPPPPPPPIPPPPPPP", as shown in the sub GOP structure 245 is good. . By varying the setting of the sub GOP structure, the efficiency is improved.

In FIG. 19, an example in which a 480P video signal is divided into two in the vertical direction is illustrated. In FIG. 21, an example in which the 480P video signal is divided into two in the horizontal direction is illustrated. It is also possible to divide each 30P signal into two interlaced signals of 60 fields by dividing it into 30 frames of the first frame and 30 frames of an even numbered frame, and to encode each signal by MPEG encoding and to record in MADM method. Do. In this case, since it is coded progressively, the coding efficiency is improved as in movies, so that the recording time increases.

In this case, the MADM non-compliant playback apparatus reproduces the crushed 525 interlaced signal of the first channel, i.

In the MADM compatible playback device, 30P signal as the basic signal. As an auxiliary signal, a 30P signal is reproduced. These two 30-frame signals are combined and output by one normal 480P signal of 60 frames by frame synthesizing means including a frame buffer.

If a line double is added to the output of 480P, an image of 1050P is obtained.

When the 525 interlaced signal is input to the sum signal portion of the synthesis section of the MADM and 0 is input to the difference signal, an image of 480P is obtained. In other words. Same effect as line double. In this method, since 525P interlace signals can also be output, 480P can be output, so that all images can be viewed by simply connecting one cable to the progressive input terminal.

In FIG. 19, it is 1/2 (A + B) rather than 2 tapes as a filter expression. 1/2 (A-B) is used. In this case, the separation frequency is about 300.

As shown in Fig. 19, the 480P signals are divided into two signals by a sum and difference operation, and the disc 724a recorded in two block groups, a first interleaved block group and a second interleaved block group, is reproduced. 734 separates the 480i signal, which is the basic signal, and the 480i signal, which is the difference signal, and decodes each of the 480i signal 729a and the differential 480i signal 731a by the MPEG decoder 728 and the MPEG decoder 730, respectively. The arithmetic unit 740 calculates (a + b) / 2, and combines two 480i signals to output a combined signal 733a of 480P (60 frames).

In the disc 724 of the disc 724, three signals in the case of 480i, 480P, and 720P are recorded in a hierarchical manner, and the difference signal of which resolution is recorded. 480i / 480P / 720P identification information 744 (FIG. 17) is recorded in the toc section or the like on the disk 724a. This information is processed by the identification information processing unit 743 to determine which sector address of the disc is the main data (main signal) or sub data (differential signal) of the stair data being recorded, and the information such as the starting point thereof is obtained. It sends to the combining part 732. The combining unit 732 performs a combining operation of the main data and the sub data at the starting point of 480P, and outputs a 480P (60 fPS) signal.

At the starting point of 720P, as shown by Vts = 6 in Fig. 17, it is recorded on the disc that the 720P-notes are the first interleaved blocks and the 720P-notes are the second interleaved blocks. This information is identified by the identification information processing unit 743, and the 720P synthesis operation is performed from the 720P start time stamp using the time stamps of the main signal and the differential signal from the MPEG decoders 728 and 730, for example, (a The calculating part 740 performs + b) / 2, and outputs a 720P signal.

When a 480P identifier is recorded as the identification information 744 (FIG. 17), as shown in FIG. 10, the identification information processing unit 745 sends a 480i decoding command to the MPEG decoder 730 to perform 480i decoding processing. By doing so, the difference signal 731a of 480i is decoded and synthesized by the combining section 732 to obtain an output of 480P (60fPS).

In this way, since the MPEG decoder 730 switches the processing of 480i (480P-30fPS) or 720P in accordance with the identification information, two MPEG decoders in total make the 480P main signal, the difference signal and the 720P main signal, the difference signal. It is effective that both decoding can be combined and the configuration can be simplified.

In addition, although the 480P / 720P up-converter 738 of the combining unit 732 is not used in the 480P reproduction mode shown in FIG. 10, the 480P-720P up-converter 738 decodes the decoded 480P 60 signal. Up-converting to a 720P signal and outputting the same can display the 720P-compatible HD video projector or the like, so that the scanning line becomes more difficult to see. In this case, one 480P-720P up-converter 738 can be used as two of 720P synthesis and 720P up-convert, so that the 720P up-converter output of the 480P signal can be obtained without adding a component. have.

(720P / 480P / 480i type 3-layer recording device)

Referring to Fig. 5, the structure and operation of a 60 frame / second type three-layer recording apparatus of 720P will be described. Since the configuration and operation of FIG. 1 are almost the same, only different parts will be described. First, the input signal is 60 frames / second at 720P. Thus, a 480P down-converted video signal is also a 480P signal (60 frames / sec). This signal is input to the basic signal processing unit 721a, and the separation unit 747 calculates (a + b) / 2 when the pixel data of the nth line is a and the pixel data of the n + 1th line is b. By using the result in the m line of 748a of the 480i video signal and using the result of calculation (ab) / 2 in the mth line of the 480i video signal 748b, the NTSC main signal and the difference signal are obtained. These signals are encoded by the MPEG encoders 708a and 708b, and decoded signals 749a and 749b of 480i are decoded by the MPEG decoders 709a and 709b to decode the 480P signal 710 by the synthesis unit 748. The order in which the 480P signal is up-converted to the 720P signal 714 to obtain difference information, MPEG encoding to obtain the third interleaved block data 718a and 718b is the same except that the claim rate is changed from 24 fPS to 60 fPS. Since it is equal to 1, it is omitted.

On the other hand, the 480i MPEG stream is separated by the multiplexing means 719a into an interleaved block in units of nGOP, followed by a second interleaved block composed of 480i-differential signals after the first interleaved block 722a composed of 480i-basic signals. 750a) and interleaved in order of the third interleave block 718a composed of 720P differential signals, and are recorded on a disc 724 such as a DVD.

In this case, hierarchical broadcasting is possible by modulating the multiplexed signal by the 8VSB, QAM, or OFD modulator 751, and transmitting it by the transmitter 752. In this case, the multiplexing means may time-division into the time domain specified in the broadcast, rather than the GOP unit.

In this way, hierarchical disks or hierarchical broadcasting of three layers of 480i, 480P (60), and 720P are realized.

Referring to Fig. 2, the operation of reproducing this disk 724a will be described. Since the structure similar to FIG. 3 is included, description of the overlapping part is abbreviate | omitted. The signal reproduced by the disc 724a or received by the receiver 753 and demodulated by the demodulator 754 is separated by the separation unit 734 into three streams in units of the above-described interleaved block, and buffered. Decoded by three MPEG decoders 728a, 728b, and 730 through 735a, 735b, and 736, and three signals of 480i basic signal 749a, 480i differential signal 749b, and 720P differential signal 731 are Demodulated Among these, the 480i-base signal 749a and the 480i difference signal 749b are calculated by the combining unit 755 by calculating (a + b) and (ab), so that the 480P (60 fPS) video signal 729 is obtained. Can be obtained. The signal and the 720P difference signal 731 described above are synthesized by the combining unit 732 to obtain a 720P output 733a. However, since the synthesis sequence has been described previously, the description is omitted.

In this way, output of three different resolutions, 480i output 749a, 480P output 729, and 720P output 733a, is obtained from the disk 724a, and the user can select the output according to the grade of the monitor playback apparatus. . In other words, an output of 480i (NTSC) in the existing playback apparatus and an output of 480P (60fPS) in the playback apparatus of the present invention corresponding to 480P and 720P (60fPS) in the playback apparatus of the present invention corresponding to 720P are obtained. To realize.

In FIG. 2, when the identification information processing unit 745 detects the high resolution identifier, the rotation speed of the motor is increased through the system control 21 and the rotation control circuit 35. According to the identifier, high-resolution signals can be reproduced by increasing the speed at 1x speed in normal image reproduction, 2x speed in 480P or 720P (24P), and 3-4x speed in 720P (60P), thereby saving power. . In the case of playing NTSC class, the system control unit 21 stops unnecessary clocks of the 720P MPEG decoder 730, the 480i MPPEG decoder 728b, or the synthesis unit 732, or operates at low speed, thereby reducing power consumption. We can cut drastically. Also, the AV synchronization controller 158 receives the APTS 84 of the audio time stamp of the audio data, creates a video presentation time stamp (VPTS) of each MPEG decoder based on this time information, and registers the decoder 39a of the decoder. , 39b and 39c, the synchronization of the playback frame of each decoder is obtained. In order to achieve vertical blanking synchronization, the decoder synchronization unit 794 resets the horizontal and vertical synchronization of each decoder at the same time, so that the image of each decoder is obtained in dot units. A detailed synchronization method of audio and video will be described later.

In the disk 724a, a first resolution identifier representing a low resolution such as NTSC of the first stream image and a second resolution identifier representing a high resolution such as 720P of the second and third streams are reproduced. In the up-converter 738 of 732, the stream control unit 21 calculates which processing to perform, such as 480P to 720P, 480P to 1080i, 480P to 1080P, 720P to 1080P, and instructs the synthesis unit 732. do. In reality, there are various first resolution identifiers of 704x480 and 720x480. This has the effect that the up-converter operates at an appropriate ratio. Of course, it is also possible to have a simple system configuration in which an identifier indicating an up-converter ratio is recorded and reproduced.

Also, the playback device 743a of FIG. 2 outputs 480i (NTSC) if only the first stream, 480P (60P) output 729 for the first stream + second stream, and first stream + second stream + third stream. Since the output of the three types of resolutions of the 720P (60P) output 733a can be output at the same time or at different times, the monitor of various resolutions can be supported.

In particular, since the 480P output 729 can be converted to the 720P output by employing the up-converter 738 of the combining unit 732, 720P converted output of 480P can be obtained without adding a circuit.

In addition, by adding a receiver 753 and a demodulator 754 in the same block diagram of the hierarchical playback device, a receiver for receiving and demodulating a hierarchical signal such as a TV and outputting video signals having three resolutions can be configured. Can be.

(Wide 480P)

The concept of the MADM method in the case of dividing in the horizontal direction with reference to FIG. 21 is shown. Wide 480P such as 1440 × 480P is suitable for movies. This signal can be converted into an 1440 x 480i interlaced signal by the 3-2 converter 174. In the horizontal filter part 206a, it divides into two horizontal directions. The principle of this filter is shown in Figs. 34A and 34B. As shown in FIG. 34B, 1440 dots are divided into odd dots 263a and 263b and even dots 264a and 264b. When these are called An and Yn, a sum signal at X + Y and a difference signal at X-Y are obtained as arithmetic output, and two 480P or 525i signals of 720x480 and 720x480 shown in Fig. 34B are obtained.

Returning to Fig. 21, the horizontal sum signal obtained in this way is reduced to 720 dots horizontally, but because of the horizontal filter, the repeated distortion is suppressed to the same level as the NTSC signal. Therefore, in the conventional reproducing apparatus, only the sum signal is reproduced, so that the picture quality of the DVD is completely equivalent. Since the difference signal is a line image of only the outline, but is limited by the second video signal output restriction information adding unit 179 of FIG. 60, the problem is prevented because it is not easily seen in a general playback apparatus. The sum signal and the difference signal become MPEG streams in the first encoder 3a and the second encoder 3b, interleaved in units of interleaved blocks of 1 GOP or more, and MADM multiplexed.

In the case of a movie, 3-2 conversion is performed by the 3-2 conversion unit 174, and MADM is recorded as each MPEG signal together with the 3-2 conversion information 174a.

In this case, since the movie is 24 frames per second, a 1440 x 480P progressive video is reproduced from the two interlaced signals in the double speed playback apparatus. In addition, the movie has a scope size of 2.35 to 1, and 1440 × 480P is suitable for aspect ratio, so the effect of wide 480P is high.

Although the hierarchical disk 724b of the wide 480i is described in FIG. 2, the operation of reproducing the disc by the W-480i reproducing apparatus will be described in FIG. When the disc 724b is recorded at 24 frames / second, the W-480P basic signal 757a and the W480P difference signal 757b are decoded by the field frame converters 756a and 756b. Since each pixel has data of (X + Y) / 2 and (XY) / 2 encoded, the combining unit 758 performs calculation of (X + Y) / 2 + (XY) / 2. That is, since odd-numbered pixel data is decoded, and Y, that is, even-numbered pixel data is decoded by an operation of (X + Y) / 2- (XY) / 2, the number of pixels in the horizontal direction is twice 1440 pixels. Becomes In this way, a W480P video 759 of 1440 x 480 pixels is obtained. In the W480P-720P conversion unit 760, this signal is transmitted in horizontal direction data of 1440 pixels to 1280 pixels in the 8/9 times horizontal filter 760a, and 480 to 720 pixels in the 3/2 times vertical filter 760b. By converting to, the 720P digital output is obtained, and the general 720P digital interface can be used.

(Detailed playback operation: Fig. 25)

Next, the reproduction operation in the reproduction device 65 of the present invention will be described in detail with reference to a block diagram of a 2X-speed progressive, super wide image, and 720P reproduction device. The signal reproduced from the optical disc 1 is separated by the separating unit 68 in units of the first interleave block 66 and the second interleave block 67, which are frame signals of 1 GOP unit or more. The frame video signals 70a and 70b of the second 30 frames, which are extended by MPEG in the extension section 69, are converted into the odd field signals 72a and 72b and the even field signals 73a and 73b in the field separators 71a and 71b. 2 channel NTSC interlace signals 74a and 74b are output. The wide screen of FIG. 20 will be described later. When this is developed, in FIG. 25, the 1440 × 960 progressive image 182a is, for example, a subband filter or wave rate in the horizontal vertical direction in the horizontal vertical separation unit 194 of the image separation unit 115. Use a transform to separate. The 525 progressive image 183 is then obtained. This 525 interlace signal 184 is separated and recorded in stream 188a.

On the other hand, the remaining interpolation information 185 is equally divided into four streams 188c, 188d, 188e, and 188f, and recorded in the interleaved block. Since the maximum data rate of each interleaved block is 8 Mbps in the DVD standard, it is possible to record 720P or 1050P HDTV video to record 48 Mbps when the interpolation information is divided into 4 streams, 32 Mbps and 6 angles. . In this case, the conventional reproducing apparatus reproduces the stream 188a and outputs the interlaced video 184. In addition, since the output limitation information is recorded on the optical disc 187 in the streams 188c, 188d, 188e, and 188f, the interpolation information 185 such as difference information of unsightly images is output. ) Does not print correctly. In this way, by separating horizontally and vertically in the manner shown in FIG. 25, there is an effect that an optical disc compatible with HDTV and NTSC can be realized.

In FIG. 25, the interlace signal is converted into an interlace signal by the interlace conversion unit 175 and outputted to obtain a scope screen 178. The 480P progressive signal is similarly outputted as the scope screen 178. In the case of viewing on a 720P monitor 1, the 480P signal is converted into a progressive signal of 720P by the 480P / 720P conversion unit 176, so that 1280 × 720 or 1440 × 720 (the image is 1280 × 480 or The letter box type 720P screen 177 of 1440x480 is output. Since the scope image (2.35: 1) becomes 1128 x 480, an image with a close aspect ratio is obtained. In particular, for movie software, since it is 24 frames / second, the progressive picture is 4Mbps. When the scope image is recorded by the method of the present invention of two screen division, it becomes 8 Mbps and can record about two hours on a two-layer disk of a DVD, so that one progressive picture of 720P or 480P of the scope image is recorded on one sheet. There is an effect that can be recorded. Also. In conventional TVs, of course, they are displayed as interlaced output signals. In this manner, an effect of outputting a scope (2.35: 1) screen of a movie at 480P or 720P is obtained.

(High resolution record identification information)

Returning to Fig. 1, the address information is output from the address circuit, and the hierarchical recording identifier 725 including the progressive / stereoscopic image arrangement information is output from the hierarchical recording identifier output unit 725a, by the recording circuit 723. Are recorded on the optical disc. This progressive / stereoscopic image arrangement information includes an identifier indicating whether a progressive or stereoscopic image exists on an optical disc, or a hierarchical recording identifier 725 indicating only an up-converter at the time of hierarchical encoding, the progressive of Fig. 17. / Stereoscopic image arrangement | positioning table 14 is included. As shown in Fig. 17, each number or cell number in which three-dimensional images or progressive signals of R and L are arranged for each VTS is recorded in the TEXTDT file 83. Since the start address and end address of each cell are recorded in the PGC file of each VTS, the start address and end address are shown as a result. Based on this arrangement information and identification information, the reproduction device accurately outputs the progressive video or the stereoscopic video as a progressive output or an R or L output. If it is wrong, the normal image of other content is outputted in R and L, which is unpleasant because of the unrelated image of the user's right eye and left eye. The progressive / stereoscopic image arrangement information, the progressive / stereoscopic image identifier, and the hierarchical recording identifier have an effect of preventing the output of such an unpleasant image. When the hierarchical recording identifier 725 is reproduced as shown in FIG. 3, the control unit sends an up-converter command 786 to up-convert the 480P signal from the up-converter 738 to a 720P signal to synthesize 720P. When there is no hierarchical record identifier 725, as shown in Fig. 10, the composition operation is performed without using the up-converter 738 to output 480P. Therefore, only one connection is switched by the identifier. By using the unit, image synthesis can be performed stably.

Referring to Fig. 23, the order of reproduction using this image identifier 222 is shown. In the optical disc, the reproduction order control information 225 is first read from the management information 224. Among these, since there is restriction information of the VOB, the existing playback apparatus is only connected to the first VOB 226b in which the main video is recorded in the 0th VOB 226a. Since the interpolation signal such as difference information is not connected to the second VOB 226a in the 0th VOB 226a, an image that is difficult to see such as difference information is not reproduced from the existing playback apparatus as described above. Next, an image identifier is recorded in each VOB of the main signal, and since the first VOB 226b and the second VOB 226c are progressive identifier = 1 and resolution identifier = 00 (525 pieces), there are 525 programs. The sieve signal is played back in the progressive player.

Since the picture identifier 222 of the next VOB 226d is a progressive identifier = 0 and a resolution identifier 219 = 10, it is 1050 interlaced signals, and three VOBs of VOB 226e, VOB 226f, and VOB 226g. It can be seen that is the interpolation information. In this way, NTSC in a conventional player, 1050 interlaces with 720 horizontal pixels in a progressive player, and a 1050c full standard HDTV signal are output in an HD player. In this way, various image signals can be interleaved and reproduced by the image identifier 222. The image identifier 222 may also be recorded in the management information 224.

(2x clock and software decoding)

In addition, although two MPEG decoders are used in the block diagrams of FIG. 3 and FIG. 4, as shown in FIG. 18, the synthesis section 36 sets the first MPEG signal and the second MPEG signal as one MPEG signal. By a circuit configuration that generates a double clock from the double clock generation unit 37, doubles the calculation by the double clock type MPEG decoder 16c, expands it, and outputs the R and L video signals by the separation unit 38. The configuration can be simplified. In this case, compared with the conventional reproducing apparatus, since only 16MB SD-RAM can be added to one memory 39, the cost increases. In the case of software decoding, when the CPU doubles the clock, it can decode at the same time in one CPU. This application is described later in Example 2.

(Synchronous playback)

18, synchronous reproduction of two streams important for decoding high resolution progressive video or stereoscopic video will be described. First, it is necessary to combine the vertical and horizontal synchronization of two streams within one line. For this reason, the vertical and horizontal synchronization control units 85c have synchronism of synchronizing the first MPEG decoder 16a and the second MPEG decoder 16b at the same time. Next, the two decode outputs must be images of the same APTS. This method will be described with reference to the flowchart of FIG. 26 and FIG. 18. In step 241a, the synchronization of both the first decoder and the second decoder is turned OFF. In step 241b, there is vertical and horizontal synchronization as described above. In step 241c, the APTS of the audio is read out and this APTS value is set as an initial value of the STC of the first decoder and the STC of the second decoder. As the processing of the first decoder in step 241e, it is checked in step 241f whether the first VPTS reaches an initial value, and if OK, decoding is started in step 241g. In step 241h, the processing delay time of the first decoder is calculated to adjust the VPTS of the decoded output so that the APTS and the VPTS are synchronized. Since the second decoder performs the same process, the images of the first decoder and the second decoder are synchronized. In this way, two decode outputs of the first MPEG signal and the second MPEG signal are synchronized within one line. Thereafter, the original progressive image is obtained even when the sum operation is performed in synchronization with the video signal synchronization unit 36a in the combining unit 36 in units of dots. As shown in Fig. 5, the audio decoder 16c reads the APTS 84 and automatically sets the same APTS in the registers 39a and 39b of the STC of the two MPEG decoders 16a and 16b. It is also possible to have synchronization of two video streams.

In the case of the present invention, when the buffers of the buffer circuits 23a and 23b under-flow, any of the two video signals are cut off in the middle, and a distorted progressive video is output. Thus, as shown in Fig. 2, the buffer control 23c is set, and the amount of two buffers is controlled. In this operation, as shown in the flowchart of Fig. 27, first, in step 240a, the maximum interleaving value in the NAVI information of each disc is read, and the maximum value 1ILB of one main interleaving block is set. It is typically about 512 sectors, or 1MB. If the limit is 1MB or less, set the value. Next, when the simultaneous reproducing command of the main and sub interleave blocks is turned on in step 240b, if the buffer amount of the first buffer 23a is 1ILB or less in step 240c, playback is performed from the main interleave block, and the first buffer 23a is performed. Command to send data for Returning to steps 240b and 240c, transmission is stopped in step 240d if the first buffer exceeds 1ILB. In this way, since the buffer 23a becomes 1ILB or more, under-flow is prevented.

In the buffer 23b, the maximum value 1ILB-Sub of the sub-interleave block is set in step 240f. Simultaneous reproduction is performed in step 240g. If the second buffer 23b is equal to or less than 1/2 ILB-Sub in step 240h, it is read into the buffer in step 240j, and if it is abnormal, it stops in step 240i.

As shown in Fig. 24 (4), since the second buffer can be 1 / 2ILB, the buffer amount can be halved. By the buffer control in FIG. There is no underflow of the buffer, and the disturbance of the composite image of the reproduction screen is reduced.

(Required capacity of track buffer: Figs. 23, 31)

Finally, a method of synchronizing two video streams of the present invention is described. First, as shown in FIG. 39, the system stream reproduced from the optical head is once accumulated in the track buffer 23, and then sent to the first video decoder 69d and the second video decoder 69c. In the track of the optical disc, two streams A of a progressive signal, that is, a first stream and a second stream of B, are alternately recorded in units of interleaved blocks.

First, the stream A is reproduced at double speed rotation, and data accumulation is started in the first track buffer 23a in the track buffer 23. In this state, as shown in Fig. 24 (1), at t = t1 to t2, data of one interleaved block ILB of the first video signal, which is a period of one interleaving time Tl, is accumulated. The first track buffer data increases to increase to a data amount of 1 ILB at t = t2, and completes accumulation of 1 ILB of data of the first video signal. At t = t2, after completing accumulation of 1ILB or more of 1 GOP or more of the first video signal, this time, the second video signal of stream B is reproduced from the next interleaved block I2 of the optical disc, and FIG. 24 (4) As shown by the solid line of, the data of the second video signal is stored in the second track buffer 23b at t = t2, and is accumulated in the first track buffer 23b until t = t6. At the same time, from t = t2 to t8, as shown in Figs. 24 (7) and 10, the track buffer 23a is made by synchronizing the time of the video presentation time stamp, that is, the VPTS, with the first video signal and the second video signal. The track buffer 23b is input to the first video decoder 69c and the second video decoder 69d. The first video decoder 69c and the second video are larger than the t = t3 of the time delayed by the video delay time twd, which is the decompression processing time of MPEG, as shown in Figs. 24 (8) and (11). It is output as two video data extended by the decoder 69d. From t = t4 to t10, two video data of this stream (A) and stream (B) are synthesized by the progressive converter 170 into a progressive signal, and a progressive signal for one interleaved block is output. do.

However, data for one interleaved block is input to the decoder from t = t2 to t8 in this manner. Therefore, at approximately the same ratio, the data of the first track buffer 23a and the second track buffer 23b is consumed and reduced. Therefore, as shown in Fig. 24 (2), the data amount of the first track buffer decreases from t2 to t7, and decreases to 1/2 of 1ILB at t = t7. At t = t7, the reproduction of the data of the interleaved block I5 is started, so that the increase and decrease are canceled, increase to t = t8 and reach 1ILB at t = t8, but in the same manner as in the case of t = t2 Since the input to the first decoder 69c is started at t = t8, the reduction is continued until t = t11, and finally the buffer memory amount is 1 / 2ILB.

Next, with reference to FIG. 24 (4), the transition of the memory amount of the second track buffer 23a which is the buffer amount of the stream B will be described. At t = t2, the data B1 of the stream B of the interleaved block I2 starts to be input to the second track buffer 23b, but at the same time transmission of the data of B1 to the second video decoder 69d is also started. Therefore, it is canceled by 1/2, and the buffer amount at t = t6 is 1 / 2ILB of 1/2. In the case of multi-angle recording of two angles of the progressive signal of the present invention, since there are four streams, that is, four interleaved blocks, the interleaved blocks I3 and I4 are track jumped over t = t6 to t7, and I5 You need to jump to During this tj jump time 197, the reproduction input of data from the optical disc is interrupted, so the buffer amount of the stream B continues to decrease until t = t8 and approaches zero at t = t8.

As the reproduction data of the data B2 of the interleave block I6 is input at t = t8, the increase starts again, and at t = t11, the memory amount of the second track buffer is 1 / 2ILB. A track jump is performed at t = t11, and the interleaved blocks I7 and I8 are skipped to access the interleaved block 19 of A3.

The above operation is repeated.

Here, the minimum memory capacity required for the track buffer 23 in which the first track buffer 23a and the second track buffer 23b of the present invention are added will be described. The track buffer capacity 198 shown in dashed lines in FIG. 24 (4) represents the data amount obtained by adding the track buffer 23a and the track buffer 23b. In this way, by setting the capacity of the minimum 1ILB in the track buffer in total, playback can be performed without truncation. In the present invention, when the progressive playback of the present invention has a total capacity of one or more interleaved blocks of the track buffers 23a and 23b of the track buffer 23, it is possible to prevent the overflow and underflow of the track buffer. It works.

(System clock control method)

28, the system clock (STC) switching method in the case of two streams will be described later. However, in the case of progressive reproduction, there are two streams A and B. In this case, if two streams, which are two interlaced signals constituting a 1ILB progressive signal, are A1 and B1, the first A1 stream data is first reproduced in a 1/2 ILB period as shown in Fig. 28 (1). All data is accumulated in the buffer. Next, as shown in Fig. 28 (2), the stream B data is reproduced as B1 after the reproduction of A1 is completed and accumulated in the buffer. In this case, in the stream B of Fig. 28 (2) for the above description, since the reproduction data from the optical disc is controlled, the track buffer does not overflow. The SCR from the track buffer of the stream A or stream B shown in FIG. 28 (3), that is, the stream clock is approximately synchronized with the playback start point J of the stream B shown in FIG. 28 (2). The counter is reset. Since the stream B is output at twice the speed, the stream clock is counted by the buffer at a rate of 1 time, that is, 1/2, as shown in Fig. 28 (3). At the point G, the stream clock is reset. It is necessary to synchronize the time VPTS2 outputted by the video signal of the stream B from the video decoder in consideration of the delay time Tvd such as the MPEG decode time. In this case, AV synchronization control is restarted at t = Ti at one point, i.e., when the increase of the VPTS is stopped. In this case, by checking the VPTS2 of the stream B and synchronizing the VPTS1 of the stream A with this VPTS2, synchronization is realized by one simple control. In this case, you may use VPTS1 together.

The audio data of the audio synchronous stream B may be reproduced, and the STC may be switched at the point H using the APTS of the stream B as shown in Fig. 28 (4). The sub video signal of the stream B may also be switched in the same manner as in Fig. 28 (4).

As described above, AV synchronization is achieved by simple control by AV synchronization using the stream B data first.

In this case, the streams A1 and A2 do not overflow because all the video data is stored in the buffer memory. There is a possibility that the stream B1 may overflow. However, in the present invention, by performing the synchronous control in the stream B, as shown in Fig. 28 (6), the STC is switched so that the VPTS2 does not exceed the VPTS2 threshold value, and the signal flow is controlled so that the buffer is over. It does not flow.

In addition, by using the audio of the stream B for audio reproduction, as described above, the buffer of the audio decoder can not only be 1/2, but as shown in Fig. 28 (4), t = Th H. By switching the STC at the point, the voice is reproduced smoothly without exceeding the APTS threshold. The sub video information is similarly reproduced smoothly in synchronization. Therefore, the video, audio and subtitles such as subtitles are synchronized, and the screen and audio are not interrupted, that is, reproduced smoothly. In this case, recording of audio and sub video of the stream A may be omitted.

(AV sync: FIGS. 29, 30, 31, 33)

Here, AV synchronization, which is important at the time of connection at the time of jumping when two or three streams are played simultaneously, will be described. In the case of the present invention, this is important because the streams of the 720P signal and the data amount of 480i are greatly synchronized.

29 is a flowchart showing the detailed procedure of the reproduction processing of the program chain group by the system control unit 21. As shown in FIG. In Fig. 29, in steps 235a, 235b, and 235c, first, the system control unit 21 reads out corresponding program chain information from the program chain information table of the volume information file or the video file. In step 235d, if the program chain has not ended, step 235e is reached.

Next, in step 235e, with reference to the seamless connection indication information of the cell to be transmitted next in the program chain information, it is determined whether or not the connection between the cell and the immediately preceding cell should be seamlessly connected, and seamless connection is required. If there is an error, the process proceeds to the seamless connection process of step 235f, and if no seamless connection is necessary, the process proceeds to the connection process.

In step 235f, the instrument control unit, the signal processing unit, and the like are read to read the DSI packet, and there is a loss in the VOB reproduction end time (VOB_E_PTM) present in the DSI packet of the cell which has been transmitted first, and in the DSI packet of the cell to be transmitted next. The applied VOB reproduction start time (VOB_S_PTM) is read.

Next, in step 235h, the "VOB playback end time (VOB_E_PTM)-VOB playback start time (VOB_S_PTM)" is calculated, and this is the STC offset of the cell and the immediately transmitted cell. It transmits to the STC offset synthesizing unit 164 in the control unit 158.

At the same time, in step 235i, the VOB reproduction end time VO_E_PTM is transmitted to the STC switching timing controller 166 as the switching time T4 of the STC switching switch 162e.

Next, the instrument control unit is instructed to read data until the end position of the cell is reached. Thus, the data of the corresponding cell is transferred to the track buffer 23 in step 235j, and the reading proceeds to the reading of the program chain information in step 235c as the transfer ends.

If it is determined in step 235e that it is not a seamless connection, the transfer to the track buffer 23 is performed to the end of the system stream, and the program chain information of step 235c is read.

Next, two embodiments of the AV synchronization control method of seamless connection control for performing seamless playback in the present invention will be described. These describe the AV synchronization control unit 158 in Figs. 2 and 31 in detail.

The system decoder 161, the audio decoder 160, the video decoders 69c, 69d, and the sub-picture decoder 159 in FIG. 31 all synchronize data with the system time clock given from the AV synchronization control unit in FIG. The process is performed.

In the first method, the AV synchronization controller 158 will be described with reference to FIG.

In Fig. 30, the AV synchronization controller is connected to the STC changeover switches 162a, 162b, 162c, and 162d, the STC 163, the STC offset synthesizing unit 164, the STC setting unit 165, and the STC switching timing control unit 166. It is composed.

The STC switching units 162a, 162b, 162c, 162d, and 162e give the system decoder 161, the audio decoder 160, the main video decoder 69c, the sub video decoder 69d, and the sub-picture decoder 159, respectively. As the reference clock, the output value of the STC 163 and the output value of the STC offset combiner 164 are switched.

The STC 163 is the reference clock of the entire MPEG decoder of FIG. 31 in normal reproduction.

The STC offset synthesizing unit 164 continues to output a value obtained by subtracting the STC offset value given from the system control from the STC 163 value.

The STC setting unit 165 sets the STC initial value given from the system control unit or the STC offset synthesis value given from the STC offset combining unit 164 to the STC 163 with the timing given from the STC switching timing control unit 166.

The STC switch timing control unit 166 is based on the STC switch timing information given from the system control unit and the STC offset synthesizer values given from the STC 163 and the STC offset combiner 164 and the STC switch timing switches 162a to 162e. Control STC setting 165.

The STC offset value is an offset value used to change the STC value when the system stream # 1 and the system stream # 2 having different STC initial values are connected and continuously played back.

Specifically, from "VOB playback end time (VOB_E_PTM)" described in the DSI packet of the system stream # 1 to be played first, "VOB playback start time described in the DSI of the system stream # 2 to be played next. (VOB_S_PTM) "to subtract. The information of these display times is calculated in advance by reading by the system control unit 167 at the time when the data read out from the optical disk is input to the track buffer 23 in FIG.

The calculated offset value is given to the STC offset synthesizing unit 64 until the last pack of the system stream # 1 is input to the system decoder 161.

The data decoding processing unit 165 in FIG. 5 operates as an MPEG decoder except when performing seamless connection control. At this time, the STC offset given from the system control unit 167 is 0 or an arbitrary value, and the STC changeover switches 162a to 162e in FIG. 30 are always selected on the STC 163 side.

Next, the STC changeover switch in the connection portion of the system stream when two system streams in which the STC values of the system stream # 1 and the system stream # 2 are not continuous are inputted to the system decoder 161 ( The switching of 162a to 162e and the operation of the STC 163 will be described using the flowchart of FIG. 33.

Description of the SCR, APTS, VPTS, and VDTS of the input system stream # 1 and the system stream # 2 is omitted.

In the STC 163, it is assumed that the STC initial value corresponding to the system stream # 1 being reproduced is set in advance by the STC setting unit 165, and is counting up sequentially with the reproduction operation. First, the system control unit 21 (FIG. 31) calculates the STC offset value by the method described above, and sets the STC offset value until the last pack of the system stream # 1 is input to the decoder buffer. It is set in the synthesis section 164. The STC offset synthesizing unit 164 continues to output the subtracted value of the STC offset value from the STC 163 value (step 168a).

The STC switching timing control unit 166 obtains the time T1 at which the last pack of the system stream # 1 to be reproduced first is input to the decoder buffer, and sets the STC switching switch 162a at time T1 to synthesize the STC offset. The output side of the unit 164 is switched (step 168b).

Thereafter, the STC value referenced by the system decoder 161 is given the output of the STC offset synthesizing unit 164, and the transmission timing of the system stream # 2 to the system decoder 161 is determined by the system stream # 2. Is determined by the SCR described in the pack header.

Next, the STC switching timing control unit 166 obtains the time T2 at which playback of the last audio frame of the system stream # 1 to be reproduced first ends, and sets the STC switching switch 162b at time T2 to STC. Switching is made to the output side of the offset synthesizing section 164 (step 168c). The method of obtaining time T2 is mentioned later.

Subsequently, the STC value referenced by the audio decoder 160 is given an output of the STC offset synthesizing unit 164, and the timing of the audio output of the system stream # 2 is recorded in the audio packet of the system stream # 2. Determined by the described APTS.

Next, the STC switching timing control unit 166 obtains the time (T3, T3) at which the decoding of the last video frame which is the main signal and sub-signal of the system stream # 1 to be reproduced first ends (T3, T3). ), The STC changeover switches 162c and 162d are switched to the output side of the STC offset combiner 164 (step 168d). The method of obtaining time T3 is mentioned later. Subsequently, the STC values referenced by the video decoders 69c and 69d are given the output of the STC offset synthesizing unit 164, and the timing of the video decoding of the system stream # 2 is determined by the video of the system stream # 2. It is determined by the VPTS described in the packet.

Next, the STC switching timing control unit 166 obtains the time T4 at which the reproduction output of the last video frame of the system stream # 1 to be reproduced first ends, and sets the STC switching switch 162e at time T4. The output side of the STC offset synthesizing unit 164 is switched (step 168e). The method of obtaining time T4 is mentioned later.

Subsequently, the STC value referenced by the video output switching switch 169 and the sub-picture decoder 159 is given the output of the STC offset synthesizing unit 164, and the video and sub-picture outputs of the system stream # 2 are given. The timing is determined by the VPTS and SPTS described in the video packet and the sub picture packet of the system stream # 2.

At the end of the switching of these STC changeover switches 162a to 162e, the STC setting unit 165 sets the value given from the STC offset synthesizing unit 164 to the STC 162 (step 168f). (This is called reloading of STC 163), and all the switches of steps 162a to 162e are switched to the STC 163 side (step 168g).

Thereafter, the STC 163 is given an output to the STC value referenced by the audio decoder 160, the video decoders 69d and 69c, the video output switching switch 169 and the sub-picture decoder 159, and returns to normal operation. Goes.

Here, two means will be described as a method of obtaining the time T1 to T4 which is the switching timing of the STC.

As a specific means, since the time T1 to T4 can be easily calculated at the time of stream creation, the information indicating the time T1 to T4 is described in advance on the disk, and the system control unit 21 reads it and switches the STC. It is a method of conveying to the timing control part 166.

In particular, for T4, the "VOB reproduction end time (VOB_E_PTM)" recorded in the DSI used when obtaining the STC offset can be used as it is.

At this time, the value to be recorded is described based on the STC value used in the system stream # 1 to be reproduced first, and the STC switching timing control unit 166 determines that the count-up value of the STC 163 is the time (T1 to T1). At the moment T4), the STC changeover switches 162a to 162e are switched.

(Example 2)

In the first embodiment, the application example of the multi-stream synchronous reproducing method of the present invention to high resolution video recording and reproducing has been described in detail. In the second embodiment, the synchronous reproducing method is applied to reproduce control for seamlessly connecting two streams. Describe the method. For MPEG record signal. Editing in GOP units is common, and editing in frame units is difficult. By using the MSS method of the present invention, substantial frame editing is possible.

In addition, although it is important to combine the timings of the video signal and the audio signal in the seams, detailed descriptions of the synchronization method will be given in Embodiments 3-9.

First, in the case of switching frame editing, when applied to seamless playback at a location, the edit data processing unit 762 processes the edit data 761 including composite information such as the zoom instruction signal 28P as shown in FIG. By sending to the switching synthesis section 763, switching / synthesizing, and outputting from the switching synthesis signal output section 764, two video signals can be seamlessly synthesized at any point other than between the GOPs of MPEG.

The method of synthesizing and synthesizing two screens at an arbitrary point based on the indication signal will be described later with reference to FIG.

In the simple switching mode in which two images are simply switched from edit point to frame unit, the a stream and the b stream are switched at the edit point tc, and are seamlessly output. In addition, in the synthesis switching mode in which two images are switched while composing two images on one screen, the switching is performed while synthesizing the streams a and b between the start point ts and the end point te. As shown in Figs. 6 and 58, the mode 1 switches from left to right, from center to periphery in mode 2, from top to bottom in mode 3, and in mosaic in mode 4 do. 6 shows a simplified block diagram, and FIG. 58 shows a detailed block diagram.

In this case, the playback means 778, separation unit 734, VTS synchronization unit 780, and MPEG decoders 728 and 730 in Fig. 6 have the same configuration as that of the 480P playback device in Fig. 3, so that they can be shared. Can be. As shown in Fig. 6, when the identification information processing unit 766 detects the reproduction control information 766a, the two video streams are sent to the switching synthesis unit 763 as described above, and the first connection point ts is connected to the first. Seamlessly switch from stream to secondary stream.

As shown in the detailed block diagram of FIG. 58, as described in the first embodiment, when the hierarchical recording identifier 725 in which a high resolution signal such as 720P / 480P is recorded is detected, the synthesis unit 732a. Is performed to output a high resolution video signal of 480P or 720P.

When the stereoscopic recording identifier 766c is detected, the stereoscopic signal processing unit 770 generates and outputs a stereoscopic video signal in which the left eye image and the right eye image are alternately interleaved.

Thus, as shown in FIG. 58, in the MSS method using two MPEG decoders or an MPEG decoder capable of decoding two streams at the same time, three functions of playback control of frame editing, high resolution signal reproduction, and stereoscopic video signal reproduction are provided. Can be combined.

11 shows a specific example of the reproduction control information 765. In the reproduction control information 765, the switching points S, 766, the synthesis mode 767, the first stream switching start address ts, 768, the first stream switching ending address te2, 769, The two stream GOP start addresses tsG 790, the switch start addresses ts2 and 771, and the switch end addresses te2 and 772 are recorded.

Specifically, when the switching point number S = 1, as shown in Fig. 12 (9), there is no image composition identifier 767. That is, since 0, it is only necessary to switch from the first stream to the second stream at the switching start address ts1-1. In the case of S = 2, as shown in Fig. 12 (10), switching is started at ts1, and two images of the first stream and the second stream are combined on one screen until te1, and the second at t = te1. Switch the stream completely.

The flowchart of FIG. 13 describes the reproduction procedure based on the reproduction control information.

As shown in Fig. 12 (1), the GOP 781a of the first stream and the GOP 781b of the second stream may be recorded and combined at separate positions on the optical disc without performing the recording swapping movement of the stream. In this case, recording switching time can be saved. As shown in Fig. 12 (3), since it can be edited and recorded on a DVD-RAM disk or the like, the GOP 781e and the GOP 781f containing the frame of the edit point of the stream are recorded adjacent to each other in GOP units. In this case, it becomes possible to change the edit point later in the GOP. In addition, since the video of the 1st stream after an edit point is needed when image | video compositing two streams like a wipe, the structure of FIG. 12 (3) is necessary.

If S = 0, that is, when two images are not combined, the data after the turning point ts1 of the GOP 781c is unnecessary, so that the duplicated portions are removed by deleting them as in the GOP 781 of Fig. 12 (2). The recording efficiency is improved. However, the GOP 781d at the IN point has an i (intra) frame, i.e., a basic frame, at the head and cannot be deleted, so a duplicate part 783 occurs.

As shown in step 92a of FIG. 59, the actual frame is about 15 frames in one GOP. If the B frame existing in front of the IN point is deleted as in step 792b, as shown in step 792c, the B frame is deleted so that the overlap part 783f becomes the 12 frames of step 792a. In this case, the overlap portion 783g is reduced to three frames, and the overlap portion 783 is about 1/4 in this case, resulting in higher recording efficiency.

When reproducing this portion, in step 792f, the B frame deletion identifier is detected, and assuming that no B frame is recorded, the number of frames is calculated. In step 792g, since MPEG decoding can be performed using only I and P frames, the frames are sequentially decoded, and the frames at IN points of t = tS2 are decoded and output. In this case, since processing for three frames is sufficient, the target IN point can be reproduced in a quarter time as described above. In this example, the overlap is 1/8 second. 59, the worst case is the case where ts2 is in the 14th frame, but in this case, the overlapping portion is 5 frames of I, P, P, P, and B. In FIG. That is, 1/3 x 1/2 = 1/6 second. About 0.18 seconds is the longest overlap. Only this time is necessary for reproduction of the IN point. Even if the cut part is present about five times in one second, it is 0.2 second interval. Therefore, by deleting the B frame, even if the cut section is successively five times in one second, it can be reproduced frame by frame in this system. This means that normal editing can be used without any problem.

A method of generating reproduction control information will be described. If the last GOP of the OUT point is defined as the first GOP and the first GOP of the IN point is defined as the second GOP, the head position of the second GOP and the time of the switching point are simply recorded as the switching position information of the switching position ts2. You can control playback. As another method, the number of frames from the head of the second GOP to the switching point may be recorded.

When the reproduction control information is reproduced by the reproduction device, as shown in step 792f of FIG. 59, of B, B, B, B, P, B, B, B, P, B, B, and B, The frame at the turning point is decoded without processing the frame (picture). That is, only I, P, and P are decoded. As a result, the image at the IN point can be decoded in a quarter of time as described above. In this case, even when five frame switching points are continuous in one second, since the overlap time is 0.18 seconds, it is possible to follow and seamlessly reproduce all the switching points.

In this case, in order to combine synchronization, as a reproduction control information, it is calculated which frame (picture) from the second GOP is the switching point from the head time and the switching point time of the second GOP. If the B frame, which is an unnecessary frame, is deleted, the unnecessary frame deletion identifier is viewed and corrected accordingly. In this case, when the second GOP is played back a frame earlier than the IN point and the OUT point, it is known whether the OUT point of the first GOP and the IN point of the second GOP are synchronized.

As the reproduction control information, it is possible to know when to synchronize when the second GOP is decoded, when unnecessary frames such as B frames are corrected when recording is made at which frame th from the head of the second GOP.

As the reproduction control information, when decoding of the second GOP is started at a specific position of the first GOP, decoding start timing information such that the switching point of the first GOP coincides with the switching point of the second GOP may be recorded.

In this case, the switching point synchronization is obtained without any special calculation on the reproduction device side only by the reproduction control information.

Further, if further proceeding, one overlapping frame 783 is recorded with one frame, many P frames, and B frames. However, these frames are decoded to create a frame one frame before the frame of the last edit point, and an intra frame is created. By this, the recording efficiency can be further increased. In the case of the DVD-RAM, as shown in Figs. 12 (1), (2) and (3), all the reproduction control information 765 and the limited reproduction control information 765a only at the switching points are shown at the head of the recording data. By recording at two places immediately before and the editing point, the entire editing structure can be known in advance as toc. In addition, before each edit point, recording of each individual edit point, for example, S = 1 only limited play control information 765a, of the entire play control information has the effect that the play control during the special play is stabilized.

Here, the procedure of the reproduction control will be described. First, reproduction control information is read out in step 774a. In step 774b, the reproduction switching point number S is set to 0, and in step 774c, S is increased by one. Since it is required to specify the decoding start position of the second stream, in step 774d, if t is the system clock or VPTS of the first stream and ta is the decoding start position information, it is checked whether t = ta. do. When t = ta, that is, as shown in Fig. 12 (5), when the VPTS of the second stream reaches ta, the process proceeds to step 774e, and as shown in Fig. 12 (6). Starts MPEG decode of two streams of GOP. In step 774f, it is checked whether t = ts1. As shown in Figs. 12 (5) and (6), after the time elapses of the value of (ts1-ta) = (ts2-tsG), the turning point ts2 is reached. With the expression above. As shown in Figs. 12 (5) and 6, the data of the first stream ts1 and the data of the second stream ts2 are MPEG decoded at the same time and output from the decoder. 12 (8) and (9) show a state in which the synchronization of these two streams is obtained. The method of obtaining a specific motivation will be described in detail in the third to the ninth embodiments. Further, it can be seen from the reproduction control information that ts1 and ts2 are frame edit points of two images. In step 774G, it is checked whether there is an image synthesizing identifier 767, and if not, the process proceeds to step 774h, and as shown in Fig. 12 (10), the switching synthesizing unit 763 is positioned at t = ts1. (FIG. 6) switches from the first stream to the second stream. Since t = ts1 is actually an OUT point, the frame of the first stream of t = ts1 is not output. Since t = ts2 is an IN point, the frame of the second stream is output. Since the frame information of the first stream is unnecessary at the time t = tS2, recording can be omitted when S = 0, that is, when no image is synthesized. In this case, the recording efficiency is improved by one P frame. In this way, the reproduction control of the switching point of the S = 1th simple switching mode is completed, and it returns to step 774c and advances to the next S = 2 switching point.

In this case, if n = 0 in step 774P, it is converted to n = 1. In other words, when the second stream is decoded by the second MPEG decoder 730, the first MPEG decoder 728 decodes the second stream, that is, the MPEG signal to be switched next. The MPEG decoder is different from the case of S = 1.

As shown in FIG. 56, the first and second MPEG decoders 728 and 730 alternately input the second streams 781a, 781b, 781g, 781h, and 781i, respectively, in the separating unit 734. The decoded videos 788a and 788b are decoded and synthesized into one stream by the switching unit 763. As is clear from the figure, the output of the first MPEG decoder 728 stops after outputting the decoded video 788a. The image becomes a freeze state. This is because the data cannot be decoded normally when it is discontinuous. The MPEG decoding is restarted by resetting the register or the like (790). The same applies to the second MPEG decoder. In order to seamlessly connect using one MPE decoder as in the related art, it was necessary to perform various complicated transfer processes in record, but in the present invention, since complicated processes are not performed at the time of recording, seamless connection can be made. In the case of playing back the missing MPEC data, even if one (first) MPEG decoder stops, the other one (second) MPEG decoder is switched to perform the resume processing of the stopped (first) MPEG decoder. Two MPEG decoders can permanently perform seamless playback output. Frame editing of MPEG, which has required complicated processing in the past, can also realize substantially the same function by playback control by using the present invention. In particular, since there is no process of decoding and re-encoding MPEG data, a large effect is obtained that the image does not deteriorate completely.

In summary, a plurality of streams are separated, alternately decoded by two MPEG decoders, and switched from the decoded output of one first MPEG decoder to the second decoded output of the other one at a switching point, and the original output between them. The first MPEG decoder is reset to decode the next stream and switch from the output of the second MPEG decoder to the output of the first MPEG decoder at the next turning point.

In this way, seamless connections are realized on a frame-by-frame basis.

(Synthesis switching mode)

By the way, returning to step 774G of FIG. 13, the image compositing identifier 767 is other than 0, i.e., two streams are combined into one screen like a wipe shown in the composite signal output section 764 of FIG. Describe the order of the cases. Proceeding to step 774i, as shown in Fig. 12 (11), switching from the first stream to the second stream is synthesized from t = ts1, and in step 774j, t = te1 or t = te2. The transition is made until this is done, and is completed in step 774k. At the same time, since decoding of the first stream is stopped at t = ts1, decoding of useless data is prevented. In this compositing mode, according to the case where the picture compositing identifier 767 is 1, 2, 3, or 4, right / left switching, center / peripheral switching, and up, as shown in the combination screens 782a, 782b, 782c, and 782d of FIG. Switching up / down, mosaic switching.

In addition, although the example which did not change the original time stamp was shown in FIG. 12, the time stamp can be changed when recording using DVD-RAM etc. by making the time of the switching point of a 1st stream and the switching point of a 2nd stream match. As a result, the configuration becomes simpler. When recording as ts1 = ts2, it is sufficient to rewrite. In this case, the first stream may be recorded up to te1. The second stream is replaced with tsG by ts1- (ts2-tsG). In this case, a time stamp earlier than ts1 is attached. Since ta is the same as tsG, in the case of reproduction in FIG. 12 (6), tsG, that is, the head address 770a of the GOP of the second stream is connected from the reproduction control information 765b shown in FIG. 14 and decoded at tsG. You can start it.

In the case of replacing the time stamps, the order of the time stamps of the GOP 761e and the GOP 781f in Fig. 12 (3) changes and overlaps. For this reason, in the case of playback, the playback device will malfunction. In the present invention, as shown in Fig. 14, since the GOP start address 770a of the second stream is recorded in the reproduction control information 765b, the abnormal position of this time stamp can be known in advance, so that it can be sent quickly. There is a secondary effect that does not malfunction even when. Naturally, using this GOP start address 770a, switching of the edit point to the second stream is more certain.

In the case of reproduction in FIG. 12 (6), tsG, that is, the head address 770a of the second stream, is read from the reproduction control information 765b shown in FIG. 14, and decoding starts at tsG.

Alternatively, if there is only the information of the edit point ts1, the head address tsG of the GOP of the edit point is read in advance, and if the data of the GOP 78f of the second stream is MPEG decoded at the time t = tsG, the first stream There is an effect that the information points of and the second stream automatically match at ts1.

As described above, the configuration and operation are greatly simplified by changing and recording the time stamps.

The procedure of this second recording method will be described with reference to FIGS. 15 and 16.

6 and 16, the editing / playback control information generating program will be described. As shown in FIG. 6, the editing information 780 including the IN and OUT points of the edit cut is input manually or as data, and is sequentially converted to the reproduction control information 765 by the reproduction control information generation unit 789. Once accumulated in the memory 779, it is recorded by the recording means 777 from the memory 779 to the disk 724 of the RAM after all the editing work is completed or just before the disk is ejected.

The procedure in this reproduction control information generation unit 789 will be described in detail using the flowchart of FIG.

First, in step 785a, the editing information 780 is sequentially input manually or as data. S denotes the edit point number, G denotes a mode (1 to 4) for combining two screens by a wiper or the like, ts0 the start point of the first stream ts2 OUT start point te1 the synthesis completion point of t OUT point, ts2 The IN point of the two streams, te2 are the IN point synthesis completion points of the second stream, and tL2 is the OUT point of the second stream.

First, set S = 0 in step 785b, increase S by 1 (step 785c), read ts0, ts1 (step 785d), check in step 785e whether G is present, If not, the first (S) stream is recorded on the optical disc 724 from ts0 to ts1 in step 785f without the need for image combining. Read the IN point ts2 of the second (S + 1) stream (step 785g), enter the time stamp conversion processing routine in step 785g, and start time stamp of the first GOP in which the frame of ts2 of the second stream is included. (tsG) and the time stamp tS2 of the last frame of the first GOP are obtained. From tsG to tL2 of all recording data of the second stream, the type stamp is reduced by (ts2-ts1) minutes, and a new type stamp is generated. Using this scene type stamp in step 785i, after replacing only the scene type stamp information from the original address tsG of the second stream to tL2 (tf2) with the scene type stamp, the frame of ts1 which is the connection point of the first stream. Overwrite next frame information of.

At this time, in step 785w, the address (tsG) of the head GOP of the second stream is used, and ta = ts1- (ts2-tsG) is calculated. The second stream preceding decode time ta is obtained and added to the limited reproduction control information 765a and the reproduction control information 765. In step 785j, the limited reproduction control information 765a, which is the reproduction control information for the S number only, is recorded in the second half of the first (S) stream as shown in Fig. 12 (2). In step 785j, if S is complete, the process advances to step 785m, if incomplete, the process returns to step 785c, and the same step is repeated. In step 785m, as shown in Fig. 12 (3), the reproduction control information 765 of all the edit points accumulated in the memory 779, the reproduction control information of the area in which the management information such as the TOC of the optical disc is recorded. It writes to a recording part and complete | finishes.

Here, if the process returns to step 785e significantly and there is a composition identifier G, at step 785n, te1, which is the completion point of the OUT point synthesis of the first stream, is read, and at step 785p, tG = te1- If tG <tGmax is performed in step 785q, the operation proceeds to the next step 785r. If tG is larger than tGmax, the two stream synthesis duration is too long, so that the allowable amount of the buffer of the playback device is increased. In step 785v, the error message &quot; change te1 to a small value &quot; is issued. If te1 is changed in step 785w, the process returns to step 785n to make te1 below the allowable value.

By the way, since the synthesis | combination of a connection point is accommodated in tolerance at this, it returns to step 785r, and records a 1st stream on t an optical disc from tsG to te1. In step 785s, ts2 of the second stream is read out, and in step 785t, the time stamp conversion processing routine is used to convert the time stamp, in the same manner as step 785g described above. In step 785u, the second stream is recorded from the original address tsG to tf2 (tL2) while the time stamp is replaced with the new time stamp while being overwritten on the next frame data of the te1 frame of the first stream. Then, ta is recorded in the memory, and the limited reproduction control information 765a is recorded in step 785j, and it is checked whether S has been completed (step 785k). In step 785m, the entire reproduction control information ( Complete all work by recording 765).

In this way, the first stream is recorded up to the connection point, and a time stamp of a time earlier than the connection point is overwritten so that the time stamp coincides with the connection point of the second stream after the connection point. As a result, an effect of outputting video signals connected in units of frames is obtained.

In this case, two MPEG decoders are required, but as shown in Fig. 6, the recording and reproducing apparatus includes an MPEG encoder 791 for encoding a video input signal into an MPEG signal. Since the MPEG encoder and the MPEG decoder are not used at the same time, and the MPEG encoder has more than twice the processing power of the MPEG decoder, one MPEG processor has one encoder or two decoder functions.

Therefore, when the present invention is applied to a recording / reproducing apparatus with an MPEG encoder, since it originally has the capability of two decoders, the frame editing effect of the present invention is obtained without adding a configuration.

When soft encoding / decoding using the CPU, the CPU time of encoding is surely required to be twice as large as the decoding process, and the soft-encoded CPU can decode two streams. Therefore, as illustrated in Fig. 57, by encoding one stream in software and simultaneously or time-dividing two streams in software, the virtual frame editing of the present invention can be performed without increasing the processing power of the CPU.

The flowchart of FIG. 57 is used to describe the encoding / decoding and recording / reproducing procedures using the CPU. First, in the encoding recording step 792a, m = 1 to the last data are inputted, and in steps 792c and 792d, the mth video signal is inputted, the mth video signal is encoded, and the mth stream is encoded. Is written (step 792e) and recorded on the optical disk (step 792f). If m is not last in step 792g, the process returns to step 792c, and if m is last, recording ends (792h). At this time, in the editing reproduction control information recording step 792i, editing is carried out frame by frame, and the reproduction control information of the present invention and the above-mentioned various identifiers are recorded on the optical disc (FIGS. 6 and 58).

In the next reproduction, the reproduction control program 792j is started to reproduce the cut point S from 1 to the end (steps 774b and 774c). As shown in steps 774m and 774e, at the frame edited point, two streams are MPEG decoded simultaneously or in time division, and in step 774h, one is decoded from one stream decoded at t = ts. To output to a stream. In step 774r this is repeated until s is last.

This CPU has the processing power to encode one stream of MPEG. That means that it can process two to three streams of MPEG decode. Therefore, the effect of MPEG encoding of one stream, frame editing, MPEG decoding of two streams, and seamless reproduction and output at the frame edit point can be obtained in the same CPU. According to the present invention, there is an effect that the CPU power at the time of MPEG decoding remaining can be utilized effectively.

(Example 3)

In the MADM method of the present invention, a plurality of streams can be played simultaneously, and a synchronization method is important.

Although the basic AV synchronization method has been described in recording and reproducing high resolution video such as 480P and 720P described in the first embodiment, and the reproduction control method of virtual frame editing described in the second embodiment, the third to ninth embodiments are more detailed. It describes various motive methods.

First, in the third embodiment of the present invention, the operation of the AV synchronization method of the reproducing apparatus which reads data from an optical disk on which three compressed video signals to be reproduced simultaneously are recorded and simultaneously reproduces and reproduces three videos will be described.

First, FIG. 37 shows a data structure on an optical disc used in the optical disc reproducing apparatus of the third embodiment.

MPEG video compression of three video signals (A), video signal (B), and video signal (C), respectively, obtains a compressed video stream (A), a compressed video stream (B), and a compressed video stream (C). .

Each compressed video stream A to C is packetized as a video packet every 2 KB, respectively. In the packet header of each packet, a stream ID for identifying whether the stored data is one of the compressed video streams A to C, and if the packet contains a head of a video frame, the frame should be played back. VPTS (Video Presentation type stamp) as video reproduction time information indicating time is added. In the third embodiment, NTSC video is used as each video signal, and the video frame period is approximately 33 msec.

On the optical disk, video packets created as described above are grouped for each of the stored data, such as the compressed video signal A-1, the compressed video signal B-1, and the compressed video signal C-1, by an appropriate number of video packets. And multiplexed and recorded.

35 is a block diagram of the optical disk reproducing apparatus of the third embodiment.

In Fig. 35, reference numeral 501 denotes an optical disk described above, 502 an optical pick-up for reading data from the optical disk 501, 503 a binarization, decoding, error correction, and the like for the signal read by the optical pick-up 502. Signal processing means for performing signal processing of a series of optical disks, 504 is a buffer memory for temporarily storing data output from the signal processing means 503, and 505 is a compressed image of the data read out from the pop memory 504, respectively. Separating means for separating into a signal, 506, is a reference time decoding generating means for generating a reference time signal, and is constituted by a counter for counting a clock of 90 KHz (not shown). 510, 520, and 530 are buffer memories for temporarily storing respective compressed video signals separated by the separating means 505, and 511, 521, and 531 are video decoders for extending and reproducing each compressed video signal, 512, 522, 532 is a monitor displaying each video signal.

36 shows the configuration of the video decoders 511, 521, and 531. As shown in FIG.

36, 601 is VPTS detecting means for detecting VPTS stored in the packet header of a video packet, 602 is video decompressing means for MPEG decompression of a compressed video stream, 603 is a comparison of the reference time signal and VPTS, and the comparison result is shown. Video playback timing control means for skipping or repeating video playback in units of frames when the threshold value is exceeded.

The operation of the optical disc reproducing apparatus shown in FIG. 35 will be described below.

The optical pick-up 502 is focused or tracked by servo means (not shown), reads a signal from the optical disk 501, and outputs it to the signal processing means 503. The signal processing means 503 performs a series of optical disk signal processing such as binarization processing, demodulation processing and error correction processing, and stores it in the buffer memory 504 as digital data.

The buffer memory 504 functions not to interrupt the data supply to the rear end even when the data read supply from the optical disk 501 is temporarily interrupted by a waiting for rotation or the like.

The data read out from the buffer memory 504 is separated into a compressed video signal A to a compressed video signal C in the separating means 505 and outputted, respectively. The separating means identifies any one of A to C in the compressed video stream stored in each packet by the stream ID of the packet header of the packetized data, and determines an output destination according to the identification result.

The separated image compressed signals are stored in the buffer memories 510 to 530, respectively.

Each buffer memory 510 to 530 functions to continuously supply data to the video decoders 511 to 531.

The video decoders 511 to 531 read data from the buffer memories 510 to 530, expand the compressed video signal, and output the compressed video signal to the monitors 512 to 532 as video signals.

The operation of each of the video decoders 511 to 531 will be described with reference to FIG. 36.

The compressed video signal read out from the buffer memory is input to the VPTS detecting means 601 and the video decompressing means 602.

The video decompression means 602 performs MPEG decompression processing on the compressed video stream and outputs a video signal.

The VPTS detecting means 601 detects and outputs the VPTS of the packet header.

The video reproduction timing control means 603 inputs a video signal output from the video decompression means 602, a reference time signal, and a VPTS output from the VPTS detection means 601, and compares the reference time signal with the VPTS. When the difference exceeds the threshold, the timing of video reproduction is controlled so that the difference between the VPTS and the reference time signal becomes less than or equal to the threshold.

In the third embodiment, 33 msec is used as the threshold value for video reproduction. In the video reproduction timing control means 603,

(Reference time signal-VPTS)> 33msec: 1 frame skip

(Reference time signal-VPTS) &lt; -33 msec: Repeat one frame.

In the third embodiment, the video decoder 511 and the video decoder 531 expand with respect to the reference time signal due to the precision error of the reference time signal generating means 506 or the crystal oscillators used in the respective video decoders 511 to 531. Since the progress of reproduction is slow and the video decoder 521 advances the progress of the extended reproduction with respect to the reference time signal, the synchronization of the video signals reproduced in each of them is shifted when the reproduction timing is not corrected.

38 is a timing chart of video reproduction in the third embodiment. 38A is a diagram showing a reference time signal with respect to the playback time t. Similarly, 38b is VPTS # A which is a VPTS of the compressed video signal A which the video decoder 511 extends, and 38c is a video decoder 521. ) Shows VPTS # B which is a VPTS of the video compression signal B, and 38d shows VPTS # C which is a VPTS of the video compression signal C, which the video decoder 531 extends.

The video decoder 511 continues the decompression and reproducing operation of the compressed video signal A, and when the reference time signal is T1, the difference between the VPTS # A and the reference time signal exceeds 33 msec. The video reproduction timing control means skips one frame to be originally reproduced, thereby correcting the reproduction timing so that the difference between the VPTS # A and the reference time signal is equal to or less than the threshold value.

Further, since the video decoder 521 continues the decompression and reproducing operation of the compressed video signal B, when the reference time signal is T2, the difference between the VPTS # B and the reference time signal exceeds the threshold value of -33 msec. The video reproduction timing control means of the decoder 521 repeats the reproduction of the frame reproduced at that point in time, thereby correcting the reproduction timing so that the difference between the VPTS # B and the reference time signal is equal to or less than the threshold value.

Similarly, the video decoder 531 continues the decompression and reproducing operation of the compressed video signal C. Since the difference between the VPTS # C and the reference time signal exceeds 33 msec at the time when the reference time signal is T3, the video decoder 531 The video reproduction timing control means of 531 skips one frame to be originally reproduced, thereby correcting the reproduction timing so that the difference between the VPTS # C and the reference time signal is equal to or less than the threshold value.

As described above, in the third embodiment, when the difference between the reference time signal and the VPTS detected by each video decoder exceeds a threshold value, the correction function of the video reproduction timing control means of each video decoder operates, so that the reference time signal and each The difference of the VPTS is maintained so as not to exceed the threshold, and it is possible to synchronize the video reproduced by each video decoder.

(Example 4)

Embodiment 4 of the present invention relates to a reproduction apparatus for correcting a reference time signal using sound reproduction time information indicating a time at which audio is to be reproduced, and synchronizing synchronization of a plurality of video signals by the reference time signal. .

41 shows a data structure on an optical disc used in the optical disc reproducing apparatus of the fourth embodiment. This optical disk includes compressed audio data as compared with the optical disk used in the third embodiment.

The audio signal is compressed into audio frames in units of 32 msec to obtain a compressed audio stream, packetized as audio packets every 2 KB, and recorded on an optical disc. A stream ID indicating that the data stored in the packet header of the audio packet is a compressed audio stream, and APTS as audio reproduction time information indicating the time at which the audio frame should be reproduced, when the packet contains the head of the audio frame. (Audio Presentation type stamp) is added.

Fig. 39 shows a block diagram of the playback apparatus of the fourth embodiment.

The same drawings 501 to 532 are the same as those of the optical disk reproducing apparatus shown in FIG. 35 of the third embodiment.

540 denotes a buffer memory 541 for temporarily storing a compressed speech signal, 541 denotes speech decompression means for decompressing the compressed speech signal, and 542 a speaker for reproducing the decompressed speech signal.

40 shows the configuration of the audio decoder 541, where 701 is APTS detecting means for detecting APTS stored in the packet header of the audio packet, and 702 is speech decompressing means for decompressing the compressed speech stream.

In the optical disc reproducing apparatus shown in FIG. 39, the operation in the case of reproducing the optical disc of FIG. 41 will be described below.

The operation up to input to the separating means 505 is the same as the optical disc reproducing apparatus shown in the third embodiment.

The data read out from the buffer memory 504 is separated into a compressed video signal A, a compressed video signal C, and a compressed audio signal in the separating means 505 and outputted, respectively. The separating means 505 identifies one of the compressed video signals A to C and the compressed audio signal for each packet by the stream ID of the packet header of the packetized data, and determines the output destination according to the identification result.

The separated compressed video signal and the compressed audio signal are temporarily stored in the buffer memories 510 to 540, respectively.

The video decoders 511 to 531 read data from the buffer memories 510 to 530, decompress the compressed video signal, and output the compressed video signal to the monitors 512 to 532 as video signals. The audio decoder 541 reads data from the buffer memory 540, expands the compressed audio signal, and outputs the compressed audio signal to the speaker 542 as the audio signal.

The video decoders 511 to 531 extend the compressed video signal, and the synchronous correction operation when the difference between the reference time signal and the VPTS exceeds the threshold is the same as that in the third embodiment.

The compressed voice signal read out from the buffer memory 540 is input to the audio decoder 541, and the APTS is detected by the APTS detecting means 701 and output. The speech decompression means 702 decompresses the compressed speech stream to output a speech signal.

The APTS signal output from the audio decoder 541 is input to the reference time signal generating means 506, and the reference time signal is corrected by this APTS.

In the fourth embodiment, the advance of the reference time signal is performed by the audio decoder 541 due to the precision error of the crystal oscillator used by the reference time signal generating means 506, the video decoders 511 to 531, and the audio decoder 541. Faster than the progression of the decompression playback, the video decoder 511 decompresses the decompression playback with respect to the reference time signal, and the video decoder 521 advances the decompression playback with respect to the reference time signal, thereby correcting the reproduction timing. If not, the video signals reproduced in each of them are out of sync with the audio.

42 is a timing chart of video reproduction and audio reproduction in the fourth embodiment. FIG. 42A is a diagram showing APTS with respect to the reproduction time t, and the same figure 42B is a diagram showing a reference time signal, and similarly, 42c is required to reproduce a compressed video signal A which the video decoder 511 extends. Time VPTS # A to be performed, and 42d shows time VPTS # B at which the video decoder 512 should reproduce the compressed video signal B.

In addition, although VPTS # C of the compressed video signal C which the video decoder 531 extends is not shown in FIG. 42, the progress is substantially the same as that of FIG.

The reference time signal generating means 506 is corrected using the APTS at the time when the APTS shows ta1 and ta2, and at each time the reference time signal is reset to ta1 and ta2.

Since the video decoder 511 continues the decompression and reproducing operation of the compressed video signal A, the difference between the VPTS # A and the reference time signal exceeds 33 msec, which is a threshold value, when the reference time signal is T4. The video reproduction timing control means skips one frame to be reproduced originally, thereby correcting the reproduction timing so that the difference between the VPTS # A and the reference time signal is equal to or less than the threshold value.

Similarly, since the video decoder 521 continues the decompression and reproducing operation of the compressed video signal B, when the reference time signals are T5 and T6, the difference between the VPTS # B and the reference time signal exceeds the threshold of -33 msec. The video playback timing control means of the video decoder 521 repeats the playback of the frame being reproduced at each time point, thereby correcting the playback timing so that the difference between the VPTS # B and the reference time signal is equal to or less than the threshold value.

As described above, in the fourth embodiment, when the difference between the reference time signal and the VPTS detected by each video decoder exceeds a threshold value, the correction function of the video reproduction timing control means of each video decoder operates so that the reference time signal and each The difference of the VPTS is maintained so as not to exceed the threshold, and it is possible to synchronize the video signals reproduced by each video decoder.

As for the difference between the reference time signal and the APTS, the APTS is not used to correct the reference time signal, but the APTS is used to correct the reference time signal, so that audio reproduction is not caused in audible discomfort. It is now possible to synchronize audio playback with each video playback.

(Example 5)

Embodiment 5 of the present invention relates to a reproduction apparatus for correcting a reference time signal using VPTS detected by one video decoder, and synchronizing the synchronization of a plurality of video signals by this reference time signal.

Fig. 43 shows a block diagram of the playback apparatus of the fifth embodiment.

The same drawings 501 to 532 are the same as those of the optical disc reproducing apparatus shown in the third embodiment, but 551 is a video decoder used in the fifth embodiment.

The video decoder 551 has a function of outputting the detected VPTS, and the configuration of the video decoder 551 is shown in FIG.

Reference numeral 801 denotes VPTS detecting means for detecting a VPTS indicating a reproduction time of a video signal multiplexed into a compressed video signal, and 802 denotes video decompression means for decompressing a compressed video signal.

In the fifth embodiment, the progress of the reference time signal is the progress of the decompression playback of the video decoder 551 due to the precision error of the crystal oscillator used in the reference time signal generating means 506 or the video decoders 521, 531, and 551. Faster, the video decoder 521 performs slower playback of the reference time signal, and the video decoder 531 does not perform synchronous correction because the video decoder 531 has a faster progression of the extended playback. The synchronization of the video signals reproduced in each is shifted.

45 is a timing chart of video output in the fifth embodiment. FIG. 45A shows the VPTS # A detected by the video decoder 551 for the playback time t. Similarly, FIG. 45B shows the reference time signal. Similarly, FIG. 45C shows the video decoder 521. 45D shows a time (VPTS # B) at which the decompressed compressed video signal B should be reproduced, and FIG. 45D shows a time (VPTS # C) at which the video decoder 531 should reproduce the decompressed compressed video signal C. have.

The reference time signal generating means 506 is corrected using VPTS # A at the time that VPTS # A represents tv1 and tv2. At each time the reference time signal is reset to tv1 and tv2.

The video decoder 521 continues the decompression and reproducing operation of the compressed video signal B, and since the difference between the VPTS # B and the reference time signal exceeds 33 msec, which is a threshold value, at the time point T7, the video decoder 521 ), The difference between the VPTS # B and the reference time signal is reduced by skipping one frame to be originally reproduced.

The playback timing is corrected to be below the threshold.

Similarly, the video decoder 531 continues the decompression and reproducing operation of the compressed video signal C, and the difference between the VPTS # C and the reference time signal exceeds the threshold value of -33 msec at the time points of the T8 and T9. The video playback timing control means of the video decoder 531 corrects the playback timing so that the difference between the VPTS # C and the reference time signal is equal to or less than the threshold value by repeating playback of the frame being reproduced at each viewpoint.

As described above, in the fifth embodiment, when the difference between the reference time signal and the VPTS detected by the video decoders 521 and 531 exceeds a threshold value, the correction function of the video reproduction timing control means of each video decoder operates to provide a reference. The difference between the time signal and each VPTS is maintained not to exceed the threshold.

In addition, by correcting the reference time signal using VPTS # A detected by the video decoder 551, the video signal reproduced by the video decoder 551 has a temporal discomfort caused by frame skipping or repeat playback. This did not occur, and it became possible to synchronize the reproduction of each video.

(Example 6)

The sixth embodiment of the present invention comprises a plurality of video decoders for decompressing and reproducing a compressed video signal, and each video decoder is provided with reference time signal generation means, and using APTS indicating time to reproduce audio, A reproduction apparatus that synchronizes by correcting a reference time signal of each video decoder.

In Example 6, an optical disc shown in the data structure of FIG. 41 was used.

46 is a block schematic diagram of the optical disk reproducing apparatus of the sixth embodiment.

501 to 542 have the same configuration as the optical disk reproducing apparatus shown in FIG. 39 of Embodiment 4, and each has no independent reference time signal generating means 506 as compared with the optical disk reproducing apparatus shown in FIG. The points provided in the video decoders 561 to 581 are different.

561 is a video decoder for decompressing and reproducing the compressed video signal A, 571 is a video decoder for decompressing and reproducing the compressed video signal B, and 581 is a video decoder for decompressing and reproducing the compressed video signal C.

47 shows the configuration of the video decoders 561 to 581 used in the sixth embodiment.

901 is a VPTS detecting means for detecting a VPTS indicating a reproduction time of a video signal multiplexed on a compressed video signal, 902 is video decompression means for decompressing a compressed video signal, and 903 is a comparison of a reference time signal and a VPTS. Video reproduction timing control means for skipping or repeating image reproduction in units of frames when the threshold value is exceeded. 904 is reference time signal generation means for generating a reference time signal.

In the sixth embodiment, the APTS detected by the audio decoder 541 is used to correct the reference time signal of the reference time signal generating means 904 included in the video decoders 561 to 581.

By correcting using the same APTS, after correction the reference time signals generated at video decoders 561 to 581 exhibit the same value.

After correction by APTS, similarly to the fourth embodiment, when the difference between the reference time signal of each video decoder and the VPTS exceeds the threshold, the video reproduction timing control means of each video decoder skips or repeats playback in units of frames. The reproduction timing is corrected so that the difference is less than or equal to the threshold.

As described above, in the sixth embodiment, the reference time signal generated inside each video decoder is corrected in the APTS, and the difference between each reference time signal and each VPTS is determined by the video reproduction timing control means of each video decoder. It is possible to synchronize the video signals reproduced by the respective video decoders so as not to exceed.

In addition, as in the fourth embodiment, it is possible to synchronize the reproduction of the audio with the reproduction of each video, without causing an audible defect in the reproduction of the audio.

In the sixth embodiment, the reference time signals of the video decoders 561 to 581 are corrected using the APTS detected by the audio decoder 541. However, one video decoder uses the one shown in FIG. 44 of the fifth embodiment. By correcting the reference time signal of the other video decoder using the VPTS detected by the video decoder, it is possible to synchronize the reproduction of each video in the same manner.

(Example 7)

In the seventh embodiment of the present invention, two compressed video signals are simultaneously reproduced. The two compressed video signals are signals obtained by dividing a stereoscopic video signal into a video signal for the right eye and a video signal for the left eye, respectively.

Although the structure of the entire apparatus is substantially the same as that of the optical disk reproducing apparatus shown in Fig. 46 of the sixth embodiment, the video decoder which extends the compressed video signal at the rear end of the separating means 505 from two video signals to be reproduced simultaneously. It is a structure provided with two. 48 shows the configuration of one video decoder used in the seventh embodiment and FIG. 49 shows the configuration of the other video decoder.

Fig. 48 is one video decoder, 1001 is VPTS detecting means for detecting a VPTS indicating a reproduction time of a video signal multiplexed on a compressed video signal, 1002 is video decompression means for decompressing an input MPEG compressed video signal, and 1004. Is a reference time signal generation means for generating a reference time signal, and 1003 compares the reference time signal with the VPTS, and skips or repeats the video playback in units of frames when the comparison result exceeds the threshold, and simultaneously reproduces the video. Video reproduction timing control means for outputting the horizontal synchronization signal and the vertical synchronization signal.

Fig. 49 is the other video decoder, 1101 is VPTS detecting means for detecting a VPTS indicating a reproduction time of a video signal multiplexed on a compressed video signal, 1102 is video decompressing means for extending an input MPEG compressed video signal; Reference numeral 1104 denotes a reference time signal generating means for generating a reference time signal, and 1103 compares the reference time signal and the VPTS to skip or repeat video reproduction in units of frames when the comparison result exceeds a threshold, and at the same time, the image signal And a video output timing control means for inputting a horizontal synchronizing signal and a vertical synchronizing signal, synchronizing with the horizontal / vertical synchronizing signal, and reproducing the decompressed image.

In addition, each video decoder uses the horizontal synchronizing signal and the vertical synchronizing signal output from the video decoder of FIG. 48 so as to be input to the horizontal synchronizing signal and the vertical synchronizing signal of the video decoder of FIG.

In the optical disk reproducing apparatus of the seventh embodiment configured as described above, similarly to the sixth embodiment, the APTS corrects a reference time signal generated inside each of the video decoders for the right eye and the left eye, and simultaneously reproduces the video reproduction of each video decoder. By the control means, the difference between each reference time signal and each VPTS is maintained so as not to exceed the threshold value, and it is possible to synchronize the video for the right eye and the left eye in units of frames. Moreover, one video decoder generates horizontal and vertical sync signals. By using the other horizontal synchronizing signal and the vertical synchronizing signal, the two images can be reproduced synchronously in pixel units.

In the seventh embodiment, a compressed video signal obtained by compressing a video signal obtained by dividing a three-dimensional image into a right eye and a left eye, respectively, is used as a compressed video signal to be reproduced simultaneously. For example, an original video signal having a first resolution is used. Is separated into at least two or more video signals including a first video signal and a second video signal having a second resolution lower than the first resolution in which the video signal is separated in the vertical direction and / or the horizontal direction. By using a compressed video signal, it is possible to obtain a plurality of video signals obtained by synchronizing in pixel units as in the case of a stereoscopic video, and by combining them, to reproduce a clear original video signal of a first resolution. It becomes possible.

(Example 8)

Embodiment 8 relates to an optical disk reproducing apparatus which decompresses and simultaneously reproduces one compressed video signal and two compressed audio signals.

52 shows a data structure on an optical disk used in the eighth embodiment.

The two audio signals, the audio signal D and the audio signal E, are respectively compressed, and the compressed audio stream D and the compressed audio stream E are compressed to obtain a compressed video stream.

The compressed video streams D, E and compressed video streams are packetized as audio packets and video packets every 2 KB. In the packet header of each packet, a stream ID for identifying whether the stored data is one of a compressed audio stream D, E or a compressed video stream, and the above-described APTS and VPTS are recorded.

50 shows the configuration of the optical disk reproducing apparatus of the eighth embodiment.

The configuration similar to that shown in FIG. 39 of the fourth embodiment is similar to that shown in FIG. 40. The audio decoder 541 uses the one shown in FIG. 36, while the audio decoder 591 uses the one shown in FIG. The one shown in 51 is used.

In addition, like 540, 590 is a buffer memory for temporarily storing compressed audio signals, and 592 is a speaker for reproducing audio signals.

51 shows the configuration of the audio decoder 591.

1201 is APTS detecting means for detecting an APTS indicating a reproduction time of a speech signal multiplexed with a compressed speech signal, 1202 is speech expanding means for expanding an input compressed speech signal, and 1203 compares a reference time signal with APTS Voice playback timing control means for skipping or pausing voice playback in audio frame units when the result exceeds a threshold.

Next, the reproduction operation in the eighth embodiment will be described.

The operation until the signal read out from the optical disk 501 is input to the separating means 505 is the same as in the other embodiments.

The data read out from the buffer memory 504 is separated into a compressed video signal, a compressed audio signal D, and a compressed audio signal E in the separating means 505, and outputted respectively. The separating means 505 identifies whether each packet is a compressed video signal, a compressed audio signal D or E based on the stream ID of the packet header of the packetized data, and determines an output destination according to the identification result.

The separated compressed video signal is temporarily stored in the buffer memory 530, the compressed audio signal D in the buffer memory 540, and the compressed audio signal E in the buffer memory 590.

The video decoder reads data from the buffer memory 530, decompresses the compressed video signal, and outputs it to the monitor 532 as a video signal. The audio decoders 541 and 591 read data from the buffer memories 540 and 590 to decompress the compressed audio signal, and output the compressed audio signal to the speakers 542 and 592 as audio signals.

The reference time signal generated by the reference time signal generating means 506 is corrected by APTS # D detected by the audio decoder 541.

In the audio decoder 591, APTS # E is detected by the APTS detecting means 1201, and the compressed speech signal E is decompressed by the speech decompressing means 1202. In the speech reproduction timing control means 1203, the expanded speech signal output from the speech decompression means 1202, the reference time signal, and APTS # E output from the APTS detection means 1201 are inputted, and the reference time signal and APTS # are input. By comparing E, the timing of audio reproduction is controlled so that the difference between APTS # E and the storage time signal becomes less than or equal to the threshold when the difference between them exceeds the threshold.

In the eighth embodiment, 32 msec is used as the threshold value of the audio reproduction. In the audio reproduction timing control means 1203,

(Reference time signal-APTS # E)> 32 msec: skip audio frame,

(Reference time signal-APTS # E) <-32 msec: Audio frame repeat is performed.

The video decoder 531 decompresses the compressed video signal, and the synchronization correction operation when the difference between the reference time signal and the VPTS exceeds the threshold is the same as that in the third embodiment.

In the eighth embodiment, the audio decoders 541 and 591 are operated with respect to the reference time signal due to the precision error of the crystal oscillator used in the reference time signal generating means 506, the video decoder 531, and the audio decoders 541 and 591. Since the progress of the decompression is slow and the video decoder 531 advances the decompression with respect to the reference time signal, when the reproduction timing is not corrected, the synchronization between the video signals to be reproduced is shifted.

53 is a timing chart of video reproduction and audio reproduction in the eighth embodiment. 53A is a diagram showing APTS # D with respect to the reproduction time t, and FIG. 53B is a diagram showing a reference time signal, and similarly, FIG. 53C is a compressed speech signal E which the audio decoder 591 stretches. Fig. 53D shows a time (VPTS) at which the video decoder 531 needs to reproduce the video signal that the video decoder 531 extends. The reference time signal generating means 506 is corrected using APTS # D at the time that APTS # D represents ta3 and ta4, and at each time the reference time signal is reset to ta3 and ta4.

The audio decoder 591 continues the decompression operation of the compressed speech signal E, and since the difference between the APTS # E and the reference time signal exceeds 32 msec, which is the threshold of speech reproduction, at the time point of the T10, the audio decoder The audio reproduction timing control means 1203 at 591 corrects the reproduction timing so that the difference between the APTS # E and the reference time signal is equal to or less than the threshold value by skipping the audio frame to be originally reproduced.

In addition, since the difference between the VPTS and the reference time signal exceeds -33 msec, which is the threshold value for video reproduction, at the time points T11 and T12, the video reproduction timing control means of the video decoder 531 reproduces at each time point. By repeating reproduction of the frame, the reproduction timing is corrected so that the difference between the VPTS and the reference time signal becomes less than or equal to the threshold value.

As described above, in the eighth embodiment, when the difference between the reference time signal and the APTS # E detected by the audio decoder 591 exceeds the threshold of speech reproduction, the correction function of the speech reproduction timing control means operates, and the reference time is achieved. The difference between the signal and APTS # E is maintained not to exceed the threshold of speech reproduction. Similarly, the difference between the reference time signal and the VPTS is maintained so as not to exceed the threshold of video reproduction. Moreover, since the reference time signal is corrected using APTS # D, it is possible to synchronize the reproduction of each voice with the reproduction of the video.

(Example 9)

The ninth embodiment used changing the time clock for performing the decompression playback operation as the audio reproduction timing control.

In the ninth embodiment, the apparatus configuration and the overall operation are the same as those in the eighth embodiment, but the operation of the audio reproduction timing control performed when the difference between the reference time signal and the APTS # E exceeds the threshold of audio reproduction is different. 54 and 55, the audio reproduction timing control used in the ninth embodiment will be described.

Fig. 54 shows the operation when the difference between the APTS # E and the reference time signal exceeds 32 msec, which is the threshold value for speech reproduction. Fig. 54A shows a reference time signal with respect to the reproduction time t. 54B shows APTS # E, and FIG. 54C shows the clock frequency at which the audio decoder 591 performs the stretch reproduction operation. The normal decompression and reproducing operation is performed by a clock f0 384 times the sampling frequency fs of the audio signal. Since the difference between the APTS # E and the reference time signal exceeds 32 msec, which is the threshold value of speech reproduction, at the time T11, the speech reproduction timing control means changes the clock of the decompression reproduction operation to f1. f1 is a clock of 10% higher frequency than the frequency of f0. When the decompression regeneration operation is performed at f1, the decompression regeneration operation proceeds at a 10% speed as compared with the case where the decompression regeneration operation is performed at f0. Further, the time for performing the decompression playback operation at f1 is a section of 320 msec from the time when the difference between APTS # E and the reference time signal exceeds 32 msec, which is the threshold value for speech reproduction. By this operation, the reproduction timing is corrected so that the difference between the APTS # E and the reference time signal is equal to or less than the threshold value of speech reproduction.

FIG. 55 shows an operation when the difference between the APTS # E and the reference time signal exceeds -32 msec, which is a threshold value for speech reproduction. FIG. 55A is a diagram showing a reference time signal with respect to the reproduction time t. 55B shows APTS # E, and FIG. 55C shows the clock frequency at which the audio decoder 591 performs the stretch reproduction operation.

Since the difference between the APTS # E and the reference time signal exceeds -32 msec, which is the threshold value of speech reproduction at the time T12, the speech reproduction timing control means changes the clock of the decompression reproduction operation to f2. f2 is a clock at a frequency 10% lower than the frequency of f0. When the decompression regeneration operation is performed at f2, the decompression regeneration operation proceeds at a 10% slower speed as compared with the case of performing the decompression regeneration operation at f0. In addition, the time for performing the decompression regeneration operation at f2 was set to a section of 320 msec when the difference between APTS # E and the reference time signal exceeds -32 msec, which is the threshold value of audio reproduction. By this operation, the reproduction timing is corrected so that the difference between the APTS # E and the reference time signal is equal to or less than the threshold value of speech reproduction.

As described above, in the ninth embodiment, when the difference between the APTS # E and the reference time signal exceeds the threshold value of the audio reproduction, the clock for performing the extension reproduction operation is changed, and the extension reproduction operation is performed at a higher or lower speed than usual. In this way, the difference between the reference time signal and APTS # E is controlled to be equal to or less than the threshold value of the audio reproduction, and it is possible to synchronize the reproduction of each audio and the reproduction of the video without generating an aural sense of discomfort.

In the ninth embodiment, the clock of the decompression and reproducing operation is changed by 10% as compared with the normal one, but it is clear that the timing can be controlled more naturally than the auditory image by changing the change width smaller or in steps.

In the eighth and ninth embodiments, the reference time signal is corrected using APTS # D, but the reference time signal may be corrected using the VPTS output from the video decoder using the video decoder shown in FIG. .

In the above, the Example of this invention was described.

In addition, comparison between the reference time signal and the VPTS or APTS, control of the playback time, and further correction of the reference time signal using the VPTS or APTS, for example, may be realized by a microcomputer controlling the entire playback device. .

In addition, although each embodiment has been described as an example of an optical disk reproducing apparatus, the virtual frame editing method of the present invention can be applied to a reproducing apparatus called a set top box which is supplied with compressed signals by a network or digital broadcasting and extends and reproduces them. This makes it possible to seamlessly connect discontinuous images at the time of program switching, and the effect is high.

By dividing the basic video signal and the interpolated video signal into frame groups of 1 GOP or more, and alternately recording them on the optical disk as interleaved blocks, the high resolution synthesis-adaptive playback apparatus reproduces information of both interleaved blocks. Progressive video can be obtained. In a progressive non-compliant playback device, when a disc having a high resolution video is played back, a complete two-dimensional normal video can be obtained by track jumping and playing back only one of the interleaved blocks of odd or even fields. In this way, there is an effect that mutual compatibility is realized.

In particular, a batch information file of a high resolution image is provided, and a high resolution image identifier is recorded on the optical disc. Therefore, since it is possible to easily determine where the high resolution image exists, there is an effect that it is possible to prevent the failure of outputting images of two different contents by progressively two normal interlaced signals or by mistake.

In addition, by using the two-stream synchronous reproducing synchronous method of the present invention, in the conventional case where there is no deterioration of an image, editing of an MPEG signal that can only be edited in GOP units can be virtually edited in units of frames. By recording the reproduction control information, this can be connected and output in units of frames at the time of reproduction. In this way, virtual frame editing can be realized without deterioration of the image.

In the two-stream simultaneous reproduction synchronization method, reproduction can be performed in synchronization with each other when the plurality of compressed video signals or the compressed audio signals to be reproduced at the same time are extended.

Further, in the playback apparatus which corrects the reference time signal using the APTS detected by the audio decoder, and controls the video output timing so that the VPTS coincides with the reference time signal, audio and plural images are output without causing audible defects. Synchronous playback is enabled.

Furthermore, in the reproducing apparatus which controls the timing of the audio output by changing the decompression operation clock, it is possible to perform synchronous reproducing without generating noise due to skipping or pause of the voice and making the auditory sense of discomfort feel.

Claims (47)

An optical disc reproducing apparatus for reproducing a signal recorded on an optical disc, In the optical disc, at least a first video stream representing a low frequency component of a video signal and a second video stream representing at least a high frequency component of the video signal are recorded, and the first video stream includes a plurality of first interleaved units. And the second video stream includes a plurality of second interleaved units, each of the plurality of first interleaved units includes m1 GOPs (m1 is an integer of 1 or more), and the plurality of second interleaved units Each of contains m2 (m2 is an integer of 1 or more), The optical disk reproducing apparatus, A reproduction unit for reproducing the first video stream and the second video stream recorded on the optical disc; A decomposition unit for decomposing the reproduced first video stream into the plurality of first interleaved units, and decomposing the reproduced second video stream into the plurality of second interleaved units. By decoding the plurality of first interleaved units, generating a first reproduction signal representing the low frequency component of the video signal, and decoding the plurality of second interleaved units, at least the high frequency of the video signals. A decoder for generating a second playback signal representing the component; A synthesizer which generates the video signal by synthesizing the first reproduced signal and the second reproduced signal; And an output unit for selectively outputting at least one of the first reproduction signal, the second reproduction signal, and the video signal. The method of claim 1, Each of the plurality of first interleaved units corresponds to first time information associated with a reproduction time, and each of the plurality of second interleaved units corresponds to light corresponding to second time information associated with a reproduction time. Disc playback device. The method of claim 2, The optical disk reproducing apparatus, A reference time signal generator for generating a reference time signal; A first reproducing control unit for controlling a reproducing time of the first reproducing signal according to a difference between the reference time signal and the first time information; A second playback control section for controlling a playback time of the second playback signal in accordance with the difference between the reference time signal and the second time information. And a correction unit for correcting the reference time signal such that the reference time signal supplied to the first reproduction control unit and the reference signal supplied to the second reproduction control unit have substantially the same time. . The method of claim 3, wherein And the correcting unit corrects the reference time signal based on sound reproduction time information indicating a time at which an audio signal to be output in synchronization with the video signal is to be reproduced. The method of claim 3, wherein The criterion is based on at least one of first image reproduction time information indicating a time at which the first reproduction signal is to be reproduced and second image reproduction time information indicating a time at which the second reproduction signal is to be reproduced. An optical disc reproducing apparatus that corrects a time signal. The method of claim 3, wherein The first playback control section controls the playback time of the first playback signal by skipping or repeatedly playing back the frame of the first playback signal, And the second playback control section controls the playback time of the second playback signal by skipping or repeatedly playing back the frames of the second playback signal. The method of claim 1, At least one of the first time information and the second time information includes at least one of PTS, DTS, and SCR. The method of claim 1, The first reproduction signal corresponds to the first pixel number, and the second reproduction signal corresponds to the second pixel number larger than the first pixel number. The synthesis section includes a converter that converts the first reproduction signal into a conversion signal corresponding to the number of second pixels, And the video signal is obtained by combining the converted signal and the second playback signal. The method of claim 8, An identifier indicating the number of first pixels corresponding to the first reproduction signal is further recorded on the optical disc, and the converter converts the first reproduction signal into the converted signal in accordance with the identifier. Device. The method of claim 8, In the optical disc, an identifier indicating the number of first pixels corresponding to the first reproduction signal is further recorded. The optical disc reproducing apparatus further includes a rotation control section for controlling the rotation of the optical disc, wherein the rotation control section controls the rotation of the optical disc in accordance with the identifier. The method of claim 1, In the optical disk, an identifier indicating that the video signal is encoded from 30 frames of progressive video signals per 24 frames per second is further recorded. The output unit, A converter for converting at least one of the first reproduction signal, the second reproduction signal, and the video signal into a frame signal, And the output unit outputs a progressive video signal of 60 frames per second by outputting the frame signal in duplicate. The method of claim 11, The optical disk reproducing apparatus, A buffer memory unit for storing the plurality of first interleaved units and the plurality of second interleaved units; The capacity of the buffer memory unit is equal to or greater than the data amount of the GOP included in the second interleaved unit. The method of claim 12, The capacity of the buffer memory unit is 1 MB or more. A first video stream representing a low frequency component of a video signal and a second video stream representing at least a high frequency component of the video signal are recorded at least, wherein the first video stream includes a plurality of first interleaved units, and the second video stream includes: The video stream includes a plurality of second interleaved units, each of the plurality of first interleaved units includes m1 GOPs (m1 is an integer of 1 or more), and each of the plurality of second interleaved units has m2 (m2 is an integer of 1 or more). The method of claim 14, The first interleaved unit and the second interleaved unit are configured such that one reproduction time of the plurality of first interleaved units and a corresponding reproduction time of the plurality of second interleaved units are substantially the same. disk. A separation unit for separating the video signal into a first video signal representing a low frequency component of the video signal and a second video signal representing at least a high frequency component of the video signal; An encoder that generates a first video stream by encoding the first video signal and generates a second video stream by encoding the second video signal, wherein the first video stream includes a plurality of first video streams. One interleaved unit, wherein the second video stream includes a plurality of second interleaved units, each of the plurality of first interleaved units includes m1 GOPs (m1 is an integer of 1 or more), and the plurality of Each of the second interleaved units of the encoder comprises m2 (m2 is an integer of 1 or more), A selective output unit for selectively outputting the plurality of first interleaved units included in the first video stream and the plurality of second interleaved units included in the second video stream; And a recording section for recording a signal output from the selective output section to an optical disk. The method of claim 16, The separation unit, A decoder for decoding the first video stream. And a difference calculator for calculating the difference between the video signal and the signal output from the decoder, And the separation unit outputs a signal output from the difference calculator as the second video signal. The method of claim 17, The separation unit, A first converter for converting the video signal into a first converted signal corresponding to the number of second pixels less than the number of first pixels corresponding to the video signal; And a second converter for converting the signal output from the decoder into a second converted signal corresponding to the first pixel number larger than the second pixel number corresponding to the signal output from the decoder, The separation unit outputs the first converted signal as the first video signal, And the difference calculator calculates a difference between the video signal and the second converted signal. The method of claim 17, And the recording unit further records on the optical disk an identifier indicating that the second video signal is a signal output from the difference calculator. The method of claim 17, And the recording unit further records an identifier indicating the number of first pixels corresponding to the video signal on the optical disk. The method of claim 17, And the recording unit further records, on the optical disk, an identifier indicating the number of second pixels corresponding to the first video signal. An input unit for inputting a first encoded video stream corresponding to the first pixel number and a second encoded video stream corresponding to the second pixel number different from the first pixel, wherein the first video stream comprises a plurality of first video streams. One interleaved unit, wherein the second video stream includes a plurality of second interleaved units, each of the plurality of first interleaved units includes m1 GOPs (m1 is an integer of 1 or more), and the plurality of Each of the second interleaving units of m2 (m2 is an integer equal to or greater than 1) comprising an input, A selective output unit for selectively outputting the plurality of first interleaved units included in the first video stream and the plurality of second interleaved units included in the second video stream; And a recording section for recording a signal output from the selective output section to an optical disk. An optical disc reproducing apparatus for reproducing a signal recorded on an optical disc, In the optical disc, at least a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs are recorded, and each of the plurality of first GOPs includes a plurality of pictures. Each of the second GOPs includes a plurality of pictures. The optical disk reproducing apparatus, A reproduction unit for reproducing the first video stream and the second video stream recorded on the optical disc; A decoder which decodes the first video stream and the second video stream; An output unit for selectively outputting the decoded first video stream and the decoded second video stream in accordance with reproduction control information, The reproduction control information includes the plurality of second GOPs included in the second video stream, following the first picture included in the last first GOP among the plurality of first GOPs included in the first video stream. A second picture included in a first second GOP among the pictures, wherein the second picture is reproduced with a second picture different from the first picture of the first second GOP. The method of claim 23, And the decoding unit starts the signal of the second video stream as if the signal of the second picture was completed when the reproduction of the first picture was completed. The method of claim 24, The reproduction control information includes information ts1 indicating the position of the first picture, information ts2 indicating the position of the second picture, and information indicating the position of the head picture of the first second GOP. ), The decoding unit obtains the decoding start position ta according to a calculation formula such as ta = ts1- (ts2-tsG), and reproduces the optical disc starting decoding of the second video stream based on the decoding start position ta. Device. The method of claim 24, The reproduction control information includes timing information indicating timing of starting decoding of the first second GOP such that a reproduction end time of the first picture and a reproduction start time of the second picture coincide; And the decoding unit starts decoding of the second video stream based on the timing information. The method of claim 23, And the decoding unit omits decoding of a picture unnecessary for decoding a picture from the first picture to the second picture of the first second GOP. The method of claim 27, The unnecessary picture is a B picture. The method of claim 23, The optical disk reproducing apparatus, And a buffer memory unit for storing the first video stream and the second video stream. An optical disk reproducing apparatus, wherein the capacity of the buffer memory section is equal to or larger than the data amount of 1 GOP. The method of claim 23, The reproduction control information is further recorded on the optical disc, And the reproduction unit reproduces the reproduction control information recorded on the optical disc. The method of claim 23, In the optical disc, an identifier indicating whether or not the reproduction control information is recorded in the optical disc is further recorded. And the reproduction unit reproduces the reproduction control information recorded on the optical disc, when the identifier indicates that the reproduction control information is recorded on the optical disc. The method of claim 23, In the high speed reproduction mode, the output unit prohibits outputting one picture included in the first second GOP when the second picture is not one picture. The method of claim 32, And the output unit prohibits outputting a part of one picture included in the first second GOP based on one picture reproduction prohibition information. An input unit configured to input a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs. The second GOP of the first of the plurality of second GOPs included in the second video stream subsequent to the first picture included in the last first GOP of the plurality of first GOPs included in the first video stream. A reproduction control information generation device comprising: a second picture included in the generation unit, the generation unit configured to generate reproduction control information indicating reproduction of a second picture different from the first picture of the first second GOP. The method of claim 34, wherein And the reproduction control information includes information indicating the number of pictures from the first picture of the first second GOP to the second picture. The method of claim 34, wherein The reproduction control information generation apparatus includes information indicating a time at which the first picture of the first second GOP is to be reproduced and a time at which the second picture of the first second GOP is to be reproduced. . The method of claim 34, wherein The reproduction control information generation includes timing information indicating timing of starting decoding of the first second GOP such that the reproduction end time of the first picture and the reproduction start time of the second picture coincide. Device. The method of claim 37, The timing information indicates a timing for starting decoding of the first second GOP when the picture unnecessary for decoding the picture from the first picture to the second picture of the first second GOP is not decoded. A reproduction control information generating device. The method of claim 38, And the unnecessary picture is a B picture. A generating unit for generating reproduction control information. A recording unit for recording the reproduction control information on an optical disc on which a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs are recorded; The reproduction control information includes the plurality of second GOPs included in the second video stream subsequent to the first picture included in the last first GOP among the plurality of first GOPs included in the first video stream. A second picture included in the first second GOP among the pictures, wherein the second picture is reproduced with a second picture different from the first picture of the first second GOP. According to the playback control information, the first video stream and the second video stream are deleted to delete pictures unnecessary for playback from a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs. With an editing unit to edit, A recording unit for recording the edited first video stream and the edited second video stream on an optical disc; The reproduction control information includes the plurality of second GOPs included in the second video stream subsequent to the first picture included in the last first GOP among the plurality of first GOPs included in the first video stream. A second picture included in the first second GOP among the pictures, wherein the second picture is reproduced with a second picture different from the first picture of the first second GOP. 42. The method of claim 41 wherein The picture unnecessary for the reproduction includes a picture after the first picture in the first video stream and a picture before the second picture in the second video stream. The method of claim 42, Pictures unnecessary for the reproduction are And a picture unnecessary for decoding a picture from the first picture of the first second GOP to the second picture of the second video stream. The method of claim 43, The unnecessary picture is a B picture. 42. The method of claim 41 wherein And the recording unit records the edited first video stream and the edited second video stream in a continuous area on the optical disc. 42. The method of claim 41 wherein And the recording unit records the reproduction control information on the optical disc. 42. The method of claim 41 wherein And the recording unit records the reproduction control information on a recording medium other than the optical disc.