JPH11150706A - Optical disk for recording high-resolution and general video, optical disk reproducer, optical disk recorder and reproduction control information generator - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a high picture quality optical disk with interchangeability by respectively dividing a basic video signal and an interpolating video signal into frame groups, alternately interleaving them and recording them on an optical disk as an interleave block. SOLUTION: After a basic signal and a differential signal are divided in the unit of each nGOP, are interleaved and alternately recorded in a disk 724 by a multiplexing means 719. This signal is operated into a first interleave block 722a and a second interleave block 718a by a separation part of a reproducing device and respectively decoded to a 480P signal and a 720P signal by MPEG decoders of 480P and 720P. The 480P signal is up-converted to the 720P signal by a 480P/720P up-converter and added with the 720P signal of differential information by an adding part to decode an original 720P video. In addition, a reproducing device of a progressive noncorresponding type reproduces only one of the interleave block to obtain perfectly a two-dimensional normal video.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an optical disk on which an image and a general image are recorded, and a recording and reproducing apparatus for the optical disk.

[0002]

2. Description of the Related Art Hitherto, as an optical disk and a reproducing apparatus on which high-quality images are recorded, progressive recording systems called 480P and 720P have been studied. Also,
As an optical disk reproduction control method, a reproduction control method using one MPEG decoder has been known.

[0003]

First, the first of the conventional systems
State the issues. When a conventional high-quality video recording type optical disc is reproduced by a standard reproducing apparatus, a normal image is not output. A high-quality video recording optical disc cannot be reproduced unless it is a reproduction apparatus compatible with high quality. Therefore, 2 of the same content
I needed to make a kind. That is, the conventional high-quality optical disc was not compatible with the normal video. Next, the object of the invention will be described. A first object of the present invention is to provide a compatible high-quality optical disk and a reproducing system.

[0004] To clarify the definition of compatibility, it is exactly the compatibility of the relationship between past monaural records and stereo records. That is, the new stereoscopic optical disk and high-resolution disk of the present invention are output at a normal resolution in an existing DVD or other reproducing apparatus, and high-resolution video is output in a new reproducing apparatus using the present invention.

Next, a second problem of the reproduction control method will be described. The conventional reproduction control method is a method of reproducing one stream using one decoder. Therefore, in order to seamlessly connect the resolution signals without stopping the movement of the two streams, a complicated system was required. A second object is to propose playback control for seamlessly connecting a plurality of streams by a simple procedure.

[0006]

An optical disk reproducing apparatus according to the present invention is an optical disk reproducing apparatus for reproducing a signal recorded on an optical disk, wherein the optical disk has a first video stream representing a low frequency component of a video signal. And at least a second video stream representing at least a high frequency component of the video signal, wherein the first video stream includes a plurality of first interleaving units,
The video stream includes a plurality of second interleaving units, each of the plurality of first interleaving units includes m1 (m1 is an integer of 1 or more) GOPs, and each of the plurality of second interleaving units includes m2 ( m
2 is an integer greater than or equal to 1), the optical disc playback device includes: a playback unit that plays back the first video stream and the second video stream recorded on the optical disc; Decomposing the stream into the plurality of first interleaved units,
A decomposing unit that decomposes the video stream into the plurality of second interleave units; and a first reproduction signal that represents the low-frequency component of the video signal by decoding the plurality of first interleave units. By decoding the second interleave unit, a decoding unit that generates a second playback signal representing at least the high-frequency component of the video signal, and combining the first playback signal and the second playback signal A synthesizing unit that generates the video signal, and an output unit that selectively outputs at least one of the first reproduction signal, the second reproduction signal, and the video signal. Objective is achieved.

[0007] Each of the plurality of first interleaving units is associated with first time information relating to a reproduction time, and each of the plurality of second interleaving units is associated with second time information relating to a reproduction time. May be associated with.

The optical disk reproducing apparatus controls a reproduction time of the first reproduction signal according to a difference between the reference time signal and the first time information. A first reproduction control unit, a second reproduction control unit for controlling a reproduction time of the second reproduction signal according to a difference between the reference time signal and the second time information, and a first reproduction control unit. A correction unit that corrects the reference time signal so that the reference time signal to be supplied and the reference signal supplied to the second reproduction control unit represent substantially the same time. .

[0009] The correction unit may correct the reference time signal based on audio reproduction time information indicating a time at which an audio signal to be output in synchronization with the video signal is to be reproduced.

[0010] The correction unit may include at least one of first video reproduction time information indicating a time at which the first reproduction signal should be reproduced and second video reproduction time information indicating a time at which the second reproduction signal should be reproduced. The reference time signal may be corrected based on one of them.

The first reproduction control unit controls the reproduction time of the first reproduction signal by skipping or repeating the frame of the first reproduction signal, and the second reproduction control unit The reproduction time of the second reproduction signal may be controlled by skipping or repeating the frame of the second reproduction signal.

[0012] At least one of the first time information and the second time information is PTS, DTS and SCR.
May be included.

The first reproduced signal corresponds to a first number of pixels, and the second reproduced signal corresponds to a second number of pixels larger than the first number of pixels.
Corresponding to the number of pixels, the combining unit includes a converter that converts the first reproduction signal into a conversion signal corresponding to the second number of pixels, and the video signal includes the conversion signal and the conversion signal. It may be obtained by combining the second reproduction signal.

An identifier indicating a first pixel number corresponding to the first reproduction signal is further recorded on the optical disc, and the converter converts the first reproduction signal into the conversion signal in accordance with the identifier. It may be converted.

An identifier indicating a first pixel number corresponding to the first reproduced signal is further recorded on the optical disk, and the optical disk reproducing device further includes a rotation control unit for controlling rotation of the optical disk. The rotation control unit may control rotation of the optical disk according to the identifier.

[0016] The optical disc further records an identifier indicating that the video signal is obtained by encoding a progressive video signal of 24 to 30 frames per second. Playback signal,
A converter for converting at least one of the second reproduction signal and the video signal into a frame signal, wherein the output section outputs the frame signal in an overlapping manner to provide a progressive signal of 60 frames per second. A video signal may be output.

The optical disk reproducing apparatus further includes a buffer memory unit for storing the plurality of first interleave units and the plurality of second interleave units, and the capacity of the buffer memory unit is equal to the second interleave unit. May be equal to or larger than the data amount of the GOP included in the.

[0018] The capacity of the buffer memory unit may be 1 MB or more. In the optical disc of the present invention, at least a first video stream representing a low frequency component of a video signal and a second video stream representing at least a high frequency component of the video signal are recorded, and the first video stream includes a plurality of first video streams. One interleaving unit, wherein the second video stream includes a plurality of second interleaving units, each of the plurality of first interleaving units includes m1 (m1 is an integer of 1 or more) GOPs, Each of the two interleaving units is m2 (m
(2 is an integer of 1 or more), thereby achieving the above object.

The first interleaving unit and the first interleaving unit are arranged such that a reproduction time of one of the plurality of first interleaving units and a corresponding one of the plurality of second interleaving units are substantially equal. Second
An interleave unit may be configured. An optical disc recording apparatus according to the present invention includes a separating unit that separates a video signal into a first video signal representing a low frequency component of the video signal and a second video signal representing at least a high frequency component of the video signal. By encoding one video signal,
An encoding unit that generates a first video stream and encodes the second video signal to generate a second video stream, wherein the first video stream includes a plurality of first interleaving units; The second video stream includes a plurality of second interleaving units, and each of the plurality of first interleaving units is m1 (m1 is 1).
A plurality of second interleaving units, each of which includes m2 (m2 is an integer of 1 or more) GOPs, and the plurality of second interleaving units include: A selection output unit for selectively outputting a first interleave unit and the plurality of second interleave units included in the second video stream;
A recording unit for recording a signal output from the selection output unit on an optical disc, thereby achieving the above object.

The separation unit includes a decoder for decoding the first video stream, and a difference calculator for calculating a difference between the video signal and a signal output from the decoder. May output a signal output from the difference calculator as the second video signal.

The separation unit converts the video signal into a first conversion signal corresponding to a second pixel number smaller than the first pixel number corresponding to the video signal, and an output from the decoder. A second converter that converts the signal to be converted into a second converted signal corresponding to a first pixel number greater than a second pixel number corresponding to the signal output from the decoder, May output the first converted signal as the first video signal, and the difference calculator may calculate a difference between the video signal and the second converted signal.

[0022] The recording unit may further record an identifier indicating that the second video signal is a signal output from the difference calculator on the optical disc.

[0023] The recording unit may further record an identifier indicating a first pixel number corresponding to the video signal on the optical disc.

[0024] The recording section may further record an identifier indicating a second pixel number corresponding to the first video signal on the optical disc. The optical disc recording apparatus of the present invention is configured to convert an encoded first video stream corresponding to a first pixel number and an encoded second video stream corresponding to a second pixel number different from the first pixel number. An input unit for inputting,
The first video stream includes a plurality of first interleaving units, the second video stream includes a plurality of second interleaving units, and each of the plurality of first interleaving units is m1 (m1 is an integer of 1 or more). And an input unit including m2 (m2 is an integer of 1 or more) GOPs, and the plurality of first interleave units included in the first video stream. A selection output unit for selectively outputting the plurality of second interleaving units included in the second video stream, and a recording unit for recording a signal output from the selection output unit on an optical disc, This achieves the above object.

An optical disk reproducing apparatus according to the present invention is an optical disk reproducing apparatus for reproducing a signal recorded on an optical disk, wherein the optical disk includes a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs. At least two video streams, each of the plurality of first GOPs includes a plurality of pictures, and the second
Each of the GOPs includes a plurality of pictures, and the optical disc playback device controls the first optical disc recorded on the optical disc.
A reproducing unit that reproduces a video stream and the second video stream; a decoding unit that decodes the first video stream and the second video stream;
An output unit for selectively outputting the decoded first video stream and the decoded second video stream, wherein the playback control information includes the plurality of first GOPs included in the first video stream. Following the first picture included in the last first GOP, the first second GOP among the plurality of second GOPs included in the second video stream
A second picture included in the OP, wherein the second picture
This indicates that a second picture different from the first picture of the GOP is reproduced, thereby achieving the above object.

[0026] The decoding section may start decoding the second video stream such that decoding of the second picture is completed at the time when reproduction of the first picture is completed.

The reproduction control information includes information ts1 indicating a position of the first picture, information ts2 indicating a position of the second picture, and information tsG indicating a position of a head picture of the head second GOP. , The decoding unit performs
= Ts1- (ts2-tsG), the decoding start position ta is obtained, and the decoding start position ta is calculated.
Decoding of the second video stream may be started based on

The reproduction control information includes timing information indicating a timing at which decoding of the first second GOP is started so that a reproduction end time of the first picture and a reproduction start time of the second picture coincide with each other; The decoding unit,
Decoding of the second video stream may be started based on the timing information.

[0029] The decoding section may omit decoding of pictures unnecessary for decoding the pictures from the first picture to the second picture of the second GOP at the top.

[0030] The unnecessary picture may be a B picture.

The optical disc reproducing apparatus further includes a buffer memory unit for storing the first video stream and the second video stream. Even if the capacity of the buffer memory unit is equal to or more than 1 GOP data amount, Good.

The reproduction control information may be further recorded on the optical disc, and the reproduction section may reproduce the reproduction control information recorded on the optical disc.

[0033] An identifier indicating whether or not the reproduction control information is recorded on the optical disk is further recorded on the optical disk, and the reproducing unit records the reproduction control information on the optical disk. When the identifier indicates, the reproduction control information recorded on the optical disc may be reproduced.

In the high-speed playback mode, the output unit is:
If the second picture is not an I picture, outputting the I picture included in the first second GOP may be prohibited.

[0035] The output unit may prohibit the output of a part of the I picture included in the first second GOP based on the I picture reproduction prohibition information.

The playback control information generating apparatus according to the present invention includes a first video stream including a plurality of first GOPs and a plurality of second GOs.
An input unit for inputting a second video stream including P, and the plurality of first GOPs included in the first video stream.
Of the plurality of second pictures included in the second video stream following the first picture contained in the last first GOP of
A generation unit that generates reproduction control information indicating that a second picture included in the first second GOP among the GOPs and that is different from the first picture of the first second GOP is reproduced. Thus, the above object is achieved.

The reproduction control information includes the second GO at the beginning.
P may include information indicating the number of pictures from the first picture to the second picture of P.

The reproduction control information includes the second GO at the beginning.
It may include information indicating a time at which the first picture of P should be reproduced and a time at which the second picture of the second GOP at the head should be reproduced.

The reproduction control information includes timing information indicating a timing at which decoding of the first second GOP is started so that the reproduction end time of the first picture and the reproduction start time of the second picture coincide with each other. May be.

The timing information includes the first 2G
A timing at which decoding of the first second GOP in a case where a picture unnecessary for decoding the pictures from the first picture to the second picture of the OP is not decoded may be indicated.

The unnecessary picture may be a B picture.

An optical disk recording apparatus according to the present invention comprises: a generating section for generating reproduction control information; and a first section including a plurality of first GOPs.
A recording unit that records the reproduction control information on an optical disc on which a video stream and a second video stream including a plurality of second GOPs are recorded, wherein the reproduction control information includes the plurality of second video streams included in the first video stream. Following the first picture included in the last first GOP of the first GOP,
The plurality of second GOs included in the second video stream
This indicates that a second picture included in the first second GOP of P, which is different from the first picture of the first second GOP, is reproduced, thereby achieving the above object.

The optical disk recording apparatus of the present invention deletes a picture unnecessary for reproduction from a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs according to the reproduction control information. An editing unit that edits the first video stream and the second video stream; and a recording unit that records the edited first video stream and the edited second video stream on an optical disc. The control information is, after the first picture included in the last first GOP among the plurality of first GOPs included in the first video stream, the first information among the first of the plurality of second GOPs included in the second video stream. A second picture included in the second GOP, which is different from the first picture of the first second GOP, is reproduced. The shows, thereby the objective described above being achieved.

[0044] The unnecessary pictures for reproduction may include a picture after the first picture in the first video stream and a picture before the second picture in the second video stream.

[0045] The pictures unnecessary for reproduction may further include pictures unnecessary for decoding the pictures from the first picture to the second picture of the second GOP at the top of the second video stream. .

The unnecessary picture may be a B picture.

[0047] The recording unit may record the edited first video stream and the edited second video stream in a continuous area on the optical disc.

[0048] The recording section may record the reproduction control information on the optical disc.

[0049] The recording section may record the reproduction control information on a recording medium other than the optical disk.

[0050]

Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1) (720P / 480P Hierarchical Recording / Reproducing System) With reference to FIG. 1, a specific hierarchical recording apparatus having two layers of 720P and 480P will be described. A method of separating an HDTV signal into a plurality of signals and performing hierarchical recording will be described later with reference to FIG.

In the case of a movie, an input 720P signal is a video signal whose original signal is 24 frames per second, such as a movie work. The 3-2 pull-down unit 746 adds an extra 60 frames / sec to 24 frames / sec. A 720P (24P) signal 703 obtained by reducing the number of frames is obtained. Normal 60 per second
In the case of a frame (60P) video, the 3-2 pull-down is bypassed. Note that 60 frames / sec is abbreviated as 60P. In the 720P / 480P down converter 704, the number of lines in the vertical direction is first reduced to 720 × 2/3 = 480 by the vertical filter 705, and then the horizontal filter 706 outputs the 1280 × 720 pixel 720P video signal 703. , 1280 × 9/16 = 720 pixels and converted to a 480P video signal 707 of 720 × 480 pixels. The 480P low-resolution video signal is encoded by the 480P MPEG encoder 708 and becomes a compressed MPEG signal.
The 480P video signal 710 is again output by the G decoder 709.
Is restored. This signal is enlarged by 3/2 times and 16/9 times by the vertical filter 712 and the horizontal filter 713 in the 480P / 720P up-converter 711, and is converted into a 720P high-resolution video signal 714. The difference between the 720P video signal 703 as the original picture and the 720P video signal 714 that has been MPEG-encoded / decoded is calculated by a calculation circuit 715 in the difference signal processing unit 720, and difference information 716 is obtained.

This difference information 716 is the second M of 720P.
It is encoded by the PEG encoder 717 and becomes a video signal in GOP units composed of an intra frame (i-picture) and a difference frame (P or B). These are multiplexed by multiplexing means 719 in second interleaved blocks 718a and 718b in GOP units of 1 GOP to nGOP.
Etc. On the other hand, 480 of the basic signal processing unit 721
The MPEG stream of the basic signal encoded by the P first MPEG encoder 708 is M
It becomes a PEG stream.
The first interleaving blocks 722a and 722b are separated into the first interleaving blocks 718a and 718b.
b, that is, interleaved, and the interleaved signal
D or the like on a disk 724. At this time, a hierarchical record identifier 725 indicating the existence, start position, and end position of the hierarchical record
And the second interleave block 7 including difference information
Also, specific interleaved block reproduction prohibition information 726 for prohibiting reproduction of 18a and 718b by a conventional reproduction device is recorded. These identifiers are recorded in the overall management information 224 and each VOB as shown in FIG.

When the disc 724 is reproduced by an existing reproducing apparatus based on the DVD standard as shown in FIG. 8, the reproduction is performed by regarding the interleaved blocks 722a and 722b as a first angle. The reproduced signal is decoded by the MPEG data 727, and is decoded into NTSC or 480P (2
(4 frames) video signal is reproduced. Since the specific interleave block reproduction prohibition information 726 for prohibiting the reproduction of the specific interleave block in which the difference information is recorded, for example, the angle switching prohibition flag is recorded as shown in FIG. 23, the user operates the reproduction apparatus by mistake. However, reproduction of the second angle, that is, the second interleave unit is prevented. That is, the difference information of 720P is automatically prevented from being reproduced by the existing DVD reproducing device. If the 720P difference information is erroneously reproduced, this signal is output to the first MP for 480i of the existing reproducing apparatus.
Since the EG decoder cannot reproduce data normally, it malfunctions. However, the present invention avoids such a trouble. In this case, the connection information to the second interleaved block may be intentionally removed from the management information 224 called navigation information in the DVD standard disc.

This effect is also useful when the 720P signal itself is recorded in the second interleaved block.
In this case, the 720P signal is directly input to the MPEG encoder 717 as shown by the arrow marked with * in FIG.

Thus, when the disc 724 of the present invention is reproduced by an existing DVD reproducing apparatus, a video signal having the same NTSC picture quality as that of an existing DVD disc is reproduced, and an existing signal such as a differential signal or a 720P signal is reproduced. DVD
This prevents information that cannot be normally reproduced by the reproducing apparatus from being reproduced by mistake. Thus, bidirectional compatibility is achieved.

[0057] Instead of the 720P signal, the 480P signal itself may be recorded in the second interleaved block.
In this case, the conventional reproducing apparatus reproduces the first interleaved block, so that 480i (NTSC) is output, and the reproducing apparatus of the present invention outputs 480i from the first interleaved block and 480i from the second interleaved block.
Either one or both of 0P can be reproduced.

On the other hand, in the reproducing apparatus of the present invention, the basic signal is reproduced from the first interleave blocks 722a and 722b, that is, the first angle according to the DVD standard, and the second interleave blocks 718a and 718b and the second angle according to the DVD standard. The difference signal and 720P signal are reproduced from
A 480P video signal 729 is reproduced by the 480 PMPEG decoder 728, and a 720P video signal 731 or 720P signal of the differential signal is reproduced by the 720b MPEG decoder 730. The two video signals having different numbers of pixels are combined by the combining unit 732 or output as it is, and the original 720P video signal 733 is decoded and output.

When the reproducing apparatus of the present invention reproduces the hierarchical recording disk 724 of the present invention, a 720P video signal is output. In this way, it is possible to record an HDTV signal such as 720P while maintaining compatibility with a conventional reproducing apparatus.

When 480P itself is recorded in the second interleaved block, a signal of 480P, that is, a signal of NTSC double density is reproduced.

Referring to FIG. 3, a more specific operation of the reproducing apparatus of FIG. 8 will be described. Description of overlapping blocks is omitted.

The multiplexing means 7 shown in FIG.
19, the basic signal and the difference signal are divided in units of nGOP, then interleaved and recorded alternately. This signal is separated into a first interleave block 722a and a second interleave block 718a by a separation unit 734 of the reproducing apparatus in FIG. That is, after being separated into a basic signal and a difference signal, and stored in the first buffer memory 735 and the second buffer memory 736, each time information is extracted by the time information extraction unit 793, and the VTS synchronization unit 780 By setting the first reference time information and the second reference time information in the first decoder 728 and the second decoder 730 so that the two signals are synchronized,
The output signals of the two decoders are synchronized. In this case, when the hierarchical record identifier 725 is detected, the identification information processing unit 7
45 indicates that the first reproduced signal, which is a decoded signal of the first stream, is a low-pixel basic signal, and the second reproduced signal, which is a decoded signal of the second stream, is difference information between the high-pixel signal and the basic signal. The combining unit 73 recognizes the instruction of the up-conversion 738 in the combining unit 732 and the instruction of the addition operation.
Give to 2.

The 480P MPEG decoder 728 and the MP
The EG decoder 730 decodes the signal into a 480P (24) signal and a 720 (24 frame) signal, respectively. The decoded signal is 24 frames / sec or 30 frames / sec. By outputting the same frame twice by the 2-3 conversion units 737a and 737b, respectively, the 480P signal 729 of 60 frames / sec and the difference of 720P are output. Signal 731
Is obtained. 480P signal 729 is 480P / 720P
720P signal 739 by up-converter 738
Is added to the 720P signal 731 of the difference information by the adding unit 740, and the original 720P video 7
33 is decrypted. The operation of the adder 740 includes:
For example, as shown in the drawing, if each pixel is a and b, the operation of (a + b) / 2 is performed, thereby obtaining the original 720.
The P video 733 is decoded. The operation of the combining unit 732 may be an operation other than (a + b) / 2.

In this case, the MPEG decoded signal is not converted into 60 frames by the 2-3 conversion units 737a and 737b,
After the frames are processed and combined, the 2-3 converter 741 can convert the frames from 24 frames to 60 frames. In this case, since the data amount of the video signal is reduced by half, there is an effect that the processing capacity of the digital processing circuit can be reduced by half.

FIGS. 1 and 3 show two signals of a 720P signal such as a movie.
Although the method of recording and reproducing four frame signals in a hierarchical manner has been described, this method has a great advantage. For HDTV, 1
There are the 080i system and the 720P system. In the case of the movie 1080i (24 frames) as shown in FIG.
As shown in 42a, the capacity of the two-layer DVD is 8.5 Gb, so that only 90 minutes can be recorded.

On the other hand, 720P (24 frames)
In this case, the data can be recorded for 150 minutes as indicated by the curve 742b. 480P (60 frames) can also be recorded for 150 minutes as shown by the curve 742c. 120 for a movie
It is said that it is meaningless if you can not record for more than a minute. The 720P (24) / 480P hierarchical recording disk of the present invention has an effect that HDTV software of a movie can be stored in one DVD disk.

In FIG. 3, 48 which is the basic information of 720P
0P as the first interleaved block, 720P and 48
An example is shown in which a disc in which difference information from 0P is recorded in a second interleaved block is reproduced. However, when a disc in which a 720P signal is directly recorded in a second interleaved block is reproduced, an arrow marked with * in FIG. , The output of the second decoder 730 may be output as it is. This determination is based on the identifier, and the identification information processing unit 743
Do. In this case, the same effect as the complete compatibility can be obtained. This method has the effect of reducing recording efficiency, but has the effect of greatly simplifying the recording / reproducing processing circuit and the effect of complete compatibility.

Here, referring to FIG.
An embodiment in which a decoder is mounted on the 8 side will be described. Since the basic operation is the same as that of FIG. 3, only different parts will be described. First, on the reproducing apparatus 743a side, the signal before decoding is encoded by the encryption encoder 795 with the encryption key 799a.
And a TV monitor 798 via the network 798 by the communication interface unit 796a.
To the communication interface unit 796b on the side. Prior to this work, the mutual authentication units 794a and 794b communicate with each other and authenticate each other. This operation may be called a handshake. The mutual authentication is confirmed, and if it is determined that the communication is legitimate communication, the mutual authentication units 794a and 794a, 7
94b is an encryption encoder 795 and an encryption decoder 7 respectively.
97 is given encryption keys 799a and 799b and communication interface units 796a and 796b are given communication permission, so that encrypted data is transmitted and received, and the key of the encrypted data is unlocked. Is sent to the first decoder 728 and the second decoder 730. The processing of this signal is sent separately to the identifier 744
The identification information processing unit 745 makes the determination. As described above, the first stream is 480P and the second stream is 720P.
If it is a P differential signal, perform up-conversion and synthesis operation,
The 720P signal is output to the TV monitor 798a. Second
If an identifier indicating that the stream is a 480P differential signal is received, the two streams are combined to output a 480P signal. When the identifier of the three-dimensional signal is received, a three-dimensional signal obtained by temporally combining the first stream with the left eye and the second stream with the right eye is output, and the TV monitor 798a
To be displayed.

According to this method, even when two streams are cryptographically authenticated, the identifier 74 on the TV monitor side is used.
According to 4, the effect of decrypting the original image by performing processing such as synthesis can be obtained without impairing the security copyright protection effect of cryptographic authentication.

Next, the playback apparatus of the present invention uses 480P (60
A reproducing operation when reproducing the disk 724a on which (frames / second) is recorded will be described with reference to FIG. In addition,
The description of the parts common to FIG. 3 is omitted.

(Sum and Difference Method FIG. 19) Here, the concept of the sum and difference method will be described with reference to FIG. A video signal is divided into a high frequency range and a low frequency range in a vertical direction or a horizontal direction, and divided and recorded at each angle of a multi-angle. This is called a multi-angle video multiplexing system (MADM). As shown in FIG.
At 41 and a difference calculation unit 143, the signal is divided into a basic signal (sum signal) and an auxiliary signal (difference signal), MPEG-encoded, and recorded alternately in interleave blocks in units of 1 GOP. in this case,
In video, the information amount can be reduced by 20% by synchronously performing the 3-2 conversion of the basic signal and the auxiliary signal. The basic signal is “IBBPBBPBBPB” in which I frames 246, B frames 248, and P frames 247 are alternately arranged as shown in a main GOP structure 244 during normal MPEG encoding.
It is efficient to use “BPBB”. However, in the case of the difference signal, because of the loop pattern, the configuration of only the I frame 246 and the P frame 247 such as “IPPPPPPPIPPPPPPP” as shown in the sub GOP structure 245 is efficient. Experiments have shown that by setting the sub-GOP structure differently, the efficiency is improved.

FIG. 19 shows an example in which the 480P video signal is divided into two in the vertical direction, and FIG. 21 described later shows an example in which the 480P video signal is divided into two in the horizontal direction. 30 of the odd-numbered frame and 30 of the even-numbered frame of the 480P signal.
It is also possible to divide the signals into frames, convert each 30P signal into two interlaced signals of 60 fields, and encode each signal by MPEG and record it in the MADM system. In this case, since the encoding is performed progressively, the encoding efficiency is improved as in the case of a movie, and the recording time is increased.

In this case, in a playback device that does not support MADM,
A distorted 525 interlace signal of the first channel, that is, 30P, that is, a dropped frame, is reproduced.

The MADM-compatible reproducing apparatus reproduces a 30P signal as a basic signal and a 30P signal as an auxiliary signal. These two 30-frame signals are combined into one regular 480P signal of 60 frames by frame combining means including a frame buffer and output.

When a line doubler is added to the output section of 480P, an image of 1050P can be obtained.

When a 525 interlace signal is input to the sum signal portion and a 0 value is input to the difference signal of the MADM synthesis section, a 480P image is obtained. That is, it has the same effect as the line doubler. With this method, a 525-interlaced signal can be output at 480P, so that there is an effect that all images can be viewed simply by connecting a single cable to the progressive input terminal.

In FIG. 19, 1/2 (A + B) and 1/2 (A-B) are used as filter operation expressions from two taps. In this case, the separation frequency is about 300 lines.

As shown in FIG. 19, the disc 724a in which the 480P signal is separated into two signals by a sum and difference operation and recorded in two blocks of a first interleave block group and a second interleave block group is reproduced and separated. Part 73
4 separates the 480i signal as a basic signal and the 480i signal as a difference signal,
8. 480i decoded by MPEG decoder 730
A 480i signal 731a having a difference from the signal 729a is obtained, an operation of (a + b) / 2 is performed by the adder 740, and the two 480i signals are combined to output a combined signal 733a of 480P (60 frames).

In the disk 724 of the disk 724, in the case of 480i, in the case of 480P, in the case of 720P, 3
This indicates that one signal is recorded in a hierarchical manner and that the difference signal of which resolution is recorded. 480i / 4
The 80P / 720P identification information 744 (FIG. 17) is recorded in the toc portion or the like on the disk 724a. This information is processed by the identification information processing unit 743 to determine at which sector address of the disk the main data (main signal) and the sub data (differential signal) of the hierarchical data are recorded, and information such as the starting point thereof To the combining unit 732. The combining unit 732 is 4
From the start point of 80P, the main data and the sub data are combined, and a 480P (60 fPS) signal is output.

At the start of 720P, Vts = 6 in FIG.
It is recorded on the disc that 720P-main is the first interleave block and 720P-sub is the second interleave block, as shown in FIG. This information is identified by the identification information processing unit 743, and the MPEG decoders 728 and 730
From the time stamp of the main signal and the differential signal
The arithmetic unit 740 performs an operation of 720P synthesis, for example, (a + b) / 2 from the start time stamp of 0P, and outputs a 720P signal.

Also, 48 as identification information 744 (FIG. 17)
If the 0P identifier has been recorded, as shown in FIG. 10, the identification information processing unit 745 sends a 480i decoding instruction to the MPEG decoder 730 to perform the 480i decoding process.
The 80i difference signal 731a is decoded and combined by the combining unit 732 to obtain an output of 480P (60 fPS).

In this way, the MPEG decoder 730 switches between the 480i (480P-30fPS) and 720P processes according to the identification information.
The EG decoder can be used to decode both the 480P main signal and the difference signal and the 720P main signal and the difference signal, which has the effect of simplifying the configuration.

In the 480P playback mode shown in FIG. 10, although the 480P / 720P up-converter 738 in the synthesizing unit 732 is not used, the decoded 480P (6
0) Signal is converted to 480P-720P up-converter 738
By up-converting to a 720P signal and outputting the signal, the image can be displayed on a 720P-compatible HD video projector or the like, so that the effect of making the scanning lines more difficult to see is obtained. In this case, one 480P-720P upconverter 738 can be used for both 720P synthesis and 720P upconversion, so that there is an effect that a 720P upconverted output of a 480P signal can be obtained without adding any components.

(720P / 480P / 480i type three-layer recording apparatus) The configuration and operation of a 720P 60 frame / second type three-layer recording apparatus will be described with reference to FIG. Since the configuration and operation are almost the same as those in FIG. 1, only different portions will be described. First, the input signal is 720P at 60 frames / sec. Therefore, the 480P down-converted video signal is also 4
It is an 80P signal (60 frames / second). This signal is input to the basic signal processing unit 721a, and in the separation unit 747, assuming that the pixel data of the n-th line is a and the pixel data of the n + 1-th line is b, the calculation result of (a + b) / 2 is 748a of the 480i video signal. Used for the m-th line of
The calculation result of (ab) / 2 is converted to a 480i video signal 748b.
, The main signal of NTSC,
A difference signal is obtained. These signals are encoded by MPEG encoders 708a and 708b, and decoded signals 749a and 749 of 480i by MPEG decoders 709a and 709b.
49b is decoded, and the combining section 748 decodes the 480P signal 710. The 480P signal is up-converted into a 720P signal 714, difference information is obtained, and MPEG encoding is performed.
Third interleaved block data 718a, 718b
The procedure to obtain is that the claim rate is from 24fPS to 60fP
Except for the point changed to S, it is the same as FIG.

On the other hand, the 480i MPEG stream has n
Multiplexing means 71 for interleaved blocks in GOP units
9a, separated by 480i-basic signals
Next to the interleave block 722a, the second interleave blocks 750a and 750a composed of 480i-difference signals
Third interleave block 7 composed of 20P differential signals
18a, and are recorded on a disk 724 such as a DVD.

In this case, the multiplexed signal is modulated by 8VSB, QAM or OFDM modulator 751 and transmitted by transmitter 7
By transmitting the broadcast from the server 52, hierarchical broadcasting can be performed. In this case, the multiplexing means may perform time division not in GOP units but in a time domain specified by broadcasting.

Thus, 480i, 480P (60) and 7
20P three-layered hierarchical disc or hierarchical broadcasting is realized.

The operation of reproducing the disk 724a will be described with reference to FIG. Since the same configuration as in FIG. 3 is included, the description of the overlapping part will be omitted. Disk 724a
Or a signal received from the receiving unit 753 and demodulated by the demodulating unit 754
, The data is separated into three streams in units of the interleaved blocks, and the buffers 735a, 735b, and 7
36, three MPEG decoders 728a, 72
8b, 730, decoded at 730
9a, 480i difference signal 749b, 720P difference signal 7
31 signals are demodulated. The 480i-basic signal 749a and the 480i difference signal 749b are
At 55, a 480P (60 fPS) video signal 729 can be obtained by performing the calculations of (a + b) and (ab). This signal and the aforementioned 720P differential signal 7
31 are synthesized by the synthesizing unit 732, and the 720P output 73 is synthesized.
3a is obtained, but the description of the synthesis procedure is omitted since it has been described above.

Thus, the discs 724a to 480i
Output 749a, 480P output 729, 720P output 73
Outputs of three different resolutions 3a are obtained, and the user can select an output according to the grade of the monitor playback device.
In other words, the existing reproducing apparatus is 480i (NTSC) grade, and the reproducing apparatus of the present invention corresponding to 480P is 480P (6
The playback device of the present invention supporting 720P (0 fPS) and 720P provides an output of 720P (60 fPS), and complete compatibility is realized.

In FIG. 2, when the identification information processing unit 745 detects a high resolution identifier, the rotation speed of the motor is increased via the system control 21 and the rotation control circuit 35. In normal image reproduction according to the identifier, 1 × speed, 480P or 7
By increasing the speed to 2 × speed for 20P (24P) and 3 to 4 × speed for 720P (60P), a high-resolution signal can be reproduced, and there is a power saving effect. Also, NTS
When reproducing the C grade, the system control unit 21 does not need the unnecessary 720 PMPEG decoder 730 or 480 iMP
By stopping or operating the clock of the EG decoder 728b and the synthesizing unit 732 at a low speed, power consumption can be significantly reduced. Also, the APTS 84 of the audio time stamp of the audio data is transferred to the AV synchronization control unit 158.
Then, based on this time information, a video presentation time stamp VPTS of each MPEG decoder is created and set in the registers 39a, 39b, 39c of the decoder, thereby synchronizing the reproduced frames of each decoder. To synchronize the vertical blanking, the decoder synchronization unit 794 resets the horizontal and vertical synchronization of each decoder at the same time, and the image of each decoder is synchronized in dot units. A specific method of synchronizing audio and video will be described later.

A first resolution identifier indicating a low resolution such as NTSC of the image of the first stream and a second resolution identifier indicating a high resolution such as 720P of the second and third streams are reproduced from the disc 724a. From these, the upconverter 738 of the synthesizing unit 732 converts 480P to 72.
0P, 480P to 1080i, 480P to 1080
The system control unit 21 calculates which processing, such as P, 720P to 1080P, is to be performed, and instructs the synthesizing unit 732. Actually, there are various first resolution identifiers such as 704 × 480 and 720 × 480. This has the effect that the upconverter operates at an optimal ratio. Of course, a simple system configuration in which an identifier indicating the ratio of the upconverter is simply recorded on a paper and reproduced is also possible.

The reproducing apparatus 743a shown in FIG. 2 outputs 480i (NTSC) for the first stream only, and outputs 480P (60P) for the first stream + second stream.
29, if the first stream + the second stream + the third stream, outputs of three kinds of resolutions of 720P (60P) output 733a can be output simultaneously or at different times, so that monitors of various resolutions can be supported.

In particular, the 480P output 729 is output to the synthesizing unit 732.
Can be converted to a 720P output by using the upconverter 738, so that a 720P converted output of 480P can be obtained without adding a circuit.

Also, in the same block diagram of the hierarchical reproducing apparatus, a receiving unit 753 and a demodulating unit 754 are added to receive and demodulate a hierarchical signal such as a TV, and to output a video signal having three resolutions. It is also possible to configure a receiving device for outputting.

(Wide 480P) The concept of the MADM system in the case of division in the horizontal direction will be described with reference to FIG. 144
Wide 480P such as 0x480P is suitable for movies. This signal is converted to 1440 × 4 by the 3-2 conversion unit 174.
It can be converted to an 80i interlace signal. The horizontal filter unit 206a divides the image into two in the horizontal direction. The principle of this filter is shown in FIGS. 1 as in (b)
The 440 dots are divided into odd-numbered dots 263a and 263b and even-numbered dots 264a and 264b. These are Xn,
When it is called Yn, a sum signal is obtained as X + Y, and a difference signal is obtained as XY as a calculation output, and 720 × 480 and 7 shown in FIG.
Two 20 × 480 480P or 525i signals are obtained.

Returning to FIG. 21, the horizontal sum signal obtained in this way is reduced to 720 dots horizontally, but since it has passed through the horizontal filter, aliasing is suppressed to the same level as the NTSC signal. Therefore, in the conventional reproducing apparatus, since only the sum signal is reproduced, completely the same DVD image quality can be obtained.
Although the difference signal is a line drawing that is only a circle, the difference signal is limited by the second video signal output restriction information adding unit 179 in FIG. 60. The sum signal and the difference signal are converted into an MPEG stream by the first encoder 3a and the second encoder 3b.
The signals are interleaved in units of P or more interleaved blocks and MADM-multiplexed.

In the case of a movie, the 3-2 conversion section 174 performs 3-2.
It is converted and MADM-recorded as each MPEG signal together with the 3-2 conversion information 174a.

In this case, since the movie is 24 frames per second, the double-speed playback device outputs one frame from two interlaced signals.
A progressive video of 440 × 480P is reproduced. For movies, the scope size is 2.35 to 1, and 14
40 × 480P is suitable in terms of the aspect ratio, and the effect of Wide 480P is high.

Although FIG. 21 has described the hierarchical type disk 724b of wide 480i, FIG.
The operation of reproducing by the 80i reproducing device will be described. Disk 7
24b When recorded at 24 frames / sec, the field frame conversion units 756a and 756b use W-
480P basic signal 757a and W480P difference signal 757
b is decoded. Each pixel is (X + Y) / 2,
Since (X−Y) / 2 data is encoded, the synthesizing unit 758 outputs (X + Y) / 2 + (XY) / 2
Is performed, the X, that is, the odd-numbered pixel data is decoded, and the Y, that is, the even-numbered pixel data is decoded by the calculation of (X + Y) / 2− (X−Y) / 2. The number of pixels is doubled to 1440 pixels. Thus, W480P of 1440 x 480 pixels
An image 759 is obtained. W480P-720P converter 7
At 60, this signal is transformed into an 8/9 times horizontal filter 76.
By converting horizontal data from 1440 pixels to 1280 pixels at 0a and converting them from 480 to 720 pixels at a 3 / 2-fold vertical filter 760b, a 720P digital output is obtained and a general 720P digital interface can be used. There is.

(Detailed Reproducing Operation: FIG. 25) Next, a double-speed progressive or super wide image shown in FIG.
The reproduction operation of the reproduction device 65 of the present invention will be described in detail with reference to a block diagram of a reproduction device for 0P reproduction. The signal reproduced from the optical disc 1 is separated by the separation unit 68 into a first interleave block 66 and a second interleave block 67 each composed of a frame signal of 1 GOP or more. The frame video signals 70a, 70b of 30 frames per second, which are MPEG-expanded by the decompression unit 69, are separated into odd field signals 72a, 72b and even field signals 73a, 73b by field separation units 71a, 71b, and 2ch
The NTSC interlace signals 74a and 74b are output. The wide screen of FIG. 20 will be described later. When this is developed, in FIG. 25, 1440 × 960
The progressive image 182a is separated in the horizontal / vertical direction by the horizontal / vertical separating unit 194 of the image separating unit 115 using, for example, a subband filter or a wavelet transform. Then, a 525 progressive video 183 is obtained. This is 5
25 interlaced signals 184, separated into stream 1
Record at 88a.

On the other hand, the remaining interpolation information
Streams 188c, 188d, 188e, 188
f and recorded in an interleaved block. Maximum transfer rate of each interleave block is 8M in DVD standard
since the interpolation information is divided into four streams, 32 Mbps, and 6 angles, 48 Mb
720p and 1050P HDTV to record ps
Video can be recorded. In this case, the conventional reproducing apparatus reproduces the stream 188a and outputs the interlaced video 184.
Is output. Also, streams 188c, 188d,
188e and 188f include an image processing restriction information generation unit 179.
Since the output restriction information is recorded on the optical disk 187, interpolation information 185 such as difference information of an image which is difficult to see is output.
Is not erroneously output. In this way, by separating in the horizontal and vertical directions in the manner of FIG. 25, there is an effect that an optical disk compatible with HDTV and NTSC is realized.

In FIG. 25, the interlace signal is converted into an interlace signal by an interlace conversion section 175 and output, and a scope screen 178 is obtained. The 480P progressive signal is similarly output as the scope screen 178. Also, 480P when viewed on a 720P monitor
The signal is converted by the 480P / 720P conversion unit 176 into 72
Converted as a progressive signal of 0P, 1280 × 72
0 or 1440 × 720 (image is 1280 × 48
0 or 1440 x 480) letterbox type 720
The P screen 177 is output. Scope image (2.35:
Since 1) is 1128 × 480, an image having a close aspect ratio can be obtained. Particularly, in the case of movie software, since the rate is 24 frames / sec, the progressive image has a rate of 4 Mbps. When a scope image is recorded by the method of the present invention in which the scope image is divided into two screens, it becomes 8 Mbps and can be recorded on a DVD double-layer disc for about two hours.
There is an effect that a high-quality progressive image of P or 480P can be recorded. In addition, even in a conventional TV, it is naturally displayed as an interlace output signal. Thus, the scope (2.35: 1) screen of the movie is set to 480P or 7
The effect of being able to output at 20P is obtained.

(High-resolution recording identification information) Returning to FIG. 1, address information is output from the address circuit, a hierarchical recording identifier 725 including progressive / stereoscopic image arrangement information is output from the hierarchical recording identifier output unit 725a, and the recording circuit 7
By 23, it is recorded on the optical disk. The progressive / stereoscopic image arrangement information includes an identifier indicating whether a progressive or stereoscopic image exists on the optical disc, a hierarchical recording identifier 725 indicating only up-conversion during hierarchical encoding, and a progressive / stereoscopic image arrangement table in FIG. 14 are included. As shown in FIG. 17, an angle number and a cell number where R and L stereoscopic images and progressive signals are arranged for each VTS are written in the TEXTT file 83. Since the start address and end address of each cell are written in the PGC file of each VTS, the start address and end address are indicated as a result. Based on the arrangement information and the identification information, the reproducing apparatus correctly outputs the progressive video and the stereoscopic video as the progressive output and the R and L outputs. If the normal images of different contents are erroneously output to R and L, the images are unrelated to the right eye and the left eye of the user, causing discomfort. The progressive / stereoscopic image arrangement information, the progressive / stereoscopic image identifier, and the hierarchical recording identifier have an effect of preventing output of such an unpleasant image. When the layer record identifier 725 is reproduced as shown in FIG. 3, the control unit sends an up-conversion command 786, up-converts the 480P signal into a 720P signal by the up-converter 738, and performs a 720P synthesizing process. 725
When there is no, as shown in FIG.
Since 480P is output by performing the combining operation without using the 38, the image combining can be stably performed using one combining unit by simply switching the connection based on the identifier.

A procedure for reproducing using the image identifier 222 will be described with reference to FIG. First, the reproduction procedure control information 225 is read from the management information 224 from the optical disk. Since there is VOB restriction information in this, in the existing playback device, only the 0th VOB 226a is connected to the 1st VOB 226b where the main video is recorded. 0th VOB2
26a, a second VO in which an interpolation signal such as difference information is recorded.
Since it is not connected to the B226c, an unsightly image such as difference information is not reproduced from the existing reproducing apparatus as described above. Next, an image identifier is recorded in each VOB of the main signal, and the first VOB 226b and the second VOB 2
26c is a progressive identifier = 1, a resolution identifier = 00
(525 lines), 525 progressive signals are reproduced from the progressive player HD player.

The image identifier 222 of the next VOB 226d has a progressive identifier = 0 and a resolution identifier 219 = 10, and is therefore a 1050 interlaced signal.
226e, VOB226f, VOB226g
It can be seen that OB is interpolation information. Thus, the conventional player outputs an NTSC, progressive player, 1050 interlaced 720 horizontal pixels, and an HD player outputs a full standard HDTV signal of 1050c. In this way, various video signals can be interleaved and reproduced by the image identifier 222. The image identifier 222 may be recorded in the management information 224.

(Double Clock and Soft Decoding) In the block diagrams of FIGS. 3 and 4, two MPEG decoders are used, but as shown in FIG.
The PEG signal and the second MPEG signal are combined into one M
The circuit is configured to generate a double clock from the double clock generation unit 37 as a PEG signal, perform double calculation by the double clock type MPEG decoder 16c, decompress it, and output it as R and L video signals by the separation unit 38. Can be easily done. In this case, 16M is stored in the memory 39 as compared with the existing playback device.
Since it is only necessary to add the BSD-RAM, there is an effect that the cost increase is small. In the case of soft decoding, simultaneous decoding can be performed in a time-division manner with one CPU if the CPU becomes a double clock. This application will be described later in a second embodiment.

(Synchronous Reproduction) The synchronous reproduction of two streams important for decoding a high-resolution progressive video image or a stereoscopic video image will be described with reference to FIG. First, it is necessary to synchronize the vertical and horizontal synchronization of the two streams within one line. For this reason, the vertical / horizontal synchronization control unit 85c
First MPEG decoder 16a and second MPEG decoder 1
6b and synchronized at the same time. Next, the two decoded outputs need to be images of the same VPTS.
This method will be described with reference to the flowchart of FIG. 26 and FIG. In step 241a, the synchronization of both the first decoder and the second decoder is turned off. In step 241b, vertical and horizontal synchronization are established as described above. Step 241c
To read the audio APTS and set the APTS value as the initial value of the STC of the first decoder and the STC of the second decoder. As the processing of the first decoder in step 241e, it is checked in step 241f whether the first VPTS has reached the initial value. If OK, the decoding is started in step 241g. In step 241h, the processing delay time of the first decoder is calculated, and the VPTS of the decoded output is adjusted so that the APTS and the VPTS are synchronized. Since the second decoder performs the same processing, the images of the first decoder and the second decoder are synchronized. Thus, the first M
The two decoded outputs of the PEG signal and the second MPEG signal are synchronized. After that, the video signal synchronizing unit 36 in the synthesizing unit 36
The original progressive image can be obtained even if the sum is calculated by synchronizing the dots in units of a. As shown in FIG. 5, the APTS 84 is read by the audio decoder 16c, and the STC registers 3 of the two MPEG decoders 16a and 16b are read.
By setting the same APTS in 9a and 39b, the audio and the two video streams can be automatically synchronized.

In the case of the present invention, the buffer circuits 23a and 23
If the buffer b underflows, one of the two video signals is interrupted, and a distorted progressive video is output. Therefore, a buffer amount control 23c is provided as shown in FIG. 2 to control the amounts of the two buffers.
In this operation, as shown in the flowchart of FIG. 27, first, in step 240a, the maximum interleave value in the NAVI information of each disk is read, and the maximum value 1ILB of one main interleave block is set. Usually, it is 512 sectors, that is, about 1 MB. If the limit is set to 1 MB or less, set that value. Next, in step 240b, when a simultaneous reproduction command of the main and sub interleave blocks is received, if the buffer amount of the first buffer 23a is 1 ILB or less in step 240c, reproduction is performed from the main interleave block and data is transferred to the first buffer 23a. Give an instruction to make it happen. Returning to steps 240b and 240c, if the first buffer amount exceeds 1 ILB, the transfer is stopped in step 240d. Thus, the buffer 23a is equal to or larger than 1 ILB, so that underflow is prevented.

In the buffer 23b, the maximum value 1ILB-Sub of the sub-interleave block is set in step 240f. Simultaneous playback is performed in step 240g, and step 240
If the value of the second buffer 23b is equal to or smaller than 1/2 ILB-Sub at h, the data is read into the buffer in step 240j.

As shown in FIG. 24 (4), since the second buffer may be ＩＬ ILB, the buffer amount can be halved. The buffer control in FIG. 27 eliminates buffer underflow and reduces the disturbance of the synthesized image on the playback screen.

(Required capacity of track buffer: FIG. 23,
31) First, a method for synchronizing two video streams according to the present invention will be described. First, as shown in FIG. 39, after the system stream reproduced from the optical head is temporarily stored in the track buffer 23, the first video decoder 6
9d and the second video decoder 69c. On a track of the optical disk, two streams A of a progressive signal, that is, a first stream and a second stream B are alternately recorded in interleaved block units.

First, the stream A is reproduced at the double speed, and the accumulation of data in the first track buffer 23a of the track buffer 23 is started. In this state, as shown in (1) of FIG. 24, at t = t1 to t2, data of one interleave block (ILB) I1 of the first video signal during one interleave time T1 is accumulated. The first track buffer data amount increases to 1I at t = t2.
The data amount is increased to the LB data amount, and the accumulation of data for one ILB of the first video signal is completed. At t = t2, after the accumulation of 1 ILB equal to or more than 1 GOP of the first video signal is completed, the second video signal of the stream B is reproduced from the next interleaved block I2 of the optical disc, and the stream shown in FIG. As shown by the solid line, the second track buffer 23 at t = t2
The storage of the data of the second video signal is started at b, and is stored in the first track buffer 23b until t = t6. at the same time,
From t = t2 to t8, the first video signal and the second video signal are synchronized with the video presentation time stamp, that is, the VPTS time, as shown in FIGS. 2
3b to the first video decoder 69c and the second video decoder 69d. This input signal is shown in FIG.
As shown in (11), the first video decoder 69c and the second video decoder 69d output two video data expanded from t = t3 which is a time delayed by the video delay time twd which is the MPEG expansion processing time. You. t
= Streams A and B from t4 to t10
Are combined into a progressive signal by the progressive conversion unit 170, and a progressive signal for one interleave block is output.

As described above, from t = t2 to t8, data of one interleave block is input to the decoder. Therefore, the data in the first track buffer 23a and the data in the second track buffer 23b are consumed and reduced at substantially the same rate. Therefore, as shown in FIG. 24 (2), the data amount of the first track buffer decreases from t2 to t7, and at t = t7, decreases to 1/2 of 1 ILB. t
= T7, the reproduction of the data of the interleaved block I5 starts, so the increment and decrement cancel each other, increase until t = t8, and reach 1 ILB at t = t8, but in the same manner as in the case of t = t2, t = T8, the input to the first decoder 69c starts. Therefore, the reduction continues until t = t11.
/ 2 ILB of buffer memory.

Next, the transition of the memory amount of the second track buffer 23a, which is the buffer amount of the stream B, will be described with reference to FIG. At time t = t2, the data B1 of the stream B of the interleaved block I2 starts to be input to the second track buffer 23b, but at the same time, the transfer of the data of B1 to the second video decoder 69d also starts.
And the buffer amount at t = t6 is の of 1
/ 2 ILB. When the progressive signal of the present invention is recorded at two angles of multi-angle, t = t since there are four streams, that is, four interleaved blocks.
From t6 to t7, interleave blocks I3, I4
Needs to be track jumped to jump to I5. During the jump time 197 of tj, the reproduction input of data from the optical disc is interrupted,
Continues to decrease until t = t8, and becomes 0 at t = t8.
Get closer.

At time t = t8, the reproduced data of the data B2 of the interleaved block I6 is input, so that the data starts to increase again. At time t = t11, the memory capacity of the second track buffer becomes 1/2 ILB. At t = t11, a track jump is performed, and the interleave blocks I7 and I8 are skipped to access the interleave block I9 of A3.

The above operation is repeated.

Here, the minimum required memory capacity of the track buffer 23 obtained by adding the first track buffer 23a and the second track buffer 23b according to the method of the present invention will be described.
The track buffer capacity 198 indicated by a dotted line in FIG.
Indicates the data amount obtained by adding the track buffer 23a and the track buffer 23b. Thus, at least 1 ILB in total
By setting the capacity of the minute in the track buffer, it is possible to reproduce the data seamlessly.

In the present invention, during the progressive reproduction of the present invention, the track buffers 23a and 23a of the track buffer 23 are used.
By setting the total capacity of b to be equal to or more than one interleave block, it is possible to prevent the track buffer from overflowing or underflowing.

(System Clock Control Method)
8, a method of switching the system clock STC in the case of two streams will be described later. In the case of progressive reproduction, A, B2
There are two streams. In this case, assuming that two streams of two interlace signals constituting one ILB progressive signal are A1 and B1, first, the data of the first A1 stream is 1 / 2I as shown in FIG.
The data is reproduced during the LB period, and all data is accumulated in the buffer. Next, as shown in FIG. 28 (2), after the reproduction of A1 is completed, the data of stream B is reproduced as B1 and stored in the buffer. In this case, since the reproduction data from the optical disc is controlled by the stream B of FIG. 28B for the above-mentioned purpose, the track buffer does not overflow. The counter of the SCR from the track buffer of the stream A or the stream B shown in FIG. 28 (3), that is, the stream clock, is reset substantially in synchronization with the reproduction start point J of the stream B shown in FIG. 28 (2).
Then, since the stream B is output at double speed, the stream clock is counted by the buffer at 1 × speed, that is, 1/2 speed as shown in FIG. 28 (3).
Then, at point G, the stream clock is reset. The time VPTS2 at which the video signal of the stream B is output from the video decoder needs to be synchronized in consideration of the delay time Tvd such as the MPEG decoding time. In this case, at point I, that is, at the point where the increase in VPTS is
Restart the synchronization control. In this case, the VPT of stream B
S2 is checked, and this VPTS2 has V
By synchronizing the PTS1, the synchronization is realized by a simple control of one system. In this case, VPTS1 may be used together.

The audio data of the audio synchronization stream B is reproduced, and as shown in FIG.
STC may be switched at the point H using the APTS.
The STC may be switched for the sub video signal of the stream B in the same manner as in FIG. 28 (4).

As described above, the AV synchronization is realized by simple control by performing the AV synchronization by using the data of the stream B preferentially.

In this case, the streams A1 and A2 do not overflow since all the video data is stored in the buffer memory. The stream B1 may overflow. However, in the present invention, by performing the synchronization control on the stream B, as shown in FIG. 28 (6), the ST is controlled so that VPTS2 does not exceed the VPTS2 threshold value.
Since the signal flow is controlled by switching C, the buffer does not overflow.

Also, by using the audio of stream B for audio reproduction, not only the buffer of the audio decoder can be reduced to half as described above, but also, as shown in FIG. By switching the STC, the sound is smoothly reproduced without exceeding the APTS threshold value. The sub-picture information is also smoothly synchronized and reproduced. Therefore, the video and the audio, the sub-video such as the caption are synchronized, and the screen and the audio are reproduced seamlessly, that is, seamlessly. In this case, even if the recording of the audio and the sub-video of the stream A is omitted, the recording can be performed.

(AV Synchronization: FIGS. 29, 30, 31, 33)
Here, an important AV synchronization at the time of connection at the time of jump when two or three streams are reproduced simultaneously will be described. In the case of the present invention, it is important to synchronize a 720P signal with a stream having a significantly different data amount of 480i.

FIG. 29 is a flowchart showing a detailed procedure of the reproduction process of the program chain group by the system control unit 21. In FIG. 29, steps 235a,
At 35b and 235c, first, the system control unit 21 reads out the corresponding program chain information from the program chain information table of the volume information file or the video file. If it is determined in step 235d that the program chain has not ended, the process proceeds to step 235e.

Next, step 235e refers to the seamless connection instruction information of the cell to be transferred next in the program chain information to determine whether or not the connection between the cell and the immediately preceding cell should be seamlessly connected. If a seamless connection is required, the process proceeds to a seamless connection process at step 235f. If a seamless connection is not required, the process proceeds to a connection process for establishing a connection.

In step 235f, the DSI packet is read out by controlling the mechanism control unit, the signal processing unit, and the like, and the VOB existing in the DSI packet of the cell to which the transfer has been performed earlier
The reproduction end time (VOB_E_PTM) and the lossy VOB reproduction start time (VOB_S_PTM) are read out in the DSI packet of the cell to be transferred next.

Next, in step 235h, "VOB playback end time (VOB_E_PTM) -VOB playback start time (VOB_S_PTM)" is calculated, and this is set as the STC offset between the cell and the cell just transferred, and the AV in FIG. The data is transferred to the STC offset combining section 164 in the synchronization control section 158.

At the same time, in step 235i, the VOB playback end time (VOB_E_PTM) is transferred to the STC switching timing control section 166 as the switching time T4 of the STC switching switch 162e.

Next, the mechanism controller is instructed to read data until the end position of the cell is reached. As a result, the data of the cell is transferred to the track buffer 23 in step 235j, and as soon as the transfer is completed, the process proceeds to reading the program chain information in step 235c.

When it is determined in step 235e that the connection is not seamless, the track buffer 2
3 to the end of the system stream, and proceeds to step 235c to read out the program chain information.

Next, two embodiments relating to an AV synchronization control method of seamless connection control for performing seamless reproduction according to the present invention will be described. These details describe the AV synchronization control unit 158 in FIGS. 2 and 31.

The system decoder 161, the audio decoder 160, and the video decoders 69c and 69 shown in FIG.
d, all the sub-picture decoders 159 process data in the system stream in synchronization with the system time clock provided from the AV synchronization control unit in FIG.

In the first method, the AV synchronization control section 158 will be described with reference to FIG.

In FIG. 30, the AV synchronization control unit
Changeover switches 162a, 162b, 162c, 162
d, STC 163, STC offset combining section 164, S
TC setting section 165, STC switching timing control section 166
Consists of

STC switching units 162a, 162b, 162
c, 162d and 162e are system decoders 16 respectively.
1, audio decoder 160, main video decoder 69c, sub video decoder 69d, sub video decoder 1
The output value of the STC 163 and the output value of the STC offset synthesizing unit 164 are switched as a reference clock to be given to 59.

The STC 163 performs the normal reproduction shown in FIG.
Is a reference clock for the entire MPEG decoder.

The STC offset synthesizing section 164 sets the STC1
A value obtained by subtracting the STC offset value given from the system control from the value of 63 is continuously output.

The STC setting section 165 sets the STC initial value given from the system control section or the STC offset combined value given from the STC offset combining section 164 to the STC offset value.
It is set in the STC 163 at the timing given from the switching timing control unit 166.

The STC switching timing control section 166 determines the STC switching section switches 162a to 162e and the STC setting 165 based on the STC switching timing information provided from the system control section and the STC offset combined value provided from the STC 163 and the STC offset combining section 164. Control.

The STC offset value is an offset value used for changing the STC value when the system stream # 1 and the system stream # 2 having different STC initial values are connected and continuously reproduced.

Specifically, from the “VOB reproduction end time (VOB_E_PTM)” described in the DSI packet of the system stream # 1 to be reproduced first, the “VOB” described in the DSI of the system stream # 2 to be reproduced next The playback start time (VOB_S_PTM) "is subtracted.
The information of these display times is read by the system control unit 167 at the time when the data read from the optical disk in FIG.
It is calculated in advance.

The calculated offset value is provided to STC offset combining section 164 before the last pack of system stream # 1 is input to system decoder 161.

The data decoding processing section 165 of FIG. 5 operates as an MPEG decoder except when performing seamless connection control. At this time, the STC offset given from the system control unit 167 is 0 or an arbitrary value.
For the STC changeover switches 162a to 162e at 0, the STC 163 side is always selected.

Next, when two system streams, system stream # 1 and system stream # 2, having discontinuous STC values, are successively input to system decoder 161, ST at the connection of the system streams is assumed.
C changeover switches 162a to 162e and STC
The operation of 163 will be described with reference to the flowchart of FIG.

The SCR, APTS, VPTS, V of the input system stream # 1 and system stream # 2
DTS description is omitted.

It is assumed that the STC initial value corresponding to the system stream # 1 being reproduced is set in the STC 163 in advance from the STC setting unit 165, and that the count is sequentially increasing with the reproduction operation. First, the system control unit 21 (FIG. 31) calculates the value of the STC offset by the method described above, and stores this value in the ST until the last pack of the system stream # 1 is input to the decoder buffer.
It is set in the C offset synthesizing unit 164. The STC offset synthesizing unit 164 continues to output a subtraction value of the STC offset value from the value of the STC 163 (Step 168).
a).

The STC switching timing control section 166 obtains the time T1 at which the last pack in the system stream # 1 to be reproduced first is input to the decoder buffer.
In step 1, the STC switch 162a is switched to the output side of the STC offset synthesizing unit 164 (step 16).
8b).

Thereafter, the output of the STC offset combining section 164 is given to the STC value referred to by the system decoder 161, and the transfer timing of the system stream # 2 to the system decoder 161 is determined by the system stream # 2
Is determined by the SCR described in the pack header.

Next, STC switching timing control section 166
Obtains a time T2 at which the reproduction of the last audio frame of the system stream # 1 to be reproduced first ends, and switches the STC switch 162b to the output side of the STC offset combining unit 164 at the time T2 (step 1).
68c). A method for obtaining the time T2 will be described later.

Thereafter, the output of the STC offset synthesizing section 164 is given to the STC value referred to by the audio decoder 160, and the audio output timing of the system stream # 2 is described in the audio packet of the system stream # 2. Determined by the APTS.

Next, the STC switching timing control section 16
6 obtains times T3 and T'3 at which decoding of the last video frame of the main signal and the sub-signal of the system stream # 1 reproduced earlier ends, and at times T3 and T'3, the STC changeover switches 162c and 162d. To the output side of the STC offset combining section 164 (step 1
68d). A method for obtaining the time T3 will be described later. Thereafter, the output of the STC offset synthesizing unit 164 is given to the STC value referred to by the video decoders 69c and 69d, and the timing of video decoding of the system stream # 2 is determined by the VPTS described in the video packet of the system stream # 2. Is determined by

Next, the STC switching timing control section 16
6 obtains a time T4 at which the reproduction output of the last video frame of the system stream # 1 reproduced earlier ends, and at time T4, switches the STC switch 162e to the output side of the STC offset synthesizing unit 164 (step 1).
68e). A method for obtaining the time T4 will be described later.

Thereafter, the STC value referred to by the video output changeover switch 169 and the sub-picture decoder 159 includes the STC value
The output of the offset synthesizing unit 164 is provided, and the timing of the video output and the sub-video output of the system stream # 2 is determined by the VPTS and the SPTS described in the video packet and the sub-video packet of the system stream # 2.

The STC changeover switches 162a to 162a
When the switching of the switch of 2e is completed, the STC setting section 165 sets the value provided from the STC offset combining section 164 in the STC 162 (step 168f).
(This is called STC 163 reloading), and all switches in steps 162a to 162e are reset to STC 16
Switch to the third side (step 168g).

Thereafter, the audio decoder 160, the video decoders 69d and 69c, the video output switch 1
The output of the STC 163 is given to the STC value that the 69 and the sub-picture decoder 159 refer to, and the operation returns to the normal operation.

Here, two means will be described as a method of obtaining the times T1 to T4, which are STC switching timings.

As a specific means, since the times T1 to T4 can be easily calculated when the stream is created, the time T1
This is a method in which information representing 1 to T4 is described on a disk, and the system control unit 21 reads out the information and transmits it to the STC switching timing control unit 166.

In particular, as for T4, "VO" recorded in the DSI used for obtaining the STC offset is used.
B playback end time (VOB_E_PTM) "can be used as it is.

The value recorded at this time is described based on the value of the STC used in the system stream # 1 to be reproduced first, and the STC switching timing control unit 166
The STC changeover switches 162a to 162e are switched at the moment when the value to be counted up by 163 becomes the time T1 to T4.

(Embodiment 2) Embodiment 1 has described in detail an application example of the present invention to a high-resolution video recording / playback of a multi-stream synchronous playback system. The following describes a reproduction control method for connecting two streams without a seam by applying. In the case of an MPEG recording signal, editing in GOP units is common, and editing in frame units is difficult. By using the MSS method of the present invention, substantial frame editing becomes possible.

It is important to match the timing of the video signal and the audio signal at the joint, but a detailed description of the synchronization method will be described in Embodiments 3 to 9.

First, when the present invention is applied to seamless reproduction of a portion at the time of switching frame editing, as shown in FIG. 10, edit data 761 including synthesis information such as the zoom instruction signal 28P and the like.
Is processed by the edit data processing unit 762, and the switching synthesis unit 763
, And performs switching / combining, and outputs the two video signals, that is, MPEG
Can be connected at any point other than the GOP break point.

A method of synchronizing and synthesizing two screens at arbitrary points based on the instruction signal will be described later with reference to FIG.

In the simple switching mode, in which two images are simply switched in frame units at the editing point, the stream a and the stream b are switched at the editing point tc and output seamlessly. Also, in a combination switching mode in which two images are combined while being combined on one screen like a wipe, the stream a and the stream b are switched while being combined from the start point ts to the end point te. As shown in FIGS. 6 and 58, in mode 1, the wipe is performed from left to right, in mode 2, the image is switched from the center to the periphery, in mode 3, the image is switched from top to bottom, and in mode 4, the image is switched in a mosaic pattern. FIG. 6 shows a simplified block diagram, and FIG. 58 shows a detailed block diagram.

In this case, the reproducing means 778, the separating section 734, the VTS synchronizing section 780, the MPEG decoder 72 shown in FIG.
8 and 730 have exactly the same configuration as the configuration of the 480P playback device in FIG. As shown in FIG. 6, when the identification information processing unit 766 detects the reproduction control information 766a, the two video streams are switched and combined as described above.
63, and switches from the first stream to the second stream at the connection point ts without any seam.

As shown in the detailed block diagram of FIG. 58, as described in the first embodiment, the hierarchical recording identifier 7 in which a high-resolution signal such as 720P / 480P is recorded.
When 25 is detected, the combining unit 732a performs a calculation and outputs a 480P or 720P high-resolution video signal.

When the stereoscopic recording identifier 766c is detected, the stereoscopic signal processing section 770 generates and outputs a stereoscopic video signal in which left-eye video and right-eye video are alternately interleaved.

Thus, as shown in FIG. 58, two M
In the MSS method using a PEG decoder or an MPEG decoder capable of decoding two streams at the same time, three functions of frame editing reproduction control, high-resolution signal reproduction, and stereoscopic video signal reproduction can be shared.

FIG. 11 shows a specific example of the reproduction control information 765. The reproduction control information 765 includes, in order of switching addresses,
Switching point S, 766, combination mode 767, first stream switching start address ts768, first stream switching end address te2, 769, second stream GOP start address tsG, 790, switching start address ts2, 7
71, switching end addresses te2 and 772 are recorded.

More specifically, when the switching point number S = 1, as shown in FIG.
There is no 7. In other words, since it is 0, the switching start address ts1
It is sufficient to simply switch from the first stream to the second stream at −1. In the case of S = 2, as shown in (10) of FIG. 12, switching is started at ts1, two images of the first stream and the second stream are combined on one screen until te1, and t = te1. Completely switch the second stream.

A reproduction procedure based on the reproduction control information will be described with reference to the flowchart of FIG.

As shown in FIG. 12A, the GOP 781 of the first stream is not rewritten and moved.
a and the GOP 781b of the second stream may be recorded at distant positions on the optical disc. In this case, rewriting time can be saved. As shown in FIG.
It can be edited and recorded on a D-RAM disk etc.
The GOP 781e and the GOP 781f containing the frame of the stream edit point are recorded adjacently in P units.
In this case, it is possible to change the editing point later in the GOP. Further, when the two streams are image-combined like a wipe, the video of the first stream after the edit point is required, and thus the configuration of FIG. 12C is required.

When S = 0, that is, when the two images are not combined, the data after the switching point ts1 of the GOP 781c is unnecessary, and the redundant portion is eliminated by deleting the data as in the GOP 781c of FIG. The recording efficiency increases. However, the GOP 781d, which is the IN point, cannot be deleted because the i (intra) frame, that is, the basic frame is included in the head portion, and therefore a redundant portion 783 occurs.

As shown in step 792a of FIG. 59,
There are about 15 actual frames in one GOP. When the B frame existing before the IN point is deleted as in step 792b, as shown in step 792c, the B frame is deleted and the redundant unit 783f is replaced by the 12 in step 792a.
In step 792c, the frame is set to 3 of the redundant portion 783g.
In this case, the number of frames is reduced to about 1/4, and the recording efficiency is increased.

When this part is reproduced, step 792
In step f, the B frame deletion identifier is detected, and the number of frames is calculated assuming that no B frame has been recorded. In step 792g, since MPEG decoding can be performed only with I and P frames, the frames are decoded one after another, and t = ts2
Is decoded and output. In this case, since processing for three frames is sufficient, the target IN point can be reproduced in 1/4 time as described above. In this example, the length of the redundant part is 1/8 second. From FIG. 59, the worst case is a case where ts2 is present in the 14th frame.
There are five frames of P, P, P, and B. That is, 1/3 × 1
/ 2 = 1/6 seconds. About 0.18 seconds is the longest redundant part. Only this time is necessary for reproducing the IN point. Even if the cut portion exists about 5 times per second, the interval is 0.2 seconds.
Therefore, by deleting the B frame, even if the cut portion continues five times a second, the frame can be reproduced in frame units by this method. This means that it can be used in normal editing without any problems.

A method for generating the reproduction control information will be described. OUT
The last GOP at the point is the first GOP, the first GOP at the IN point
Is defined as the second GOP, the playback control can be easily performed by recording the start time of the second GOP and the time of the switching point as the switching position information of the switching position ts2. As another method, the number of frames from the head of the second GOP to the switching point may be recorded.

When the reproduction control information is reproduced by the reproduction apparatus, as shown in step 792f in FIG.
Among I, B, B, B, P, B, B, B, P, B, B, and B, the frame at the switching point is decoded without processing the B frame (picture). That is, only I, P, and P are decoded. Then, the image at the IN point can be decoded in 1/4 time as described above. In this case, even when five frame switching points are continuous in one second, since the redundant time is 0.18 seconds, all the switching points can be seamlessly reproduced because the redundant time can be followed.

In this case, in order to synchronize, from the start time of the second GOP and the time of the switching point, it is calculated which frame (picture) is located in the second GOP as reproduction control information. Unnecessary frame B
If the frame has been deleted, the unnecessary frame deletion identifier is checked and corrected accordingly. Then, IN point, OUT
If the second GOP is played several frames earlier than the point,
It can be seen whether the OUT point of the OP and the IN point of the second GOP are synchronized.

In the case where the number of frames from the beginning of the second GOP at which the switching point is located is recorded as the reproduction control information, the decoding of the second GOP can be started by correcting unnecessary frames such as the B frame. You know if they are synchronized.

As the reproduction control information, if the decoding of the second GOP is started at a specific position of the first GOP,
, And the decoding start timing information such that the switching point of the second GOP coincides with the switching point of the second GOP.

In this case, the switching point can be synchronized with the reproducing apparatus without any special calculation using only the reproduction control information.

Further, one I frame and a plurality of P frames and B frames are recorded in the redundant section 783. These frames are decoded and decoded one frame before the frame at the last edit point. , And by creating an intra frame, the recording efficiency can be further increased. In the case of a DVD-RAM, all playback control information 7
65, the limited reproduction control information 765a of only the switching point is
As shown in (1), (2) and (3), by recording the data at two points immediately before the head of the recording data and the editing point, the entire editing configuration can be known in advance as toc. Also, before the edit point, of the entire playback control information,
By recording each individual editing point, for example, the limited reproduction control information 765a of only S = 1, there is an effect that reproduction control at the time of special reproduction is stabilized.

Here, the procedure of the reproduction control will be described. First, in step 774a, the reproduction control information is read. Step 7
At 74b, the reproduction switching point number S is set to 0, and step 7
At 74c, S is incremented by one. Since it is required to specify the decoding start position of the second stream, step 774
d is the system clock or VP of the first stream
If TS is t and ta is decoding start position information,
Check if t = ta. At the time when t = ta, that is, as shown in (5) of FIG. 12, when the VPTS of the second stream reaches ta, step 774e is performed.
Then, as shown in (6) of FIG. 12, MPEG decoding of the GOP of the second stream is started. Step 77
It is checked whether t = ts1 at 4f. FIG.
As shown in (5) and (6), (ts1-ta) = (ts
After a lapse of the value of (2-tsG), the switching point ts2 is reached. As shown in the above equations and FIGS. 12 (5) and (6), the data of the first stream ts1 and the data of the second stream ts2 are MPEG-decoded at the same time and output from the decoder. FIGS. 12 (8) and (9) show a state in which the two streams are synchronized. A specific method of synchronization will be described in detail in Embodiments 3 to 9. Note that ts1 and t
It can be seen from the reproduction control information that s2 is the frame editing point of the two images. In step 774G, it is confirmed whether or not there is an image combining identifier 767.
4h, and t = ts1 as shown in (10) of FIG.
At the position, the switching stream is switched from the first stream to the second stream by the switching synthesis unit 763 (FIG. 6). Actually t =
Since ts1 is the OUT point, the frame of the first stream at t = ts1 is not output. Since t = ts2 is the IN point, the frame of the second stream is output. t = t
Since the frame information of the first stream is unnecessary at the time of s2, recording can be omitted when S = 0, that is, when no image combining is performed. In this case, the recording efficiency is improved by one P frame. Thus, the reproduction control of the switching point of the S = 1st simple switching mode is completed, and the process returns to step 774c to proceed to the next switching point of S = 2.

In this case, n = 0 in step 774P.
If so, convert to n = 1. In other words, the second stream is
When decoded by the PEG decoder 730, the second stream, that is, the next MPEG signal to be switched is set to the first M
The data is decoded by the PEG decoder 728. S = 1 and MP
The EG decoder is different.

As shown in FIG. 56, this is the input second stream 781a, 781b, 781g, 78
1h and 781i are alternately distributed to the first MPEG decoder 728 and the second MPEG decoder 730 by the separation unit 734, and the decoded images 788a and 788b are decoded.
In step 3, a single stream is combined. As is clear from the figure, the output of the first MPEG decoder 728 is the decoded video 788.
After outputting a, the operation is stopped. The image freezes. This is because normal decoding cannot be performed if the data is discontinuous. The register 790 is reset and the MPEG decoding is restarted. The same applies to the second MPEG decoder. In order to perform a seamless connection using one MPEG decoder as in the related art, it was necessary to perform various complicated pre-processing in recording, but in the present invention, no complicated processing is performed during recording. Therefore, when playing back MPEG data that cannot be connected seamlessly, one (first)
Even if the MPEG decoder stops, the other (second) M
Switching to the PEG decoder and the restart processing of the (first) MPEG decoder that has been stopped during this time are performed, so that seamless playback output can be performed permanently by the two MPEG decoders. By using the present invention, substantially the same function can be realized by the playback control of the MPEG frame editing which conventionally required complicated processing. In particular, since there is no process for decoding and re-encoding the MPEG data, a great effect that the image does not deteriorate at all can be obtained.

In summary, a plurality of streams are separated and alternately decoded by two MPEG decoders. At a switching point, the decoded output of one first MPEG decoder is switched to the decoded output of the other second MPEG decoder and output. During this time, the original first MPEG decoder is reconfigured,
The decoding of the next stream is resumed, and the second MPE is
The output of the G decoder is switched to the output of the first MPEG decoder.

In this way, continuous seamless connection is realized in frame units.

(Composition Switching Mode) Returning to step 774G in FIG. 13, the image composition identifier 767 is other than 0, that is, two streams are combined into one screen like a wipe shown in the composite signal output unit 764 in FIG. The procedure for switching will be described. Proceeding to step 774i, (1) in FIG.
As shown in 1), switching is performed from the first stream to the second stream while synthesizing from t = ts1, switching is performed in step 774j until t = te1 or t = te2 is reached, and the process is completed in step 774k. At the same time, the decoding of the first stream is stopped at t = ts1, so that decoding of useless data is prevented. This combination mode corresponds to the case where the image combination identifier 767 is 1, 2, 3, or 4, and the combination screens 782a, 782b, 782c, and 782c in FIG.
Switching is performed such as right / left switching, center / surrounding switching, up / down switching, and mosaic switching as in 782d.

Although FIG. 12 shows an example in which the original time stamp is not changed, the switching point of the first stream and the second
DVD-RAM by matching the time of stream switching point
In the case of recording by using such as, the time stamp can be changed, so that the configuration becomes simpler. When recording as ts1 = ts2, it may be rewritten. In this case, the first stream may be recorded up to te1. The second stream is ts
G is replaced with ts1- (ts2-tsG). In this case, a time stamp younger than ts1 is attached. Since ta is the same as tsG, in the case of reproduction in FIG. 12 (6), the reproduction control information 765b shown in FIG. 14 connects tsG, that is, the start address 770a of the GOP of the second stream, and starts decoding in tsG. I just need.

In the case of replacing the time stamp,
The order of the time stamps of GOP761e and GOP781f in (3) of FIG. 12 changes and overlaps. Therefore, when reproduction is performed, a malfunction occurs on the reproduction device side. In the present invention, as shown in FIG. 14, since the GOP start address 770a of the second stream is recorded in the reproduction control information 765b, the abnormal part of this time stamp can be known in advance, so that there is no malfunction during fast-forward reproduction. It has the following effects: Naturally, the switching of the edit point to the second stream is more reliably performed using the GOP start address 770a.

In the case of reproduction in FIG. 12 (6), it is sufficient to pre-read tsG, that is, the start address 770a of the second stream from the reproduction control information 765b shown in FIG. 14, and start decoding with tsG.

Alternatively, even with the information of the edit point ts1, if the head address tsG of the GOP at the edit point is read ahead and the data of the GOP 781f of the second stream is MPEG-decoded at t = tsG,
The edit point of the first stream and the second stream is ts
1 has the effect of automatically matching.

As described above, by changing the time stamp and recording, the configuration and operation are greatly simplified.

The procedure of the second recording method is shown in FIG.
This will be described with reference to FIGS.

The editing / reproduction control information generation program will be described with reference to FIGS. As shown in FIG. 6, the editing information 780 including the IN and OUT points of the editing cut is input manually or by data, and the reproduction control information generation unit 7
89, is sequentially converted into reproduction control information 765, and is temporarily stored in the memory 779. After all editing work is completed, or immediately before the disc is ejected, the recording means 777 is recorded from the memory 779 to the disc 724 of the RAM. Recorded by

The procedure in the reproduction control information generator 789 will be described in detail with reference to the flowchart of FIG.

First, at step 785a, the editing information 780
Are sequentially input manually or as data. S indicates the number of the edit point, G indicates modes 1 to 4 in which two screens are switched while synthesizing by wipe or the like, ts0 the start point of the first stream ts2OUT, the synthesis end point of the start point te1OUT point, and ts2 indicates the synthesis end point of the second stream The IN point, te2 is the IN point synthesis completion point of the second stream, and tL2 is the OUT point of the second stream.

First, at step 785b, S = 0 is set,
S is incremented by 1 (step 785c), ts0 and ts1 are read (step 785d), and G is set at step 785e.
Is checked, and if not, there is no need to perform image composition, and in step 785f, the first (S) stream is set to ts
Data is recorded on the optical disk 724 from 0 to ts1. Second
(S + 1) The IN point ts2 of the stream is read (step 785g), the time stamp conversion processing routine is entered in step 785g, and the first time stamp tsG of the first GOP including the frame of ts2 of the second stream.
And the time stamp ts2 of the last frame of the first GOP
Get. Ts of all recording data of the second stream
From G to tL2, the time stamp is (ts2-ts
A new time stamp is generated by subtracting 1). In step 785i, the new time stamp is used to
After replacing only the new time stamp information with the new time stamp from the stream original address tsG to tL2 (tf2), the new time stamp information is overwritten on the frame information next to the frame of ts1, which is the connection point of the first stream.

At this time, in step 785w, using the address tsG of the first GOP of the second stream, ta = ts
1- (ts2-tsG) is calculated to determine the second stream preceding decode time ta, and the limited playback control information 76
5a and the playback control information 765. Step 785
The limited playback control information 765a, which is playback control information of only the S number in j, is added to the latter half of the first (S) stream in FIG.
Record as shown in (2). If S is completed in step 785j, the process proceeds to step 785m. If not completed, the process returns to step 785c and the same steps are repeated. In step 785m, the reproduction control information 765 of all edit points stored in the memory 779 is recorded in the reproduction control information recording section of the area of the optical disc where the management information such as TOC is recorded as shown in (3) of FIG. And exit.

Here, the process largely returns to step 785e.
If there is a combining identifier G, at step 785n, te1, which is the OUT point combining completion point of the first stream, is read. At step 785p, tG = te1-ts1 is calculated. If tG <tGmax at step 785q, the following is performed. Proceeding to step 785r, if tG is greater than tGmax, the two-stream synthesis duration is too long,
Step 7 because the buffer capacity of the playback device is exceeded.
At 85v, an error message "Change te1 to a smaller value" is issued, and when te1 is changed at step 785w, the process returns to step 785n to set te1 to be equal to or less than the allowable value.

Now, since the combination of the connection points is within the allowable value, the flow returns to step 785r to record the first stream from tsG to te1 on the optical disk. In step 785s, ts2 of the second stream is read, and in step 785t, the time stamp is converted using the time stamp conversion processing routine in the same manner as in step 785g. In step 785u, the second stream is overwritten and recorded on the frame data next to the te1 frame of the first stream from the original address tsG to tf2 (tL2) while replacing the time stamp with the new time stamp. Then, ta is recorded in the memory, and limited playback control information 765a is recorded in step 785j, and it is checked whether S is completed (step 785).
k) At step 785m, the entire reproduction control information 765 is recorded on the optical disk, and all operations are completed.

In this manner, the first stream is recorded up to the connection point, and a time stamp younger than the connection point is attached after the connection point so that the time stamp at the connection point of the second stream matches. By overwriting,
By playing back the optical disc while synchronizing it with the playback apparatus, an effect of outputting a video signal connected in frame units is obtained.

In this case, two MPEG decoders are required. However, as shown in FIG. 6, the recording / reproducing apparatus has an MPEG encoder 791 for encoding a video input signal into an MPEG signal. Since the MPEG encoder and the MPEG decoder are not used at the same time, and the MPEG encoder has a processing capability more than twice that of the MPEG decoder, one MPEG processing unit has one encoder or two decoder functions.

Therefore, when the present invention is applied to a recording / reproducing apparatus with an MPEG encoder, since it originally has the capability of two decoders, the frame editing effect of the present invention can be obtained without adding a configuration.

In the case of performing soft encoding / decoding using a CPU, the CPU time for encoding is required to be at least twice as long as that of the decoding process.
U can decode two streams. Therefore, FIG.
As described in, by encoding one stream by software and simultaneously or time-sharing two streams by software, without increasing the processing capability of the CPU,
The virtual frame editing of the present invention becomes possible.

Referring to the flowchart of FIG.
The procedure of encoding / decoding and recording / reproducing will be described with reference to FIG. First, in the encode recording step 792a, m
= 1 to the last data are input, and steps 792 c and 7
At 92d, the m-th video signal is input, and the m-th video signal is encoded to create an m-th stream (step 7).
92e), and record on the optical disk (step 792)
f). If m is not the last in step 792g, the process returns to step 792c, and if m is the last, the recording is terminated (792h). At this time, in the editing / reproduction control information recording step 792i, editing is performed in frame units, and the reproduction control information of the present invention and the various identifiers described above are recorded on the optical disk (FIGS. 6, 58).

At the time of next reproduction, the reproduction control program 7
92j is started and the cut point S is reproduced from 1 to the last (steps 774b, 774c). Step 774
As shown in FIGS. m and 774e, at the point where the frame is edited, the two streams are simultaneously or time-divided.
PEG decoding is performed, and at step 774h, the output is switched from one decoded stream to the other decoded stream at t = ts. In step 774r, s
This is repeated until is the last.

[0209] This CPU uses one stream of MPEG.
There is a processing ability to encode. That means,
3 means that the MPEG stream can be decoded. Therefore, one stream is MPEG-encoded by the same CPU, frame editing is performed, and two streams are MPEG-decoded, and at the frame editing point,
An effect that seamless reproduction and output can be obtained is obtained. According to the present invention, there is an effect that surplus CPU power at the time of MPEG decoding can be effectively used.

(Embodiment 3) In the MADM system of the present invention, a plurality of streams can be reproduced simultaneously, and the synchronization system is important.

The 480P and 720P described in Embodiment 1
In the recording / playback of a high-resolution video such as that described above and the playback control method of virtual frame editing described in the second embodiment, the basic A
Although the V synchronization method has been described, various synchronization methods will be described in more detail in the third to ninth embodiments.

First, in the third embodiment of the present invention, data is read from an optical disk on which three compressed video signals to be reproduced at the same time are recorded, and the AV synchronous system of a reproducing apparatus for simultaneously decompressing and reproducing three videos. The operation will be described.

First, FIG. 37 shows a data structure on an optical disk used in the optical disk reproducing apparatus according to the third embodiment.

The video signals A, B, and C, which are three video signals, are MPEG-compressed to obtain a compressed video stream A, a compressed video stream B, and a compressed video stream C.

Each of the compressed video streams A to C is packetized as a video packet every 2 KB. In the packet header of each packet, a stream ID for identifying whether the stored data is one of the compressed video streams A to C, and, if the beginning of a video frame is stored in the packet, the frame VPTS (V) as video playback time information indicating the time at which
video Presentation Time St
amp) is added. In the third embodiment, NTSC video is used as each video signal, and the video frame period is approximately 33 msec.

On the optical disk, the video packets created as described above are stored in the compressed video signal A-1 and the compressed video signal B-
1. Grouped like a compressed video signal C-1, and multiplexed and recorded.

FIG. 35 is a block diagram of an optical disk reproducing apparatus according to the third embodiment.

In FIG. 35, reference numeral 501 denotes the optical disk described above, 502 denotes an optical pickup for reading data from the optical disk 501, and 503 denotes the optical pickup 502
Signal processing means for performing a series of optical disk signal processing such as binarization, demodulation, and error correction on the signal read by
Reference numeral 504 denotes a buffer memory for temporarily storing data output from the signal processing unit 503, reference numeral 505 denotes a separating unit for separating data read from the buffer memory 504 into respective compressed video signals, and reference numeral 506 denotes a reference for generating a reference time signal. The time signal generating means is constituted by a counter (not shown) that counts a clock of 90 KHz.
Reference numerals 510, 520, and 530 denote buffer memories for temporarily storing the respective compressed video signals separated by the separation means 505, and reference numerals 511, 521, and 531 denote video decoders 512 and 52 for expanding and reproducing the respective compressed video signals.
Reference numerals 2 and 532 denote monitors for displaying respective video signals.

FIG. 36 shows video decoders 511, 521,
531 shows the configuration of FIG.

In FIG. 36, reference numeral 601 denotes a VP for detecting a VPTS stored in a packet header of a video packet.
TS detection means 602 converts the compressed video stream to MPEG
603 is a video decompression means for decompressing,
S is a video reproduction timing control means that compares S and skips or repeats video reproduction in frame units when the comparison result exceeds a threshold value.

The operation of the optical disk reproducing apparatus shown in FIG. 35 will be described below.

The optical pickup 502 is subjected to focus control and tracking control by servo means (not shown) to read signals from the optical disk 501 and
Output to 3. The signal processing unit 503 performs a series of optical disk signal processes such as a binarization process, a demodulation process, and an error correction process, and stores the digital data in the buffer memory 504.

The buffer memory 504 is used for the optical disk 501.
Even if the data read supply from is temporarily interrupted due to a rotation wait or the like, it functions so as not to interrupt the data supply to the subsequent stage.

The data read from the buffer memory 504 is separated by the separating means 505 into compressed video signals A to C and output respectively. The separating unit identifies which of the compressed video streams A to C is stored in each packet based on the stream ID of the packet header of the packetized data, and determines an output destination according to the identification result.

The separated video compression signals are stored in buffer memories 510 to 530, respectively.

Each of the buffer memories 510 to 530 functions to continuously supply data to the video decoders 511 to 531.

The video decoders 511 to 531 read data from the buffer memories 510 to 530, decompress the compressed video signal, and convert the
2 to 532.

Referring to FIG. 36, each of video decoders 511-511
The operation of 531 will be described.

The compressed video signal read from the buffer memory is input to the VPTS detection means 601 and the video decompression means 602.

[0230] The video decompression means 602 performs MPEG decompression processing on the compressed video stream and outputs a video signal.

The VPTS detecting means 601 detects and outputs the VPTS of the packet header.

In the video reproduction timing control means 603, the video signal output from the video decompression means 602, the reference time signal, and the VPTS output from the VPTS detection means 601.
, And compares the reference time signal with the VPTS. If the difference between the two exceeds a threshold value, the video playback timing is controlled so that the difference between the VPTS and the reference time signal is equal to or less than the threshold value.

In the third embodiment, 33 msec is used as a threshold value for video reproduction. In video reproduction timing control means 603, (reference time signal-VPTS)> 33 msec: 1
Frame skip (reference time signal -VPTS) <-33 msec: 1
It performs frame repeat.

In the third embodiment, reference time signal generating means 5
06 and the video decoder 511 and the video decoder 531 are slow in the progress of decompression reproduction with respect to the reference time signal due to the accuracy error of the crystal oscillator used in each of the video decoders 511 to 531. Since the progress of the decompression reproduction is fast, if the correction of the reproduction timing is not performed, the synchronization of the video signals reproduced respectively will be out of synchronization.

FIG. 38 is a timing chart of video reproduction according to the third embodiment. 38A shows a reference time signal with respect to the reproduction time t. Similarly, FIG. 38B shows VPTS # A which is the VPTS of the compressed video signal A expanded by the video decoder 511, and FIG. (D) VPTS # C, which is the VPTS of the video compression signal C which is expanded by the video decoder 531;
Each is shown.

The video decoder 511 continues the expansion / reproduction operation of the compressed video signal A, and when the reference time signal is at T1, V
The difference between PTS # A and the reference time signal is a threshold of 33 mse
Therefore, the video playback timing control means of the video decoder 511 skips one frame to be originally played back, and corrects the playback timing so that the difference between VPTS # A and the reference time signal is equal to or smaller than a threshold.

When the video decoder 521 continues the decompression operation of the compressed video signal B and the reference time signal is at T2, the difference between VPTS # B and the reference time signal is −3.
Since the time exceeds 3 msec, the video playback timing control means of the video decoder 521 repeats the frame being played back at that time to correct the playback timing so that the difference between VPTS # B and the reference time signal becomes equal to or less than the threshold value. I do.

Similarly, the video decoder 531 continues the expansion / reproduction operation of the compressed video signal C, and when the reference time signal is at T3, the difference between VPTS # C and the reference time signal is a threshold value 3
Since the time exceeds 3 msec, the video reproduction timing control means of the video decoder 531 corrects the reproduction timing so that the difference between VPTS # C and the reference time signal becomes equal to or smaller than a threshold value by skipping one frame to be originally reproduced.

As described above, in the third embodiment, when the difference between the reference time signal and the VPTS detected by each video decoder exceeds the threshold, the correction function of the video reproduction timing control means of each video decoder operates. Reference time signal and each VP
The difference in TS was kept so as not to exceed the threshold value, and the video reproduced by each video decoder could be synchronized.

(Embodiment 4) Embodiment 4 of the present invention
The present invention relates to a reproducing apparatus that corrects a reference time signal using audio reproduction time information indicating a time at which audio is to be reproduced, and synchronizes a plurality of video signals with the reference time signal.

FIG. 41 shows a data structure on an optical disk used in the optical disk reproducing apparatus according to the fourth embodiment. Compared to the optical disk used in the third embodiment, the optical disk includes compressed audio data.

An audio signal is converted into an audio frame in units of 32 msec and compressed to obtain a compressed audio stream.
It is packetized as audio packets for each KB and recorded on an optical disk. In the packet header of the audio packet, a stream ID indicating that the stored data is a compressed audio stream, and, if the beginning of the audio frame is stored in the packet, a time at which the audio frame should be reproduced. APTS (Audio Present) as audio reproduction time information
ation Time Stamp) is added.

FIG. 39 is a block diagram showing the structure of a reproducing apparatus according to the fourth embodiment.

FIGS. 501 to 532 have the same configuration as that of the optical disk reproducing apparatus shown in FIG. 35 of the third embodiment.

Reference numeral 540 is a buffer memory for temporarily storing the compressed audio signal, 541 is audio expansion means for expanding the compressed audio signal, and 542 is a speaker for reproducing the expanded audio signal.

FIG. 40 shows the structure of the audio decoder 541. Reference numeral 701 denotes APTS detecting means for detecting an APTS stored in the packet header of an audio packet, and 702 denotes audio expanding means for expanding a compressed audio stream.

The operation of the optical disk reproducing apparatus shown in FIG. 39 for reproducing the optical disk shown in FIG. 41 will be described below.

The operation up to the input to the separating means 505 is the same as that of the optical disk reproducing apparatus shown in the third embodiment.

The data read from the buffer memory 504 is separated by the separation means 505 into compressed video signals A to C and a compressed audio signal, and output. The separating unit 505 identifies whether each packet is a compressed video signal A to C or a compressed audio signal based on the stream ID of the packet header of the packetized data, and determines an output destination according to the identification result.

The separated compressed video signal and compressed audio signal are temporarily stored in buffer memories 510 to 540, respectively.

The video decoders 511 to 531 read data from the buffer memories 510 to 530, decompress the compressed video signal, and convert the
2 to 532. The audio decoder 54
Numeral 1 reads data from the buffer memory 540, decompresses the compressed audio signal, and outputs it to the speaker 542 as an audio signal.

The operation of the video decoders 511 to 531 to expand the compressed video signal and the operation of correcting the synchronization when the difference between the reference time signal and the VPTS exceeds the threshold value are the same as those in the third embodiment.

The compressed audio signal read from the buffer memory 540 is input to the audio decoder
The APTS is detected by the TS detection means 701 and output.
The audio expansion unit 702 performs an expansion process on the compressed audio stream and outputs an audio signal.

The APTS signal output from audio decoder 541 is input to reference time signal generation means 506, and the reference time signal is corrected by the APTS.

In the fourth embodiment, reference time signal generating means 5
06 and the precision error of the crystal oscillator used in each of the video decoders 511 to 531 and the audio decoder 541, the progress of the reference time signal is faster than the progress of the extension reproduction of the audio decoder 541, and the video decoder 511 Since the progress of decompression reproduction is slow and the decompression reproduction of the video decoder 521 progresses quickly with respect to the reference time signal, if the reproduction timing is not corrected, the synchronization between the video signals reproduced and the audio with each other is not performed. Will be shifted.

FIG. 42 shows video reproduction in the fourth embodiment.
3 shows a timing chart of audio reproduction. FIG. 42 (a)
Is a diagram showing the APTS with respect to the reproduction time t, and FIG. 4B is a diagram showing the reference time signal, and similarly, FIG.
Is the time VPTS # A at which the video decoder 511 should reproduce the compressed video signal A, and (d) is the time VP at which the video decoder 512 should reproduce the compressed video signal B.
TS # B is shown.

Although FIG. 42 does not show VPTS # C of the compressed video signal C expanded by the video decoder 531, the progress is almost the same as that of FIG. 38 of the third embodiment.

The reference time signal generation means 506 corrects the APTS at the time at which the APTS indicates ta1 and ta2, and converts the reference time signal to the time ta1 and t2 at each time.
It is reset to a2.

When the video decoder 511 continues the expansion / reproduction operation of the compressed video signal A and the reference time signal is T4,
The difference between PTS # A and the reference time signal is a threshold of 33 mse
Therefore, the video playback timing control means of the video decoder 511 skips one frame to be originally played back, and corrects the playback timing so that the difference between VPTS # A and the reference time signal is equal to or smaller than a threshold.

Similarly, the video decoder 521 continues the expansion / reproduction operation of the compressed video signal B, and the difference between VPTS # B and the reference time signal exceeds the threshold value of -33 msec at the time points T5 and T6. The video playback timing control means of the video decoder 521 repeats the playback of the frame being played back at each point in time, thereby correcting the playback timing so that the difference between VPTS # B and the reference time signal is equal to or less than a threshold.

As described above, in the fourth embodiment, when the difference between the reference time signal and the VPTS detected by each video decoder exceeds the threshold value, the correction function of the video reproduction timing control means of each video decoder operates. Reference time signal and each VP
The difference in TS is maintained so as not to exceed the threshold value, and the video signals reproduced by the respective video decoders can be synchronized with each other.

Also, regarding the difference between the reference time signal and the APTS, the APTS is not corrected using the reference time signal, but the reference time signal is corrected using the APTS. This makes it possible to synchronize the reproduction of the audio with the reproduction of each video without causing a sense of discomfort.

(Embodiment 5) Embodiment 5 of the present invention
The present invention relates to a reproducing apparatus that corrects a reference time signal using VPTS detected by one video decoder, and synchronizes a plurality of video signals with the reference time signal.

FIG. 43 is a block diagram of a playback apparatus according to the fifth embodiment.

FIGS. 501 to 532 have the same structure as that of the optical disk reproducing apparatus shown in the third embodiment.
Reference numeral 1 denotes a video decoder used in the fifth embodiment.

The video decoder 551 detects the VPTS
44. FIG. 44 shows the configuration of a video decoder 551.

Reference numeral 801 denotes a VPTS for detecting a VPTS indicating a reproduction time of a video signal multiplexed on a compressed video signal.
A detecting means 802 is a video decompression means for decompressing the compressed video signal.

In the fifth embodiment, reference time signal generating means 5
06 and the precision error of the crystal oscillator used in the video decoders 521, 531 and 551, the reference time signal progresses faster than the video decoder 551 performs the expansion reproduction, and the video decoder 521 performs the expansion reproduction with respect to the reference time signal. Since the progress is slow and the video decoder 531 progresses the decompression reproduction with respect to the reference time signal, if the synchronization is not corrected, the synchronization of the video signals reproduced respectively will be out of synchronization.

FIG. 45 is a timing chart of video output in the fifth embodiment. FIG. 45A shows VPTS # detected by the video decoder 551 with respect to the reproduction time t.
A is a diagram showing a reference time signal. Similarly, (c) is a diagram showing a time VPTS # B at which the video decoder 521 should reproduce the compressed video signal B which is expanded.
(D) shows a time VPTS # C at which the compressed video signal C expanded by the video decoder 531 should be reproduced.

The reference time signal generating means 506 operates as VPTS #
A is corrected using VPTS # A at times indicating tv1 and tv2, and the reference time signal is changed to tv1 at each time.
And tv2.

When the video decoder 521 continues the expansion / reproduction operation of the compressed video signal B and the reference time signal is at T7,
The difference between PTS # B and the reference time signal is a threshold of 33 mse
Since c exceeds c, the video playback timing control means of the video decoder 521 skips one frame to be originally played back, and corrects the playback timing so that the difference between VPTS # B and the reference time signal is equal to or less than a threshold value.

Similarly, the video decoder 531 continues the expansion / reproduction operation of the compressed video signal C, and the difference between VPTS # C and the reference time signal exceeds the threshold value of -33 msec at the time points T8 and T9. The video playback timing control means of the video decoder 531 repeats playback of the frame being played back at each point in time, thereby correcting the playback timing so that the difference between VPTS # C and the reference time signal is equal to or less than a threshold.

As described above, in the fifth embodiment, the reference time signal and the VPT detected by video decoders 521 and 531 are detected.
When the difference of S exceeds the threshold value, the correction function of the video reproduction timing control means of each video decoder operates, and the difference between the reference time signal and each VPTS does not exceed the threshold value.

In addition, V detected by video decoder 551
By correcting the reference time signal using the PTS # A, the video signal reproduced by the video decoder 551 does not have a visual discomfort due to skipping or repeat reproduction in frame units, and the reproduction of each video is synchronized. It became possible to make it.

(Embodiment 6) Embodiment 6 of the present invention
Is provided with a plurality of video decoders for expanding and reproducing the compressed video signal, and each video decoder is provided with a reference time signal generating means. And a playback device that synchronizes by correcting the following.

In the sixth embodiment, the optical disk shown by the data structure in FIG. 41 was used.

FIG. 46 is a block diagram showing the configuration of the optical disk reproducing apparatus according to the sixth embodiment.

Numerals 501 to 542 have the same configuration as the optical disk reproducing apparatus shown in FIG.
As compared with the optical disk reproducing apparatus shown in FIG. 7, the reference time signal generating means 506 is not provided independently, but is provided in each of the video decoders 561 to 581.

Reference numeral 561 denotes a video decoder for expanding and reproducing the compressed video signal A, 571 a video decoder for expanding and reproducing the compressed video signal B, and 581 a video decoder for expanding and reproducing the compressed video signal C.

Video decoder 56 used in Embodiment 6
FIG. 47 shows the configuration of 1 to 581.

Reference numeral 901 denotes a VPTS for detecting a VPTS indicating a reproduction time of a video signal multiplexed on a compressed video signal.
Detector 902 is a video expander that expands the compressed video signal. 903 is a video playback timing that compares the reference time signal with the VPTS and skips or repeats video playback in frame units when the comparison result exceeds a threshold. Control means 904 is a reference time signal generation means for generating a reference time signal.

In the sixth embodiment, the audio decoder 54
1 using the APTS detected by the video decoder 561.
The reference time signal of the reference time signal generation means 904 included in the reference time signal 581 is corrected.

Since correction is performed using the same APTS, the reference time signals generated by video decoders 561 to 581 show the same value after correction.

After the correction by the APTS, similarly to the fourth embodiment, the reference time signal of each video decoder and the VPT
When the difference of S exceeds the threshold value, the video playback timing control means of each video decoder performs skip or repeat playback in frame units, and corrects the playback timing so that the difference becomes equal to or less than the threshold value.

As described above, in the sixth embodiment, the reference time signal generated inside each video decoder is corrected by the APTS, and the video reproduction timing control means of each video decoder controls each reference time signal and each VPTS. The difference is kept so as not to exceed the threshold value, and the video signals reproduced by the respective video decoders can be synchronized with each other.

As in the case of the fourth embodiment, it is possible to synchronize the reproduction of the sound with the reproduction of each video without causing any auditory trouble in the reproduction of the sound.

[0287] In the sixth embodiment, the video decoder 5 uses the APTS detected by the audio decoder 541.
Although the reference time signals 61 to 581 were corrected, the one shown in FIG. 44 of the fifth embodiment is used as one video decoder, and the reference time signal of another video decoder is converted using the VPTS detected by the video decoder. By making the correction, it becomes possible to synchronize the reproduction of each video similarly.

(Embodiment 7) Embodiment 7 of the present invention
Is a signal that simultaneously reproduces two compressed video signals. The two compressed video signals are signals obtained by compressing a stereoscopic video signal obtained by separating a stereoscopic video signal into a right-eye video signal and a left-eye video signal.

The structure of the entire apparatus is almost the same as the structure of the optical disk reproducing apparatus shown in FIG.
Since two video signals are reproduced at the same time, two video decoders are provided to decompress the compressed video signal at the subsequent stage of the separating means 505. FIG. 48 shows the configuration of one video decoder used in Embodiment 7, and FIG. 49 shows the configuration of the other video decoder.

FIG. 48 shows one of the video decoders.
Reference numeral 1 denotes VPTS detecting means for detecting a VPTS indicating a reproduction time of a video signal multiplexed on a compressed video signal;
2 is a video decompression means for decompressing the input MPEG-compressed video signal, 1004 is a reference time signal generation means for generating a reference time signal, 1003 is a reference time signal and VPTS
And a video reproduction timing control means for skipping or repeating video reproduction in frame units when the comparison result exceeds the threshold value, and outputting a horizontal synchronization signal and a vertical synchronization signal of the video to be reproduced.

FIG. 49 shows the other video decoder 110
Reference numeral 1 denotes VPTS detecting means for detecting a VPTS indicating a reproduction time of a video signal multiplexed on a compressed video signal, 110
Reference numeral 2 denotes a video decompression means for decompressing the input MPEG-compressed video signal, 1104 denotes a reference time signal generation means for generating a reference time signal, 1103 denotes a reference time signal and VPTS
When the comparison result exceeds the threshold value, the video reproduction is skipped or repeated in units of frames, and a horizontal synchronization signal and a vertical synchronization signal of the video signal are inputted, and the video signal is synchronized with the horizontal / vertical synchronization signal. And video output timing control means for reproducing the expanded video.

Each of the video decoders is shown in FIG.
The horizontal synchronizing signal and the vertical synchronizing signal output from the video decoder 8 are connected and used as the input of the horizontal synchronizing signal and the vertical synchronizing signal of the video decoder in FIG.

In the optical disk reproducing apparatus according to the seventh embodiment configured as described above, like the sixth embodiment, the right-eye
The reference time signal generated inside each video decoder for the left eye is corrected by the APTS, and the difference between each reference time signal and each VPTS does not exceed the threshold value by the video reproduction timing control means of each video decoder. For right eye,
It is now possible to synchronize the left-eye video in frame units. Further, by using the horizontal synchronization signal and the vertical synchronization signal generated by one of the video decoders as the other horizontal synchronization signal and the vertical synchronization signal, the two images can be reproduced synchronously in pixel units. Was.

In the seventh embodiment, the compressed video signals obtained by compressing the video signals obtained by separating the stereoscopic video for the right eye and the left eye are used as the compressed video signals to be reproduced simultaneously. Separating the original video signal into at least two video signals including a first video signal and a second video signal having a second resolution lower than the first resolution obtained by separating the video signal in the vertical or horizontal direction, By converting each of them into a compressed video signal, it becomes possible to obtain a plurality of video signals synchronized in pixel units as in the case of a stereoscopic video, and by combining them, a clear image of the first resolution is obtained. It is possible to reproduce an original video signal.

(Eighth Embodiment) An eighth embodiment relates to an optical disk reproducing apparatus which expands one compressed video signal and two compressed audio signals respectively and reproduces them simultaneously.

FIG. 52 shows the data structure on the optical disk used in the eighth embodiment.

[0297] The audio signal D and the audio signal E, which are two audio signals, are compressed, and the compressed audio stream D and the compressed audio stream E are compressed, and the video signal is compressed to obtain a compressed video stream.

Each of the compressed video streams D and E and the compressed video stream is an audio packet for every 2 KB,
Packetized as video packets. In the packet header of each packet, a stream ID for identifying whether the stored data is the compressed audio stream D or E or the compressed video stream, and the AP described above.
TS and VPTS are recorded.

FIG. 50 shows the structure of the optical disk reproducing apparatus according to the eighth embodiment.

The configuration is almost the same as that of the fourth embodiment shown in FIG. 39. The audio decoder 541 uses the one shown in FIG. 40 and the video decoder 531 uses the one shown in FIG. Uses the one shown in FIG.

Reference numeral 590 is a buffer memory for temporarily storing the compressed audio signal, similarly to 540, and 592 is a speaker for reproducing the audio signal.

FIG. 51 shows the structure of the audio decoder 591.

Reference numeral 1201 denotes an APT for detecting an APTS indicating a reproduction time of an audio signal multiplexed on a compressed audio signal.
S detection means 1202 is an audio expansion means for expanding the input compressed audio signal, and 1203 is a reference time signal and APTS
And audio reproduction timing control means for skipping or pausing audio reproduction in audio frame units when the comparison result exceeds a threshold value.

Next, a reproducing operation according to the eighth embodiment will be described.

The operation until the signal read from the optical disk 501 is input to the separation means 505 is the same as in the other embodiments.

The data read from the buffer memory 504 is separated by the separating means 505 into a compressed video signal, a compressed audio signal D, and a compressed audio signal E, which are output. The separating unit 505 identifies whether each packet is a compressed video signal or a compressed audio signal D or E based on the stream ID of the packet header of the packetized data, and determines an output destination according to the identification result.

The separated compressed video signal is stored in the buffer memory 530, the compressed audio signal D is stored in the buffer memory 540,
The compressed audio signal E is temporarily stored in the buffer memory 590.

The video decoder operates as a buffer memory 530.
, And decompresses the compressed video signal and outputs it to the monitor 532 as a video signal. The audio decoders 541 and 591 are respectively provided in the buffer memories 541 and 591.
Data is read from 0 and 590, the compressed audio signal is expanded, and output to the speakers 542 and 592 as an audio signal.

The reference time signal generated by the reference time signal generation means 506 is corrected by APTS # D detected by the audio decoder 541.

[0310] In the audio decoder 591, the APTS
The detecting means 1201 detects APTS # E, and the audio expanding means 1202 expands the compressed audio signal E. The audio reproduction timing control means 1203 outputs the expanded audio signal output from the audio expansion means 1202 and the reference time signal, AP
The APTS # E output from the TS detection means 1201 is input, the reference time signal is compared with the APTS # E, and when the difference between the two exceeds the threshold, the difference between the APTS # E and the reference time signal is determined to be equal to or smaller than the threshold. The audio playback timing is controlled so that

In the eighth embodiment, 32 msec is used as the threshold value of the audio reproduction. The audio reproduction timing control means 1203 sets (reference time signal-APTS # E)> 32 msec
: 1 audio frame skip, (reference time signal -APTS # E) <-32 mse
c: 1 audio frame repeat.

The operation of the video decoder 531 for expanding the compressed video signal and the operation of correcting the synchronization when the difference between the reference time signal and the VPTS exceeds the threshold value are the same as those in the third embodiment.

In the eighth embodiment, reference time signal generating means 5
06, video decoder 531 and audio decoder 54
Due to the accuracy error of the crystal oscillator used in 1, 591, the progress of decompression reproduction of the audio decoders 541, 591 is slow with respect to the reference time signal, and the decompression reproduction of the video decoder 531 is rapid with respect to the reference time signal. In the case where the reproduction timing is not corrected, the synchronization of the video signals reproduced in each case is shifted.

FIG. 53 shows video reproduction according to the eighth embodiment.
3 shows a timing chart of audio reproduction. FIG. 53 (a)
Is a diagram showing APTS # D with respect to playback time t,
FIG. 13B shows a reference time signal. Similarly, FIG. 13C shows a time APTS # E at which the compressed audio signal E to be expanded by the audio decoder 591 is to be reproduced, and FIG. The time VPTS at which the expanding video signal should be reproduced is shown. The reference time signal generation means 506 outputs the APT at the time when APTS # D indicates ta3 and ta4.
The correction is performed using S # D, and the reference time signal is reset to ta3 and ta4 at each time.

The audio decoder 591 continues the expansion operation of the compressed audio signal E, and when the reference time signal is T10,
Since the difference between APTS # E and the reference time signal exceeds 32 msec, which is the threshold value for audio reproduction, the audio decoder 59
One audio reproduction timing control means 1203 corrects the reproduction timing such that the difference between APTS # E and the reference time signal becomes equal to or less than a threshold value by skipping one audio frame to be reproduced originally.

The reference time signals are T11 and T12.
Since the difference between the VPTS and the reference time signal exceeds the threshold value of the video reproduction of -33 msec at the time point of, the video reproduction timing control means of the video decoder 531 repeats the frame being reproduced at each time point. , And the reproduction timing is corrected so that the difference between the VPTS and the reference time signal is equal to or smaller than the threshold.

As described above, in the eighth embodiment, the reference time signal and the APTS # detected by the audio decoder 591
When the difference of E exceeds the threshold value for audio reproduction, the correction function of the audio reproduction timing control means operates, and the reference time signal and A
The difference of PTS # E is kept so as not to exceed the threshold value of audio reproduction. Similarly, the difference between the reference time signal and the VPTS is kept so as not to exceed the threshold value for video reproduction. In addition, APT
Since the reference time signal is corrected using S # D, it is possible to synchronize the reproduction of each audio with the reproduction of a video.

(Embodiment 9) In Embodiment 9, as the audio reproduction timing control, one that changes the clock for performing the expansion reproduction operation is used.

[0319] The ninth embodiment has the same device configuration and overall operation as those of the eighth embodiment. However, when the difference between the reference time signal and the APTS # E exceeds the threshold value for audio reproduction, the ninth embodiment performs the audio The operation of the reproduction timing control is different. The audio reproduction timing control used in the ninth embodiment will be described with reference to FIGS. 54 and 55.

FIG. 54 shows the operation when the difference between APTS # E and the reference time signal exceeds 32 msec, which is the threshold value for audio reproduction. FIG. 54A shows the reference time signal for the reproduction time t. FIG. 3B shows the APT.
S # E and (c) show the clock frequency at which the audio decoder 591 performs the decompression reproduction operation. The normal expansion / reproduction operation is performed at the sampling frequency fs of the audio signal.
384 times the clock f0. Since the difference between APTS # E and the reference time signal at the time point of the reference time signal T11 exceeds 32 msec which is the threshold value of the sound reproduction, the sound reproduction timing control means switches the clock of the decompression reproduction operation to f1. f1 is 10 times higher than the frequency of f0.
% Higher frequency clock. Performing the decompression playback operation at f1 is 10 times more than performing the decompression playback operation at f0.
% The decompression playback operation proceeds at a high speed. Further, the time for performing the extension reproduction operation at f1 is set to a section of 320 msec from the point in time when the difference between APTS # E and the reference time signal exceeds 32 msec which is the threshold value of audio reproduction. By this operation, AP
The reproduction timing is corrected so that the difference between TS # E and the reference time signal is equal to or less than the threshold value for audio reproduction.

FIG. 55 shows the operation when the difference between APTS # E and the reference time signal exceeds a threshold value of -32 msec for audio reproduction. FIG. 55A shows the operation of the reference time signal with respect to the reproduction time t. FIG. 3B shows the AP.
TS # E and (c) show the clock frequency at which the audio decoder 591 performs the decompression reproduction operation.

When the reference time signal is at T12, APTS #
The difference between E and the reference time signal is the threshold for audio reproduction -32 m
Since the time exceeds sec, the audio reproduction timing control means switches the clock of the expansion reproduction operation to f2. f2 is f0
Is a clock having a frequency 10% lower than the frequency of f2
When the decompressed reproduction operation is performed at, the decompressed reproduction operation proceeds at a speed 10% lower than when the decompressed reproduction operation is performed at f0. Further, the time for performing the decompression reproduction operation at f2 is determined by the difference between APTS # E and the reference time signal being −32 msec, which is the threshold value for audio reproduction.
The interval was set to 320 msec from the point of time exceeding c. By this operation, the reproduction timing is corrected so that the difference between the APTS # E and the reference time signal is equal to or less than the audio reproduction threshold value.

As described above, in Embodiment 9, APTS
When the difference between #E and the reference time signal exceeds the threshold value for audio reproduction, the clock for performing the decompression reproduction operation is changed, and the decompression reproduction operation is performed at a higher or lower speed than usual, thereby obtaining the reference time signal and the APTS # E. Is controlled so as to be equal to or less than the threshold value of the sound reproduction, and it is possible to synchronize the reproduction of each sound and the reproduction of the video without causing an auditory discomfort.

In the ninth embodiment, the clock for the expansion / reproduction operation is changed by 10% as compared with the normal operation. However, the timing can be controlled more naturally from the aural point of view by making the change width smaller or changing stepwise. Clearly, it is possible to do so.

In Embodiments 8 and 8, the reference time signal is corrected using APTS # D. However, the reference time signal is corrected using VPTS output from this video decoder by using the video decoder shown in FIG. The signal may be corrected.

The embodiments of the present invention have been described above.

Note that the reference time signal and the VPTS or APTS
Comparison and playback time control, and reference time signal
The correction using the TS or the APTS may be realized by, for example, a microcomputer that controls the entire playback device.

In each embodiment, an example of an optical disk reproducing apparatus has been described. However, a virtual frame according to the present invention is applied to a reproducing apparatus called a set-top box which is supplied with a compressed signal through a network or digital broadcasting and expands and reproduces the compressed signal. By applying the editing method, it is possible to seamlessly connect discontinuous images at the time of program switching, and the effect is high.

[0329]

According to the present invention, the basic video signal and the interpolated video signal are
By dividing into P or more frame groups, and interleaving them alternately and recording them on an optical disc as interleaved blocks, the playback device capable of synthesizing high resolution obtains progressive video by reproducing both information of the interleaved blocks. be able to. When a disc on which high-resolution video is recorded is played back by a non-progressive playback device, only one of the interleaved blocks in the odd field or the even field is track-jumped and played back, so that a complete two-dimensional normal video is reproduced. Can be obtained. Thus, there is an effect that mutual compatibility is realized.

In particular, a high-resolution video arrangement information file is provided, and a high-resolution video identifier is recorded on the optical disc. Therefore, since it is possible to easily determine where the high-resolution video exists, it is possible to prevent two normal interlaced signals from being progressively output and to prevent a failure in outputting two different content images by mistake.

[0331] When the two-stream simultaneous playback synchronization method of the present invention is used, the editing of an MPEG signal, which could only be edited in GOP units without image degradation, can be virtually edited in frame units. . By recording the reproduction control information, it can be connected and output in frame units during reproduction. Thus, there is an effect that virtual frame editing can be realized without image degradation.

In the two-stream simultaneous reproduction synchronous system, when a plurality of compressed video signals or a plurality of compressed audio signals to be reproduced at the same time are expanded and reproduced, they can be reproduced in synchronization with each other.

The AP detected by the audio decoder
A playback device that corrects a reference time signal using a TS and controls the video output timing so that the VPTS coincides with the reference time signal can perform synchronized playback of audio and a plurality of video outputs without causing a hearing problem. It becomes possible.

[0334] Further, in the reproducing apparatus that controls the timing of audio output by changing the expansion operation clock, synchronous reproduction is performed without generating noise due to skipping or pausing of audio and without causing a sense of auditory discomfort. It is possible to do.

[Brief description of the drawings]

FIG. 1 is a block diagram of a 720P / 480P hierarchical recording apparatus according to an embodiment of the present invention.

FIG. 2 shows 480i / 480P / according to an embodiment of the present invention.
Block diagram of 720P (60) playback device

FIG. 3 shows a 480P / 720P according to an embodiment of the present invention.
(24/60) Block diagram of playback device

FIG. 4 is a block diagram of a horizontal direction synthesizing reproduction apparatus (720P output) according to an embodiment of the present invention;

FIG. 5 is a block diagram of a three-layer optical disc recording apparatus according to an embodiment of the present invention.

FIG. 6 is a block diagram of a recording / reproducing apparatus using a frame-based reproduction control method according to an embodiment of the present invention;

FIG. 7 is a diagram illustrating a stream recording procedure of a recording apparatus using a reproduction control information recording method according to an embodiment of the present invention.

FIG. 8 is a comparison diagram of a case where the optical disc of one embodiment of the present invention is reproduced by an existing reproducing apparatus and a case where the optical disc is reproduced by the reproducing apparatus of the present invention;

FIG. 9 is a diagram showing the relationship between the recording time and the capacity of the optical disc according to the embodiment of the present invention;

FIG. 10 illustrates a fourth example of the hierarchical playback device according to the embodiment of the present invention.
Block diagram of 80P playback mode

FIG. 11 is a diagram showing a data structure of reproduction control information according to one embodiment of the present invention;

FIG. 12 is a diagram showing a recording procedure of a plurality of streams of the recording apparatus according to the embodiment of the present invention and a reproducing procedure of the reproducing apparatus.

FIG. 13 shows a reproduction apparatus according to an embodiment of the present invention.
Flow chart for controlling reproduction of two streams based on reproduction control information

FIG. 14 is a data structure diagram of reproduction control information when time stamps of a stream according to an embodiment of the present invention are continuous;

FIG. 15 is a diagram showing recording and reproduction streams of the recording / reproduction device according to the embodiment of the present invention;

FIG. 16 is a flowchart showing a procedure for generating editing and playback control information in the recording apparatus according to the embodiment of the present invention;

FIG. 17 is a data structure diagram of an image identifier including the resolution of management information data according to an embodiment of the present invention.

FIG. 18 is a block diagram showing another type of MPEG decoder of the reproducing apparatus according to the embodiment of the present invention;

FIG. 19 is a diagram illustrating the principle of a multi-angle video division multiplex recording system according to an embodiment of the present invention;

FIG. 20 is a diagram showing a method of separating horizontal and vertical interpolation information and recording the information in an interleaved block according to an embodiment of the present invention;

FIG. 21 is a diagram illustrating the principle of a MADM system that divides horizontally into two parts according to an embodiment of the present invention;

FIG. 22 is a diagram illustrating image synthesis control of the playback device according to the embodiment of the present invention;

FIG. 23 is a signal arrangement diagram for outputting a progressive signal, an NTSC signal, and an HDTV signal according to an embodiment of the present invention.

FIG. 24 is a diagram illustrating a buffer when reproducing a progressive, stereoscopic, or wide signal according to an embodiment of the present invention.

FIG. 25 is a block diagram of the playback device according to the embodiment of the present invention in an interlace video signal output mode.

FIG. 26 shows a first decoder and a second decoder according to an embodiment of the present invention.
Flowchart for synchronizing AV between decoders

FIG. 27 is a flowchart for controlling two buffer units according to an embodiment of the present invention;

FIG. 28 is a timing chart of a data stream according to an embodiment of the present invention, which is reproduced and output through a buffer of a decoder and a decoding process;

FIG. 29 shows a system control unit M1 according to an embodiment of the present invention.
-9 is a flowchart showing a detailed procedure of a program chain group reproduction process according to -9.

FIG. 30 is an AV synchronization control 12- according to the embodiment of the present invention.
10 is a block diagram showing a partial configuration for performing AV synchronization with respect to 10

FIG. 31 is a block diagram of a data recovery processing unit according to an embodiment of the present invention;

FIG. 32 is a diagram showing a signal format of an image identifier according to an embodiment of the present invention.

FIG. 33 is a flowchart of STC switching during seamless connection according to an embodiment of the present invention;

FIG. 34 is a diagram showing processing of the horizontal filter circuit according to one embodiment of the present invention;

FIG. 35 is a block diagram of an optical disk reproducing apparatus according to an embodiment of the present invention;

FIG. 36 is a configuration diagram of a video decoder according to an embodiment of the present invention.

FIG. 37 is a diagram showing a data structure on an optical disc according to an embodiment of the present invention.

FIG. 38 is a timing chart of video reproduction according to an embodiment of the present invention.

FIG. 39 is a block diagram of an optical disk reproducing apparatus according to an embodiment of the present invention;

FIG. 40 is a configuration diagram of an audio decoder according to an embodiment of the present invention.

FIG. 41 is a diagram showing a data structure on an optical disc according to an embodiment of the present invention.

FIG. 42 is a timing chart of audio and video reproduction according to an embodiment of the present invention.

FIG. 43 is a diagram showing an optical disc reproducing device according to an embodiment of the present invention;

FIG. 44 is a configuration diagram of a video decoder according to an embodiment of the present invention.

FIG. 45 is a timing chart of video reproduction according to an embodiment of the present invention.

FIG. 46 is a block diagram of an optical disk reproducing apparatus according to an embodiment of the present invention.

FIG. 47 is a configuration diagram of a video decoder according to an embodiment of the present invention.

FIG. 48 is a configuration diagram of a video decoder according to an embodiment of the present invention.

FIG. 49 is a configuration diagram of a video decoder according to an embodiment of the present invention.

FIG. 50 is a block diagram showing an optical disk reproducing apparatus according to an embodiment of the present invention;

FIG. 51 is a configuration diagram of an audio decoder according to an embodiment of the present invention.

FIG. 52 is a view showing a data structure on an optical disc according to an embodiment of the present invention;

FIG. 53 is a timing chart of audio and video reproduction according to an embodiment of the present invention.

FIG. 54 is a timing chart of audio reproduction and operating frequency according to an embodiment of the present invention.

FIG. 55 is a timing chart of audio reproduction and operating frequency according to an embodiment of the present invention.

FIG. 56 is a diagram showing a stream flow in the playback device according to the embodiment of the present invention.

FIG. 57 is a flowchart showing MPEG encoding, editing / playback control information generation, and playback control procedures in the recording / playback apparatus according to one embodiment of the present invention;

FIG. 58 is a block diagram of a recording / reproducing apparatus of a reproduction control method in a frame unit according to one embodiment of the present invention;

FIG. 59 is a diagram showing a procedure for deleting unnecessary frames according to an embodiment of the present invention;

FIG. 60 is a block diagram of a reproducing apparatus and a TV monitor of a mutual authentication system according to an embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 1 optical disk 16 MPEG decoder 21 control unit 23a, 23b buffer circuit 25 SW circuit 26 stereoscopic video arrangement information reproducing unit 27 SW circuit 28 RL mixing circuit 29 R output unit 30 L output unit 31 video output unit 32 audio output unit 33 "stereoscopic" Display signal output unit 34 Motor 35 Rotation control circuit 39 Memory 43 3D-compatible playback device 707 480P video signal 710 480P video signal 717 MPEG encoder 718a Third interleaved block 723 Recording means 724 Disk 725 Hierarchical recording identifier 726 Specific interleaved block reproduction inhibiting means 727 MPEG data 728 MPEG decoder 729 480P signal 730 MPEG decoder 731 Difference signal 732 Synthesizing unit 733 720P signal 734 Separating unit 735 First buffer Memory 736 Second buffer memory 737a, 737b 2-3 conversion unit 738 480P-720P up converter 739 720P signal 740 Operation unit 741 2-3 conversion unit 743 Hierarchical playback device 744 Resolution-attribute identification information 745 Identification information processing unit 746 3 -2 pull-down section 747 separation section 748 synthesis section 749 480i signal 751 modulation section 752 transmission section 753 reception section 754 demodulation section 755 synthesis section 756a field frame conversion section 758 synthesis section 759 W480P video signal 760 W480P-720P conversion section 763 switching synthesis section 764 Switching composite signal output section 765 Playback control information 766 Switching point number 767 Image composition identifier 768 Switching start address 769 Switching end address 770 GOP start address 771 Off Replacement start address 772 Switching end address 773 Decoding start address 777 Recording means 778 Reproduction means 779 Memory 780 VTS synchronization section 781 GOP 782a, 782b, 782c, 782d Synthetic screen 783 Redundancy section 785 Flowchart (recording means) 786 Up-conversion instruction 787 Up-conversion Identifier 789 Reproduction control information generation unit 790 Editing information 791 MPEG encoder 792 Flow chart (deletion of unnecessary frames) 794a, 794b Mutual authentication unit 795 Encryption encoder 796 Communication interface unit 797 Encryption decoder 798 TV monitor 799a, 799b (encryption) key

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Hideki Fukuda 1006 Kadoma Kadoma, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (47)

[Claims] An optical disc reproducing apparatus for reproducing a signal recorded on an optical disc, wherein the optical disc has a first signal representing a low frequency component of a video signal.
At least a video stream and a second video stream representing at least a high-frequency component of the video signal are recorded, the first video stream includes a plurality of first interleaving units, and the second video stream includes a plurality of second interleaving units. Each of the plurality of first interleaving units includes m1 (m1 is an integer of 1 or more) GOPs, and each of the plurality of second interleaving units includes m2 (m2 is an integer of 1 or more) G
An optical disc reproducing apparatus, comprising: a reproducing unit that reproduces the first video stream and the second video stream recorded on the optical disc; and a plurality of first interleaves that reproduces the reproduced first video stream. A decomposing unit that decomposes the reproduced second video stream into the plurality of second interleave units; and decodes the plurality of first interleave units to convert the low-frequency component of the video signal. A decoding unit that generates a first playback signal representing the high frequency component of the video signal by decoding the plurality of second interleaving units; A synthesizing unit that generates the video signal by synthesizing the second reproduction signal and the second reproduction signal; And an output unit for selectively outputting at least one of the raw signal and the video signal, the optical disk reproducing apparatus. 2. Each of the plurality of first interleaving units is associated with first time information associated with a playback time, and each of the plurality of second interleaving units is associated with a second time information associated with a playback time. 2. The optical disk reproducing device according to claim 1, wherein the optical disk reproducing device is associated with time information. 3. The optical disc reproducing apparatus, further comprising: a reference time signal generation unit that generates a reference time signal; and a difference between the reference time signal and the first time information.
A first reproduction control unit that controls a reproduction time of the first reproduction signal, and a difference between the reference time signal and the second time information,
A second reproduction control unit that controls the reproduction time of the second reproduction signal; and the reference time signal supplied to the first reproduction control unit and the reference signal supplied to the second reproduction control unit are substantially different. 3. The optical disc reproducing apparatus according to claim 2, further comprising: a correction unit configured to correct the reference time signal so as to represent the same time. 4. The correction unit according to claim 3, wherein the correction unit corrects the reference time signal based on audio reproduction time information indicating a time at which an audio signal to be output in synchronization with the video signal is to be reproduced. An optical disc playback device according to claim 1. 5. The correction unit according to claim 1, wherein the first video reproduction time information indicating a time at which the first reproduction signal is to be reproduced and a second video reproduction time information indicating a time at which the second reproduction signal is to be reproduced. 4. The optical disk reproducing device according to claim 3, wherein the reference time signal is corrected based on at least one of the signals. 6. The first reproduction control unit controls a reproduction time of the first reproduction signal by skipping or repeatedly reproducing a frame of the first reproduction signal, and further comprising: By skipping or repeating the frame of the second reproduction signal,
4. The optical disk reproducing device according to claim 3, wherein a reproduction time of the second reproduction signal is controlled. 7. At least one of the first time information and the second time information includes PTS, DTS, and SC
The optical disk reproducing device according to claim 1, comprising at least one of R. 8. The first reproduction signal corresponds to a first number of pixels, the second reproduction signal corresponds to a second number of pixels larger than the first number of pixels, and the combining unit includes: A converter for converting a first reproduction signal into a conversion signal corresponding to the second pixel number, wherein the video signal is obtained by synthesizing the conversion signal and the second reproduction signal. Item 2. An optical disk reproducing device according to item 1. 9. The optical disc further records an identifier indicating a first pixel number corresponding to the first reproduction signal, and the converter converts the first reproduction signal according to the identifier. The optical disk reproducing device according to claim 8, wherein the optical disk reproducing device converts the signal into a signal. 10. The optical disc further stores an identifier indicating a first pixel number corresponding to the first reproduction signal, wherein the optical disc reproducing apparatus further includes a rotation control unit that controls rotation of the optical disc. 9. The optical disc reproducing apparatus according to claim 8, wherein the optical disc reproducing apparatus includes the rotation control unit, and controls the rotation of the optical disc according to the identifier. 11. The optical disc further records an identifier indicating that the video signal is obtained by encoding a progressive video signal of 24 to 30 frames per second, and the output unit includes: A converter for converting at least one of the first reproduction signal, the second reproduction signal, and the video signal into a frame signal, wherein the output unit outputs the frame signal redundantly for one second. 2. The optical disc reproducing apparatus according to claim 1, wherein a progressive video signal of 60 frames per frame is output. 12. The optical disc reproducing apparatus, wherein the plurality of first interleaving units and the plurality of second interleaving units
12. The optical disk reproducing apparatus according to claim 11, further comprising a buffer memory unit for storing an interleave unit, wherein a capacity of the buffer memory unit is equal to or larger than a data amount of a GOP included in the second interleave unit. 13. The capacity of the buffer memory unit is 1M
13. The optical disk reproducing device according to claim 12, wherein the number is B or more. 14. At least a first video stream representing a low-frequency component of a video signal and a second video stream representing at least a high-frequency component of the video signal are recorded, and the first video stream includes a plurality of first video streams. An interleaving unit, wherein the second video stream comprises a plurality of second video streams.
Each of the plurality of first interleaving units includes m1 (m1 is an integer of 1 or more) GOPs, and each of the plurality of second interleaving units includes m2 (m2 is an integer of 1 or more) GO
An optical disk including P. 15. The first interleaving unit such that a playback time of one of the plurality of first interleaving units and a corresponding one of the plurality of second interleaving units are substantially equal. 15. The optical disc according to claim 14, wherein the optical disc comprises a second interleave unit. 16. A separating unit for separating a video signal into a first video signal representing a low-frequency component of the video signal and a second video signal representing at least a high-frequency component of the video signal; A first video stream is generated by encoding the first video stream, and a second video stream is generated by encoding the second video signal. The first video stream includes a plurality of first video streams. One interleaving unit, wherein the second video stream comprises a plurality of second
Each of the plurality of first interleaving units includes m1 (m1 is an integer of 1 or more) GOPs, and each of the plurality of second interleaving units includes m2 (m2 is an integer of 1 or more) GO
P, an encoding unit, and a selection output unit that selectively outputs the plurality of first interleaving units included in the first video stream and the plurality of second interleaving units included in the second video stream. An optical disc recording device, comprising: a recording unit that records a signal output from the selection output unit on an optical disc. 17. The apparatus according to claim 17, wherein the separating unit includes: a decoder configured to decode the first video stream; and a difference calculator configured to calculate a difference between the video signal and a signal output from the decoder. 17. The optical disk recording device according to claim 16, wherein the separation unit outputs a signal output from the difference calculator as the second video signal. 18. A first converter for converting the video signal into a first conversion signal corresponding to a second number of pixels smaller than the first number of pixels corresponding to the video signal, and the decoder And a second converter that converts the signal output from the second converter into a second conversion signal corresponding to a first pixel number greater than a second pixel number corresponding to the signal output from the decoder. The optical disc recording apparatus according to claim 17, wherein the separating unit outputs the first converted signal as the first video signal, and the difference calculator calculates a difference between the video signal and the second converted signal. . 19. The optical disc recording apparatus according to claim 17, wherein the recording unit further records an identifier indicating that the second video signal is a signal output from the difference calculator on the optical disc. 20. The optical disc recording apparatus according to claim 17, wherein the recording unit further records an identifier indicating a first pixel number corresponding to the video signal on the optical disc. 21. The optical disc recording apparatus according to claim 17, wherein the recording unit further records an identifier indicating a second pixel number corresponding to the first video signal on the optical disc. 22. An input for inputting an encoded first video stream corresponding to a first pixel number and an encoded second video stream corresponding to a second pixel number different from the first pixel number. Wherein the first video stream includes a plurality of first interleaving units, the second video stream includes a plurality of second interleaving units, and each of the plurality of first interleaving units is m1 (m1 is Each of the plurality of second interleaving units includes m2 (m2 is 1).
An input unit including a GOP of the above (integer), and selectively outputting the plurality of first interleaving units included in the first video stream and the plurality of second interleaving units included in the second video stream. An optical disc recording apparatus, comprising: a selection output unit that performs the operation; and a recording unit that records a signal output from the selection output unit on an optical disc. 23. An optical disc reproducing apparatus for reproducing a signal recorded on an optical disc, wherein the optical disc includes at least a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs. Recorded on said plurality of first GOs
P includes a plurality of pictures, and the second GOP
Includes a plurality of pictures, wherein the optical disc reproducing apparatus reproduces the first video stream and the second video stream recorded on the optical disc; and the first video stream and the second video A decoding unit that decodes the stream, and an output unit that selectively outputs the decoded first video stream and the decoded second video stream in accordance with playback control information. Is the first second GOP among the plurality of second GOPs included in the second video stream, following the first picture included in the last first GOP among the plurality of first GOPs included in the first video stream.
, The second picture included in the first GO
An optical disc reproducing apparatus for reproducing a second picture different from the first picture of P. 24. The decoding device according to claim 23, wherein the decoding unit starts decoding the second video stream such that decoding of the second picture is completed at the time when reproduction of the first picture is completed. An optical disk reproducing apparatus according to claim 1. 25. The reproduction control information includes information ts1 indicating a position of the first picture, information ts2 indicating a position of the second picture, and information tsG indicating a position of a head picture of the head second GOP. 25. The decoding unit, wherein the decoding unit obtains a decoding start position ta according to a calculation expression of ta = ts1- (ts2-tsG), and starts decoding the second video stream based on the decoding start position ta. An optical disc playback device according to claim 1. 26. The playback control information includes timing information indicating a timing at which decoding of the first second GOP is started such that a playback end time of the first picture matches a playback start time of the second picture. The decoding unit includes the second unit based on the timing information.
25. The optical disc playback device according to claim 24, wherein decoding of the video stream is started. 27. The decoding unit according to claim 27, wherein:
24. The optical disc reproducing apparatus according to claim 23, wherein decoding of pictures unnecessary for decoding the pictures from the first picture to the second picture is omitted. 28. The optical disc reproducing apparatus according to claim 27, wherein the unnecessary picture is a B picture. 29. The optical disc playback device further includes a buffer memory unit for storing the first video stream and the second video stream, and the capacity of the buffer memory unit is equal to or more than the data amount of 1 GOP. An optical disk reproducing apparatus according to claim 23. 30. The optical disk reproducing apparatus according to claim 23, wherein the reproduction control information is further recorded on the optical disk, and the reproduction unit reproduces the reproduction control information recorded on the optical disk. 31. An identifier indicating whether or not the reproduction control information is recorded on the optical disk is further recorded on the optical disk. The reproduction unit is configured to record the reproduction control information on the optical disk. 24. The optical disc reproducing apparatus according to claim 23, wherein when the identifier indicates that the reproduction control information is present, the reproduction control information recorded on the optical disc is reproduced. 32. The high-speed playback mode, wherein the output unit prohibits output of an I picture included in the first second GOP when the second picture is not an I picture. Optical disc playback device. 33. The optical disc reproduction apparatus according to claim 32, wherein the output unit prohibits, based on the I picture reproduction prohibition information, output of a part of the I picture included in the first second GOP. 34. An input unit for inputting a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs, and a last one of the plurality of first GOPs included in the first video stream. Of the plurality of second GOPs included in the second video stream, following the first picture included in the first GOP of the second GOP.
, The second picture included in the first GO
A generation unit that generates reproduction control information indicating that a second picture different from the first picture of P is reproduced.
Playback control information generation device. 35. The reproduction control information according to claim 27, wherein:
35. The reproduction control information generation device according to claim 34, further comprising information indicating the number of pictures from the first picture to the second picture of a GOP. 36. The reproduction control information may include the first second
35. The reproduction control information generation apparatus according to claim 34, further comprising information indicating a time at which the first picture of a GOP is to be reproduced and a time at which the second picture of the second GOP at the head is to be reproduced. 37. The playback control information includes timing information indicating a timing at which decoding of the first second GOP is started such that a playback end time of the first picture matches a playback start time of the second picture. Claim 34, comprising
3. The reproduction control information generation device according to 1. 38. The timing information starts decoding of the first second GOP in a case where pictures unnecessary for decoding the pictures from the first picture to the second picture of the first second GOP are not decoded. 38. The reproduction control information generation device according to claim 37, which indicates a timing. 39. The reproduction control information generation device according to claim 38, wherein the unnecessary picture is a B picture. 40. A reproduction unit for generating reproduction control information, and recording the reproduction control information on an optical disc on which a first video stream including a plurality of first GOPs and a second video stream including a plurality of second GOPs are recorded. A recording unit, wherein the reproduction control information is included in the second video stream following the first picture included in the last first GOP of the plurality of first GOPs included in the first video stream. First second GOP among the plurality of second GOPs
, The second picture included in the first GO
An optical disc recording apparatus for reproducing a second picture different from the first picture of P. 41. A method according to claim 1, wherein a plurality of first Gs
A first video stream including an OP and a plurality of second GOPs
An editing unit that edits the first video stream and the second video stream so as to delete unnecessary pictures for reproduction from the second video stream that includes the edited first video stream and the edited second video stream. A recording unit for recording two video streams on an optical disc, wherein the reproduction control information includes a first picture included in a last first GOP among the plurality of first GOPs included in the first video stream, A first second GOP among the plurality of second GOPs included in the second video stream;
, The second picture included in the first GO
An optical disc recording apparatus for reproducing a second picture different from the first picture of P. 42. The picture unnecessary for reproduction includes a picture after the first picture in the first video stream and a picture before the second picture in the second video stream. 42. The optical disc recording device according to 41. 43. The picture unnecessary for reproduction further includes a picture unnecessary for decoding pictures from the first picture to the second picture of the second GOP at the top of the second video stream. Item 43. The optical disk recording device according to item 42. 44. The optical disc reproducing apparatus according to claim 43, wherein the unnecessary picture is a B picture. 45. The recording unit according to claim 4, wherein the recording unit records the edited first video stream and the edited second video stream in a continuous area on the optical disc.
2. The optical disk recording device according to 1. 46. The optical disc recording apparatus according to claim 41, wherein the recording section records the reproduction control information on the optical disc. 47. The optical disc recording apparatus according to claim 41, wherein the recording section records the reproduction control information on a recording medium other than the optical disc.