JP2001309306A - Device and method for reproduction and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To output a recorded PES packet as a TS. SOLUTION: In a step S41, DTS-(vbv-delay) is operated and a STC(system time clock) is further initialized at a time obtained by subtracting a prescribed time. In a step S42, the PSI packets of a PAT and a PMT are outputted. In a step S43, a TS packet for a dedicated PCR with the value of the STC recorded thereon is outputted in an optional interval. In a step S44, with respect to video, a video PES packet is made TS and an output is started at timing when the STC coincides with the time obtained by subtracting the vbv-delay from the DTS of the front I picture. With respect to audio, an audio PES packet is made TS and an output is started at timing when the STC coincides with the time obtained by subtracting a start up delay from the PTS of the front frame (AAU).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a reproducing apparatus and method, and a recording medium, for example, when outputting an AV signal recorded as a packetized elementary stream packet on an information recording medium as a transport stream. The present invention relates to a reproducing apparatus and method suitable for use, and a recording medium.

[0002]

2. Description of the Related Art Digital VCR (Video Cassette R) for consumer use
ecorder), like the DV format
There is a system in which a video signal is encoded by intra-frame compression, and a corresponding audio signal is encoded so that it can be uncompressed or instantaneously expanded and recorded on a magnetic tape.

A video signal and an audio signal encoded by the DV format and recorded on a recording medium are suitable for editing such that video and audio are connected at an arbitrary position.

However, due to the low signal compression ratio of the DV format, a recording system with a high transfer rate is required, a medium with a large storage capacity is required, and the capacity of an information recording medium is limited. In such a case, there is a problem that the recording time is shortened.

In order to solve such a problem, video signals and audio signals are converted to MPEG (Moving Picture Expe
There is already a system that performs compression encoding using the rts Group (rts Group) method and records the data on a recording medium in a state of a transport stream (hereinafter, also referred to as TS).

According to the system using the MPEG system,
The video signal is a Lo signal composed of a plurality of frames of images.
Since inter-frame compression is performed by ng GOP (Group Of Picture) and the audio signal is frame-compressed by a plurality of samples, a high compression rate can be realized. Therefore, a recording system with a high transfer rate is not required, the capacity of the recording medium can be saved, and when the capacity of the recording medium is limited, the recording time is extended as compared with a DV format system. There are advantages.

[0007]

However, the following problems exist in a system for recording a video signal and an audio signal compressed and encoded by the MPEG system in a TS state.

That is, the video signal is, as described above,
MPEG compression is performed in units of Long GOP, but the image type (I (In
tra) picture, P (Predictive) picture, or B (Bid
The data length of an image of one frame is not constant (it is not compressed at a fixed rate) due to an image (irectionally predictive) and the picture pattern of the image. On the other hand, audio signals are compressed at a fixed rate. Therefore, even if the corresponding video signal and audio signal are encoded at the same time, there is a possibility that the packet of the corresponding video signal and audio signal is arranged at a remote position on the TS.

When the corresponding video signal and audio signal packets are arranged at distant positions on the TS, if editing is performed such that the TSs are joined on the way, the timing of the connection of the video signals and the connection of the audio signals are changed. There was a problem that the timing was shifted or one of the data was insufficient.

[0010] The TS is added with a TS header, a time stamp indicating the arrival time at the decoder, and a PCR packet storing a PCR (Program Clock Reference: Reference Time) serving as a time reference for decoding. Therefore, there is a problem that the recording rate is reduced by the overhead.

Further, since it is difficult to perform a so-called jog reproduction such as pause (pause), slow reproduction, and reverse reproduction of a video signal and an audio signal recorded in a TS state, the jog reproduction is required. Has a problem that the TS must be converted into an elementary stream.

The present invention has been made in view of such a situation, and is intended to record a video signal and an audio signal compressed and encoded by using the MPEG method as a packetized elementary stream and output the signal as a TS. The purpose is to do.

[0013]

According to the present invention, there is provided a reproducing apparatus comprising: a reading means for reading a packetized elementary stream packet from an information recording medium; a decoding time stamp or a decoding time stamp included in a header of the packetized elementary stream packet; Initialization means for initializing the system time clock using the presentation time stamp, first generation means for generating a program clock reference packet using the value of the system time clock read out at predetermined intervals, and At the time when the time delayed by the time of the packet matches the time indicated by the decoding time stamp or the presentation time stamp included in the header of the packetized elementary stream packet. Characterized in that it comprises a conversion means for converting the elementary stream packets into transport stream packets.

The initialization means uses a value obtained by subtracting a predetermined time from a decoding time stamp or a presentation time stamp included in a header of a packetized elementary stream packet from which reproduction is started first, and uses the value obtained by subtracting a predetermined time from the system time. The clock may be initialized, and the first generation unit may be more than a predetermined timing when the packetized elementary stream packet whose reproduction is started first is converted into a transport packet by the conversion unit. The generation of the program clock reference packet can be started ahead of time.

[0015] The reproducing apparatus of the present invention may further include a second generating means for generating a program association table packet and a program map table packet, wherein the second generating means is configured such that the first generating means generates a program clock. The generation of the program association table packet and the program map table packet can be started earlier by a predetermined time than the timing of starting the generation of the reference packet.

[0016] The conversion means may include a time obtained by delaying the system time clock by vbv_delay recorded in the picture header, and a decoding time stamp or presentation time stamp contained in the header of the video packetized elementary stream packet. The video packetized elementary stream packets can be converted into transport stream packets at the timing when the indicated times match.

[0017] The conversion means may convert video packetized elementary stream packets into transport stream packets at a fixed rate and output the packets intermittently.

[0018] The converting means may convert the video packetized elementary stream packets into transport stream packets at a variable rate, and output the transport stream packets at equal intervals.

[0019] The conversion means is configured to output the audio signal at a timing when the time obtained by delaying the system time clock by a predetermined time and the time indicated by the presentation time stamp included in the header of the audio packetized elementary stream packet match. Packetized elementary stream packets can be converted into transport stream packets.

The reproducing method of the present invention uses a reading step of reading a packetized elementary stream packet from an information recording medium and a decoding time stamp or a presentation time stamp included in a header of the packetized elementary stream packet. An initialization step of initializing the system time clock, a first generation step of generating a program clock reference packet using a value of the system time clock read at a predetermined interval, and a delay of the system time clock by a predetermined time When the time matches the time indicated by the decoding time stamp or the presentation time stamp included in the header of the packetized elementary stream packet, the packet Characterized in that it comprises a conversion step of converting the Zudo elementary stream packets into transport stream packets.

[0021] The program of the recording medium of the present invention includes a reading step of reading a packetized elementary stream packet from an information recording medium, and a decoding time stamp or a presentation time stamp included in a header of the packetized elementary stream packet. An initialization step of initializing the system time clock by using the value of the system time clock read at a predetermined interval; a first generation step of generating a program clock reference packet using the value of the system time clock; At the timing when the time indicated by the decoding time stamp and the time indicated by the presentation time stamp included in the header of the packetized elementary stream packet match. , Characterized in that it comprises a conversion step of converting the packetized elementary stream packets into transport stream packets.

According to the reproducing apparatus and method of the present invention and the program of the recording medium, the packetized elementary stream packet is read from the information recording medium, and the decoding time included in the header of the packetized elementary stream packet is read. The system time clock is initialized using the stamp or the presentation time stamp. In addition, a program clock reference packet is generated using the value of the system time clock read at a predetermined interval, and is included in the header of the packetized elementary stream packet and the time obtained by delaying the system time clock by a predetermined time. At a timing when the times indicated by the decoding time stamp or the presentation time stamp match, the packetized elementary stream packet is converted into a transport stream packet.

[0023]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An AV recording / reproducing apparatus to which the present invention is applied will be described. This AV recording / reproducing apparatus converts input video and audio baseband signals into packetized elementary streams (Packetized Elementary Streams).
ntary stream (hereinafter, also referred to as PES) and recorded on a magnetic tape, an input TS is converted into a PES and recorded on a magnetic tape, and an input TS is recorded on the magnetic tape in a TS state. The AV recording / reproducing apparatus also reproduces the PES recorded on the magnetic tape, or converts the PES recorded on the magnetic tape into a TS and outputs the TS.

FIG. 1 shows an example of the configuration of an AV recording / reproducing apparatus. The video encoding unit 1 encodes an input video baseband signal by an MPEG method and encodes a video elementary stream (hereinafter referred to as ES).
) And outputs it to the video PES generator 2.
The video PES conversion unit 2 converts the video ES input from the video encoding unit 1 into a PES and outputs the PES to the A / V mixing unit 5. Video PES unit 2 The video ES input from the video encoding unit 1 can be output to the A / V mixing unit 5 as it is. The video PES conversion unit 2 further converts the video TS packet input from the demultiplexer 7 into a PES
And outputs it to the A / V mixing unit 5.

The audio encoding unit 3 generates an audio ES by encoding the input audio baseband signal by the MPEG method, and outputs the audio ES to the audio PES conversion unit 4. The audio PES conversion unit 4 converts the audio ES input from the audio encoding unit 3 into a PES to generate an A /
Output to V mixing section 5. The audio PES conversion unit 4 also
Audio E input from the audio encoding unit 3
S can be output to the A / V mixing section 5 as it is.
The audio PES conversion unit 4 further converts the audio TS packet input from the demultiplexer 7 into a PES to generate an A /
Output to V mixing section 5.

The A / V mixing unit 5 converts a video PES packet input from the video PES conversion unit 2 and an audio PES packet input from the audio PES conversion unit 4 into a predetermined recording format (described later). Then, the obtained sync block is output to the recording unit 6. The A / V mixing unit 5 also
After adding a time stamp to the TS packet input from the demultiplexer 7, the TS packet is converted into a predetermined recording format, and the obtained sync block is output to the recording unit 6.
The A / V mixing unit 5 further edits the video ES (which will be described later) that has passed through the video PES conversion unit 2 and an audio PE.
After adding a time stamp to the editing unit of the audio ES that has passed through the S-making unit 4, the unit converts the time into a predetermined recording format, and outputs the obtained sync block to the recording unit 6.

The recording unit 6 randomizes the sync block input from the A / V mixing unit 5 in the M-sequence in the same manner as the DV format used in the existing consumer digital VCR, and then, 24/25 The conversion is performed so that the run-length limit and the tracking frequency are superimposed and recorded on the magnetic tape 9.

The demultiplexer 7 outputs a video TS packet included in the input TS to the video PES conversion unit 2, outputs an audio TS packet to the audio PES conversion unit 4, and outputs a PSI (Program System Infornation) TS packet. Is output to the A / V mixing unit 5. Demultiplexer 7
In addition, the input non-native (described later) TS
The packet is separated into packets and output to the A / V mixing unit 5. At this time, the demultiplexer 7 may discard the PCR packet.

The reproducing unit 10 reads out the sync blocks recorded on the magnetic tape 9, reproduces the PES, and executes A / V
Output to the separation unit 11 or the TS conversion unit 14. Reproduction unit 10
Also, the sync block recorded on the magnetic tape 9 is read to reproduce the TS, and the A / V separation unit 11 or the T /
Output to the S conversion unit 14.

The A / V separation unit 11 converts the PES or TS input from the reproduction unit 10 into a video data stream (P
(ES or TS) and an audio data stream and output to the corresponding video decoding unit 12 or audio decoding unit 13.

The video decoding section 12 has an A / V separation section 1
The decoder decodes the video data stream input from 1 and outputs the resulting video signal. The audio decoding unit 13 decodes an audio data stream input from the A / V separation unit 11 and outputs an obtained audio signal.

The TS conversion unit 14 converts the PES input from the reproduction unit 10 into a TS and outputs the TS. The TS conversion unit 14 also adds a sync byte to the head of the TS packet from which the sync byte (described later) of the TS input from the reproduction unit 10 has been removed, and outputs the TS packet.

The control unit 16 controls the drive 17 to
Magnetic disk 18, optical disk 19, magneto-optical disk 2
0 or a control program stored in the semiconductor memory 21 is read, and each unit of the AV recording / reproducing apparatus is controlled based on the read control program.

Next, a recording method of the AV recording / reproducing apparatus will be described. FIG. 2 shows an example of recording the ES on the magnetic tape 9. As shown in the figure, with respect to video, every three frames of I picture, B picture, and B picture or every three frames of P picture, B picture, and B picture are combined to form an editing unit. Between (3 frames), a corresponding audio editing unit is arranged.

[0035] In the figure, four frames are used as a video editing unit composed of three frames (AAU: AudioAccess Unit).
An example is shown in which audio editing units of 5 frames or audio editing units of 5 frames are arranged in correspondence.

However, in practice, the number of audio frames corresponding to three frames of video is usually not an integer. Therefore, a dedicated time stamp (TS) indicating a reproduction time is added to each video and audio editing unit. This makes it possible to play back video and audio in synchronization.

Hereinafter, a recording method as shown in FIG. 2 will be described as an ES recording method.

According to the ES recording method, a video editing unit to which a dedicated time stamp is added and an audio editing unit to which a corresponding dedicated time stamp is added are arranged and recorded side by side. In this case, it is possible to suppress the occurrence of inconvenience such that the joined timing is shifted between video and audio.

FIG. 3 shows an example of recording PES on the magnetic tape 9. Specifically, the dedicated time stamp shown in FIG. 2 is not added to the video editing unit consisting of three frames and the corresponding audio editing unit described above,
By applying the syntax of the PES packet and adding the time management information PTS (Presentation Time Stamp) for playback output and the time management information DTS (Decoding Time Stamp) for decoding, the PES
Packetize.

Hereinafter, a recording method as shown in FIG. 3 will be described.
Described as PES recording method.

The advantage of the PES recording system over the ES recording system is that when reading from the magnetic tape 9 and outputting it as a TS to the outside of the apparatus, conversion to TS is easy due to the addition of PTS and DTS. That is.

Incidentally, the structure of the PES packet is not unique. For video, for example, when one PES packet is composed of one video frame, or
One PES packet may be composed of a GOP composed of a plurality of video frames. For audio, for example, one PES packet may be composed of one audio frame (AAU), or one PES packet may be composed of a plurality of audio frames.

There. In order to make editing easier, the PES structure in the PES recording method is unified so that one frame constitutes one PES packet for both video and audio.

Next, a recording format suitable for recording the PES on the magnetic tape 9 will be described. Before that, the data structures of the TS packet and the PES packet will be described. The recording format can be applied to a case where the ES is recorded on the magnetic tape 9. Further, the recording format can correspond to a TS such as a multi-program.

FIG. 4 shows the data structure of a TS packet. The TS packet is an 8-bit sync byte (syn
c_byte), 1-bit transport error indicator (transport_error_indicator), 1-bit payload unit start indicator (payload_unit_start_
indicator), 1-bit transport priority
(transport_priority), 13-bit packet identification information
(Packet_ID), 2-bit scramble control (transport_ID
This is a fixed-length (188-byte) packet including a scrambling_control, a 2-bit adaptation field control (adaptation_field_control), a 4-bit continuity counter (continuity_counter), and an adaptation field of 184 bytes.

The sync byte indicates the head of the TS packet. The transport error indicator indicates whether there is a bit error in the TS packet. The payload unit start indicator indicates that the head of the PES packet is recorded in the payload of the TS packet. The packet priority indicates the importance of the TS packet. The packet identification information indicates the attribute of the individual stream of the TS packet. The scramble control indicates the presence or absence and type of the scramble of the payload of the TS packet.
The adaptation field control indicates presence / absence of an adaptation field and presence / absence of a payload. The continuity counter indicates the order of a plurality of TS packets having the same packet identification information.

In the adaptation field, in addition to the program time reference value PCR, additional information relating to the individual stream is recorded. If the additional information to be recorded is less than 184 bytes, a stuffing byte is recorded in the adaptation field. In the payload, the divided PES packet, program specification information PSI
(Program Specific Information) and the like are recorded.

FIG. 5 shows the data structure of a PES packet. The PES packet has a 32-bit packet start code (Packet Start Code), a 16-bit PES packet length (PES packet length), and a 2-bit “1”.
0 ", 14-bit flag and control, 8-bit PES header data length, 40-bit PTS, 40-bit DTS, 152-bit other information, and 8N-bit stuffing byte It is a variable-length packet composed of a PES header and a PES payload with an undefined data length.

The packet start code is composed of a 24-bit head start code and an 8-bit stream ID.
Indicates the beginning of an S packet. In the PES packet length, the data length of the PES packet is recorded. "10" following the PES packet length indicates that the packet is a PES packet. The flag and the control record whether or not the PES packet is scrambled, the type, the priority, the copyright information, and the like. The PES header data length records the data length of the PES header.

Next, a recording format for the magnetic tape 9 will be described with reference to FIG. Magnetic tape 9
One track has 141 sync blocks (hereinafter, referred to as “sync blocks”).
SB). C2 parity for error correction is recorded in the 9 SBs at both ends of each track.
Main data (such as PES packets) is recorded in the 123 SBs sandwiched between C2 parities.

SB has a fixed length of 111 bytes, and is 2 bytes.
It is composed of a byte sync, a 3-byte ID, a 1-byte SB header, a 95-byte data area, and a 10-byte C1 parity for error correction.

The 3-byte ID includes a track number, S
The B number and the overwrite protection code are recorded. The overwrite protection code is a value that is updated each time information is overwritten on the same SB, and is information that is used to prevent the previous data from being erased when overwritten.

FIG. 7 shows information recorded in a 1-byte (8-bit) SB header. MSB of SB header (Mo
3 bits on the side of st Significant Bit (bit-7 to
bit-5) represents the data type of the data recorded in the 95-byte data area following the SB header. LS
B (Least Significant Bit) side 5 bits (bit-
4 to bit-0), different information is recorded for each data type.

When the 3 bits on the MSB side of the SB header are 000, the data type is PES-VIDEO. If the three bits on the MSB side of the SB header are 001, the data type is PES-AUDIO. Data type is PES-VIDEO or
In the case of PES-AUDIO, the Full / Partial flag is recorded in the fourth bit (bit-4 in FIG. 7) from the MSB side of the SB header, and the subsequent 4 bits in the LSB side (bit-3 to bi in FIG. 7).
At (t-0), a continuity count value indicating the continuity of SBs of the same data type is recorded.

FIG. 8 shows that the data type is PES-VIDEO or P
The data structure of SB which is ES-AUDIO is shown. When the PES packet occupies the entire 95-byte data area following the SB header, 0 is recorded in the Full / Partial flag of the SB header. When the PES packet does not occupy the entire data area, 1 is recorded in the Full / Partial flag, and the data length of the PES packet recorded after the MSB is recorded in the 1 byte on the MSB side of the data area. Is done.

Referring back to FIG. 7, when the three bits on the MSB side of the SB header are 010, the data type is SEARCH-DATA. When the data type is SEARCH-DATA, a Video / Audio flag is recorded in the fourth bit from the MSB side of the SB header, and a search speed is recorded in the next three bits. The remaining one bit is reserved. In the data area,
Fixed size search data is recorded. Note that the position of the SB of the data type SEARCH-DATA in the track is predetermined, and the SB of the other data type is
Are arranged so as to avoid the SB position of SEARCH-DATA.

When the 3 bits on the MSB side of the SB header are 011, the data type is AUX. Data type is A
In the case of UX, the AUX mode is recorded in the fourth to sixth bits from the MSB side of the SB header. The remaining two bits are reserved. The data area has a fixed size
AUX data (auxiliary information) is recorded.

The 3-bit AUX mode indicates the type of AUX data. If the 3 bits are 000, AUX
The mode is AUX_V, and AUX data accompanying video data is recorded in the data area. The three bits are 0
If it is 01, the AUX mode is AUX_A, and AUX data accompanying the audio data is recorded in the data area. If the three bits are 010, the AUX mode is P
This is SI-1, and the first half of the PSI TS packet is recorded in the data area. If the 3 bits are 011, the AUX mode is PSI-2, and the latter half of the PSI TS packet is recorded in the data area. If the three bits are 100, the AUX mode is SYSTEM, and system-like AUX data is recorded in the data area.

FIG. 9 shows the data structure of an SB whose data type is AUX and whose AUX mode is PSI-1 or PSI-2. The first 3 bytes of the SB data area where the AUX mode is PSI-1 are reserved, and the next 92 bytes are:
92, which is obtained by removing the first byte of the sync byte (Sync_byte) from the first half of the PSI TS packet (188 bytes)
Bytes are recorded. In the SB data area of AUX mode PSI-2, 95 bytes of the latter half of the PSI TS packet in which the first half is recorded in the SB data area of AUX mode PSI-1 are recorded. That is, TS of one PSI
The packet is recorded with the AUX mode divided into the PSI-1 SB and the PSI-2 SB.

Referring back to FIG. 7, when the three bits on the MSB side of the SB header are 100, the data type is TS-1. If the data type is TS-1, the SB header
The fourth and fifth bits from the MSB side are reserved. A 27-bit time stamp is recorded in the remaining three bits and the first three bytes (24 bits) of the subsequent data area.

When the three bits on the MSB side of the SB header are 101, the data type is TS-2. When the data type is TS-2, a continuity count value is recorded in 5 bits on the LSB side of the SB header.

FIG. 10 shows that the data type is TS-1 or TS-2.
2 shows the data structure of the SB. Data type is
As described above, the first 3 bytes of the SB data area, which is TS-1, are combined with the 3 bits on the LSB side of the SB header to be used for recording a 27-bit time stamp. In the subsequent data area of 92 bytes, a TS packet (188
1 byte sync byte from the first half of
92 bytes excluding (Sync_byte) are recorded. In the data area of the SB having the data type TS-2, there is a T in which the first half is recorded in the data area of the SB having the data type TS-1.
95 bytes of the latter half of the S packet are recorded.

That is, one TS packet is divided into two SBs each having a data type of TS-1 and one having a data type of TS-2 and recorded. The continuity count value recorded in the SB header whose data type is TS-2 is equal to the SB of TS-1.
It indicates the continuity of TS packets recorded in the SB of TS-2.

Returning to FIG. 7, when the three bits on the MSB side of the SB header are 110, the data type is NULL. When the data type is NULL, invalid data only for satisfying the recording rate is recorded in the data area. Data bytes recorded after the SB header whose data type is NULL are ignored.

When the three bits on the MSB side of the SB header are 111, the data type is undefined (reserved).

Next, four types of recording processing which can be performed by the AV recording / reproducing apparatus to which the present invention is applied will be described with reference to FIGS.
This will be described with reference to FIG. 11 to 14 show the concept of each recording process. In the following, a video encoding unit 1, a video PES unit 2,
The ES converted to ES by the audio encoding unit 3 or the audio PES conversion unit 4, the PES converted to PES, and the TS including the PES are referred to as Native.
ES and TS are called Non-Native.

In the first recording process, as shown in FIG.
This is a method of converting a native ES into a PES and recording it as a native PES. In the second recording process, as shown in FIG.
This is a method in which a native TS is converted into a PES again and recorded as a native PES.

In the third recording process, as shown in FIG.
Non-Native TS is converted to ES and PES is converted to Non-Native TS.
This is a method of recording as PES of the native. However, the conditions under which the third recording process can be applied are that the TS is not a multi-program but a single program, and that the video ES is added with vbv_delay. This is because vbv_delay is not given (vbv_delay
If 0xFFFF is recorded in the TS, the arrival time information is lost when the TS is converted to the PES, and the TS cannot be restored during reproduction.

In the fourth recording process, as shown in FIG.
A time stamp is added to the non-native TS, and the non-native
This is a method of recording as TS of ve. The fourth recording process is applied to a TS that does not satisfy the conditions to which the above-described third recording process can be applied.

Hereinafter, the first to fourth recording processes will be described in detail.

The first recording process will be described with reference to the flowchart of FIG. In step S1,
The video encoding unit 1 encodes the input video baseband signal by the MPEG method to generate a video ES, and outputs the video ES to the video PES conversion unit 2. At this time, video E
The bit rate of S is accurately encoded at a bit rate equal to the maximum rate recorded in the bit rate included in the sequence header. Also, an accurate value is recorded in vbv_delay of the picture header.

The audio encoding unit 3 encodes the input audio baseband signal by the MPEG method to generate an audio ES, and outputs the audio ES to the audio PES conversion unit 4.

In step S2, the video PES conversion unit 2
Generates a PES packet by adding a PES header including a PTS and a DTS to each video frame of the video ES input from the video encoding unit 1, and outputs the PES packet to the A / V mixing unit 5.

The audio PES conversion section 4 adds a PES header including a PTS and a DTS to each audio frame (AAU) of the audio ES input from the audio encoding section 3 to generate a PES packet, and generates an A / V Output to the mixing unit 5.

In step S3, the A / V mixing section 5
Edits a video PES packet from the video PES conversion unit 2 by combining three PES packets of an I picture, a B picture, and a B picture, or combining three PES packets of a P picture, a B picture, and a B picture. Unit. The A / V mixing unit 5 also sets the earliest value among the PTS times of the combined three-frame images as PTS1,
Assuming that the earliest value of the image of the next three frames is PTS2, audio PES packets having PTSs after PTS1 and before PTS2 are combined into an edit unit, an audio edit unit, and a video edit unit. A mixed PES is generated by alternately arranging the editing units.

In step S4, the A / V mixing section 5
Generates an SB whose data type is AUX and AUX mode is AUX_V or AUX_A, records auxiliary information such as copyright information in those data areas, and inserts the SB of the AUX at the boundary of the mixed PES I do.

In step S5, the A / V mixing section 5
Is a video PE that is mixed and placed in order to use the data area as an SB data area of PES_VIDEO or PES_AUDIO.
The S packet and the audio PES packet are divided into 95 P bytes for each PES packet. Further, the A / V mixing unit 5
As described above with reference to FIG. 8, when the PES packet is divided into 95 bytes and occupies the entire data area of the SB, 0 is recorded in the Full / Partial flag.
Generate a B header. PES packet is divided into 9
If the data length is less than 5 bytes and the data area of the SB (95 bytes) is not satisfied, the data length is recorded in the first byte of the divided PES packet that is less than 95 bytes, and the Full / Partial flag is set in the flag. 1 is generated.

In step S6, the A / V mixing section 5
Records the continuity counter value in the SB header for each of the SBs whose data types are PES_VIDEO and PES_AUDIO, completes the SB header, and adds the PES packet to the data obtained by dividing the PES packet by 95 bytes in step S5. Generate. The generated SB is held in a memory in an interleave unit built in the A / V mixing unit 5.

The A / V mixing unit 5 further includes an SB in which the data type in which the search data is recorded is SEARCH_DATA, an SB in which the data type in which the auxiliary information for the system is recorded is AUX, and the AUX mode is SYSTEM. Generate. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.

When the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing section 5 further generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.

In step S7, the A / V mixing section 5
Generates C2 parity for SBs for one track, adds C1 parity to the end of each SB, and starts outputting to the recording unit 6 in the order of recording on the magnetic tape 9.

In step S8, the recording unit 6 sets the A /
The SBs sequentially input from the V mixing unit 5 are randomized in the M-sequence in the same manner as the DV format used in the existing consumer digital VCR, and then the run-length limit and the tracking frequency are converted by 24/25 conversion. Superposition is performed, and recording is performed on the magnetic tape 9.

The second recording process will be described with reference to the flowchart of FIG. In the second recording process, the PMT (Program
The process is started when it is determined that the TS is Native based on information recorded in a descriptor or the like of the MapTable).

In step S11, the demultiplexer 7 separates the input TS into a video TS packet and an audio TS packet, and outputs them to the video PES unit 2 or the audio PES unit 4. At this time, the demultiplexer 7 detects a TS packet in which an error has occurred or a discontinuous TS packet and discards it based on the transport error indicator and the continuity counter of the header of the TS packet. The occurrence is notified to the A / V mixing unit 5 via the control unit 16. The demultiplexer 7 is further included in the TS
Discard the PCR.

The video PES conversion unit 2 includes a demultiplexer 7
And restores the video PES packet from the video TS packet input from the A / V mixer 5. Video PES
The converting unit 2 extracts auxiliary information such as copyright information from the video TS packet and outputs the auxiliary information to the A / V mixing unit 5. In addition,
Since the restored video PES packet is Native, each P
An ES packet is composed of one video frame.

The audio PES conversion section 4 restores the audio PES packet from the audio TS packet input from the demultiplexer 7 and outputs it to the A / V mixing section 5. The audio PES unit 4 also extracts auxiliary information such as copyright information from the audio TS packet and outputs the auxiliary information to the A / V mixing unit 5. Since the restored audio PES packet is Native, each PES packet is composed of one audio frame (AAU).

The A / V mixing unit 5 converts the video PES packet from the video PES conversion unit 2 into three PES packets of I picture, B picture, and B picture, or
Three PEs: P picture, B picture, and B picture
S packets are combined into an edit unit. A / V mixing section 5
Also, as shown in FIG. 17, when the earliest value of the combined PTS times of the image of the three frames is PTS1, and the earliest value of the next three frames of the image is PTS2, the PTS
An audio PES packet having a PTS after PTS 1 and before PTS2 is combined into an edit unit, and the PES packets are alternately arranged in the order of an audio edit unit and a video edit unit to generate a mixed PES. FIG. 17 shows a delay amount until the input TS is recorded as a PES by the second recording process.

In step S12, A / V mixing section 5
Generates an SB having a data type of AUX and an AUX mode of AUX_V, records auxiliary information such as copyright information input from the video PES conversion section 2 in the data area, and stores the SB in the video PES. Join to a packet. A / V mixing section 5
Also, if the data type is AUX and the AUX mode is AUX_A
Is generated and an audio PES is stored in the data area.
The auxiliary information such as the copyright information input from the converting unit 4 is recorded, and the SB is combined with the audio PES packet.

In step S13, the A / V mixing section 5
Is a video PE that is mixed and placed in order to use the data area as an SB data area of PES_VIDEO or PES_AUDIO.
The S packet and the audio PES packet are divided into 95 P bytes for each PES packet. Further, the A / V mixing unit 5
As described above with reference to FIG. 8, when the PES packet is divided into 95 bytes and occupies the entire data area of the SB, 0 is recorded in the Full / Partial flag.
Generate a B header. PES packet is divided into 9
If the data length is less than 5 bytes and the data area of the SB (95 bytes) is not satisfied, the data length is recorded in the first byte of the divided PES packet that is less than 95 bytes, and the Full / Partial flag is set in the flag. 1 is generated.

In step S14, the A / V mixing section 5
Is used to record the continuity counter value in the SB header and complete the SB header for each of the SBs whose data types are PES_VIDEO and PES_AUDIO. In step S13, the PES packet is added to the data obtained by dividing the PES packet into 95 bytes, and the SB is added. Generate. The generated SB is held in a memory in an interleave unit built in the A / V mixing unit 5.

The A / V mixing section 5 further includes an SB whose data type for recording search data is SEARCH_DATA and an SB whose data type for recording auxiliary information for the system is AUX and the AUX mode is SYSTEM. Generate. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.

When the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 further generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.

When the error or discontinuity of the TS packet is notified from the demultiplexer 7 via the control unit 16, the A / V mixing unit 5 determines in steps S13 and S14 that the odd Is recorded in the SB by Partial, and the data after the error is recorded in a new SB. Further, the new S
In the continuity counter of the header of B, a discontinuous value is intentionally recorded so that the position of the error can be identified during reproduction.

In step S15, the A / V mixing section 5
Generates C2 parity for SBs for one track, adds C1 parity to the end of each SB, and starts outputting to the recording unit 6 in the order of recording on the magnetic tape 9.

In step S16, the recording unit 6
The SBs sequentially input from the / V mixing unit 5 are randomized in the M-sequence in the same manner as the DV format used in the existing consumer digital VCR, and then run-length limited and tracking frequency by 24/25 conversion. Are superimposed and recorded on the magnetic tape 9.

The third recording process will be described with reference to the flowchart of FIG. The third recording process is a descrip of the PMT input to the demultiplexer 7 together with the TS.
Based on the information recorded in the tor, etc., the TS
This is started when it is determined that the program is -Native and satisfies the condition that the third recording process can be applied (the program is a single program, and vbv_delay is added to the video ES).

In step S21, the demultiplexer 7 separates the input TS into a video TS packet and an audio TS packet, and outputs them to the video PES unit 2 or the audio PES unit 4. At this time, the demultiplexer 7 detects a TS packet in which an error has occurred or a discontinuous TS packet and discards it based on the transport error indicator and the continuity counter of the header of the TS packet. The occurrence is notified to the A / V mixing unit 5 via the control unit 16. The demultiplexer 7 further detects a TS packet of the PSI from the TS and supplies the TS packet to the A / V mixing unit 5. The demultiplexer 7 further discards the PCR included in the TS.

The video PES conversion unit 2 includes a demultiplexer 7
The video PES packet is restored from the video TS packet input from the STA, and it is determined whether or not the video PES packet is composed of one video frame. If it is determined that the video PES packet is not composed of one video frame, the ES After that, PTS and DTS are interpolated and are composed of one frame
Converts to PES packet similar to Native, A / V mixing unit 5
Output to The video PES conversion unit 2 also extracts auxiliary information such as copyright information from the video TS packet and outputs it to the A / V mixing unit 5.

The audio PES conversion section 4 restores the audio PES packet from the audio TS packet input from the demultiplexer 7 and determines whether or not the audio PES packet is composed of one audio frame (AAU). If it is determined that the frame is not composed of one audio frame, after ES conversion, the PTS is interpolated, converted into a PES packet similar to the Native composed of one frame, and output to the A / V mixing unit 5 . Audio PES part 4
Extracts auxiliary information such as copyright information from the audio TS packet and outputs it to the A / V mixing unit 5.

In step S22, the A / V mixing section 5
Edits a video PES packet from the video PES conversion unit 2 by combining three PES packets of an I picture, a B picture, and a B picture, or combining three PES packets of a P picture, a B picture, and a B picture. Unit. The A / V mixing unit 5 also sets the earliest value among the PTS times of the combined three-frame images as PTS1,
Assuming that the earliest value of the image of the next three frames is PTS2, audio PES packets having PTSs after PTS1 and before PTS2 are combined into an edit unit, an audio edit unit, and a video edit unit. A mixed PES is generated by alternately arranging the editing units.

In step S23, A / V mixing section 5
Generates an SB having a data type of AUX and an AUX mode of AUX_V, records auxiliary information such as copyright information input from the video PES conversion section 2 in the data area, and stores the SB in the video PES. Join to a packet. A / V mixing section 5
Also, if the data type is AUX and the AUX mode is AUX_A
Is generated and an audio PES is stored in the data area.
The auxiliary information such as the copyright information input from the converting unit 4 is recorded, and the SB is combined with the audio PES packet. A
The / V mixing unit 5 further has a data type of AUX,
An SB having a UX mode of PSI-1 and an SB having an AUX mode of PSI-2 are generated, and the first half of the PSI TS packet from the demultiplexer 7 is recorded in the SB data area of the PSI-1. The second half of the PSI TS packet is recorded in the second SB data area.

In step S24, A / V mixing section 5
Is a video PE that is mixed and placed in order to use the data area as an SB data area of PES_VIDEO or PES_AUDIO.
The S packet and the audio PES packet are divided into 95 P bytes for each PES packet. Further, the A / V mixing unit 5
As described above with reference to FIG. 8, when the PES packet is divided into 95 bytes and occupies the entire data area of the SB, 0 is recorded in the Full / Partial flag.
Generate a B header. PES packet is divided into 9
If the data length is less than 5 bytes and the data area of the SB (95 bytes) is not satisfied, the data length is recorded in the first byte of the divided PES packet that is less than 95 bytes, and the Full / Partial flag is set in the flag. 1 is generated.

In step S25, the A / V mixing section 5
Completes the SB header by recording the continuity counter value in the SB header of the SB whose data type is PES_VIDEO and the SB whose data type is PES_AUDIO, and adds it to the PES packet divided into 95 bytes in step S5. To generate an SB. The generated SB is A / V
The data is stored in a memory in an interleave unit built in the mixing unit 5.

The A / V mixing unit 5 further includes an SB whose search data is recorded in the data type SEARCH_DATA, an AUX data type in which the auxiliary information for the system is recorded, and an SB in which the AUX mode is SYSTEM. Generate. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.

When the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 further generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.

When the error or discontinuity of the TS packet is notified from the demultiplexer 7 via the control unit 16, the A / V mixing unit 5 determines in steps S24 and S25 that the odd data immediately before the error is received. Is left, the Partial flag is set and the SB is recorded, and the data after the error is recorded in the new SB. further,
A discontinuous value is intentionally recorded in the continuity counter of the header of the new SB so that the position of the error can be identified at the time of reproduction.

In step S26, A / V mixing section 5
Generates C2 parity for SBs for one track, adds C1 parity to the end of each SB, and starts outputting to the recording unit 6 in the order of recording on the magnetic tape 9.

In step S27, the recording unit 6
The SBs sequentially input from the / V mixing unit 5 are randomized in the M-sequence in the same manner as the DV format used in the existing consumer digital VCR, and then run-length limited and tracking frequency by 24/25 conversion. Are superimposed and recorded on the magnetic tape 9.

The fourth recording process will be described with reference to the flowchart of FIG. The fourth recording process is a descrip of the PMT input to the demultiplexer 7 together with the TS.
Based on the information recorded in the tor, etc., the TS
The process is started when it is determined that the data is -Native and does not satisfy the conditions for applying the third recording process (the program is not a single program or vbv_delay is not added to the video ES).

In step S 31, the demultiplexer 7 separates the input Non-Native TS into each TS packet and outputs the TS packet to the A / V mixer 5. After removing the leading sync byte from the input TS packet, the A / V mixing unit 5 sets the first 92 bytes and the second 95 bytes.
When the data type is TS-1, the data type of which is divided into two bytes and the first half of which is 92 bytes recorded in the data area is TS-1;
Generate an SB that is -2.

In step S32, the A / V mixing section 5
Adds a time stamp indicating the arrival time to 27 bits consisting of the 3 bits on the LSB side of the header of the SB having the data type TS-1 generated in step S31 and the first 3 bytes of the data area.

In step S33, the A / V mixing section 5
Records a continuity count value indicating the continuity of the TS packet in 5 bits on the LSB side of the header of the SB whose data type is TS-2 generated in step S31. The generated SB is held in a memory built in the A / V mixing unit 5. The corresponding SBs of TS-1 and TS-2 are:
Place them as continuously as possible. Even if an error or discontinuity occurs in the TS packet, it is recorded on the SB as it is.

The A / V mixing unit 5 further includes an SB whose data type for recording search data is SEARCH_DATA, an AUX whose data type for recording auxiliary information for the system is AUX, and an AUX mode of SYSTEM. Generate. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.

When the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 generates an SB having a data type of NULL. The generated SB is held in a memory built in the A / V mixing unit 5.

In step S34, A / V mixing section 5
Outputs the SBs from the built-in memory to the recording unit 6 in the order of recording on the magnetic tape 9. The recording unit 6 converts the SBs sequentially input from the A / V mixing unit 5 into M, as in the DV format used in the existing consumer digital VCR.
After randomizing the sequence, run length limitation and tracking frequency superimposition are performed by 24/25 conversion.
The information is recorded on the magnetic tape 9.

Next, the reproduction process of the AV recording / reproducing apparatus to which the present invention is applied will be described. This AV recording / reproducing apparatus reads and decodes the PES or TS recorded on the magnetic tape 9 by the above-described four types of recording processing, decodes the PES or TS, and outputs the obtained video signal and audio signal. A TS output process of reading the PES recorded in the PES and converting the PES into a TS is output.

The TS output processing of the AV recording / reproducing apparatus will be described with reference to the flowchart of FIG. 20 and FIG. In this TS output process, the SBs sequentially read out from the magnetic tape 9 by the reproducing unit 10 are reproduced into PES packets (including error correction based on parity data and the like) and supplied to the TS converting unit 14, and Picture of
Triggered when a PES packet is detected. FIG. 21 shows the amount of delay until the read PES is output as a TS.

Step S41 (corresponding to FIG. 22)
, The TS output unit 14 reads the DTS from the PES header of the I picture, reads vbv_delay from the picture header, calculates DTS- (vbv_delay), and further calculates DTS- (vbv_delay).
lay) and the time obtained by subtracting the predetermined time from the
(System Time Clock) and start self-running of STC counter.

Step S42 (corresponding to FIG. 22)
, The TS output unit 14 generates a PAT and a PMT PSI packet and outputs them at predetermined intervals. As a result, the receiving side of the TS can receive and recognize the PAT and the PMT before receiving the video and audio TS packets, thereby causing a problem that the reproduction of the first GOP is missing. Can be deterred.

Step S43 (corresponding to FIG. 22)
, The TS output unit 14 outputs a PCR packet recording the value of the STC at an arbitrary interval.

Step S44 (corresponding to FIG. 22)
In TS, the TS output unit 14
Time when vbv_delay is subtracted from DTS of I picture (DTS- (vb
v_delay)) and when the STC matches, the video PES
The packet is converted into a TS and output is started. For the subsequent pictures, the PES packet is converted into a TS and output at the timing when the time obtained by subtracting vbv_delay from the DTS matches the DTS. Note that since no DTS is recorded in the B picture, the same processing is performed using the PTS instead.

The TS output unit 14 also (as processing corresponding to FIG. 22) calculates the time (PTS-PTS−T) obtained by subtracting Start Up Delay from the PTS of the first frame (AAU) for audio.
(Start Up Delay)) and the STC match, the audio PES packet is converted to TS and output is started.
Note that the audio output rate is made to exactly match the value recorded in the bit rate index (Bitrate_index) of the header.

Note that the AV recording / reproducing apparatus can further output a TS recorded on the magnetic tape 9 in a TS state.

Next, as points to be noted in the TS output processing of the TS conversion section 14, the output interval of video TS packets,
Processing of AUX data (auxiliary information), processing of outputting a non-native TS recorded on the magnetic tape 9, error processing of PES recording, and error processing of TS recording are listed.

First, the output interval of video TS packets will be described. Vbv_delay other than 0xFFFF is recorded in the picture header of the PES read and reproduced from the magnetic tape 9, and the bit rate (b
If the value of (it_rate) exactly matches the output rate, that is, if the PES is Native, it is converted to a TS at a slightly higher rate than the bit rate. What is necessary is just to wait until is input.

Also, vbv_delay is not recorded in the picture header of the PES read and reproduced from the magnetic tape 9 (0xFFFF is recorded), or the bit rate (bit_rate) value and output rate of the sequence header are accurate. If the PES does not match, that is, if the PES is Non-Native, (DTS- (vbv_dela)
y)) is divided by the number of bits in the picture,
What is necessary is just to output at the interval of a division value.

Next, the handling of AUX data (auxiliary information) will be described. PE read from magnetic tape 9 and reproduced
When S is Native, the AUX data is recorded in the SB with the data type of AUX_V or AUX_A by the above-described first or second recording process. The AUX data is output as it is in a TS packet. AU
X_V is combined with video PES, AUX_A is audio PES
Video or audio PES
AUX data is converted to TS in accordance with the timing and output.

[0128] The PMT is generated only for Native. The PMT records each PID of video, audio, AUX, and PCR. The PMT also records copyright information and the like of the AUX data so that the general-purpose device can interpret the copyright information and the like. The PMT further records a descriptor indicating that it is Native.

PES read from magnetic tape 9 and reproduced
Is non-native, the AUX data PAT, PMT,
And SIT etc. are recorded in the SB whose data type is AUX and the AUX mode is PSI-1 or PSI-2,
What is necessary is just to return to a TS packet and to output it. Note that T
Video, audio and PC when returning to S-packet
If the value recorded in the PMT is used as it is as the PID of the R, the PMT and the CRC (Cyclic Redundancy C
heck) can be omitted.

Next, the Non-
The process of outputting Native TS will be described. Since the time stamp is recorded on the TS recorded on the magnetic tape 9 by the above-described fourth recording process, the time stamp is output when the time stamp matches with reference to the STC at the time of reproduction. Note that the T reproduced from the magnetic tape 9
Since there is no sync byte in the S header due to the fourth recording process, this is added and output.

Next, S for the data recorded by PES
The error processing based on the continuity counter of the B header will be described with reference to FIG. Through the above-described first to third recording processes, the data type of the SB is recorded in the SB header. Therefore, when an error occurs in the SB and cannot be corrected, the data type of the SB becomes unknown.

Therefore, the S of the SB where no error has occurred is
An error occurs and cannot be corrected based on the continuity of the continuity counter value recorded in the B header.
The data type of B is determined.

Specifically, when the continuity counter value of the SB whose data type is PES-VIDEO is monitored and discontinuity of the continuity counter value of the SB before and after the SB where the uncorrectable error occurs is detected. The data type of the SB in which the uncorrectable error has occurred is determined to be PES-VIDEO. Similarly, if the continuity counter value of the SB whose data type is PES-AUDIO is monitored and discontinuity of the continuity counter value of the SB before and after the SB where the uncorrectable error occurs is detected, the uncorrectable error is detected. It is determined that the data type of the SB in which is generated is PES-AUDIO.

By such a determination, it is possible to determine whether or not an error has occurred in the SB on which the PES is recorded. Therefore, it is possible to reduce the influence of the error on the video and audio to be reproduced. Can be.

The SB of PES-VIDEO and the SB of PES-AUDIO
Even if an error has occurred at the boundary with, the error can be detected by checking the continuity with the last continuity counter value of the previous connection unit.

When the continuity counter value is continuous, the TS is continuously output, and when it is determined that the continuity counter value is discontinuous and cannot be corrected, an error code is inserted. The error code is inserted in the ES layer using a sequence error code.
(Sequence Error Code) 0x000001B4 may be inserted. In the TS layer, a packet whose transport error indicator (transport_error_indicator) is set to 1 may be output.

The continuity counter value is 0
Since it is a 4-bit value that circulates from 15 to 15, if SBs having the same data type are continuously lost in multiples of 16, it cannot be detected. Therefore, when 16 or more SBs in which an uncorrectable error has occurred continue,
An error code is inserted regardless of the data type of the SB.

Also, if this error processing is executed even when an uncorrectable error has not occurred in the SB, the discontinuous continuity counter value intentionally recorded at the time of recording can be replaced with an error at the time of reproduction. Can be treated as

Next, S for the data recorded in the TS
The error processing based on the continuity counter of the B header will be described with reference to FIG. By the above-described fourth recording process, the data type of the SB is recorded in the SB header. Therefore, when an error occurs in the SB and cannot be corrected, the data type of the SB becomes unknown.

Then, the S of the SB where no error has occurred is
An error occurs and cannot be corrected based on the continuity of the continuity counter value recorded in the B header.
The data type of B is determined.

Specifically, the data type of the normal SB sandwiching the uncorrectable SB is monitored, and the data type is changed from TS-1.
In the case of following the TS-2, the continuity of the continuity counter value recorded in the SB header of the TS-2 with the continuity counter value recorded in the SB header of the immediately preceding TS-2 is determined. . If it is determined that they are continuous, the TS-1
Of the TS-2 and the SB of the TS-2 are a pair.
Restore to packet and output. On the other hand, if it is determined that they are not continuous, the SB of the TS-1 and the SB of the TS-2 are not pairs, and both are SBs with missing pairs, so both are discarded.

Here, the discard of the TS is detected on the receiving side based on the continuity counter value recorded in the TS header of the preceding and succeeding output TS, so that the video and audio to be reproduced are not detected. The effect of the occurrence of the error can be reduced.

When the data type continues from TS-2 to TS-1, the data is output as it is without performing error processing. That is, even if the data type of the uncorrectable SB is TS-1 or TS-2, this is identified on the reproduction side based on the discontinuity of the continuity counter value of the TS header.

When the data type continues from TS-1 to TS-1, the SB of TS-1 previously read is discarded. Discarding the previously read TS-1 SB means that the playback side
It is identified based on the discontinuity of the continuity counter value of the S header.

When the data type continues from TS-2 to TS-2, the SB of TS-2 read later is discarded. Discarding the SB of TS-2 that was read later means that T
It is identified based on the discontinuity of the continuity counter value of the S header.

With the above in mind, the TS output processing is executed. Next, the effects that can be expected of the AV recording / reproducing apparatus to which the present invention is applied are listed.

At the time of recording, when recorded by ES,
The recording rate overhead can be minimized. When recorded by PES, it can be recorded so that it can be easily converted to TS. When recording with ES or PES, there is little processing during jog playback. When recording by ES or PES, the TS header and the time stamp indicating the TS arrival time are not recorded, so that the overhead can be reduced. Therefore, the recording capacity can be saved. Alternatively, the recording time can be lengthened. Since we did not record the PCR,
Low overhead. Therefore, the recording capacity can be saved. Alternatively, the recording time can be lengthened.

Further, since one PES packet is composed of one video frame, PTS is included in every frame.
Is given. This makes it easier to restore the timing when converting to TS. Also, jog reproduction is easily realized. Since one PES packet is constituted by one video frame, PTS is added to all frames.
This makes it easier to restore the timing when converting to TS. In addition, audio can be easily divided at the time of editing. Even non-Natives can be edited. Conventionally, the data type (data type) identified by the PID is represented by an identification code having a smaller number of bits than the PID, so that the overhead can be reduced.

Further, when the entire data area of the SB is occupied by valid data, Length bytes indicating the data length are not recorded, so that the overhead can be reduced. PS
When the section of the I information is divided into a plurality of TS packets, the head is identified by the payload unit start indicator of the TS packet header, so the PSI should be recorded in two SBs whose data type is AUX for each TS header. Will save this.

At the time of TS output, the TS output is set to (DTS
-(vbv_delay)), so the timing can be restored even if the arrival time is not recorded. TS at an output rate slightly higher than the recorded bit_rate
Is output, so that no collision occurs at the frame boundary.
By outputting TS at regular intervals, even if bit_rate is recorded considerably higher than the actual rate, it is possible to output at an average rate. Since the PCR is performed first, the first frame can be received on the reproduction side after the PCR is loaded into the STC, and therefore, the reproduction data can be displayed without missing the beginning. Since the PAT and the PMT precede, the playback side can receive the PCR packet without dropping it. Since the location of the error can be identified, the influence of the error on the image and sound quality can be reduced. The error detected during recording can be transmitted to the reproducing side without increasing the number of bits.

The present invention can be applied to a case where an AV signal is recorded on an information recording medium other than a magnetic tape.

Incidentally, the series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software can execute various functions by installing a computer built into dedicated hardware or installing various programs. It is installed from a recording medium into a possible general-purpose personal computer or the like.

As shown in FIG. 1, this recording medium is a magnetic disk 18 (including a floppy disk) on which the program is recorded and an optical disk 19 which are distributed separately from a computer to provide the program to the user.
(CD-ROM (Compact Disc-Read Only Memory), DVD (Digit
al Versatile Disc), magneto-optical disc 20 (M
D (including Mini Disc)), or a packaged medium including the semiconductor memory 21 and the like, which is provided to the user in a state of being incorporated in a computer in advance, and a ROM or a hard disk in which a program is recorded. It consists of.

In the present specification, the steps of describing a program recorded on a recording medium may be performed in a chronological order according to the described order. Alternatively, it also includes individually executed processing.

In this specification, the system is
It represents the entire device composed of a plurality of devices.

[0156]

As described above, according to the reproducing apparatus and method of the present invention, and the program of the recording medium, the decoding time stamp or the presentation time stamp included in the header of the read packetized elementary stream packet is used. The system time clock is initialized using the value of the system time clock read at a predetermined interval, a program clock reference packet is generated, and the time obtained by delaying the system time clock by a predetermined time, and the packetized elementary stream When the decoding time stamp or the presentation time stamp included in the packet header matches the time indicated by the presentation time stamp, the packetized elementary stream packet is transport-streamed. Since so as to convert the packet, it is possible to output the packetized elementary stream packets recorded as TS.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration example of an AV recording / reproducing apparatus to which the present invention has been applied.

FIG. 2 is a diagram showing an ES recording method.

FIG. 3 is a diagram showing a PES recording method.

FIG. 4 is a diagram showing a data structure of a TS packet.

FIG. 5 is a diagram showing a data structure of a PES packet.

FIG. 6 is a diagram showing SBs in one track.

FIG. 7 is a diagram showing an SB header.

FIG. 8 is a diagram illustrating a data structure of an SB whose data type is PES-VIDEO or PES-AUDIO.

FIG. 9 is a diagram showing a data structure of an SB whose data type is AUX.

FIG. 10 is a diagram showing a data structure of an SB having a data type of TS-1 or TS-2.

FIG. 11 is a diagram illustrating a concept of a first recording process.

FIG. 12 is a diagram illustrating a concept of a second recording process.

FIG. 13 is a diagram illustrating a concept of a third recording process.

FIG. 14 is a diagram illustrating a concept of a fourth recording process.

FIG. 15 is a flowchart illustrating a first recording process.

FIG. 16 is a flowchart illustrating a second recording process.

FIG. 17 is a diagram illustrating a delay amount in a second recording process.

FIG. 18 is a flowchart illustrating a third recording process.

FIG. 19 is a flowchart illustrating a fourth recording process.

FIG. 20 is a flowchart illustrating a TS output process.

FIG. 21 is a diagram illustrating a delay amount in a TS output process.

FIG. 22 is a diagram for explaining TS output processing.

FIG. 23 is a diagram for explaining error processing during PES recording.

FIG. 24 is a diagram for explaining error processing during TS recording.

[Explanation of symbols]

1 video encoding unit, 2 video PES conversion unit, 3
Audio encoding section, 4 audio PES section, 5 A / V mixing section, 6 recording section, 7 demultiplexer, 9 magnetic tape, 10 playback section, 11
A / V separation unit, 12 video decoding unit, 13
Audio decoding unit, 14 TS conversion unit, 16 control unit, 17 drive, 18 magnetic disk, 1
9 optical disk, 20 magneto-optical disk, 21 semiconductor memory

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C018 AB01 AB10 AB13 5C053 FA14 FA21 GA11 GB06 GB10 GB11 GB15 GB37 JA01 JA22 5C059 KK36 MA00 PP05 PP06 PP07 RB03 RB10 RB14 RC04 RC32 SS16 SS20 5D044 AB05 AB07 BC01 CC01 DE04 GK08HL07

Claims (9)

[Claims] 1. A reproducing apparatus for converting an AV signal recorded as a packetized elementary stream packet on an information recording medium into a transport stream, comprising: reading out the packetized elementary stream packet from the information recording medium; Means, initialization means for initializing a system time clock using a decoding time stamp or a presentation time stamp included in a header of the packetized elementary stream packet, and a value of the system time clock read at a predetermined interval First generating means for generating a program clock reference packet, a time obtained by delaying the system time clock by a predetermined time, and a packetized elementary stream packet. Conversion means for converting the packetized elementary stream packet into a transport stream packet at a timing when the time indicated by the decoding time stamp or the presentation time stamp included in the header of the packet matches. Playback device. 2. The initialization unit according to claim 1, wherein a value obtained by subtracting a predetermined time from the decoding time stamp or the presentation time stamp included in the header of the packetized elementary stream packet from which reproduction is started first is used. Using the system time clock, wherein the first generation unit calculates a timing at which the packetized elementary stream packet whose reproduction is first started is converted into the transport packet by the conversion unit. 2. The reproducing apparatus according to claim 1, wherein the generation of the program clock reference packet is started earlier by a predetermined time. 3. The method according to claim 1, further comprising a second generation unit that generates a program association table packet and a program map table packet, wherein the second generation unit starts the generation of the program clock reference packet by the first generation unit. 2. The reproducing apparatus according to claim 1, wherein the generation of the program association table packet and the program map table packet is started ahead of a predetermined time by a predetermined time. 4. The system according to claim 1, wherein the converting unit delays the system time clock by vbv_delay recorded in a picture header, and decodes the decoding time included in the header of the packetized elementary stream packet of video. 2. The playback device according to claim 1, wherein the packetized elementary stream packet of the video is converted into a transport stream packet at a timing when a time indicated by a stamp or the time indicated by the presentation time stamp matches. 5. The apparatus according to claim 1, wherein the converting means converts the packetized elementary stream packets of the video into transport stream packets at a fixed rate and outputs the packets intermittently. Playback device. 6. The reproducing apparatus according to claim 1, wherein the converting means converts the packetized elementary stream packets of the video into transport stream packets at a variable rate, and outputs the transport stream packets at equal intervals. apparatus. 7. The conversion unit according to claim 1, wherein a time obtained by delaying the system time clock by a predetermined time matches a time indicated by the presentation time stamp included in the header of the audio packetized elementary stream packet. 2. The reproducing apparatus according to claim 1, wherein the packetized elementary stream packet of the audio is converted into a transport stream packet at the timing. 8. A reproducing method of a reproducing apparatus for converting an AV signal recorded as a packetized elementary stream packet on an information recording medium into a transport stream, wherein the packetized elementary stream packet is transmitted from the information recording medium. A reading step of reading a packet; an initialization step of initializing a system time clock using a decoding time stamp or a presentation time stamp included in a header of the packetized elementary stream packet; and the system time reading at a predetermined interval. A first generation step of generating a program clock reference packet using a clock value; a time obtained by delaying the system time clock by a predetermined time; Converting the packetized elementary stream packet into a transport stream packet at a timing when the time indicated by the decoding time stamp or the presentation time stamp included in the header of the binary stream packet matches. A reproduction method characterized by the above-mentioned. 9. A reproduction program for converting an AV signal recorded as a packetized elementary stream packet on an information recording medium into a transport stream, wherein the packetized elementary stream is transmitted from the information recording medium. A reading step of reading a packet; an initialization step of initializing a system time clock using a decoding time stamp or a presentation time stamp included in a header of the packetized elementary stream packet; and the system reading at a predetermined interval. A first generation step of generating a program clock reference packet using a time clock value; a time obtained by delaying the system time clock by a predetermined time; Converting the packetized elementary stream packet into a transport stream packet at a timing when the time indicated by the decoding time stamp or the presentation time stamp included in the header of the binary stream packet matches. A recording medium on which a computer-readable program is recorded.