JP4254007B2 - Playback apparatus and method, and recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a playback apparatus and method, and a recording medium, and, for example, a playback apparatus suitable for use when, for example, outputting an AV signal recorded as a packetized elementary stream packet on an information recording medium as a transport stream, and The present invention relates to a method and a recording medium.
[0002]
[Prior art]
Like the DV format used in consumer digital VCR (Video Cassette Recorder), video signals are encoded with intra-frame compression, and the corresponding audio signals are encoded so that they can be uncompressed or instantaneously expanded. There is a system for recording on magnetic tape.
[0003]
The video signal and the audio signal encoded by the DV format and recorded on the recording medium are suitable for editing such that video and audio are connected at arbitrary positions.
[0004]
However, when the DV format signal compression rate is low, a recording system with a high transfer rate is required, a medium with a large storage capacity is required, or the capacity of the information recording medium is limited. Has problems such as a short recording time.
[0005]
In order to solve such a problem, a video signal and an audio signal are compression-coded using an MPEG (Moving Picture Experts Group) method, and recorded in a transport stream (hereinafter also referred to as TS) recording medium. There is already a recording system.
[0006]
According to a system using the MPEG system, a video signal is inter-frame compressed with a Long GOP (Group Of Picture) composed of images of a plurality of frames, and an audio signal is frame-compressed with a plurality of samples. Therefore, a high compression rate can be realized. Therefore, a recording system with a high transfer rate is not required, the capacity of the recording medium can be saved, and when the capacity of the recording medium is limited, the recording time is extended as compared with a DV format system. There are advantages.
[0007]
[Problems to be solved by the invention]
However, a system that records video signals and audio signals compressed and encoded in the MPEG format in the TS state has the following problems.
[0008]
That is, the video signal is MPEG-compressed in units of Long GOP as described above, but depending on the image type (I (Intra) picture, P (Predictive) picture, or B (Bidirectionally predictive) picture), the picture pattern, etc. The data length of one frame image is not constant (it is not compressed at a fixed rate). On the other hand, the audio signal is compressed at a fixed rate. Therefore, even if the corresponding video signal and audio signal are encoded at the same time, there is a possibility that the corresponding video signal and audio signal packets will be arranged at positions separated on the TS.
[0009]
If the corresponding video signal and audio signal packets are placed at a distance from each other on the TS, the video signal connection timing and the audio signal connection timing will not match when editing is performed to connect the TSs halfway. There was a problem that one of the data was missing.
[0010]
Also, it is necessary to add a TS packet, a time stamp indicating the arrival time to the decoder, a PCR packet storing a PCR (Program Clock Reference) as a time reference at the time of decoding, and the like to the TS. Therefore, there is a problem that the recording rate is lowered by the overhead.
[0011]
Furthermore, since video signals and audio signals recorded in the TS state are difficult to perform so-called jog playback such as pause playback (PAUSE), slow playback, and reverse playback, in order to enable jog playback, There was a problem that had to be converted into an elementary stream.
[0012]
The present invention has been made in view of such a situation, and it is intended to record a video signal and an audio signal compressed and encoded using the MPEG system as a packetized elementary stream and output it as a TS. Objective.
[0013]
[Means for Solving the Problems]
The reproducing apparatus of the present invention uses a reading time unit for reading a packetized elementary stream packet from an information recording medium, and a system time clock using a decoding time stamp or a presentation time stamp included in the header of the packetized elementary stream packet. Initialization means for initializing, a first generation means for generating a program clock reference packet using a value of a system time clock read at a predetermined interval, a time at which the system time clock is delayed by a predetermined time, At the timing when the time indicated by the decoding time stamp or presentation time stamp included in the header of the packetized elementary stream packet matches, the packetized elementary list is displayed. Characterized in that it comprises a conversion means for converting the Mupaketto into transport stream packets.
[0014]
The initialization means initializes a system time clock using a value obtained by subtracting a predetermined time from a decoding time stamp or a presentation time stamp included in a header of a packetized elementary stream packet from which playback is started first. The first generation means precedes a timing at which a packetized elementary stream packet that is first played back is converted into a transport packet by a conversion means by a predetermined time. Then, the generation of the program clock reference packet can be started.
[0015]
The reproduction apparatus of the present invention can further include second generation means for generating a program association table packet and a program map table packet, wherein the second generation means is configured such that the first generation means includes a program clock reference packet. The generation of the program association table packet and the program map table packet can be started ahead of the generation start timing by a predetermined time.
[0016]
The conversion means includes a time obtained by delaying the system time clock by vbv_delay recorded in the picture header, and a time indicated by a decoding time stamp or a presentation time stamp included in the header of the packetized elementary stream packet of the video. The video packetized elementary stream packet can be converted into a transport stream packet at the matching timing.
[0017]
The converting means may convert video packetized elementary stream packets into transport stream packets at a fixed rate and intermittently output them.
[0018]
The converting means may convert video packetized elementary stream packets into transport stream packets at a variable rate and output them at equal intervals.
[0019]
The conversion means performs the audio packetized at the timing when the time when the system time clock is delayed by a predetermined time and the time indicated by the presentation time stamp included in the header of the audio packetized elementary stream packet match. Elementary stream packets can be converted into transport stream packets.
[0020]
The reproducing method of the present invention includes a reading step of reading a packetized elementary stream packet from an information recording medium, and a system time clock using a decoding time stamp or a presentation time stamp included in the header of the packetized elementary stream packet. An initialization step for initializing, a first generation step for generating a program clock reference packet using a value of a system time clock read at a predetermined interval, a time at which the system time clock is delayed by a predetermined time, When the time indicated by the decoding time stamp or the presentation time stamp included in the header of the packetized elementary stream packet matches, Characterized in that it comprises a conversion step of converting a stream packet in the transport stream packet.
[0021]
The recording medium program of the present invention is a system that uses a reading step of reading a packetized elementary stream packet from an information recording medium and a decoding time stamp or presentation time stamp included in the header of the packetized elementary stream packet. An initialization step for initializing a time clock, a first generation step for generating a program clock reference packet using a system time clock value read at a predetermined interval, and a time at which the system time clock is delayed by a predetermined time And the time indicated by the decoding time stamp or presentation time stamp included in the header of the packetized elementary stream packet. Characterized in that it comprises a conversion step of converting the Zudo elementary stream packets into transport stream packets.
[0022]
In the playback apparatus and method and the recording medium program of the present invention, a packetized elementary stream packet is read from the information recording medium, and a decoding time stamp or presentation included in the header of the packetized elementary stream packet The system time clock is initialized using the time stamp. In addition, a program clock reference packet is generated using a system time clock value read at a predetermined interval, and is included in the time when the system time clock is delayed by a predetermined time and the header of the packetized elementary stream packet. At the timing when the time indicated by the decoding time stamp or the presentation time stamp matches, the packetized elementary stream packet is converted into a transport stream packet.
[0023]
DETAILED DESCRIPTION OF THE INVENTION
An AV recording / reproducing apparatus to which the present invention is applied will be described. This AV recording / playback device converts input video and audio baseband signals into a packetized elementary stream (hereinafter also referred to as PES) and records it on a magnetic tape. The recorded TS is recorded on the magnetic tape, and the input TS is recorded on the magnetic tape in the TS state. The AV recording / reproducing apparatus also reproduces the PES recorded on the magnetic tape or converts the PES recorded on the magnetic tape into a TS for output.
[0024]
FIG. 1 shows a configuration example of an AV recording / reproducing apparatus. The video encoding unit 1 encodes an input video baseband signal by the MPEG method to generate a video elementary stream (hereinafter referred to as ES), and outputs it to the video PES converting unit 2. The video PES converting unit 2 converts the video ES input from the video encoding unit 1 to PES and outputs the PES to the A / V mixing unit 5. Video PES conversion unit 2 The video ES input from the video encoding unit 1 can also be output to the A / V mixing unit 5 as it is. The video PES converting unit 2 further converts the video TS packet input from the demultiplexer 7 to PES and outputs the PES to the A / V mixing unit 5.
[0025]
The audio encoding unit 3 encodes the input audio baseband signal by the MPEG method to generate an audio ES, and outputs the audio ES to the audio PES converting unit 4. The audio PES converting unit 4 converts the audio ES input from the audio encoding unit 3 to PES and outputs the PES to the A / V mixing unit 5. The audio PES conversion unit 4 can also output the audio ES input from the audio encoding unit 3 to the A / V mixing unit 5 as it is. The audio PES converting unit 4 further converts the audio TS packet input from the demultiplexer 7 into a PES and outputs the PES to the A / V mixing unit 5.
[0026]
The A / V mixing unit 5 converts the video PES packet input from the video PES conversion unit 2 and the audio PES packet input from the audio PES conversion unit 4 into a predetermined recording format (described later), and obtains the result. The sync block is output to the recording unit 6. The A / V mixing unit 5 also adds a time stamp to the TS packet input from the demultiplexer 7, converts it to a predetermined recording format, and outputs the resulting sync block to the recording unit 6. The A / V mixing unit 5 further adds a time stamp to the editing unit (described later) of the video ES that has passed through the video PES unit 2 and the editing unit of the audio ES that has passed through the audio PES unit 4. The data is converted into a recording format, and the obtained sync block is output to the recording unit 6.
[0027]
The recording unit 6 randomizes the sync block input from the A / V mixing unit 5 in the M series in the same manner as the DV format used in the existing consumer digital VCR, and then executes the run by 24/25 conversion. The length limit and the tracking frequency are superimposed and recorded on the magnetic tape 9.
[0028]
The demultiplexer 7 outputs the video TS packet included in the input TS to the video PES converting unit 2, outputs the audio TS packet to the audio PES converting unit 4, and performs PSI (Program System Infor m ation) TS packet is output to the A / V mixing unit 5. The demultiplexer 7 also separates the input Non-Native (described later) TS into TS packets and outputs the TS packets to the A / V mixing unit 5. At this time, the demultiplexer 7 may discard the PCR packet.
[0029]
The reproducing unit 10 reads the sync block recorded on the magnetic tape 9 to reproduce the PES, and outputs the PES to the A / V separating unit 11 or the TS unit 14. The reproducing unit 10 also reads the sync block recorded on the magnetic tape 9 to reproduce the TS, and outputs the TS to the A / V separating unit 11 or the TS unit 14.
[0030]
The A / V separator 11 converts the PES or TS input from the playback unit 10 into a video data stream. When The audio data stream is separated and output to the corresponding video decoding unit 12 or audio decoding unit 13.
[0031]
The video decoding unit 12 decodes the video data stream input from the A / V separation unit 11 and outputs an obtained video signal. The audio decoding unit 13 decodes the audio data stream input from the A / V separation unit 11 and outputs an obtained audio signal.
[0032]
The TS unit 14 converts the PES input from the playback unit 10 into a TS and outputs the TS. The TS unit 14 also adds the sync byte to the head of the TS packet from which the sync byte (described later) of the TS input from the playback unit 10 has been removed, and outputs it.
[0033]
The control unit 16 controls the drive 17 to read a control program stored in the magnetic disk 18, the optical disk 19, the magneto-optical disk 20, or the semiconductor memory 21, and perform AV recording based on the read control program. Control each part of the playback device.
[0034]
Next, a recording method of the AV recording / reproducing apparatus will be described. FIG. 2 shows an example in which ES is recorded on the magnetic tape 9. As shown in the figure, with respect to video, an editing unit is formed by combining every three frames of I picture, B picture, and B picture, or every three frames of P picture, B picture, and B picture. Corresponding audio editing units are arranged between (3 frames).
[0035]
The figure shows an example in which a video editing unit consisting of 3 frames is arranged in correspondence with an audio editing unit consisting of 4 frames (same as AAU: Audio Access Unit) or an audio editing unit consisting of 5 frames. It is shown.
[0036]
However, in practice, the number of audio frames corresponding to three frames of video is usually not an integer. Therefore, a dedicated time stamp (TS) indicating the reproduction time is added to each video and audio editing unit. Thereby, it becomes possible to reproduce | regenerate video and audio synchronizing.
[0037]
Hereinafter, the recording method as shown in FIG. 2 is described as an ES recording method.
[0038]
According to the ES recording method, a video editing unit with a dedicated time stamp and an audio editing unit with a corresponding dedicated time stamp are arranged adjacent to each other for recording. It is possible to suppress the occurrence of inconvenience that the combined timing is shifted between video and audio.
[0039]
FIG. 3 shows an example in which PES is recorded on the magnetic tape 9. Specifically, the PES packet syntax is applied to the video editing unit consisting of the above three frames and the corresponding audio editing unit without adding the dedicated time stamp shown in FIG. Time management information PTS (Presentation Time Stamp) and decoding time management information DTS (Decoding Time Stamp) are added to form a PES packet.
[0040]
Hereinafter, the method of recording as shown in FIG. 3 is described as a PES recording method.
[0041]
The advantage of the PES recording method over the ES recording method is that, when reading from the magnetic tape 9 and outputting it as TS to the outside of the apparatus, conversion to TS is easy due to the addition of PTS and DTS. .
[0042]
By the way, the structure of the PES packet is not unique. For video, for example, when one PES packet is composed of one video frame, or one PES packet is composed of GOPs composed of a plurality of video frames. There is a case. For audio, for example, one PES packet may be composed of one audio frame (AAU), or one PES packet may be composed of a plurality of audio frames.
[0043]
Therefore. In order to make editing easier, the PES structure in the PES recording system is unified so that one frame is composed of one PES packet for both video and audio.
[0044]
Next, a recording format suitable for recording PES on the magnetic tape 9 will be described. Before that, the data structure of TS packets and PES packets will be described. The recording format can also be applied when ES is recorded on the magnetic tape 9. The recording format can also correspond to a TS such as a multi-program.
[0045]
FIG. 4 shows the data structure of the TS packet. TS packet is 8 bit sync byte (sync_byte), 1 bit transport error indicator (transport_error_indicator), 1 bit payload unit start indicator (payload_unit_start_indicator), 1 bit transport priority (transport_priority), 13 bit packet identification Information (Packet_ID), 2 bits of scramble control (transport_scrambling_control), 2 bits of adaptation field control (adaptation_field_control), 4 bits of continuity counter (continuity_counter), and a fixed length (hereinafter, 184 bytes of adaptation field) 188 bytes).
[0046]
The sync byte represents the head of the TS packet. The transport error indicator represents the presence / absence of a bit error in the TS packet. The payload unit start indicator indicates that the head of the PES packet is recorded in the payload of the TS packet. The packet priority represents the importance of the TS packet. The packet identification information represents the attribute of the individual stream of the TS packet. The scramble control represents the presence / absence and type of the payload of the TS packet. The adaptation field control represents the presence / absence of an adaptation field and the presence / absence of a payload. The continuity counter represents the order of a plurality of TS packets having the same packet identification information.
[0047]
In the adaptation field, in addition to the program time base reference value PCR, additional information related to the individual stream is recorded. In the adaptation field, if additional information to be recorded is less than 184 bytes, a stuffing byte is recorded. In the payload, a divided PES packet, program specification information PSI (Program Specific Information), and the like are recorded.
[0048]
FIG. 5 shows the data structure of the PES packet. The PES packet includes a 32-bit packet start code, a 16-bit PES packet length, a 2-bit “10”, a 14-bit flag and control, an 8-bit PES header data length ( PES header data length), 40-bit PTS, 40-bit DTS, 152-bit other information, PES header consisting of 8N-bit stuffing bytes, and variable-length PES payload consisting of undefined data length Packet.
[0049]
The packet start code is composed of a 24-bit start start code and an 8-bit stream ID and represents the start of the PES packet. In the PES packet length, the data length of the PES packet is recorded. “10” following the PES packet length indicates that the packet is a PES packet. In the flag and control, scrambled presence / absence and type of the PES packet, priority, copyright information, and the like are recorded. The PES header data length records the data length of the PES header.
[0050]
Next, a recording format for the magnetic tape 9 will be described with reference to FIG. On one track of the magnetic tape 9, 141 sync blocks (hereinafter referred to as SB) are recorded. Error correction C2 parity is recorded in nine SBs at both ends of each track. Main data (such as PES packets) is recorded in 123 SBs sandwiched between C2 parities.
[0051]
The SB has a fixed length of 111 bytes and includes a 2-byte sync, a 3-byte ID, a 1-byte SB header, a 95-byte data area, and a 10-byte C1 parity for error correction.
[0052]
In the 3-byte ID, a track number, an SB number, and an overwrite protect code are recorded. The overwrite protect code is a value that is updated each time information is overwritten on the same SB, and is information that is used to prevent previous data from being erased during overwriting.
[0053]
FIG. 7 shows information recorded in a 1-byte (8-bit) SB header. Three bits (bit-7 to bit-5 in FIG. 7) on the MSB (Most Significant Bit) side of the SB header represent the data type of data recorded in the 95-byte data area following the SB header. Different information for each data type is recorded in 5 bits (bit-4 to bit-0 in FIG. 7) on the LSB (Least Significant Bit) side.
[0054]
When the 3 bits on the MSB side of the SB header is 000, the data type is PES-VIDEO. When the 3 bits on the MSB side of the SB header is 001, the data type is PES-AUDIO. When the data type is PES-VIDEO or PES-AUDIO, the Full / Partial flag is recorded in the 4th bit (bit-4 in FIG. 7) from the MSB side of the SB header, followed by 4 bits on the LSB side (see FIG. 7). 7 (bit-3 to bit-0) records a continuity count value indicating the continuity of SBs of the same data type.
[0055]
FIG. 8 shows the data structure of an SB whose data type is PES-VIDEO or PES-AUDIO. When the PES packet occupies the entire 95-byte data area following the SB header, 0 is recorded in the Full / Partial flag of the SB header. If the PES packet does not occupy the entire data area, 1 is recorded in the Full / Partial flag, and the data length of the PES packet that is recorded after being pre-packed is recorded in 1 byte on the MSB side of the data area. Is done.
[0056]
Returning to FIG. 7, when the 3 bits on the MSB side of the SB header is 010, the data type is SEARCH-DATA. When the data type is SEARCH-DATA, the Video / Audio flag is recorded in the fourth bit from the MSB side of the SB header, and the search speed is recorded in the next three bits. The remaining 1 bit is reserved. Search data of a fixed size is recorded in the data area. Note that the positions of SBs having a data type of SEARCH-DATA in the track are determined in advance, and SBs of other data types are arranged avoiding the position of the SB of SEARCH-DATA.
[0057]
When the 3 bits on the MSB side of the SB header are 011, the data type is AUX. When the data type is AUX, the AUX mode is recorded in the 4th to 6th bits from the MSB side of the SB header. The remaining 2 bits are reserved. Fixed-size AUX data (auxiliary information) is recorded in the data area.
[0058]
The 3-bit AUX mode represents the type of AUX data. When the 3 bits are 000, the AUX mode is AUX_V, and AUX data accompanying the video data is recorded in the data area. When the 3 bits are 001, the AUX mode is AUX_A, and AUX data accompanying audio data is recorded in the data area. When the 3 bits are 010, the AUX mode is PSI-1, and the first half of the PSI TS packet is recorded in the data area. When the 3 bits are 011, the AUX mode is PSI-2, and the latter half of the PSI TS packet is recorded in the data area. When the 3 bits are 100, the AUX mode is SYSTEM, and system AUX data is recorded in the data area.
[0059]
FIG. 9 shows the data structure of an SB whose data type is AUX and whose AUX mode is PSI-1 or PSI-2. The first 3 bytes of the SB data area where the AUX mode is PSI-1 is reserved, and the next 92 bytes are the first one sync byte (Sync_byte) from the first half of the PSI TS packet (188 bytes). 92 bytes excluding are recorded. In the SB data area where the AUX mode is PSI-2, 95 bytes of the second half part of the PSI TS packet in which the first half part is recorded in the SB data area where the AUX mode is PSI-1 are recorded. That is, one PSI TS packet is recorded with the AUX mode divided into two parts, PSI-1 SB and PSI-2 SB.
[0060]
Returning to FIG. 7, when the 3 bits on the MSB side of the SB header is 100, the data type is TS-1. When the data type is TS-1, the 4th and 5th bits from the MSB side of the SB header are reserved. A 27-bit time stamp is recorded in the remaining 3 bits and the first 3 bytes (24 bits) of the subsequent data area.
[0061]
When the 3 bits on the MSB side of the SB header is 101, the data type is TS-2. When the data type is TS-2, a continuity count value is recorded in 5 bits on the LSB side of the SB header.
[0062]
FIG. 10 shows the data structure of an SB whose data type is TS-1 or TS-2. As described above, the first 3 bytes of the data area of SB whose data type is TS-1 are combined with 3 bits on the LSB side of the SB header and used for recording a 27-bit time stamp. In the subsequent 92 bytes of the data area, 92 bytes are recorded by excluding the first one byte sync byte (Sync_byte) from the first half of the TS packet (188 bytes). In the data area of the SB whose data type is TS-2, 95 bytes of the latter half of the TS packet in which the first half is recorded in the data area of the SB whose data type is TS-1 are recorded.
[0063]
That is, one TS packet is recorded by being divided into two SBs having a data type TS-1 and SBs TS-2. The continuity count value recorded in the SB header whose data type is TS-2 represents the continuity of TS packets recorded in the SB of TS-1 and the SB of TS-2.
[0064]
Returning to FIG. 7, when the 3 bits on the MSB side of the SB header is 110, the data type is NULL. When the data type is NULL, invalid data is recorded in the data area only to satisfy the recording rate. Note that data bytes recorded after the SB header whose data type is NULL are ignored.
[0065]
The data type when the 3 bits on the MSB side of the SB header is 111 is undefined (reserved).
[0066]
Next, four types of recording processing that can be performed by the AV recording / reproducing apparatus to which the present invention is applied will be described with reference to FIGS. 11 to 14 show the concept of each recording process. In the following, the ES encoded by the video encoding unit 1, the video PES converting unit 2, the audio encoding unit 3 or the audio PES converting unit 4 of the AV recording / playback apparatus, the PES converted PES, and the PES The TS formed is referred to as Native, and the other ES, PES, and TS are referred to as Non-Native.
[0067]
As shown in FIG. 11, the first recording process is a method of converting a native ES into a PES and recording it as a native PES. As shown in FIG. 12, the second recording process is a method in which a Native TS is converted to PES again and recorded as a Native PES.
[0068]
As shown in FIG. 13, the third recording process is a method of converting a non-native TS into an ES, further converting it into a PES, and recording it as a non-native PES. However, the condition for applying the third recording process is that the TS is not a multi-program but a single program, and vbv_delay is added to the video ES. This is because when vbv_delay is not assigned (when 0xFFFF is recorded in vbv_delay), arrival time information is lost when the TS is converted to PES, and the TS cannot be restored during reproduction.
[0069]
As shown in FIG. 14, the fourth recording process is a method of adding a time stamp to a non-native TS and recording it as a non-native TS. The fourth recording process is applied to a TS that does not satisfy the conditions for applying the third recording process described above.
[0070]
Hereinafter, the first to fourth recording processes will be specifically described.
[0071]
The first recording process will be described with reference to the flowchart of FIG. In step S <b> 1, the video encoder 1 encodes the input video baseband signal by the MPEG method to generate a video ES, and outputs the video ES to the video PES converter 2. At this time, the bit rate of the video ES is accurately encoded at a bit rate equal to the maximum rate recorded in the bit rate included in the sequence header. In addition, an accurate value is recorded in vbv_delay of the picture header.
[0072]
The audio encoding unit 3 generates an audio ES by encoding the input audio baseband signal using the MPEG method, and outputs the audio ES to the audio PES unit 4.
[0073]
In step S2, the video PES converting unit 2 generates a PES packet by adding a PES header including PTS and DTS to each video frame of the video ES input from the video encoding unit 1, and generates an A / V mixing unit. 5 is output.
[0074]
The audio PES conversion unit 4 generates a PES packet by adding a PES header including PTS and DTS for each audio frame (AAU) of the audio ES input from the audio encoding unit 3, and generates an A / V mixing unit 5. Output to.
[0075]
In step S3, the A / V mixing unit 5 performs three PES packets of I picture, B picture, and B picture, or P picture, B picture, and B picture for the video PES packet from the video PES converting unit 2. The three PES packets are combined into an editing unit. The A / V mixing unit 5 also sets PTS1 as the earliest value among the PTS times of the combined three-frame images, and sets PTS2 as the earliest value of the next three-frame images. In addition, audio PES packets having PTSs prior to PTS2 are combined into an editing unit, and are arranged alternately in the order of audio editing unit and video editing unit to generate a mixed PES.
[0076]
In step S4, the A / V mixing unit 5 generates SB whose data type is AUX and AUX mode is AUX_V or AUX_A, records auxiliary information such as copyright information in the data area, and Insert the SB of AUX at the boundary of the mixed PES.
[0077]
In step S5, the A / V mixing unit 5 sets the mixed video PES packet and audio PES packet to 95 bytes for each PES packet so that the data type is the SB data area of PES_VIDEO or PES_AUDIO. Divide every time. Further, as described above with reference to FIG. 8, the A / V mixing unit 5 divides the PES packet into 95 bytes and occupies the entire data area of the SB. Is generated. If the PES packet divided is less than 95 bytes and does not fill the SB data area (95 bytes), the data length is recorded in the first byte of the divided PES packet less than 95 bytes, Also, an SB header in which 1 is recorded in the Full / Partial flag is generated.
[0078]
In step S6, the A / V mixing unit 5 records the continuity counter value in the SB header for each SB whose data types are PES_VIDEO and PES_AUDIO, and completes the SB header. In step S5, the PES packet is sent every 95 bytes. The SB is generated by adding to the divided data. The generated SB is held in an interleave unit memory built in the A / V mixing unit 5.
[0079]
The A / V mixing unit 5 further generates SB whose search data is recorded as a data type SEARCH_DATA, system auxiliary information is recorded as AUX, and the AUX mode is SYSTEM SB. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.
[0080]
In addition, when the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.
[0081]
In step S7, the A / V mixing unit 5 generates C2 parity for the SB for one track, adds C1 parity to the end of each SB, and outputs it to the recording unit 6 in the order of recording on the magnetic tape 9. To start.
[0082]
In step S8, the recording unit 6 randomizes the SBs sequentially input from the A / V mixing unit 5 in the M series in the same manner as the DV format used in the existing consumer digital VCR, The run length limitation and tracking frequency are superimposed by 25 conversions and recorded on the magnetic tape 9.
[0083]
The second recording process will be described with reference to the flowchart of FIG. The second recording process is started when it is determined that the TS is Native based on information recorded in a descriptor of a PMT (Program Map Table) input together with the TS to the demultiplexer 7.
[0084]
In step S11, the demultiplexer 7 separates the input TS into a video TS packet and an audio TS packet, and outputs them to the video PES unit 2 or the audio PES unit 4, respectively. At this time, based on the transport error indicator and continuity counter in the header of the TS packet, the demultiplexer 7 detects and discards the TS packet with the error or the discontinuous TS packet, The generation is notified to the A / V mixing unit 5 via the control unit 16. The demultiplexer 7 further discards the PCR included in the TS.
[0085]
The video PES converting unit 2 restores the video PES packet from the video TS packet input from the demultiplexer 7 and outputs it to the A / V mixing unit 5. The video PES converting unit 2 also extracts auxiliary information such as copyright information from the video TS packet and outputs it to the A / V mixing unit 5. Since the restored video PES packet is Native, each PES packet is composed of one video frame.
[0086]
The audio PES unit 4 restores the audio PES packet from the audio TS packet input from the demultiplexer 7 and outputs it to the A / V mixing unit 5. The audio PES unit 4 also extracts auxiliary information such as copyright information from the audio TS packet and outputs it to the A / V mixing unit 5. Since the restored audio PES packet is Native, each PES packet is composed of one audio frame (AAU).
[0087]
For the video PES packet from the video PES converting unit 2, the A / V mixing unit 5 includes three PES packets of I picture, B picture, and B picture, or three PESs of P picture, B picture, and B picture. Combine the packets into an editing unit. As shown in FIG. 17, the A / V mixing unit 5 also sets the earliest value of PTS times of the combined three-frame images as PTS1 and the earliest value of the next three-frame images as PTS2. In this case, an audio PES packet having a PTS after PTS1 and before PTS2 is combined into an editing unit, and a mixed PES is generated by alternately arranging the audio editing unit and the video editing unit in this order. To do. FIG. 17 shows the delay amount until the input TS is recorded as PES by the second recording process.
[0088]
In step S12, the A / V mixing unit 5 generates an SB whose data type is AUX and whose AUX mode is AUX_V, and auxiliary information such as copyright information input from the video PES converting unit 2 in the data area. And the SB is combined with the video PES packet. The A / V mixing unit 5 also generates an SB whose data type is AUX and the AUX mode is AUX_A, and records auxiliary information such as copyright information input from the audio PES converting unit 4 in the data area. Then, the SB is combined with the audio PES packet.
[0089]
In step S13, the A / V mixing unit 5 sets the video PES packet and the audio PES packet, which are arranged in a mixed manner, to 95 bytes for each PES packet so that the data type is the SB data area of PES_VIDEO or PES_AUDIO. Divide every time. Further, as described above with reference to FIG. 8, the A / V mixing unit 5 divides the PES packet into 95 bytes and occupies the entire data area of the SB. Is generated. If the PES packet divided is less than 95 bytes and does not fill the SB data area (95 bytes), the data length is recorded in the first byte of the divided PES packet less than 95 bytes, Also, an SB header in which 1 is recorded in the Full / Partial flag is generated.
[0090]
In step S14, the A / V mixing unit 5 records the continuity counter value in the SB header for each SB whose data types are PES_VIDEO and PES_AUDIO, and completes the SB header. The SB is generated by adding to the divided data. The generated SB is held in an interleave unit memory built in the A / V mixing unit 5.
[0091]
The A / V mixing unit 5 further generates SB whose search data is recorded as a data type SEARCH_DATA, system auxiliary information is recorded as AUX, and the AUX mode is SYSTEM SB. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.
[0092]
In addition, when the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.
[0093]
If a TS packet error or discontinuity is notified from the demultiplexer 7 via the control unit 16, in steps S13 and S14, the A / V mixing unit 5 leaves half-complete data up to the point immediately before the error. If there is, the data is recorded in the SB with Partial, and the data after the error is recorded in the new SB. Further, a discontinuous value is intentionally recorded in the continuity counter of the new SB header so that the position of the error can be identified during reproduction.
[0094]
In step S15, the A / V mixing unit 5 generates C2 parity for the SB for one track, adds C1 parity to the end of each SB, and outputs it to the recording unit 6 in the order of recording on the magnetic tape 9. To start.
[0095]
In step S16, the recording unit 6 performs randomization of the SBs sequentially input from the A / V mixing unit 5 in the M series in the same manner as the DV format used for the existing consumer digital VCR. The run length limitation and tracking frequency are superimposed by 25 conversions and recorded on the magnetic tape 9.
[0096]
The third recording process will be described with reference to the flowchart of FIG. The third recording process is a condition in which the TS is non-native and the third recording process can be applied based on the information recorded in the descriptor of the PMT input to the demultiplexer 7 together with the TS. It is started when it is determined that the condition is satisfied (single program and vbv_delay is added to the video ES).
[0097]
In step S21, the demultiplexer 7 separates the input TS into a video TS packet and an audio TS packet, and outputs each to the video PES unit 2 or the audio PES unit 4. At this time, based on the transport error indicator and continuity counter in the header of the TS packet, the demultiplexer 7 detects and discards the TS packet with the error or the discontinuous TS packet, The generation is notified to the A / V mixing unit 5 via the control unit 16. The demultiplexer 7 further detects TS packets of PSI from the TS and supplies them to the A / V mixing unit 5. The demultiplexer 7 further discards the PCR included in the TS.
[0098]
The video PES converting unit 2 restores the video PES packet from the video TS packet input from the demultiplexer 7, determines whether or not the video PES packet is composed of one video frame, and is composed of one video frame. If it is determined that it has not been converted, it is converted to ES, and then PTS and DTS are interpolated, converted into a PES packet similar to Native composed of one frame, and output to the A / V mixing unit 5. The video PES converting unit 2 also extracts auxiliary information such as copyright information from the video TS packet and outputs it to the A / V mixing unit 5.
[0099]
The audio PES converting unit 4 restores the audio PES packet from the audio TS packet input from the demultiplexer 7 and determines whether or not the audio PES packet is composed of one audio frame (AAU). If it is determined that the frame is not configured, it is converted to ES, and then the PTS is interpolated to be converted into a PES packet similar to Native configured by one frame and output to the A / V mixing unit 5. The audio PES unit 4 also extracts auxiliary information such as copyright information from the audio TS packet and outputs it to the A / V mixing unit 5.
[0100]
In step S22, the A / V mixing unit 5 performs three PES packets of I picture, B picture, and B picture, or P picture, B picture, and B picture for the video PES packet from the video PES converting unit 2. The three PES packets are combined into an editing unit. The A / V mixing unit 5 also sets PTS1 as the earliest value among the PTS times of the combined three-frame images, and sets PTS2 as the earliest value of the next three-frame images. In addition, audio PES packets having PTSs prior to PTS2 are combined into an editing unit, and are arranged alternately in the order of audio editing unit and video editing unit to generate a mixed PES.
[0101]
In step S23, the A / V mixing unit 5 generates an SB whose data type is AUX and whose AUX mode is AUX_V, and auxiliary information such as copyright information input from the video PES converting unit 2 in the data area. And the SB is combined with the video PES packet. The A / V mixing unit 5 also generates an SB whose data type is AUX and the AUX mode is AUX_A, and records auxiliary information such as copyright information input from the audio PES converting unit 4 in the data area. Then, the SB is combined with the audio PES packet. In addition, the A / V mixing unit 5 generates SB whose data type is AUX and whose AUX mode is PSI-1 and SB whose AUX mode is PSI-2, and stores it in the data area of the SB of PSI-1. The first half of the PSI TS packet from the multiplexer 7 is recorded, and the second half of the PSI TS packet is recorded in the SB data area of the PSI-2.
[0102]
In step S24, the A / V mixing unit 5 sets the mixed video PES packet and audio PES packet to 95 bytes for each PES packet so that the data type is SB data area of PES_VIDEO or PES_AUDIO. Divide every time. Further, as described above with reference to FIG. 8, the A / V mixing unit 5 divides the PES packet into 95 bytes and occupies the entire data area of the SB. Is generated. If the PES packet divided is less than 95 bytes and does not fill the SB data area (95 bytes), the data length is recorded in the first byte of the divided PES packet less than 95 bytes, Also, an SB header in which 1 is recorded in the Full / Partial flag is generated.
[0103]
In step S25, the A / V mixing unit 5 records the continuity counter value in the SB header of the SB whose data type is PES_VIDEO and the SB whose data type is PES_AUDIO, and completes the SB header. In step S5, the PES packet Is added to those divided every 95 bytes to generate SB. The generated SB is held in an interleave unit memory built in the A / V mixing unit 5.
[0104]
The A / V mixing unit 5 further generates SB whose search data is recorded as a data type SEARCH_DATA, system auxiliary information is recorded as AUX, and the AUX mode is SYSTEM SB. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.
[0105]
In addition, when the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.
[0106]
If a TS packet error or discontinuity is notified from the demultiplexer 7 via the control unit 16, in steps S24 and S25, the A / V mixing unit 5 leaves half-complete data up to immediately before the error. If so, the Partial flag is set and recorded in the SB, and the data after the error is recorded in the new SB. Further, a discontinuous value is intentionally recorded in the continuity counter of the new SB header so that the position of the error can be identified during reproduction.
[0107]
In step S26, the A / V mixing unit 5 generates C2 parity for SB for one track, adds C1 parity to the end of each SB, and outputs it to the recording unit 6 in the order of recording on the magnetic tape 9. To start.
[0108]
In step S27, the recording unit 6 performs randomization of the SBs sequentially input from the A / V mixing unit 5 in the M series in the same manner as the DV format used in the existing consumer digital VCR. The run length limitation and tracking frequency are superimposed by 25 conversions and recorded on the magnetic tape 9.
[0109]
The fourth recording process will be described with reference to the flowchart of FIG. The fourth recording process is a condition in which the TS is Non-Native and the third recording process can be applied based on information recorded in a descriptor of the PMT input to the demultiplexer 7 together with the TS. It is started when it is determined that the above is not satisfied (not a single program or vbv_delay is not added to the video ES).
[0110]
In step S <b> 31, the demultiplexer 7 separates the input non-native TS into TS packets and outputs the TS packets to the A / V mixing unit 5. The A / V mixing unit 5 removes the first sync byte from the input TS packet, then divides it into 92 bytes in the first half and 95 bytes in the second half, and records the 92 bytes in the first half in the data area. An SB having a data type of TS-1 and an SB having a data type of TS-2 in which 95 bytes of the latter half are recorded in the data area are generated.
[0111]
In step S32, the A / V mixing unit 5 sets the arrival time to 27 bits including 3 bits on the LSB side of the header of the SB whose data type is TS-1 generated in step S31 and the first 3 bytes of the data area. A time stamp indicating is added.
[0112]
In step S33, the A / V mixing unit 5 records a continuity count value indicating the continuity of TS packets in 5 bits on the LSB side of the SB header whose data type is TS-2 generated in step S31. The generated SB is held in a memory built in the A / V mixing unit 5. Note that the corresponding TS-1 SB and TS-2 SB are arranged as continuously as possible. Even if an error or discontinuity occurs in the TS packet, it is recorded in the SB as it is.
[0113]
The A / V mixing unit 5 further generates SB whose search data is recorded as a data type SEARCH_DATA, system auxiliary information is recorded as AUX, and the AUX mode is SYSTEM SB. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.
[0114]
The A / V mixing unit 5 further generates an SB whose data type is NULL when the generated SB is insufficient for the recording rate for the magnetic tape 9. The generated SB is held in a memory built in the A / V mixing unit 5.
[0115]
In step S <b> 34, the A / V mixing unit 5 outputs SB from the built-in memory to the recording unit 6 in the order of recording on the magnetic tape 9. The recording unit 6 randomizes the SBs sequentially input from the A / V mixing unit 5 in the M series in the same manner as the DV format used in the existing consumer digital VCR, and then performs the run by 24/25 conversion. The length limit and the tracking frequency are superimposed and recorded on the magnetic tape 9.
[0116]
Next, playback processing of the AV recording / playback apparatus to which the present invention is applied will be described. This AV recording / reproducing apparatus reads out and decodes PES or TS recorded on the magnetic tape 9 by the above-described four types of recording processes, and outputs the resulting video signal and audio signal, as well as the magnetic tape 9. TS output processing that reads the PES recorded in the above and converts it into a TS for output is possible.
[0117]
The TS output process of the AV recording / reproducing apparatus will be described with reference to the flowchart of FIG. 20 and FIG. In this TS output process, SBs sequentially read from the magnetic tape 9 by the reproducing unit 10 are reproduced into PES packets (including error correction based on parity data) and supplied to the TS unit 14, and I Triggered when a PES packet of a picture is detected. FIG. 21 shows a delay amount until the read PES is output as a TS.
[0118]
In step S41 (corresponding to (1) in FIG. 22), the TS output unit 14 reads DTS from the PES header of the I picture, reads vbv_delay from the picture header, calculates DTS- (vbv_delay), and further calculates DTS- A time obtained by subtracting a predetermined time from (vbv_delay) is set to an initial value to initialize an STC (System Time Clock), and the STC counter starts free-running.
[0119]
In step S42 (corresponding to (2) in FIG. 22), the TS output unit 14 generates PAT and PMT PSI packets and outputs them at predetermined intervals. As a result, the receiving side of the TS can receive and recognize the PAT and PMT before receiving the video and audio TS packets. Can be suppressed.
[0120]
In step S43 (corresponding to (3) in FIG. 22), the TS output unit 14 outputs a PCR packet in which the STC value is recorded at an arbitrary interval.
[0121]
In step S44 (corresponding to (4) in FIG. 22), the TS output unit 14 at the timing when the STC coincides with the time (DTS- (vbv_delay)) obtained by subtracting vbv_delay from the DTS of the first I picture for the video. The video PES packet is converted to a TS and output is started. For subsequent pictures, the PES packet is converted to TS and output at the timing when the time obtained by subtracting vbv_delay from DTS coincides with DTS. Since no DTS is recorded in the B picture, the same process is performed using PTS instead.
[0122]
The TS output unit 14 (as processing corresponding to (5) in FIG. 22) also subtracts Start Up Delay from the PTS of the first frame (AAU) for audio (PTS- (Start Up Delay)) and STC. The audio PES packet is converted to a TS and output is started at the timing when the two match. Note that the audio output rate is made to exactly match the value recorded in the bit rate index (Bitrate_index) of the header.
[0123]
The AV recording / reproducing apparatus can further output the TS recorded on the magnetic tape 9 in the TS state.
[0124]
Next, as points to be noted in the TS output process of the TS unit 14, the output interval of video TS packets, the handling of AUX data (auxiliary information), and the process of outputting a non-native TS recorded on the magnetic tape 9 PES recording error processing and TS recording error processing are listed.
[0125]
First, the output interval of video TS packets will be described. When vbv_delay other than 0xFFFF is recorded in the picture header of the PES read and reproduced from the magnetic tape 9, and the value of the bit rate (bit_rate) of the sequence header and the output rate exactly match, that is, the PES is In the case of Native, TS conversion is performed at a rate slightly higher than the bit rate, and when there is no data for each picture, it is only necessary to wait until data for the next picture is input.
[0126]
Also, vbv_delay is not recorded (0xFFFF is recorded) in the PES picture header read and played back from the magnetic tape 9, or the bit rate (bit_rate) value of the sequence header does not exactly match the output rate If the PES is Non-Native, the time to (DTS- (vbv_delay)) of the next picture for each picture is divided by the number of bits of the picture and output at the interval of the division value. Good.
[0127]
Next, the handling of AUX data (auxiliary information) will be described. When the PES read from and reproduced from the magnetic tape 9 is Native, the AUX data is recorded in the SB having the data type of AUX_V or AUX_A by the first or second recording process described above. Outputs AUX data recorded in AUX_V and AUX_A as they are in a TS packet. Since AUX_V is combined with the video PES and AUX_A is combined with the audio PES, the AUX data is converted into a TS in accordance with the video or audio PES and output.
[0128]
PMT generates a native one. The PMT records video, audio, AUX, and PCR PIDs. The PMT also records copyright information etc. in the AUX data so that it can be interpreted by general-purpose devices. In addition, a descriptor indicating that it is Native is recorded in the PMT.
[0129]
When the PES read from the magnetic tape 9 and played back is Non-Native, the AUX data PAT, PMT, SIT, etc. are SB whose data type is AUX and AUX mode is PSI-1 or PSI-2 Therefore, it may be returned to the TS packet as it is and output. When returning to the TS packet, if the values recorded in the PMT are used as they are as the video, audio, and PCR PIDs, the process of rewriting the PMT and CRC (Cyclic Redundancy Check) can be omitted.
[0130]
Next, a process of outputting a non-native TS recorded on the magnetic tape 9 will be described. Since a time stamp is recorded on the TS recorded on the magnetic tape 9 by the above-described fourth recording process, the TS is output when the time stamp matches with respect to the STC at the time of reproduction. Since the TS header reproduced from the magnetic tape 9 does not have a sync byte by the fourth recording process, this is added and output.
[0131]
Next, error processing based on the SB header continuity counter for data recorded by PES will be described with reference to FIG. Through the first to third recording processes described above, the SB data type is recorded in the SB header. Therefore, when an error occurs in an SB and cannot be corrected, the data type of the SB is unknown.
[0132]
Therefore, based on the continuity of the continuity counter value recorded in the SB header of the SB in which no error has occurred, the SB data type in which an error has occurred and cannot be corrected is determined.
[0133]
Specifically, when the continuity counter value of the SB whose data type is PES-VIDEO is monitored and a discontinuity in the SB continuity counter value before and after the SB where an uncorrectable error has occurred is detected, the correction is not possible. It is determined that the data type of the SB in which an error has occurred is PES-VIDEO. Similarly, if the SB continuity counter value with the data type PES-AUDIO is monitored and a discontinuity in the SB continuity counter value before or after the SB where an uncorrectable error has occurred is detected, an uncorrectable error will occur. It is determined that the data type of the SB in which the error occurs is PES-AUDIO.
[0134]
Such determination makes it possible to identify whether or not an error has occurred in the SB in which the PES is recorded, so that the influence of the occurrence of the error on the video and audio to be reproduced can be reduced.
[0135]
Even if an error occurs at the boundary between the SB of PES-VIDEO and the SB of PES-AUDIO, the error is determined by checking the continuity with the last continuity counter value of the previous unit. Can be detected.
[0136]
When the continuity counter value is continuous, TS is continuously output, and when it is determined that the continuity counter value is discontinuous and cannot be corrected, an error code is inserted. As an error code insertion method, a sequence error code 0x000001B4 may be inserted in the ES layer. In the TS layer, a packet in which the transport error indicator (transport_error_indicator) is set to 1 may be output.
[0137]
By the way, since the continuity counter value is a 4-bit value that circulates from 0 to 15, when SBs having the same data type are successively lost in multiples of 16, it cannot be detected. Therefore, when 16 or more SBs having uncorrectable errors are consecutive, an error code is inserted regardless of the data type of those SBs.
[0138]
In addition, even if no uncorrectable error has occurred in the SB, if this error processing is executed, the discontinuous continuity counter value intentionally recorded at the time of recording is handled as an error at the time of reproduction. Can do.
[0139]
Next, error processing based on the SB header continuity counter for data recorded in the TS will be described with reference to FIG. By the fourth recording process described above, the SB data type is recorded in the SB header. Therefore, when an error occurs in an SB and cannot be corrected, the data type of the SB is unknown.
[0140]
Therefore, based on the continuity of the continuity counter value recorded in the SB header of the SB in which no error has occurred, the SB data type in which an error has occurred and cannot be corrected is determined.
[0141]
Specifically, a normal SB data type sandwiching an uncorrectable SB is monitored, and if the data type continues from TS-1 to TS-2, the continuity counter recorded in the SB header of the TS-2 The continuity of the value with the continuity counter value recorded in the SB header of the previous TS-2 is determined. If it is determined that they are continuous, the SB of the TS-1 and the SB of the TS-2 are a pair, so that they are restored to one TS packet and output. On the other hand, if it is determined that they are not continuous, the SB of the TS-1 and the SB of the TS-2 are not pairs, but both are discarded because they are SBs lacking a pair.
[0142]
The fact that the TS is discarded here is detected on the receiving side based on the continuity counter value recorded in the TS header of the output TS that precedes and follows, so that an error occurs in the video and audio to be played back. Can reduce the influence of.
[0143]
If the data type continues from TS-2 to TS-1, the data is output as is without executing error processing. That is, even if the uncorrectable SB data type is TS-1 or TS-2, this is identified on the reproduction side based on the discontinuity of the continuity counter value of the TS header.
[0144]
When the data type continues from TS-1 to TS-1, the previously read SB of TS-1 is discarded. The discarding of the previously read TS-1 SB is identified on the playback side based on the discontinuity of the continuity counter value of the TS header.
[0145]
If the data type continues from TS-2 to TS-2, the SB of TS-2 read later is discarded. Discarding the TS-2 SB read later is identified on the playback side based on the discontinuity of the continuity counter value of the TS header.
[0146]
With this in mind, the TS output process is executed.
Next, effects expected from the AV recording / reproducing apparatus to which the present invention is applied will be listed.
[0147]
At the time of recording, when recording with ES, the overhead of the recording rate can be minimized. When recording with PES, it can be recorded so that it can be easily converted to TS. When recording with ES or PES, there is less processing during jog playback. When recording by ES or PES, the TS header and the time stamp indicating the TS arrival time are not recorded, so that overhead can be reduced. Therefore, the recording capacity can be saved. Alternatively, the recording time can be extended. Since the PCR is not recorded, there is little overhead. Therefore, the recording capacity can be saved. Alternatively, the recording time can be extended.
[0148]
Also, since one video frame constitutes one PES packet, PTS is assigned to all frames. This makes it easier to restore the timing when converting to TS. In addition, jog reproduction can be easily realized. Since one video frame constitutes one PES packet, PTS is added to all frames. This makes it easier to restore the timing when converting to TS. In addition, audio can be easily divided during editing. It can be edited even if it is not Native. Conventionally, since the data type (data type) identified by PID is represented by an identification code having a smaller number of bits than PID, overhead can be reduced.
[0149]
Further, when the entire data area of the SB is occupied by valid data, the length byte indicating the data length is not recorded, so that the overhead can be reduced. When the section of PSI information is divided into a plurality of TS packets, the head is identified by the payload unit start indicator in the TS packet header, so the PSI should be recorded in two SBs whose data type is AUX for each TS header. This is saved.
[0150]
At the time of TS output, since the TS output is started from (DTS- (vbv_delay)), the timing can be restored even if the arrival time is not recorded. Since TS is output at a slightly higher output rate than the recorded bit_rate, there is no collision at the frame boundary. By outputting TS at equal intervals, even if bit_rate is recorded much higher than the actual rate, it can be output at an average rate. Since the PCR is preceded, the playback side can receive the first frame after loading the PCR into the STC. Therefore, the playback data can be displayed without the beginning missing. Since PAT and PMT are preceded, the playback side can receive the PCR packet without missing it. Since the location of the error can be identified, the influence of the error on the image quality and sound quality can be reduced. An error detected during recording can be transmitted to the reproducing side without increasing the number of bits.
[0151]
The present invention can also be applied to the case where AV signals are recorded on an information recording medium other than a magnetic tape.
[0152]
By the way, the series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.
[0153]
As shown in FIG. 1, this recording medium is distributed to provide a program to a user separately from a computer, and includes a magnetic disk 18 (including a floppy disk) on which a program is recorded, an optical disk 19 (CD- It is not only configured by a package medium including a ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc), a magneto-optical disc 20 (including an MD (Mini Disc)), or a semiconductor memory 21. It is configured by a ROM, a hard disk or the like on which a program is recorded, which is provided to the user in a state of being pre-installed in the computer.
[0154]
In the present specification, the step of describing the program recorded in the recording medium is not limited to the processing performed in time series according to the described order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.
[0155]
Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.
[0156]
【The invention's effect】
As described above, according to the reproducing apparatus and method and the recording medium program of the present invention, the system time clock is used by using the decoding time stamp or the presentation time stamp included in the header of the read packetized elementary stream packet. Is generated and a program clock reference packet is generated using a system time clock value read at a predetermined interval, and is included in the header of the packetized elementary stream packet when the system time clock is delayed by a predetermined time. The packetized elementary stream packet is converted to a transport stream packet when the time indicated by the decoding time stamp or the presentation time stamp matches. Since the way, it is possible to output the packetized elementary stream packets recorded as TS.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration example of an AV recording / reproducing apparatus to which the present invention is applied.
FIG. 2 is a diagram showing an ES recording method.
FIG. 3 is a diagram showing a PES recording method.
FIG. 4 is a diagram illustrating a data structure of a TS packet.
FIG. 5 is a diagram illustrating a data structure of a PES packet.
FIG. 6 is a diagram showing SB in one track.
FIG. 7 is a diagram illustrating an SB header.
FIG. 8 is a diagram illustrating a data structure of an SB whose data type is PES-VIDEO or PES-AUDIO.
FIG. 9 is a diagram illustrating a data structure of an SB whose data type is AUX.
FIG. 10 is a diagram illustrating a data structure of an SB whose data type is TS-1 or TS-2.
FIG. 11 is a diagram showing a concept of first recording processing.
FIG. 12 is a diagram showing a concept of second recording processing.
FIG. 13 is a diagram showing a concept of a third recording process.
FIG. 14 is a diagram showing a concept of fourth recording processing.
FIG. 15 is a flowchart illustrating a first recording process.
FIG. 16 is a flowchart illustrating a second recording process.
FIG. 17 is a diagram illustrating a delay amount in the second recording process.
FIG. 18 is a flowchart illustrating a third recording process.
FIG. 19 is a flowchart illustrating a fourth recording process.
FIG. 20 is a flowchart illustrating TS output processing.
FIG. 21 is a diagram illustrating a delay amount in TS output processing;
FIG. 22 is a diagram for explaining TS output processing;
FIG. 23 is a diagram for explaining error processing during PES recording.
FIG. 24 is a diagram for explaining error processing during TS recording;
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Video encoding part, 2 Video PES conversion part, 3 Audio encoding part, 4 Audio PES conversion part, 5 A / V mixing part, 6 Recording part, 7 Demultiplexer, 9 Magnetic tape, 10 Playback part, 11 A / V separation Part, 12 video decoding part, 13 audio decoding part, 14 TS conversion part, 16 control part, 17 drive, 18 magnetic disk, 19 optical disk, 20 magneto-optical disk, 21 semiconductor memory

Claims (9)

In a playback device for converting an AV signal recorded as a packetized elementary stream packet on an information recording medium into a transport stream,
Read means for reading the packetized elementary stream packet from the information recording medium;
Initialization means for initializing a system time clock using a decoding time stamp or a presentation time stamp included in a header of the packetized elementary stream packet;
First generation means for generating a program clock reference packet using a value of the system time clock read at a predetermined interval;
At a timing when the time when the system time clock is delayed by a predetermined time coincides with the time indicated by the decoding time stamp or the presentation time stamp included in the header of the packetized elementary stream packet. A playback device comprising: conversion means for converting a sized elementary stream packet into a transport stream packet. The initialization unit uses the decoding timestamp or the presentation timestamp included in the header of a packetized elementary stream packet from which playback is first started, and a value obtained by subtracting a predetermined time from the system. Initialize the time clock,
The first generating means precedes the timing at which the packetized elementary stream packet whose reproduction is started first is converted into the transport packet by the converting means by a predetermined time, and The reproduction apparatus according to claim 1, wherein generation of a clock reference packet is started. Further comprising second generation means for generating a program association table packet and a program map table packet;
The second generation unit generates the program association table packet and the program map table packet ahead of a timing when the first generation unit starts generating the program clock reference packet by a predetermined time. The playback apparatus according to claim 1, wherein the playback apparatus starts. The converting means includes a time obtained by delaying the system time clock by vbv_delay recorded in a picture header, and the decoding time stamp or the presentation time included in the header of the packetized elementary stream packet of video. 2. The playback apparatus according to claim 1, wherein the packetized elementary stream packet of the video is converted into a transport stream packet at a timing when times indicated by stamps coincide with each other. 2. The reproducing apparatus according to claim 1, wherein the converting unit converts the packetized elementary stream packet of the video into a transport stream packet at a fixed rate and intermittently outputs the packet. 2. The playback apparatus according to claim 1, wherein the converting unit converts the packetized elementary stream packets of the video into transport stream packets at a variable rate and outputs the transport stream packets at equal intervals. The conversion means, at a timing when the time when the system time clock is delayed by a predetermined time and the time indicated by the presentation time stamp included in the header of the packetized elementary stream packet of audio coincide with each other, The playback apparatus according to claim 1, wherein the packetized elementary stream packet of audio is converted into a transport stream packet. In a playback method of a playback device for converting an AV signal recorded as a packetized elementary stream packet on an information recording medium into a transport stream,
A reading step of reading the packetized elementary stream packet from the information recording medium;
An initialization step of initializing a system time clock using a decoding time stamp or a presentation time stamp included in a header of the packetized elementary stream packet;
A first generation step of generating a program clock reference packet using the value of the system time clock read at a predetermined interval;
At a timing when the time when the system time clock is delayed by a predetermined time coincides with the time indicated by the decoding time stamp or the presentation time stamp included in the header of the packetized elementary stream packet. And a converting step of converting the sized elementary stream packet into a transport stream packet. A reproduction program for converting an AV signal recorded as a packetized elementary stream packet on an information recording medium into a transport stream,
A reading step of reading the packetized elementary stream packet from the information recording medium;
An initialization step of initializing a system time clock using a decoding time stamp or a presentation time stamp included in a header of the packetized elementary stream packet;
A first generation step of generating a program clock reference packet using the value of the system time clock read at a predetermined interval;
At a timing when the time when the system time clock is delayed by a predetermined time coincides with the time indicated by the decoding time stamp or the presentation time stamp included in the header of the packetized elementary stream packet. A recording medium on which a computer-readable program is recorded, comprising a converting step of converting a sized elementary stream packet into a transport stream packet.

Images