JP4284574B2 - Recording apparatus and method, and recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a recording apparatus and method, and a recording medium, and more particularly, to a recording apparatus and method suitable for use when, for example, an AV signal is compressed and encoded and recorded on an information recording medium, and a recording medium.
[0002]
[Prior art]
Like the DV format used in consumer digital VCR (Video Cassette Recorder), video signals are encoded with intra-frame compression, and the corresponding audio signals are encoded so that they can be uncompressed or instantaneously expanded. There is a system for recording on magnetic tape.
[0003]
The video signal and the audio signal encoded by the DV format and recorded on the recording medium are suitable for editing such that video and audio are connected at arbitrary positions.
[0004]
However, when the DV format signal compression rate is low, a recording system with a high transfer rate is required, a medium with a large storage capacity is required, or the capacity of the information recording medium is limited. Has problems such as a short recording time.
[0005]
In order to solve such a problem, a video signal and an audio signal are compression-coded using an MPEG (Moving Picture Experts Group) method, and recorded in a transport stream (hereinafter also referred to as TS) recording medium. There is already a recording system.
[0006]
According to a system using the MPEG system, a video signal is inter-frame compressed with a Long GOP (Group Of Picture) composed of images of a plurality of frames, and an audio signal is frame-compressed with a plurality of samples. Therefore, a high compression rate can be realized. Therefore, a recording system with a high transfer rate is not required, the capacity of the recording medium can be saved, and when the capacity of the recording medium is limited, the recording time is extended as compared with a DV format system. There are advantages.
[0007]
[Problems to be solved by the invention]
However, a system that records video signals and audio signals compressed and encoded in the MPEG format in the TS state has the following problems.
[0008]
That is, the video signal is MPEG-compressed in units of Long GOP as described above. The data length of one frame image is not constant (it is not compressed at a fixed rate). On the other hand, the audio signal is compressed at a fixed rate. Therefore, even if the corresponding video signal and audio signal are encoded at the same time, there is a possibility that the corresponding video signal and audio signal packets will be arranged at positions separated on the TS.
[0009]
If the corresponding video signal and audio signal packets are placed at a distance from each other on the TS, the video signal connection timing and the audio signal connection timing will be different if editing is performed to connect the TSs halfway. There was a problem that one of the data was missing.
[0010]
Also, it is necessary to add a TS packet, a time stamp indicating the arrival time to the decoder, a PCR packet storing a PCR (Program Clock Reference) as a time reference at the time of decoding, and the like to the TS. Therefore, there is a problem that the recording rate is lowered by the overhead.
[0011]
Furthermore, since video signals and audio signals recorded in the TS state are difficult to perform so-called jog playback such as pause playback (PAUSE), slow playback, and reverse playback, in order to enable jog playback, There was a problem that had to be converted into an elementary stream.
[0012]
The present invention has been made in view of such a situation, and is edited by recording a video signal and an audio signal compressed and encoded using the MPEG system on an information recording medium as a packetized elementary stream. Sometimes it does not cause inconvenience.
[0013]
[Means for Solving the Problems]
  The first recording apparatus of the present invention is a video elementary stream in which a video signal is compressed and encoded by a predetermined method.Every video frameA video packetized elementary stream packet generating means for generating a video packetized elementary stream packet, and an audio elementary stream in which the audio signal is compressed and encoded by a predetermined method.Every audio frameAudio packetized elementary stream packet generation means for generating audio packetized elementary stream packets, and video packetized elementary stream packets are combined every predetermined number, Video packetized elementary stream packet combination generating means for generating video packetized elementary stream packet combination, and video packetized elementary stream packet combinationAudio frames that are played at the same time as video frames includedAudio packetized elementary stream packet combination generating means for combining audio packetized elementary stream packets to generate audio packetized elementary stream packet combination, video packetized elementary stream packet combining and audio packetizing After alternately arranging elementary stream packet combinations, sync block generating means for generating a sync block by converting to a predetermined recording format, and recording means for recording the sync block on an information recording medium are included.Mu.
[0015]
The audio packetized elementary stream packet generation means divides the audio elementary stream into each audio frame, adds a header including at least a presentation time stamp, and generates an audio packetized elementary stream packet. Can be.
[0016]
The audio packetized elementary stream packet combination generation means is the most of the time indicated by the presentation time stamp included in the header of each video packetized elementary stream packet constituting the video packetized elementary stream packet combination. From the earliest time among the times indicated by the presentation time stamps included in the header of each video packetized elementary stream packet that constitutes the next video packetized elementary stream packet combination after the earlier time An audio packetized elementary stream is created by combining the audio packetized elementary stream packet recorded in the header with the presentation time stamp indicating the previous time. It is possible to generate a stream-packet bond.
[0017]
The first recording apparatus of the present invention separates a transport stream in which a compression-encoded video signal and a compression-encoded audio signal are multiplexed into a video elementary stream and an audio elementary stream. Can further be included.
[0018]
The sync block generation means can generate a sync block whose data type is AUX using the transport stream packet of the program specific information included in the transport stream as it is.
[0019]
The sync block generating means may record identification information for identifying the data type of the sync block in the header of the sync block to generate the sync block.
[0020]
The sync block generation means records a flag indicating whether or not all of the data area of the sync block is occupied by valid data in the header of the sync block, and all of the data area of the sync block is occupied by valid data. If not, the data length of valid data can be recorded at the head of the data area.
[0021]
  In the first recording method, which is packed, a video elementary stream in which a video signal is compressed and encoded by a predetermined systemEvery video frameA video packetized elementary stream packet generation step for generating a video packetized elementary stream packet, and an audio elementary stream in which the audio signal is compressed and encoded by a predetermined method.Every audio frameAn audio packetized elementary stream packet generation step for generating an audio packetized elementary stream packet, and a video packetized elementary stream packet are combined every predetermined number, Video packetized elementary stream packet combination generating step for generating video packetized elementary stream packet combination, and video packetized elementary stream packet combinationAudio frames that are played at the same time as video frames includedAn audio packetized elementary stream packet combination generating step for combining audio packetized elementary stream packets to generate an audio packetized elementary stream packet combination; and video packetized elementary stream packet combining and audio packetizing. After alternately arranging the elementary stream packet combination, a sync block generating step for generating a sync block by converting to a predetermined recording format and a recording step for recording the sync block on the information recording medium are included.Mu.
[0022]
  First recording medium of the present inventionbodyIs a video elementary stream in which the video signal is compressed and encoded by a predetermined method.Every video frameA video packetized elementary stream packet generation step for generating a video packetized elementary stream packet, and an audio elementary stream in which the audio signal is compressed and encoded by a predetermined method.Every audio frameAn audio packetized elementary stream packet generation step for generating an audio packetized elementary stream packet, and a video packetized elementary stream packet are combined every predetermined number, Video packetized elementary stream packet combination generating step for generating video packetized elementary stream packet combination, and video packetized elementary stream packet combinationAudio frames that are played at the same time as video frames includedAn audio packetized elementary stream packet combination generating step for combining audio packetized elementary stream packets to generate an audio packetized elementary stream packet combination; and video packetized elementary stream packet combining and audio packetizing. After alternately arranging the elementary stream packet combination, a sync block generating step for generating a sync block by converting to a predetermined recording format and a recording step for recording the sync block on the information recording medium are included.A program for causing the computer of the recording apparatus to execute the process is recorded.
[0023]
  According to a second recording apparatus of the present invention, there is provided a video editing unit generating means for generating a video editing unit by dividing a video elementary stream in which a video signal is compression-encoded by a predetermined method every predetermined number of video frames. An audio elementary stream in which the audio signal is compressed and encoded by a predetermined method, Played at the same time as the video editing unitAudio editing unit generation means for generating an audio editing unit by dividing the number of audio frames, time stamp adding means for adding a time stamp indicating playback timing to the video editing unit and the audio editing unit, and a time stamp added A video recording unit and an audio editing unit which are alternately arranged and then converted into a predetermined recording format to generate a sync block; and a sync block generating unit which records the sync block on an information recording medium.Mu.
[0024]
  A second recording method of the present invention includes a video editing unit generation step of generating a video editing unit by dividing a video elementary stream in which a video signal is compression-encoded by a predetermined method for each predetermined number of video frames. An audio elementary stream in which the audio signal is compressed and encoded by a predetermined method, Played at the same time as the video editing unitAn audio editing unit generation step for generating an audio editing unit by dividing the number of audio frames, a time stamp adding step for adding a time stamp indicating playback timing to the video editing unit and the audio editing unit, and a time stamp are added. After alternately arranging video editing units and audio editing units, a sync block generating step for generating a sync block by converting to a predetermined recording format and a recording step for recording the sync block on an information recording medium are included.Mu.
[0025]
  Second recording medium of the present inventionbodyIncludes a video editing unit generation step for generating a video editing unit by dividing a video elementary stream in which a video signal is compression-encoded by a predetermined method for each predetermined number of video frames, and an audio signal by a predetermined method. Compressed and encoded audio elementary streams, Played at the same time as the video editing unitAn audio editing unit generation step for generating an audio editing unit by dividing the number of audio frames, a time stamp adding step for adding a time stamp indicating playback timing to the video editing unit and the audio editing unit, and a time stamp are added. After alternately arranging video editing units and audio editing units, a sync block generating step for generating a sync block by converting to a predetermined recording format and a recording step for recording the sync block on an information recording medium are included.A program for causing the computer of the recording apparatus to execute the process is recorded.
[0026]
  In the first recording apparatus and method and the recording medium program of the present invention, a video elementary stream in which a video signal is compression-encoded by a predetermined method is recorded.Every video frameInto which a header is added and a video packetized elementary stream packet is generated, and an audio elementary stream in which an audio signal is compressed and encoded by a predetermined method is generated.Every audio frameAudio packetized elementary stream packets are generated by adding the headers and video packetized elementary stream packets are combined every predetermined number to generate video packetized elementary stream packet combinations. , Video packetized elementary stream packet combinationAudio frames that are played at the same time as video frames includedAudio packetized elementary stream packet combinations are combined to generate an audio packetized elementary stream packet combination. Furthermore, after the video packetized elementary stream packet combination and the audio packetized elementary stream packet combination are alternately arranged, the video packetized elementary stream packet combination is converted into a predetermined recording format to generate a sync block, and the sync block is converted into an information recording medium. To be recorded.
[0027]
  In the second recording apparatus and method and the recording medium program of the present invention, a video elementary stream in which a video signal is compression-encoded by a predetermined method is divided for each predetermined number of video frames to be a video editing unit. Audio elementary stream in which the audio signal is compressed and encoded by a predetermined method is generated., Played at the same time as the video editing unitAn audio editing unit is generated by being divided for each number of audio frames. In addition, a time stamp indicating the playback timing is added to the video editing unit and the audio editing unit, and the video editing unit and the audio editing unit to which the time stamp is added are alternately arranged, and then converted into a predetermined recording format and synchronized. A block is generated and a sync block is recorded on the information recording medium.
[0028]
DETAILED DESCRIPTION OF THE INVENTION
An AV recording / reproducing apparatus to which the present invention is applied will be described. This AV recording / playback device converts input video and audio baseband signals into a packetized elementary stream (hereinafter also referred to as PES) and records it on a magnetic tape. The recorded TS is recorded on the magnetic tape, and the input TS is recorded on the magnetic tape in the TS state. The AV recording / reproducing apparatus also reproduces the PES recorded on the magnetic tape or converts the PES recorded on the magnetic tape into a TS for output.
[0029]
FIG. 1 shows a configuration example of an AV recording / reproducing apparatus. The video encoding unit 1 encodes an input video baseband signal by the MPEG method to generate a video elementary stream (hereinafter referred to as ES), and outputs it to the video PES converting unit 2. The video PES converting unit 2 converts the video ES input from the video encoding unit 1 to PES and outputs the PES to the A / V mixing unit 5. Video PES conversion unit 2 The video ES input from the video encoding unit 1 can also be output to the A / V mixing unit 5 as it is. The video PES converting unit 2 further converts the video TS packet input from the demultiplexer 7 to PES and outputs the PES to the A / V mixing unit 5.
[0030]
The audio encoding unit 3 encodes the input audio baseband signal by the MPEG method to generate an audio ES, and outputs the audio ES to the audio PES converting unit 4. The audio PES conversion unit 4 converts the audio ES input from the audio encoding unit 3 to PES and outputs the PES to the A / V mixing unit 5. The audio PES conversion unit 4 can also output the audio ES input from the audio encoding unit 3 to the A / V mixing unit 5 as it is. The audio PES converting unit 4 further converts the audio TS packet input from the demultiplexer 7 into a PES and outputs the PES to the A / V mixing unit 5.
[0031]
The A / V mixing unit 5 converts the video PES packet input from the video PES conversion unit 2 and the audio PES packet input from the audio PES conversion unit 4 into a predetermined recording format (described later), and obtains the result. The sync block to be output is output to the recording unit 6. The A / V mixing unit 5 also adds a time stamp to the TS packet input from the demultiplexer 7, converts it to a predetermined recording format, and outputs the resulting sync block to the recording unit 6. The A / V mixing unit 5 further adds a time stamp to the editing unit (described later) of the video ES that has passed through the video PES unit 2 and the editing unit of the audio ES that has passed through the audio PES unit 4. The data is converted into a recording format, and the obtained sync block is output to the recording unit 6.
[0032]
The recording unit 6 randomizes the sync block input from the A / V mixing unit 5 in the M series in the same manner as the DV format used in the existing consumer digital VCR, and then executes the run by 24/25 conversion. The length limit and the tracking frequency are superimposed and recorded on the magnetic tape 9.
[0033]
  The demultiplexer 7 outputs the video TS packet included in the input TS to the video PES converting unit 2, outputs the audio TS packet to the audio PES converting unit 4, and performs PSI (Program System Information) TS packet is output to the A / V mixing unit 5. The demultiplexer 7 also separates the input Non-Native (described later) TS into TS packets and outputs the TS packets to the A / V mixing unit 5. At this time, the demultiplexer 7 may discard the PCR packet.
[0034]
The reproducing unit 10 reads the sync block recorded on the magnetic tape 9 to reproduce the PES, and outputs the PES to the A / V separating unit 11 or the TS unit 14. The reproducing unit 10 also reads the sync block recorded on the magnetic tape 9 to reproduce the TS, and outputs the TS to the A / V separating unit 11 or the TS unit 14.
[0035]
  The A / V separator 11 converts the PES or TS input from the playback unit 10 into a video data stream.WhenThe audio data stream is separated and output to the corresponding video decoding unit 12 or audio decoding unit 13.
[0036]
The video decoding unit 12 decodes the video data stream input from the A / V separation unit 11 and outputs an obtained video signal. The audio decoding unit 13 decodes the audio data stream input from the A / V separation unit 11 and outputs an obtained audio signal.
[0037]
The TS unit 14 converts the PES input from the playback unit 10 into a TS and outputs the TS. The TS unit 14 also adds the sync byte to the head of the TS packet from which the sync byte (described later) of the TS input from the playback unit 10 has been removed, and outputs it.
[0038]
The control unit 16 controls the drive 17 to read a control program stored in the magnetic disk 18, the optical disk 19, the magneto-optical disk 20, or the semiconductor memory 21, and perform AV recording based on the read control program. Control each part of the playback device.
[0039]
Next, a recording method of the AV recording / reproducing apparatus will be described. FIG. 2 shows an example in which ES is recorded on the magnetic tape 9. As shown in the figure, with respect to video, an editing unit is formed by combining every three frames of I picture, B picture, and B picture, or every three frames of P picture, B picture, and B picture. Corresponding audio editing units are arranged between (3 frames).
[0040]
The figure shows an example in which an audio editing unit consisting of 4 frames (same as AAU: Audio Access Unit) or an audio editing unit consisting of 5 frames is arranged corresponding to a video editing unit consisting of 3 frames. It is shown.
[0041]
However, in practice, the number of audio frames corresponding to three frames of video is usually not an integer. Therefore, a dedicated time stamp (T.S.) indicating the playback time is added to each video and audio editing unit. Thereby, it becomes possible to reproduce | regenerate video and audio synchronizing.
[0042]
Hereinafter, the recording method as shown in FIG. 2 is described as an ES recording method.
[0043]
According to the ES recording method, a video editing unit with a dedicated time stamp and an audio editing unit with a corresponding dedicated time stamp are arranged adjacent to each other for recording. It is possible to suppress the occurrence of inconvenience that the combined timing is shifted between video and audio.
[0044]
FIG. 3 shows an example in which PES is recorded on the magnetic tape 9. Specifically, the PES packet syntax is applied to the video editing unit consisting of the above three frames and the corresponding audio editing unit without adding the dedicated time stamp shown in FIG. Time management information PTS (Presentation Time Stamp) and decoding time management information DTS (Decoding Time Stamp) are added to form a PES packet.
[0045]
Hereinafter, the method of recording as shown in FIG. 3 is described as a PES recording method.
[0046]
The advantage of the PES recording method over the ES recording method is that when reading from the magnetic tape 9 and outputting it as a TS to the outside of the apparatus, conversion to TS is easy due to the addition of PTS and DTS. .
[0047]
By the way, the structure of the PES packet is not unique. For video, for example, when one PES packet is composed of one video frame, or one PES packet is composed of GOPs composed of a plurality of video frames. There is a case. For audio, for example, one PES packet may be composed of one audio frame (AAU), or one PES packet may be composed of a plurality of audio frames.
[0048]
Therefore. In order to make editing easier, the PES structure in the PES recording system is unified so that one frame is composed of one PES packet for both video and audio.
[0049]
Next, a recording format suitable for recording PES on the magnetic tape 9 will be described. Before that, the data structure of TS packets and PES packets will be described. The recording format can also be applied when ES is recorded on the magnetic tape 9. The recording format can also correspond to a TS such as a multi-program.
[0050]
FIG. 4 shows the data structure of the TS packet. TS packet is 8 bit sync byte (sync_byte), 1 bit transport error indicator (transport_error_indicator), 1 bit payload unit start indicator (payload_unit_start_indicator), 1 bit transport priority (transport_priority), 13 bit packet identification Information (Packet_ID), 2 bits of scramble control (transport_scrambling_control), 2 bits of adaptation field control (adaptation_field_control), 4 bits of continuity counter (continuity_counter), and a fixed length (hereinafter, 184 bytes of adaptation field) 188 bytes).
[0051]
The sync byte represents the head of the TS packet. The transport error indicator represents the presence / absence of a bit error in the TS packet. The payload unit start indicator indicates that the head of the PES packet is recorded in the payload of the TS packet. The packet priority represents the importance of the TS packet. The packet identification information represents the attribute of the individual stream of the TS packet. The scramble control represents the presence / absence and type of the payload of the TS packet. The adaptation field control represents the presence / absence of an adaptation field and the presence / absence of a payload. The continuity counter represents the order of a plurality of TS packets having the same packet identification information.
[0052]
In the adaptation field, in addition to the program time base reference value PCR, additional information related to the individual stream is recorded. In the adaptation field, if additional information to be recorded is less than 184 bytes, a stuffing byte is recorded. In the payload, a divided PES packet, program specification information PSI (Program Specific Information), and the like are recorded.
[0053]
FIG. 5 shows the data structure of the PES packet. The PES packet includes a 32-bit packet start code, a 16-bit PES packet length, a 2-bit “10”, a 14-bit flag and control, and an 8-bit PES header data length ( PES header data length), 40-bit PTS, 40-bit DTS, 152-bit other information, PES header consisting of 8N-bit stuffing bytes, and variable-length PES payload consisting of undefined data length Packet.
[0054]
The packet start code is composed of a 24-bit start start code and an 8-bit stream ID and represents the start of the PES packet. In the PES packet length, the data length of the PES packet is recorded. “10” following the PES packet length indicates that the packet is a PES packet. In the flag and control, scrambled presence / absence and type of the PES packet, priority, copyright information, and the like are recorded. In the PES header data length, the data length of the PES header is recorded.
[0055]
Next, a recording format for the magnetic tape 9 will be described with reference to FIG. On one track of the magnetic tape 9, 141 sync blocks (hereinafter referred to as SB) are recorded. Error correction C2 parity is recorded in nine SBs at both ends of each track. Main data (such as PES packets) is recorded in 123 SBs sandwiched between C2 parities.
[0056]
The SB has a fixed length of 111 bytes and includes a 2-byte sync, a 3-byte ID, a 1-byte SB header, a 95-byte data area, and a 10-byte C1 parity for error correction.
[0057]
In the 3-byte ID, a track number, an SB number, and an overwrite protect code are recorded. The overwrite protect code is a value that is updated every time information is overwritten on the same SB, and is information used to prevent previous data from being erased at the time of overwriting.
[0058]
FIG. 7 shows information recorded in a 1-byte (8-bit) SB header. Three bits (bit-7 to bit-5 in FIG. 7) on the MSB (Most Significant Bit) side of the SB header represent the data type of data recorded in the 95-byte data area following the SB header. Different information for each data type is recorded in 5 bits (bit-4 to bit-0 in FIG. 7) on the LSB (Least Significant Bit) side.
[0059]
When the 3 bits on the MSB side of the SB header is 000, the data type is PES-VIDEO. When the 3 bits on the MSB side of the SB header is 001, the data type is PES-AUDIO. When the data type is PES-VIDEO or PES-AUDIO, the Full / Partial flag is recorded in the 4th bit (bit-4 in FIG. 7) from the MSB side of the SB header, followed by 4 bits on the LSB side (see FIG. 7). 7 (bit-3 to bit-0) records a continuity count value indicating the continuity of SBs of the same data type.
[0060]
FIG. 8 shows the data structure of an SB whose data type is PES-VIDEO or PES-AUDIO. When the PES packet occupies the entire 95-byte data area following the SB header, 0 is recorded in the Full / Partial flag of the SB header. If the PES packet does not occupy the entire data area, 1 is recorded in the Full / Partial flag, and the data length of the PES packet that is recorded after being pre-packed is recorded in 1 byte on the MSB side of the data area. Is done.
[0061]
Returning to FIG. 7, when the 3 bits on the MSB side of the SB header is 010, the data type is SEARCH-DATA. When the data type is SEARCH-DATA, the Video / Audio flag is recorded in the fourth bit from the MSB side of the SB header, and the search speed is recorded in the next three bits. The remaining 1 bit is reserved. Search data of a fixed size is recorded in the data area. Note that the positions of SBs having a data type of SEARCH-DATA in the track are determined in advance, and SBs of other data types are arranged avoiding the position of the SB of SEARCH-DATA.
[0062]
When the 3 bits on the MSB side of the SB header are 011, the data type is AUX. When the data type is AUX, the AUX mode is recorded in the 4th to 6th bits from the MSB side of the SB header. The remaining 2 bits are reserved. Fixed-size AUX data (auxiliary information) is recorded in the data area.
[0063]
The 3-bit AUX mode represents the type of AUX data. When the 3 bits are 000, the AUX mode is AUX_V, and AUX data accompanying the video data is recorded in the data area. When the 3 bits are 001, the AUX mode is AUX_A, and AUX data accompanying audio data is recorded in the data area. When the 3 bits are 010, the AUX mode is PSI-1, and the first half of the PSI TS packet is recorded in the data area. When the 3 bits are 011, the AUX mode is PSI-2, and the latter half of the PSI TS packet is recorded in the data area. When the 3 bits are 100, the AUX mode is SYSTEM, and system AUX data is recorded in the data area.
[0064]
FIG. 9 shows the data structure of an SB whose data type is AUX and whose AUX mode is PSI-1 or PSI-2. The first 3 bytes of the SB data area where the AUX mode is PSI-1 is reserved, and the next 92 bytes are the first one sync byte (Sync_byte) from the first half of the PSI TS packet (188 bytes) 92 bytes excluding are recorded. In the SB data area where the AUX mode is PSI-2, 95 bytes of the second half of the PSI TS packet in which the first half is recorded in the SB data area where the AUX mode is PSI-1 are recorded. That is, one PSI TS packet is recorded with the AUX mode divided into two parts, PSI-1 SB and PSI-2 SB.
[0065]
Returning to FIG. 7, when the 3 bits on the MSB side of the SB header is 100, the data type is TS-1. When the data type is TS-1, the 4th and 5th bits from the MSB side of the SB header are reserved. A 27-bit time stamp is recorded in the remaining 3 bits and the first 3 bytes (24 bits) of the subsequent data area.
[0066]
When the 3 bits on the MSB side of the SB header is 101, the data type is TS-2. When the data type is TS-2, a continuity count value is recorded in 5 bits on the LSB side of the SB header.
[0067]
FIG. 10 shows the data structure of an SB whose data type is TS-1 or TS-2. As described above, the first 3 bytes of the data area of SB whose data type is TS-1 are combined with 3 bits on the LSB side of the SB header and used for recording a 27-bit time stamp. In the subsequent 92 bytes of the data area, 92 bytes are recorded by excluding the first one byte sync byte (Sync_byte) from the first half of the TS packet (188 bytes). In the data area of the SB whose data type is TS-2, 95 bytes of the latter half of the TS packet in which the first half is recorded in the data area of the SB whose data type is TS-1 are recorded.
[0068]
That is, one TS packet is recorded by being divided into two SBs having a data type TS-1 and SBs TS-2. The continuity count value recorded in the SB header whose data type is TS-2 represents the continuity of TS packets recorded in the SB of TS-1 and the SB of TS-2.
[0069]
Returning to FIG. 7, when the 3 bits on the MSB side of the SB header is 110, the data type is NULL. When the data type is NULL, invalid data is recorded in the data area only to satisfy the recording rate. Note that data bytes recorded after the SB header whose data type is NULL are ignored.
[0070]
The data type when the 3 bits on the MSB side of the SB header is 111 is undefined (reserved).
[0071]
Next, four types of recording processing that can be performed by the AV recording / reproducing apparatus to which the present invention is applied will be described with reference to FIGS. 11 to 14 show the concept of each recording process. In the following, the ES encoded by the video encoding unit 1, the video PES converting unit 2, the audio encoding unit 3 or the audio PES converting unit 4 of the AV recording / playback apparatus, the PES converted PES, and the PES The TS formed is referred to as Native, and the other ES, PES, and TS are referred to as Non-Native.
[0072]
As shown in FIG. 11, the first recording process is a method of converting a native ES into a PES and recording it as a native PES. As shown in FIG. 12, the second recording process is a method in which a Native TS is converted to PES again and recorded as a Native PES.
[0073]
As shown in FIG. 13, the third recording process is a method of converting a non-native TS into an ES, further converting it into a PES, and recording it as a non-native PES. However, the condition for applying the third recording process is that the TS is not a multi-program but a single program, and vbv_delay is added to the video ES. This is because when vbv_delay is not assigned (when 0xFFFF is recorded in vbv_delay), arrival time information is lost when TS is converted to PES, and TS cannot be restored during playback.
[0074]
As shown in FIG. 14, the fourth recording process is a method of adding a time stamp to a non-native TS and recording it as a non-native TS. The fourth recording process is applied to a TS that does not satisfy the conditions for applying the third recording process described above.
[0075]
Hereinafter, the first to fourth recording processes will be specifically described.
[0076]
The first recording process will be described with reference to the flowchart of FIG. In step S <b> 1, the video encoder 1 encodes the input video baseband signal by the MPEG method to generate a video ES, and outputs the video ES to the video PES converter 2. At this time, the bit rate of the video ES is accurately encoded at a bit rate equal to the maximum rate recorded in the bit rate included in the sequence header. In addition, an accurate value is recorded in vbv_delay of the picture header.
[0077]
The audio encoding unit 3 generates an audio ES by encoding the input audio baseband signal using the MPEG method, and outputs the audio ES to the audio PES unit 4.
[0078]
In step S2, the video PES converting unit 2 generates a PES packet by adding a PES header including PTS and DTS to each video frame of the video ES input from the video encoding unit 1, and generates an A / V mixing unit. 5 is output.
[0079]
The audio PES conversion unit 4 generates a PES packet by adding a PES header including PTS and DTS for each audio frame (AAU) of the audio ES input from the audio encoding unit 3, and generates an A / V mixing unit 5. Output to.
[0080]
In step S3, the A / V mixing unit 5 performs three PES packets of I picture, B picture, and B picture, or P picture, B picture, and B picture for the video PES packet from the video PES converting unit 2. The three PES packets are combined into an editing unit. The A / V mixing unit 5 also sets PTS1 as the earliest value among the PTS times of the combined three-frame images, and sets PTS2 as the earliest value of the next three-frame images. In addition, audio PES packets having PTSs prior to PTS2 are combined into an editing unit, and are arranged alternately in the order of audio editing unit and video editing unit to generate a mixed PES.
[0081]
In step S4, the A / V mixing unit 5 generates SB whose data type is AUX and AUX mode is AUX_V or AUX_A, records auxiliary information such as copyright information in the data area, and Insert the SB of AUX at the boundary of the mixed PES.
[0082]
In step S5, the A / V mixing unit 5 sets the mixed video PES packet and audio PES packet to 95 bytes for each PES packet so that the data type is the SB data area of PES_VIDEO or PES_AUDIO. Divide every time. Further, as described above with reference to FIG. 8, the A / V mixing unit 5 divides the PES packet into 95 bytes and occupies the entire data area of the SB. Is generated. If the PES packet divided is less than 95 bytes and does not fill the SB data area (95 bytes), the data length is recorded in the first byte of the divided PES packet less than 95 bytes, Also, an SB header in which 1 is recorded in the Full / Partial flag is generated.
[0083]
In step S6, the A / V mixing unit 5 records the continuity counter value in the SB header for each SB whose data types are PES_VIDEO and PES_AUDIO, and completes the SB header. In step S5, the PES packet is sent every 95 bytes. The SB is generated by adding to the divided data. The generated SB is held in an interleave unit memory built in the A / V mixing unit 5.
[0084]
The A / V mixing unit 5 further generates SB whose search data is recorded as a data type SEARCH_DATA, system auxiliary information is recorded as AUX, and the AUX mode is SYSTEM SB. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.
[0085]
In addition, when the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.
[0086]
In step S7, the A / V mixing unit 5 generates C2 parity for the SB for one track, adds C1 parity to the end of each SB, and outputs it to the recording unit 6 in the order of recording on the magnetic tape 9. To start.
[0087]
In step S8, the recording unit 6 randomizes the SBs sequentially input from the A / V mixing unit 5 in the M series in the same manner as the DV format used in the existing consumer digital VCR, The run length limitation and tracking frequency are superimposed by 25 conversions and recorded on the magnetic tape 9.
[0088]
The second recording process will be described with reference to the flowchart of FIG. The second recording process is started when it is determined that the TS is Native based on information recorded in a descriptor of a PMT (Program Map Table) input together with the TS to the demultiplexer 7.
[0089]
In step S11, the demultiplexer 7 separates the input TS into a video TS packet and an audio TS packet, and outputs them to the video PES unit 2 or the audio PES unit 4, respectively. At this time, based on the transport error indicator and continuity counter in the header of the TS packet, the demultiplexer 7 detects and discards the TS packet with the error or the discontinuous TS packet, The generation is notified to the A / V mixing unit 5 via the control unit 16. The demultiplexer 7 further discards the PCR included in the TS.
[0090]
The video PES converting unit 2 restores the video PES packet from the video TS packet input from the demultiplexer 7 and outputs it to the A / V mixing unit 5. The video PES converting unit 2 also extracts auxiliary information such as copyright information from the video TS packet and outputs it to the A / V mixing unit 5. Since the restored video PES packet is Native, each PES packet is composed of one video frame.
[0091]
The audio PES unit 4 restores the audio PES packet from the audio TS packet input from the demultiplexer 7 and outputs it to the A / V mixing unit 5. The audio PES unit 4 also extracts auxiliary information such as copyright information from the audio TS packet and outputs it to the A / V mixing unit 5. Since the restored audio PES packet is Native, each PES packet is composed of one audio frame (AAU).
[0092]
For the video PES packet from the video PES converting unit 2, the A / V mixing unit 5 includes three PES packets of I picture, B picture, and B picture, or three PESs of P picture, B picture, and B picture. Combine the packets into an editing unit. As shown in FIG. 17, the A / V mixing unit 5 also sets the earliest value of PTS times of the combined three-frame images as PTS1 and the earliest value of the next three-frame images as PTS2. In this case, an audio PES packet having a PTS after PTS1 and before PTS2 is combined into an editing unit, and a mixed PES is generated by alternately arranging the audio editing unit and the video editing unit in this order. To do. FIG. 17 shows the delay amount until the input TS is recorded as PES by the second recording process.
[0093]
In step S12, the A / V mixing unit 5 generates an SB whose data type is AUX and whose AUX mode is AUX_V, and auxiliary information such as copyright information input from the video PES converting unit 2 in the data area. And the SB is combined with the video PES packet. The A / V mixing unit 5 also generates an SB whose data type is AUX and the AUX mode is AUX_A, and records auxiliary information such as copyright information input from the audio PES converting unit 4 in the data area. Then, the SB is combined with the audio PES packet.
[0094]
In step S13, the A / V mixing unit 5 sets the video PES packet and the audio PES packet, which are arranged in a mixed manner, to 95 bytes for each PES packet so that the data type is the SB data area of PES_VIDEO or PES_AUDIO. Divide every time. Further, as described above with reference to FIG. 8, the A / V mixing unit 5 divides the PES packet into 95 bytes and occupies the entire data area of the SB. Is generated. If the PES packet divided is less than 95 bytes and does not fill the SB data area (95 bytes), the data length is recorded in the first byte of the divided PES packet less than 95 bytes, Also, an SB header in which 1 is recorded in the Full / Partial flag is generated.
[0095]
In step S14, the A / V mixing unit 5 records the continuity counter value in the SB header for each SB whose data types are PES_VIDEO and PES_AUDIO, and completes the SB header. The SB is generated by adding to the divided data. The generated SB is held in an interleave unit memory built in the A / V mixing unit 5.
[0096]
The A / V mixing unit 5 further generates SB whose search data is recorded as a data type SEARCH_DATA, system auxiliary information is recorded as AUX, and the AUX mode is SYSTEM SB. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.
[0097]
In addition, when the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.
[0098]
If a TS packet error or discontinuity is notified from the demultiplexer 7 via the control unit 16, in steps S13 and S14, the A / V mixing unit 5 leaves half-complete data up to the point immediately before the error. If there is, the data is recorded in the SB with Partial, and the data after the error is recorded in the new SB. Further, a discontinuous value is intentionally recorded in the continuity counter of the new SB header so that the position of the error can be identified during reproduction.
[0099]
In step S15, the A / V mixing unit 5 generates C2 parity for the SB for one track, adds C1 parity to the end of each SB, and outputs it to the recording unit 6 in the order of recording on the magnetic tape 9. To start.
[0100]
In step S16, the recording unit 6 performs randomization of the SBs sequentially input from the A / V mixing unit 5 in the M series in the same manner as the DV format used for the existing consumer digital VCR. The run length limitation and tracking frequency are superimposed by 25 conversions and recorded on the magnetic tape 9.
[0101]
The third recording process will be described with reference to the flowchart of FIG. The third recording process is a condition in which the TS is non-native and the third recording process can be applied based on the information recorded in the descriptor of the PMT input to the demultiplexer 7 together with the TS. It is started when it is determined that the condition is satisfied (single program and vbv_delay is added to the video ES).
[0102]
In step S21, the demultiplexer 7 separates the input TS into a video TS packet and an audio TS packet, and outputs each to the video PES unit 2 or the audio PES unit 4. At this time, based on the transport error indicator and continuity counter in the header of the TS packet, the demultiplexer 7 detects and discards the TS packet with the error or the discontinuous TS packet, The generation is notified to the A / V mixing unit 5 via the control unit 16. The demultiplexer 7 further detects TS packets of PSI from the TS and supplies them to the A / V mixing unit 5. The demultiplexer 7 further discards the PCR included in the TS.
[0103]
The video PES converting unit 2 restores the video PES packet from the video TS packet input from the demultiplexer 7, determines whether or not the video PES packet is composed of one video frame, and is composed of one video frame. If it is determined that it has not been converted, it is converted to ES, and then PTS and DTS are interpolated, converted into a PES packet similar to Native composed of one frame, and output to the A / V mixing unit 5. The video PES converting unit 2 also extracts auxiliary information such as copyright information from the video TS packet and outputs it to the A / V mixing unit 5.
[0104]
The audio PES converting unit 4 restores the audio PES packet from the audio TS packet input from the demultiplexer 7 and determines whether or not the audio PES packet is composed of one audio frame (AAU). If it is determined that the frame is not configured, it is converted to ES, and then the PTS is interpolated to be converted into a PES packet similar to Native configured by one frame and output to the A / V mixing unit 5. The audio PES unit 4 also extracts auxiliary information such as copyright information from the audio TS packet and outputs it to the A / V mixing unit 5.
[0105]
In step S22, the A / V mixing unit 5 performs three PES packets of I picture, B picture, and B picture, or P picture, B picture, and B picture for the video PES packet from the video PES converting unit 2. The three PES packets are combined into an editing unit. The A / V mixing unit 5 also sets PTS1 as the earliest value among the PTS times of the combined three-frame images, and sets PTS2 as the earliest value of the next three-frame images. In addition, audio PES packets having PTSs prior to PTS2 are combined into an editing unit, and are arranged alternately in the order of audio editing unit and video editing unit to generate a mixed PES.
[0106]
In step S23, the A / V mixing unit 5 generates an SB whose data type is AUX and whose AUX mode is AUX_V, and auxiliary information such as copyright information input from the video PES converting unit 2 in the data area. And the SB is combined with the video PES packet. The A / V mixing unit 5 also generates an SB whose data type is AUX and the AUX mode is AUX_A, and records auxiliary information such as copyright information input from the audio PES converting unit 4 in the data area. Then, the SB is combined with the audio PES packet. In addition, the A / V mixing unit 5 generates SB whose data type is AUX and whose AUX mode is PSI-1 and SB whose AUX mode is PSI-2, and stores it in the data area of the SB of PSI-1. The first half of the PSI TS packet from the multiplexer 7 is recorded, and the second half of the PSI TS packet is recorded in the SB data area of the PSI-2.
[0107]
In step S24, the A / V mixing unit 5 sets the mixed video PES packet and audio PES packet to 95 bytes for each PES packet so that the data type is the SB data area of PES_VIDEO or PES_AUDIO. Divide every time. Further, as described above with reference to FIG. 8, the A / V mixing unit 5 divides the PES packet into 95 bytes and occupies the entire data area of the SB. Is generated. If the PES packet divided is less than 95 bytes and does not fill the SB data area (95 bytes), the data length is recorded in the first byte of the divided PES packet less than 95 bytes, Also, an SB header in which 1 is recorded in the Full / Partial flag is generated.
[0108]
In step S25, the A / V mixing unit 5 records the continuity counter value in the SB header of the SB whose data type is PES_VIDEO and the SB whose data type is PES_AUDIO, and completes the SB header. In step S5, the PES packet Is added to those divided every 95 bytes to generate SB. The generated SB is held in an interleave unit memory built in the A / V mixing unit 5.
[0109]
The A / V mixing unit 5 further generates SB whose search data is recorded as a data type SEARCH_DATA, system auxiliary information is recorded as AUX, and the AUX mode is SYSTEM SB. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.
[0110]
In addition, when the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.
[0111]
If a TS packet error or discontinuity is notified from the demultiplexer 7 via the control unit 16, in steps S24 and S25, the A / V mixing unit 5 leaves half-complete data up to immediately before the error. If so, the Partial flag is set and recorded in the SB, and the data after the error is recorded in the new SB. Further, a discontinuous value is intentionally recorded in the continuity counter of the new SB header so that the position of the error can be identified during reproduction.
[0112]
In step S26, the A / V mixing unit 5 generates C2 parity for SB for one track, adds C1 parity to the end of each SB, and outputs it to the recording unit 6 in the order of recording on the magnetic tape 9. To start.
[0113]
In step S27, the recording unit 6 randomizes the SBs sequentially input from the A / V mixing unit 5 in the M series in the same manner as the DV format used in the existing consumer digital VCR. The run length limitation and tracking frequency are superimposed by 25 conversions and recorded on the magnetic tape 9.
[0114]
The fourth recording process will be described with reference to the flowchart of FIG. The fourth recording process is a condition in which the TS is Non-Native and the third recording process can be applied based on information recorded in a descriptor of the PMT input to the demultiplexer 7 together with the TS. It is started when it is determined that the above is not satisfied (not a single program or vbv_delay is not added to the video ES).
[0115]
In step S <b> 31, the demultiplexer 7 separates the input non-native TS into TS packets and outputs the TS packets to the A / V mixing unit 5. The A / V mixing unit 5 removes the first sync byte from the input TS packet, then divides it into 92 bytes in the first half and 95 bytes in the second half, and records the 92 bytes in the first half in the data area. An SB having a data type of TS-1 and an SB having a data type of TS-2 in which 95 bytes of the latter half are recorded in the data area are generated.
[0116]
In step S32, the A / V mixing unit 5 sets the arrival time to 27 bits including 3 bits on the LSB side of the header of the SB whose data type is TS-1 generated in step S31 and the first 3 bytes of the data area. A time stamp indicating is added.
[0117]
In step S33, the A / V mixing unit 5 records a continuity count value indicating the continuity of TS packets in 5 bits on the LSB side of the SB header whose data type is TS-2 generated in step S31. The generated SB is held in a memory built in the A / V mixing unit 5. Note that the corresponding TS-1 SB and TS-2 SB are arranged as continuously as possible. Even if an error or discontinuity occurs in the TS packet, it is recorded in the SB as it is.
[0118]
The A / V mixing unit 5 further generates SB whose search data is recorded as a data type SEARCH_DATA, system auxiliary information is recorded as AUX, and the AUX mode is SYSTEM SB. The generated SB is held at a predetermined position in a memory built in the A / V mixing unit 5.
[0119]
In addition, when the generated SB is insufficient for the recording rate for the magnetic tape 9, the A / V mixing unit 5 generates an SB whose data type is NULL. The generated SB is held in a memory built in the A / V mixing unit 5.
[0120]
In step S <b> 34, the A / V mixing unit 5 outputs SB from the built-in memory to the recording unit 6 in the order of recording on the magnetic tape 9. The recording unit 6 randomizes the SBs sequentially input from the A / V mixing unit 5 in the M series in the same manner as the DV format used in the existing consumer digital VCR, and then performs the run by 24/25 conversion. The length limit and the tracking frequency are superimposed and recorded on the magnetic tape 9.
[0121]
Next, playback processing of the AV recording / playback apparatus to which the present invention is applied will be described. This AV recording / reproducing apparatus reads out and decodes PES or TS recorded on the magnetic tape 9 by the above-described four types of recording processes, and outputs the resulting video signal and audio signal, as well as the magnetic tape 9. TS output processing that reads the PES recorded in the above and converts it into a TS for output is possible.
[0122]
The TS output process of the AV recording / reproducing apparatus will be described with reference to the flowchart of FIG. 20 and FIG. In this TS output process, SBs sequentially read from the magnetic tape 9 by the reproducing unit 10 are reproduced into PES packets (including error correction based on parity data) and supplied to the TS unit 14, and I Triggered when a PES packet of a picture is detected. FIG. 21 shows a delay amount until the read PES is output as a TS.
[0123]
In step S41 (corresponding to (1) in FIG. 22), the TS output unit 14 reads DTS from the PES header of the I picture, reads vbv_delay from the picture header, calculates DTS- (vbv_delay), and further calculates DTS- A time obtained by subtracting a predetermined time from (vbv_delay) is set to an initial value to initialize an STC (System Time Clock), and the STC counter starts free-running.
[0124]
In step S42 (corresponding to (2) in FIG. 22), the TS output unit 14 generates PAT and PMT PSI packets and outputs them at predetermined intervals. As a result, the receiving side of the TS can receive and recognize the PAT and PMT before receiving the video and audio TS packets. Can be suppressed.
[0125]
In step S43 (corresponding to (3) in FIG. 22), the TS output unit 14 outputs a PCR packet in which the STC value is recorded at an arbitrary interval.
[0126]
In step S44 (corresponding to (4) in FIG. 22), the TS output unit 14 at the timing when the STC coincides with the time (DTS- (vbv_delay)) obtained by subtracting vbv_delay from the DTS of the first I picture for the video. The video PES packet is converted to a TS and output is started. For the subsequent pictures, the PES packet is converted to TS and output at the timing when the time obtained by subtracting vbv_delay from DTS coincides with DTS. Since no DTS is recorded in the B picture, the same process is performed using PTS instead.
[0127]
The TS output unit 14 (as processing corresponding to (5) in FIG. 22) also subtracts Start Up Delay from the PTS of the first frame (AAU) for audio (PTS- (Start Up Delay)) and STC. The audio PES packet is converted to a TS and output is started at the timing when the two match. Note that the audio output rate is made to exactly match the value recorded in the bit rate index (Bitrate_index) of the header.
[0128]
The AV recording / reproducing apparatus can further output the TS recorded on the magnetic tape 9 in the TS state.
[0129]
Next, as points to be noted in the TS output process of the TS unit 14, the output interval of video TS packets, the handling of AUX data (auxiliary information), and the process of outputting a non-native TS recorded on the magnetic tape 9 PES recording error processing and TS recording error processing are listed.
[0130]
First, the output interval of video TS packets will be described. When vbv_delay other than 0xFFFF is recorded in the picture header of the PES read and reproduced from the magnetic tape 9, and the value of the bit rate (bit_rate) of the sequence header and the output rate exactly match, that is, the PES is In the case of Native, TS conversion is performed at a rate slightly higher than the bit rate, and when there is no data for each picture, it is only necessary to wait until data for the next picture is input.
[0131]
Also, vbv_delay is not recorded (0xFFFF is recorded) in the PES picture header read and played back from the magnetic tape 9, or the bit rate (bit_rate) value of the sequence header does not exactly match the output rate If the PES is Non-Native, the time to (DTS- (vbv_delay)) of the next picture for each picture is divided by the number of bits of the picture and output at the interval of the division value. Good.
[0132]
Next, the handling of AUX data (auxiliary information) will be described. When the PES read from and reproduced from the magnetic tape 9 is Native, the AUX data is recorded in the SB having the data type of AUX_V or AUX_A by the first or second recording process described above. Outputs AUX data recorded in AUX_V and AUX_A as they are in a TS packet. Since AUX_V is combined with the video PES and AUX_A is combined with the audio PES, the AUX data is converted into a TS in accordance with the video or audio PES and output.
[0133]
PMT generates a native one. The PMT records video, audio, AUX, and PCR PIDs. The PMT also records copyright information etc. in the AUX data so that it can be interpreted by general-purpose devices. In addition, a descriptor indicating that it is Native is recorded in the PMT.
[0134]
When the PES read from the magnetic tape 9 and played back is Non-Native, the AUX data PAT, PMT, SIT, etc. are SB whose data type is AUX and AUX mode is PSI-1 or PSI-2 Therefore, it may be returned to the TS packet as it is and output. When returning to the TS packet, if the values recorded in the PMT are used as they are as the video, audio, and PCR PIDs, the process of rewriting the PMT and CRC (Cyclic Redundancy Check) can be omitted.
[0135]
Next, a process of outputting a non-native TS recorded on the magnetic tape 9 will be described. Since a time stamp is recorded on the TS recorded on the magnetic tape 9 by the above-described fourth recording process, the TS is output when the time stamp matches with respect to the STC at the time of reproduction. Since the TS header reproduced from the magnetic tape 9 does not have a sync byte by the fourth recording process, this is added and output.
[0136]
Next, error processing based on the SB header continuity counter for data recorded by PES will be described with reference to FIG. Through the first to third recording processes described above, the SB data type is recorded in the SB header. Therefore, when an error occurs in an SB and cannot be corrected, the data type of the SB is unknown.
[0137]
Therefore, based on the continuity of the continuity counter value recorded in the SB header of the SB in which no error has occurred, the SB data type in which an error has occurred and cannot be corrected is determined.
[0138]
Specifically, when the continuity counter value of the SB whose data type is PES-VIDEO is monitored and a discontinuity in the SB continuity counter value before and after the SB where an uncorrectable error has occurred is detected, the correction is not possible. It is determined that the data type of the SB in which an error has occurred is PES-VIDEO. Similarly, if the SB continuity counter value with the data type PES-AUDIO is monitored and a discontinuity in the SB continuity counter value before or after the SB where an uncorrectable error has occurred is detected, an uncorrectable error will occur. It is determined that the data type of the SB in which the error occurs is PES-AUDIO.
[0139]
Such determination makes it possible to identify whether or not an error has occurred in the SB in which the PES is recorded, so that the influence of the occurrence of the error on the video and audio to be reproduced can be reduced.
[0140]
Even if an error occurs at the boundary between the SB of PES-VIDEO and the SB of PES-AUDIO, the error is determined by checking the continuity with the last continuity counter value of the previous unit. Can be detected.
[0141]
When the continuity counter value is continuous, TS is continuously output, and when it is determined that the continuity counter value is discontinuous and cannot be corrected, an error code is inserted. As an error code insertion method, a sequence error code 0x000001B4 may be inserted in the ES layer. In the TS layer, a packet in which the transport error indicator (transport_error_indicator) is set to 1 may be output.
[0142]
By the way, since the continuity counter value is a 4-bit value that circulates from 0 to 15, when SBs having the same data type are successively lost in multiples of 16, it cannot be detected. Therefore, when 16 or more SBs having uncorrectable errors are consecutive, an error code is inserted regardless of the data type of those SBs.
[0143]
In addition, even if no uncorrectable error has occurred in the SB, if this error processing is executed, the discontinuous continuity counter value intentionally recorded at the time of recording is handled as an error at the time of reproduction. Can do.
[0144]
Next, error processing based on the SB header continuity counter for data recorded in the TS will be described with reference to FIG. By the fourth recording process described above, the SB data type is recorded in the SB header. Therefore, when an error occurs in an SB and cannot be corrected, the data type of the SB is unknown.
[0145]
Therefore, based on the continuity of the continuity counter value recorded in the SB header of the SB in which no error has occurred, the SB data type in which an error has occurred and cannot be corrected is determined.
[0146]
Specifically, a normal SB data type sandwiching an uncorrectable SB is monitored, and if the data type continues from TS-1 to TS-2, the continuity counter recorded in the SB header of the TS-2 The continuity of the value with the continuity counter value recorded in the SB header of the previous TS-2 is determined. If it is determined that they are continuous, the SB of the TS-1 and the SB of the TS-2 are a pair, so that they are restored to one TS packet and output. On the other hand, if it is determined that they are not continuous, the SB of the TS-1 and the SB of the TS-2 are not pairs, but both are discarded because they are SBs lacking a pair.
[0147]
The fact that the TS is discarded here is detected on the receiving side based on the continuity counter value recorded in the TS header of the output TS that precedes and follows, so that an error occurs in the video and audio to be played back. Can reduce the influence of.
[0148]
If the data type continues from TS-2 to TS-1, the data is output as is without executing error processing. That is, even if the uncorrectable SB data type is TS-1 or TS-2, this is identified on the reproduction side based on the discontinuity of the continuity counter value of the TS header.
[0149]
When the data type continues from TS-1 to TS-1, the previously read SB of TS-1 is discarded. The discarding of the previously read TS-1 SB is identified on the playback side based on the discontinuity of the continuity counter value of the TS header.
[0150]
If the data type continues from TS-2 to TS-2, the SB of TS-2 read later is discarded. Discarding the TS-2 SB read later is identified on the playback side based on the discontinuity of the continuity counter value of the TS header.
[0151]
With this in mind, the TS output process is executed.
Next, effects expected from the AV recording / reproducing apparatus to which the present invention is applied will be listed.
[0152]
At the time of recording, when recording with ES, the overhead of the recording rate can be minimized. When recording with PES, it can be recorded so that it can be easily converted to TS. When recording with ES or PES, there is less processing during jog playback. When recording by ES or PES, the TS header and the time stamp indicating the TS arrival time are not recorded, so that overhead can be reduced. Therefore, the recording capacity can be saved. Alternatively, the recording time can be extended. Since the PCR is not recorded, there is little overhead. Therefore, the recording capacity can be saved. Alternatively, the recording time can be extended.
[0153]
Also, since one video frame constitutes one PES packet, PTS is assigned to all frames. This makes it easier to restore the timing when converting to TS. In addition, jog reproduction can be easily realized. Since one video frame constitutes one PES packet, PTS is added to all frames. This makes it easier to restore the timing when converting to TS. In addition, audio can be easily divided during editing. It can be edited even if it is not Native. Conventionally, since the data type (data type) identified by PID is represented by an identification code having a smaller number of bits than PID, overhead can be reduced.
[0154]
Further, when the entire data area of the SB is occupied by valid data, the length byte indicating the data length is not recorded, so that the overhead can be reduced. When the section of PSI information is divided into a plurality of TS packets, the head is identified by the payload unit start indicator in the TS packet header, so the PSI should be recorded in two SBs whose data type is AUX for each TS header. This is saved.
[0155]
At the time of TS output, since the TS output is started from (DTS- (vbv_delay)), the timing can be restored even if the arrival time is not recorded. Since TS is output at a slightly higher output rate than the recorded bit_rate, there is no collision at the frame boundary. By outputting TS at equal intervals, even if bit_rate is recorded much higher than the actual rate, it can be output at an average rate. Since the PCR is preceded, the playback side can receive the first frame after loading the PCR into the STC. Therefore, the playback data can be displayed without the beginning missing. Since PAT and PMT are preceded, the playback side can receive the PCR packet without missing it. Since the location of the error can be identified, the influence of the error on the image quality and sound quality can be reduced. An error detected during recording can be transmitted to the reproducing side without increasing the number of bits.
[0156]
The present invention can also be applied to the case where AV signals are recorded on an information recording medium other than a magnetic tape.
[0157]
By the way, the series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.
[0158]
As shown in FIG. 1, this recording medium is distributed to provide a program to a user separately from a computer, and includes a magnetic disk 18 (including a floppy disk) on which a program is recorded, an optical disk 19 (CD- It is not only configured by a package medium including a ROM (Compact Disc-Read Only Memory), a DVD (Digital Versatile Disc), a magneto-optical disc 20 (including an MD (Mini Disc)), or a semiconductor memory 21. It is configured by a ROM, a hard disk or the like on which a program is recorded, which is provided to the user in a state of being pre-installed in the computer.
[0159]
In the present specification, the step of describing the program recorded in the recording medium is not limited to the processing performed in time series according to the described order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.
[0160]
Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.
[0161]
【The invention's effect】
  As described above, according to the first recording apparatus and method and the recording medium program of the present invention,,It is possible to record an AV signal so that no inconvenience occurs when editing.
[0162]
  Further, according to the second recording apparatus and method and the recording medium program of the present invention,,It is possible to record an AV signal so that no inconvenience occurs when editing.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration example of an AV recording / reproducing apparatus to which the present invention is applied.
FIG. 2 is a diagram showing an ES recording method.
FIG. 3 is a diagram showing a PES recording method.
FIG. 4 is a diagram illustrating a data structure of a TS packet.
FIG. 5 is a diagram illustrating a data structure of a PES packet.
FIG. 6 is a diagram showing SB in one track.
FIG. 7 is a diagram illustrating an SB header.
FIG. 8 is a diagram illustrating a data structure of an SB whose data type is PES-VIDEO or PES-AUDIO.
FIG. 9 is a diagram illustrating a data structure of an SB whose data type is AUX.
FIG. 10 is a diagram illustrating a data structure of an SB whose data type is TS-1 or TS-2.
FIG. 11 is a diagram showing a concept of first recording processing.
FIG. 12 is a diagram showing a concept of second recording processing.
FIG. 13 is a diagram showing a concept of a third recording process.
FIG. 14 is a diagram showing a concept of fourth recording processing.
FIG. 15 is a flowchart illustrating a first recording process.
FIG. 16 is a flowchart illustrating a second recording process.
FIG. 17 is a diagram illustrating a delay amount in the second recording process.
FIG. 18 is a flowchart illustrating a third recording process.
FIG. 19 is a flowchart illustrating a fourth recording process.
FIG. 20 is a flowchart illustrating TS output processing.
FIG. 21 is a diagram illustrating a delay amount in TS output processing;
FIG. 22 is a diagram for explaining TS output processing;
FIG. 23 is a diagram for explaining error processing during PES recording.
FIG. 24 is a diagram for explaining error processing during TS recording;
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Video encoding part, 2 Video PES conversion part, 3 Audio encoding part, 4 Audio PES conversion part, 5 A / V mixing part, 6 Recording part, 7 Demultiplexer, 9 Magnetic tape, 10 Playback part, 11 A / V separation Part, 12 video decoding part, 13 audio decoding part, 14 TS conversion part, 16 control part, 17 drive, 18 magnetic disk, 19 optical disk, 20 magneto-optical disk, 21 semiconductor memory

Claims (15)

In a recording apparatus for recording an AV signal on an information recording medium,
A video packetized elementary stream packet for generating a video packetized elementary stream packet by dividing a video elementary stream in which a video signal is compression-encoded by a predetermined method into video frames and adding a header. Generating means;
An audio packetized elementary stream packet that generates an audio packetized elementary stream packet by dividing an audio elementary stream in which an audio signal is compressed and encoded by a predetermined method and adding a header to each audio frame. Generating means;
Video packetized elementary stream packet combination generating means for generating video packetized elementary stream packet combination by combining the video packetized elementary stream packets every predetermined number;
An audio packetized elementary stream packet combination is generated by combining the audio packetized elementary stream packet including an audio frame that is played back simultaneously with a video frame included in the video packetized elementary stream packet combination. An audio packetized elementary stream packet combination generating means,
Sync block generating means for generating a sync block by alternately arranging the video packetized elementary stream packet combination and the audio packetized elementary stream packet combination and then converting the packet into a predetermined recording format;
Recording means and the including recording apparatus for recording the sync block on the information recording medium. The predetermined method for compressing and encoding the video signal and the predetermined method for compressing and encoding the audio signal are MPEG methods.
The recording apparatus according to 請 Motomeko 1. The video packetized elementary stream packet generation means divides the video elementary stream into video frames , adds the header including at least one of a presentation time stamp and a decoding time stamp, Generate video packetized elementary stream packets
The recording apparatus according to 請 Motomeko 1. The audio packetized elementary stream packet generation means divides the audio elementary stream into one audio frame , adds the header including at least a presentation time stamp, and adds the audio packetized elementary stream packet to the audio packetized elementary stream packet. Generate
The recording apparatus according to 請 Motomeko 1. The audio packetized elementary stream packet combination generation means includes a time indicated by a presentation time stamp included in the header of each video packetized elementary stream packet constituting the video packetized elementary stream packet combination. Among the times indicated by the presentation time stamp included in the header of each video packetized elementary stream packet that is after the earliest time and that constitutes the next video packetized elementary stream packet combination, A presentation time stamp indicating a time prior to the earliest time is combined with the audio packetized elementary stream packet recorded in the header to generate the audio. Generating a packetized elementary stream packet bond
The recording apparatus according to 請 Motomeko 1. A transport stream which has been compressed and encoded the video signal and compression encoded the audio signal is multiplexed, further including claims the separating means for separating the audio elementary stream and the video elementary stream The recording apparatus according to 1. The sync block generation means generates the sync block whose data type is AUX using the transport stream packet of the program specific information included in the transport stream as it is.
A recording apparatus according to 請 Motomeko 6. The sync block generating means records identification information for identifying a data type of the sync block in a header of the sync block and generates the sync block
The recording apparatus according to 請 Motomeko 1. The identification information can at least identify whether the data type of the sync block is a video packetized elementary stream packet, an audio packetized elementary stream packet, or a transport stream packet.
The recording apparatus according to 請 Motomeko 8. The sync block generation means records a flag indicating whether or not all of the data area of the sync block is occupied by valid data in the header of the sync block, and all of the data area of the sync block When not occupied by valid data, the data length of the valid data is recorded at the head of the data area.
The recording apparatus according to 請 Motomeko 1. In a recording method of a recording apparatus for recording an AV signal on an information recording medium,
By dividing the video elementary stream video signal is compression-encoded in a predetermined manner for each video frame by adding a header, a video packetized elementary stream packets to generate video packetized elementary stream packet Generation step;
An audio packetized elementary stream packet that generates an audio packetized elementary stream packet by dividing an audio elementary stream in which an audio signal is compressed and encoded by a predetermined method and adding a header to each audio frame. Generation step;
A video packetized elementary stream packet combination generating step for generating a video packetized elementary stream packet combination by combining the video packetized elementary stream packets every predetermined number;
An audio packetized elementary stream packet combination is generated by combining the audio packetized elementary stream packet including an audio frame that is played back simultaneously with a video frame included in the video packetized elementary stream packet combination. An audio packetized elementary stream packet combining generation step;
A sync block generating step for alternately generating the video packetized elementary stream packet combination and the audio packetized elementary stream packet combination, and then converting the video packetized elementary stream packet combination into a predetermined recording format to generate a sync block;
Including recording method and a recording step of recording the sync blocks on said information recording medium. A program for controlling a recording apparatus for recording an AV signal on an information recording medium,
By dividing the video elementary stream video signal is compression-encoded in a predetermined manner for each video frame by adding a header, a video packetized elementary stream packets to generate video packetized elementary stream packet Generation step;
An audio packetized elementary stream packet that generates an audio packetized elementary stream packet by dividing an audio elementary stream in which an audio signal is compressed and encoded by a predetermined method and adding a header to each audio frame. Generation step;
A video packetized elementary stream packet combination generating step for generating a video packetized elementary stream packet combination by combining the video packetized elementary stream packets every predetermined number;
An audio packetized elementary stream packet combination is generated by combining the audio packetized elementary stream packet including an audio frame that is played back simultaneously with a video frame included in the video packetized elementary stream packet combination. An audio packetized elementary stream packet combining generation step;
A sync block generating step for alternately generating the video packetized elementary stream packet combination and the audio packetized elementary stream packet combination, and then converting the video packetized elementary stream packet combination into a predetermined recording format to generate a sync block;
A recording medium on which a program for causing a computer of a recording apparatus to execute a process including a recording step of recording the sync block on the information recording medium is recorded. In a recording apparatus for recording an AV signal on an information recording medium,
A video editing unit generating means for generating a video editing unit by dividing a video elementary stream in which a video signal is compression-encoded in a predetermined method for each predetermined number of video frames;
Audio editing unit generating means for generating an audio editing unit by dividing an audio elementary stream in which an audio signal is compressed and encoded by a predetermined method for each number of audio frames reproduced at the same time as the video editing unit ; ,
Time stamp adding means for adding a time stamp indicating playback timing to the video editing unit and the audio editing unit;
A sync block generating means for alternately generating the video editing unit and the audio editing unit to which the time stamp has been added and then converting the video editing unit into a predetermined recording format to generate a sync block;
Recording means and the including recording apparatus for recording the sync block on the information recording medium. In a recording method of a recording apparatus for recording an AV signal on an information recording medium,
A video editing unit generation step of generating a video editing unit by dividing a video elementary stream in which a video signal is compression-encoded by a predetermined method for each predetermined number of video frames;
An audio editing unit generation step of generating an audio editing unit by dividing an audio elementary stream in which an audio signal is compression-encoded by a predetermined method for each number of audio frames reproduced at the same time as the video editing unit ; ,
A time stamp adding step of adding a time stamp indicating a reproduction timing to the video editing unit and the audio editing unit;
A sync block generating step of alternately arranging the video editing unit and the audio editing unit to which the time stamp is added and then converting the video editing unit to a predetermined recording format to generate a sync block;
Including recording method and a recording step of recording the sync blocks on said information recording medium. A program for controlling a recording apparatus for recording an AV signal on an information recording medium,
A video editing unit generation step of generating a video editing unit by dividing a video elementary stream in which a video signal is compression-encoded by a predetermined method for each predetermined number of video frames;
An audio editing unit generation step of generating an audio editing unit by dividing an audio elementary stream in which an audio signal is compression-encoded by a predetermined method for each number of audio frames reproduced at the same time as the video editing unit ; ,
A time stamp adding step of adding a time stamp indicating a reproduction timing to the video editing unit and the audio editing unit;
A sync block generating step of alternately arranging the video editing unit and the audio editing unit to which the time stamp is added and then converting the video editing unit to a predetermined recording format to generate a sync block;
A recording medium on which a program for causing a computer of a recording apparatus to execute a process including a recording step of recording the sync block on the information recording medium is recorded.

Images