JP2003235011A - Program stream production apparatus and recording and reproducing apparatus employing the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a program stream generating apparatus capable of efficiently producing a program stream from a compressed video stream adopting a variable bit rate method in a field with high real time performance such as a DVD-RAM. <P>SOLUTION: A video bit rate in a VOBU (video object unit) is obtained from a video stream subjected to variable bit rate compression for each VOBU, and reference time information (SCR) to be captured in an input buffer and a decoding time stamp/presentation time stamp (DTS/PTS) are calculated on the basis of the bit rate. Audio and video packs are interleaved according to them to produce the program stream. As a result, the audio packs and the video packs are arranged in average and audio and video data for a longer time can be stored in a medium with a limited capacity. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a field for performing real-time encoding and recording on a DVD recorder or the like, based on a compressed video stream and audio stream.
The present invention relates to an apparatus for generating a program stream in real time or recording / reproducing this.

[0002]

2. Description of the Related Art MPEG (Mov
ing Picture coding Experts Group). this is,
ISO (Interna) regarding efficient compression of moving images
WG8 (Working Group) of the National Standard Organization
8) or a compression standard (CCITT
H261) is meant. Among them, the MPEG-2 compression method uses a fixed bit rate coding method or a variable bit rate coding method.

When the fixed bit rate coding method is used, a certain image group unit, for example, GOP (Group Of P
icture) unit (about 15 frames for playback-only DVD)
The encoding control is performed so that the amount of generated encoding information is constant. That is, from the difference value between the target information amount and the generated information amount for one screen and the initial value of the virtual buffer occupation amount,
Coding control is performed by determining the quantization step of the orthogonal transform coefficient. Such a constant bit rate encoding method is disclosed in, for example, Japanese Patent Laid-Open No. 8-340533.

When the variable bit rate coding method is used, temporary coding is performed once to extract the coding difficulty of a moving image in units of pictures or GOPs. After that, actual encoding is performed again while allocating the bit amount for each picture or GOP according to the extracted encoding difficulty level. Here, when allocating the bit amount, it is necessary to consider the predetermined target average generated information amount, the maximum allowable generated information amount of the transmission medium or the storage medium, and the size of the decoder buffer.
As described above, by assigning a bit amount smaller than the average to an image with low coding difficulty and conversely assigning a bit amount larger than the average to an image with high coding difficulty, a predetermined target average is obtained. It is possible to improve the overall image quality of a moving image within the total bit amount limited by the generated information amount. Such a variable bit rate coding method is mainly used in package media such as authoring of a read-only DVD. The bit rate coding method is disclosed in, for example, Japanese Patent Laid-Open No. 8-289294.

[0005]

When a program stream is generated based on a video stream and an audio stream compressed by the conventional fixed bit rate method, the intervals of the reference time value SCR described in each pack header are constant. is there. However, in the conventional constant bit rate system,
The same bit amount is assigned to each image group regardless of the image coding difficulty. Therefore, an unnecessary bit amount is consumed because an excessive bit amount is allocated to an image having a low coding difficulty. On the other hand, in an image with a high degree of difficulty in encoding, only a small bit amount is assigned, so that image quality deterioration easily occurs.

The object of the present invention is to solve the above problems,
To provide a program stream generation apparatus and a recording / reproducing apparatus using a variable bit rate method that enables recording for a longer time in the field of recording audiovisual information on a medium having a limited capacity such as a DVD-RAM. is there.

[0007]

In order to achieve the above object, a program stream generation device of the present invention comprises a video data transfer unit for extracting and transferring video data for a payload required for video pack generation from a video stream, A video pack generation unit that generates a fixed-length video pack from the transferred video stream, a video reference time value at which the picture data included in the video pack should be captured in the video input buffer of the decoding device, and decoding start and display start A video time information calculation unit that calculates a time value to be performed, a video pack header generation unit that describes the calculated video time information in the header of the video pack, and audio data for a payload required to generate an audio pack from an audio stream. Audio data transfer part that extracts and transfers the audio data, and a fixed-length audio packet from the transferred audio stream. And audio pack generation unit for generating a,
A voice time information calculation unit that calculates a voice reference time value that should take the voice frame data included in the voice pack into the voice input buffer of the decoding device, and a time value that starts decoding and displaying the voice reference time value, and the calculated voice time. An audio pack header generation unit that describes information in the header of an audio pack, an initial value and an increment value of video time information, an initial value and an increment value of audio time information, a head audio pack insertion position, and further calculates picture data. An initial information calculation unit that calculates the pack insertion ratio of the video pack and the audio pack in the audio-video pack group based on the amount, and a request to generate the video pack and the audio pack according to the leading audio pack insertion position and the pack insertion ratio. To the video pack generator and audio pack generator,
And a control unit that notifies the initial information calculation unit when the generation of the audio / video pack group is completed.

The program stream recording / reproducing apparatus of the present invention further includes a video and audio input section for converting an input analog video and audio signal into a digital video and audio signal, and a video and audio signal obtained by compressing and encoding the digital video and audio signal. A video and audio encoder section for generating an audio stream, a program stream generating apparatus described above for generating a program stream from the video and audio streams, a storage section for recording and reproducing the generated program stream in a storage medium, and a storage medium A program stream separation unit that separates the reproduced program stream into video and audio streams, a video and audio decoder unit that decodes the video and audio streams, and the decoded digital video and audio signals into analog video and audio signals. It includes a video and audio output unit converts the voice signal.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. First, a program stream in the DVD-RAM standard will be described as an example of signals handled by the present invention. FIG. 4 shows the structure of a program stream in the DVD-RAM standard.
The program stream used in the DVD-RAM standard is called VOB (Video Object). V
OB is a plurality of VOBUs (Video Objects).
Unit). The VOBU has a configuration in which at least one GOP of an MPEG video stream and an audio stream accompanying it are interleaved. Also, one GOP data should not span multiple VOBUs. VOBU is a GOP included in it
A plurality of video packs that compose the above and a plurality of audio packs that accompany it are configured in the form of an audio / video pack group.

The video pack (V_PCK) includes a pack header 400 that describes a reference time value (SCR) for loading the picture data included in the pack into the video input buffer of the decoding device, a video decoding start time (DTS), and a display start. Video packet header 401 describing time (PTS)
And a payload 402 in which the compressed video stream is stored. The audio pack (A_PCK) is
A pack header 400 that describes a reference time value (SCR) that should capture the audio frame included in the pack into the audio input buffer of the decoding device, and the audio display and decoding start time (P
A voice packet header 401 describing a TS) and a payload 402 storing a compressed voice stream.

In this standard, the size of the physical sector of the DVD-RAM medium is specified to 2048 bytes. Therefore, the generated video pack and audio pack must be 2048 Byte fixed length packs.

FIG. 1 shows an embodiment of a program stream generating device according to the present invention. The program stream generation device 1 receives the compressed video stream 100, the audio stream 101, and the picture data amount 102 included in the video stream as input, and
Is a device for generating and outputting 03. In this embodiment, V
1 shows a program stream generation device when a video stream 100 compressed by a variable bit rate method in which a bit rate is variable for each OBU is used.

The initial information calculation unit 11 is a block for calculating the initial value of the following time information for each VOBU based on the picture data amount. When the VOBU generation completion notification 151 supplied from the control unit 10 is received when the program stream generation is started or when the VOBU generation is completed, the next V
The initial value calculation for OBU is started. As the initial time information to be calculated, the video decoding start time value (DTS) 110, the audio decoding and display start time value (PTS) 111, and the audio frame data included in the first audio pack should be taken into the audio input buffer of the decoding device. When the audio reference time initial value (SCRa [0]) 116 indicating the time, the reference time increment value (ΔSCR) 113 indicating the difference between the reference time values SCR described in each pack header, and the SCR value allocated to each pack The resulting fractional time value, that is, the reference time fractional value (remaining S
CR) 114. Also, the head audio pack insertion position (a_pack_start) 112 in VOBU 112
Then, the pack insertion ratio 115 of the video pack and the audio pack forming the VOBU is calculated.

The time information calculation unit 14 is the initial information calculation unit 1.
1 video decoding start time value (DTS) 110
And voice decoding and display start time value (PTS) 111,
Voice reference time initial value (SCRa [0]) 116, reference time increment value (ΔSCR) 113, reference time fractional value (remaining S
(CR) 114 is input. Then, when the video pack header is generated, the video pack header generation unit 13 receives the video decoding and display start time values (DTS and PT) according to the pack.
S) 120 is supplied. Further, the audio decoding and display start time value (PTS) 121 corresponding to the pack is supplied to the audio pack header generation unit 17 when the audio pack header is generated. Further, the reference time value (SCR) 123 to be added to each pack is supplied to the video pack header generation unit 13 and the audio pack header generation unit 17.

Based on the head audio pack insertion position 112 and the pack insertion ratio 115 supplied from the initial information calculation unit 11, the control unit 10 requests the video pack generation unit 12 and the audio pack generation unit 16 to generate a pack. This is a block that issues 150, collects the generated video pack 134 and audio pack 144, and outputs them as the program stream 103. Further, when the VOBU generation is completed, the VOBU generation completion notification 151 is issued to the initial information calculation unit 11.

The video pack generation unit 12 issues a video pack header generation request 130 to the video pack header generation unit 13 when the pack generation request 150 requests the video pack generation, and thereby the video pack header data 131. Is acquired, and the video data request 132 is issued to the video data transfer unit 15 to acquire the video data 133 necessary for pack generation and generate a video pack.

The audio pack generation unit 16 issues an audio pack header generation request 140 to the audio pack header generation unit 17 when the pack generation request 150 requests the audio pack generation, and thereby the audio header data 141 is issued. Is acquired and the audio data request 142 is issued to the audio data transfer unit 19 to acquire the audio data 143 necessary for the pack generation, and the audio pack is generated.

When the video pack header generation unit 13 receives the video header request 130 from the video pack generation unit 12, the time information calculation unit 14 outputs the reference time value SCR12.
3 is acquired to generate a pack header, the video time information (DTS / PTS) 120 is further acquired from the time information calculation unit 14, a packet header is generated, and the generated header data is supplied to the video pack generation unit 12. It is a block.

When the video data transfer unit 15 receives the video data request 132 from the video pack generation unit 12, the video data transfer unit 15 takes out the video data 133 of the payload required for the video pack generation from the video stream 100 to generate the video pack. This block is supplied to the unit 12.

When the audio pack header generation unit 17 receives the audio header request 140 from the audio pack generation unit 16, the audio pack header generation unit 17 receives the reference time value SCR12 from the time information calculation unit 14.
3 to obtain a pack header, further obtain the audio time information (PTS) 121 from the time information calculation unit 14 to generate a packet header, and supply the generated header data to the audio pack generation unit 16. is there.

When the audio data transfer unit 19 receives the audio data request 142 from the audio pack generation unit 16, the audio data transfer unit 19 extracts the audio data 143 corresponding to the payload required for the audio pack generation from the audio stream 101 to generate the audio pack. This is a block supplied to the unit 16.

This program stream generating device is a VO
The picture data amount is acquired for each BU, and the reference time increment value (ΔSCR) 113 and the insertion ratio of the audio pack and the video pack are calculated based on this, and the audio pack and the video pack are generated on average for each VOBU. can do.

FIG. 2 is a detailed diagram of the initial information calculating section 11 which constitutes the program stream generating apparatus shown in FIG. The video bit rate calculation unit 20 is a block that calculates the video bit rate 200 for each VOBU. VOB
Using the reproduction time length of U (Tgop [seconds]) and the total sum (Dv [bits]) of the picture data amount 102 included in VOBU, the video bit rate (BRv [bps]) 200 is Dv.
It can be represented by / Tgop [bps].

From the picture data amount 102, the video pack calculation unit 23 determines the number of video packs (N included in the VOBU).
This is a block for calculating vpck) 201. The audio pack calculator 24 calculates the audio data amount based on the number of audio frames included in the VOBU, and based on this data amount, V
This is a block for calculating the number of audio packs (Napck) 202 included in the OBU.

The initial video time information calculation unit 21 calculates the time value until a predetermined amount N0 is accumulated in the video input buffer at a video bit rate (BRv [bps]) of 200, which is the decoding start time of the first picture, that is, the video. Decoding start time (DT
S) 110 is a block to be output. DVD-R
The size of the video input buffer defined by the AM standard is 232 KBytes when MPEG2 is used. N0 must not exceed 232 KBytes. The initial audio time information calculation unit 22 includes an audio decoding and display start time (PTS) 111 and an audio reference time initial value (SCRa) indicating the time at which the audio frame data included in the first audio pack should be taken into the audio input buffer of the decoding device. [0]) 1
This is a block for calculating 16.

Speech decoding and display start time (PTS) 11
1 is the same as the video decoding start time (DTS) 110, the audio reference time initial value (SCRa [0]) 116 is
The calculation is performed under the condition that one audio frame or more is accumulated at the time of the video display start time (PTS) 110 and that the audio input buffer is below the audio input buffer.

The head audio pack insertion position calculation unit 25 calculates the number of video packs to be transmitted at times up to the audio reference time initial value (SCRa [0]) 116. In the calculation, the number of video packs included in SCRa [0] is calculated based on the reference time increment (ΔSCR) 113 indicating the pack reference time interval in VOBU. The audio pack at the head of the VOBU is inserted at the next pack position after the video packs of the obtained number of video packs have been transmitted. In addition, VOB is a plurality of VO
When configured with BU, second and subsequent VOBs in VOB
For U, the head voice insertion position 112 is 1. Two
By bringing the first audio pack of the second and subsequent VOBUs to the beginning of the VOBU, it is possible to prevent the interval with the last audio pack of the immediately preceding VOBU from increasing and prevent the audio input buffer from becoming empty at the VOBU boundary. To do.

The reference time increment calculation unit 26 determines the reproduction time length (Tgop [seconds]) of the VOBU as the number of video packs (Nvpck) 201 and the number of audio packs (Napck) 2 included in the VOBU.
In this block, the time value obtained by evenly distributing the sum of 02 as the reference time increment (ΔSCR) 113 between the packs is supplied. In addition, it is a block that outputs a fraction of the reference time that occurs during distribution, that is, a reference time fractional value 114.

The pack insertion ratio calculation unit 27 uses the number of video packs (Nvpck) 201 and the number of audio packs (Napck) 202 to divide the audio packs into the video pack group evenly and insert the audio packs and the video packs. Is a block for calculating the ratio of the pack insertion ratio and supplying it as the pack insertion ratio 115 to the control unit 10.

FIGS. 6 and 7 are schematic diagrams of a program stream generated by using the initial information calculating section shown in FIGS. 1 and 2. FIG. 6 shows the VOB at the beginning of the VOB.
It is the figure which showed the structure of U. The head audio pack 603 is inserted after the video input buffer is composed of only the video pack until the predetermined amount N0 is accumulated. The pack insertion ratio 114 is the audio pack interval in the figure. Figure 7
FIG. 6 is a diagram showing a configuration of second and subsequent VOBUs in a VOB. The head audio pack insertion position 112 is 1.

In the program stream generating apparatus of this embodiment, VOBU is used when generating a program stream using a fixed-length pack used in a DVD-RAM or the like.
It is possible to arrange the audio pack and the video pack on average in the inside. Therefore, for each VOBU, the number of audio packs and the number of video packs are calculated in advance from the obtained picture data amount, and the reference time increment (ΔSCR) 11
3 and the pack insertion ratio 115 are calculated.

FIG. 3 is a detailed diagram of the time information calculation unit 14 which constitutes the program stream generation apparatus shown in FIG. The reference time correction unit 34 is a block that divides the reference time fractional value 114 into minimum time units and adds them sequentially from the VOBU head pack. That is, 1 is issued as the reference time correction value 310 from the beginning of the VOBU each time a pack is generated.
When the remaining amount of the reference time fractional value 114 becomes empty, 0 is issued as the reference time correction value 310.

The reference time calculation unit 33, for each pack generation,
By adding the reference time increment value (ΔSCR) 113 to the reference time value (SCR) 123 of the immediately preceding pack, and further adding the reference time correction value 310 supplied from the reference time correction unit 34, the reference time value ( SCR) 123 is generated.

When the video pack to be generated includes an MPEG access unit, the video time information calculation unit 30 includes the immediately preceding access unit in the video time information (DTS) of the video pack including the immediately preceding access unit. By adding the time interval for the access unit from the video pack, the video time information (DTS / PTS) 12
This is a block for calculating 0. The access unit is an MPEG standard (ISO / IEC 13818-1 2.1.1 access uni
defined in t).

When the audio pack to be generated includes an audio frame header, the audio time information calculation unit 31 adds the immediately preceding audio frame to the audio time information (PTS) included in the audio pack including the immediately preceding audio frame header. This is a block for calculating the audio time information (PTS) 121 by adding the time interval for the audio frame from the included audio pack.

FIG. 5 is an example of an embodiment in which the program stream generating apparatus of the present invention is applied to a recording / reproducing apparatus. The recording / reproducing apparatus converts a video / audio signal obtained by a CCD camera, a microphone or the like into a program stream signal, and records / reproduces it on / from a recording medium such as a DVD.

The image input means 90 uses the analog image original signal 8
00, the video input unit 80 converts it into a digital video original signal, the video encoder unit 81 performs the encoding process, and outputs the picture data amount 102 and the video stream 100. The voice input means 91 is an analog voice original signal 80.
2 is input, and the audio input unit 82 outputs the original digital audio signal 8
03, the audio encoder unit 83 performs encoding processing, and outputs the audio stream 101. Based on the video stream 100, the audio stream 101, and the picture data amount 102, the above-described program stream generation device 94 according to the present invention creates a program stream. The storage unit 89 records and reproduces the program stream on a storage medium such as a DVD-RAM.

The program stream separation unit 88 stores the program stream 811 read from the storage unit 89,
It is separated into a video stream 805 and an audio stream 808. The video decoder unit 85 uses the video digital decoded signal 8
06, and the video output unit 84 converts the video analog decoded signal 807 into a video output means 92 such as a monitor. The audio decoder unit 87 generates an audio digital decoded signal 809, and the audio output unit 86 converts the audio analog decoded signal 810 into audio output means 9 such as a speaker.
Output to 3.

The program stream 811 is the time information (SC
According to R), the data is transferred from the storage unit 89 to the program stream separation unit 88. In addition, the separated video stream 805 is, in accordance with the video time information (DTS / PTS) added by the program stream generation unit 94,
It is decoded by the video decoder unit 85. The separated audio stream 808 is decoded by the audio decoder unit 87 according to the audio time information (PTS) added by the program stream generation unit 94.

This recording / reproducing apparatus is also used as a recording / reproducing apparatus integrated with a camera, and the storage medium is a DVD.
-In addition to RAM and the like, magnetic media and semiconductor memory are also possible.

[0041]

According to the present invention, when a program stream using a fixed-length pack is generated, the number of audio packs and the number of video packs are calculated in advance from the picture data amount of each audio / video pack group (VOBU). Then, by calculating the reference time increment (ΔSCR) and the pack insertion ratio, the audio packs and the video packs can be arranged on average in the VOBU. As a result, it is possible to realize a program stream generation device capable of storing audio / video data for a longer time in a medium having a limited capacity.

[Brief description of drawings]

FIG. 1 is a block diagram showing an embodiment of a program stream generation device according to the present invention.

FIG. 2 is a detailed example of a block diagram of an initial information calculation unit 11 shown in FIG.

FIG. 3 is a detailed example of a block diagram of a time information calculation unit 14 shown in FIG.

FIG. 4 is a schematic structure of a program stream in the DVD-RAM standard.

FIG. 5 is an example of a recording / reproducing apparatus using a program stream generating apparatus.

FIG. 6 is a configuration example of a head VOBU in a VOB.

FIG. 7 is a configuration example of second and subsequent VOBUs in a VOB.

[Explanation of symbols]

10 ... Control unit 11 ... Initial information calculation unit 12 ... Video pack generation unit 13 ... Video pack header generation unit 14 ... Time information calculation unit 15 ... Video data transfer unit 16 ... Audio pack generation unit 17 ... Audio pack header generation unit 19 ... Audio data transfer unit 20 ... Video bit rate calculation unit 21 ... Initial video time information calculation unit 22 ... Initial audio time information calculation Part 23 ... Video pack number calculation unit 24 ... Audio pack number calculation unit 25 ... Leading audio pack insertion position calculation unit 26 ... Reference time increment value calculation unit 27 ... Pack insertion ratio calculation unit 81 ... video encoder section 83 ... audio encoder section 85 ... audio decoder section 87 ... audio decoder section 88 ... program stream separation section 89 ... storage section 94 ... program stream raw Part 120 ... video decoding and display start time value (DTS / P
TS) 121 ... Voice decoding and display start time value (PTS) 123 ... Reference time value (SCR)

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) H04N 5/85 H04N 5/92 H 7/24 7/13 Z (72) Inventor Masa Takahashi Yokohama, Kanagawa F-Term (Reference) 5C052 AA04 AB08 5C053 FA24 GB26 GB38 JA22 KA24 5C059 KK22 MA00 RB09 RC04 SS13 TA00 TB00 TC18 UA32 5D044 AB05 AB07 BC06 CC06 DE02 DE03 DE12 DE96 GK08 GK12 5D110 AA17 AA27 AA29 BB27 DA11 DB02

Claims (10)

[Claims] 1. A program stream including an audio / video pack group based on a video stream including a picture data group compressed at a variable bit rate and an audio stream including a compressed audio frame group. In a program stream generation device that generates and outputs to a decoding device, a video data transfer unit that extracts and transfers video data of a payload required for video pack generation from the video stream, and a fixed-length video data transferred from the transferred video stream. A video pack generation unit for generating a video pack, a video reference time value at which the picture data included in the video pack should be captured in the video input buffer of the decoding device,
A video time information calculation unit that calculates a time value for starting decoding and displaying the video time, a video pack header generation unit that describes the calculated video time information in the header of the video pack, and an audio pack from the audio stream. An audio data transfer unit that extracts and transfers audio data for a payload required for generation, an audio pack generation unit that generates a fixed-length audio pack from the transferred audio stream, and audio frame data included in the audio pack Of the audio reference time value to be loaded into the audio input buffer of the decoding device, and an audio time information calculation unit for calculating a time value for starting decoding and displaying the audio reference time value, and the calculated audio time information for the audio pack. An audio pack header generation unit described in the header, an initial value and an increment value of the video time information, and an initial value of the audio time information And an increment value and a leading audio pack insertion position are calculated, and an initial information calculation unit that calculates a pack insertion ratio of a video pack and an audio pack in the audio / video pack group based on the amount of picture data, and the leading audio Issue a video pack and audio pack generation request to the video pack generation unit and the audio pack generation unit according to the pack insertion position and the pack insertion ratio, and notify the initial information calculation unit when the generation of the audio / video pack group is completed. A program stream generation device, comprising: 2. The program stream generation device according to claim 1, wherein the initial information calculation unit is based on the amount of picture data included in the audio / video pack group to be generated, and the video bits in the audio / video pack group. A video bit rate calculation unit for calculating a rate; a video pack number calculation unit for calculating the number of fixed-length video packs included in the audio / video pack group based on the picture data amount; An audio pack number calculation unit that calculates the number of fixed-length audio packs included, and calculates the time at which a predetermined amount of data is accumulated in the video input buffer of the decoding device based on the video bit rate, and performs video decoding. An initial video time information calculation unit that outputs the initial value of the start time, and based on the video decoding start time initial value, the initial value of the audio decoding start time and the start audio packet. An initial audio time information calculation unit that calculates and outputs an initial value of the audio reference time to be taken into the audio input buffer of the decoding device; and a video input buffer in the video input buffer during a period up to the time indicated by the initial value of the audio reference time. Calculate the number of captured video packs,
A head audio pack insertion position calculation unit having the next pack as a head audio pack insertion position, and the time intervals of the audio / video pack group are equally distributed by the sum of the video pack number and the audio pack number. A reference time increment calculation unit that outputs a time interval between packs as a reference time increment value, and an audio pack interval when a video pack and an audio pack are uniformly arranged in the audio / video pack group, as a pack insertion ratio. A program stream generation device comprising: a pack insertion ratio calculation unit. 3. The program stream generation device according to claim 2, wherein the leading audio pack insertion position calculation unit calculates an initial value of the audio reference time from a video reference time at which a leading video pack is loaded into a video input buffer of a decoding device. , The number of divisions obtained by dividing the period up to the time indicated by the reference time increment value is calculated as the number of video packs to be taken in by the time indicated by the audio reference time initial value, from which the first audio pack is inserted. A program stream generation device characterized by obtaining a position. 4. The program stream generation device according to claim 2, wherein the reference time increment calculation unit equalizes the time intervals of the audio / video pack group with the sum of the number of video packs and the number of audio packs. A program stream generation device, which further outputs a fractional value of a reference time generated when a time interval between packs is calculated, when distributed. 5. The program stream generation device according to claim 1, wherein the time information calculation unit adds the reference time increment value to the reference time value of the immediately preceding generation pack. Then, a reference time calculation unit that calculates a reference time value to be added to the generated pack, and 0 or a predetermined time value as the reference time value for the first video pack, and for the second and subsequent video packs including the access unit. Then, the video time information calculation unit that outputs the time value obtained by adding the time values indicated by the access unit intervals as the reference time value, and the audio decoding start time initial value for the first audio pack as the reference time value. Also, for the second and subsequent audio packs that include audio frame headers, the number of audio frames from the audio pack that includes the immediately preceding audio frame header is supported. A program stream generation device comprising: a voice time information calculation unit that outputs a time value obtained by adding the time values as a reference time value. 6. The program stream generation device according to claim 4, wherein the time information calculation unit adds the reference time increment value to the reference time value of the immediately previous generation pack, and further calculates the reference time fraction value. A reference time calculation unit that outputs a time value obtained by adding unit amounts from the first pack of the audio / video pack group as a reference time value; and 0 or a predetermined time value for the first video pack as a reference time value. Also, for the second and subsequent video packs including the access unit, the video time information calculation unit that outputs the time value obtained by adding the time value indicated by the access unit interval as the reference time value, and the first audio pack On the other hand, using the initial value of the audio decoding start time as the reference time value, and for the second and subsequent audio packs including the audio frame header, the sound immediately before that is added. A program stream generation, comprising: an audio time information calculation unit that outputs a time value obtained by adding time values corresponding to the number of audio frames from an audio pack including a voice frame header as a reference time value. apparatus. 7. The program stream generating device according to claim 1, wherein the audio / video pack group includes at least one MPEG-compressed GOP and an audio frame associated therewith. A characteristic program stream generation device. 8. The program stream generation device according to claim 7, wherein the video data transfer unit has a buffer for accumulating a video stream of GOPs constituting the audio / video pack group, and the data of the GOPs. The program stream generation device, wherein the initial information calculation unit starts a calculation process and a program generation process at the time when is accumulated. 9. A program stream generation device for generating a program stream composed of an audio / video pack group based on a video stream compressed at a variable bit rate and a compressed audio stream, wherein each audio / video pack group is Calculate the video bit rate,
Based on this, the time information calculation unit that calculates the reference time information, the video decoding start time information, and the video decoding display time information that should be captured in the input buffer, and the video pack and the audio pack based on the video bit rate. An audio / video pack generation unit that calculates an insertion ratio and generates an audio / video pack group in which audio and video packs are interleaved, and a program stream generation device. 10. A program stream recording / reproducing apparatus for converting an input analog video and audio signal into a program stream of a compressed digital signal and recording and reproducing the program stream on a storage medium. And a video and audio input unit for converting the video and audio signals, a video and audio encoder unit for compressing and encoding the digital video and audio signals to generate video and audio streams, and generating a program stream from the video and audio streams. 1 or 9, a program stream generation apparatus, a storage unit that records and reproduces the program stream in the storage medium, and a program stream that separates the program stream reproduced from the storage medium into a video stream and an audio stream. A video separation unit, a video and audio decoder unit for decoding the video and audio streams, and a video and audio output unit for converting the decoded digital video and audio signals into analog video and audio signals. A program stream recording / reproducing apparatus characterized by: