JP2002152738A - Video audio stream converter and video audio stream conversion method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video audio stream converter that conducts a time stamp sequence PS(Program Stream) conversion output and to provide a video audio stream conversion method. SOLUTION: An input transport steam TS is given to a VIDEO/AUDIO/other detection-select circuit, which selects video an audio packets from the stream TS, a VIDEO-PES and AUDIO-PES separation circuits separate a video PES(Packetized Elementary Stream) and an audio PES. The video PES is transferred to a VIDEO-PES memory and a VIDEO-PTS, DTS(Presentation-Time- Stamp, Decoding-Time-Stamp) detection circuit, and the audio PES is transferred to an AUDIO-PES memory and an AUDIO-PTS detection circuit, where each PES is stored in each memory and each time stamp is detected. A time stamp sequence sector unit PS conversion circuit uses the time stamp to read the PES in the sequence of the time stamp and to apply PS processing, and an SCR(System Clock Reference) attachment circuit adds an SCR to the PES to obtain an output PS.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a video / audio stream conversion apparatus and a video / audio stream conversion method for converting an MPEG2 transport stream and an MPEG2 program stream.

[0002]

2. Description of the Related Art At present, digitalization of television broadcasting is rapidly progressing. The transmitted television signal is M
MPEG used mainly for transmission in the PEG system
2 transport stream (hereinafter, TS).

The above-mentioned TS is a format in which a plurality of programs can be multiplexed and transmitted, and as shown in FIG.
It is composed of TS packets in byte units. On the receiving side, a desired TS packet is stored in a PID (Packet_Id) in the TS_Header indicating the head of the TS packet.
(entification) can be detected and selected using 13 bits. As a method for setting this desired PID, first, PID = 0x000
0 PAT (Program Association)
(Table) TS packet is detected. The PAT is a PMT (Program) indicating a PID of a stream constituting each program corresponding to each multiplexed program.
m Map Table).
Therefore, a TS packet having the PMT PID is detected next, a PID of a desired program is selected from the TS packets, and a TS packet having the PID is detected to obtain only the desired program.

[0004] Next, a TS packet is composed of a PCR (Progr).
am Clock Reference). This is because, in the MPEG decoder, the STC (System
Time management information for setting and calibrating the value of (Time Clock) to a value intended by encoding.

In this PCR, if the upper bit of the two bits of the adaptation field control shown in FIG. 7 is "1", an adaptation field is present in the subsequent payload, and the PCR_flag in the adaptation field is "1".
If "1", it can be recognized that the PCR 42 bit exists.

The PCR repeats 300 counts 9b
the extension part of the it and the extension
33-bit ba that counts 1 for every 300 counts
It is described by a total of 42 bits of the "se" part, and is expressed in units of 27 MHz clock.

In the STC, the extension of this PCR
A counter having the same configuration is constructed by using the on-part and base-part values as initial values, and the counter is turned at 27 MHz to form an STC counter.

[0008] Video Packetized Elem
In an entry stream (hereinafter, PES), a PES_Packet_Hea having a configuration as shown in FIG.
PTS (Presentation_Tim) in der
e_Stamp) of 33 bits of time management information of a reproduction signal and DTS (Decoding_Time_Sta).
mp), which is 33 bits of decoding time management information. There is no DTS in the audio PES.
Only TS is provided.

For both video and audio, the aforementioned STC
The upper 33 bits of the counter are compared with the 33 bits of PTS and DTS to manage the time of decoding and the time of reproduction.

Next, an MPEG2 program stream (hereinafter, PS) is mainly used for recording in the MPEG2 system.

This PS is a TS that handles a plurality of programs.
Unlike this, it is a system that handles one program.
The configuration example starts with Pack_Header as shown in FIG.
aders, and thereafter, PES_Packet_He
ader and PES_Element.

This PS is an SCR (System Clo)
ck Reference: System Clock
Reference), and has a 33-bit base like the PCR of the TS.
e section and a 9-bit extension section. The PTS and DTS are also used as the initial reference values of the system time, and are used as reference values for the system time to manage the reproduction time and the decoding time.

The advantages of the PS over the TS are that unnecessary programs are discarded and that the TS_Pack
In et, 4 Bytes out of 188 Bytes must be Heade
r information, and the recording data capacity can be reduced in that it can be truncated. Furthermore, the arrangement information of the recorded contents can be grasped by using a management file, and is excellent in editing at the time of reproduction.

A system using this PS is a DVD.
A player. Recently, a device for recording in a DVD format has also been commercialized,
Recording and reproduction by using the same.

Under these circumstances, there is no compatibility between the TS of the transmission format and the PS of the recording format. Therefore, when the signal received by the TS is recorded as the PS, and when the signal reproduced by the PS is recorded. In order to transmit as a TS, format conversion is required.

However, in recent years, without converting TS to PS,
A system for recording and reproducing a TS as it has been developed. However, in the case of a TS recording / playback system,
T of what program is composed at the time of reproduction
Since S analysis is required, free editing is not possible, and it is used as a system for simply recording and reproducing. Under such system requirements, P
There is no problem if recording / reproducing is performed as it is without converting it to S.

However, since the PS is a format that is conscious of recording and reproduction, it is good at various kinds of editing. Therefore, at present, there are two types of recording systems, PS and TS.

The prior art is disclosed in JP-A-11-4551.
No. 2 and the like. Here, as described above, T
The necessity and method of converting from S to PS are described.

Also, basic principles of MPEG,
TS, PS, PES, PCR, SCR, STC, PT
S, DTS, and the like are known in, for example, “Latest MPEG Textbook” (published by ASCII Corporation, issued on August 1, 1994), and the description above is omitted.

[0020]

However, according to the prior art shown in the patent gazettes and the like, the TS is converted into the PS, but the time information of the video and the audio is not considered and the PS is sequentially converted into the unit of the PS. PS conversion is performed according to accumulation of data for a certain sector length. Although the conversion can be performed as it is, the result is not sufficiently considered from the viewpoint of editing.

For example, just by sequentially performing PS conversion,
Audio PS packs are scattered, and dubbing and the like cannot be performed easily. Therefore, in order to perform post-recording,
A conversion order that is aware of the PS configuration order is required. Also, even in the reproduction from an arbitrary frame, it is impossible to determine from which sector reproduction is optimal unless the time information of the video and audio and the arrangement order of the PS and the position information of both are known. There was a problem.

Further, when recording is performed in the form of the TS as it is, a simple recording / reproducing system is used, and there is a problem that no consideration is given to editing or the like.

The present invention has been made in view of such a problem. An object of the present invention is to record a TS by converting it into a PS. In the case of TS recording, by changing the configuration of the TS, it is possible to make up for parts that are not considered for editing, etc. Another object of the present invention is to provide a video / audio stream conversion apparatus and a video / audio stream conversion method.

[0024]

According to the first aspect of the present invention, there is provided a data receiving apparatus which receives an input data stream of a first format and separates the data stream into video, audio, and the like; A buffer memory for temporarily holding video and audio and other streams, respectively, and a unit for detecting video, audio and other time stamps, and using the time stamps, the buffer memory in order of time stamp. The video / audio stream conversion apparatus is characterized in that a stream temporarily held and stored in the video / audio stream converter is converted into a data stream of the second format in units of a data stream of the second format. The gist of the invention described in claim 2 of the present invention resides in that the stream held in the buffer memory is converted in the order of the time stamp using the time stamp in the unit of the data stream of the second format. When the video is GOP (Group of
2. The video / audio stream conversion apparatus according to claim 1, wherein the conversion is performed in units of Picture, and the audio is also collectively converted in synchronization with the GOP unit of the video. The gist of the invention described in claim 3 of the present invention is that, when viewed in video GOP units, a stream synchronized with an audio video GOP unit is converted into the second format data stream before a video stream. The video and audio stream converter according to claim 2, wherein all of the video and audio streams are converted and arranged. The gist of the invention described in claim 4 of the present invention is that, when viewed in video GOP units, all streams synchronized with audio video GOP units are added to the data stream of the second format after the video stream. The video and audio stream converter according to claim 2, wherein the video and audio stream is converted and arranged. The gist of the invention described in claim 5 of the present invention is that, when a stream synchronized with a GOP unit of an audio video is converted into a data stream of the second format in a video GOP unit, To convert the audio to the data stream of the second format, before converting all the video, and then convert the remaining video to the data stream of the second format. 3. The video / audio stream conversion apparatus according to claim 2, wherein the video / audio stream conversion apparatus converts the data stream into a data stream. The gist of the invention described in claim 6 of the present invention is that, when converting the data stream of the first format into the data stream of the second format, a first time reference value is detected, 3. The video / audio stream converter according to claim 1, wherein a second time reference value is generated based on the value. The gist of the invention described in claim 7 of the present invention resides in that, when converting the data stream of the first format into the data stream of the second format,
3. The video / audio according to claim 1, wherein a second time reference value is generated based on the detected time reference value, and based on the detected value. Exists in a stream converter. The gist of the invention described in claim 8 of the present invention is that, when the time stamp is a video, the time management information Pre of the reproduction signal is used.
Sentation_Time_Stamp (PTS)
And decoding management information Decoding_Time_Stata
mp (DTS), in the case of audio, time management information Presentation_Time_S of the reproduction signal
3. The video / audio stream conversion device according to claim 1, wherein the video / audio stream conversion device is a stamp (PTS).
The gist of the invention described in claim 9 of the present invention is that the data stream of the first format is an ISO / IEC13
818-1 is an MPEG2 transport stream, wherein the data stream of the second format is
MPEG2 defined in ISO / IEC13818-1
The program stream is a program stream.
9. The video / audio stream converter according to any one of the above items 1 to 8. The gist of the invention described in claim 10 of the present invention is that the separated video, audio, and other streams are packetized elements.
10. The video / audio stream conversion device according to claim 9, wherein the video / audio stream conversion device is a target stream (PES). The gist of the invention described in claim 11 of the present invention is that the first time base reference value is a Program Cl value.
In the OCK Reference (PCR), the second time reference value is a System Clock Reference.
response (SCR).
In the video / audio stream conversion device described in (1). Also,
The gist of the invention described in claim 12 of the present invention resides in the first aspect.
The video stream according to any one of claims 1 to 8, wherein the data stream of the second format and the data stream of the second format are an MPEG2 transport stream defined by ISO / IEC13818-1. It exists in the audio stream converter. The gist of claim 13 of the present invention is that the separated video,
13. The video / audio stream converter according to claim 12, wherein the audio and other data streams are MPEG2 transport streams. The gist of the invention according to claim 14 of the present invention is that the first time reference value and the second time reference value are P
program Clock Reference (PC
R), wherein the video and audio stream converter according to claim 12 is provided. The gist of the invention described in claim 15 of the present invention is that the data stream of the first format is an MPEG2 program stream defined in ISO / IEC13818-1, and the data stream of the second format is , ISO / IEC13818
The video / audio stream converter according to any one of claims 1 to 8, wherein the MPEG-2 transport stream is defined as -1. Also,
The gist of the invention described in claim 16 of the present invention is that the separated video, audio, and other data streams are packetized elementary St.
17. A beam of light (PES).
In the video / audio stream conversion device described in (1). Also,
The gist of the invention described in claim 17 of the present invention resides in the first aspect.
Is the System Clock Ref
erence (SCR), the second time reference value is a Program Clock Reference.
(PCR). The video / audio stream converter according to claim 15, wherein The gist of the invention described in claim 18 of the present invention is to receive a data stream of a first format to be input, and to receive video, audio,
Separating the video, audio, and other streams, respectively, into a buffer memory temporarily.
Detecting the other time stamps, and using the time stamps to convert the stream temporarily held and stored in the buffer memory in the order of the time stamps to a second time stamp.
The present invention also provides a video / audio stream conversion method characterized by comprising a step of converting a data stream of the second format into a data stream of the second format.

[0025]

DESCRIPTION OF THE PREFERRED EMBODIMENTS In the present invention, for example, a VIDEO_PES separation circuit 3 and an AUDIO_PE
Video and audio from input TS are input to PE by S separation circuit 4
S, and each memory (for example, VID described later in FIG. 1)
EO_PES memory 5, AUDIO_PES memory 8)
, For example, VIDEO_P described later in FIG.
The TS and DTS detection circuits 6 and the AUDIO_PTS detection circuit 7 perform time stamp detection, and, for example, time-stamp order sector unit PS conversion circuit 9 described later in FIG. Is going.

In the present invention, for example, a VIDEO_PES separation circuit 3 and an AUDIO_PES
Separation circuit 4 converts video and audio from input TS to PES
And each memory (for example, VIDE
Writing to the O_PES memory 5 and the AUDIO_PES memory 8), for example, VIDEO_PT described later in FIG.
S, DTS, I-Picture detection circuit 12, AUD
The IO_PTS detection circuit 7 detects the time stamp, and for example, the video and audio are sequentially transferred to the GOP in sector units in the GOP in the time stamp order by the PS conversion circuit 13 in the time stamp order GOP described later in FIG.
S conversion is performed.

In the present invention, for example, FIG.
VIDEO_TS_Packet memory 14, AUD
IO_TS_Packet memory 15, VIDEO / A
Input TS in TS_Packet memory 16 other than UDP
Video, audio and other TS_Packets from
Is written to each memory, for example, VID of FIG.
EO_PTS, DTS detection circuit 6, AUDIO_PTS
The detection circuit 7 performs time stamp detection, and, for example, a TS_Packet rearrangement circuit 17 in the time stamp order shown in FIG. 3 described later performs TS_Packet rearrangement of video and audio in time stamp order.

Further, in the present invention, for example, a VIDEO_TS_Packet memory 14 and an AUD
IO_TS_Packet memory 15, VIDEO / A
Input TS in TS_Packet memory 16 other than UDP
Video, audio and other TS_Packets from
Is written to each memory, for example, VID described later in FIG.
EO_PTS, DTS, I-Picture detection circuit 1
2. Time stamp detection is performed by the AUDIO_PTS detection circuit 7, and for example, a time stamp order G described later in FIG.
In the OP TS_Packet rearranging circuit 20, video,
Audio is transmitted in the GOP in the order of
_Packet rearrangement is performed.

In addition, in the present invention, for example, FIG.
VIDEO_PES separation circuit 3, AUDIO
_PES separation circuit 4 separates video, audio, and the like from the input PS into PES, and separates each memory (for example, FIG.
VIDEO_PES memory 5, AUDIO_
Writing to the PES memory 8), for example, a VIDEO_PTS and DTS detection circuit 6, AUDIO described later in FIG.
_PTS detection circuit 7 performs time stamp detection, for example, a time stamp order TS conversion circuit 2 described later with reference to FIG.
In step 4, TS conversion is performed on video and audio in order of time stamp.

In the present invention, for example, a VIDEO_PES separation circuit 3 and an AUDIO_PES
The separation circuit 4 separates video, audio, and the like from the input PS into PES, and writes them into each memory (for example, VIDEO_PES memory 5 and AUDIO_PES memory 8 described later in FIG. 6). For example, VIDEO described later in FIG.
O_PTS, DTS, I-Picture detection circuit 1
2. A time stamp is detected by the AUDIO_PTS detection circuit 7, and for example, TS conversion is performed on the video and audio in the GOP in the time stamp order by the TS conversion circuit 26 in the time stamp order described later in FIG.

As described above, according to the present invention, when performing recording after converting from TS to PS, when performing recording with the TS arranged in a different order, or from PS to TS, When performing conversion and recording, PS conversion, TS rearrangement, and TS conversion are performed in units of sectors or in units of GOPs based on time information of video and audio, so that PS and TS that are better at editing can be obtained. Can be obtained. Hereinafter, various embodiments of the present invention will be described in detail with reference to the drawings.

(First Embodiment) Hereinafter, a first embodiment of the present invention will be described.
An embodiment will be described in detail with reference to the drawings. FIG.
1 is a block diagram of a video / audio stream converter 30 according to a first embodiment of the present invention.

Referring to FIG. 1, in the present embodiment, the transmitted TS is a VIDEO / AU from input TS1.
It is supplied to the DIO / other detection / select circuit 2, where video and audio TS packets are extracted.

The video TS packet is VIDEO
_PES separation circuit 3. The audio TS packet is supplied to the AUDIO_PES separation circuit 4.
VIDEO_PES separation circuit 3 and AUDIO_PES
Each of the separation circuits 4 extracts only the PES.

Next, the PES of the extracted video is V
IDEO_PES memory 5, VIDEO_PTS, DT
The data is transferred to the S detection circuit 6. In the VIDEO_PES memory 5, a video PES is written. VID
In the EO_PTS / DTS detection circuit 6, the video PT
S and DTS are detected.

Similarly, the PES of the extracted audio
Are AUDIO_PES memory 8 and AUDIO_PT
The data is transferred to the S detection circuit 7. In the AUDIO_PES memory 8, audio PES is written. A
The audio PTS detection circuit 7 outputs the audio PTS
Is detected.

Next, each detection circuit (VIDEO_PTS,
DTS detection circuit 6 and AUDIO_PTS detection circuit 7)
The PTS and DTS obtained in step (1) are transferred to the PS unit conversion circuit 9 in the order of the time stamp. The time stamp order sector unit PS conversion circuit 9 determines the order of PS conversion in video and audio sector units, and sequentially reads from each memory in accordance with the order to achieve PS conversion.

Finally, the SCR adding circuit 10
By adding an R value, PS can be obtained from the output PS11.

More specifically, a first embodiment of the present invention will be described with reference to FIG. As described in the section of the prior art, since the TS is a format capable of transmitting a plurality of programs, in order to extract an arbitrary program, in this case, a video or audio TS packet from the TS, detection by the PID is required. Will be needed. Therefore, in order to specify the PID, PAT and PMT are sequentially detected, and PIDs for video and audio are set to perform detection.

More specifically, since the PAT is defined as 0x0000 in each PID of 13 bits, a TS_Packet having that PID value is detected, and from this content, the PID value of the PMT is grasped, set, and detected. Then, the PID values of video and audio to be detected are grasped from the contents, and setting and detection are performed. In the present embodiment, this processing is called VIDEO / AUDIO / other detection /
This is executed by the select circuit 2.

From the detected video and audio TS packets, only the PES is extracted by the VIDEO_PES separation circuit 3 and the AUDIO_PES separation circuit 4, and the VIDEO_PES memory 5,
Writing to AUDIO_PES memory 8 and VI
DEO_PTS, DTS detection circuit 6, AUDIO_PT
The transfer to the S detection circuit 7 is performed.

FIG. 7 shows the structure of the TS packet. In order to extract only the PES from the TS packet, the payload portion having the PES must be detected. For that purpose, first, it is necessary to detect a TS packet whose 4-bit indicated by the cyclic counter unit has been updated by one more than the cyclic counter value of the TS packet having the same previous PID. In the TS, the same TS packet is allowed to be retransmitted. Therefore, data whose 4 bits have not been updated is retransmission data, and must be discarded.

Next, the two bits indicated by the adaptation field control unit determine the PE in the payload unit.
S part and adaptation field part are identified, and P
Extract only the ES part.

The adaptation field portion includes a PCR
This bit is defined as undefined if these two bits are "00". "
"01" is defined as having no adaptation field and only payload, "10" is defined as having only adaptation field and no payload, and "1".
1 "is the payload after the adaptation field,
It is prescribed. Therefore, at the time of "10", it is rounded down since all subsequent fields are adaptation fields, and "11"
In the case of, only the adaptation field portion following the TS_Header is cut off, and only the subsequent PES portion is extracted to detect the PES, and the video,
The audio is written to the PES memory.

FIG. 8 shows the PES_Packet_Head.
FIG. 3 is a configuration diagram of er. Referring to FIG. 8, in the present embodiment, VIDEO_PTS, DT for detecting each time information
The S detection circuit 6 and the AUDIO_PTS detection circuit 7 perform respective detections. The arrangement of the PTS and DTS in the PES is as shown in FIG.
3 bits are detected.

Also, using the PTS and DTS of video and the PTS of audio, the PE written in each memory is used.
We will convert S into PS.

The structure of the PS is as shown in FIGS.
FIG. 9 is a block diagram of the PS (part 1), and FIG. 10 is a block diagram of the PS (part 2). Referring to FIGS. 9 and 10, in the present embodiment, packs are packed in units of sector length, and Pack_Header is arranged at the beginning of the pack, and System_Header is arranged at the head pack of the program. PES_Packet
_Header and PES_Element.

The structure of the PS shown in FIG. 9 and the PS shown in FIG.
The difference between the two is that the PES unit is used for each PES unit or the PS unit is used for a plurality of PES units. P shown in FIG.
The configuration of S is a configuration in which no other PES enters the pack. The configuration of the PS shown in FIG. 10 is a configuration in which 15 PESs are sequentially converted into PSs. In addition, 1 in 1 pack
Stuffin in which the remaining portion where one PES is arranged or one PES is arranged over a plurality of packs and the surplus portion in the last pack is filled with all “0” s
g processing is performed.

Here, prior to the implementation of the PS conversion, time information based on PTS and DTS of video and audio, that is, time stamps and TS arrangement will be described with reference to FIG. FIG. 11 is a schematic configuration diagram of a video and audio TS list shown using time stamps.

First, the time stamp of a video will be described. The video has a PT indicating time management information of the reproduction signal.
S and DTS indicating decoding time management information. Here, 1 GOP (Group of Picture: 1
In a configuration of a group of multiple pictures compressed as a unit),
Assume that the number N of pictures in a GOP is 15, and the period M in which an I picture or a P picture appears is 3. PTS and DTS exist for I picture and P picture, and PT
Since only S exists, the relationship between these and the picture (frame) number, PTS, and DTS time is approximately as follows.

I1 picture: PTS = 2, DTS = −1 B2 picture: PTS = 0 B3 picture: PTS = 1 P4 picture: PTS = 5, DTS = 2 B5 picture: PTS = 3 B6 picture: PTS = 4 P7 picture : PTS = 8, DTS = 5 B8 picture: PTS = 6 B9 picture: PTS = 7 P10 picture: PTS = 11, DTS = 8 B11 picture: PTS = 9 B12 picture: PTS = 10 P13 picture: PTS = 14, DTS = 11 B14 picture: PTS = 12 B15 picture: PTS = 13

In MPEG2, the rearrangement of pictures after compression has changed. When the picture order is restored, the B2 picture, B3 picture, I1 picture, B5 picture, B5 picture
6 pictures, P4 pictures,..., And when viewed from the PTS, time is continuous as 0, 1, 2, 3, 4, 5,. In the above case, if DTS exists, D
When the TS is used and the PTS is used only for the PTS, -1,
It can be seen that 0, 1, 2, 3,... Are also temporally continuous.

In the case of audio, since only PTS exists in each audio frame, when expressed in terms of time, for example, A1 frame: PTS = 0 A2 frame: PTS = 0.7 A3 frame: PTS = 1.4 A4 frame: PTS = 2.1 A5 frame: PTS = 2.8, etc.

In each of the video and audio PESs, the old and new time stamps are not exchanged, that is, the time order is not exchanged and transmitted. However, there is no provision in the TS that video and audio must be transmitted up to the temporal order correctly. Specifically, the above video,
When the audio time stamps are sequentially written so as to be temporally continuous, as shown in TS sequence 1 in FIG. 11, I1 picture, B2 picture, A1 frame, A2 frame,
B3 picture, A3 frame, P4 picture, A4 frame, A5 frame,... However, the transmission order in the actual broadcast is not necessarily as described above. For example, as in TS list 2, I1 picture, A1 frame, A2 frame, B2 picture, A3 frame, B3
Picture, A4 frame, A5 frame, P4 picture,... Further, the time stamps of video and audio are far apart from each other to form a TS.

The transmission order can be considered in various ways, such as a difference in encoding time between video and audio on the transmitting side, and depending on transmission control. As a result, the transmission order differs depending on the method of defining the transmitting device.

As described above, TSs in which the time order of video and audio do not match are simply P
If the S conversion is performed, the temporal order of the video and the audio after the PS naturally remains interchanged. This is itself P
There is no problem in recording and playing back from the beginning in simple order instead of the S format violation. However, editing can hinder management.

For example, when the video time stamp is earlier than the audio time stamp and the audio time stamp is located after the audio on the recording medium, or vice versa, the audio time stamp is earlier than the video time stamp. If it is located behind the video on the recording medium, to start playback from a certain video frame, of course, the video located further forward, or
You must start playback from the audio.

If it is not clear from the input TS which is located ahead, the management system is as follows:
For both video and audio, time information and arrangement position information must be managed, and the amount of stored information increases. Therefore, if the time order of the video and the audio is always the youngest, there is no need to add such an extra system.

Therefore, the sector unit PS in time stamp order is
The conversion circuit 9 compares the time stamps detected in video and audio, and sequentially converts each PES from the youngest in time.
The PES is read from the memory and converted into a PS, and finally the SCR adding circuit 10 sets the system time reference value SCR.
Is added. The SCR is Pack_H as shown in FIG.
header3, and Reference3
The point having 3 bits, Extension 9 bits is P
Same as CR. Therefore, the PC obtained from the input TS
An STC counter having an R value or a value obtained by adding an offset to the PCR value by the system as an initial value is configured and counted by a 27 MHz clock, and the STC counter value at the time of PS output is added to the SCR. Can be added.

By doing so, it is possible to record a temporally continuous PS on a recording medium. For example, if time information and position information on a video frame are managed, reproduction from a certain video frame can be performed. Also, since the time stamp of the video and the audio are in the same order, the audio can be reproduced by reproducing the video frame from the video frame. However, in the case of MPEG2, since the video is compressed in GOP units, time information and position information are managed in GOP units, playback is started from the GOP start position, decoded, and before the specified frame is discarded. Control will be performed so as to output from the specified frame. Audio is compressed in units of audio frames. Unnecessary audio frames are truncated in accordance with the video, and control is performed so that audio frames that match the designated frames of the video are output.

As described above, according to the first embodiment, the video and audio PS packets are converted in the order of the time stamp and can be recorded on the recording medium continuously in time. , P including the beginning of the GOP
If the position information and the time information of the S packet are managed in the system, the management at the time of starting the reproduction becomes very easy. Also, when audio is converted to PS in a GOP collectively, post-recording can be easily performed based on the position information.

(Second Embodiment) Hereinafter, a second embodiment of the present invention will be described.
An embodiment will be described in detail with reference to the drawings. In addition,
The same parts as those already described in the above embodiment are denoted by the same reference numerals, and redundant description will be omitted. FIG. 2 is a block diagram of a video / audio stream converter 30 according to the second embodiment of the present invention. As in the first embodiment, video and audio TS packets and each PES are extracted.

Next, the PES of the extracted video is V
IDEO_PES memory 5 and VIDEO_PTS, D
The TS is transferred to the I-Picture detection circuit 12.
In the VIDEO_PES memory 5, a video PES is written. VIDEO_PTS, DTS, I-
In the Picture detection circuit 12, the video PTS, D
TS and I-Picture are detected.

Similarly, the PES of the extracted audio
Are AUDIO_PES memory 8 and AUDIO_PT
The data is transferred to the S detection circuit 7. The writing of the audio PES to the AUDIO_PES memory 8 is
The PTS detection circuit 7 detects an audio PTS.

Next, each detection circuit (VIDEO_PTS,
DTS, I-Picture detection circuit 12 and AUDI
The PTS and DTS obtained by the O_PTS detection circuit 7) are
Time stamp order GOP sector unit PS conversion circuit 13
Is forwarded to Time stamp order GOP sector unit P
The S conversion circuit 13 determines the order of PS conversion in sector units in the video and audio GOPs, sequentially reads data from each memory according to the order, and achieves PS conversion.

Finally, the SCR adding circuit 10
By adding an R value, PS can be obtained from the output PS11.

The second embodiment of the present invention will be described in more detail with reference to FIG. In the present embodiment, the time stamp order sector unit P in the first embodiment is used.
In this embodiment, the S conversion circuit 9 is changed to a sector PS conversion circuit 13 in a time stamp order GOP. The former part and the latter part of the sector unit PS conversion circuit 13 in the time stamp order GOP are basically the same as those in the first embodiment. However, in order to recognize the GOP, the I-Picture is detected. VIDEO_PTS, DTS, I-Pictur
The e detection circuit 12 has been changed.

The time-stamp order GOP sector unit PS conversion circuit 13 is different from the PS conversion in the sector unit described in the first embodiment in that video and audio in the GOP are grouped in sector units. PS conversion is performed.

FIG. 12 is a schematic PS configuration diagram showing rearrangement in units of sectors and sectors in a GOP. FIG.
In the present embodiment, in the present embodiment, the input TS has a timing difference between the transmission of each GOP of video and the corresponding audio data stream (here, AUDIO_GOP following video). Things.

Such a TS is converted into a PS.
When converted into a PS in sector units shown in the first embodiment,
The result is as shown in FIG. In the second embodiment, the sector unit PS in the GOP shown in FIG.
It realizes the configuration of the first scheme, the second sector unit in the GOP, and the third sector unit in the GOP.

In the second embodiment, instead of sequentially converting the data into PSs according to the time stamp in sector units, GO
The video and audio are grouped together within P
The difference from the first embodiment resides in that the arrangement is performed in a different manner.

In the sector-based PS conversion 1 in a GOP shown in FIG. 12, a video 1 GOP is arranged in the first half of an area corresponding to one GOP, and an audio 1 GOP is arranged in the second half. In sector unit PS conversion 2 within a GOP, an audio 1 GOP is arranged in the first half of a 1 GOP area and a video 1 GOP is arranged in the second half. Then, in the sector unit PS conversion 3 in the GOP, 1 GO
Audio 1 GOP at positions other than both ends of P area
Are divided into video 1 GOPs at both ends.

Specifically, the time stamp of the video in one GOP is V1.0, V1.2, V1.4,
, V2.6, V2.8, and the time stamp of the audio within one GOP is V1.1, V1.3, V1.3.
5,..., V2.7, V2.9. In the first embodiment, V1.0, A1.1, V1.2, A1.
3,..., V2.8, A2.9, in order of time stamp, video and audio are converted into PS in sector units.
On the other hand, the sector unit P in the GOP of the second embodiment
In S conversion 1, V1.1, V1.3,..., V2.8, A
, A2.9 in the order of A2.9, A2.9, A2.9
1.3, ..., A2.9, V1.1, V1.3, ..., V
It is converted to PS in the order of 2.8, and the sector unit PS in GOP
In formula 3, V1.1,..., A1.1, A1.3,.
PS conversion is performed in the order of 2.9,..., V2.8.

Therefore, in the present embodiment, in order to realize such a configuration, in addition to the first embodiment, I-
A means for detecting the Picture and recognizing the head of the GOP is added, and the sector unit P
The S conversion circuit 13 performs the PS conversion processing on video and audio in the GOP as described above in sector units, and finally performs the SCR addition described in the first embodiment. As a result, video and audio can be converted to PS in the GOP in sector units.

As described above, according to the second embodiment, the video and audio PS packets are converted in the order of the time stamp and can be recorded on the recording medium continuously in time. , P including the beginning of the GOP
If the position information and the time information of the S packet are managed in the system, the management at the time of starting the reproduction becomes very easy. Also, when audio is converted to PS in a GOP collectively, post-recording can be easily performed based on the position information.

(Third Embodiment) Hereinafter, a third embodiment of the present invention will be described.
An embodiment will be described in detail with reference to the drawings. In addition,
The same parts as those already described in the above embodiment are denoted by the same reference numerals, and redundant description will be omitted. FIG. 3 is a block diagram of a video / audio stream converter 30 according to the third embodiment of the present invention.

Referring to FIG. 3, in the present embodiment, the transmitted TS is transmitted from input TS1 to VIDEO / AU.
The data is supplied to the DIO / other detection / select circuit 2, where video, audio, and other TS packets are extracted.

A video TS packet is a VIDEO TS packet.
O_TS_Packet memory 14 and VIDEO_P
The data is transferred to the TS and DTS detection circuit 6. VIDEO_T
In the S_Packet memory 14, a video TS packet is written. VIDEO_PTS, DTS
The detection circuit 6 detects video PTS and DTS.

Similarly, the audio TS packet is A
UDIO_TS_Packet memory 15 and AUDI
The data is transferred to the O_PTS detection circuit 7. AUDIO_TS
In the _Packet memory 15, an audio TS packet is written. The AUDIO_PTS detection circuit 7 detects an audio PTS.

The TS packets other than video and audio are TS_Packets other than VIDEO / AUDIO.
The data is written to the t memory 16.

Next, each detection circuit (VIDEO_PTS,
The PTS and DTS obtained by the DTS detection circuit 6 and the AUDIO_PTS detection circuit 7) are in the order of time stamp TS_P
The packet is transferred to the packet rearrangement circuit 17.

In this embodiment, the time stamp TS
The _Packet rearranging circuit 17 determines the output order of video, audio, and other TS packets in units of TS packets, and sequentially reads out from each memory according to the determined order to form a new TS. And finally, PCR
The replacement circuit 18 replaces the PCR value. Thereby, a TS can be obtained from the output TS19.

A third embodiment of the present invention will be described in more detail with reference to FIG. In the third embodiment, rearrangement is performed in the order of the time stamp in the form of a TS packet without performing the PS conversion performed in the first embodiment.

In the third embodiment, video, audio, and other TS packet detection and selection are performed on an input TS in the same manner as in the first embodiment. In the second embodiment, other TS packets that have been truncated are also required.

For this reason, in the third embodiment, each detected / selected video, audio, and other TS
In the packet, VIDEO_TS_Packet
Memory 14, AUDIO_TS_Packet memory 1
5. Write to TS_Packet memory 16 other than VIDEO / AUDIO.

In addition, for video and audio, each time stamp is set to VIDEO_PTS, DTS.
Detection is performed by the detection circuit 6 and the AUDIO_PTS detection circuit 7.

Also, TS_Packet in order of time stamp
The t rearranging circuit 17 uses video and audio time stamps as in the first embodiment,
The TS packets are read from each memory so as to be in the order of the time stamp, and the configuration order of the TS is changed.
It should be noted that some TS packets other than video and audio have a time stamp and some do not. For example, subtitles are synchronous, and superimpose is asynchronous. Therefore, those with a time stamp are TS in time stamp order.
The information is sent to the _Packet rearrangement circuit 17 and readout from the memory is performed using the information. However, those without a timestamp do not require detailed time management, so that if they are written to the memory, they can be read out immediately in units of TS packets.

In this embodiment, finally, the PCR
By performing the PCR replacement by the replacement circuit 18, it becomes possible to output a TS in which video and audio are arranged in time stamp order. Note that the PCR is the input T
STC with the PCR value obtained from S or the value obtained by adding an offset to the PCR value by the system as an initial value
By configuring a counter and counting with a 27 MHz clock and adding an STC counter value at the time of TS output, PCR can be added.

As described above, according to the third embodiment, video and audio TS_Packets are rearranged in the order of time stamp, and can be recorded on a recording medium continuously in time. If the position information and the time information of the TS_Packet including the head of the GOP are managed in the system, the management at the time of starting the reproduction is very easy as in the first and second embodiments. Become. In addition, audio is collectively stored in GOP
When rearranging packets, it is possible to easily perform post-recording based on the position information.

(Fourth Embodiment) Hereinafter, a fourth embodiment of the present invention will be described.
An embodiment will be described in detail with reference to the drawings. In addition,
The same parts as those already described in the above embodiment are denoted by the same reference numerals, and redundant description will be omitted. FIG. 4 is a block diagram of a video / audio stream converter 30 according to the fourth embodiment of the present invention.

In the fourth embodiment, video, audio, and other TS packets are extracted in the same manner as in the third embodiment. The video TS packet is stored in the VIDEO_TS_Packet memory 14 and V
The information is transferred to the IDEO_PTS, DTS, and I-Picture detection circuit 12. VIDEO_TS_Packet
In the memory 14, video TS packets are written. VIDEO_PTS, DTS, I-Pictu
In the re detection circuit 12, the video PTS, DTS, I-
Picture is detected.

Similarly, the audio TS packet is A
UDIO_TS_Packet memory 15 and AUDI
The data is transferred to the O_PTS detection circuit 7. AUDIO_TS
In the _Packet memory 15, an audio TS packet is written. The AUDIO_PTS detection circuit 7 detects an audio PTS.

[0093] TS packets other than video and audio are TS_Package other than VIDEO / AUDIO.
The data is written to the t memory 16.

Next, each detection circuit (VIDEO_PTS,
DTS, I-Picture detection circuit 12, AUDIO
_PTS detection circuit 7).
Picture is TS_P in GOP in time stamp order
The packet is transferred to the packet rearrangement circuit 20. In the present embodiment, TS_Packet in GOP in time stamp order
Video, audio, and other TS in the sorting circuit 20
The output order of the TS packets in the GOP of the packet is determined, and readout is sequentially performed from each memory in accordance with the determined order.
Construct S.

Finally, the PCR value is changed in the PCR changing circuit 18. Thereby, the output TS19
Can be obtained from TS.

The fourth embodiment of the present invention will be described in more detail with reference to FIG. The fourth embodiment is different from the third embodiment in the time stamp order TS_
In this embodiment, a TS_Packet rearranging circuit 20 in a time stamp order GOP is used instead of the packet rearranging circuit 17. TS_ in this time stamp order GOP
The former part and the latter part of the packet rearranging circuit 20 are basically the same as those of the third embodiment.
In order to recognize the I-Picture, an I-Picture detection is added, and the VIDEO_PTS / DTS detection circuit 6
It is changed to IDEO_PTS, DTS, I-Picture detection circuit 12. This is configured such that video and audio are collectively arranged in one GOP as a unit as in the second embodiment.

Next, TS_Pac for video and audio
An example is shown in which kets are rearranged in order of time stamp. FIG.
3 is TS_Packet unit, TS_Pac in GOP
FIG. 3 is a schematic diagram of a TS configuration showing rearrangement by ket. Referring to FIG. 13, in the present embodiment, input TS is
2, the TS_Packet rearrangement TS in the figure is the same as the third embodiment, and the TS_Packet rearrangement TSs 1, 2, and 3 in the GOP are the same as the fourth embodiment. However, video,
TS_Packets other than audio are omitted. .., A1.1, a1.3, V1.0, V1.2,... Described in the second embodiment.
.., And the PS conversion is merely TS rearrangement.

Therefore, in the present embodiment, in order to realize such a configuration, in addition to the third embodiment, I-
A means for detecting the Picture and recognizing the head of the GOP is added.
The TS_Packet rearrangement circuit 20 performs TS_Packet rearrangement processing in video and audio units in the GOP as described above, and finally, the PCR shown in the third embodiment.
Perform addition. As a result, TS_Packet rearrangement in video and audio units within a GOP can be realized.

As described above, according to the fourth embodiment, TS_Packets of video and audio are rearranged in time stamp order, and can be recorded on a recording medium continuously in time. If the position information and the time information of the TS_Packet including the head of the GOP are managed in the system, the management at the time of starting the reproduction is very easy as in the first and second embodiments. Become. In addition, audio is collectively stored in GOP
When rearranging packets, it is possible to easily perform post-recording based on the position information.

(Fifth Embodiment) Hereinafter, a fifth embodiment of the present invention will be described.
An embodiment will be described in detail with reference to the drawings. In addition,
The same parts as those already described in the above embodiment are denoted by the same reference numerals, and redundant description will be omitted. FIG. 5 is a block diagram of a video / audio stream converter 30 according to the fifth embodiment of the present invention.

Referring to FIG. 5, in the present embodiment, the transferred PS is transmitted from input PS 21 to VIDEO / A
It is supplied to the UDP / other detection / select circuit 2.
VIDEO / AUDIO / other detection / selection circuit 2
In, video, audio, and other PS packs are extracted.

The video PS pack is VIDEO_
The audio PS pack is supplied to the PES separation circuit 3, the audio PS pack is supplied to the AUDIO_PES separation circuit 4, and the other PS packs are supplied to the data stream separation circuit 22 other than VIDEO / AUDIO. Will be

Next, the PES of the extracted video is V
IDEO_PES memory 5 and VIDEO_PTS, D
The data is transferred to the TS detection circuit 6. Video PES is written to the VIDEO_PES memory 5. VID
In the EO_PTS / DTS detection circuit 6, the video PT
S and DTS are detected.

Similarly, the PES of the extracted audio
Are AUDIO_PES memory 8 and AUDIO_PT
The data is transferred to the S detection circuit 7. The audio PES is written into the AUDIO_PES memory 8. AU
The DIO_PTS detection circuit 7 detects an audio PTS.

Similarly, the extracted VIDEO /
Data streams other than AUDIO are VIDEO / A
The data is transferred and written to the data stream memory 23 other than the UDP.

Next, each detection circuit (VIDEO_PTS,
The PTS and DTS obtained by the DTS detection circuit 6 and the AUDIO_PTS detection circuit 7) are transferred to the time stamp order TS conversion circuit 24.

In the present embodiment, the time stamp TS
The conversion circuit 24 determines the TS conversion order based on the time stamps of video and audio, and VIDEO, AUD
The data is sequentially read from each memory of the data stream other than IO, VIDEO / AUDIO, and TS packets are created.

Finally, the PCR adding circuit 25
By adding an R value, a TS can be obtained from the output TS19.

More specifically, a fifth embodiment of the present invention will be described with reference to FIG. In the fifth embodiment, the PS is converted into the TS in the order of the time stamp, contrary to the PS conversion performed in the first embodiment.

In this embodiment, video, audio, and other PS packs are detected and selected for the input PS to the input PS 21. Video, audio, and other PS packs detected and selected are VIDEO
_PES separation circuit 3, AUDIO_PES separation circuit 4 separates only PES, and VIDEO_PES memory 5,
Writing to AUDIO_PES memory 8 and VI
DEO_PTS, DTS detection circuit 6, AUDIO_PT
The transfer to the S detection circuit 7 is performed. In addition, PS packs other than video and audio are packed via the data stream separation circuit 22 other than VIDEO / AUDIO.
A data stream from which unnecessary portions such as _Header are removed is written to the data stream memory 23 other than VIDEO / AUDIO. PS other than video and audio
The pack is a pack such as a private stream, and can be determined based on the value indicated by the Stream_ID in FIG. This Stream_ID8bit is
The packs indicated by 1110 ××××× for video and 110 ××××× for audio are data streams other than video and audio.

The time stamp order TS conversion circuit 24
In, using each detected time stamp, the PES is read from each memory in the order of the time stamp, and is converted into TS. In addition, some data streams other than video and audio have a time stamp, and do not have a time stamp, such as captions and superimposed characters described in the third embodiment. For some, time information is transferred to the time stamp order TS conversion circuit 24 in the same manner as video and audio, and TS conversion is performed in the time stamp order in the same manner as for video and audio. Since management is not required, it is only necessary to perform control for performing TS conversion immediately after writing to the memory.

The time stamp order TS conversion circuit 24
Then, according to the TS configuration shown in FIG. 7, a TS is configured by adding a header including setting of a PID, a cyclic counter and the like, and inserting an adaptation field.

Finally, the PC is added by the PCR adding circuit 25.
By adding R, it becomes possible to output a TS in which video and audio are arranged in time stamp order. The PCR constitutes an STC counter having an SCR value obtained from the input PS or a value obtained by adding an offset to the SCR value by the system as an initial value.
Count by z clock, STC at TS output
By adding a counter value, PCR can be added. As described above, according to the fifth embodiment, the TS_Packets of video and audio are rearranged in the order of the time stamp, and can be recorded on the recording medium continuously in time. If the position information and the time information of the TS_Packet including the head are managed on the system, the management at the time of starting the reproduction becomes very easy as in the first and second embodiments. In addition, audio is collectively stored in GOP
In the case of conversion, post-recording can be easily performed from the position information.

(Sixth Embodiment) Hereinafter, a sixth embodiment of the present invention will be described.
An embodiment will be described in detail with reference to the drawings. In addition,
The same parts as those already described in the above embodiment are denoted by the same reference numerals, and redundant description will be omitted. FIG. 6 is a block diagram of a video / audio stream converter 30 according to the sixth embodiment of the present invention.

Referring to FIG. 6, in the present embodiment, video, audio, and other PS packs are extracted as in the fifth embodiment.

Also, the video PS pack is VIDEO_
The audio PS pack is supplied to the PES separation circuit 3, the audio PS pack is supplied to the AUDIO_PES separation circuit 4, and the other PS packs are supplied to the data stream separation circuit 22 other than VIDEO / AUDIO. Will be

Next, the PES of the extracted video is V
IDEO_PES memory 5 and VIDEO_PTS, D
The TS is transferred to the I-Picture detection circuit 12.
In the VIDEO_PES memory 5, a video PES is written. VIDEO_PTS, DTS, I-
In the Picture detection circuit 12, the video PTS, D
TS and I-Picture are detected.

Similarly, the PES of the extracted audio
Are AUDIO_PES memory 8 and AUDIO_PT
The AUDIO_PES memory 8
Then, audio writing is performed. AUDIO_
The PTS detection circuit 7 detects an audio PTS.

Similarly, the extracted VIDEO /
Data streams other than AUDIO are VIDEO / A
The data is transferred to the data stream memory 23 other than the UDPO,
Writing to the memory is performed.

Next, each detection circuit (VIDEO_PTS,
DTS, I-Picture detection circuit 12, AUDIO
_PTS detection circuit 7).
The Picture is transferred to the TS conversion circuit 26 in the GOP in the order of the time stamp. In this embodiment, the TS conversion circuit 26 in the GOP by the time stamp of video and audio determines the TS conversion order in the GOP by the time stamp order,
VIDEO, AUDIO, VIDEO / A
The data is sequentially read from each memory of the data stream other than the UDP, and the packetization is performed.

Finally, in the PCR adding circuit 25, the PC
By adding an R value, a TS can be obtained from the output TS19.

The sixth embodiment of the present invention will be described in more detail with reference to FIG. In the sixth embodiment, a time stamp order GOP TS conversion circuit 26 is used instead of the time stamp order TS conversion circuit 24 in the fifth embodiment.
The former part and the latter part of the TS conversion circuit 26 in the OP
This embodiment is basically the same as the embodiment, except that an I-Picture detection is added in order to recognize a GOP, and the VIDEO_PTS / DTS detection circuit 6
O_PTS, DTS, I-Picture detection circuit 12
Has been changed to This is similar to the fourth embodiment.
In this configuration, video and audio are concentrated in one GOP.

Video and audio TS_Packets
In the example of reordering by timestamp,
The input TS in FIG. 13 shown in the embodiment is regarded as the input PS. The rest is as shown in FIG. In addition,
Specific examples of the order of conversion based on time stamps of video and audio are V1.0 and V1.0 described in the second embodiment.
.., A1.1, a1.3,..., Except that TS conversion is only PS conversion.

Therefore, in the present embodiment, in order to realize such a configuration, in addition to the fifth embodiment, I-
In addition to means for detecting the picture and recognizing the beginning of the GOP, the TS conversion circuit 26 in the GOP in the time stamp order performs the TS conversion processing in video and audio units in the GOP as described above. The PCR addition described in the fifth embodiment is performed. Thereby, TS conversion in video and audio units can be realized in a GOP.

As described above, according to the sixth embodiment, TS_Packets of video and audio are rearranged in time stamp order, and can be recorded on a recording medium continuously in time. If the position information and the time information of the TS_Packet including the head of the GOP are managed in the system, the management at the time of starting the reproduction is very easy as in the first and second embodiments. Become. In addition, audio is collectively stored in GOP
In the case of conversion, post-recording can be easily performed from the position information.

It should be noted that the present invention is not limited to the above embodiments, and it is clear that the above embodiments can be appropriately modified within the scope of the technical idea of the present invention. Further, the number, position, shape, and the like of the constituent members are not limited to the above-described embodiments, and can be set to numbers, positions, shapes, and the like suitable for carrying out the present invention. In each drawing, the same components are denoted by the same reference numerals.

[0127]

Since the present invention is configured as described above, the following effects can be obtained. The first effect is P
In both S and TS, by arranging video and audio in order of time stamp, file management and editing control on a recording medium can be facilitated.

The second effect is that it is possible to provide a video / audio stream conversion apparatus that can easily perform post-recording in a configuration in which audios are collectively arranged in GOP units.

[Brief description of the drawings]

FIG. 1 is a block diagram of a video / audio stream conversion device according to a first embodiment of the present invention.

FIG. 2 is a block diagram of a video / audio stream conversion device according to a second embodiment of the present invention.

FIG. 3 is a block diagram of a video and audio stream conversion device according to a third embodiment of the present invention.

FIG. 4 is a block diagram of a video / audio stream conversion device according to a fourth embodiment of the present invention.

FIG. 5 is a block diagram of a video / audio stream converter according to a fifth embodiment of the present invention.

FIG. 6 is a block diagram of a video and audio stream conversion device according to a sixth embodiment of the present invention.

FIG. 7 is a configuration diagram of a TS.

FIG. 8 is a configuration diagram of a PES_Packet_Header.

FIG. 9 is a configuration diagram (No. 1) of a PS.

FIG. 10 is a configuration diagram (No. 2) of a PS.

FIG. 11 is a schematic diagram of a TS arrangement of video and audio shown using time stamps.

FIG. 12 is a schematic PS configuration diagram showing rearrangement in sector units and sector units in a GOP.

[FIG. 13] TS_Packet unit, TS_P in GOP
FIG. 3 is a schematic TS configuration diagram showing rearrangement in an pocket.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Input TS 2 ... VIDEO / AUDIO / other detection / selection circuit 3 ... VIDEO_PES separation circuit 4 ... AUDIO_PES separation circuit 5 ... VIDEO_PES memory 6 ... VIDEO_PTS, DTS detection circuit 7 ... AUDIO_PTS detection circuit 8 ... AUDIO_PES time stamp 9 memory Sector unit PS conversion circuit 10 SCR addition circuit 11 Output PS 12 VIDEO_PTS, DTS, I-Pictur
e detection circuit 13: PS conversion circuit in sector unit within GOP in time stamp order 14: VIDEO_TS_Packet memory 15: AUDIO_TS_Packet memory 16: TS_Packet other than VIDEO / AUDIO
Memory 17: Time stamp order TS_Packet rearrangement circuit 18: PCR rearrangement circuit 19 ... Output TS 20: Time stamp order TS_Packet rearrangement circuit within GOP 21 ... Input PS 22: Data stream separation circuit other than VIDEO / AUDIO 23: Other than VIDEO / AUDIO Data stream memory 24 ... TS conversion circuit in time stamp order 25 ... PCR addition circuit 26 ... TS conversion circuit in GOP in time stamp order 30 ... Video / audio stream conversion device

Continued on the front page F term (reference) 5C053 FA20 FA24 GA10 GB06 GB11 GB17 GB38 HA29 HA33 JA21 JA22 KA18 KA24 LA15 5C059 KK39 LA02 MA00 PP05 PP06 PP07 RC02 RC04 RC32 SS13 SS19 UA32 5D044 AB05 AB07 DE04 DE17 DE38

Claims (18)

[Claims] 1. A means for receiving an input data stream of a first format and separating it into video, audio, and the like, and a buffer memory for temporarily holding and storing the separated video, audio, and other streams, respectively. And means for detecting video, audio, and other time stamps, and using the time stamps to convert a stream temporarily held and stored in the buffer memory in the order of time stamps into data of a second format. A video / audio stream conversion apparatus, which converts a stream into a data stream of the second format in units of a stream. 2. When converting a stream held in the buffer memory in a unit of the data stream of the second format in the order of the time stamp using the time stamp, a video is converted to a GOP (Group of
2. The video / audio stream conversion apparatus according to claim 1, wherein the conversion is performed in units of Picture, and the audio is also converted in synchronism with the video GOP unit. 3. A video stream in synchronism with a GOP unit of an audio video, which is converted into a data stream of the second format prior to a video stream, and is arranged. The video / audio stream converter according to claim 2. 4. The method according to claim 1, wherein a stream synchronized with the GOP unit of the audio video is converted into the data stream of the second format after the video stream, and is arranged. Item 3. The video / audio stream conversion device according to item 2. 5. A stream synchronized with a GOP unit of an audio video when viewed in GOP units of a video.
When converting to a data stream of the second format, first convert video to the data stream of the second format, and before converting all video, convert all of the audio to the data stream of the second format. The video / audio stream conversion apparatus according to claim 2, wherein the remaining video is converted into the data stream of the second format and arranged. 6. When converting the data stream of the first format into the data stream of the second format, a first time reference value is detected, and the second time reference value is detected based on the first time reference value. 3. The video / audio stream converter according to claim 1, wherein the video / audio stream converter generates a reference value. 7. When converting a data stream of the first format into a data stream of the second format, a first time reference value is detected, and a system is defined based on the first time reference value. 3. The video / audio stream converter according to claim 1, wherein the second time reference value is generated based on the value. 8. In the case of video, the time stamp is time management information Presentation of a reproduction signal.
_Time_Stamp (PTS) and decryption management information D
In encoding_Time_Stamp (DTS),
In the case of audio, the time management information Pre of the reproduction signal
Sentation_Time_Stamp (PTS)
The video / audio stream converter according to claim 1 or 2, wherein: 9. The data stream of the first format,
MPEG2 defined in ISO / IEC13818-1
The video / audio according to any one of claims 1 to 8, wherein the video / audio is a transport stream, and the data stream in the second format is an MPEG2 program stream defined in ISO / IEC13818-1. Stream converter. 10. The separated video, audio,
Other streams are Packetized Elem
The video / audio stream converter according to claim 9, wherein the stream is an entry stream (PES). 11. The first time reference value is Prog.
ram ClockReference (PCR)
The second time reference value is SystemClock.
The video / audio stream converter according to claim 9, wherein the video / audio stream converter is Reference (SCR). 12. The data stream of the first format,
The data stream of the second format is an ISO / IEC
The video / audio stream converter according to any one of claims 1 to 8, wherein the video / audio stream converter is an MPEG2 transport stream specified in 13818-1. 13. The separated video, audio,
The video / audio stream converter according to claim 12, wherein the other data stream is an MPEG2 transport stream. 14. The first time reference value, the second time reference value,
The time reference reference value is Program Clock Re.
13. The video / audio stream converter according to claim 12, wherein the video / audio stream converter is a reference (PCR). 15. The data stream of the first format is an MPE defined by ISO / IEC13818-1.
The video according to any one of claims 1 to 8, wherein the video stream is a G2 program stream, and the data stream in the second format is an MPEG2 transport stream defined in ISO / IEC13818-1. Audio stream converter. 16. The separated video, audio,
Other data streams are Packetized E
16. The video / audio stream conversion device according to claim 15, wherein the video / audio stream conversion device is a elementary stream (PES). 17. The system according to claim 17, wherein the first time reference value is Syst.
In the em Clock Reference (SCR), the second time reference value is Program Clock.
16. The video / audio stream conversion device according to claim 15, wherein the video / audio stream conversion device is Reference (PCR). 18. A step of receiving an input first-format data stream and separating it into video, audio, and other streams, and temporarily holding and storing the separated video, audio, and other streams in a buffer memory, respectively. And detecting video, audio, and other time stamps, and using the time stamps,
Video having a step of converting a stream temporarily held and stored in the buffer memory in the order of time stamp into the data stream of the second format in units of a data stream of the second format. Audio stream conversion method.