JP2000287178A - Insert edit system for mpeg 2 data - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an insert edit system that can edit audio data in compliance with the MPEG 2 in real time. SOLUTION: The insert edit system for in compliance with the MPEG 2 is provided with an extract means that extracts audio data in compliance with the MPEG 2-TS, an edit means that edits extracted audio data, and an output means that merges the edited audio data to an audio data part of the data in compliance with the MPEG 2-TS and outputs the merged data as the data in compliance with the MPEG 2-TS.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an insert editing system for MPEG2 data, and more particularly to an insert editing system capable of editing audio data in MPEG2 data in real time.

[0002]

2. Description of the Related Art In order to highly compress a moving image and treat it as digital moving image data, MPEG (motion photograpy) is used.
The data format of the phic coding experts groupe) standard is used. In the editing processing for digital moving image data (hereinafter, referred to as MPEG data) using such an MPEG data format, editing of images and sounds is performed individually, and finally images and sounds are combined, and the MPEG data and I do.

FIG. 1 is a diagram showing an example of the configuration of a conventional insert editing system for editing MPEG data. 1, 1 is an MPEG2-TS data file, 2 is an audio data conversion / extraction unit, 3 is an audio data file, 4 is a video data edit processing unit, 5 is an audio data edit processing unit, 6 is a video data output unit, 7, an audio data output unit; and 8, a synchronization processing unit.

[0004] Since MPEG data contains coded and highly compressed video data and audio data mixed as packet data, the MPEG2 format is used.
In an insert editing system that edits data,
The editing process of the video data and the editing process of the audio data are individually performed. As shown in FIG. 1, video data editing processing is performed by a video data editing processing unit 4 on a packet of video data of MPEG data extracted from an MPEG2-TS data file 1, and is output from a video data output unit 6. Then, the edited video data resource is extracted. In this case, the video data editing processing unit 4 edits the video by displaying the frame image of the video data on a monitor screen or the like.

[0005] Regarding audio data editing processing, first,
The audio data conversion / extraction unit 2 extracts an audio data packet, which is an audio data portion of MPEG2-TS data, from the MPEG2-TS data file 1 and converts it into audio data of another data format (WAVE data, PCM data). And extracts it and stores it in the audio data file 3. Then, audio data is extracted from the audio data file 3, edited by the audio data editing unit 5, and the edited audio data resource is extracted from the audio data output unit 7. Then, in order to synchronize the audio with the video, the video data output unit 6 and the audio data output unit 7 are controlled by the control of the synchronization processing unit 8, and the edited results are output from different resources in synchronization with each other. Edit.

That is, in this case, one MPEG2-T
S data is subjected to separate editing processing (4, 5) for its video data and audio data, and the edited results are output as separate data resources (6, 7) while being synchronized (8). Realizes insert editing.

In such an insert editing system, the result of insert editing, such as adding audio data to video data, is output with the video output and audio output synchronized. Since the output and the audio output are signals of different systems, and the data is also returned to the video data and the audio data having a large data amount, these are combined into one data to form a compact MPEG2-TS. In order to be able to handle as data, the video data and audio data
Must be re-encoded into data.

Therefore, the insert editing system that handles MPEG2-TS data is provided with an encode processing unit that encodes video data (video resources, video output) and audio data (audio resources, audio output) into MPEG data.

FIG. 2 is a diagram showing another example of the configuration of a conventional insert editing system for editing MPEG2 data. In FIG. 2, 10 is an MPEG2-TS data file, 11 is an audio data conversion / extraction unit, 12 is an audio data file, 13 is a video data editing processing unit, 14 is an audio data editing processing unit, 15 is a video data output unit, 16
Is an audio data output unit, 17 is a synchronization processing unit, 18 is an encoding processing unit, and 19 is an edited MPEG2-TS data file.

The insert editing system for MPEG2 data shown in FIG. 2 is different from the insert editing system shown in FIG. 1 in that video data (video resources and video output) and audio data (audio resources and audio output) are In this configuration, an encoding processing unit for encoding is provided.

As shown in FIG. 2, the MPEG2 data insert editing system performs video data editing processing on the MPEG data extracted from the MPEG2-TS data file 10 by a video data editing processing unit 13. It is taken out from the video data output unit 15 as an edited video data resource under the control of the synchronization processing unit 17. In the audio data editing process, the audio data conversion / extraction unit 11 converts the audio data portion of the MPEG2-TS data from the MPEG2-TS data file 10 into audio data of another data format (WAVE data, PCM data). And extracts it and stores it in the audio data file 12. Then, audio data is extracted from the audio data file 12, edited by the audio data editing processing unit 14, and the edited audio data is extracted from the audio data output unit 16 as an audio data resource under the control of the synchronization processing unit 17. At this time, in order to output the audio together with the video, the synchronization processing unit 17 controls the video data output unit 15 and the audio data output unit 16 to output the video data and the audio data while synchronizing them. , To the encoding processing unit 18. The encoding processing unit 18 converts the video data and the audio data input
The data is encoded into two data and output, and stored in the MPEG2-TS data file 19.

[0012]

As described above, in the conventional insert editing system, the editing process of the video data and the editing process of the audio data are separately performed, and the audio data is added to the video data. The edit result of insert editing such as is output with the video output and the audio output synchronized, but since the video output and the audio output are signals of different systems, they are collected as one data. In order to be able to handle the video data and the audio data simply, the video data and the audio data must be encoded again into MPEG data.

[0013] The encoding process to MPEG data has a heavy load because video data and audio data are highly compressed.
There is a problem that it requires a lot of processing time and cannot perform real-time insert editing. That is, MPEG
Even when performing simple insert editing such as adding audio data to video data of data, the video output and audio output of the edited result are output as signals of different systems, respectively. M
In order to convert to PEG data, re-encoding processing must be performed, which requires a lot of processing time, and there is a problem that real-time insert editing cannot be performed.

Therefore, an object of the present invention is to provide an MPEG2
An object of the present invention is to provide an insert editing system that can edit audio data of data in real time.

[0015]

In order to achieve the above object, an insert editing system for MPEG2 data according to the present invention converts audio data of MPEG2-TS data into, for example, MPEG1 Audio Layer II-ES.
Extracting means for extracting data in a data format; editing means for editing the extracted audio data;
2-Overwrite the audio data part of the TS data,
Output means for outputting 2-TS data.

In the MPEG2 data insert editing system according to the present invention, the packet data of the audio data portion in the MPEG2 data is taken out and edited in consideration of the data format of the MPEG2 data, and the MPEG2 data having a large processing load is extracted.
The MPEG2 data obtained by editing the audio data portion is output without performing the encoding process on the data. This allows insert editing in real time.

That is, the extracting means converts the audio data of the MPEG2-TS data into the MPEG1 Audio layer II.
-Extracting in the ES data format, editing the extracted audio data by the editing means, overwriting the edited audio data on the audio data portion of the MPEG2-TS data by the output means, and outputting it as MPEG2-TS data. As a result, the audio data portion of the MPEG2 data can be extracted in the MPEG data format and edited, and the edited result can be output as MPEG2 data each time from the same resource.

[0018]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below in detail with reference to the drawings. The data handled by the insert editing system according to the present invention is MP
This is data in the data format of EG2. Specifically, M
PEG2 data format is MPEG2-TS GOP = 1
Or 2 is assumed.

FIG. 3 is a diagram showing the configuration of an insert editing system for editing MPEG data according to an embodiment of the present invention. In FIG. 3, reference numeral 20 denotes an MPEG2-TS data file, reference numeral 21 denotes an audio data extraction unit, and reference numeral 22 denotes "MP
EG1 Audio "audio data file, 23 is a video data editing processor, 24 is an audio data editing processor, 2
5 is a merge processing unit, 26 is an edited MPEG2-TS
A data file 27 is an output processing unit.

The MPEG2-TS data to be edited is, as shown in FIG.
From the video data editing processing unit 23,
If necessary, edit processing of the video data is performed on the frame image of the video data of the MPEG data. In this case, for example, the video data editing processing unit 23 edits the video data by displaying a frame image of the video data on a monitor screen or the like.

In the audio data editing process, the audio data extraction unit 21 extracts an audio data packet which is an audio data portion of MPEG2-TS data from the MPEG2-TS data file 1. Here, the extracted audio data is not converted into audio data of another data format (WAVE data, PCM data),
The audio data portion of the EG2-TS data is “MPEG1
Audio "audio data packet data. The packet data is arranged in order and, for example, excluding the header portion, is set as “MPEG1 Audio” audio data, and is stored in the audio data file 22 in order to determine one frame portion of the audio data distinguished by the synchronization word. As will be described later, since one frame of the audio data is the minimum unit that can be decoded, one frame is determined by the synchronization word.
The audio data of the frame is determined, the audio data is decoded on a frame basis, and the audio data is edited as needed.

That is, in the audio data editing processing, the audio data editing processing unit 24 causes the audio data file 22
, Audio data of one frame unit is determined based on the synchronization word, the audio data is decoded in frame units, and the audio data is edited as necessary. Then, the audio data editing processing unit 24 encodes the edited audio data again, adds a header portion thereto, decomposes the data into packet data as packet data of “MPEG1 Audio” audio data, 25, overwrites and merges the corresponding position of the packet data in the video data portion. As a result, it becomes the MPEG2-TS data that has been insert-edited as it is. The edited MPEG2-TS data is stored in an MPEG2-TS data file 26 that stores the edited result, and is reproduced by an output processing unit 27 that decodes and reproduces the MPEG2-TS data. As a result, a video output and an audio output subjected to insert editing are obtained. In the insert editing process here, M which requires a lot of load
No encoding processing is performed on PEG2 data, and real-time editing becomes possible.

FIG. 4 shows an MPE according to an embodiment of the present invention.
It is a figure explaining the data format of G2. This will be described with reference to FIG. As described above, the MPEG applied in the present invention
The two-data format is based on GOP = 1 or 2 of MPEG2-TS.

In the MPEG2-TS data, as shown in FIG. 4, a video data stream 30 and an audio data stream 31 are divided into packets (TS packets) in units of 188 bytes, and further multiplexed.
One frame 32 of the video data is composed of a plurality of TS packets, and the data break of one frame always matches the break of the TS packet.

On the other hand, one frame 33 of audio data
The data delimiter does not match the delimiter of the TS packet in most cases. One frame 33 of the audio data is the minimum unit that can be decoded. This is distinguished by the synchronization word. Therefore, in order to edit the audio data, one frame of audio data is determined by the synchronization word. The audio data is decoded frame by frame, and the audio data is edited as needed.

1 of the video data of the MPEG2-TS data
The data size of the frame 32 varies greatly depending on the type of picture (image) (I picture, P picture) (variable length). On the other hand, audio data has a high sampling frequency and high quality. Therefore, the data amount is not so large, and the data size of one frame 33 of the audio data is fixed.

FIG. 5 is a diagram for explaining a method of insert-editing MPEG2-TS data according to the present invention. This M
According to the insert editing method of PEG2-TS data,
As shown in FIG. 5, only the audio data of the MPEG2-TS data is extracted from the MPEG2 file 40 storing the MPEG2-TS data, and the MPEG1 Audio is extracted.
o The edited audio data stored in the layer II-ES file 42 is subjected to editing processing such as decoding as necessary and merging with other audio resources as an audio signal to correspond to one frame of video. 1 frame (approximately 1
/ 30 seconds). This audio data is decomposed as packet data, and a merge process for replacing the audio data in the MPEG2-TS data with packet data is performed. The result of the editing is, in each case, MPEG2-
Output from the same resource as TS data. Here, the packet data size of the video data and the audio data is managed to replace the packet data of the audio data in the MPEG2-TS data. Here, the data size of each frame based on video is managed using the data size management file 41.
Referring to the data size managed here, the MPE
From the G2-TS data, only the packet of the audio data portion is sequentially replaced, and each time the packet is output as MPEG2-TS data from the same resource.

That is, according to the insert editing method of MPEG2 data, the audio data of the MPEG2-TS data is extracted, the packet data of the extracted audio data is collectively edited in units of one frame, and the edited audio data is edited. The packet data is disassembled, the packet data is merged with the corresponding position of the audio data portion of the MPEG2-TS data, and insert editing is performed so as to be output from the same resource as the MPEG2-TS data. Also in this editing process, encoding processing for creating MPEG2 data is not required, and insert editing can be performed in real time.

FIG. 6 is a flowchart showing a processing flow of the insert editing processing of MPEG2-TS data according to the present invention. This will be described with reference to FIG.

In the insert editing process, first,
In order to edit the MPEG2 data to be edited, the corresponding data of the portion where the reproduction instruction is issued is extracted (step 51). Next, as for the video data, the data size management file 41 which manages the data size of each frame based on the video is analyzed to obtain the data size (step 52). Then, the corresponding one frame of the MPEG2-TS from the MPEG2 file 40
Is obtained (step 53).

Next, regarding the audio data, MPEG1
From the audio layer II-ES file 42, the corresponding M of about 1/30 second (corresponding to one frame of video)
PEG1 Audio layer II-ES data is obtained (step 54). And MPEG2 file 4
0, the MPEG2-TS voice packet acquired from
The MPEG2 data is reorganized by replacing the audio packets obtained from the PEG1 Audio layer II-ES file 42 (step 55). Subsequently, the rearranged MPEG2 data is output from the same resource (step 56).

[0032]

As described above, as described above, the MPE of the present invention
According to the insert editing method of G2 data, MPEG2
The audio data part of the data is extracted and edited, and the edited result is output as MPEG2 data from the same resource each time, thereby implementing the insert editing of the audio data. Thereby, insert editing of MPEG2 data can be performed in real time.

[Brief description of the drawings]

FIG. 1 is a diagram showing an example of a configuration of a conventional insert editing system that performs an editing process of MPEG data;

FIG. 2 is a diagram showing another configuration example of a conventional insert editing system that performs editing processing of MPEG2 data;

FIG. 3 is a diagram showing a configuration of an insert editing system that performs an MPEG data editing process according to an embodiment of the present invention;

FIG. 4 is a view for explaining the data format of MPEG2 related to the embodiment of the present invention;

FIG. 5 is a view for explaining an insert editing method of MPEG2-TS data according to the present invention;

FIG. 6 is a flowchart showing a processing flow of insert editing processing of MPEG2-TS data according to the present invention.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... MPEG2-TS data file, 2 ... Audio data conversion / extraction part, 3 ... Audio data file, 4 ... Video data edit processing part, 5 ... Audio data edit processing part, 6 ... Video data output part, 7 ... Audio data Output unit 8 Synchronization processing unit 10 MPEG2-TS data file 11 Audio data conversion / extraction unit 12 Audio data file 13 Video data editing processing unit 14 Audio data editing processing unit 15 Video Data output unit 16 Audio data output unit 17 Synchronization processing unit 18 Encoding processing unit 19 Edited MPEG2-TS data file 20 MPEG2-TS data file 21 Audio data extraction unit 22 "MPEG1 Audio" audio data file, 23: video data editing processing unit, 24: audio data editing processing 25, a merge processing unit, 26, an edited MPEG2-TS data file, 27, an output processing unit, 30, a video data stream, 31, an audio data stream, 32, one frame of video, 33, one frame of audio, 40: MPEG2-TS data file, 41: Data size management file, 42: MPEG1 Audio layer II-ES file, 43: One frame of audio.

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Tomoyuki Morita 6-81 Ouecho, Naka-ku, Yokohama-shi, Kanagawa Prefecture In-house Hitachi Software Engineering Co., Ltd. 81 Hitachi Software Engineering Co., Ltd. In-house F-term (reference) 5C023 AA40 CA01 CA04 DA01 DA08 EA03 5C053 FA14 GB38 JA01 KA24 5C059 KK11 KK36 MA00 RA01 RC32 SS02 SS30 UA01 5D044 AB05 DE03 GK08 HL14 5D110 CA06 CA17CK21

Claims (3)

[Claims] 1. An extracting means for extracting audio data of MPEG2-TS data; an editing means for editing the extracted audio data; and merging the edited audio data into an audio data portion of the MPEG2-TS data. MPEG having output means for outputting as TS data
2 data insert editing system. 2. The MPEG-2 data insert editing system according to claim 1, wherein said extracting means extracts the audio data of the MPEG2-TS data in an MPEG1 Audio layer II-ES data format. Data insert editing system. 3. The audio data of the MPEG2-TS data is extracted, and the packet data of the extracted audio data is collectively edited in units of one frame. The edited audio data is decomposed into packet data. A method for inserting and editing MPEG2 data, wherein the data is merged with the corresponding position of the audio data portion of the TS data and output from the same resource as MPEG2-TS data.