JP2005020529A - Editing method and editing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an editing method and an editing device which reproduce continuous images to which a user does not have a sense of incongruity by deleting a part which the user considers as unnecessary. <P>SOLUTION: An editing point at the start of editing and an editing point at the end of editing are inputted (S1) and a reference picture having reproduction time existing before the editing point at the start and closest to reproduction time of the editing point at the start is considered as an overwrite starting position (S2). A picture to be reproduced first among pictures existing between the overwrite starting position and the editing point at the start is considered as a picture for overwrite (S3). Then, all the pictures from the overwrite starting position to VOBU in which the editing point at the end exists are replaced with images which are the same as the picture for overwrite. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an editing method and an editing apparatus, and more particularly to an editing method and an editing apparatus for editing an MPEG standard program stream.
[0002]
[Prior art]
2. Description of the Related Art In recent years, various types of moving image-compatible optical disc playback apparatuses that play back optical discs that record data such as video and audio have been developed. At present, a DVD standard that uses the internationally standardized MPEG2 (Moving Picture Experts Group 2) system and an AC3 audio compression system has been defined. According to the MPEG2 system layer, the DVD standard supports the MPEG2 system as a moving picture compression system, and supports the AC3 audio compression system and the MPEG audio compression system as audio compression systems.
[0003]
In addition, as a standard of the media itself, a DVD-RAM standard (4.7 GB) has been completed following a DVD-ROM standard which is a DVD-video medium, and a DVD-RAM drive has begun to spread as a computer peripheral device. Yes.
[0004]
Furthermore, a DVD video standard that realizes a system capable of recording and reproducing information in real time using a DVD-RAM, that is, a DVD-VR (DVD-Video Recording) -DVD standard, has also been established and complies with this standard. Products to market are also on the market.
[0005]
Editing of a data string including video data compressed by the MPEG2 system, that is, an MPEG program stream is usually performed in units of video object units (VOBU).
[0006]
That is, for a program stream recorded in accordance with the DVD-VR standard, editing for deleting the rear part of the stream, editing for extracting a part of the stream, and extracting a part of the DVD-VR standard data to obtain a DVD -Editing such as conversion to video standard data is often performed in units of VOBUs. This is because editing in units of VOBU does not require detailed data correction (see, for example, Patent Document 1).
[0007]
[Patent Document 1]
JP 2000-69413 (Section 1-5, FIGS. 1 and 2)
[0008]
[Problems to be solved by the invention]
As described above, conventional MPEG program stream editing is often performed in units of VOBUs.
However, one VOBU usually has a display time of about 0.5 seconds, and there may be some errors from the editing point intended by the user. That is, there is no inconvenience when the start point and the end point that the user desires to delete are exactly delimited in units of VOBU, but inconvenience occurs when it is desired to delete the middle of the VOBU. This is because, if editing is performed for each VOBU, an image of a necessary part is deleted, or an image of an unnecessary part remains.
[0009]
Here, assuming an actual usage, it is considered that an edit method that leaves some unnecessary parts is selected rather than removing necessary parts.
However, leaving such an unnecessary image feels uncomfortable as long as it is captured visually. Usually, the part that has been left is often a video such as a CM (advertising) between programs, and when this is played after editing, even if it is a time of a few seconds of commas, As long as it is captured by human vision, it will be a part that feels uncomfortable.
[0010]
In other words, even if it is a few seconds of commas, an image that is completely different from the image that was played before the above unnecessary part is played back. On the contrary, since it is a few seconds of commas, it seems that it has not been completely deleted. It becomes a part.
[0011]
Therefore, in the present invention, the portion considered unnecessary by the user is replaced with overwriting data that does not feel uncomfortable, and the above-mentioned images such as CMs that feel uncomfortable for a few seconds are completely eliminated, and continuous images that do not feel uncomfortable are reproduced. It is an object to provide a method and an editing apparatus.
[0012]
[Means for Solving the Problems]
In order to achieve the above object, according to the present invention, in the editing method of video data recorded as an MPEG program stream, a step of inputting a first editing point for starting editing and a second editing point for ending editing. A reference picture that exists before the first edit point and has a reproduction time closest to the reproduction time of the first edit point is set as an overwrite start position, and the overwrite start position and the first edit point A step of making the picture to be reproduced first among pictures existing between one editing point as an overwriting picture, and all pictures from the overwriting start position to the VOBU where the second editing point exists And a step of replacing the same image as the overwriting picture with an image to be reproduced.
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of an editing apparatus according to an embodiment of the present invention. The editing apparatus 1 includes an optical disk 10, a hard disk drive (HDD) 20, a disk drive 35, a data processor 36, an encoder unit 50, a decoder unit 60, and a microcomputer block 30 as main components.
[0014]
Next, the configuration of each element will be described.
The disk drive 35 rotates and drives the optical disk 10 that is an information recording medium for video files, and reads / writes information from / to the optical disk 10.
The encoder unit 50 constitutes the recording side of the optical disc 10. That is, the encoder unit 50 includes an ADC group 53 including an ADC (analog-digital converter) 52, a V (video) encoder, an A (audio) encoder, and an SP (sub-picture) encoder, and each encoder from the encoder group 53. Is provided with a formatter 56 for converting the output of the data into a predetermined format and a buffer memory 57.
[0015]
Here, the ADC 52 receives an external analog video signal + external analog audio signal from the A / V input unit 42 or an analog TV signal + analog audio signal from the TV (television) tuner 44.
[0016]
The microcomputer block 30 controls the overall operation of the editing apparatus 1. That is, the microcomputer block 30 includes an MPU (micro processing unit), a ROM in which a control program and the like are written, and a RAM for providing a work area necessary for executing the program. The microcomputer block 30 is connected to the HDD 20, the disk drive 35, the data processor 36, the encoder unit 50, the decoder unit 60, and the like.
[0017]
Then, the MPU of the microcomputer block 30 uses the RAM as a work area according to the control program stored in the ROM, and edits, detects a defect location, detects an unrecorded area, sets recording information recording position, UDF recording, AV address Perform settings and so on.
[0018]
The data processor 36 receives the DVD recording data output from the formatter 56 of the encoder unit 50 under the control of the microcomputer block 30 and supplies it to the disk drive 35, the HDD 20, and the temporary storage unit 37. Further, a DVD reproduction signal reproduced from the optical disk 10 is captured from the disk drive 35 and output to the decoder unit 60, management information recorded on the optical disk 10 is rewritten, or data recorded on the optical disk 10 is deleted. .
[0019]
The decoder unit 60 constitutes the playback side of the optical disc 10. That is, the decoder unit 60 includes a separator 62 that separates and extracts each pack from video information having a pack structure read from the optical disc 10, a memory 63 that is used when pack separation and other signal processing are performed, and a separator 62. A decoder group 64 including a V decoder that decodes the separated main video data, an SP decoder that decodes the sub-video data separated by the separator 62, and an A decoder that decodes the audio data separated by the separator 62; A video processor 66 is provided that appropriately synthesizes the sub video data obtained from the SP decoder with the main video data obtained from the decoder, and superimposes the menu, subtitles, and other sub videos on the main video and outputs them.
[0020]
The synthesized video data from the video processor 66, the external analog video signal from the ADC 52, and the data output from the video processor 66 are input to a video mixer 71, through which a DAC (D / A converter) 74 is supplied. And output to the outside via an I / F (interface) 73.
[0021]
Here, when the output of the A decoder from the decoder group 64 is digitally output, it is output to the outside via the I / F (interface) 75, and when it is analog output, it is output via the selector 76 to the DAC (D / A Converter 77 converts the signal to analog and outputs it to the outside. The selector 76 selects one of a signal input from the TV tuner 44 or the A / V input unit 42 via the ADC 52 and an output signal of the A decoder input from the decoder group 64 according to a select signal from the microcomputer block 30. Select and output. The analog audio signal is supplied to an external component (2-channel to 6-channel multi-channel stereo device) not shown.
[0022]
An STC (System Time Counter) 38 creates time stamp data that serves as a reference for recording and reproduction in the data recording mode and the data reproduction mode.
[0023]
The key input unit 11 has buttons such as play (PLAY), stop (STOP), recording (REC), skip (Skip), fast forward (FF), reverse feed (Rew), and slow (Slow) enter key. By pressing this button, the user can operate the editing apparatus 1 to record, play back, and edit the recorded video data on the HDD 20 or the rewritable optical disc 10.
[0024]
Further, a display unit 48 is connected to the microcomputer block 30, and the reproduction time and the like can be confirmed here.
FIG. 2 shows a directory structure of video and audio files in the VR format of DVD as an example of the optical disk 10 applied to the editing apparatus 1 shown in FIG.
[0025]
In DVD, a directory exists for each standard. In DVD-VR, the directory name is “DVD_RTAV”. Similarly, in DVD-Audio, “AUDIO_TS”, and in DVD-Video, “VIDEO_TS”. Yes. Since FIG. 2 is a DVD-VR format, “DVD_RTAV” is indicated.
[0026]
In FIG. 2, recording data exists in each directory. In the case of a DVD, data is stored in a file format. The title corresponds to, for example, one movie, and a plurality of titles can be recorded on one disc.
[0027]
In the directory “DVD_RTAV”, VR_MANGR.V as a video manager (VMG) file is stored. VR_MOVIE. As IFO, movie video file. VRO, VR_STILL. As a still picture video file. VRO, VR_AUDIO. As a still picture audio video file. VRO, VR_MANGR. As a backup for video manager. Each file of BUP exists.
[0028]
VR_MANGR. Management information for managing the optical disc 10 is recorded in the IFO file. This management information is data for advancing programs, entry points, playlists, and the like.
[0029]
VR_MOVIE. The VRO file is a so-called movie AV file for recording a movie video object (movie VOB).
VR_STILL. VRO is a still picture AV file for recording a still picture VOB. This VR_STILL. VRO is used to record an original VOB composed of a video part including an arbitrary sub-picture unit. At this time, the audio part related to the video part is also included in the original still picture VOB.
[0030]
VR_AUDIO. The VRO is a still picture-added audio video file for recording an additional audio stream for the still picture. This additional audio part indicates an audio stream recorded by after recording. VR_AUDIO. The audio part recorded in VRO is VR_STILL. Used in combination with several video parts recorded on VRO.
[0031]
FIG. 3 shows VR_MOVIE. As the movie video file. VR_STILL. As a VRO and still picture video file. The file structure of VRO is shown.
[0032]
A video file has a hierarchical structure, one file is composed of a plurality of VOBs (video objects), one VOB is composed of a plurality of VOBUs (video object units), and one VOBU is composed of a plurality of packs. As the plurality of packs, there are an RDI pack, a V pack (video pack), an SP pack (sub-picture pack), and an A pack (audio pack). In some cases, the SP pack (sub-picture pack) and the A pack (audio pack) are not included.
[0033]
The V pack is a video data compressed by the MPEG2 system, and includes a pack header, a packet header, and a video data portion. The A pack is obtained by processing audio data by a method such as linear PCM, MPEG, or AC3, and includes a pack header, a packet header, and an audio data portion. In addition, sub-picture data is recorded in the SP pack.
[0034]
In the packet header, time stamps such as PTS (Presentation Time Stamp) indicating playback time and DTS (Decoding Time Stamp) indicating decoding time are described as appropriate. For the sub-picture PTS, a time arbitrarily delayed from the PTS of the main picture data or audio data in the same reproduction time zone can be described.
[0035]
The playback time of one video object unit (VOBU) is normally the playback time of video data composed of one or more video groups (group of pictures GOP) included in the video object unit. Normally, 1 GOP is about 0.5 seconds in the MPEG2 standard, and video data compressed so as to reproduce about 15 frame images is stored.
[0036]
FIG. 4 is a diagram illustrating a group of picture GOP. The MPEG2 data stream is encoded in units of this group of picture GOP. The group of picture GOP includes an intra-coded screen (I picture) and an inter-coded screen (P picture, B picture) as shown in FIG.
[0037]
The I picture can be decoded by itself, whereas the P picture is decoded by referring to the decoding result of the reference picture (I picture or P picture) that is one before in the recording order, and , B picture is decoded with reference to the decoding result of the reference picture (I picture) which is one before and two before in the recording order.
[0038]
FIG. 5A is a diagram showing the structure of the picture and the editing points. For example, in FIG. 5A, I2 is an I picture, which is the third picture reproduced in this figure. B0 is a B picture, which is the first picture to be reproduced in this figure. In FIG. 5A, the original picture of the arrow is decoded with reference to the decoding result of the picture of the arrow destination. For example, B0, B1, and P5 pictures are decoded with reference to the decoding result of the I2 picture. The B3 and B4 pictures are decoded with reference to the decoding results of the P5 picture and the I2 picture. The P8 picture is decoded with reference to the decoding result of the P5 picture. The B6 and B7 pictures are decoded with reference to the decoding results of the P8 picture and the P5 picture.
[0039]
Due to this reference relationship, the recording order and the playback order do not necessarily match. The two previous reference pictures referenced by the B picture are in the playback order before the B picture, but the previous reference picture is in the playback order after the B picture.
[0040]
Since the reference to the reference picture is always the reference to the previous picture in the recording order, even if the rear part is deleted in any picture unit of the recorded stream, the reference picture is lost in the remaining pictures. No picture is generated.
[0041]
However, since the recording order is not the reproduction order, there is a possibility that a missing picture occurs in the reproduction. For example, when the picture after the edit point X0 in FIG. 5A is deleted and another stream is connected to the edit point X0, the pictures reproduced in this figure are B0, B1, I2, B3, and P5. Therefore, the B4 picture is not reproduced, resulting in an unnatural reproduction image.
[0042]
Considering the above, even if the data after a certain picture is deleted, the picture in which all the pictures before it are not affected by the playback order and the recording order is the reference picture (I picture or P picture). The picture just before. Therefore, in the present invention, the pictures up to immediately before the reference picture are left and the subsequent data is edited. That is, this editing is performed in reference picture units (3 frame units).
[0043]
On the other hand, audio data can be edited in units of access units. This is because the playback order and recording order are always the same for each access unit. Hereinafter, it is assumed that audio data is also edited with data corresponding to video data.
[0044]
The VR format data editing method according to the present invention will be described below with reference to FIGS.
FIG. 6 is a flowchart showing the editing method according to the embodiment of the present invention. FIG. 7 is a diagram showing before and after conversion of stream data.
First, recording processing is performed in the editing apparatus 1 in response to a REC (recording) key input from the key input unit 11 by the user. That is, the microcomputer block 30 gives instructions to the encoder unit 50, the data processor 36, and the disk drive 35, and the process is started, and the analog TV signal + analog audio signal from the TV tuner 44 or the A / V input unit 42 The external analog video signal + external analog audio signal is input to the encoder group 53 directly or via the ADC 52 and encoded. The formatter 56 generates a VR format based on the output, and the data processor 36 that has received the output records it in the HDD 20 in the VR format (step S0). As a result, the stream shown in FIG. 7A is recorded in the HDD 20.
[0045]
Next, the microcomputer block 30 checks whether or not there is an editing request for the VR format stream recorded in the HDD 20 from the user through the key input unit 11 (step S1). That is, it is checked whether an edit point for starting editing and an edit point for ending editing have been input.
[0046]
Here, the editing designation by the user is, for example, the above-described stream data read from the HDD 20 is decoded by the decoder unit 60, and the audio data is output to the display device (not shown) via the DAC 75 and the image data via the video mixer 71 and the DAC 74. The start point and the end point of the edit point are input by feeding the output video frame and selecting one frame (image). In addition, the user operates the key input unit 11 to directly input the editing start time and the editing end time so that the editing point is 36 minutes 24 seconds 2 from the start of the video program. It may be.
[0047]
As a result, if there is no editing request from the user (No in step S1), the process proceeds to step S5 described later without editing. On the other hand, when there is an editing request from the user (Yes in step S1), the following processing is performed.
[0048]
First, a position for starting overwriting is determined (step S2). That is, the microcomputer block 30 of the editing apparatus 1 shown in FIG. 1 exists before the start editing point input at the time of the editing request in step S1 and has the closest reproduction time (I (Picture or P picture) is determined as the overwrite start position (step S2).
[0049]
Here, as described above, even if rewriting after this overwriting start position is performed, there is no effect on the picture existing before that, and a continuous image and sound can be reproduced. Therefore, the edit target position is after the overwrite start position determined in step S2.
[0050]
The above operation will be described with reference to FIG. In FIG. 7A, it is assumed that the data from the point X0 in the VOBU_3 of the stream data recorded in the HDD 20 to the point X1 in the VOBU_5 is unnecessary data such as CM.
[0051]
Therefore, if the group of picture (GOP) shown in FIG. 5A is VOBU_3 in FIG. 7A, the overwrite start position exists before the start editing point X0, and this P5 which is a reference picture having a reproduction time closest to. Therefore, the editing target starts from P5 and the picture to be edited is up to the last frame of VOBU_5 in FIG.
[0052]
Even when the editing point is designated by time, similarly, the editing apparatus 1 starts overwriting the reference picture (I or P picture) that exists before the designated time and is closest to the reproduction time. Prepare as a position.
[0053]
Next, the microcomputer block 30 determines an overwriting picture to be rewritten as a new image (step S3). This determines an image to be reproduced first as an overwrite picture at the edit point X0 from the overwrite start position (in the case of audio, an access unit is determined).
[0054]
That is, in FIG. 5, the overwriting picture is determined to be B3, which is the first picture to be reproduced from the P5 picture that is the overwriting start position to the starting editing point X0.
[0055]
Next, the microcomputer block 30 executes the replacement from P5 to VOBU_5 up to the final frame using the overwriting picture determined in step S3 (step S4).
[0056]
Specifically, in FIG. 5A, if the P5 picture is the overwrite start position and B3 is the overwrite picture, the picture of P5 to B7 is replaced so that the B3 picture is reproduced. .
[0057]
Here, the P5 picture refers to the I2 reference picture and the difference is created as a P5 picture. Therefore, the microcomputer block 30 compares the image data of I2 and B3, and creates the difference as a new P′5. Then, the position of P5 is replaced with a new picture of P′5. In this way, P′5 reproduces the same image as the image from which the original B3 as the overwrite picture was reproduced at the time of reproduction.
[0058]
Similarly, since the B3 picture is reproduced with reference to the P5 and I2 pictures, the microcomputer block 30 calculates the difference between these images and the overwritten picture B3, and creates a new picture B Create '3 and replace it with the position of B3.
[0059]
Similarly, since the B4 picture is reproduced with reference to the P5 and I2 pictures, a new picture B′4 is created so that the same picture as B4 is reproduced with reference to these pictures. This is replaced with the position B4.
[0060]
Thereafter, the picture is replaced for each reference picture unit (3 frame units) using the same method as described above, and the VOBU is rewritten as shown in FIG. 5B.
[0061]
FIG. 7 shows this in units of VOBU. 5A, if I2 to B7 are VOBU_3 in FIG. 7A, FIG. 5A shows P′5, so that the same image as the original B3 is reproduced after P5. B'3 and the overwriting picture are successively replaced as shown in FIG. 5B. Accordingly, the point X0 (starting editing point) in FIG. 7A is replaced with the overwriting picture as shown in FIG. 7B, and finally the same image as B3 is reproduced until the last image of VOBU_5. Thus, the image is replaced.
[0062]
Here, since deleting data in units of VOBU is an operation that can be performed by a conventional editing apparatus, in FIG. 7 (a), it is possible to delete VOBU_4 completely first, and then to If the invention is used, as a result, unnecessary portions are deleted as shown in FIG. 7C, and the space between programs is replaced so that the same image as the overwriting picture in BOBU_3 is reproduced. It becomes.
[0063]
By taking the above measures, the unnecessary part is shortened as much as possible, and the remaining part has overwriting data, so even if that part is continued, you can watch it without feeling uncomfortable between programs Is possible.
[0064]
Next, the microcomputer block 30 confirms whether there is a conversion request from the VR format to the Video format through the key input unit 11 (step S5). That is, it is checked whether or not there is a definite input for format conversion.
[0065]
As a result, when there is no conversion request (No in step S5), the processing ends as it is.
On the other hand, if there is a conversion request (Yes in step S5), the encoder unit 50 performs format conversion from DVD-VR to DVD-Video (step S6). The converted data is recorded on the optical disc 10 using the disc drive 35 via the data processor 36. Note that details of the conversion from the VR format to the DVD-Video format have been introduced in, for example, Japanese Patent Application Laid-Open No. 2003-101927, and a description thereof will be omitted.
[0066]
By using the editing apparatus and editing method as described above, the following effects can be obtained. In other words, when the edited data is played back, the user does not see a completely different image such as a CM (advertising) between the programs. Conventionally, although it is a few seconds of commas, It becomes possible to eliminate the part that was felt as incomplete editing.
[0067]
As a modification of the embodiment of the present invention, the overwriting picture described above is not necessarily limited to the B3 picture shown in the example of FIG. 5, but is an image reproduced immediately before B3 (ie, here. I2 picture). In addition, since the purpose is to prevent the image from changing extremely as in the case of a commercial or the like, an image in which a human does not feel uncomfortable visually (for example, a single color image such as a black or white image). ) May be used as an overwriting picture. Further, several overwrite picture candidates from the recorded MPEG program stream may be displayed on the display device, and one of them may be arbitrarily selected by the user and used as the overwrite picture.
[0068]
【The invention's effect】
According to the present invention, it is possible to reproduce a continuous image without a sense of incongruity by writing a picture for overwriting on an area of unnecessary data between programs.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of an editing apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram showing a directory structure of video and audio files in a VR format of a DVD.
FIG. 3 is a diagram illustrating file structures of a movie video file and a still picture video file.
FIG. 4 is a diagram for explaining a GOP.
FIG. 5 is a diagram illustrating a picture configuration and editing points.
FIG. 6 is a flowchart showing an editing method according to the embodiment of the present invention.
FIG. 7 is a diagram showing before and after conversion of stream data.
[Explanation of symbols]
1 Editing device
10 Optical disc
11 Key input part
20 Hard disk drive (HDD)
30 Microcomputer block
35 disk drive
36 data processor
37 Temporary storage
38 STC
42 A / V input section
44 TV tuner
48 display
50 Encoder unit
52 ADC
53 V, A, SP encoder group
56 Formatter
57 Buffer memory
60 Decoder part
62 Separator
63 memory
64 V, A, SP decoder group
66 Video processor
71 Video Mixer
73 I / F
74 DAC
75 I / F
76 selector
77 DAC

Claims (5)

In a method for editing video data recorded as an MPEG program stream,
Receiving an editing start point for starting editing of the video data, and an editing end point for ending editing;
A reference picture that exists before the edit start point and is closest to the edit start point is set as an overwrite start position;
A picture to be reproduced first among pictures existing between the overwrite start position and the edit start point is used as an overwrite picture;
A step of replacing all the pictures from the overwriting start position to the video object unit where the editing end point exists with an image in which the same image as the overwriting picture is reproduced. In an editing apparatus for editing video data recorded as an MPEG program stream,
Means for inputting an editing start point for starting editing of the video data, and an editing end point for ending editing;
Overwrite start position determining means for determining a reference picture that exists before the edit start point and is closest to the edit start point as an overwrite start position;
Overwriting picture determination means for setting a picture to be reproduced first among pictures existing between the overwriting start position and the editing start point as an overwriting picture;
An editing apparatus comprising: means for replacing all pictures from the overwriting start position to the video object unit where the editing end point exists with an image in which the same image as the overwriting picture is reproduced. 3. The editing apparatus according to claim 2, wherein the overwriting picture determination unit sets an image reproduced immediately before the previous overwriting picture as an overwriting picture. The editing apparatus according to claim 2, wherein the overwriting picture determination unit uses a single color as an overwriting picture. 3. The editing apparatus according to claim 2, wherein the overwriting picture determination means includes means for selecting an arbitrary image from the data conforming to the MPEG standard as an overwriting picture.

Images