JP2008124932A - Nonlinear editing device and program thereof, and data replacing method of nonlinear editing device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a nonlinear editing device capable of replacing a specified part of stream data at a high speed. <P>SOLUTION: The nonlinear editing device 1 includes an encoding means 23 of performing in-frame encoding of respective frames of raw material data, a dummy data adding means 24 of adding dummy data so that the data length of the encoded frames generated by the encoding means is a predetermined data length, an alteration section search means 31 of searching the stream data composed of the encoded frames to which the dummy data are added for absolute positions of frames in an alteration section based upon editing data indicating relative positions of the frames in the alteration section and the predetermined data length, and a replacing means 33 of replacing stream data between the frames corresponding to the alteration section with replacing data for alteration. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a non-linear editing apparatus and program for editing video material data, and a data replacement method in the non-linear editing apparatus.

In recent years, video and audio editing has been performed by playing back a tape on which video or the like has been recorded, copying the desired location to another tape, writing the video or the like as digital data in a storage device such as a hard disk, Shifting to non-linear editing that is performed by a computer.
This non-linear editing device performs operations such as “copy”, “cut”, “paste”, etc. on the GUI (Graphical User Interface) of a computer terminal by the operator using a non-linear editing device for performing non-linear editing. By doing the above, edit data composed of the start point and end point of video and the like is created. Then, when reproducing the edited video or the like, the nonlinear editing device reads and outputs the video or the like between a desired start point and end point from the storage device based on the edited data. Thus, the non-linear editing can reduce the time required for the editing as compared with the linear editing.
The video is generally data compression-coded in MPEG2 (Moving Picture Coding Experts Group 2) format. For example, in the HDV (digital high definition video) standard for recording and reproducing digital high-definition video, the MPEG2 Long GOP method is adopted.

  Conventionally, when editing video material data, a nonlinear editing apparatus generates a single main stream data (main stream data) used for broadcasting, for example, by combining a plurality of cuts. is doing. That is, the conventional nonlinear editing apparatus generates one stream data by reproducing the material data for each cut point (start point / end point).

Here, the MPEG2 encoding format will be briefly described with reference to FIG. FIG. 7 is a block diagram showing the structure of MPEG2 stream data.
As shown in FIG. 7, MPEG2 stream data includes 6 “sequence layer”, “GOP (Group of Picture) layer”, “picture layer”, “slice layer”, “macroblock layer”, and “block layer”. Consists of layers. Here, the GOP is composed of one or more pictures and includes an I picture (intra-frame encoded image) that is encoded without using a reference image. Further, the GOP includes a P picture (inter-frame encoded image) that is predictively encoded from a picture that is temporally located in the past, and a B picture that is predictively encoded from pictures that are temporally located in the past and the future ( Bidirectional encoded images) are also included.
Thus, in a coding method that performs predictive coding such as MPEG2, each picture in the GOP is not independent, and in principle, editing such as replacement cannot be performed in units of pictures. Thus, a technique for changing the picture configuration in the GOP when replacing a picture has been disclosed (see Patent Document 1).
JP 09-238347 A

However, in the conventional non-linear editing apparatus, a plurality of cuts are combined to generate one main stream data (physical file). Therefore, if the replacement of a specific part of the video occurs after editing, the main stream data is again converted to the entire main stream data. There is a problem that it takes time to edit.
In addition, when replacing a specific part of a desired video, the technique for changing the picture configuration in the GOP disclosed in Patent Document 1 is requested from the beginning of stream data in order to search for a picture (frame) to be replaced. There is a problem that it takes a long time to replace the picture.

  The present invention has been made to solve the above-described problems. When a specific portion of stream data is replaced, an edited file (main stream data) once generated is regenerated again over the entire program. It is an object of the present invention to provide a non-linear editing device and a program for the same, and a data replacement method in the non-linear editing device.

  The present invention was devised to achieve the above object. First, the nonlinear editing apparatus according to claim 1 is a non-linear editing apparatus for editing video material data. An adding unit, a storage unit, a change section search unit, and a replacement unit are provided.

  In such a configuration, the nonlinear editing apparatus generates an encoded frame by performing intra-frame encoding on each frame of the material data by the encoding means. Here, unlike intra-frame coding, intra-frame coding is coding based on only data in the frame. For example, in the MPEG2 encoding method, this intraframe encoding corresponds to an encoding method for generating an I frame (picture) by encoding a frame in units of macroblocks. As a result, each encoded frame is encoded independently of (not affected by) other frames.

Then, the nonlinear editing device adds dummy data to the encoded frame by the dummy data adding unit so that the data length of the encoded frame generated by the encoding unit becomes a predetermined specified data length. As a result, the data lengths of the encoded frames are all unified to the same length.
Then, the non-linear editing apparatus stores stream data composed of encoded frames to which dummy data is added in the storage unit.

Further, the non-linear editing device searches for the absolute position of the frame in the change section in the stream data based on the edit data indicating the relative position of the frame in the change section in the stream data and the specified data length by the change section search means. . In this case, since the data length of the encoded frame is a predetermined specified data length (fixed length), the absolute position of the frame in the changed section is obtained by calculating (multiplying) the specified data length and the frame number. be able to.
Then, the non-linear editing device replaces the stream data between frames corresponding to the change section searched by the change section search means with replacement data for change. In this case, since the stream data is encoded independently for each frame, even if partial replacement is performed, the frames before and after the changed section are not affected.

  The nonlinear editing apparatus according to claim 2 is the nonlinear editing apparatus according to claim 1, wherein the material data is encoded data encoded by a motion prediction encoding method, and the encoding unit includes: In the preceding stage, a configuration is further provided with a frame generation means for generating an image in units of frames from the encoded data.

  In such a configuration, the nonlinear editing apparatus generates an image for each frame by decoding the encoded data encoded by the motion predictive encoding method by the frame generation unit. As a result, even if the frames are correlated and encoded by a motion predictive encoding method such as MPEG2, the frames can be separated.

  The non-linear editing program according to claim 3 functions as a coding means, a dummy data adding means, a change section searching means, and a replacing means in order to edit the video material data in the non-linear editing apparatus. It was set as the structure made to do.

In such a configuration, the nonlinear editing program generates an encoded frame by performing intra-frame encoding on each frame of the material data by the encoding means. As a result, each encoded frame is encoded independently of the other frames.
Then, the non-linear editing program adds dummy data to the encoded frame by the dummy data adding unit so that the data length of the encoded frame generated by the encoding unit becomes a predetermined specified data length. As a result, the data lengths of the encoded frames are all unified to the same length.

Then, the non-linear editing program uses the change section search means in the stream data composed of the encoded frame to which the dummy data is added based on the edit data indicating the relative position of the frame in the change section and the specified data length. The absolute position of the frame in the changed section is searched.
Then, the non-linear editing program replaces the stream data between frames corresponding to the changed section searched by the changed section searching means by the replacing means with replacement data for change.

  Further, the data replacement method in the nonlinear editing device according to claim 4 is a method of performing partial replacement on stream data generated by editing video material data, wherein the encoding step includes: The procedure includes a dummy data addition step, a change interval search step, and a replacement step.

In this procedure, the data replacement method generates an encoded frame by performing intra-frame encoding on each frame of the material data by the encoding means in the encoding step. As a result, each encoded frame is encoded independently of the other frames.
Then, in the dummy data adding step, the data replacement method includes a dummy data adding unit that performs dummy processing on the encoded frame so that the data length of the encoded frame generated by the encoding unit becomes a predetermined specified data length. Append data. As a result, the data lengths of the encoded frames are all unified to the same length.

The data replacement method is an encoded frame to which dummy data is added based on the edit data indicating the relative position of the frame in the changed section and the specified data length by the changed section search means in the changed section search step. In the configured stream data, the absolute position of the frame in the changed section is searched.
In the data replacement method, in the replacement step, the replacement means replaces the stream data between frames corresponding to the changed section searched by the changed section search means with the replacement data for change.

The present invention has the following excellent effects.
According to the invention of claim 1, claim 3 or claim 4, when replacing the specific part of the stream data, the edited stream data once generated can be replaced again without regenerating the entire program. It can be carried out. Further, according to the present invention, since the position of the frame of the specific portion can be obtained by calculation, it is not necessary to search for a desired frame from the head of the stream data, and the editing operation can be performed at high speed.

  According to the second aspect of the present invention, even if the encoded data is encoded by the motion predictive encoding method, it can be replaced at high speed by generating stream data composed of frames having the same data length. Can be edited.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[Functional overview of nonlinear editing equipment]
First, an outline of functions of the nonlinear editing apparatus will be described with reference to FIGS. 1 and 2. FIG. 1 is an explanatory diagram for explaining a function of generating independent stream data for each frame by intra-frame encoding each frame of material data in the nonlinear editing apparatus according to the embodiment of the present invention. . FIG. 2 is an explanatory diagram for explaining a function of replacing a specific portion of stream data independent for each frame in the nonlinear editing apparatus according to the embodiment of the present invention.

As shown in FIG. 1, the non-linear editing device 1 has a function of converting video material data into stream data (main stream data) composed only of intra-frame encoded images independently encoded within a frame ( I-frame function).
Specifically, the I frame thus converted is configured by adding a sequence header and a GOP header. As a result, each frame becomes an independent image as an intra-frame encoded image. The non-linear editing apparatus 1 also has a function of adding dummy data so that each frame has the same data length.

As shown in FIG. 2, the nonlinear editing apparatus 1 has a function (replacement function) of replacing a specific part in the main stream data converted into an I frame. In the main stream data converted into I frames, since each frame is encoded independently, even when a specific portion (for example, frames I _{3 to} I _{7 in} FIG. 2) is replaced, The desired main stream data is generated by replacing only the replacement part without affecting the preceding and subsequent frames (frames I ₂ and I _{8 in} FIG. 2).
Hereinafter, the configuration of the nonlinear editing apparatus 1 that realizes this function will be described in detail.

[Configuration of nonlinear editing device]
Here, the configuration of the nonlinear editing apparatus according to the embodiment of the present invention will be described with reference to FIG. FIG. 3 is a block diagram showing the configuration of the nonlinear editing apparatus according to the embodiment of the present invention. The nonlinear editing apparatus 1 includes a storage unit 10, a stream data generation unit 20, and a stream replacement unit 30. It should be noted that, here, illustrations of editing means and display means for realizing a GUI for editing operations such as “copy”, “cut”, “paste” and the like provided in a general nonlinear editing apparatus are omitted. Yes.

The storage unit 10 stores material data to be edited and main stream data that is edited data, and is a general storage device such as a hard disk.
Note that the material data is data that is taken by a camera and used as a broadcast program. Here, it is assumed that the material data is stored in the storage unit 10 via an input unit (not shown). The main stream data is data in which a plurality of material data is edited by operations such as “copy”, “cut”, “paste”, and combined for one broadcast program.

  The stream data generation means 20 generates the main stream data from the material data based on the edit data (first edit data), and implements the I-frame conversion function described with reference to FIG. Here, the stream data generation unit 20 includes a frame image generation unit 21, a frame image analysis unit 22, an encoding unit 23, and a dummy data addition unit 24.

The frame image generation means (frame generation means) 21 generates an image for each frame from the material data stored in the storage means 10 (or input from the outside) based on the edit data (first edit data). To do.
Here, when the material data is input from the outside as a video signal, the frame image generation means 21 captures the video in a frame unit in a memory or the like (not shown) and generates a frame image. In addition, when the material data is encoded by a motion predictive encoding method such as MPEG2, the frame image generation means 21 generates a frame image by decoding in units of frames.

  The edit data (first edit data) includes cut points (in and out points) indicating the start point and end point of the video, text to be combined with a predetermined video section of the video, and effects on the video in the video section. (Fade, wipe, dissolve, etc.) Although the editing data is input from the outside here, it may be input via editing means (not shown) in the nonlinear editing apparatus 1.

  Here, the frame image generation means 21 generates a single frame image by synthesizing text for each frame or converting the frame into an effected frame based on the editing data. The frame image generated by the frame image generation unit 21 is output to the frame image analysis unit 22 and the encoding unit 23.

The frame image analysis unit 22 analyzes the frame image generated by the frame image generation unit 21 and encodes the encoding parameter (the encoding data length when encoded by the encoding unit 23 is equal to or less than the prescribed data length). Compression ratio). For example, the frame image analysis means 22 can use a quantization scale used in MPEG2 or the like as the compression rate. In MPEG2, a frame is encoded on a macroblock basis. The quantization scale indicates the compression rate of each macroblock. The smaller the value, the lower the compression rate, and the higher the value, the higher the compression rate.
The encoding parameter (compression rate; here, the quantization scale) determined by the frame image analysis unit 22 is output to the encoding unit 23.
The method for obtaining the compression rate (quantization scale) in the frame image analysis means 22 will be specifically described later.

The encoding unit 23 generates an encoded frame by intra-frame encoding the frame image generated by the frame image generation unit 21 based on the encoding parameter (compression rate) analyzed by the frame image analysis unit 22. Is.
Here, when MPEG2 is used as the encoding method and the quantization scale is notified as the compression rate from the frame image analysis means 22, the encoding means 23 makes the quantization finer as the quantization scale is smaller. The larger the value is, the coarser the quantization is, and encoding is performed in units of macroblocks. As a result, the frame image is generated as an intra-frame encoded image (encoded frame) encoded independently of the other frames, and can be replaced individually.

Furthermore, when MPEG2 is used as the encoding method, the encoding means 23 adds a sequence header and a GOP header for each encoded frame (intra-frame encoded image, I picture) (see FIG. 1). As a result, in the intra-frame encoded image, one I picture is managed by one GOP in MPEG2.
The frame image (encoded frame) encoded by the encoding unit 23 is output to the dummy data adding unit 24.

  The dummy data adding means 24 adds dummy data of a data length difference between a predetermined specified data length and an encoded frame for each encoded frame encoded by the encoding means 23. Here, when the data length of the encoded frame is longer than the specified data length, the encoding unit 23 resets the compression rate by notifying the encoding unit 23 to that effect, and again, Encoding is performed. The encoded frame to which the dummy data is added is stored as main stream data in the storage unit 10. As the dummy data, a value “0” recommended in MPEG2 or the like is used. As a result, each frame is managed with the same data length including dummy data.

  The stream replacement means 30 replaces a specific part of the main stream data with other stream data based on the edit data (second edit data), and implements the replacement function described in FIG. Here, the stream replacement unit 30 includes a change section search unit 31, a replacement data generation unit 32, and a replacement unit 33.

  The change section searching means 31 is based on the edit data (second edit data) indicating the relative position of the frame in the change section, and the absolute position (address) of the frame in the section (change section) to be changed in the main stream data. Is to search. In addition to the information indicating the change section of the main stream data, the edit data also includes information indicating the change instruction content (rendering, etc.) and the cut point of the material data that is the source of the change. Note that the change section is relatively specified in the stream data by a frame number or the like for specifying individual frames.

Here, since the main stream data has the same specified data length for each frame, when the frame number is designated as the changed section, the change section search means 31 is a multiple of the frame number with respect to the specified data length. By performing this calculation, position information (absolute position [address]) of a desired frame can be obtained.
For example, when the specified data length is L _CONST and the frame number is F _NUM (0 to N), the frame position information (address) AD is the specified data length and frame number as shown in the following equation (1). Can be obtained by multiplication with

AD = F _NUM × L _CONST (1)

  Then, the changed section search unit 31 outputs the searched position information (address) to the replacement data generation unit 32 and the replacement unit 33. Further, the change section search unit 31 outputs the change instruction content to the replacement data generation unit 32.

  The replacement data generating means 32 generates data (replacement data) for replacing the change section of the main stream data based on the content of the change instruction instructed by the edit data. Here, the replacement data generating unit 32 includes a section video extracting unit 32a and a section video generating unit 32b.

  The section video extraction unit 32 a extracts a section video corresponding to the changed section searched by the changed section search unit 31 from the material data stored in the storage unit 10. If the change instruction content instructed by the edit data is only replacement of the section video, the section video extraction unit 32 a outputs the extracted section video (replacement data) to the replacement unit 33. On the other hand, when the change instruction content instructed by the edit data needs to perform rendering processing on the section video, the section video extraction unit 32a outputs the extracted section video (replacement data) to the section video generation unit 32b. To do.

The section video generation unit 32b generates a replacement video (replacement data) by editing the section video extracted by the section video extraction unit 32a based on the change instruction content. For example, when adding text to the section video, the section video generation unit 32b combines the text with the video based on information such as a character string, a character type, and a display position indicated by the change instruction content. Generate replacement data.
In addition to the text synthesis, the section video generation unit 32b generates replacement data by performing rendering processing such as fade, wipe, dissolve, etc. on the section video based on the change instruction content. The replacement data generated in this way is output to the replacement means 33.

The replacement means 33 replaces the video (section stream data) of the change section of the main stream data searched by the change section search means 31 with the replacement data generated by the replacement data generation means 32, so that a new post-replacement data is obtained. Main stream data is generated.
Since the main stream data is composed only of the intra-frame coded image (I picture), even if only the changed section is replaced, the video before and after that is not affected.

  By configuring the non-linear editing apparatus 1 as described above, the non-linear editing apparatus 1 can convert the material data into stream data (main stream data) configured only by intra-frame encoded images (I frames). . Furthermore, the non-linear editing apparatus 1 can generate new main stream data by replacing the specific part without reconstructing the main stream data by configuring the main stream data only with the intra-frame encoded image. it can.

(How to determine the compression ratio performed by frame image analysis means)
Here, an example of a compression rate (quantization scale) determination method performed by the frame image analysis unit 22 will be specifically described using mathematical expressions. In MPEG2, encoding is performed by dividing a frame into 16-pixel × 16-pixel blocks called macroblocks. The macroblock is further divided into four sub-blocks each having a size of 8 pixels × 8 pixels and is used for encoding. Hereinafter, a procedure (procedure 1 to procedure 3) in which the frame image analysis unit 22 determines a quantization scale for each macroblock will be described.

[Procedure 1: Determination of initial value of quantization scale]
First, the frame image analysis means 22 determines the initial value of the quantization scale of the encoding target frame.
Specifically, the frame image analysis means 22 calculates the quantization scale mquant _j of the _jth macroblock by the following equation (2).

Q is a quantization parameter, and N_act _j is a normalization coefficient (normalization activity).
Here, the quantization parameter Q is calculated by the following equation (3).

Note that d is the encoded data length of one macroblock, and r is a coefficient (reaction parameter) for quantization.
Here, when the target specified data length (target encoded data length) is T, and the number of macroblocks in one frame is MB_cnt, the encoded data length d in the above equation (3) is the following (4) Calculated by the formula.

  Further, when the bit rate is bit_rate and the picture rate is picture_rate, the coefficient r in the equation (3) is calculated by the following equation (5).

Further, the normalized activity N_act _{j in the} equation (2) is calculated by the following equation (6).

Here, avg_act is an average value of act _j of all macroblocks. Act _j is an amount indicating the complexity of the j-th macroblock, and is calculated by the following equation (7).

Note that min (...) Is a function for obtaining the minimum value of elements in parentheses. Further, VBLK _n is a quantity that indicates the complexity of the n-th sub-block, when the luminance value of the k-th pixel of the sub block P ⁿ _k, is calculated by the following equation (8).

P_mean _n is the luminance average value of the n-th sub-block shown in the following equation (9).

[Procedure 2: Prediction of encoded data length after encoding]
Usually, even if encoding is performed with the quantization scale determined in step 1, the encoded data length may not fit within the specified data length depending on the frame. Therefore, the frame image analysis unit 22 predicts the encoded data length by performing encoding with a low processing load on the frame and calculating the encoded data length. There are various methods for calculating the encoded data length. For example, a macroblock in a frame is selected at a fixed interval, and only the selected macroblock is encoded to encode the encoded data length (prediction). (Encoded data length) can be estimated.

  Specifically, the frame image analysis means 22 performs encoding by selecting a macro block for every 8 blocks in the vertical and horizontal directions of the frame. Since this encoded data length corresponds to 1/64 of the encoded data length of all frames, the frame image analysis means 22 multiplies the encoded data length by 64 to predict the entire frame. Calculate the encoded data length.

[Procedure 3: Evaluation of prediction encoded data length]
As a result of the procedure 2, when the predicted encoded data length is longer than the specified data length, when the frame is actually encoded, there is a high possibility that the encoded data length exceeds the specified data length. Therefore, since it is necessary to further increase the compression rate in order to make the encoded data length equal to or less than the specified data length, the frame image analysis unit 22 increases the quantization scale and performs the process of the above-described procedure 2 again.
By the above procedure (procedure 1 to procedure 3), the frame image analysis means 22 can obtain the compression rate (quantization scale) that is predicted that the encoded data length is equal to or less than the specified data length.

[Operation of non-linear editing device]
Next, the operation of the nonlinear editing apparatus according to the embodiment of the present invention will be described with reference to FIGS. Here, the operation when realizing the I-frame conversion function of material data and the replacement function of the main stream data converted into the I-frame, which are features of the nonlinear editing apparatus of the present invention, will be described. FIG. 4 is a flowchart showing an operation when realizing the I-frame conversion function of the nonlinear editing apparatus according to the embodiment of the present invention. FIG. 5 is a flowchart showing an operation when realizing the replacement function of the nonlinear editing apparatus according to the embodiment of the present invention.

(Operation of I-frame function)
First, referring to FIG. 4 (for the configuration, refer to FIG. 3 as appropriate), the operation in which the nonlinear editing apparatus 1 converts material data into I frames will be described.
First, the nonlinear editing apparatus 1 generates an image (frame image) for each frame from the material data by the frame image generation means 21 (step S1). At this time, the frame image generating means 21 performs editing such as text synthesis if necessary based on the editing data (first editing data).
Further, the nonlinear editing apparatus 1 analyzes the frame image generated in step S1 by the frame image analysis unit 22, and the encoded data length when encoded by the encoding unit 23 is equal to or less than the specified data length. Such an encoding parameter (compression rate) is determined (step S2).

Then, the nonlinear editing apparatus 1 encodes the frame image generated in step S1 by the encoding unit 23 based on the encoding parameter (compression rate) determined in step S2 (step S3; encoding step). . At this time, the encoding means 23 generates an encoded frame (intra-frame encoded image, I frame) by encoding the frame image independently within the frame.
Then, the nonlinear editing apparatus 1 determines whether or not the data length of the encoded frame generated (encoded) in step S3 is equal to or less than a predetermined data length (specified data length) by the dummy data adding unit 24. (Step S4).

  Here, when the data length of the encoded frame is longer than the prescribed data length (No in step S4), the encoding means 23 adjusts the encoding parameter (step S5). Note that the compression rate is reset to a higher value by adjusting the encoding parameter in step S5. Then, the nonlinear editing apparatus 1 returns to step S3 and again encodes the frame image.

On the other hand, when the data length of the encoded frame is equal to or less than the specified data length (Yes in step S4), the dummy data adding unit 24 adds dummy data of the data length difference between the specified data length and the encoded frame to the encoded frame. Is added and output (step S6; dummy data adding step). Thus, by adding dummy data, the data length of each encoded frame is unified to the same length.
It should be noted that the generated encoded frames are continuously configured to become main stream data. The output destination of the main stream data is the storage unit 10 here, but may be output to the outside.

Then, the nonlinear editing device 1 determines whether or not the processing for all the frames has been completed (step S7). When the processing for all the frames is completed (Yes in step S7), the nonlinear editing device 1 ends the operation. On the other hand, if there is a frame that has not been processed yet (No in step S7), the nonlinear editing apparatus 1 returns to step S1 and continues its operation.
With the above operation, the nonlinear editing apparatus 1 can generate main stream data of only a fixed-length intraframe encoded image (I frame) from material data.

(Operation of the replacement function)
Next, referring to FIG. 5 (refer to FIG. 3 as appropriate for the configuration), the operation in which the nonlinear editing apparatus 1 replaces the main stream data will be described.
First, the non-linear editing device 1 uses the change section search unit 31 to change the section (change section) to be changed in the main stream data based on the edit data (second edit data) including the change instruction content, and The original material data section corresponding to the section is searched (step S21; change section searching step).

Then, when there is a change section (Yes in Step S22), the nonlinear editing device 1 executes a replacement process after Step S23. On the other hand, when there is no change section (or when all the changes are completed; No in step S22), the operation ends.
If the non-linear editing device 1 determines that a change section exists in step S22, the replacement data generation unit 32 needs to render the change section based on the change instruction content instructed by the edit data. It is determined whether or not (step S23).

Here, when rendering is necessary (Yes in step S23), the nonlinear editing apparatus 1 extracts the section video for the changed section from the material data stored in the storage unit 10 by the section video extraction unit 32a. Furthermore, replacement data is generated by performing rendering processing such as text synthesis, fade, wipe, dissolve, etc., on the section video by the section video generation means 32b (step S24).
On the other hand, when rendering is not necessary for the changed section (No in step S23), the nonlinear editing apparatus 1 replaces the section video for the changed section from the material data stored in the storage unit 10 by the section video extracting unit 32a. Extracted as data (step S25).

Then, the non-linear editing apparatus 1 replaces the stream data in the changed section of the main stream data searched in step S21 with the replacement data generated in step S24 or step S25 by the replacement unit 33 (step S26; replacement step). .
Then, the nonlinear editing apparatus 1 returns to step S1 and repeats the replacement operation while there is a change section.
With the above operation, the nonlinear editing apparatus 1 does not need to regenerate the main stream data from the beginning based on the material data, and can generate the main stream data by replacing the partial section video.

[Example of editing with a non-linear editing device]
Next, with reference to FIG. 6 (refer to FIG. 3 as appropriate), the editing operation of the nonlinear editing apparatus according to the embodiment of the present invention will be described in association with a screen example. 6A and 6B are explanatory diagrams for explaining an editing operation of the nonlinear editing apparatus according to the embodiment of the present invention, in which FIG. 6A is a screen example during editing, FIG. 6B is a main stream data generation procedure, c) is an example of a screen after editing.

The non-linear editing apparatus 1 displays an editing screen having a GUI as shown in FIG.
The editing screen includes, for example, a video display area M for reproducing and displaying video, a plurality of editing buttons B for performing editing operations, an editing time axis display area L in which titles, video, and audio are associated with the time axis. Etc. are displayed. FIG. 6A shows an example in which a title (here, “XX flowers bloomed at Mr. XX's house”) is synthesized with a video on a certain time axis.
In such an editing stage, the material data is managed for each cut point C of the material data as shown in (b-1) of FIG.

The nonlinear editing apparatus 1, by being pressed Export button B _W in FIG. 6 (a), as shown in FIG. 6 (b) (b-2) , on the basis of the material data to the cut point one The main stream data is generated in which all frames are converted into I frames.

Here, it is assumed that an error is found in the edited content after editing, and it is necessary to re-edit the main stream data. Here, as an example, it is assumed that there is an error in the title, and “Mr. XX” is actually “Mr. △ Δ”.
In this case, as shown in (b-3) of FIG. 6B, the change request title “I bloomed at Mr. Δ △ 's house” is input to the nonlinear editing apparatus 1 as editing data. .

Then, nonlinear editing apparatus 1, by being pressed the replacement button B _C of FIG. 6 (a), as shown in FIG. 6 (b) (b-4) , sectional images corresponding to the changed title The main stream data is regenerated by replacing only.
As a result, the nonlinear editing apparatus 1 generates main stream data in which only the title is changed, as shown in FIG.

The configuration and operation example of the nonlinear editing apparatus according to the embodiment of the present invention have been described above, but the present invention is not limited to this.
For example, here, the nonlinear editing apparatus 1 (see FIG. 3) generates the main stream data as an I frame having the same data length by adding dummy data after encoding the frame. Only dummy data may be added and dummy data may not be added. In this case, the nonlinear editing apparatus 1 is configured by omitting the dummy data adding means 24. Even in this case, the non-linear editing apparatus 1 can perform replacement without affecting the previous and subsequent frames when performing partial replacement because each frame is encoded independently. . However, since each frame does not have the same data length, it is desirable that the I frame has the same data length in order to reduce the time required for the search for the changed section in the changed section search means 31.

  The non-linear editing apparatus 1 can be configured by a general computer including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. (not shown). It can be operated by a nonlinear editing program that functions as each means.

It is explanatory drawing for demonstrating the function which produces | generates the independent stream data for every flame | frame in the nonlinear editing apparatus which concerns on embodiment of this invention. It is explanatory drawing for demonstrating the function to replace the specific part of the independent stream data for every flame | frame in the nonlinear editing apparatus which concerns on embodiment of this invention. It is a block block diagram which shows the structure of the nonlinear editing apparatus which concerns on embodiment of this invention. It is a flowchart which shows the operation | movement at the time of implement | achieving the I frame-izing function of the nonlinear editing apparatus which concerns on embodiment of this invention. It is a flowchart which shows the operation | movement at the time of implement | achieving the replacement function of the nonlinear editing apparatus which concerns on embodiment of this invention. It is explanatory drawing for demonstrating the edit operation | movement of the nonlinear editing apparatus which concerns on embodiment of this invention, (a) is the example of a screen at the time of editing, (b) is the production | generation procedure of main stream data, (c) is editing It is a later screen example. It is a block diagram which shows the structure of the stream data of MPEG2.

Explanation of symbols

1 Nonlinear Editing Device 10 Storage Unit 20 Stream Data Generation Unit 21 Frame Image Generation Unit (Frame Generation Unit)
22 Frame image analysis means 23 Encoding means 24 Dummy data addition means 30 Stream replacement means 31 Change section search means 32 Replacement data generation means 32a Section video extraction means 32b Section video generation means 33 Replacement means

Claims (4)

In a non-linear editing device that edits video material data,
Encoding means for generating an encoded frame by performing intra-frame encoding for each frame of the material data;
Dummy data adding means for adding dummy data to the encoded frame so that the data length of the encoded frame generated by the encoding means becomes a predetermined specified data length;
Storage means for storing stream data composed of encoded frames to which dummy data is added by the dummy data adding means;
A change section search means for searching for an absolute position of a frame of the change section based on edit data indicating a relative position of the frame of the change section in the stream data and the specified data length;
Replacement means for replacing stream data between frames corresponding to the change section searched by the change section search means with replacement data for change;
A non-linear editing apparatus comprising: The material data is encoded data encoded by a motion predictive encoding method,
The nonlinear editing apparatus according to claim 1, further comprising a frame generation unit that generates an image in a frame unit from the encoded data before the encoding unit. In a non-linear editing device, a computer is used to edit video material data.
Encoding means for generating an encoded frame by performing intra-frame encoding for each frame of the material data;
Dummy data adding means for adding dummy data to the encoded frame so that the data length of the encoded frame generated by the encoding means is a predetermined specified data length;
Based on the edit data indicating the relative position of the frame in the changed section and the specified data length, the absolute position of the frame in the changed section is searched in the stream data composed of the encoded frame to which the dummy data is added. Change section search means to
Replacement means for replacing stream data between frames corresponding to the changed section searched by the changed section search means with replacement data for change;
Non-linear editing program characterized by functioning as A data replacement method in a nonlinear editing apparatus that performs partial replacement on stream data generated by editing video material data,
An encoding step of generating an encoded frame by performing intra-frame encoding for each frame of the material data by an encoding means;
A dummy data adding step of adding dummy data to the encoded frame so that the data length of the encoded frame becomes a predetermined specified data length by the dummy data adding means;
Based on the edit data indicating the relative position of the frame in the change section and the specified data length by the change section search means, stream data composed of encoded frames to which the dummy data is added, A change section search step for searching for an absolute position of the frame;
A replacement step of replacing stream data between frames corresponding to the changed section searched by the changed section searching means by replacement means with replacement data for change;
A data replacement method in a non-linear editing apparatus, comprising:

Images