JP2007049653A - Motion image editing apparatus and method thereof, program and storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a motion image editing apparatus and a method thereof which can reduce processing load of editing reproducing processing in the editing reproducing in motion image editing, and can store an editing result without omission in editing storing processing, and to provide a program and a storage medium. <P>SOLUTION: The motion image editing apparatus edits compression-coded motion image signals. The motion image editing apparatus is provided with a setting unit for setting attribute information about the motion image signals, a decoding unit for decoding the motion image signals based on the set attribute information, and a reproducing and storing unit for reproducing and storing the decoded motion image signals. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a moving image editing apparatus and method, a program, and a storage medium.

  With the spread of digital video cameras and digital cameras with video shooting functions, opportunities to view moving image signals in general households and businesses are increasing. At the same time, interest in moving image editing processing for editing moving image signals is increasing, and many moving image editing applications are sold.

  In general, a moving image signal has a larger capacity than a still image, and when editing these moving image signals, it is desired to add some image effect to the original image, which increases the load on the processing apparatus. This may impair real-time performance during video playback. In addition, since the PC, which is the operating environment of these video editing applications, shares limited hardware resources among a plurality of applications, the increase in processing load of the video editing processing occupies the CPU, and other applications Control cannot be performed sufficiently. As a result, in some cases, even the operability of the PC is lowered.

  Conventionally, as a moving image playback device considering reduction in processing load of moving image editing processing, a display processing unit can be updated at regular intervals and a thinned frame can be selected by making a decoding processing unit and a display processing unit independent. There has been proposed a moving image playback apparatus that can perform smooth playback (see, for example, Patent Document 1).

  FIG. 6 is a block diagram schematically showing a configuration of a conventional moving image reproducing apparatus.

  In FIG. 6, a moving image reproduction apparatus 900 includes a compressed data file 901 that stores compressed image data, a decoding processing unit 903 that reads the compressed image data from the compressed data file 901, and performs decoding processing, and image data of the decoding result A plurality of image data buffers 904 for storing images as frames, a display control unit 905 for displaying frames accumulated in the image data buffer 904, a timer unit 906 for measuring the display timing of the display control unit 905, and a decoding process The thinning processing unit 902 for thinning the decoding processing by the unit 903 and the display device 907 are configured.

  The decoding processing unit 903 reads compressed image data from the compressed data file 901 and sequentially stores the decoded frames in the image data buffer 904. The image data buffer 904 is a ring buffer that can store a plurality of decoded frames, and instructs the timer unit 906 to start display when a certain number of frames or more are stored. . The timer unit 906 notifies the display control unit 905 of a display request signal at regular intervals. The display control unit 905 transfers the frame decoded from the image data buffer 904 to the display device 907 and displays it.

At this time, if the number of frames remaining in the image data buffer 904 is equal to or less than a certain number, the counter indicating the number of thinned frames is incremented to omit the decoding process by the decoding processing unit 903. Conversely, when the number of frames remaining in the image data buffer 904 is greater than a certain number, the counter is cleared and the thinning designation is canceled. The decimation control unit 902 checks the counter, and when there is a decimation request and when a frame to be decoded can be decimationed, the decimation control unit 902 instructs the decoding processing unit 903 to skip compressed data. When there is an instruction to skip compressed image data, the decoding processing unit 903 skips frames by skipping one frame of compressed image data.
Japanese Patent Laid-Open No. 10-13794

  However, in the above conventional technique, the input compressed data file is reproduced at the original frame display interval, and the frame is thinned out only when decoding is not in time, so that the load is reduced only when the processing load during reproduction becomes high. Therefore, there is a problem that the timing at which frames should be thinned out cannot be detected until the processing load approaches the limit. At the time when frame thinning occurs, it is impossible to avoid the result that not only the display contents but also the operability has been lowered.

  It is an object of the present invention to reduce the processing load of the reproduction process in the editing / playback process in the moving image editing process, and in the editing / save process, the moving image editing can save the edited result without omission. An apparatus and method, and a program and a storage medium are provided.

  In order to achieve the above object, a moving image editing apparatus according to claim 1 is a moving image editing apparatus that edits a compression-coded moving image signal; and setting means for setting attribute information related to the moving image signal; And a decoding means for decoding the moving image signal based on the set attribute information, and a reproduction storing means for reproducing and storing the decoded moving image signal.

  The moving image editing method according to claim 5 is a moving image editing method for editing a compressed and encoded moving image signal, a setting step for setting attribute information relating to the moving image signal, and the set attribute information. A decoding step of decoding a moving image signal based thereon and a reproduction / storing step of reproducing and storing the decoded moving image signal are provided.

  The moving image editing program according to claim 9 is a moving image editing program for editing a compression-encoded moving image signal, a setting module for setting attribute information related to the moving image signal, and the set attribute information. A decoding module that decodes a moving image signal based thereon and a reproduction and storage module that reproduces and stores the decoded moving image signal are executed by a computer.

  A computer-readable storage medium according to a tenth aspect stores the program according to the ninth aspect.

  According to the present invention, since the moving image signal based on the set attribute information is decoded and the decoded moving image signal is reproduced and stored, in the edit reproduction process in the moving image editing process, the processing load of the reproduction process In the editing and saving process, the editing result can be saved without being lost.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram schematically showing a configuration of a moving image editing apparatus according to an embodiment of the present invention.

  In FIG. 1, a PC 100 as a moving image editing apparatus according to an embodiment of the present invention performs editing / playback processing and editing / saving processing shown in FIG. Do.

  The PC 100 includes a CPU 200 that controls the operation of the entire apparatus, a hard disk drive 300 in which digital data such as an execution program and a compression-coded moving image signal is recorded, and a hard disk drive 300 that records the data. A memory device 400 for loading program code and target image data, an operation unit 500 including a keyboard and a mouse, which is an input unit for a transfer operation, a transfer status including a CRT display and a liquid crystal panel, and a decoded moving image A display unit 600 for displaying signals and an external storage medium drive 700 for reading an external storage medium such as a CD-ROM or a DVD-ROM are provided. The CPU 200, the hard disk drive 300, the memory device 400, the operation unit 500, the display unit 600, and the external storage medium drive 700 are connected to each other via an internal bus 800.

  The CPU 200 detects an input from the operation unit 500, loads a predetermined program or moving image data recorded on the hard disk drive 300 into the memory device 400, and executes a process according to the input.

  In the present embodiment, moving image data recorded on the hard disk drive 300 is used. However, when moving image data is recorded on an external storage medium, it may be executed via the external storage medium drive 700. Similarly, the moving image data may be loaded via a network.

  In the present embodiment, the format of the moving image signal to be edited is Motion JPEG with no inter-frame correlation.

  FIG. 2 is a block diagram schematically showing the configuration of the CPU 200 in FIG.

  2, a CPU 200 inputs a frame rate setting unit 202 (setting means) for setting frame rate settings (attribute information) that are input display settings and storage settings, and input in the edit reproduction process and edit save process in FIG. 3. A decoding processing unit 201 (decoding unit) that decodes the received moving image signal based on the setting of the frame rate setting unit 202, and an image effect addition unit 203 (editing unit) that adds an effect to the decoded data. In order, they are connected in this order.

  The CPU 200 also includes a display processing unit 204 (reproduction storage unit) and a storage processing unit 205 (reproduction storage unit) connected in parallel to the image effect addition unit 203.

  The moving image signal is an input moving image signal and may be a plurality of inputs. In this case, individual processing is sequentially executed by the CPU 200 for each moving image signal.

  The frame rate setting unit 202 sets a frame rate mainly used in the edit reproduction process and edit save process of the decoding processing unit 201.

  In the present embodiment, the frame rate setting unit 202 sets a frame rate lower than the input moving image signal as the display setting, and sets a frame rate equal to the input moving image signal as the storage setting. By setting in this way, it is possible to reduce the processing load in the edit / playback process and to save the edit result without omission in the edit / save process.

  FIG. 3 is a flowchart showing a procedure of edit reproduction processing executed by the CPU 200 of FIG.

  In FIG. 3, first, when a reproduction start request is detected (YES in step S301), reproduction is started (step S302), and the decoding processing unit 201 acquires a preset reproduction frame rate from the frame rate setting unit 202. (Step S303) Furthermore, the decoding processing unit 201 acquires the original frame rate from the input moving image signal (Step S304).

  In the subsequent step S305, it is determined whether or not the processing of all the images has been completed, and when the processing of all the images has not been completed, a frame that is the minimum reproducible unit is detected from the moving image signal. (Step S306), it is determined whether or not the detected frame is a frame to be reproduced (step S307).

  If it is determined in step S307 that the frame is not to be reproduced, the process returns to step S305. If the frame is to be reproduced, the decoding processing unit 201 decodes the frame (step S308) and adds an image effect. The unit 203 adds an effect to the decoded result (step S309), displays the frame on the screen (step S310), and returns to the process of step S305.

  As a result of the determination in step S305, when all the images have been processed, the reproduction is ended (step S311), and this processing is ended.

  The determination in step S307 is performed by comparing the frame rates acquired in steps S303 and S304. More specifically, when the set playback frame rate is the original frame rate of the input moving image signal, frames that match the original frame rate are extracted at equal intervals, and are used as playback frames. When the set playback frame rate is half of the original frame rate of the input moving image signal, only the odd frame is decoded by thinning out the even frame of the moving image signal, or the odd frame By decimation, even-numbered frames are decoded and used as playback frames.

  According to the editing / playback processing of FIG. 3, when the detected frame is a frame to be played back (YES in step S307), the frame is decoded (step S308). Therefore, it is possible to perform reproduction with a reduced processing load. Thus, it is possible to perform reproduction while always reducing the processing load without depending on the processing load variation of the moving image editing apparatus.

  In the editing and saving process in the moving image editing process, the decoding processing unit 201 decodes all the images without thinning out the frames at the original frame rate of the moving image signal, adds the effect to the decoded images, and stores them. The editing result corresponding to the input of the original moving image signal can be saved without being lost.

  FIG. 4 is a block diagram schematically showing a configuration of a modified example of the CPU 200 of FIG.

  4, the CPU 210 inputs the decoding resolution setting unit 212 (setting means) for setting the decoding resolution setting (attribute information) that is the input display setting and storage setting, and the editing reproduction processing and editing saving processing of FIG. 5. A decoding processing unit 211 (decoding unit) that decodes the received moving image signal based on the setting of the decoding resolution setting unit 212, and an image effect addition unit 213 (editing unit) that adds an effect to the decoded data. In order, they are connected in this order.

  The CPU 210 also includes a display processing unit 214 (reproduction / storage unit) and a storage processing unit 215 (reproduction / storage unit) connected in parallel to the image effect addition unit 213.

  The moving image signal is an input moving image signal and may be a plurality of inputs. In this case, the CPU 210 sequentially executes individual processing for each moving image signal.

  The decoding resolution setting unit 212 sets the decoding resolution mainly used in the editing / playback processing and editing / storing processing of the decoding processing unit 211.

  In the present embodiment, the decoding resolution setting unit 212 sets a decoding resolution lower than the input moving image signal as the display setting, and sets a decoding resolution equal to the input moving image signal as the storage setting. By setting in this way, it is possible to reduce the processing load in the edit / playback process and to save the edit result without any omission in the edit / save process.

  FIG. 5 is a flowchart showing a procedure of edit reproduction processing executed by the CPU 210 of FIG.

  In FIG. 5, first, when a reproduction start request is detected (YES in step S501), reproduction is started (step S502), and the decoding processing unit 211 acquires a preset decoding resolution from the decoding resolution setting unit 212 ( Step S503).

  In the subsequent step S504, it is determined whether or not all the images have been processed. If all the images have not been processed, a frame that is the smallest unit that can be reproduced is detected from the moving image signal. (Step S505), the decoding processing unit 211 performs decoding at the decoding resolution obtained for the detected frame (Step S506), and the image effect adding unit 213 adds an effect to the decoded result (Step S507). After displaying the frame on the screen (step S508), the process returns to step S504.

  As a result of the determination in step S504, when all the images have been processed, the reproduction is ended (step S509), and this processing is ended.

  According to the editing / playback process of FIG. 5, the preset decoding resolution is acquired (step S503), and the detected frame is decoded with the acquired decoding resolution (step S506). By setting a resolution lower than the original resolution, all frames can be decoded and reproduced lower than the original resolution, and reproduction with a reduced processing load can be performed. Thus, it is possible to perform reproduction while always reducing the processing load without depending on the processing load variation of the moving image editing apparatus.

  Further, in the editing and saving process in the moving image editing process, the decoding processing unit 211 decodes all images at the original resolution of the moving image signal, adds an effect to the decoded image, and stores the decoded image. It is possible to save the editing result corresponding to the input without missing.

  Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the embodiments to a system or apparatus, and the computer (or CPU, MPU, etc.) of the system or apparatus stores the storage medium. It is also achieved by reading out and executing the program code stored in.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention.

  Examples of the storage medium for supplying the program code include a floppy (registered trademark) disk, a hard disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a DVD-ROM, a DVD-RAM, and a DVD. -RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM, etc. can be used. Alternatively, the program code may be downloaded via a network.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code. This includes a case where part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. This includes a case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

1 is a block diagram schematically showing a configuration of a moving image editing apparatus according to an embodiment of the present invention. FIG. 2 is a block diagram schematically showing a configuration of a CPU in FIG. 1. It is a flowchart which shows the procedure of the edit reproduction | regeneration process performed by CPU of FIG. FIG. 3 is a block diagram schematically showing a configuration of a modified example of the CPU of FIG. 2. FIG. 5 is a flowchart showing a procedure of edit reproduction processing executed by the CPU of FIG. 4. FIG. It is a block diagram which shows schematically the structure of the conventional moving image reproducing device.

Explanation of symbols

100 PC
200,210 CPU
201, 211 Decoding processing unit 202 Frame rate setting unit 203, 213 Image effect adding unit 204, 214 Display processing unit 205, 215 Storage processing unit 212 Decoding resolution setting unit

Claims (10)

In a moving image editing apparatus for editing a compression-coded moving image signal,
Setting means for setting attribute information relating to the moving image signal;
Decoding means for decoding a moving image signal based on the set attribute information;
A moving image editing apparatus, comprising: a reproducing / storing unit that reproduces and stores the decoded moving image signal.   2. The moving image editing apparatus according to claim 1, further comprising editing means for performing predetermined editing on the decoded moving image signal.   The moving image editing apparatus according to claim 1, wherein the attribute information is a frame rate.   The moving image editing apparatus according to claim 1, wherein the attribute information is a resolution. In a moving image editing method for editing a compression-coded moving image signal,
A setting step of setting attribute information relating to the moving image signal;
A decoding step of decoding a moving image signal based on the set attribute information;
A moving image editing method comprising: a reproduction / storing step of reproducing and storing the decoded moving image signal.   6. The moving image editing method according to claim 5, further comprising an editing step of performing predetermined editing on the decoded moving image signal.   7. The moving image editing method according to claim 5, wherein the attribute information is a frame rate.   7. The moving image editing method according to claim 5, wherein the attribute information is resolution. In a video editing program for editing a compression-coded video signal,
A setting module for setting attribute information relating to the moving image signal;
A decoding module for decoding a moving image signal based on the set attribute information;
A moving image editing program for causing a computer to execute a reproduction / storing module for reproducing and storing the decoded moving image signal.   A computer-readable storage medium storing the program according to claim 9.

Images