JPH05207410A - Animation edition processing method - Google Patents

Abstract

PURPOSE:To edit an image and the sound of the natural animation having sound simultaneously and to make access to a frame to be edited properly and to facilitate an editing work by constituting a natural animation having sound with image information and an acoustic spectrum at every frame and implementing edition processing at every frame on one and the same computer. CONSTITUTION:The method consists of an input section 12, an image processing section 13, a sound processing section 14, a display section 15 and an image and sound synthesis processing section 16. Then the natural animation having sound is read at first and composed of image information and the acoustic spectrum. Then an identification code for retrieving a header provided on every frame is set and the identification code to be edited is designated to read the frame by header retrieval and the frame is displayed on a screen. Then the image information and the sound information are edited and processed on the screen by the computer, the content of the header of the frame is corrected after the edition processing to obtain the edited natural animation having sound is obtained.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a moving image editing processing method in which a natural moving image with sound is constructed as image information for each frame and its acoustic spectrum, and each frame is displayed on the screen and edited by a computer. ..

[0002]

2. Description of the Related Art In recent years, with the increase in the capacity of storage elements and the improvement in the processing speed of personal computers, a natural moving image such as a television image is displayed in one frame (1/30 second) or one field (1/60 second). Record as a unit, 1
Image processing technology for making corrections, changes, composition, creation, etc. on a computer for each frame (one screen or one field consisting of one frame or two fields) has been dramatically advanced. By such image processing, imaginary images can be created instead of animation, and are being applied in the field of personal entertainment.

Conventionally, in a natural moving image including audio information such as a television image, the image information can be corrected or changed for each screen, but the audio information corresponding to each screen can be displayed on the same computer. It had the drawback that it couldn't be edited, making it difficult to edit the audio that matched the video. Further, in order to select an image to be edited, for example, the image is fast-forwarded and extracted, so that a necessary image selecting operation is not easy and the editing work is inconvenient.

[0004]

That is, there has been a demand for realization of a moving image editing processing method capable of simultaneously editing an image and a sound and also freely selecting an image to be edited.

An object of the present invention is to provide a moving image editing processing method capable of simultaneously editing images and sounds of a natural moving image with sound for each frame, appropriately accessing the frame to be edited, and facilitating editing work. To aim.

[0006]

In order to achieve the above object, the moving image editing processing method of the present invention is a method for converting a natural moving image with sound into one.
The frame or frame is composed of image information and its sound spectrum for each frame, and an identification code for searching each frame is set in a header provided for each frame, and the identification code set in this header is set. The designated and corresponding frames are read out and displayed on the screen, and the computer performs the editing process for each frame on the screen display, and after this editing process, the header contents corresponding to the frames are corrected.

[0007]

According to the present invention, a natural moving image with sound is composed of image information and its acoustic spectrum for each frame, and by performing the editing process for each frame on the same computer, it is possible to edit the sound according to the image, Further, each frame is provided with a header, and an identification code is set in this header, so that the header can be easily searched with this identification code, the frame can be appropriately accessed, and the editing work can be facilitated.

[0008]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be specifically described below with reference to an embodiment shown in the drawings. FIG. 1 is a diagram for explaining the configuration of a moving image edit processing method according to the embodiment of the present invention, and FIG. 2 is a block diagram for explaining the configuration of a moving image edit processing device according to the embodiment of the present invention.

In FIG. 2, the moving image editing processing apparatus of this embodiment is an apparatus for editing processing of image and sound information on a computer, and reads a natural moving image with sound 11 taken by a television or a video camera. An input unit 12, an image processing unit 13 that performs image information editing processing for each frame, and a voice processing unit 14 that performs audio information editing processing corresponding to each frame.
A display unit 15 such as a CRT display for displaying an image for each frame and a corresponding sound spectrum of sound, and an image output and sound processing unit 1 of the image processing unit 13.
Edited sound-added video information 17 by synthesizing the audio output of 4
And an image / speech synthesis processing unit 16 for obtaining

The image processing unit 13 compresses the image information input by the input unit 12 as will be described later in detail, and sets a frame number for each frame in units of one frame or one field. , Processing for displaying the image information recorded for each frame on the display unit 15 as a still image (stop motion), and for each frame, for example,
This is a part for performing edit processing such as cutting out a part of a still image, inserting another still image, or creating a completely new image. Further, the voice processing unit 14 performs fast Fourier transform on the voice information input by the input unit 12 into data on the frequency axis every time it corresponds to one frame to obtain an acoustic spectrum, and the acoustic spectrum is displayed on the display unit 15. This is a part for performing processing for displaying and for editing the acoustic spectrum on the screen, and obtaining an audio output for each frame by performing an inverse Fourier transform on the edited acoustic spectrum.

The moving image editing processing method of this embodiment is performed by the above moving image editing processing apparatus according to the steps shown in FIG. That is, first, a natural moving image with sound is read and composed of image information and an acoustic spectrum (ST1).
Next, an identification code for searching is set in the header provided for each frame (ST2). Next, when editing, the identification code is designated and the frame is read by the header search, and the screen display of this frame is performed (ST3). Then, the computer edits the image information and the audio information on this screen display (ST4), and after the editing process, the header content of the frame is corrected (ST5) to obtain edited moving image information with sound.

FIG. 3 is a flow chart for explaining the number setting for each frame according to the embodiment of the present invention. As shown in FIG. 3, a predetermined medium on which a natural moving image with sound is recorded is read by a computer to display a screen. I (ST11), then
Coding is performed by setting a frame number for each frame during compression processing of a natural moving image (ST12) and recorded on a predetermined recording medium (ST13). As a method of compressing the natural moving image, for example, a high efficiency coding method using DCT (Discrete Cosine Transform), variable length coding or motion compensation is used. When setting the frame number without performing the compression process, the frame number may be assigned in synchronization with the start signal for one-screen scanning.

FIG. 4 is a diagram for explaining the structure of the header according to the embodiment of the present invention. As shown in FIG. 4, one frame recorded on the recording medium is a header provided at the beginning for setting a search code. It consists of a section and a data section that follows it. This header section is composed of an area for recording a mark storage code, a quoted medium code, a video identification number (ID No.) and a remark code. The mark memory code is added to the mark on a specific screen, for example, by hitting a key on the keyboard, while monitoring during the video editing process.
It is a code to access the screen for editing later by the mark. The quoted medium code is a code for leaving a history as an attribute of an image or sound quoted from another medium. In particular, a serial number peculiar to the medium is set for those whose copyright is considered important. The video identification number is a unique number corresponding to each frame, and is, for example, a number obtained by combining the elapsed time (second) from the beginning with the frame order or field order at that time (second) for each frame. For example, the 29th frame, which is 3 seconds after the start of the image, is 3-29, and the 50th field after 1 hour (3600 seconds) is 3600-50. At the beginning of the recording medium, there is prepared a search table in which a video identification number and a keyword are associated with each other at required points so that the keyword can be accessed at the time of editing.

FIG. 5 is a flow chart for explaining access and display in the embodiment of the present invention.

First, in the step shown in FIG. 3, a recording medium in which a frame number is set for each frame is read (ST21), and then an operation for directly accessing the edit screen is performed.
That is, when the access operation is performed by the frame number, the video identification number is directly designated, and the header search corresponding to this number is performed (ST22, 23). For example, if 20-35 is designated as the video identification number, the header search in which this frame number is recorded is performed. When the access operation by time is performed, the video identification number is calculated by converting the time into seconds and the field (or frame), and the header search in which this number is recorded is performed (ST24, 2).
5). When the access operation by the mark storage is performed, the header is searched by the mark recording code (ST26, 2).
7). For example, the header search corresponding to the mark added to the recording area of the mark recording code is performed. When an access operation based on the table of contents is performed, a search is performed from a table prepared at the head of the medium. For example, a header search in which a video identification number corresponding to a keyword in the table is recorded is performed. Next, the screen of the frame selected as a result of the header search is displayed (ST30), and editing processing such as image and voice synthesis and correction is performed on this screen display (ST3).
1) After the editing, the headers such as the quoted medium code of the frame and the video identification number are automatically corrected (ST32) and recorded on a predetermined recording medium (ST33).

FIG. 6 is a flow chart for explaining the whole editing process of the embodiment of the present invention, and FIG. 7 is a flow chart for explaining the details of the zoom process of the embodiment of the present invention.

As shown in FIG. 6, first, the process is started by reproducing the image of the natural moving image with sound. This playback includes normal speed playback, low speed (slow) playback, and fast-forward playback (ST41 to 43), and playback by direct access that jumps to a specific scene at a stretch as special playback. (ST44). The reproduction by direct access is the reproduction by various kinds of access described in FIG. Next, while monitoring the video to be reproduced, if there is a portion to be edited, the reproduction is interrupted (ST45) and the image of a predetermined frame is displayed as a still image. Next, as a result of examining this still image, if there is no need for editing, the reproduction is continued under the same condition as before (ST46).
To do. If it is desired to monitor for a while, slow reproduction or normal reproduction is performed (ST48, 49). When it is desired to edit the image immediately after the interruption, the process moves to the zoom process (ST47). On the other hand, while monitoring the slow reproduction or the normal reproduction, if a desired edit portion is found, the operation is interrupted (ST50). If it is not necessary to edit the examination result, the process returns to the normal operation (ST51) to return to the normal operation (return to the start A). If it is desired to continue monitoring, the process is continued (ST52), the slow reproduction or the normal reproduction is returned (return to B), and if the editing process is desired, the zoom process is started (ST53). If editing is not necessary, end.

When the zoom process is started, as shown in FIG. 7, first, one frame of the image and the acoustic spectrum is displayed on the screen of the computer (ST61). When it is desired to process an image, the screen is enlarged, various repairs and synthesizing operations are performed on the screen, and then the header contents of the edited frame are automatically corrected (ST62 to 65). In addition, when changing the acoustic spectrum, the screen is enlarged in the same way, various repairs and compositing work described in detail later on that screen are performed, and the header contents of the edited frame are automatically It is corrected (ST66 to ST69). on the other hand,
If you want to combine with the video recorded on other media, specify the other media on the same computer, specify the title such as the work name, and display it in another window on the display. And open it and perform zoom processing in the same way (ST7
0-73). If it is desired to continue these operations for each frame, the operation is continued (ST74 or 75) and returns to the original state (returns to D or C), and if interrupted (ST76), the operation returns to the main flow of the flowchart shown in FIG.

FIG. 8 is a diagram for explaining an image displayed on a screen by operating a button according to the embodiment of the present invention, FIG. 9 is a diagram for explaining an image displayed on one frame of a display unit according to the embodiment of the present invention, and FIG. 10 is an embodiment for the present invention. It is a figure explaining the acoustic spectrum of the 3 axis display of.

As shown in FIG. 8, the display unit 15 is provided with function keys 18 for performing various operations such as reproduction, interruption, continuation, zooming, and restoration, and an interruption button is provided during image reproduction. When pressed, the image of the frame designated at that time is displayed as a still image, and when the zoom button is further pressed in this state, the image of the still image and the acoustic spectrum are displayed. The still image and the sound spectrum of the display unit 15 are displayed on the left half of the display unit 15 as shown in FIG. 9, and the power spectrum on the frequency axis is used as the sound spectrum of the sound corresponding to this image. Is displayed on the right half of the display unit 15. The display of the acoustic spectrum on the display unit 15 is a basic form, and when more detailed data is required, as shown in FIG. 10, not only the power spectrum on the frequency axis but also the time axis is added.
The axis is displayed.

FIG. 11 is a diagram for explaining an example of the voice changing process according to the embodiment of the present invention, and an example of the acoustic spectrum correcting and synthesizing process of FIG. 7 will be specifically described.

As shown in the change mode 1 in the figure, for example, when it is desired to change the strength of the voice information, the value of the power spectrum (amplitude) is changed without changing the frequency distribution position as shown by the arrow. ) May be increased or decreased from the solid line to the dotted line, and when changing the voice, the value of the power spectrum may be added on the arbitrary frequency as the dotted line. In addition, as shown in the change mode 2 of FIG.
For example, if you want to change the pitch, change the frequency from the solid line to the dotted line without changing the frequency distribution pattern.
If you double it, or halve it, it sounds one octave higher,
Or you can change to a low tone. As shown in the change mode 3 in the same figure, for example, when it is desired to make a husky voice or a dull voice, it can be changed by adding a sideband like a dotted line. Furthermore, it can be converted into completely different data.

According to the moving image editing processing method having the above-described structure, one frame or one field of a natural moving image with sound is converted into an image 1.
Since it is composed of frames and the corresponding sound spectrum and is edited on the same computer, it has become possible to edit the sound according to the image. In addition, a header section is provided for each frame to set an identification code such as a video identification number or mark storage code, and a table of contents for search is provided at the beginning of the medium to display the frame number, elapsed time, mark storage, and table of contents. Frames are directly accessed by searching various headers with, etc., and there are various ways to extract the frame to be edited, and it is possible to properly access the frame, making it easy to edit the natural video with sound. Became. Further, in the present embodiment, the header content is automatically corrected after the editing process for each frame, and when extracted from another medium at the time of editing, a history as an attribute of each frame is left,
It also prevents copyright infringement.

In the above embodiment, the mark storage code, the video identification number, etc. are set in the header provided for each frame, but the present invention is not limited to these examples, and an identification code for searching may be set.

Further, in the above embodiment, the voice processing may be performed by at least modifying the acoustic spectrum obtained by the fast Fourier transform, or adding a completely new acoustic spectrum, and converting the acoustic spectrum into the voice information by the inverse Fourier transform. Also, various image processing techniques are applied to the editing process of the moving image information.

[0026]

As described above, according to the present invention, a natural moving image with sound is composed of image information and its sound spectrum for each frame, and the editing process for each frame is performed on the same computer to match the image. You can edit the audio. In addition, each frame is provided with a header, and an identification code is set in this header, which has the effect of facilitating header search with this identification code, allowing proper access to the frame, and facilitating editing work.

[Brief description of drawings]

FIG. 1 is a diagram illustrating a configuration of a moving image edit processing method according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a moving image edit processing device according to an embodiment of the present invention.

FIG. 3 is a flowchart illustrating number setting for each frame according to the embodiment of this invention.

FIG. 4 is a diagram illustrating the configuration of a header according to the embodiment of this invention.

FIG. 5 is a flowchart illustrating access and display according to an embodiment of the present invention.

FIG. 6 is a flowchart illustrating an entire editing process according to the embodiment of this invention.

FIG. 7 is a flowchart illustrating details of zoom processing according to an embodiment of the present invention.

FIG. 8 is a diagram illustrating a screen display image by button operation according to the embodiment of the present invention.

FIG. 9 is a diagram illustrating a display image of one frame on the display unit according to the embodiment of the present invention.

FIG. 10 is a diagram illustrating an acoustic spectrum of 3-axis display according to an embodiment of the present invention.

FIG. 11 is a diagram illustrating an example of voice change processing according to the embodiment of this invention.

[Description of symbols] 11 moving image information with sound 12 input unit 13 image processing unit 14 audio processing unit 15 display unit 16 image / speech synthesis processing unit 17 edited moving image information with sound 18 function key

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁵ Identification code Internal reference number FI Technical display location G11B 15/087 101 A 8022-5D 27/024 H04N 5/782 A 7916-5C

Claims (1)

[Claims] 1. A natural moving image with sound is composed of image information and its sound spectrum for each frame in units of one frame or one field, and an identification code for searching each frame is provided in a header provided for each. Set, specify the identification code set in this header, read out the corresponding frame, display it on the screen, perform the editing process for each frame on the screen display, and after this editing process the header content corresponding to the frame A video editing processing method characterized by correcting.