JPH07203296A - Nonlinear video image editer - Google Patents

Abstract

PURPOSE:To provide the video image editer in which plural cuts (scenes) are rearranged and again linked through a video image effect repetitively according to the purpose without increasing the scale. CONSTITUTION:Channel cut gap packing sections 103, 104 reference display/video (between cuts) effect information of each channel to extend longer a front end or a tail end of preceding and succeeding cuts by adding other frame to it and output the result from video storage sections 105, 106 in a form that the gap is eliminated when the gap to be displayed or the like for the display of the cut of the other channel is in existence between cut's in one and same channel displayed precedingly and succeedingly. FIFO circuits 107, 108 exclusively for each channel read the extended cut at a high speed. Then a video image (mix) effect section 110 applies a prescribed video image effect based on the inter-cut effect information. In this case, the added frame is eliminated.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a non-linear video editing apparatus mainly for digitized data.

[0002]

2. Description of the Related Art Conventionally, in editing work of digitized video, it is not limited to the meaning of a channel of material (frequency band in television and radio broadcasting, but a series of recording for a program or one purpose. Multiple cuts in the concept) (single or multiple frames (a scene in a video or a similar concept), so to speak)
A technique has been developed to complete one work by repeatedly collecting images according to the purpose of editing and connecting each channel and cut (scene, scene) with a visual effect such as wipe. There is.

FIG. 29 shows a block diagram of a conventional video editing apparatus. Now, this conventional video editing apparatus will be described by taking as an example the case where four cuts A1, A2, B1 and B2 are edited as shown in FIG. . FIG. 5 shows that editing is performed for two channels A and B (as described above, A and B are images recorded with a different intention as a record).
Cut A1 from one scene in channel A to cut B1 in the case of channel B from cut B1 to cut A2
Is an example of editing in which the displayed scenes are switched one after another by the wipe (WIPE) effect in which the case where the cut A2 is displayed to the cut B2 is gradually changed.

The video storage unit 2903 stores cuts A1, A2, B1 and B2 on one storage medium as shown in FIG. In this figure, the shaded area is a frame that is not the target of editing. As a general rule, each cut is numbered only on the frames at both ends. And this is almost the same also in other figures. A channel cut connection memory 2
901 and B channel cut connection memory 2902 store reproduction information of cuts in the A channel and B channel, respectively.

FIG. 8 shows an A channel cut connection information memory 2
A channel cut reproduction information stored in the 901, FIG.
An example of the B channel cut reproduction information stored in the B channel cut connection information memory 2902 is shown in FIG. The original start frame number and the original end frame number in FIGS. 8 and 9 are the start number and the end number of the frame that can specify the storage area of the cut in the storage medium, respectively. The reproduction start frame and the reproduction end frame respectively represent the number of elapsed frames from the start of the video editing work until the cut is reproduced and the number of elapsed frames until the reproduction is finished.

FIG. 10 shows the inter-cut effect information memory 290.
6 shows the effect information between cuts stored in FIG. The in point and the out point in the figure are the number of elapsed frames from the start of the work to the start of applying the effect and the number of elapsed frames until the end. The effect number represents the content of the effect such as fade-in, fade-out, and wipe. In the figure, all are wipes, and 05, 14, and 07 further represent the contents of the wipe.

First, the video storage unit 2903 obtains information for reproducing the cut A1 from the A channel cut reproduction information sent from the A channel cut connection information memory 2901,
When it is time to replay cut A1, cut A1
Is read. The switch 2904 interprets the A channel cut reproduction information sent from the A channel cut connection information memory 2901, turns on the switch when the time to reproduce the cut A1 comes, and the video storage unit 290
The cut effect A1 output from No. 3 is mixed effect unit 2907
To turn off the switch when playback is complete.

Next, the video storage unit 2903 interprets the B channel cut reproduction information sent from the B channel cut connection information memory 2902, obtains information for reproducing the cut B1, and it is time to reproduce the cut B1. At this point, the cut B1 is read. The switch 2905 interprets the B channel cut reproduction information sent from the B channel cut connection information memory 2902, turns on the switch at the time when the cut B1 is reproduced, and outputs the cut output from the video storage unit 2903. B1 is sent to the mix effect unit 2907, and the switch is turned off when the reproduction is completed.

Based on the inter-cut effect information obtained from the inter-cut effect information memory 2906, the mix effect section 2907 compares the two cuts A1 and B1 sent at the time when the effect start time arrives with the figure. Cut A as shown in 5
Edit is performed by switching from 1 to cut B1 by the wipe effect. Further, the video storage unit 2903 obtains information for reproducing the cut A2 from the A channel cut reproduction information sent from the A channel cut connection information memory 2901, and reads out the cut A2 at the time when the cut A2 is reproduced. Do.

The switch 2904 interprets the A channel cut reproduction information sent from the A channel cut connection information memory 2901, turns on the switch at the time when the cut A2 is reproduced, and from the video storage unit 2903. The output cut A2 is sent to the mix effect unit 2907, and the switch is turned off when the reproduction is completed. The mix effect unit 2907 is a cut effect information memory 290.
According to the effect information between cuts obtained from No. 6, at the time when the effect start time comes, the two cuts B1 and A2 sent are switched by the wipe effect from the cut B1 to the cut A2 as shown in FIG. Give.

The video storage unit 2903 obtains information for reproducing the cut B2 from the B channel cut reproduction information sent from the B channel cut connection information memory 2902, and when it is time to reproduce the cut B2, the cut B2 is reproduced. Is read. The switch 2905 interprets the B channel cut reproduction information sent from the B channel cut connection information memory 2902, turns on the switch at the time when the cut B2 is reproduced, and the video storage unit 29
The cut B2 output from 03 is mixed with the effect unit 290.
7 and the switch is turned off when the reproduction is completed.

The mix effect section 2907 uses the inter-cut effect information obtained from the inter-cut effect information memory to detect the two cuts A2 sent when the effect start time comes.
As shown in FIG. 5, B2 is edited by switching from cut A2 to cut B2 by a wipe effect. By the above processing, editing as shown in FIG. 5 is performed.

[0013]

However, in the video editing apparatus according to the above-mentioned prior art, when a plurality of cuts are rearranged according to the purpose, and a video effect is connected between the cuts, the connection is repeatedly performed. In order to make the reproduction start time and the reproduction end time for each cut accurate, it is necessary to frequently switch the switches. Eventually, the switch part needs to be equipped with a timer and various wirings, which increases the scale of the device.

The present invention has been made in view of the above circumstances, and an object thereof is to provide an image editing apparatus in which a plurality of cuts can be easily connected by applying an image effect without increasing the apparatus scale. It is a thing.

[0015]

In order to achieve the above object, according to the invention of claim 1, position information specifying each cut is arranged for each cut and arranged according to a certain rule, which constitutes a video of a channel. A plurality of dedicated video storage units for each channel that can be stored in association with each other and sequentially output the frames that form the corresponding cuts based on the cut position information,
Type of video effect to be applied to the connection part of different channels when combining and displaying video of one channel from video of multiple channels, identification information of channels targeted for display and video effects, and display and video for each channel A display image effect information storage unit that stores display image effect information that includes position information of cuts to be effected, and necessary information is read from the display image effect information storage unit, and sequentially before and after each channel. Since only the cuts of other channels are targeted between the cuts targeted for display or video effect, the time interval for checking whether or not there is a time interval for applying the display or video effect for each channel. When the detection unit and the time interval detection unit determine that there is a time interval, the necessary information is read from the display image effect information storage unit as well. Then, the number of frames corresponding to the time interval when the display or the video effect is applied between the two cuts having the time interval is calculated for each two cuts to be displayed or the video effect in the order of each channel. Based on the information stored in the frame number calculation unit and the display image effect information storage unit, the frame number calculation is performed when the cuts to be displayed or image effects are output from the channel dedicated video storage unit in that order. A display or video effect that is stored subsequent to the last frame of the preceding cut for each two cuts that are subject to display or video effect based on the number of frames calculated by the copy. Cuts that are not subject to (The display is not displayed as a result because it is used for display at other times, but the time targeted for editing is different. (Including cuts and frames) that are continuously output for a specified number of times, or for a predetermined number of frames that are stored prior to the frame at the end of the subsequent cut and output continuously. By doing so, a cut of the number of frames corresponding to the time interval at the time of applying the display or the video effect is interleaved, and the output adjustment unit for the video storage unit dedicated to each channel to be output, and each of the above Frames to be output under the action of the output adjustment unit for the video storage unit dedicated to the channels are sequentially stored, and are then sequentially output to each channel dedicated FIFO (First In First Ost).
ut, first-in first-out) storage unit and a cut-out that is sequentially output after being divided for each channel from the FIFO storage unit dedicated to each channel, based on the information stored in the display image effect information storage unit. The targeted cuts are output in order, and the specified video effects are applied to the cuts targeted for the video effect, and the interleaved cuts that are not targeted for the display or video effect are cut off. By doing so, it is characterized by having a video effect section for combining and outputting a video of one channel from video of a plurality of channels, and a display section for displaying the video output by the video effect section.

According to the second aspect of the present invention, each of the arranged cuts forming the image is stored for each cut in association with the cut identification information including the identification information and the position information of the channel to which the cut belongs, and the cut is stored. A video storage unit for multiple channels that can output the corresponding frame based on the specific information, and a video effect to be applied to the connection unit of different channels when combining and displaying the video of one channel from the video of multiple channels. A display image effect information storage unit for storing display image effect information including type, display and identification information of a channel to be displayed and image effect, and cut specifying information of a cut to be displayed and image effect for each channel; Displayed video effect information necessary information is read out from the storage unit, and each channel is displayed before or after each other for display or video effect target cuts. Since only the cuts of other channels are targeted at, the time interval detection unit that checks for each channel whether or not there is a time interval when performing a display or video effect, and the time interval detection unit If it is determined that there is a frame, the necessary information is read from the display image effect information storage unit, and a frame corresponding to the time interval when the display or the video effect is applied between the two cuts having the time interval. The number of frames is displayed in the order of each channel or is calculated for each two cuts to be subjected to the video effect, and the number of frames is displayed from the video storage unit based on the information stored in the display video effect information storage unit. When the cuts targeted for video effects are displayed first in the same channel or output in the order in which they are targeted for video effects, the number of frames is calculated. Based on the number of frames calculated by the unit, the display or the video effect is not stored as the display or the video effect that is stored after the preceding cut for every two cuts of the same channel that are displayed or the video effect before or after the above. A predetermined number of frames are combined and continuously output as a frame of the channel, or a predetermined number of frames stored prior to a subsequent cut are combined as a cut of the channel (since two cuts are connected in time, Cuts or frames of other channels may be output continuously or at least one is performed so that the cuts of the number of frames corresponding to the time interval for applying the display or video effect are interleaved. The output adjustment unit for the video storage unit to be output above and the output adjustment unit for the video storage unit are output in order. A channel partitioning unit for partitioning and outputting a frame for each channel, a FIFO storage unit dedicated to each channel for sequentially storing the cuts partitioned under the action of the channel partitioning unit, and sequentially outputting the cuts, and Channel dedicated F
The cuts to be displayed are sequentially output based on the information stored in the display image effect information storage unit for the cuts that are sequentially output after being divided for each channel from the IFO storage unit. A specified video effect is applied to the cut that is the target of the effect, and the cuts that are interspersed between the cuts that are not the target of the video effect are turned off so that the video of multiple channels It is characterized in that it has a video effect section for combining and outputting the video and a display section for displaying the video output by the video effect section.

According to the third aspect of the present invention, each of the arranged cuts forming the video of the channel is stored for each cut in association with the cut identification information including the identification information and the position information of the channel to which the cut belongs, and A video effect that is applied to the connection part of different channels when combining and displaying the video of one channel from the video of multiple channels and the video storage parts that can output the corresponding cuts based on the cut identification information. Type, display and video effect identification information of the channel targeted for display and video effects, and display video effect information including information for identifying the cut targeted for display and video effect for each channel and the identification number of the stored video storage unit. The display image effect information storage unit that stores the information and necessary information are read from the display image effect information storage unit, and are displayed one after another for each channel. Actually, since only the cuts of other channels are targeted between the cuts targeted for the video effect, it is checked for each channel whether or not there is a time interval in applying the display or the video effect. Section and the time interval detecting section determines that there is a time interval, the necessary information is also read from the display image effect information storage section and then displayed between two cuts having the time interval. A frame number calculation unit that calculates the number of frames corresponding to a time interval for applying a video effect for each two cuts that are displayed or displayed in the order of video effects, and is stored in the display video effect information storage unit. Based on the information, the cuts to be displayed or image effects from the plurality of image storage sections are displayed or image effects to be targeted in the same channel. When outputting in the order of the following, based on the number of frames calculated by the number-of-frames calculation unit, succeeding the preceding cut with respect to each two cuts of the same channel which are subject to display or video effect before and after the frame number. A predetermined number of frames that are not subject to display or video effects that have been stored in the channel and are continuously output as frames of the channel, or a predetermined number of frames that are stored prior to a subsequent cut in the channel. The frames are continuously output, or at least one is performed so that the cuts of the number of frames corresponding to the time interval when the display or the video effect is applied are interleaved and then output. An output adjustment unit for a video storage unit that operates on each channel and each video storage unit, and a source of the operation of the output adjustment unit for the video storage unit The channel storage section for sequentially outputting the frames sequentially output by each channel, and the FIFO storage dedicated to each channel for sequentially storing the cuts sectioned under the action of the channel partitioning section Units and the cuts that are sequentially output after being divided for each channel from the FIFO storage unit dedicated to each channel, the cuts to be displayed based on the information stored in the display image effect information storage unit are Output in sequence, and at this time, apply the specified video effect to the cut targeted for the video effect and display or cut the intervening cuts that are not targeted for the video effect by cutting off the cuts of multiple channels. A video effect section for combining and outputting a video of one channel from the video, and a display section for displaying the video output by the video effect section. To have.

According to a fourth aspect of the present invention, the plurality of video storage sections are divided cuts in a state in which each frame constituting each cut is divided not for each cut for the image of at least one channel. For each divided cut, the divided cut identification information is stored in association with the divided cut identification information including the identification information of the channel to which the divided cut belongs, the cut information, the division information, and the position information, and the divided cut identification information is stored. Originally, it is possible to output the corresponding divided cuts, and for the cut of the channel, the display image effect information stored in the display image effect information storage unit is set for each divided cut,
Similarly, the operation of the time interval detection unit, the frame number calculation unit, the video storage unit output adjustment unit, and the channel division unit is performed for each divided cut, and the divided cut output from the channel division unit is also cut information and division information. A cut is synthesized by synthesizing one frame of each cut of the channel on the basis of the above, and then a cut cut synthesizing section for outputting this cut to a FIFO storage section dedicated to the channel is provided. The section changes the information about the divided cuts possessed by the display image effect information storage section into the information about one combined cut, and divides each channel into predetermined ones for the cuts inputted in the upper order. It is characterized by synthesizing the video of the channels.

In the inventions of claims 5 and 6,
The video storage unit dedicated to each channel stores a digitized video and arbitrarily (random, Random, Random,
It is characterized by being able to output the necessary stored contents at the required time and in the required order. In the invention of claim 7, the video storage section dedicated to each channel stores an analogized video such as a movie film or a record board, and the cut output from the video storage section dedicated to each channel is stored together with its position information. The display image effect information stored in the display image effect information storage unit is matched with the conversion of the A / D information conversion unit to be digitized and the conversion of the A / D information conversion unit, and is used for displaying the effect of the image effect unit. It is characterized by having a display image effect information adjustment unit for performing a predetermined adjustment from the number of frames to a sector or the like.

In the invention of claim 8, the video storage unit stores analogized video, and A / D information for digitizing cuts or divided cuts output from the video storage unit together with position information thereof. The conversion unit and the A
And a display image effect information adjusting unit that adjusts the display image effect information stored in the display image effect information storage unit in a predetermined manner so as to match the conversion of the / D information converting unit. It is characterized by having.

According to a ninth aspect of the present invention, the first aspect
According to the invention of claim 8, the display image effect information changing unit determines at least one of the type of image effect to be applied, the display and the channel targeted for the image effect, among the information stored in the display image effect information storage unit. In addition, at least one or at least a part of the channel identification information and the position information of the cut or divided cut targeted for display and video effect for each channel can be changed manually.

[0022]

With the above structure, in the invention of claim 1,
A plurality of dedicated video storage units for each channel that can output cuts store each arrayed cut that constitutes the video of the channel in association with position information that directly or indirectly identifies each cut. Then, the corresponding cut is output based on the cut position information. The display video effect information storage unit identifies the type of the video effect to be applied to the connection unit of different channels, the display and the identification information of the channel to which the video effect is applied when the video of one channel is synthesized and displayed from the videos of the plurality of channels. In addition, display video effect information including position information of the cut for which display and video effect are performed for each channel is stored. The time interval detection unit reads out necessary information from the display video effect information storage unit, and thereafter, only the cuts of other channels are targeted between the cuts targeted for display or video effect before and after each channel. Because
It is checked for each channel whether or not there is a time interval, which is a so-called waiting time when a display or video effect is applied. When the time interval detection unit determines that such a time interval exists, the frame number calculation unit also reads out necessary information from the display image effect information storage unit and then determines whether two time intervals are present. Between cuts,
The number of frames corresponding to the time interval when the display or the video effect is applied is calculated for each two cuts to be displayed or the video effect in the order of each channel. Based on the information stored in the display video effect information storage unit, the output adjustment unit for the video storage unit dedicated to each channel sequentially selects the cuts to be displayed or the video effect from the video storage unit dedicated to each channel in that order. When outputting in the order of the frames forming the, the two cuts that are subject to the display or the video effect are displayed after the preceding cut, based on the number of frames calculated by the frame number calculation unit. Whether to output a predetermined number of frames that are not subject to display or video effects stored in succession, or to output a predetermined number of frames that have been stored prior to the subsequent cut in succession. By doing at least one,
The cuts of the number of frames corresponding to the time interval for applying the display or video effect are interleaved and then output. The FIFO storage unit dedicated to each channel sequentially stores the cuts output under the action of the output adjustment unit for the video storage unit dedicated to each channel and then outputs the cuts in order. The video effect section is based on the information stored in the display video effect information storage section for the cuts which are output from the FIFO storage section dedicated to each channel for each channel and are output in order and in the frame order forming the channels. In addition, the cuts to be displayed are output in order.At this time, the specified video effects are applied to the cuts that are not only displayed but also subject to the video effect, and the cuts to be displayed or the video effect are applied. By cutting off the cuts that are not present and not displayed, the video of one channel is synthesized from the video of a plurality of channels and then output. The display is
Displays the video output by the video effect section.

According to the second aspect of the present invention, the video storage unit for a plurality of channels determines, for each cut, each cut arranged according to a certain rule from the identification information and the position information of the channel to which the cut belongs. It is possible to store the corresponding cut specifying information in association with the cut specifying information and output the corresponding cut based on the cut specifying information. The display video effect information storage unit identifies the type of the video effect to be applied to the connection unit of different channels, the display and the channel to be the target of the video effect when combining and displaying the video of one channel from the video of the plurality of channels. The display image effect information including information and cut identification information of a cut to be displayed and an image effect for each channel is stored. The time interval detection unit reads out necessary information from the display image effect information storage unit, and then only the cuts of other channels are cut between the cuts to be displayed or the video effect before and after each channel. Since it is a target, it is checked for each channel whether or not there is a time interval in applying the display or the video effect. When the time interval detection unit determines that there is a time interval, the frame number calculation unit reads necessary information from the display image effect information storage unit and then displays between two cuts having the time interval. Alternatively, the number of frames corresponding to the time interval for applying the image effect is calculated for each of the two cuts that are displayed or image effect targets in the order of each channel. Based on the information stored in the display video effect information storage unit, the output adjustment unit for the video storage unit first displays the cut to be displayed or the video effect from the video storage unit in the same channel or the cut of the video effect. When outputting in the target order, based on the number of frames calculated by the frame number calculation unit, a preceding cut is performed for every two cuts of the same channel which are subject to display or video effect before and after the frame number. A predetermined number of frames that are not subject to the display or video effect that are stored subsequently (including the frames that result) are output continuously as the frame of the channel, or prior to the subsequent cut. A predetermined number of stored frames are combined and output continuously as a frame of the channel, or at least one is displayed or displayed. It is output after having made to be able to Zaisa between the number of frames corresponding to the time interval of the cut when performing image effect. The channel sorting unit directly or indirectly reads the cuts that are sequentially output under the action of the output adjustment unit for the video storage unit, and reads the stored contents of the video result information storage unit, and attaches the cuts or frames to the frames. The identification symbol is identified, and the output is divided on each channel. FI dedicated to each channel
The FO storage unit sequentially stores the cuts divided under the action of the channel dividing unit, and then outputs the cuts in that order. The video effect unit selects a display target based on the information stored in the display video effect information storage unit with respect to cuts that are sequentially output after being divided for each channel from the FIFO storage unit dedicated to each channel. The cuts are output in order, at this time, the specified video effect is applied to the cut targeted for the video effect, and the intervening cuts which are not targeted for the display or video effect are cut off. As a result, the video of one channel is synthesized from the video of a plurality of channels and then output. The display unit displays the image output by the image effect unit. In the invention of claim 3, the plurality of video storage units associates each of the arranged cuts forming the video of the channel with the cut identification information including the identification information and the position information of the channel to which the frame belongs. Remember
Moreover, the corresponding cut can be output based on the cut specifying information. The display video effect information storage unit identifies the type of the video effect to be applied to the connection unit of different channels, the display and the channel to be the target of the video effect when combining and displaying the video of one channel from the video of the plurality of channels. The display image effect information including information, information for specifying a cut to be displayed and an image effect for each channel, and an identification number of a stored image storage unit is stored. The time interval detection unit reads out the necessary information from the display video effect information storage unit, and then targets only the cuts of other channels between the cuts to be displayed or the video effect before and after each channel. Therefore, it is checked for each channel whether or not there is a time interval when the display or the video effect is applied. When the time interval detection unit determines that the time interval exists, the frame number calculation unit also reads necessary information from the display image effect information storage unit,
The number of frames corresponding to the time interval when the display or the video effect is applied between two cuts having the time interval is calculated for each of the two cuts to be displayed or the video effect in the order of each channel. The output adjustment unit for the video storage unit, which operates on each channel and each video storage unit, becomes a target of display or a video effect from the plurality of video storage units based on the information stored in the display video effect information storage unit. When the cuts are output within the same channel in the order of display or image effect target, the same channel that is displayed or image effect target in succession is based on the number of frames calculated by the frame number calculation unit. For each of the two cuts, the specified number of frames that are stored after the preceding cut and are not subject to display or video effects are continuously output as the frame of the channel, or the subsequent cut is performed. By combining at least one of the frames stored in advance as the frame of the channel and outputting the frames continuously, It is output after having made to be possible to Zaisa between serial display or the number of frames corresponding to the time interval of the cut when performing video effect. The channel partitioning unit directly or indirectly reads the storage of the display image effect information storage unit for the cuts sequentially output under the action of the output adjustment unit for the video storage unit, and identifies the channel attached to the cut. Based on the information, each channel is divided and output. The FIFO storage unit dedicated to each channel sequentially stores the frames segmented under the action of the channel segmentation unit and then outputs the frames in sequence.
The video effect unit is set as a display target based on the information stored in the display video effect information storage unit for the cuts that are sequentially output after being divided for each channel from the FIFO storage unit dedicated to each channel. Cuts are output in order. At this time, the specified video effect is applied to the cut targeted for the video effect, and the intervening cuts that are not targeted for the display or video effect are cut off. As a result, the video of one channel is synthesized from the video of a plurality of channels and then output. The display unit displays the image output by the image effect unit.

In a fourth aspect of the present invention, the plurality of video storage units are provided for video of at least one channel.
Not for each cut but for each divided cut in a state where each frame constituting each cut is divided, and for each divided cut, identification information of a channel to which the divided cut belongs and information of the cut and the divided information. In addition, the divided cut specifying information including the position information is stored in association with the divided cut specifying information, and the corresponding divided cut can be output based on the divided cut specifying information. Regarding the cut of the channel, the display image effect information stored in the display image effect information storage unit is set for each divided cut, and similarly, the time interval detection unit, the frame number calculation unit, the image storage unit output adjustment unit, and the channel division unit. The action of is performed for each divided cut. The divided cut synthesizing unit also synthesizes the divided cuts output from the channel segmenting unit by synthesizing one frame of each cut of the channel based on the cut information and the division information, and then synthesizing the cuts. FIFO for this channel
The data is sequentially output to the storage unit. The image effect unit changes the information about the divided cuts included in the display image effect information storage unit into the information about one combined cut,
An image of a predetermined one channel is combined with the cuts input for each channel in the upper order.

In the inventions of claims 5 and 6,
The video storage unit dedicated to each channel can store the digitized video and can output the necessary storage contents arbitrarily (at a required time and in a required order). Claims 7 and 8
In the invention, the dedicated video storage section for each channel is
Memorize the analogized video. The A / D information conversion unit digitizes the cut output from the dedicated video storage unit for each channel together with position information such as the number of assigned frames.
The display image effect information adjustment unit matches the conversion of the A / D information conversion unit, and changes the number of frames to be included in the display image effect information stored in the display image effect information storage unit in order to exert the action of the image effect unit. Make predetermined adjustments to the sector number and so on.

[0026] In the invention of claim 9, the above-mentioned claim 1
Therefore, in the invention of claim 8, the display video information changing unit is
Of the information stored in the display video effect information storage unit, at least one of the types of video effects to be applied, the channels to be displayed and the video effects is, by extension, the identification information of the channels and the display and video effects of each channel. At least part of the position information of the target frame or the divided frames can be changed manually.

[0027]

EXAMPLES The present invention will be described below based on examples.
Note that the following examples are intended for all two channels so that the content of the present invention can be easily understood. In addition, the control and operation of the device are often controlled on a frame-by-frame basis.
It is not possible to directly input the frame to be the target of the video effect in frame units of about 30 seconds, and since it is input with a cut composed of a plurality of frames, not only in the claims but also in each embodiment. As a general rule, the target of image effects and display shall be cut units. However, the operation associated with filling between the cuts for performing display and image effects in the front and rear will be described focusing on the frame. (First Embodiment) FIG. 1 is a block diagram of a first embodiment of a nonlinear video editing apparatus according to the present invention.

In the figure, 101 is an A channel cut connection information memory, 102 is a B channel cut connection information memory, 103 is an A channel cut gap filling section, and 104 is a B channel cut gap filling section. , 105 is an A-channel video storage unit capable of random access (reading out a necessary portion at a necessary time).
Reference numeral 06 is a randomly accessible B channel video storage unit, and 107 is an A channel data FIFO (First
In, First Out, first-in first-out storage unit)
, 108 is a B channel data FIFO, 1
Reference numeral 09 is an effect information memory between cuts, and 110 is A and B.
This is a mix effect part that applies a wipe, which is a kind of video effect, to both channels.

Next, regarding the hardware side of each of the above-mentioned units, each of the video storage units 105 and 106 is a hard disk or the like, and each frame is given an address and stored in the address order. The channel cut connection memories 101 and 102, the channel data FIFOs 107 and 108, and the inter-cut effect information memory 109 are high-speed semiconductor memories. The operations of the channel cut gap filling units 103 and 104 and the mixing effect unit 110 are performed by a small computer (M
A CPU (not shown) reads out necessary memory contents according to a predetermined program, and then performs the operation.

Further, in order to exert its function, the video editing apparatus includes a storage unit for adjusting the processing speed of each unit, a processing speed adjusting device, and a CRT in addition to the microcomputer described above.
Such as a display device, a calendar-equipped electronic timepiece, an operation panel that allows the user to input desired information into the inter-cut effect information memory 109 and the channel cut connection information memories 101 and 102, and the user input of desired information A mix (video effect) adjustment unit that changes the data stored in each related unit according to the above, a D / A information conversion unit that converts the digital data into analog so that it can be perceived by humans, if necessary.
Further, it has an A / D information conversion unit for converting analog data into digital data as an option. Furthermore,
Optimum capacity and dimensions of the FIFO, video storage section, display section, etc. are selected as appropriate. However, these are so-called self-evident, and are not complicated because they are not the gist of the present invention themselves, so that illustrations and the like are omitted.

Next, the software aspect, the feasibility aspect, or the user operation aspect of each of the above parts will be described. The user knows in advance in which channel, at which position the display, the frame to be subjected to the video effect, and the cut exist.
I also understand the content of video effects. On this, display,
Displayed image effect information including a frame, a cut, a channel and contents of the image effect, which are objects of the image effect, A, B channel connection information, effect information memory between cuts, and the like are input in this embodiment. However, as a practical matter, as described above, frame units (video of about 1/30 second)
There will be no input for, and it will be input for each cut. Based on this input by the user, the required frame and the required frame are output. This is exactly the opposite of the operation of output and recording (input), but a VTR with a home program that can input multiple programs is set to the television broadcast of the set channel at the time set by the user. It's like recording only for a certain amount of time.

Next, from the information on the display and the video effect input by the user, whether or not there is a time gap in the display and the video effect between two frames of the same channel, and if there is, convert it into the number of frames. Then, some are required, and this is calculated by the MCPU according to a predetermined program. The method determines whether the elapsed time from the start of image synthesis to the start of the subsequent cut after the end of the processing of the previous cut between the preceding and following two cuts is longer than the processing time of one frame. It is done by judging whether or not. Therefore, this M
It goes without saying that the time required for displaying one frame or applying a video effect is input (input) in the program of the CPU in advance. Further, when the contents of the display and the video effect are changed by the user operating the mix adjusting unit, the number of frames to be added and output by the A channel cut gap filling unit 101 and the like as well as the channel and frame to be read out. However, if the processing speed of the mix effect unit 110 is changed in this case as well, naturally this and the number of filling frames are also reflected in the calculation by the MCPU. Specifically, the A channel was switched to the B channel by wiping over four frames, but the display of only the A channel was extended two frames backward, and the display of only the B channel was extended two frames forward, If switching is performed suddenly without applying a wipe, the display target frame has two frames truncated at the A channel and two frames truncated at the B channel.
Therefore, with this, the number of frames to be displayed is decreased by 2 for each of the A and B channels, and the number of frames to be filled is also increased or decreased by 2. In a home VTR that can be timer-recorded with the number of a television program just printed on a newspaper, if the user changes the program number, the channel to be recorded by the MCPU built into the VTR, the recording start time and the end It is like changing the time settings automatically.

Next, regarding the operation principle of the mix effect section 212, if the carrier frequencies of the A channel and the B channel are different, although they are visual information, the carrier frequency of the B channel is once changed to the carrier frequency of the A channel. After conversion, set both channels to the same frequency, perform processing, and write the video to be displayed once in the storage unit for display. At this time, according to the contents of the video effect for each frame to be displayed. There is a method of determining the storage area of the A channel and the B channel and the position of the pixel stored in the VRAM for each frame of both channels. In this embodiment, the latter method is adopted. This is because the display of images is faster than the reading from the storage unit or the processing for images, so anyway a storage unit is required for display. This is in consideration of the reproduction of the recorded images.

The A / D converter is a visual signal which, in the case of a voice signal, digitizes the magnitude of the voice in each frequency (H _Z ) region for each frequency (H _Z ) region based on decibels. This is done by dividing the plane of each frame into meshes and dividing the brightness of each of the meshes (pixels) into colors of red, blue, and yellow, and digitizing the brightness. The D / A change is, so to speak, the reverse operation.

However, the mix effect section, the FIF
Principles of O, A / D information converter, D / A information converter, etc. are described in "Information Processing Handbook, published by Ohmsha, Information Processing Society of Japan", "Shigeru Watanabe et al., 2nd Edition, Microcomputer Handbook, published by Ohmsha", etc. Further, the software aspect adopted by the present invention is also adopted for broadcasting old movies in daily television broadcasting, displaying a back program in one corner, and reproducing video and audio on a CD disc. Therefore, illustrations and explanations thereof are omitted, and the content, configuration, action, etc. are described only with respect to the part related to the unique function related to the gist of the present invention. This is also the case with other embodiments that follow.

The A-channel image storage unit 105 and the B-channel image storage unit 106 are, for example, Max Corporation (Max) of the United States.
Tor Corporation's MXT-1240
As can be seen from S (note, product name), access (proximity for reading, etc.) can be made in sector (fixed unit) units. Each sector is assigned a unique address in the table. In the case of visual images, the amount of data in one frame is 20 sectors (51
2 bytes / sector) is common. However,
In the present embodiment, the data amount of one frame is one sector because it is easy to understand in relation to the explanatory diagram.

With respect to the present embodiment having the above-described structure, first, the operation for editing four cuts as shown in FIG. 5 will be described. FIG. 5 shows the cut A1 →
This is an edit in which the cut B1 → the cut A2 → the cut B2 is switched by the wipe effect. A channel image storage unit 105
Stores cuts A1 and A2 as shown in FIG.

The B channel image storage unit 106 stores cuts B1 and B2 as shown in FIG. The A channel cut connection information memory 101 and the B channel cut connection information memory 102 are respectively reproduction information including original frame cut reproduction information and original channel cut reproduction information including a start frame number of a cut in each channel. I remember.

FIG. 8 shows an example of the original A channel cut reproduction information stored in the A channel cut connection information memory 101, and FIG. 9 shows the B channel cut connection information memory 10.
2 shows an example of original B channel cut reproduction information stored in No. 2. The original start frame number and the original end frame number in FIGS. 8 and 9 respectively indicate the start position and the end position of the cut in the storage medium, and the original reproduction start frame and the original reproduction end frame respectively reproduce the cut from the start of the work. The number of elapsed frames up to and the number of elapsed frames until the end of reproduction are represented.

FIG. 10 shows the inter-cut effect information memory 109.
An example of the inter-cut effect information including the content of the effect to be applied to the video image stored in is shown. In and out points in this figure indicate the number of elapsed frames from the start of the work to the start of the effect and the number of elapsed frames until the end of the work, the effect number indicates the contents of the video effect, and WIPE is a wipe. The number of types of image effects is applied, and the number thereafter indicates which type of wipe is applied in WIPE.

The A channel cut gap filling portion 103 is
Regarding the original A channel cut reproduction information of two consecutive cuts in the original A channel cut reproduction information sent from the channel cut connection information memory 101, of the original A channel cut reproduction information of A1 which is the cut to be reproduced first. It is checked whether or not there is a frame gap, that is, a temporal gap between the original reproduction end frame and the original reproduction start frame of the original A channel cut reproduction information of A2 which is the cut to be reproduced next. Then, in some cases, the number of frames corresponding to this time interval is calculated.

In this case, when the cuts A1 and A2 are arranged on the time axis in the order of reproduction time from the start of the work, it becomes as shown in FIG. FIG. 12 shows a frame unit by enlarging the hatched portion of FIG. The numbers in FIG. 12 are the number of elapsed frames from the start of the work to the reproduction of the cut. As shown in FIG. 12, there is 1 between the two cuts A1 and A2.
There is a gap of 0 frames.

As shown in FIG. 13, the A-channel cut gap filling unit 103 shifts the original end frame of the cut A1 five frames behind and the original start frame of the cut A2 five frames before, thereby making two cuts A1. , A2 is eliminated, and the original start frame number and the original end frame number are converted into the start frame number and the end frame number, respectively.
The video storage output from the A-channel video storage unit 105 is adjusted by generating the channel cut reproduction information.

Here, in the present embodiment, the conversion from the original start frame number to the start frame number is obtained by the following formula. Start frame number = original start frame number = first original start frame number−number of frames shifted before In the present embodiment, the conversion from the original end frame number to the end frame number is obtained by the following formula.

End frame number = original end frame number =
First original end frame number + number of frames shifted backward FIG. 14 shows A channel cut reproduction information. As shown in the figure, the cut A1 is extended backward by 5 frames to become 30 frames, and the cut A2 is extended forward by 5 frames to become 29 frames. And as I explain later,
In the A channel FIFO 107, the frame 0
To frame 58 will be stored.

The B channel cut gap filling portion 104 is
Regarding the original B channel cut reproduction information of two consecutive cuts in the original B channel cut reproduction information sent from the channel cut connection information memory 102, the original reproduction end frame of the original B channel cut reproduction information of the preceding cut Whether there is a temporal gap between the original reproduction start frames of the original B channel cut reproduction information of the next cut is checked.

In this case, when the cuts B1 and B2 are arranged on the time axis in the order of reproduction time from the start of the work, it becomes as shown in FIG.
Meanwhile, there is a gap between the two cuts B1 and B2. Figure 1
Fig. 1 shows an enlarged view of the shaded area of 5 in frame units.
6 shows. The numbers in FIG. 16 are the number of elapsed frames from the start of the work to the reproduction of the cut. As shown in FIG. 16, there are 19 frames between the cut B1 and 10 frames between the cuts B1 and B2 from the start time of the work.

As shown in FIG. 17, the B channel cut gap filling unit 104 sets the original start frame of the cut B1 to 19
By extending the original end frame 5 frames before the frame and the original start frame of cut B2 5 frames before, the start time of the work is between cut B1 and two cuts B
The original start frame number and the original end frame number are converted into the start frame number and the end frame number by eliminating the gap between 1 and B2 to generate the B channel cut reproduction information.

In the present embodiment, the original start frame number to the start frame number and the original end frame number to the end frame number are converted using the formula in the A channel cut gap filling section. FIG. 18 shows B channel cut reproduction information. The start frame number and the end frame number in FIGS. 14 and 18 are the frame start number and the frame end number, respectively, which can specify the cut storage area in the A channel video storage unit, and the reproduction start frame and the reproduction end frame are the start of the work, respectively. Represents the number of elapsed frames from when the cut is played back to the end of playback.

The A channel image storage unit 105 sequentially obtains the recording positions of the cut A 1 and the cut A 2 on the medium from the A channel cut reproduction information sent from the A channel cut gap filling unit 103, and then the A channel data F.
Output to IFO. In this case, the A channel video storage unit 1
The area read from 05 is shown in FIG. Figure 1
The upper and lower two thick line portions in 9 are regions in which the cut length is extended in order to eliminate the gap in the A channel cut gap filling portion 103.

The A-channel data FIFO 107 receives the images of frames 50 to 79 and then 174 to 198 of the A-channel image storage unit, and at the time of displaying and effecting the image, mix effect unit 110.
Output to. The B channel image storage unit 106 sequentially acquires the recording positions of the cut B1 and the cut B2 on the medium from the B channel cut reproduction information sent from the B channel cut gap filling unit 104, and then the B channel data F.
Output to IFO. In this case, the area read from the medium of the B channel image storage unit 106 is shown in FIG. The upper and lower thick line portions in FIG. 20 are regions in which the cut length is extended in order to eliminate the gap in the B channel cut gap filling portion 104.

The B channel data FIFO 108 includes frames 3 to 48 of the B channel video storage unit, and then 1
The video from 08 to 132 is input and is output to the mix effect unit 110 at high speed. Mix effect part 11
0 obtains the inter-cut effect information shown in FIG. 10 from the inter-cut effect information memory 109, and starts the effect designated by the effect number when the number of frames elapsed from the work start time coincides with the IN point. Then, the effect ends when it coincides with the out point. In the case of FIG. 5, the effect is applied three times without turning the switch on or off. The image on which the effect is applied is output as an effect image. FIG. 21 shows a representation of the output result on the time axis. The shaded area in FIG. 21 represents where the video effect is applied. In this case,
Cut between A1 and B1, between B1 and A2, like A2
A wipe corresponding to the number is applied between B2 and B2. (Second Embodiment) FIG. 2 is a block diagram of a second embodiment of the nonlinear video editing apparatus according to the present invention.

In the figure, 201 is an A channel cut connection information memory, 202 is a B channel cut connection information memory, 203 is an A channel cut gap filling section, and 204 is a B channel cut gap filling section. , 205 is a transfer command holding unit, 206 is a randomly accessible video storage unit, 207 is a selector capable of outputting data input as one channel as a plurality of channels, and 208 is a video storage unit 206.
And a selector 207 for two-channel playback video storage, 209 is an A channel data FIFO, 210 is a B channel data FIFO, 211
Is a memory for effect information between cuts, and 212 is a mix effect unit.

Next, the operation principle of the selector 207 which did not exist in the previous embodiment will be described. In this embodiment, the carrier frequencies of the A channel and B channel are the same. Therefore, it is necessary to distinguish whether the transmitted frame is on the A or B channel. in this case,
Judgment is made based on a direct method in which a code indicating the channel to which the frame belongs is added to the inside of the signal of the frame in advance, and the position of the sector in the video storage unit 206 from which the frame is extracted or the extraction time, which is practically equivalent. There is an indirect method such as doing. In this embodiment, the latter is adopted in order to give flexibility to the video to be edited.

The video storage unit 207 is the same as that of the previous embodiment, is accessible in sector units, and each sector is assigned a unique address, and the data amount of one frame is one sector. Occupy. The operation of this embodiment configured as described above will be described by taking as an example the case where four cuts are edited as shown in FIG. 5 as in the first embodiment.

The video storage unit 207 cuts into sectors (positions and addresses) that are separated from each other as shown in FIG.
It stores 1, A2, B1 and B2. A channel cut connection information memory 201, B channel cut connection information memory 202, A channel cut gap filling section 203 and B
The channel cut gap filling unit 204 performs the same operation as in the first embodiment described above, and the A channel cut reproduction information, B
The channel cut reproduction information is sent to the transfer command holding unit 205.

FIG. 14 shows an example of A channel cut reproduction information and FIG. 18 shows an example of B channel reproduction information. The start frame number and the end frame number in FIGS. 14 and 18 respectively indicate the frame start number and the frame end number that can specify the storage area of the cut in the storage medium, and the reproduction start frame and the reproduction end frame are each cut from the start of the work. Represents the number of frames that have elapsed until the playback of and the number of frames that have elapsed until the playback ends.

The transfer command holding unit 205 starts reproduction of the A channel cut reproduction information sent from the A channel cut gap filling unit 203 and the B channel cut reproduction information sent from the B channel cut gap filling unit 204. The frames are referred to and rearranged in the order of reproduction start, and the cut reproduction information is generated on this. FIG. 23 shows the cut reproduction information. The start frame number and the end frame number in this figure respectively indicate the frame start number and the frame end number that can specify the storage area of the cut on the recording medium. It represents the number of frames that have elapsed until the end of playback and the number of frames that have elapsed until the end of reproduction. Figure 2
In 3, the cuts A1, B1, A are cut in the order of the reproduction start frame.
2. The reproduction information of B2 is arranged.

In the video storage section 208 for 2-channel reproduction,
First, based on the cut reproduction information sent from the transfer command holding unit 205, the recording positions of the cuts A1, B1, A2, and B2 on the storage medium are sequentially acquired, and then output. In this case, the area read from the video storage unit 206 is shown in FIG. The upper and lower thick line portions in FIG. 24 are regions in which the cut length is extended to eliminate the gap in the A channel cut gap filling portion 203 and the B channel cut gap filling portion 204. When compared with FIG. 22,
Similar to the first embodiment, the cut B1 is extended 19 frames forward and 5 frames backward. Similarly, the cut A1 is extended by 5 frames to the rear. The same applies to B2 cut and A2 cut.

Next, the selector 207 receives the notification from the transfer command holding unit 205 that the cut reproduction information is the cut reproduction information of the A channel, and then the video storage unit 20.
The video sent from No. 6 is output to the A channel data FIFO 209 as the playback video of the A channel, and when it is the cut playback information of the B channel, it is output to the B channel data FIFO 210 as the playback video of the B channel. Therefore, the cuts A1 and A2 are output as the A channel image, and the cuts B1 and B2 are output as the B channel image.
Then, the contents of information regarding the start and end of reproduction of each frame in the A channel data FIFO 209 and the B channel data FIFO are as shown in FIG.

A channel data FIFO 209, B channel data FIFO 210, cut effect information memory 2
11 and the mix effect unit 212 perform the same operation as in the first embodiment, and obtain the output result shown in FIG. Here, the shaded area in FIG. 21 represents where the video effect is applied as in the first embodiment. (Third Embodiment) FIG. 3 is a block diagram of the third embodiment of the nonlinear video editing apparatus according to the present invention.

In this figure, 301 is an A channel cut connection information memory, 302 is a B channel cut connection information memory, 303 is an A channel cut gap filling section, and 304 is a B channel cut gap filling section. , 305 are transfer command holding units, and 306 and 3
Reference numeral 07 denotes a sub-image (divided image) storage unit that is randomly accessible and can operate in parallel, 308 is a selector that can output one input and multiple outputs, 309 is a sub-image storage unit 306,
A video storage unit composed of 307 and a selector 308, 310 is an A channel data FIFO, 311
Is a B channel data FIFO, 312 is an inter-cut effect information memory, and 313 is a mix effect unit. The sub video storage units 306 and 307 are the same as those in the previous embodiment, and are accessible in sector units, and each sector is assigned a unique address.
In this embodiment, the data amount of one frame occupies two sectors.

The present embodiment configured as described above will be described by taking as an example the case where four cuts are edited as shown in FIG. 5 as in the previous embodiment. As shown in FIG. 25, the sub-image storage units 306 and 307 are cut A1 and cut A1, respectively.
A2, B1 and B2 are divided into odd scanning lines and even scanning lines, and these are shared and partially recorded.

A channel cut connection information memory 301,
B channel cut connection memory 302, A channel cut gap filling section 303 and B channel cut gap filling section 30
4 performs the same operation as the first embodiment, the transfer command holding unit 305 performs the same operation as the second embodiment, and the cut reproduction information is sent to the video storage unit 309. Becomes

FIG. 23 shows cut reproduction information. And
This is the same as the second embodiment. Video storage unit 30
The operation of No. 9 is shown below. The sub video storage unit 306 sequentially acquires the recording positions of the cuts A1, B1, A2, and B2 from the cut reproduction information sent from the transfer command storage unit 305, and then outputs them. In this case, the area read from the sub video storage unit 306 is shown in FIG.
It is shown as 6. The upper and lower thick lines in FIG. 26 are A
In the channel cut gap filling portion 303 and the B channel cut gap filling portion 304, the cut length is extended to eliminate the gap.

The sub video storage unit 307 sequentially acquires the positions of the cuts A1, B1, A2, and B2 on the storage medium from the cut reproduction information sent from the transfer command storage unit 305, and outputs this. In this case, the area read from the sub video storage unit 307 is shown in FIG. The upper and lower thick line portions in FIG. 26 are regions in which the cut length is extended to eliminate the gap in the B channel cut gap filling portion 304.

The selector 308 is used for the sub video storage unit 30.
6 and 307, the images of odd scanning lines and the images of even scanning lines are combined into one image, and the cut reproduction information from the transfer command holding unit 305 is the cut reproduction information of the A channel. A when there is a notification to that effect
It is output to the A channel FIFO 310 as the reproduced image of the channel, and when the cut reproduced information of the B channel is also output, the B channel FIFO 31 is reproduced as the reproduced image of the B channel.
Output to 1. Note that the restoration of the original video information from the divided video information is a well-known technique that is also used in color television broadcasting and the like, and therefore description thereof will be omitted. The cuts A1 and A2 are output as A channel images to the A channel FIFO 310, and the cuts B1 and B2 are output as B channel images to the B channel FIFO 311. The reproduction start frame and reproduction end frame at this time are as shown in FIG. become.

A channel data FIFO 310, B channel data FIFO 311 and inter-cut effect information memory 3
12. The mix effect unit 313 performs the same operation as in the first embodiment described above, and obtains the output result shown in FIG. Here, the shaded area in FIG. 21 shows where the image effect is applied. (Fourth Embodiment) FIG. 4 is a block diagram of the fourth embodiment of the nonlinear video editing apparatus according to the present invention.

In the figure, 401 is an A channel cut connection information memory, 402 is a B channel cut connection information memory, 403 is an A channel cut gap filling section, and 404 is a B channel cut gap filling section. , 405 are transfer command holding units, and 406 and 40
Reference numeral 7 denotes a sub-image storage unit that can be randomly accessed and can perform an alternative operation, 408 is a selector that can output a plurality of inputs to one of a plurality of outputs, and 409 is a sub-image storage unit 40.
6, 407 and a selector 408, which is a video storage unit, 410 is an A channel data FIFO, and 41
Reference numeral 1 is a B channel data FIFO, 412 is an inter-cut effect information memory, and 413 is a mix effect unit.

The sub-image storage sections 406 and 407 are accessible in sector units as in the previous embodiment, and each sector is assigned a unique address, and the data amount of one frame occupies one sector. . The operation of the present embodiment configured as described above will be described by taking as an example the case where four cuts are edited as shown in FIG.

The sub-picture storage section 406 stores cuts A1 and B2 as shown in FIG. 27, and the sub-picture storage section 407 stores cuts B2 and A2. A channel cut connection information memory 401, B channel cut connection memory 40
2. The A channel cut gap filling unit 403 and the B channel cut gap filling unit 404 each perform the same operation as in the first embodiment, and the transfer command holding unit 405 performs the same operation as in the second embodiment. .. Then, the cut reproduction information is sent to the video storage unit 409.

FIG. 23 shows cut reproduction information. This is the same as the second and third embodiments. The operation of the video storage unit 409 is shown below. The sub video storage unit 406 is
From the cut reproduction information sent from the transfer command holding unit 405, the storage positions of the cuts A1 and B2 on the storage medium are sequentially acquired, and then these are output. In this case, the area read from the sub video storage unit 406 is shown in FIG.
8 shows. The upper and lower thick line portions in FIG. 28 are regions in which the cut length is extended to eliminate the gap in the A channel cut gap filling portion 403 and the B channel cut gap filling portion 404.

The sub video storage unit 407 sequentially acquires the positions of the cuts B1 and A2 on the storage medium from the cut reproduction information sent from the transfer command storage unit 405 and outputs them. In this case, the area read from the medium of the sub video storage unit 407 is shown in FIG. The area between the upper and lower thick lines in FIG. 28 is a region where the cut length is extended by the A channel cut gap filling portion 403 and the B channel cut gap filling portion 404 to eliminate the gap.

The selector 408 is used for the sub video storage unit 40.
When the transfer command holding unit 305 notifies that the cut reproduction information is the cut reproduction information of the A channel, the video sent from the S. Then
If it is the cut reproduction information of the B channel, it is output to the B channel data FIFO 411 as a reproduction image of the B channel. In this case, the cuts A1 and A2 are output as A channel images, and the cuts B1 and B2 are output as B channel images.

A channel data FIFO 410, B channel data FIFO 411, inter-cut effect information memory 4
12 and the mix effect unit 413 perform the same operation as in the first embodiment, and obtain the output result shown in FIG. Figure 21
The shaded area in indicates that the video effect is applied. The present invention has been described above based on the embodiments,
Of course, the present invention is not limited to the above embodiments. That is, for example, the following is also included in the present invention. (1) In the embodiment, the transfer parameter is represented by a frame number, and the conversion to the actual hard disk sector number is performed by the A channel cut gap filling section and the B channel cut gap filling section. ,
The sector corresponding to the frame number is described in the B channel cut connection information memory, or the frame number is converted to the sector number in the video storage unit. (2) The video effect and the corresponding frame (cut) at the time of display are specified by starting the FIFOs for all channels at the same time and outputting them at the same speed when the mix effect section operates. The time information is given, and when outputting a predetermined frame (cut) from the video storage unit, position information is used as output time information. In principle, there is no variety of information specifying a frame (cut) and it is time information. . The same method is used for channel identification. (3) The FIFO is activated when the first frame required at the channel (the frame at the tip of the cut) is output without adopting the unified time information as the information for specifying the frame for each channel. The output is based on time. This is because when there are a large number of channels with a small number of frames (cuts) to be displayed or image effects,
This is effective in saving the storage resources of the FO. (4) In the embodiment, a hard disk is used as the image storage unit, but a magneto-optical disk or the like is used as a randomly accessible medium having equivalent performance. (5) One sub video storage unit in the third embodiment is
It is composed of a plurality of sub-image storage units capable of performing alternative operations shown in the embodiment. (6) In the embodiment, the visual image editing is described to facilitate the understanding of the present invention, but it is intended to edit the image having both the image and the audio, or the audio only. That is, the image referred to in the present invention is not limited to information for human vision, but includes only auditory information, and information including both auditory and visual information. In this case, it goes without saying that the display unit also includes a speaker and the like. The specific content of editing the auditory information is the connection of two types of audio scenes corresponding to a wipe in a video, one audio scene is gradually reduced, and the other audio scene is inversely little by little. In the end, the audio type wipe that switches from one audio scene to another audio scene, or even one audio scene completely different from the video, while the other audio scene is used as the background. I can give you something to do for a certain time. (7) Effects of visual image connection include wipe and simple connection, fade-in in which the image gradually appears from the black or white screen, conversely fade-out in which the image disappears, and one image is slightly Dissolve gradually disappears while other images appear darker, DSK (Downstream Keyse) that puts characters in a pictorial image, one image first appears in another image It is a replacement in which a smaller image is displayed and then a larger one is displayed, and a mosaic in which one image is cut into a grid and the arrangement is changed. In the case of mosaic, only one channel is used, but the technique of the present invention is used at the start point and the end point. (8) When synthesizing a plurality of channels, in the case of visual information, bit information of each channel is provided at a predetermined position of a storage element corresponding to a pixel of a CRT storage unit (VRAM) in accordance with the contents of the mix effect. However, in the case of voice information, instead of performing operations on a single storage unit for a single microphone, operations on multiple microphones and the storage unit for each microphone are performed. Alternatively, a microphone dedicated to each channel is provided, and when voice information such as non-display is input from the FIFO, it is not input to the microphone storage unit for the channel. (9) When dividing the image of one frame, it is not based on odd or even scanning lines, but based on R (red), B (blue), and G (green) as in color television broadcasting. (10) When the video of one frame is divided and stored, the storage positions of the divided frames (divided cuts) in each video storage unit are the same or adjusted for each frame (cut), and then the frame is cut. Only one divided frame is stored as the display image effect information of (cut), and the other divided frames (divided cut) are used as they are, or the corrected upstream is used after being adjusted. I have to. (11) The display section is physically and mechanically separated from the video effect section, and the output of the video effect section is once output to a laser disk, a magnetic disk, etc., and the disk is taken out from the video effect section for display. It is built into the department so that people can recognize the edited result. (12) Channels, cuts, and frames that are not displayed in the video effect section are hardened by switching a switch, or software-like by setting 0 to bit information of a frame (cut) that is sent. If the disconnection time is long, the former is adopted. If the disconnection time is short, the latter is adopted. (13) The same cut (frame) of the same channel is used multiple times for display and video effects. (14) Only the cuts (frames) of the same channel are targeted for a video effect such that the display area gradually becomes smaller. (15) The same frame of the same cut on the same channel is duplicated and branched into two, and the branched one is reduced, and the other is adopted in a cut-in-cut form.
For this reason, a function is added to the larger image as necessary so that the other image is delayed by the processing time necessary for reducing the size of the other image and input to the image effect unit. (16) The information for identifying the cuts stored in the display video effect information storage unit is the information for identifying the leading frame and the trailing frame of each cut as in the embodiment, and the fact that the frames between the two frames are continuous. In principle, the actions of the time interval detecting unit and the frame number calculating unit are not information in cut units in principle, but are in each frame unit. (17) For convenience of manufacturing and manufacturing, one constituent element (requirement) of the present invention is physically and mechanically plural, and conversely, a plurality of constituent elements (requirement) is physically and mechanically integrated. , Or a combination of these, as well,
The hard and soft things are integrated. For example, it has a CRT and a microphone as the display unit.

[0076]

As described above, in the video editing apparatus of the present invention, which is mainly intended for digital video, the video storage section that can be arbitrarily accessed and the object to be processed are digital signals. By providing a cut gap filling unit and transfer command holding unit for each channel, multiple cuts can be rearranged according to the purpose without increasing the scale of the device such as wiring for various switches and their operation, installation of a timer, etc. It becomes possible to edit by connecting video effects between them.

[Brief description of drawings]

FIG. 1 is a configuration diagram of a first embodiment of a video editing apparatus according to the present invention.

FIG. 2 is a configuration diagram of a second embodiment of a video editing apparatus according to the present invention.

FIG. 3 is a configuration diagram of a video editing apparatus according to a third embodiment of the present invention.

FIG. 4 is a configuration diagram of a video editing apparatus according to a fourth embodiment of the present invention.

FIG. 5 is a diagram conceptually showing a change in a video when a cut effect is switched and edited after adopting a wipe effect or the like in each embodiment.

FIG. 6 is a diagram showing a state of cuts (frames) stored in an A channel image storage unit in the first embodiment.

FIG. 7 is a diagram similarly showing a state of cuts (frames) stored in the B channel video storage unit.

FIG. 8 is a diagram showing a state of A channel cut reproduction information stored in an A channel cut connection information memory in the first embodiment.

FIG. 9 is a diagram similarly showing a state of B channel cut reproduction information stored in a B channel cut connection information memory.

FIG. 10 is a diagram showing a state of inter-cut effect information stored in an inter-cut effect information memory in the first embodiment.

FIG. 11 is a diagram showing a state of a gap between two cuts of the A channel in the first embodiment.

12 is a detailed view of the contents of the gap shown in FIG.

13 is a diagram showing a state in which a cut is filled in the gap shown in FIG.

FIG. 14 is a diagram showing a state of cut reproduction information of an A channel in the first embodiment.

FIG. 15 is a diagram showing a state of a gap between two cuts of the B channel in the first embodiment.

16 is a detailed view of the contents of the gap shown in FIG.

FIG. 17 is a diagram showing a state in which a cut is filled in the gap shown in FIG. 15.

FIG. 18 is a diagram showing a state of cut reproduction information of a B channel in the first embodiment.

FIG. 19 is a diagram showing an area read from the A channel image storage unit in the first embodiment.

FIG. 20 is a diagram showing an area similarly read from the B channel image storage unit.

FIG. 21 is a diagram showing a state of an editing result in the first embodiment.

FIG. 22 is a diagram showing how cuts are recorded in the video storage unit in the second embodiment.

FIG. 23 is a diagram showing a state of reproduction information of each cut shown in FIG. 22.

FIG. 24 is a diagram showing an area read from a video storage unit in the second embodiment.

FIG. 25 is a diagram showing a state of cuts partially stored in a sub video storage unit in the third example.

FIG. 26 is a diagram showing a state of a region where the cut length is extended to eliminate a gap in the third embodiment.

FIG. 27 is a diagram showing a state of cuts recorded in the sub-image storage unit in the fourth example.

FIG. 28 is a diagram showing a state of a region where a cut length is extended to eliminate a gap in the fourth embodiment.

FIG. 29 is a configuration diagram of a video editing device according to a conventional technique.

[Explanation of symbols]

101, 201, 301, 4, 1 A channel cut connection information memory 102, 202, 302, 402 B channel cut connection information memory 103, 203, 303, 403 A channel cut gap filling unit 104, 204, 304, 404 B channel Cut gap filling unit 105 A channel image storage unit 106 B channel image storage unit 107, 209, 310, 410 A channel data F
IFO 108, 210, 311, 411 B channel data F
IFO 109, 211, 312, 412 Inter-cut effect information memory 110, 212, 313, 413 Mix effect section 205, 305, 405 Transfer command holding section 206 Video storage section 207, 308, 408 Selector 208, 409 2 channel playback video Storage unit 306, 307, 406, 407 Sub video storage unit

Claims (9)

[Claims] 1. An array of cuts constituting a video image of a channel can be stored in association with position information for specifying each cut, and the corresponding cut can be output based on the cut position information. When combining and displaying the video of one channel from the video of a plurality of channels and the video of a plurality of channels, the type of the video effect to be applied to the connection part of different channels, the channel to be displayed and the video effect And a display image effect information storage unit that stores the display image effect information including the identification information of each channel and the position information of the cut to be displayed and the image effect for each channel, and necessary information is read from the display image effect information storage unit. In addition, only the cuts of other channels are displayed between the cuts that are displayed or image effects are displayed before or after each channel. Is a time interval detection unit that checks for each channel whether or not a time interval will be present when applying a video effect, and if the time interval detection unit determines that a time interval exists, the same display is performed. After reading the necessary information from the video effect information storage unit, the number of frames corresponding to the time interval when displaying or applying the video effect is displayed between the two cuts having the time interval in order of each channel or the video effect. Based on the information stored in the display image effect information storage unit, and the frame number calculation unit that calculates for each of the two cuts
When outputting the cuts to be displayed or image effects from the channel dedicated video storage section in that order, based on the number of frames calculated by the frame number calculation section, the display or image effect of For each of the two target cuts, a predetermined number of frames that are stored following the preceding cut and are not targeted for display or video effects are output continuously, or prior to the subsequent cuts. By performing at least one of outputting a predetermined number of stored frames in succession, at least one is performed so that the cuts of the number of frames corresponding to the time interval at the time of performing the display or the video effect are intervened. Under the action of the output adjustment unit for the video storage unit dedicated to each channel to be output after the above, and the output adjustment unit for the video storage unit dedicated to each channel After sequentially storing the cuts output in, the FIFO storage unit dedicated to each channel that is sequentially output, and the cuts that are sequentially output after being divided for each channel from the FIFO storage unit dedicated to each channel, Based on the information stored in the display image effect information storage unit, the cuts to be displayed are sequentially output, and at this time, the predetermined image effect is applied to the cuts that are the object of the image effect, and the cut is displayed. Alternatively, by cutting off the intervening cuts that are not targeted for the video effect, a video effect unit that synthesizes and outputs the video of one channel from the video of multiple channels, and outputs the video effect unit A non-linear video editing device having a display unit for displaying video. 2. Each of the arranged cuts forming an image is stored for each cut in association with cut identification information consisting of identification information and position information of a channel to which the cut belongs, and based on the cut identification information. The video storage unit for multiple channels that can output the cut corresponding to the above, and the type and display of the video effect to be applied to the connection unit of different channels when combining and displaying the video of one channel from the video of the multiple channels. A display image effect information storage unit that stores display image effect information that includes identification information of a channel to which the image effect is applied and display for each channel and cut specifying information of a cut to be the image effect, and the display image effect information. After reading the necessary information from the storage unit, each channel can be displayed before or after the cut of another channel between the cuts that are subject to display or video effects. Since only the video is targeted, the time interval detection unit that checks for each channel whether or not there is a time interval when applying the display or video effect, and the time interval detection unit is configured to detect the time interval. If it is determined that the necessary information is also read from the display image effect information storage unit, a frame corresponding to the time interval for applying the display or image effect between the two cuts having the time interval. Based on information stored in the display image effect information storage unit, a frame number calculation unit that calculates the number of each of the two cuts that are displayed in the order of each channel or targeted for the image effect, and
Based on the number of frames calculated by the frame number calculation unit, when the cuts to be displayed or the image effect are output from the image storage unit in the same channel in the order in which they are first displayed or to be the image effect. , A predetermined number of frames that are not subject to display or video effect and are stored after the preceding cut for every two cuts of the same channel that are subject to display or video effect before and after the channel. The display or image can be output by performing at least one of continuously outputting as a frame or outputting a predetermined number of frames stored prior to the subsequent cut as a frame of the channel. The output is made after interposing the cuts of the number of frames corresponding to the time interval for applying the effect. A video storage unit output adjustment unit, a channel division unit that divides and outputs cuts that are sequentially output under the action of the video storage unit output adjustment unit, and an operation of the channel division unit First, the cuts that have been divided under the following are sequentially stored, and the FIFO storage unit dedicated to each channel that outputs in sequence, and the cuts that are segmented for each channel from the FIFO storage unit dedicated to each channel On the other hand, based on the information stored in the display video effect information storage unit, the cuts to be displayed are sequentially output, and at this time, the video effects determined for the cuts targeted for the video effect are displayed. A video effect that combines and outputs the video of one channel from the video of multiple channels by cutting off the intervening cuts that are not subject to display or video effects. Parts and non-linear video editing apparatus which is characterized in that it has a display unit for displaying the image output from the video effect unit. 3. The cuts arranged to form a video image of a channel are stored for each cut in association with cut identification information consisting of identification information and position information of a channel to which the cut belongs, and the cut identification information is stored. Originally, when combining and displaying multiple video storage units that can output the corresponding cuts and the video of one channel from the video of multiple channels, the type, display and A display image storing the display image effect information including the identification information of the channel targeted for the video effect, the information specifying the display for each channel and the cut targeted for the video effect, and the identification number of the stored video storage unit. After reading the necessary information from the effect information storage unit and the display image effect information storage unit, display or image effect targets are displayed before and after each channel. Since only the cuts of other channels are targeted during the cuts, a time interval detection unit that checks for each channel whether or not there is a time interval when performing a display or video effect, and the time interval. When the detection unit determines that there is a time interval, the necessary information is also read from the display image effect information storage unit and the display or image effect is applied between two cuts having the time interval. Based on the information stored in the frame number calculation unit that calculates the number of frames corresponding to the time interval for each of the two cuts that are displayed or image effects in the order of each channel, and the display image effect information storage unit. To
Based on the number of frames calculated by the frame number calculation unit, when outputting the frames to be displayed or image effect from the plurality of image storage units in the same channel in the order in which they are to be displayed or image effect , 2 of the same channel that is subject to display or video effects before and after the above
For each cut, a predetermined number of frames that are stored after the preceding cut and are not subject to display or video effects are combined and output continuously as the frame of the relevant channel, or prior to the subsequent cut. A predetermined number of stored frames are continuously output as the frame of the channel, or at least one is performed to cut the number of frames corresponding to the time interval when performing the display or video effect. The output adjustment unit for the video storage unit that operates on each channel and each video storage unit that are to be output after being interleaved, and sequentially output under the action of the output adjustment unit for the video storage unit The divided cuts for each channel and outputs the cuts, and the cuts divided under the action of the channel separation unit. The display video effect information storage for the FIFO storage unit dedicated to each channel that is sequentially stored and sequentially output, and the cuts that are sequentially output after being divided for each channel from the FIFO storage unit dedicated to each channel Based on the information stored in the section, the cuts to be displayed are sequentially output, and at this time, the specified video effect is applied to the cuts targeted for the video effect, and the cuts to be displayed or targeted for the video effect are selected. A video effect unit for synthesizing and outputting the video of one channel from the video of a plurality of channels by cutting off the interleaved cuts, and a display unit for displaying the video output by the video effect unit. And a non-linear video editing device. 4. The plurality of video storage units are arranged not for each cut but for each divided cut in a state in which each frame constituting each cut is divided, for an image of at least one channel. Then, for each of the divided cuts, it is stored in association with the divided cut specifying information consisting of the identification information of the channel to which the divided cut belongs, the cut information and the dividing information, and the position information, and based on the divided cut specifying information. Corresponding divided cuts can be output, and for the cut of the channel, the display image effect information stored in the display image effect information storage unit is set for each divided cut. Similarly, the time interval detection unit, the frame number calculation unit, the image The operation of the output adjustment unit for the storage unit and the channel dividing unit is performed for each divided cut. Similarly, based on the divided cut output from the channel dividing unit, There is a divided cut synthesizing unit for synthesizing the cuts by synthesizing one frame of each cut, and then outputting the cuts to the FIFO storage unit dedicated to the channel. The information about the divided cuts stored in the video effect information storage unit is changed to the information about the combined one cut, and the cuts that are input in the upper order divided for each channel The image editing apparatus according to claim 3, wherein the images are combined. 5. The non-linear video editing apparatus according to claim 1, wherein the video storage unit dedicated to each channel stores a digitized video and can output necessary storage contents arbitrarily. 6. The video storage unit according to claim 2, 3 or 4, wherein the video storage unit is capable of storing a digitized video and outputting necessary storage contents. Non-linear video editing device. 7. The A / D information conversion unit, wherein the dedicated video storage unit for each channel stores an analogized image, and digitizes a cut output from the dedicated video storage unit for each channel together with its position information. Display image effect information adjustment for adjusting the display image effect information stored in the display image effect information storage unit in a predetermined manner to match the conversion of the A / D information conversion unit and to exert the action of the image effect unit. The non-linear video editing apparatus according to claim 1, further comprising a section. 8. The video storage unit stores an analogized video, and an A / D information conversion unit that digitizes the cuts or divided cuts output from the video storage unit together with their position information, and the A / D information conversion unit. And a display image effect information adjusting unit that adjusts the display image effect information stored in the display image effect information storage unit in a predetermined manner so as to match the conversion of the / D information converting unit. The non-linear video editing apparatus according to claim 2, claim 3, or claim 4 having. 9. Among the information stored in the display video effect information storage unit, at least one of the types of video effects to be applied, the channels to be displayed and the video effects is, by extension, channel identification information and each channel. 2. The display image effect information changing unit capable of manually changing at least a part of the position information of the cut or the divided cut targeted for the display and the image effect of FIG. The non-linear video editing apparatus according to claim 2, claim 3, claim 4, claim 5, claim 6, claim 7, or claim 8.