JP2008011472A - Special video effector, and method of controlling video player in special video effector - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To designate a position to apply special effecting on a screen while following up the motion of an object in a video image through simple work with respect to the video image recorded in a video player. <P>SOLUTION: Each time a temporal position of a video image is designated by a temporal position designating means, the video image at the designated temporal position is played by a video player 31 via an IF means 13, and a storage means 23 stores data in which the designated temporal position corresponds to a position on the screen designated by a parameter designating means for the video image at the designated temporal position. When executing special effecting, video images are continuously played by the video player 31 via the IF means 13 and each time a video image at a temporal position stored in the storage means 23 is reached, a special effecting means 6 is controlled to apply special effecting to the position on the screen stored in the storage means 23 in accordance with the temporal position. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video special effect device that controls a video playback device to apply a special effect to the playback video, and a method for controlling the video playback device in such a video special effect device.

  In the field of television broadcasting, it is widely performed to apply various special effects to video using a video special effect device such as an effect switcher.

  In a conventional video special effect device, for example, processing for changing a position where a special effect is applied on a screen with time can be performed by time-series control called a key frame / timeline (for example, Patent Documents 1 and 2). reference). “Key frame” is data that associates special effect parameters (parameters indicating the position where special effects are applied on the screen, etc.) with the time code of the frames (one screen of the video) to which the special effects are applied in advance. It is. The “timeline” is data in which a plurality of such key frames are arranged in the time code time order. When executing the special effect, the special effect is applied using the key frame parameter corresponding to the reached time code as time passes. Further, in a time code in which the corresponding key frame does not exist in the time line, a special effect is applied by interpolating the parameters of the preceding and following key frames.

  In addition, in the conventional video special effect device, in order to save the space in front of the operator, a function for controlling a video playback device such as a VTR is provided as an additional function of the control panel for controlling the video special effect device. . Specifically, an RS-422 interface is provided on the control panel to communicate with the VTR, etc., and various controls (recording, recording, etc.) of the VTR are performed by using an additional module of the control panel or switching an existing button. Playback, jog, fast forward, rewind, pause (still image), etc.).

  By the way, in recent years, protection of privacy has become important, and in television broadcasting, special effects such as mosaic are frequently applied to a part of a video (for example, a human face). Since a person in the video is naturally moving, there is a demand for controlling the position of the special effect so as to follow the movement of the object in the video.

  Conventionally, a technique for tracking the movement of an object in an image has also been proposed (see, for example, Patent Document 3). However, in reality, an object that is complicated and changes with time, such as a human face, can be accurately detected. It is difficult to track. In addition, since the object itself to which a special effect is to be applied also changes depending on the scene of the video, it is difficult to process by automatic recognition.

  Here, if the above-described key frame timeline is used, it is possible to change the position on the screen where the special effect is applied with time as specified in advance. However, when an attempt is made to create a key frame / timeline for a video recorded on a video playback device such as a VTR by designating a position on the screen so as to follow the movement of an object in the video, Although the video special effects device has a function to control the video playback device with the control panel, there is no function to easily create such keyframes and timelines, which requires a lot of labor. It was.

  On the other hand, it is possible to change the position where the special effect is applied on the screen with time so as to follow the movement of the object by rendering processing using a computer. However, since the rendering process generally takes time, it is impossible to change the position where the special effect is applied in real time while reproducing the video recorded on the video reproduction device such as the VTR at the same speed as the recording. It is.

JP-A-5-56347 JP-A-5-110945 JP 2000-132691 A

  In view of the above points, the present invention is a position for applying special effects on a screen by following the movement of an object in the video recorded on a video playback device such as a VTR by a simple operation. The position where the special effect is applied can be changed in real time while the video is reproduced at the same speed as recording.

  In order to solve this problem, the video special effect device according to the present invention includes an interface unit for controlling the video playback device, and a special effect for applying a special effect to the video played back from the video playback device. Means, a time position specifying means for performing an operation for specifying a temporal position of an image, and a parameter specifying means for performing an operation for specifying a position where a special effect should be applied on the screen as a special effect parameter; Each time the temporal position is designated by the execution instruction means for performing the operation for instructing the execution of the special effect, the storage means, and the temporal position designation means, the designation is made via the interface means. The video playback device plays back the video at the temporal position, and this parameter is specified for the specified temporal position and the video at the specified temporal position. The key frame / timeline creation means for creating the data corresponding to the parameters specified in the stage and storing the data in the storage means, and the execution instruction means instructing the execution of the special effect Accordingly, each time the video at the temporal position stored in the storage means is reached, the video reproduction apparatus continuously reproduces the video via the interface means, and this time corresponding to the temporal position is reached. And a key frame / timeline executing means for controlling the special effect means so as to apply the special effect to the position on the screen stored as a parameter in the storage means.

  In addition, the control method according to the present invention includes an interface unit for controlling the video reproduction device, a special effect unit for applying a special effect to the video reproduced from the video reproduction device, and a temporal position of the video. Instructing the execution of the special effect and the parameter specifying means for performing the operation of specifying the position where the special effect should be applied on the screen as the special effect parameters. In a control method of a video reproduction device in a video special effect device comprising an execution instruction means for performing an operation, a storage means, and a control means, the control means designates a temporal position by the temporal position designation means Each time, the video reproduction device reproduces the video at the designated temporal position via the interface means, and the designated temporal position. And a step of creating a key frame / timeline for creating data in which the parameter designated by the parameter designation means is associated with the video at the designated temporal position, and storing the data in the storage means In response to the execution of the special effect instructed by the execution instructing means, the control means causes the video reproducing apparatus to continuously reproduce the video through the interface means and stores it in the storage means. A key frame for controlling the special effect means so as to apply a special effect to the position on the screen stored as a parameter in the storage means corresponding to the time position every time the image of the time position is reached. And a timeline execution step.

  According to the above invention, when the operator designates the temporal position of the video by the temporal position designation means, the video at the designated temporal position is automatically reproduced from the video reproduction device. Then, each time the position of the special effect on the screen is designated as a parameter by the parameter designation means, the parameter is associated with the temporal position designated by the temporal position designation means. Data (ie key frames) is created and stored. Therefore, a video playback device can be obtained simply by specifying a plurality of temporal positions and specifying the position on the screen of an object (target to which a special effect is to be applied) in the playback video at each temporal position. In accordance with the movement of the object in the video, the position where the special effect is to be applied can be specified on the screen (key frame / timeline is created).

  Then, after the key frame / timeline is created, when the operator operates the execution instructing means, the video is continuously played from the video playback device, and each time the key frame time position video is reached, the key frame The special effect means is controlled to apply the special effect using the parameters. As a result, the position where the special effect is applied on the screen can be changed in real time while the video is played back from the video playback device at the same speed as when recording.

  Next, another video special effect device according to the present invention includes an interface unit for controlling the video playback device, a special effect unit for applying a special effect to the video played back from the video playback device, Temporal position specifying means for performing an operation for specifying the temporal position of an image, parameter specifying means for performing an operation for specifying a position where a special effect should be applied on the screen as a special effect parameter, and a special effect When the time position is designated by the execution instruction means for performing the operation for instructing the execution, the storage means, and the time position designation means, the designated time is passed through the interface means. Each time a parameter is specified by the parameter specifying means, the parameter and the parameter are specified. Information indicating the temporal position of the video at the specified timing is stored in correspondence with the storage means, and the execution of the special effect is instructed by the execution instruction means. Each time the video playback device continuously plays back video through the interface means and reaches the video at the temporal position stored in the storage means, the storage means corresponds to the temporal position. And a key frame / timeline executing means for controlling the special effect means so as to apply the special effect to the position on the screen stored as a parameter.

  Further, another control method according to the present invention includes interface means for controlling the video reproduction apparatus, special effect means for applying special effects to the video reproduced from the video reproduction apparatus, and video time. A time position specifying means for performing an operation for specifying a target position, a parameter specifying means for performing an operation for specifying a position where a special effect should be applied on the screen as a special effect parameter, and execution of the special effect. In a method for controlling a video reproduction device in a video special effect device comprising an execution instruction means for performing an instruction operation, a storage means, and a control means, the control means is adapted to the temporal position by the temporal position designation means. When this is specified, the video playback device continuously plays back the video from the specified temporal position via the interface means. Each time a parameter is specified by the data specifying means, the key frame timeline for storing the parameter and information indicating the temporal position of the video at the timing at which the parameter is specified is stored in correspondence with the storage means. The creation step and the control means cause the video reproduction apparatus to continuously reproduce the video through the interface means in response to the execution of the special effect by the execution instruction means, and the storage means. A key for controlling the special effect means so as to apply a special effect to the position on the screen stored as a parameter in the storage means corresponding to the temporal position every time an image of the temporal position stored in the screen is reached. And a frame timeline execution step.

  According to the above invention, when the operator designates the temporal position of the video by the temporal position designation means, the continuous video from the designated temporal position is automatically reproduced from the video reproduction device. Each time the position of the special effect on the screen is designated as a parameter by the parameter designation means at the timing of the video at an arbitrary temporal position by looking at the continuous playback video, the parameter and its timing Data corresponding to the temporal position of the video at (ie, key frame) is created and stored. Therefore, simply by specifying the position on the screen of the target object (target to which the special effect is to be applied) at the timing of the video at multiple temporal positions in the continuously played video, A position where a special effect is to be applied on the screen can be specified (create a key frame / timeline) following the movement of the object in the video recorded on the video playback device.

  Then, after the key frame / timeline is created, when the operator operates the execution instructing means, the video is continuously played from the video playback device, and each time the key frame time position video is reached, the key frame The special effect means is controlled to apply the special effect using the parameters. As a result, the position where the special effect is applied on the screen can be changed in real time while the video is played back from the video playback device at the same speed as when recording.

  According to the present invention, for a video recorded on a video playback device such as a VTR, the position of a special effect on the screen can be specified by following the movement of an object in the video by a simple operation. In addition, it is possible to obtain an effect that the position where the special effect is applied can be changed in real time while the video is reproduced at the same speed as the recording.

  Hereinafter, embodiments in which the present invention is applied to an effect switcher will be described with reference to the drawings. FIG. 1 is a diagram showing an example of the overall configuration of an effect switcher to which the present invention is applied. In this effect switcher, a main unit 1 and an operation panel 2 are connected by a communication path 3 such as a LAN (local area network).

  The main unit 1 is supplied with input lines 4 (1) to 4 (9) for inputting video signals from one VTR, video camera, etc. (the video signals are supplied to the input line 4 (1) in the figure). A background video selection switch 5, a special effect circuit 6, and a microcomputer 7 for controlling each part in the main unit 1 are provided.

  The background video selection switch 5 is a switch for selecting a background video from the video on the input lines 4 (1) to 4 (9). The special effect circuit 6 performs mosaic, defocus (processing to blur the image like a lens blur), swirl (images of individual pixels) on the background image selected by the background image selection switch 5 by digital signal processing. This is a circuit that performs special effects such as a process of moving the spiral to obscure the original image. The time required for the special effect circuit 6 to apply one special effect is usually a time for one frame. However, depending on the content of the special effect, processing may be possible in a shorter time (less than one frame). (If pixel mapping is done without going back in scan order, it is not necessary to store the entire frame.)

  The video signal to which the special effect is applied by the special effect circuit 6 is output from the output line 8 to the outside of the main unit 1 and displayed on the monitor 32 and sent to the VTR 33 or a program sending device (not shown). Sent to.

  In practice, the main unit 1 is also provided with two or more background video selection switches and key video selection switches (switches for selecting video used for keying). Functions such as mixing and wiping using the background video selected with two or more background video selection switches, and superimposing the foreground video on the background video using the video selected with the key video selection switch However, since they are not directly related to the present invention, description thereof is omitted.

  The operation panel 2 is a panel for controlling the main unit 1 and an external VTR. The operation panel 2 includes an operation unit 11 for performing various operations on the panel surface, and includes a microcomputer 12 and an RS-422 interface 13 which is a serial communication interface for controlling an external VTR. Is provided.

  Although not shown, the operation unit 11 designates a plurality of buttons for controlling the background video selection switch 5 and the type of special effect applied by the special effect circuit 6 in the same manner as in a normal effect switcher. And a lever for controlling the ratio of the two background images during mixing and wiping.

  In addition, the operation unit 11 performs various controls (recording, playback, jog, fast forward, rewind, pause (still image), etc.) of the VTR, and controls the VTR to be controlled, as in a normal effect switcher. There are buttons for selection, etc., but the input of the time code value of the VTR that reproduces the video is performed by the jog dial 14 shown in FIG. 2 (however, the time code is made by the button instead of the jog dial). You may enter a value).

  Further, as a feature of the present invention, as shown in FIG. 2, the operation unit 11 is provided with various buttons related to creation and execution of a key frame / timeline. Among these, the position designation knob 15 is an operation for designating the horizontal and vertical positions where the special effect should be applied on the screen as a special effect parameter by tilting the rod-like handle vertically and horizontally on the panel surface. Is for doing.

The parameter input unit 16 is used to input parameter values other than the position, such as the following (a) to (d), using a GUI (graphical user interface), a rotary dial, or the like.
(A) Size of the area on the screen where the special effect is applied in the horizontal and vertical directions (b) Degree of effect (granularity in case of mosaic, intensity of blur in case of defocus, change in color, etc.) )
(C) On / off for each type of special effect (mosaic, defocus, spiral, etc.) (d) Number of positions where special effect is applied on the screen

  The timeline creation mode button 17 is a button for instructing start / end of a keyframe / timeline creation mode.

  The display selection button 18 selects whether to apply a special effect or display a mark that clearly shows the original image at the position specified by the position specifying knob 15 when creating the key frame / timeline, This is a button for selecting a mark type (crosshair, transparent circle, transparent square, combination of crosshair and transparent circle or square, etc.) for display.

  The interpolation selection button 19 is a button for selecting whether or not to interpolate between individual key frames when creating a key frame / timeline.

  The key frame registration button 20 is a button for instructing registration of individual key frames when creating a key frame / timeline.

  The timeline execution button 21 is a button for instructing execution of the created key frame / timeline.

  The record button 22 is a button for instructing to record a video with a special effect when the key frame / timeline is executed.

  Note that the layout of buttons and the like shown in FIG. 2 is merely an example, and these buttons and the like may be provided in an appropriate layout. Further, an existing button may be used as a button for creating or executing a key frame / timeline as shown in FIG. 2 by switching modes.

  The microcomputer 12 transmits a command corresponding to the operation content of the operation unit 11 to the microcomputer 7 of the main unit 1 via the communication path 3 or to the VTRs 31 and 33 via the RS-422 interface 13. .

  FIG. 3 is a flowchart showing a process in which the microcomputer 12 creates a key frame / timeline for the video recorded in the VTR. This processing is started in response to the start of the key frame / timeline creation mode being instructed by the timeline creation mode button 17 (FIG. 2) of the operation unit 11, and the time of the VTR that plays the video first is started. Wait until the code value is input with the jog dial 14 (step S1).

  When the time code value is input, the time code value is set as the value of the variable ct (step S2). Then, via the RS-422 interface 13 (FIG. 1), the VTR that reproduces the video (for example, the VTR 31 when the input line 4 (1) is selected by the background video selection switch 5 in FIG. 1) is timed. A command for cueing up to the frame of the code value ct is transmitted (step S3).

  Subsequently, the value ct is stored as the first time code value cts in an area prepared in the memory 23 in the microcomputer 12 for storing key frame timeline data (hereinafter simply referred to as timeline data). At the same time, the selection result of the interpolation selection button 19 (FIG. 2) is stored (step S4). Then, the value of the variable ct is set to ct0 (step S5), the subscript i indicating the key frame number is set to 0 (step S6), and the process waits until a new operation is performed on the operation unit 11. (Step S7).

  When a new operation is performed, the operation content is determined (step S8). When it is determined that an operation for designating a position on the screen has been performed with the position designation knob 15, the designated horizontal and vertical positions are changed to the horizontal and vertical directions on which special effects should be applied on the screen. Are set in variables x and y indicating the position of (step S9). Then, depending on the operation content of the display selection button 18, a special effect is applied to the x and y positions on the screen, or a mark is superimposed so that the original image can be clearly seen at the x and y positions. Is transmitted to the microcomputer 7 of the main unit 1 via the communication path 3 (step S10). Then, the process returns to step S7.

  If it is determined in step S8 that the parameter input unit 16 (FIG. 2) has input a parameter value other than the position, the input parameter value is temporarily stored in the work area of the memory 23 (step S8). S11). If the display selection button 18 is selected to apply a special effect, a command for reflecting the temporarily stored parameter value in the special effect applied to the special effect circuit 7 in step S10 is transmitted. The data is transmitted to the microcomputer 7 of the main unit 1 via the path 3 (step S12). (If display of the mark is selected by the display selection button 18, this step S12 is omitted.) Then, the process returns to step S7.

  If it is determined in step S8 that the key frame registration button 20 (FIG. 2) has been operated, it is first determined whether i is 1 or more and ct and ct0 are in the same state ( Step S13). If yes, the process directly returns to step S7. On the other hand, if no, the “Duration” (key frame KF [i−1] and the next key frame KF [ (ct-ct0) is stored as a value of information indicating how many frames there are between [i] and a special effect parameter value for the key frame KF [i] in step S9. The set x and y values and the parameter values other than the positions temporarily stored in step S11 are stored (however, since the key frame starts with KF [0], Duration is not stored when i = 0) ( Step S14).

  Then, the subscript i representing the key frame number is incremented by 1 (step S15), the value of the variable ct0 is incremented by the value of Duration (step S16), and the process returns to step S7. Note that the determination in step S13 prevents an erroneous key frame from being created by the second and subsequent operations when the key frame registration button 20 is operated twice or more with the same time code value frame. Is for.

  If it is determined in step S8 that a new time code value has been input with the jog dial 14, the time code value is set as a new value of the variable ct (step S17). Then, a command for cueing up to the frame of the time code value ct is transmitted to the VTR for reproducing the video via the RS-422 interface 13 (step S18). Then, the process returns to step S7.

  In step S8, if it is determined that the end of the key frame / timeline creation mode is instructed by the timeline creation mode button 17, the creation of the key frame / timeline is terminated (step S19). Exit timeline creation mode.

  If it is determined in step S8 that another operation has been performed, the process returns to step S7 as it is as processing in the timeline creation mode.

  FIG. 4 is a diagram showing the concept of the key frame / timeline created by the processing of FIG. 3, and the horizontal axis is the time axis. The “key frame” is data in which a special effect parameter is associated with a time code of a video frame to which the special effect is applied in advance. The “timeline” is data in which a plurality of such key frames are arranged in the time code time order. In the example of FIG. 4, the time code (only the units of seconds and frames are shown) indicates the time from 00 seconds 00 frames to 00 seconds 09 frames, 00 seconds 00 frames, 00 seconds added with the characters “KF”. Key frames exist at 04 frames and 00 seconds 09 frames.

  In FIG. 4, variables x and y indicating the horizontal and vertical positions on the screen are shown as special effect parameters, and x = 25 and y = 110 in 00 seconds 00 frame, and 00 seconds. In the 04 frame, x = 30 and y = 120, and in the 00 second 09 frame, x = 50 and y = 95.

  FIG. 5 is a diagram showing a structure of timeline data created and stored by the processing of FIG. 3 corresponding to the example of FIG. Key frames KF [0], KF [1], and KF [2] are created at 00 second 00 frame, 00 second 04 frame, and 00 second 09 frame, respectively. Duration values of key frames KF [0], KF [1], and KF [2] (values stored in step S14 in FIG. 3) are 4, 5, and 5 respectively (however, key frame KF [2] ] Is 5 when the key frame KF [3] is created at 14 frames of 00 seconds).

  The values of the parameters (x, y) of the key frames KF [0], KF [1], KF [2] (values stored in step S14 in FIG. 3) are (25, 110), (30, 120), respectively. ), (50, 95). In FIG. 5, parameters other than the position are not shown.

  “Interpolation designation” is the selection result of the interpolation selection button 19 stored in step S4 of FIG. 3. “step” is not to be interpolated (a frame between key frames and the value at the previous key frame is held). "Linear" indicates that interpolation is performed (in a frame between key frames, values in the immediately preceding key frame and the immediately following key frame are linearly interpolated).

  The first frame cts is the time code value ct stored in step S4 of FIG. 3, and here is 00 seconds 00 frames.

  FIG. 6 is a flowchart showing a process in which the microcomputer 12 executes the key frame timeline created and stored in the process of FIG. This process starts in response to the operation of the timeline execution button 21 (FIG. 2). First, from the timeline data (see FIG. 5) stored in the memory 23 in the process of FIG. Information on cts is acquired (step S21). Then, via the RS-422 interface 13 (FIG. 1), the VTR that reproduces the video (for example, the VTR 31 when the input line 4 (1) is selected by the background video selection switch 5 in FIG. 1) is timed. A command for cueing up to the frame of the code value cts is transmitted (step S22).

  Subsequently, a command for reproducing a video at a normal reproduction speed is transmitted to the VTR via the RS-422 interface 13. When the recording button 22 (FIG. 2) is operated, the recording is started to the VTR (for example, the VTR 33 in FIG. 1) that records the video with the special effect via the RS-422 interface 13. A command is transmitted (step S23).

  Subsequently, the subscript i representing the key frame number is set to 0 (step S24). Then, the value of each parameter (position x, y where the special effect is to be applied on the screen and parameters other than the position) on the screen is read out from the timeline data in the memory 23, and the parameter value is used. Then, a command for controlling the special effect circuit 6 is transmitted to the microcomputer 7 of the main unit 1 via the communication path 3 (step S25).

  Subsequently, it is determined whether or not the key frame from which the parameter is read in step S25 is the last key frame in the timeline data in the memory 23 (step S26). If no, it is determined whether or not “interpolation designation” in the timeline data is “step” (step S27). If yes, the playback frame is counted by the duration value of the key frame KF [i] in the timeline data (step S28), and the process proceeds to step S37.

  If NO in step S27 (if the interpolation designation is “linear”), it is determined whether the duration value of the key frame KF [i] is 1 (step S29). If yes, after waiting for the next frame (step S30), the process proceeds to step S37.

  If NO in step S29 (when the duration value of the key frame KF [i] is 2 or more), the variable j is set to 1 (step S31), and then waits until the next frame (step S31). S32). Then, assuming that the Duration value of the key frame KF [i] in the timeline data in the memory 23 is nf, the parameter value p (i) of the key frame KF [i] for each parameter in the timeline data. And a value Δ obtained by multiplying the difference between the parameter p (i + 1) of the key frame KF [i + 1] by j / nf, that is, Δ = {p (i + 1) −p (i)} × (j / nf). Obtained (step S33).

  Then, the value Δ obtained for the parameter in step S33 is added to the value of each parameter of the key frame KF [i] in the timeline data in the memory 23, and the special effect circuit 6 is used using the added parameter value. Is sent to the microcomputer 7 of the main unit 1 via the communication path 3 (step S34).

  Subsequently, j is incremented by 1 (step S35), and it is determined whether j is smaller than the duration value of the key frame KF [i] (step S36). If yes, it returns to step S32 and repeats steps S32 to S36. If no in step S36, the process proceeds to step S37. In step S37, i is incremented by 1, and the process returns to step S25.

  If the answer is YES in step S26, a playback end command is transmitted to the VTR that has transmitted the playback command in step S23 via the RS-422 interface 13, and the RS-422 interface 13 is transmitted to the VTR that has transmitted the recording start command in step S23. A command to end recording is transmitted via (step S38). Then, the execution of the key frame timeline is finished.

  7 and 8 show the processing contents of FIG. 6 when the “interpolation designation” in the timeline data is “step” and “linear”, taking the parameters x and y of FIG. 4 as an example. It is a figure which shows the difference (difference between the process of step S28, and the process of step S32-S36). Among these, FIG. 7 shows the processing when the interpolation designation is “step”. In the 00 second 01 frame to 00 second 03 frame and 00 second 05 frame to 00 second 08 frame between the key frames, respectively. The special effect circuit 6 is controlled with the same values as the x and y values of the immediately preceding key frame.

  On the other hand, FIG. 8 shows processing when the interpolation designation is “linear”, and each of 00 seconds 01 frames to 00 seconds 03 frames and 00 seconds 05 frames to 00 seconds 08 frames between the key frames is shown. The special effect circuit 6 is controlled by a value obtained by linear interpolation between the x and y values of the immediately preceding key frame and the x and y values of the immediately following key frame. Taking the value of x at 00 second 01 frame as an example, Δ = (30−25) × (1/4) = 1.25 is obtained in step S33 of FIG. 6, and x == 30 in step S34 of FIG. The special effect circuit 6 is controlled by 25 + 1.25 = 26 (the decimal point is rounded off). Taking the value of x at 00 second 02 frame as an example, Δ = (30−25) × (2/4) = 2.5 is obtained in step S33 in FIG. 6, and in step S34 in FIG. The special effect circuit 6 is controlled by x = 25 + 2.5 = 28 (the decimal point is rounded off).

  Next, the manner in which the operator who operates this effect switcher creates a key frame / timeline for the video recorded in the VTR will be described.

[Operation procedure 1]
When creating a key frame / timeline, the operator performs a selection operation using the display selection button 18 or the interpolation selection button 19 (FIG. 2) on the operation unit 11 of the operation panel 2, and then creates a timeline. The mode button 17 (FIG. 2) is used to instruct the start of the key frame / timeline creation mode.

  Then, the VTR (in this case, the input line 4 (1) is selected by the background video selection switch 5 in FIG. The video is reproduced by frame advance or the like. Then, the reproduced video displayed on the monitor 32 (FIG. 1) is viewed through the input line 4 (1) of the main unit 1 (FIG. 1), the background video selection switch 5, the special effect circuit 6, and the output line 8. On the other hand, the time code value of the frame in which the target to which the special effect such as mosaic is desired exists is input by the jog dial 14.

  Then, the video (still image) of the frame of the time code value input with the jog dial 14 is reproduced from the VTR 31 and displayed on the monitor 32 in steps S1 to S3 of the processing of FIG.

[Operation procedure 2]
The operator looks at the display screen of the monitor 32 and designates the position on the screen where the target to which the special effect is to be applied exists with the position designation knob 15 (FIG. 2). Further, the parameter input unit 16 is operated to input parameters other than the position (parameters such as the size of the area on the screen on which special effects are applied, such as (a) to (d) described above).

  Then, if the display selection button 18 is selected to apply a special effect, the key frame / timeline is placed at the position on the screen designated by the position designation knob 15 in steps S10 and S12 of the process of FIG. Has the same special effects as when On the other hand, if mark display has been selected with the display selection button 18, a mark that clearly shows the original image is displayed at the position on the screen designated by the position designation knob 15 at step S10 of the process of FIG. Is displayed. In FIG. 9A, as an example, a face portion of a person is designated with a position designation knob 15 as a position on the screen where a special effect is to be applied, and a mark M (crosshair and transparent square and ) Is displayed.

In addition, when the special effect is selected with the display selection button 18 and when the mark display is selected, it is considered that there are the following advantages and disadvantages, respectively.
(1) When a special effect is selected Advantage: The position can be specified while grasping the result of how the special effect is actually applied when the key frame timeline is executed.
Disadvantage: Since the original image is difficult to see in the portion where the special effect is applied, it may be difficult to adjust the position.
(2) When mark display is selected Advantage: Since the image of the entire screen can always be clearly seen, it is easy to adjust the position.
Disadvantages: The actual results when executing the keyframe timeline cannot be grasped.
The operator compares the advantages / disadvantages, and uses the display selection button 18 to select the one that has priority as an advantage or that can be tolerated as a defect (for example, if you want to prioritize the advantage of being able to grasp the actual result) To select).

[Operation procedure 3]
The operator operates the key frame registration button 20 (FIG. 2) after specifying the position on the screen and inputting parameters other than the position in this way. Then, in step S14 of the process of FIG. 3, the value of the special effect parameter (see FIG. 5) for the first key frame KF [0] is stored in the timeline data area of the memory 23 in the microcomputer 12. The

[Operation procedure 4]
Subsequently, the operator inputs the time code value of the frame for which a key frame is to be created next with the jog dial 14. Then, the video of the frame of the time code value is displayed on the monitor 32 by steps S17 to S18 of the processing of FIG. 3, so that the position on the screen where the special effect is to be applied is positioned as in the case of the first frame. The parameter is designated by the designation knob 15 and parameters other than the position are inputted by the parameter input unit 16.

  Then, a special effect is applied to the position on the screen designated by the position designation knob 15 or the mark is displayed according to the selection result of the display selection button 18 by the steps S10 and S12 of the process of FIG. Is called. In FIG. 9B, the face portion of the same person as in FIG. 9A (however, the position on the screen has changed from the previous frame) is designated by the position designation knob 15, and this face portion is designated. The state where the same mark M as the previous one is displayed is shown.

[Operation procedure 5]
When the operator operates the key frame registration button 20, the value of the special effect parameter for the second key frame KF [1] is stored in the timeline data area of the memory 23 in step S14 of the process of FIG. Is stored, and the Duration value (see FIG. 5) for the first key frame KF [0] is stored.

[Operation procedure 6]
Hereinafter, when the operator repeats the above-mentioned [Operation Procedure 4] and [Operation Procedure 5] as necessary, timeline data as illustrated in FIG. 5 is stored. When the operator uses the timeline creation mode button 17 to instruct the end of the keyframe / timeline creation mode, creation of the keyframe / timeline is completed.

  Thus, in this effect switcher, when the operator designates a time code value with the jog dial 14, the video of the frame of the designated time code value is automatically reproduced from the VTR. Then, when the reproduced image is viewed and the position on the screen where the special effect is to be specified is specified with the position specifying knob 15 or a parameter value other than the position is input with the parameter input unit 16, the values of those parameters, the jog dial, A key frame corresponding to the time code value specified in 14 is created and stored.

  Therefore, the VTR can be simply performed by specifying a plurality of time code values and specifying the position on the screen of the target object (target to which the special effect is to be applied) in the playback video of each time code value frame. In accordance with the movement of the object in the video, the position where the special effect is to be applied can be specified on the screen (key frame / timeline is created).

  Then, after creating the key frame / timeline in this way, when the operator operates the timeline execution button 21 (FIG. 2) on the operation unit 11 of the operation panel 2, the normal reproduction from the VTR is performed by the processing of FIG. The video is continuously reproduced at a speed, and the special effect circuit 6 is controlled so as to apply a special effect using the parameter of the key frame every time the video of the time code value of the key frame is reached.

  As a result, the position for applying the special effect on the screen is reproduced in real time (the time required to apply one special effect in the special effect circuit 6 for one frame while reproducing the video from the VTR at the same speed as recording. Since it is time, even if several special effects are continuously applied, it can be changed (with a delay of only a few frames).

In addition, for the purpose of the operator to execute the timeline,
・ Check: To check the quality ・ Broadcast: To play the video with special effects while playing the video from the VTR ・ Recording: Record the special effects with a recording device such as a VTR For example, when the purpose is to record, if the recording button 22 (FIG. 2) is operated before the timeline execution button 21 is operated, the VTR that reproduces the video can be recorded. At the same time as the playback command, a recording start command is transmitted to the VTR that records the video with the special effect (step S23 in FIG. 6), and at the same time as the playback end command to the VTR that plays the video, the special effect is applied. A recording end command is transmitted to the VTR that records the recorded video (step S38 in FIG. 6). Therefore, it is possible to automatically record a video with a special effect without performing complicated operations by the operator.

  Finally, a modified example of the key frame / timeline creation process shown in FIG. 3 will be described. FIG. 10 is a flowchart showing a modification example of the key frame / timeline creation process, and the same step numbers are assigned to the process parts common to FIG. In this modified example, between step S6 and step S8, instead of the process of step S7 in FIG. 3, it is determined whether or not any new operation has been performed on the operation unit 11 (step S41), and set in advance. The determination as to whether or not the fixed time has passed (step S42) is repeated until the answer becomes yes.

  Further, the processing corresponding to steps S17 and S18 in FIG. 3 is not performed (when it is determined in step S8 that the jog dial 14 has been operated, the process directly returns to step S41).

  If yes in step S41, the process proceeds to step S8. If the answer is yes in step S42, the value of the variable ct is incremented by 1 (step S43), and then queued up to the frame of the time code value ct to the VTR for reproducing the video via the RS-422 interface 13 (FIG. 1). A command to be uploaded is transmitted (step S44). Then, the process returns to step S41. The other processes are the same as those in FIG.

  The fixed time in step S42 is the degree normally required until the operator designates a position where a special effect is desired on the screen or inputs parameters other than the position after the image of one frame is displayed on the monitor 32. For example, several tens of milliseconds to 10 seconds. Further, the operator may arbitrarily set the time with the operation unit 11 or adjust the time with the operation unit 11 according to the progress of the video.

  According to this modified example, when the operator designates a time code value with the jog dial 14, in steps S42 to S44, images of continuous frames from the frame of the designated time code value are sufficiently slow (operator However, it is automatically reproduced from the VTR at a speed at which a position where a special effect is to be applied or a parameter other than the position can be input on the screen of each frame. Then, by watching the continuously reproduced video, the position where the special effect is to be applied on the screen is designated with the position designation knob 15 at any frame timing, and the parameter values other than the position are inputted with the parameter input unit 16. Each time the key frame registration button 20 is operated, a key frame in which the values of these parameters are associated with the time code value at that timing is created and stored.

  Therefore, it is just a simple task to specify the position on the screen of the object (the object to which the special effect is to be applied) at the timing of multiple frames in the video that is continuously played back at a sufficiently low speed. For a video recorded on the VTR, it is possible to follow a movement of an object in the video and specify a position where a special effect is applied on the screen (create a key frame / timeline).

  As a further partial modification to the modification of FIG. 10, both the position specifying knob 15 and the parameter input unit 16 are operated (or at least the position specifying) between the start and end of one frame. When the knob 15 is operated), a key frame may be created and stored at the end of the frame even if the key frame registration button is not operated. As a result, the number of buttons that must be operated within one frame is reduced, so that a key frame timeline can be created even if the video playback speed is somewhat increased.

  Further, the same processing as step S7 in FIG. 3 is performed between step S6 and step S8, and in step S3, in addition to the cue-up command, a command for continuing to reproduce the video at a low speed may be transmitted. Again, it is possible to automatically reproduce the video of continuous frames from the frame of the time code value designated by the operator with the jog dial 14 at a low speed. In that case, as an alternative process to step S43 of FIG. 10, after the process of step S5 is performed, the value of the variable ct is incremented by 1 every time a video of a new frame is reproduced. .

  In the above example, the key frame / timeline execution process of FIG. 6 is started in response to the operation of the timeline execution button 21 (FIG. 2) of the operation panel 2. However, for example, when this effect switcher and an editing device (editor) are connected to each other, a command for instructing execution of a key frame / timeline is sent from the editing device to the microcomputer of the operation panel 2. The microcomputer 12 may start the key frame / timeline execution process of FIG. 6 even when the command is received. Alternatively, a GPI (General Purpose Interface) port, which is a parallel input / output control port, is provided on the operation panel 2, and a command for instructing execution of a key frame / timeline from an external controller via the GPI port is provided to the microcomputer. The microcomputer 12 may start the key frame / timeline execution process of FIG. 6 even when the command is received.

  In the above example, the VTR is controlled via the RS-422 interface. However, the VTR may be controlled via the network.

  In the above example, the VTR is controlled. However, a video playback device or a recording device other than the VTR (for example, an optical disk or a hard disk used as a recording medium) may be controlled.

  In the above example, the present invention is applied to the effect switcher. However, the present invention is an apparatus other than the effect switcher, which controls the video playback device and applies a special effect to the playback video. May also apply.

It is a figure which shows the example of whole structure of the effect switcher to which this invention is applied. It is a figure which shows the button etc. relevant to a key frame timeline on the operation part of an operation panel. It is a flowchart which shows the process which the microcomputer of an operation panel produces a key frame timeline. It is a figure which shows the concept of a key frame timeline. It is a figure which shows the data structure of the key frame timeline produced and memorize | stored by the process of FIG. It is a flowchart which shows the process in which the microcomputer of an operation panel performs a key frame timeline. It is a figure which illustrates the value of x, y in the frame between key frames when interpolation specification is "step". It is a figure which illustrates the value of x and y in the frame between key frames when interpolation specification is "linear". It is a figure which shows the example of the screen display at the time of key frame timeline preparation. It is a flowchart which shows the example of a change of the process of FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Main unit, 2 Operation panel, 3 Communication path, 4 (1) -4 (9) Input line, 5 Background image selection switch, 6 Special effect circuit, 7 Microcomputer, 11 Operation part, 12 Microcomputer, 13 RS- 422 interface, 14 jog dial, 15 position designation knob, 16 parameter input section, 17 timeline creation mode button, 18 display selection button, 19 interpolation selection button, 20 key frame registration button, 21 timeline execution button, 22 recording button, 23 Memory, 31, 33 VTR, 32 monitor

Claims (9)

Interface means for controlling the video playback device;
Special effect means for applying a special effect to the video played from the video playback device;
A temporal position specifying means for performing an operation of specifying a temporal position of the video;
As the special effect parameter, parameter specifying means for performing an operation for specifying a position on the screen where the special effect should be applied;
Execution instruction means for performing an operation to instruct execution of the special effect;
Storage means;
Each time the temporal position is designated by the temporal position designation means, the video reproduction apparatus is caused to reproduce the video at the designated temporal position via the interface means, and the designated temporal position is And key frame timeline creation means for creating data in which the parameter designated by the parameter designation means is associated with the video at the designated temporal position and storing the data in the storage means When,
In response to an instruction to execute a special effect by the execution instruction unit, the video reproduction device continuously reproduces the video through the interface unit, and the video at the temporal position stored in the storage unit A key frame timeline executing means for controlling the special effect means so as to apply the special effect to a position on the screen stored as a parameter in the storage means corresponding to the time position. A video special effect device characterized by comprising: The video special effect device according to claim 1,
The key frame / timeline execution means stores an image of a temporal position between two temporal positions stored in the storage means in the storage means corresponding to the two temporal positions. A video special effect device, wherein the special effect means is controlled so as to apply the special effect to a position obtained by interpolating a position on a screen. The video special effect device according to claim 1,
The key frame / timeline creation means controls the special effect means so as to apply the special effect to the position on the screen designated by the parameter designation means for the video reproduced from the video reproduction device. This is a video special effects device. The video special effect device according to claim 1,
The key frame / timeline creation means identifies the position of the video reproduced from the video reproduction device without applying the special effect to the position on the screen designated by the parameter designation means. The video special effect device is characterized in that the special effect means is controlled to display the mark. The video special effect device according to claim 1,
An interface means for controlling the video recording apparatus;
The video special effect device, wherein the key frame / timeline execution means causes the video recording device to record the video output from the special effect means. The video special effect device according to claim 1,
The parameter designating unit is further for performing an operation of designating the size of the area to be subjected to the special effect on the screen and / or the degree of the special effect as a parameter other than the position,
The video special effect device characterized in that the key frame / timeline execution means controls the special effect means using parameters other than the position. Interface means for controlling the video playback device;
Special effect means for applying a special effect to the video played from the video playback device;
A temporal position specifying means for performing an operation of specifying a temporal position of the video;
As the special effect parameter, parameter specifying means for performing an operation for specifying a position on the screen where the special effect should be applied;
Execution instruction means for performing an operation to instruct execution of the special effect;
Storage means;
In a video playback device control method in a video special effect device comprising a control means,
Each time the control means designates a temporal position by the temporal position designation means, the video reproduction apparatus reproduces the video at the designated temporal position via the interface means, and the designation A key frame for creating data in which the specified temporal position is associated with the parameter specified by the parameter specifying means for the video at the specified temporal position, and storing the data in the storage means・ Timeline creation step,
In response to the execution of the special effect instructed by the execution instructing unit, the control unit causes the video reproducing device to continuously reproduce the video through the interface unit, and is stored in the storage unit A key frame for controlling the special effect means so as to apply the special effect to a position on the screen stored as a parameter in the storage means corresponding to the temporal position each time a video at a temporal position is reached. And a timeline execution step. A method for controlling a video reproduction device in a video special effect device. Interface means for controlling the video playback device;
Special effect means for applying a special effect to the video played from the video playback device;
A temporal position specifying means for performing an operation of specifying a temporal position of the video;
As the special effect parameter, parameter specifying means for performing an operation for specifying a position on the screen where the special effect should be applied;
Execution instruction means for performing an operation to instruct execution of the special effect;
Storage means;
When the temporal position is designated by the temporal position designation means, the video reproduction device is caused to continuously reproduce video from the designated temporal position via the interface means, and the parameter designation is performed. Each time a parameter is designated by the means, the key frame and timeline creation means for storing the parameter and information indicating the temporal position of the video at the timing when the parameter is designated in association with the storage means When,
In response to an instruction to execute a special effect by the execution instruction unit, the video reproduction device continuously reproduces the video through the interface unit, and the video at the temporal position stored in the storage unit A key frame timeline executing means for controlling the special effect means so as to apply the special effect to a position on the screen stored as a parameter in the storage means corresponding to the time position. A video special effect device characterized by comprising: Interface means for controlling the video playback device;
Special effect means for applying a special effect to the video played from the video playback device;
A temporal position specifying means for performing an operation of specifying a temporal position of the video;
As the special effect parameter, parameter specifying means for performing an operation for specifying a position on the screen where the special effect should be applied;
Execution instruction means for performing an operation to instruct execution of the special effect;
Storage means;
In a video playback device control method in a video special effect device comprising a control means,
In response to the temporal position being designated by the temporal position designation means, the control means reproduces video from the designated temporal position to the video reproduction device continuously via the interface means. Each time a parameter is specified by the parameter specifying means, the parameter and information indicating the temporal position of the video at the timing when the parameter is specified are stored in correspondence with the storage means.・ Timeline creation step,
In response to the execution of the special effect instructed by the execution instructing unit, the control unit causes the video reproducing device to continuously reproduce the video through the interface unit, and is stored in the storage unit A key frame for controlling the special effect means so as to apply the special effect to a position on the screen stored as a parameter in the storage means corresponding to the temporal position each time a video at a temporal position is reached. And a timeline execution step. A method for controlling a video reproduction device in a video special effect device.

Images