JP2006140872A - Control system using operating unit - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video edit system capable of establishing the compatibility between a delicate operation and a rough operation. <P>SOLUTION: An operation presence discrimination means 14 discriminates whether or not a pedal controller 2 is stepped in on the basis of a manipulated variable acquired by a manipulated variable acquisition means 10. When detecting the pedal controller 2 changed from a non-operating state into an operating state, the operation presence discrimination means 14 informs a count means 16 about the change. Further, when detecting the pedal controller 2 changed from an operating state into the non-operating state, the operation presence discrimination means 14 informs a control signal output means 12 about the change. When the operation presence discrimination means 14 detects the non-operating state before the control signal output means 12 receives a time-up signal from the count means 16, the control signal output means 12 outputs a feed control signal of a prescribed frame. When the control signal output means 12 receives the time-up signal from the count means 16 before the operation presence discrimination means 14 detects the non-operating state, the control signal output means 12 carries out a frame feed in response to the manipulated variable. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a control system using an operating device, and more particularly to improving the operability thereof.

  A device that receives an operation output of an operation device and performs control based on the operation amount is used. For example, an operation device called a pedal controller as shown in FIG. 1 is known (Patent Document 1). In this pedal controller, a pedal 2 is attached via a bearing 3 provided on the base 1. When the pedal 2 is depressed in the direction of arrow F, the rack 5 moves in the same direction. The rack 5 rotates the pinion 7 provided on the rotating shaft of the sliding resistor 6. Therefore, a control signal (resistance value) corresponding to the depression of the pedal 2 can be output.

  The pedal 2 is provided with a protrusion 4 and is urged by a spring 9. Accordingly, when the depression of the pedal 2 is stopped, the pedal 2 returns to the original position.

  In addition to the pedal controller, an operation device such as a mouse or a trackball is used.

Japanese Utility Model Publication No. 7-034489

  However, in these operating devices, depending on the work content, it may be difficult to change the value of the control signal slightly. For example, let us consider a case where a pedal controller is used when editing is performed while a video is being reproduced by a computer. The video is processed with a mouse or the like, and the pedal controller is operated to search for a desired frame.

  The value of the output signal of the pedal controller proportional to the depression is taken into the CPU through the A / D converter. The CPU sends a frame according to the value of this output signal. However, one frame is an extremely short time, and it is extremely difficult to perform an operation of sending only one frame and displaying the next frame. In order to solve this, it is possible to prevent one frame from being fed unless the pedal controller is depressed considerably. However, if you want to move a lot (you want to send a lot of frames), this will reduce the work efficiency.

  An object of the present invention is to solve the above-described problems and to provide a control system capable of achieving both delicate operation and significant operation.

(1) The video editing system according to the present invention includes an operation device, operation amount acquisition means for acquiring an operation amount from the operation device, and presence / absence of an operation for determining whether the operation device is in a non-operation state or an operation state. The determining means, the time measuring means for determining that a predetermined time has elapsed after the operating device has changed from the non-operating state to the operating state, and the operating device is in a non-operating state before the time measuring means counts the predetermined time. If a control signal indicating a predetermined number of frame movements is output at the time of the change to the non-operation state, and the operation state of the operation device is maintained even after the time measuring means has timed the predetermined time, A control signal output means for outputting a control signal indicating the number of frame movements according to the operation amount; and a video editing means for moving the video in accordance with the control signal from the control signal output means and receiving an edit input. I have.

  Therefore, if the operating device is stepped on and released within a predetermined time, the predetermined frame can be easily moved. Furthermore, if it is desired to adjust the frame feed amount in accordance with the depression of the pedal, it may be continued for a predetermined time. Therefore, both subtle frame feed and large frame feed are easy to operate.

(2) (3) (4) A control system using an operating device according to the present invention includes an operating device, operating amount acquisition means for acquiring an operating amount from the operating device, and whether the operating device is in a non-operating state. Operation presence / absence determining means for determining whether or not the operating state is present, timing means for determining that a predetermined time has elapsed after the operating device has changed from the non-operating state to the operating state, and until the timing means counts the predetermined time In addition, when the operating device is in a non-operating state, a control signal indicating a predetermined numerical value is output when the operating device is changed to the non-operating state, and the operating state of the operating device is not changed even after the time measuring means measures a predetermined time. If it is maintained, a control signal output means for outputting a control signal indicating a numerical value corresponding to the operation amount is provided.

  Therefore, a predetermined numerical control signal can be easily output by depressing the operating device and releasing it within a predetermined time. Furthermore, if it is desired to adjust the numerical value of the control signal according to the depression of the pedal, it may be continuously depressed for a predetermined time. Therefore, the operation is easy both when outputting a predetermined numerical value and when outputting a numerical value corresponding to the depression.

(5) The control system according to the present invention is characterized in that the operation presence / absence determining means determines whether the operating device is in a non-operating state or an operating state based on an operation amount from the operating device. Therefore, the configuration can be simplified.

(6) In the control system according to the present invention, when the operation amount acquired by the operation amount acquisition means is greater than a predetermined threshold value, the control signal output means immediately determines a predetermined numerical value or A control signal indicating a numerical value corresponding to the operation amount is output.

  Therefore, when it is desired to output a large numerical value, it can be output without a time lag.

(7) The control system according to the present invention is characterized in that the operating device is a pedal controller type operating device.

  In a pedal controller that must be operated with feet, it is difficult to adjust the amount of depression. Therefore, the effect of applying the present invention is great.

(8) The control system according to the present invention is provided with a first operating device and a second operating device, and the control signal output means outputs the first operating device in response to the operation of the first operating device. The numerical value indicated by the control signal and the sign of the numerical value indicated by the second control signal output in response to the operation of the second operating device are reversed.

  If the two controllers are associated with each other so as to output numerical values with different signs, an intuitive operation becomes easy.

(9) The control system according to the present invention is characterized in that the control signal output means outputs, to the video editing apparatus, a frame advance signal for performing frame advance corresponding to a numerical value as a control signal.

   Therefore, both the subtle frame feed and the large frame feed are easy to operate.

(10) In the control system according to the present invention, the control signal output means outputs a signal for performing forward frame feed as the first control signal, and performs the reverse frame feed as the second control signal. It is characterized by outputting a signal.

  Therefore, it is effective for editing work performed while sending and returning frames.

(11) The control method according to the present invention obtains the operation amount from the operating device, determines whether the operating device is in the non-operating state or the operating state, and the operating device changes from the non-operating state to the operating state. After that, when it is determined that the predetermined time has elapsed and the operation device is in a non-operating state before the predetermined time is counted, a control signal indicating a predetermined numerical value is displayed when the operating device is changed to the non-operating state. When the operation state of the operating device is maintained even after the output and the time measuring means time the predetermined time, a control signal indicating a numerical value corresponding to the operation amount is output.

  Therefore, a predetermined numerical control signal can be easily output by depressing the operating device and releasing it within a predetermined time. Furthermore, if it is desired to adjust the numerical value of the control signal according to the depression of the pedal, it may be continuously depressed for a predetermined time. Therefore, the operation is easy both when outputting a predetermined numerical value and when outputting a numerical value corresponding to the depression.

  Furthermore, the video editing apparatus according to the present invention has the following features.

  A video editing apparatus according to the present invention is a video editing apparatus for applying a user-desired special effect to given video data, and (a) reads the video data and sequentially sets the image frames at a predetermined timing. Image frame display means for displaying; (b) special effect image display means for displaying a special effect image based on a user operation superimposed on the image frame; and (c) an image frame displayed on the image frame display means. Special effect information recording means for recording information relating to the special effect image displayed on the special effect image display means when the change is detected, directly or indirectly associated with a predetermined image frame; Features. Therefore, a special effect can be applied to the image frame while reproducing the video data. Thereby, editing efficiency can be improved.

  In the video editing apparatus according to the present invention, (d) before changing the image frame in the image frame display means, the image frame before the change and the special effect image displayed in the special effect display means are synthesized and output. The image frame composition output means is further provided. Therefore, while reproducing the video data, it is possible to perform a special effect on the image frame and edit the video by accurately specifying the image frame to be subjected to the special effect. Thereby, editing accuracy can be improved.

  The video editing apparatus according to the present invention is a video editing apparatus for applying a user-desired special effect to given video data. (A) The video data is read and an image frame is read at a predetermined timing. Image frame display means for sequentially displaying; (b) special effect image display means for displaying a special effect image based on a user operation superimposed on the image frame; and (d) before changing the image frame in the image frame display means. And a synthesized image frame output means for synthesizing and outputting the image frame before change and the special effect image displayed on the special effect display means. Therefore, while reproducing the video data, it is possible to perform a special effect on the image frame and edit the video by accurately specifying the image frame to be subjected to the special effect. Thereby, editing accuracy can be improved.

  In the video editing apparatus according to the present invention, the special effect image display means displays the special effect image at a position determined based on a user operation. Therefore, the special effect image can be displayed at the position desired by the user in the image frame being edited. Thereby, editing accuracy can be improved.

  In the video editing apparatus according to the present invention, the special effect image display means displays a special effect image having a shape determined based on a user operation. Therefore, a special effect image having a shape desired by the user can be displayed in the image frame during video editing. Thereby, editing accuracy can be improved.

  In the video editing apparatus according to the present invention, the special effect image display means determines the shape of the special effect image based on the shape input by the user with the pen tablet. Therefore, a special effect with higher accuracy can be applied to an image frame during video editing.

  In the video editing apparatus according to the present invention, the special effect information recording means records the time on the same timeline, thereby associating information on the special effect image with a predetermined image frame. To do. Therefore, it is possible to easily associate the image frame in the video data with the information related to the special effect image applied to the image frame. In addition, it is not necessary to record the actual data of the image frame, and after editing, the edited video data can be stored based on the time on the timeline of the information about the image frame and the special effect image and the original video data. Can be generated.

  In the present invention, the “program” is not only a program that can be directly executed by the CPU, but also a program in a source format, a compressed program, an encrypted program, a program that can be installed and operated by a hard disk, etc. It is a concept that includes.

  In the embodiment, “operation amount acquisition means” corresponds to steps S1, S2, S4, and S7.

  The “time measuring means” may be hardware or software as long as it can measure time. In the embodiment, the internal timer of the CPU 203 corresponds to this.

  The “control signal output means” corresponds to the flowchart of FIG. 8 in the embodiment.

  In the embodiment, the “video editing unit” corresponds to the video editing device of FIG.

1. Overall Configuration FIG. 2 shows the overall configuration of a video editing system according to an embodiment of the present invention. A signal indicating the operation amount of the pedal controller 2 is acquired by the operation amount acquisition means 10. The operation presence / absence determination unit 14 determines whether or not the pedal controller 2 is operated (whether the pedal is depressed) based on the operation amount signal acquired by the operation amount acquisition unit 10. When detecting that the pedal controller 2 has changed from the non-operating state to the operating state, the operation presence / absence determining unit 14 notifies the time measuring unit 16 of this. Further, when it is detected that the operation state has changed to the non-operation state, this is transmitted to the control signal output means 12.

  When the operation presence / absence determining unit 14 detects the operation state, the time measuring unit 16 starts measuring the time in response to the operation state. The time measuring means 16 gives a time-up signal to the control signal output means 12 when a predetermined time has elapsed from the start of time measurement.

  If the operation presence / absence determining unit 14 detects a non-operation state before receiving the time-up signal from the time measuring unit 16 (that is, if the predetermined time has not elapsed), the control signal output unit 12 performs the following processing. I do. The control signal output means 12 outputs a control signal for sending a predetermined number of frames. In response to this control signal, the video editing means 18 advances (returns) the image by the number of frames. Therefore, if the pedal controller 2 is lightly pressed and immediately returned, frame advance (return) of a predetermined frame can be performed.

  When the control signal output unit 12 receives a time-up signal from the time measuring unit 16 before the operation presence / absence determination unit 14 detects the non-operation state (that is, if a predetermined time has elapsed), the control signal output unit 12 Process. The control signal output unit 12 outputs a feed (return) control signal corresponding to the operation amount acquired by the operation amount acquisition unit 10. The video editing means 18 receives this control signal and advances the image at a speed according to the operation amount. Therefore, if the pedal controller 2 is continuously pressed, it can be fed (returned) at a speed corresponding to the depression depth.

2. First embodiment 2-1. Functional Block Diagram FIG. 3 shows a functional block diagram of a video editing apparatus that is the video editing means 18. The video editing apparatus includes an image frame display unit 101, a special effect image display unit 103, a special effect information recording unit 105, an image frame synthesis unit 107, a video data recording unit 109, an input operation unit 111, and an editing data recording unit 113. ing.

  The video data recording unit 109 records video data to be subjected to special effects. The image frame display means 101 reads the video data from the video data recording unit 109 and displays the image data at a predetermined timing. A control signal from the control signal output unit 12 in FIG. 2 is given to the image frame display unit 101.

  The input operation unit 111 acquires input operation information for image editing such as special effect processing generated by the user's input operation. The special effect image display unit 103 displays a special effect image based on the input operation information acquired by the input operation unit 111. The special effect information recording unit 105 associates the image frame displayed by the image frame display unit 101 with the special effect image displayed by the special effect image display unit 103 and records it in the editing data recording unit 113. The image frame synthesis means 107 synthesizes and outputs the image frame displayed by the image frame display means 101 and the special effect image displayed by the special effect image display means 103.

2-2. Hardware Configuration FIG. 4 shows an example of a hardware configuration in which the video editing system shown in FIGS. 2 and 3 is realized using a CPU. The video editing apparatus includes a display 201, a CPU 203, a memory 205, a keyboard / mouse 207, a hard disk 209, a CD-ROM drive 211, a communication circuit 215, a joystick 213, a pedal controller 217, and a pen tablet 219. In this embodiment, a pedal controller 217 is used as an operating device. The joystick 213 and the pen tablet 219 serve as an input operation unit 111 for editing special effects and the like.

  The hard disk 209 includes a feed back control program 2097 for controlling the image frame in accordance with an input from the pedal controller 217, a video editing program 2091 for performing video editing processing, video data 2093 to be subjected to special effects, and special data. Record the edit data generated after applying the effect. Feed control program 2097. The video editing program 2091 is obtained by reading and installing a program recorded on the CD-ROM 212 via the CD-ROM drive 211. The installation may be performed using a program downloaded from the Internet 216 or the like using the communication circuit 215.

  Specific examples of the joystick 213, the pedal controller 217, and the pen tablet 219 are shown in FIG. 5A shows a joystick 213, which includes a slider portion 231 and a stick portion 233. FIG. The slider part 231 can perform a single-axis operation in the front-rear direction, and has four buttons 232 on the side surface. The stick portion 233 can perform three-axis operations in the front-rear direction, the left-right direction, and the left-right rotation direction, and has three buttons 234 at the top. When the user operates the joystick 213, the CPU 203 changes the position and shape of a special effect image such as mosaic processing and displays the result on the display 201 in accordance with the operation.

  B of FIG. 5 is a pedal controller 217, which includes a base portion 250, a left foot pedal 251 and a right foot pedal 253. The left foot pedal 251 and the right foot pedal 253 have variable resistors, and the resistance value of the variable resistor changes according to the pedal depression angle (operation amount) of the user, and data corresponding to the resistance value is obtained. It is designed to output. In addition, the amount of depression may be detected by generating a pulse in response to depression and counting the pulse.

  The pedal controller 217 outputs an operation amount signal of 0 to 100% as described above. 0% is when there is no depression, and 100% is when the depression is complete. The pedal controller 217 is configured so that the playback speed and playback direction of video data can be adjusted.

  C in FIG. 6 is a pen tablet 219, which includes a video display screen unit 271 having an LCD capable of displaying video data and a pen shaft 273. Note that a rotation mechanism is provided at the lower part of the video display screen unit 271 so as to be horizontally rotated in the direction desired by the user. By bringing the tip of the pen shaft 273 into contact with the video display screen portion 271 on which the video data is displayed, the CPU 201 recognizes that the pen is placed and its position.

2-3. Processing Details Processing details in this embodiment will be described with reference to FIG. In the present embodiment, for each image frame recorded in a video data file created in an avi (Audio Video Interleaving) format, a mosaic process is performed on a predetermined portion of each image frame while the video file is played back. An example of creating edit data and mosaic processed composite data will be described. In addition, after performing the processing, it is possible to generate video data that has been subjected to mosaic processing in an arbitrary format using the editing data. The avi format is a format developed by Microsoft for handling moving images with audio in Windows (trademark).

2-3-1. Starting the video editing program When the user double-clicks or selects a predetermined icon indicating the video editing program 2091 displayed on the display 201 using the keyboard / mouse 207, the CPU 203 starts the video editing program 2091. An operation screen 70 as shown in FIG. 12 is displayed on the display 201.

  As shown in FIG. 12, on the operation screen 70, a display area 700 for reproducing the video data selected by the user operation and a playback button group 701 for instructing a playback method of the video data are displayed. The playback button group 701 includes “stop”, “start”, “rewind”, “play”, “pause”, “frame reverse”, “frame forward”, “fast forward”, “last”, “ Buttons on the screen for giving instructions such as “previous scene detection” and “rear scene detection”.

  The user clicks the “From AVI file” button 705 on the operation screen 70 to open a video data file selection screen (not shown), and a desired video data file 2093 (for example, aaa.avi) is displayed on the video data file selection screen. Etc.), the CPU 203 starts a playback application associated with the extension of the video data file (for example, “.avi”, etc.), and pauses the top image frame of the video data file. It is displayed in the display area 700. For example, an image frame as shown in FIG.

  When the user clicks the “Pattern” button 707 on the operation screen 70, the CPU 203 displays the name of the pattern shape of the selectable special effect image in the drop-down list. Similarly, when the user clicks a “Type” button 708, the CPU 203 displays the name of the pattern type of the special effect image that can be selected from the drop-down list.

  For example, when the user clicks the “Pattern” button 707, selects “Elipse”, clicks the “Type” button 708, and selects “Mosaic”. The CPU 203 displays an elliptical mosaic image 401 near the center of the image frame in the display area 700, as shown in FIG. 9B. The user may select a “Pattern (pattern)” other than an ellipse such as a rectangle or a triangle. Therefore, the special effect image may be selected in accordance with the shape of the predetermined portion where the special effect is desired. Further, the user may select “Type (type)” other than a mosaic such as a color reversal image or a predetermined image. Therefore, the special effect image may be selected in accordance with the shape of the predetermined portion where the special effect is desired.

  When the user operates the keyboard / mouse 207 or the joystick 213 according to the shape of a predetermined part to which the special effect of the image frame is desired, the CPU 203 changes the shape, size, etc. of the special effect image and displays it. 201 is displayed. When the user performs an operation of tilting the stick portion 233 of the joystick 213 in the front / rear / left / right direction, the CPU 203 performs a display for moving the center coordinates of the elliptical mosaic image 401. Note that the center coordinates in this case may be obtained by calculating the center of gravity of the pixels constituting the ellipse. Further, when the user performs an operation of rotating the stick unit 233 around the axis, the CPU 203 performs a display for rotating the elliptical mosaic image 401 around the screen vertical direction of the center coordinates.

  When the user performs an operation of tilting the slider portion 231 of the joystick 213 in the front-rear direction while pressing a predetermined button 232, the CPU 203 performs a display for changing the size of the elliptical mosaic image 401. Similarly, when the operation of tilting the slider portion 231 of the joystick 213 in the front-rear direction while pressing the predetermined button 232 is performed, the CPU 203 performs the aspect ratio (vertical / horizontal ratio) and border size (edge portion of the edge portion) of the elliptical mosaic image 401. (Width) or the block size of the mosaic (the size of the rectangle constituting the mosaic) is displayed. For example, when the elliptical mosaic image 401 is transformed into a reduced circular shape as shown in FIG. 9C and further moved to the left as shown in FIG. 9D, a predetermined portion showing a human face 403 can be completely covered with the mosaic image 401.

2-3-2. Video Editing Process In the video editing process, a special effect such as a mosaic is applied to each image frame of the video data in response to an operation of the slider unit 231 or the stick unit 233 during playback of the video data.

  FIG. 6 shows an example of a processing flowchart in the case where the video editing program 2091 performs mosaic processing on video data. When the user presses the video data playback button 701 from the state shown in FIG. 9D, the CPU 203 starts video editing processing. Note that the playback button 701 can be pressed by pressing the button 234 of the stick 231 or the like.

  In the video editing process, the display of the mosaic image is updated in response to the user operation, the editing data recording process for recording the image frame and the mosaic information in association with each other, and the video data is input at a predetermined timing. In addition to displaying image frames of video data, it has video data playback processing for acquiring mosaic information and synthesizing the image frames and mosaic images to output video. That is, the editing data recording process and the video data reproduction process are started as independent threads on the CPU 203, and each of them cooperates to constitute a video editing process.

2-3-2-1. Frame Sendback Processing Editing processing is performed as described above. First, it is necessary to search for an image frame to be edited. In this embodiment, the pedal controller 217 is used for such feed (return). The right pedal 253 (see FIG. 5) of the pedal controller 217 is a pedal for feeding. The left pedal 251 is a return pedal.

  FIG. 8 shows a flowchart of the send back control program 2097. First, the CPU 203 receives an operation amount signal from the pedal 253 of the pedal controller 217, and determines whether or not the pedal 253 has been depressed (step S1). If the CPU 203 determines that it has been depressed, it next determines whether or not the operation amount is 50% or more (step S2).

  If it is determined that it is 50% or more, the CPU 203 performs feeding according to the operation amount (step S6). This feed is performed according to the operation amount at that time until the depression is stopped (step S7). In this embodiment, the operation amount is 10%, 20%, 30%, 40%, 50%, 60%, 70%, 80%, and 90%, respectively, 1/20, 1/10, 1 Feeding at / 4, 1/2, 1, 2, 4, 8 times speed is performed. Here, feeding at 1/2, 1, 2, 4, and 8 times speed is performed according to the amount of depression (control of reading of video data).

  In this way, when the stepping is quickly performed deeply, feeding is started without a time lag. It makes sense if you want to move a lot, because you want it to work without a time lag.

  If it is determined in step S2 that the operation amount is less than 50%, the CPU 203 resets its internal timer and starts measuring time (step S3). Thereafter, it is determined whether or not the timer has passed 300 mS (predetermined time) (step S5). When the pedal 253 is released before the timer elapses for 300 mS (step S4), a predetermined frame (for example, one frame) feed is executed.

  In this way, when a light step is performed and then released quickly, a predetermined frame feed is performed in advance. In particular, since it is difficult to control a fine movement such as sending one frame with the operation amount of the pedal 253, it is useful.

  If the pedal 253 is continuously depressed until the timer elapses of 300 ms, the CPU 203 performs frame advance according to the operation amount (steps S5 and S6). This feed is performed according to the operation amount at that time until the depression is stopped (step S7).

  As described above, both the fine feed operation and the large feed operation are facilitated by the manner in which the pedal 253 is depressed.

  In the above description, the pedal 253 of the pedal controller 250 has been described. When the pedal 251 is depressed, the “return (reverse direction time)” is performed instead of the above “feed (forward direction time)”, but the other control (flow chart) is the same. In other words, the control executed by depressing the pedal 253 (output control signal) and the control executed by depressing the pedal 251 (output control signal) have opposite signs.

  In the above example, when the pedal is operated even a little, the predetermined frame feed is executed even if the pedal is released immediately. However, if the time from when the pedal is depressed until it is released is 20 mS (predetermined time) or less, no operation (feeding, returning) may be performed.

2-3-2-2. Video Data Playback Processing When the user presses the playback button 701, the CPU 203 detects this and performs playback processing to advance the image frame of the video data displayed in the display area 700 in a paused state at a predetermined timing. .

  The video data playback process for performing the playback process will be described with reference to the flowchart of FIG. Upon receiving an instruction to start playback from a user operation, the CPU 203 that executes video data playback processing resets the timing count and continues counting until the timing counter reaches a predetermined timing (steps S351 to 355). Here, the predetermined timing is to determine the display interval of the image frame, and the NTSC (National Television Standards Committee) system adopts 1/30 second (the screen is rewritten 30 times per second). In the PAL (Phase Alternation by Line) method, 1/25 second (the screen is rewritten 25 times per second) is adopted.

  When the predetermined timing comes, the CPU 203 acquires mosaic information from the mosaic information work 3001 in which mosaic information is temporarily recorded on the memory 205 (step S357). The mosaic information is information regarding a mosaic image that is a special effect image displayed on the screen based on the position and shape designated by the user operation, and details thereof will be described later. When acquiring the mosaic information, the CPU 203 combines the image frame and the mosaic image and outputs a video (step S359). Details of the video output will be described later.

  The CPU 203 acquires the next image frame from the video data 2093 and displays the image frame in the display area 700 on the operation screen 70 of the display 201 (step S361). FIG. 10 shows an example of reproduction of an image frame displayed in the display area 700. For example, the state 501 is a state in which an image frame with the frame number “0001” and a mosaic image based on the mosaic information “a” are displayed, and when the play button 701 is pressed in this state, the CPU 203 Then, reproduction processing is performed in which the image frame with the frame number “0001” shown in the state 501 is advanced to the image frame with the frame number “0002” shown in the state 502.

  When the next image frame is displayed, the CPU 203 updates the image frame counter 3005 (step S363). Here, the data recorded in the image frame counter 3005 indicates the number of the image frame in the editing data that is currently being reproduced.

  The CPU 203 repeats the above process (steps S351 to 363) until it detects the end of the process. The process ends when the user presses an edit end button (not shown) or when the video data has been reproduced to the end.

2-3-2-3. Editing Data Recording Processing When the user presses the playback button 701, the CPU 203 executes the above playback processing and edits the mosaic information acquired from the joystick 213 operated by the user and a predetermined image frame corresponding to the mosaic information. Process to record data.

  The edit data recording process for performing the recording process will be described with reference to the flowchart of FIG. When receiving the reproduction start instruction, the CPU 203 that executes the editing data recording process acquires information on the joystick 213 (step S301). When the CPU 203 detects a change in the operation amount in the slider unit 231 (step S303, YES), the CPU 203 updates the mosaic shape information in the mosaic information work 3001 (step S305). FIG. 11A shows an example of the mosaic information work 3001. In the mosaic information work 3001, mosaic information acquired from the joystick 213 operated by the user is recorded, and when an operation amount related to the “shape / size” of the mosaic is detected, the “shape / size” 63 is updated. Is done. For example, the “shape / size” 63 of the mosaic is updated to “circle 10 (circle having a size of 10)” based on the operation amount of the slider portion 231.

  Note that the CPU 203 operates the operation amount related to the “aspect ratio (vertical / horizontal ratio)”, “border size (width of the edge portion)”, or “mosaic block size (size of the rectangle constituting the mosaic)” of the mosaic from the joystick 213. Is detected, the values of “aspect ratio” 65, “border size” 67 or “block size” 69 in the mosaic information work 3005 are updated.

  On the other hand, when the CPU 203 detects a change in the operation amount in the stick unit 233 (step S307, YES), the CPU 203 updates the mosaic position information in the mosaic information work 3001 (step S309). For example, the operation amount related to the coordinate change in the center coordinates of the mosaic is detected, and the “position information (x, y)” 61 of the mosaic information work 3001 is updated to “110, 100”.

  When the CPU 203 determines that the mosaic information acquired from the joystick 213 has changed, the CPU 203 updates the mosaic image displayed in the display area 700 based on the mosaic information work 3001. For example, the contents of the mosaic information work 3001 may be recorded at the time of reference, and it may be determined whether or not the mosaic information of the mosaic information work 3001 has changed based on whether or not it matches the content at the time of previous reference. . For example, when the mosaic image 401 is moved to the right side by operating the stick unit 233 in the state 502 shown in FIG. That is, the mosaic image 401 moves from the left side of the screen to the vicinity of the center of the screen and covers a predetermined portion 403 indicating a human face.

  The CPU 203 reads the image frame counter 3005 (step S315), and determines whether or not the image frame being reproduced in the video data reproduction process has been updated (step S317). As described above, the image frame counter 3005 records the number of the image frame currently being reproduced in the editing data. For this reason, the CPU 203 records the contents of the image frame counter 3005 at the time of reference, and determines whether or not the image frame counter of the image frame counter 3005 has been updated based on whether or not it matches the contents at the time of previous reference. Just judge. For example, when the image frame is updated from the frame number “0002” shown in the state 502 in FIG. 10 to the frame number “0003” shown in the state 503, the CPU 203 updates the image frame counter 3005 to “0003”. Frame update is detected.

  When the CPU 203 determines that the image frame being reproduced in the video data reproduction process is updated based on the image frame counter 3005 (step S317, YES), the mosaic information and the image frame before the update are determined. Are associated with each other, and these are recorded as editing data 2095. For example, when the image frame is updated from the frame number “0002” shown in the state 502 of FIG. 10 to the frame number “0003” shown in the state 503, the CPU 203 displays the mosaic information “b” and the frame information “b” as shown in the state 512. Edit data is created in association with the frame number “0002”.

  FIG. 11B shows an example of editing data. As shown in this figure, a timeline 601, a video data file name 603, a frame number 605, and mosaic information 607 are recorded in the edit data. The timeline 601 is an axis that represents the passage of time in the editing data, and is set at the same timing as the display interval of image frames. The video data file name is the file name of the video data file 2093 (for example, aaa.avi) selected on the video data file selection screen (not shown) of the operation screen 70 by the user. The frame number 605 is the frame number of the previous image frame recorded in the image frame counter 3005, and the mosaic information 607 is the mosaic information (position information, shape information, etc.) recorded in the mosaic information work 3001. . For example, the mosaic information “b” and the frame number “0002” are stored on the same timeline “00002” in the record 652 shown in FIG. , y) 120, 100 ”,“ (shape / size) circle 10 ”,“ (aspect ratio) 1: 1 ”,“ (border size) 10 ”,“ (block size) 110 ””.

  The CPU 203 repeats the above process (steps S301 to S319) until it detects the end of the process. The process ends when the user presses an edit end button (not shown) or when the video data has been reproduced to the end. For example, the CPU 203 performs a process of recording the editing data in association with the mosaic information acquired from the joystick 213 and a predetermined image frame corresponding to the mosaic information while executing the reproduction process. For example, when the image frame is updated from the frame number “0003” shown in the state 503 in FIG. 10 to the frame number “0004” shown in the state 504, the CPU 203 displays the mosaic information “c” and the frame information “c” as shown in the state 513, respectively. Edit data is created by associating the frame number “0003”. In this case, the mosaic information “c” and the frame number “0003” are recorded on the same timeline “00003” in the record 653 shown in FIG. , Frame number “0003” and mosaic information ““ (position information (x, y) 130, 100 ”,“ (shape / size) circle 10 ”,“ (aspect ratio) 1: 1 ”“ (border size) 10 "" (Block size) 110 "".

  Steps S357 to S359 of the video data reproduction process will be described below. The CPU 203 that executes the video data reproduction process acquires mosaic information from the mosaic information work 3001 in which the mosaic information is recorded in the edit data recording process (step S357). For example, the mosaic information ““ (position information (x, y) 110, 100 ”,“ (shape / size) circle 10 ”,“ 10 ”from the mosaic information work 3001 shown in A of FIG. (Aspect ratio) 1: 1 ”“ (Border size) 10 ”“ (Block size) 110 ”” is acquired.

  When acquiring the mosaic information, the CPU 203 generates a mosaic image based on the mosaic information, combines the image frame displayed in the display area 700 with the mosaic image, and outputs a video (step S359). Here, the video output is, for example, processing that outputs image frames subjected to mosaic processing to hardware that can sequentially process the image frames. For example, it is possible to reproduce or record an image frame which has been output to a TV monitor or a video deck via a video output function of a video board and subjected to mosaic processing. Thereby, during the editing operation, it is possible to check in real time the combined state of the mosaic image and the image frame recorded correspondingly. In particular, it is possible to reliably check image differences due to differences in characteristics between a computer monitor and a TV monitor.

2-3-3. Video Data Creation Processing FIG. 7 shows an example of a flowchart for creating video data based on edit data. When the user presses the file write button 709 in the display area 700 of the operation screen 70 (FIG. 12) displayed on the display 201 using the keyboard / mouse 207, the CPU 203 executing the video editing program 2091 One record of the edit data 2095 shown in 11B is read (step S391). For example, a record 651 shown in B of FIG. 11 is read.

  The CPU 203 identifies the video data file 2093 from the video data file name recorded in the record related to the read editing data 2095, and acquires an image frame based on the data recorded in the video data file 2093 (step S393). For example, the video data file name 603 “aaa.avi” is specified based on the record 651 shown in FIG. 11B, and the image frame with the frame number 605 “0001” in the video data file is acquired.

  The CPU 203 generates a mosaic image from the mosaic information recorded in the record relating to the read edit data 2095 (step S395). For example, the mosaic information ““ (position information (x, y) 110, 100 ”,“ (shape / size) circle 10 ”,“ (aspect ratio) 1: 1 ”acquired from the record 651 shown in FIG. A mosaic image is generated based on “(border size) 10” and “(block size) 110”.

  When the mosaic image is generated, the CPU 203 combines the generated mosaic image and the acquired image frame, and outputs this as mosaic-added video data 2099. For example, the image shown in the state 501 in FIG. 10 is output. The output image has an avi format in which video data is recorded for each image frame. In addition, you may make it output in another moving image file format (digital or analog).

  The CPU 203 repeats the above process (steps S391 to S9797) until the end of the process is detected. The process ends when the user presses an editing end button (not shown) or when the editing data has been output to the end.

  Thus, after the video editing process, the user can create a video with a special effect at any time by performing the video creation process using the created editing data. In addition, since a moving image file format to be created can be designated, video data can be created in various formats as required. Further, even after the video data is confirmed, the editing data can be easily added / modified, and versatility can be improved.

  As described above, according to the present invention, since the mosaic process can be performed while reproducing each image frame of the video data, the editing process can be greatly shortened. In addition, even if there is a change in the image between frames, the editing operation can be performed while changing the position and shape of the mosaic image. Can be improved. Therefore, editing efficiency and editing accuracy can be improved when special effects are applied to video data.

  In particular, by using the pedal controller 217 shown in FIG. 5B to adjust the playback speed of the video data file while performing the above video editing process, the editing efficiency and the editing accuracy are further improved. It can be further enhanced. For example, the special effect image can be moved or changed while the playback speed (pitch) is increased or decreased in accordance with the movement of a predetermined location where the special effect is desired in the video data.

  The present invention can be applied to an editing operation in which a special effect such as mosaic processing is applied only to a predetermined portion that is not desired to be displayed as video data, such as a vehicle license plate, a human face, or a telephone number.

3. Other Embodiments In the above embodiment, a control system using an operating device is applied to editing when a video is added with a mosaic. However, it may be used for editing other than adding a mosaic.

  Further, the present invention may be applied when searching for a desired image frame in a sports form check or the like. Furthermore, the present invention may be applied when searching for a desired image frame in a crime investigation or the like. As described above, the control system using the operation device according to the present invention can be generally applied to a case where a desired image frame is searched for while performing image forwarding and returning while viewing the video on the display.

  In the above embodiment, an example using a video data file created in the avi format has been described, but the present invention can be applied to any video data file composed of a plurality of image frames. For example, a markup language that can specify an arbitrary tag may be used. Further, even if the video data file itself is not composed of a plurality of image frames, it is only necessary that the image frames can be constructed in the reproduction process. For example, video format formats such as MPEG-1, MPEG-2, MPEG-4, rm, wmv, DivX, and XVD correspond to this.

  In the above embodiment, the shape of the special effect image is determined by selecting the pattern shape from the drop-down list, but a special effect image having an arbitrary shape acquired by a user operation may be used. For example, in the pen tablet 219 shown in FIG. 5C, even if the shape of the special effect image determined based on the shape drawn by the user using the pen shaft 273 on the video display screen unit 271 is displayed in the display area 700. Good. Thereby, the precision of a special effect can be improved more.

  In the above embodiment, an example in which the mosaic process is performed while reproducing the video data in the forward direction has been described. However, the image data may be reproduced in the reverse direction.

  In the above-described embodiment, an example has been described in which when the image frame is changed, the mosaic information at that time is associated with the previous image frame and recorded as editing data. You may make it match | combine with a flame | frame. For example, in the case of performing an operation of moving a mosaic image in accordance with the movement of the image, if the response speed of the user operation on the image is slow, a past image frame corresponding to the delay of the response speed may be associated.

  In the above-described embodiment, when the image frame is changed, the example in which the mosaic information at that time and the image frame displayed in the past are associated with each other and recorded as editing data has been described. The image frame may be associated with each other. For example, when performing an operation to move a mosaic image according to the movement of the image, if you want to apply a special effect in anticipation of future movement of the image, you can associate the special effect image with the special effect image. That's fine. Such a function is effective when a prediction line of a human flow line in sports or the like is used as a special effect image.

  In the above embodiment, the example in which the predetermined frame number and the mosaic information in the video data file are recorded in association with each other has been described. However, the actual data for configuring the image frame is acquired from the edit data file, and the edit data is acquired. The actual data and the mosaic information may be recorded in association with each other.

  In the above embodiment, the example in which the user moves / changes the mosaic image in accordance with the movement of the predetermined portion in the image frame has been described. However, a shape recognition function is added to the video editing apparatus, and the first image frame is The shape of the predetermined portion to which the mosaic processing is performed may be recognized, and the mosaic image may be automatically followed by the predetermined portion by the shape recognition processing.

  In the above embodiment, the example of the video editing apparatus that realizes both the special effect information recording unit 105 and the image frame synthesis output unit 107 has been described. However, either the special effect information recording unit 105 or the image frame synthesis output unit 107 is used. It may be a video editing device that realizes either of them. For example, when only the special effect information recording unit 105 is realized, steps S359 and 361 in FIG. 6 may be deleted. Further, when only the image frame composition output unit 107 is realized, steps S315 to 319 may be deleted.

  In the above embodiment, a pedal controller is used as the operating device, but a mouse, a joystick, or the like may be used.

  In the above-described embodiment, the video editing device is controlled by the operation device. However, other devices (such as a voice editing device) may be controlled.

  In the above embodiment, in order to realize the functions shown in FIGS. 1 and 3, this is realized by software using a CPU. However, some or all of them may be realized by hardware such as a logic circuit. In addition, you may make it make an operating system (OS) process a part of program further.

It is a figure which shows a pedal controller. It is a functional block diagram of the video editing system of this invention. It is a block diagram of the video editing apparatus of this invention. It is a figure which shows the example of a hardware block diagram at the time of implement | achieving each function of FIG. 2 and FIG. 3 with a computer apparatus. It is a figure which shows the example of the joystick of the computer apparatus which comprises the video editing system by embodiment, a pedal controller, and a pen tablet. It is a figure which shows the flowchart of a video editing program. It is a figure which shows the flowchart of a video data creation program. It is a figure which shows the flowchart of a sending back control program. It is a figure which shows the example in the case of transforming a special effect image. It is a figure which shows the example of the screen at the time of a video editing process. It is a figure which shows the example of the edit data produced in a video editing process. It is a figure which shows the example of the operation screen of an image editing process.

Explanation of symbols

11 Operation amount acquisition means 12 Control signal output means 14 Operation presence / absence judgment means 16 Timekeeping means 18 Video editing means

Claims (11)

A controller,
An operation amount obtaining means for obtaining an operation amount from the operation device;
Operation presence / absence determining means for determining whether the operating device is in a non-operating state or an operating state;
A timing means for determining that a predetermined time has elapsed after the operating device has changed from the non-operating state to the operating state;
If the operating device is in a non-operating state before the time measuring means counts the predetermined time, a control signal indicating a predetermined number of frame movements is output when the operating device changes to the non-operating state, and the time measuring means outputs the predetermined time. Control time output means for outputting a control signal indicating the number of frame movements according to the operation amount, when the operating state of the operating device is maintained even after measuring the time,
A video editing means for moving an image in response to a control signal from the control signal output means and receiving an editing input;
Video editing system with A controller,
An operation amount obtaining means for obtaining an operation amount from the operation device;
Operation presence / absence determining means for determining whether the operating device is in a non-operating state or an operating state;
A timing means for determining that a predetermined time has elapsed after the operating device has changed from the non-operating state to the operating state;
If the operating device is in a non-operating state before the time measuring means counts the predetermined time, a control signal indicating a predetermined numerical value is output at the time of changing to the non-operating state, and the time measuring means timed the predetermined time. A control system comprising control signal output means for outputting a control signal indicating a numerical value corresponding to the operation amount when the operating state of the operating device is maintained afterwards. An operation amount obtaining means for obtaining an operation amount from the operation device;
Operation presence / absence determining means for determining whether the operating device is in a non-operating state or an operating state;
A timing means for determining that a predetermined time has elapsed after the operating device has changed from the non-operating state to the operating state;
If the operating device is in a non-operating state before the time measuring means counts the predetermined time, a control signal indicating a predetermined numerical value is output at the time of changing to the non-operating state, and the time measuring means timed the predetermined time. A control device comprising control signal output means for outputting a control signal indicating a numerical value corresponding to the operation amount when the operating state of the operating device is maintained afterwards. In order for a computer to function as a control device, a control program for causing the computer to realize the following functions:
An operation amount obtaining means for obtaining an operation amount from the operation device;
Operation presence / absence determining means for determining whether the operating device is in a non-operating state or an operating state;
After the operating device has changed from the non-operating state to the operating state, time measuring means for determining that a predetermined time has elapsed,
If the operating device is in a non-operating state before the time measuring means counts the predetermined time, a control signal indicating a predetermined numerical value is output at the time of changing to the non-operating state, and the time measuring means timed the predetermined time. Control signal output means for outputting a control signal indicating a numerical value corresponding to the operation amount when the operating state of the operating device is maintained afterwards. In the control device, system or program according to any one of claims 2 to 4,
The operation presence / absence determining means determines whether the operating device is in a non-operating state or an operating state based on an operation amount from the operating device. In the control device, system or program according to any one of claims 2 to 5,
The control signal output means, when the operation amount acquired by the operation amount acquisition means is larger than a predetermined threshold value, immediately indicates a control signal indicating a predetermined numerical value or a numerical value corresponding to the operation amount regardless of the time of the time measuring means. It is characterized by outputting. In the control device, system or program according to any one of claims 2 to 6,
The operation device is a pedal controller type operation device. In the control device, system or program according to any one of claims 2 to 7,
A first operating device and a second operating device are provided;
The control signal output means includes a numerical value indicated by the first control signal output in response to the operation of the first operating device and a numerical value indicated by the second control signal output in response to the operation of the second operating device. Characterized by reversing the sign. In the control device, system or program according to any one of claims 2 to 8,
The control signal output means outputs a frame advance signal for performing frame advance corresponding to a numerical value as a control signal to the video editing apparatus. The control device, system or program according to claim 9.
The control signal output means outputs a signal for performing forward frame feed as the first control signal, and outputs a signal for performing reverse frame feed as the second control signal. . Get the operation amount from the controller
Determine whether the controller is in non-operating state or operating state,
After the operating device changes from the non-operating state to the operating state, it is determined that a predetermined time has elapsed,
If the operating device is in a non-operating state before timing the predetermined time, a control signal indicating a predetermined numerical value is output at the time of changing to the non-operating state, and after the time measuring means has timed the predetermined time When the operation state of the operation device is maintained, a control signal indicating a numerical value corresponding to the operation amount is output. A control method using the operation device.