JP4419627B2 - Video data processing apparatus and video data processing method - Google Patents

Description

  The present invention relates to a video data processing apparatus and a video data processing method for applying video effects to video data obtained from an input video signal and outputting video data with various effects, and in particular, mixing a plurality of video signals. It is suitable for a video mixer device or the like that outputs the processed video data.

Conventionally, a video mixer device mixes video signals of a plurality of input systems designated by an operator and outputs them in real time to a video display device. For example, a video mixer device is used to produce a back video at a concert or various events. It is done. At that time, selection of an input system, setting of a mixing ratio of video data of a plurality of input systems, setting of a visual effect (video effect) to be given to video data of each input system, and the like are performed. Note that each of the processing specifications of the video according to these settings, or the video processed by this setting is called a “scene”. As such a thing, there exist some which were disclosed by Unexamined-Japanese-Patent No. 2002-262179, for example.
JP 2002-262179 A

  According to the conventional video mixer apparatus as described above, a wide variety of images can be obtained by using a plurality of systems of video signals as a source of mixing and processing. However, when inputting video signals to multiple input systems, work to prepare input sources, such as simultaneously playing multiple video playback devices and multiple media, or reading multiple video signals from different storage devices There was a problem that became complicated. Also, if you want to process and play back multiple images in a specific situation using a specific combination, and then change this in another situation and reprocess it again, you need to prepare multiple video sources with the same combination. There is a problem that managing the media and the like becomes complicated.

  An object of the present invention is to improve workability when handling a plurality of moving images and to facilitate management of a video source in a video data processing apparatus that mixes and processes a plurality of videos.

  The video data processing device according to claim 1 extracts video data of a certain range determined by the range determination unit from the video signal obtained by recording a plurality of moving images in one frame acquired by the video signal acquisition unit, The video data is output so that the drawing area has a certain size. The drawing area of a certain size is not limited to the drawing area of the entire screen, but may be a drawing area in which a drawing area such as a window is provided in a part of the screen and drawn there.

  According to a second aspect of the present invention, in addition to the first aspect, the video data processing apparatus switches the video extracted by the video data extracting means at a specific timing or performs drawing control by the control means. The specific timing is determined by, for example, a change in the operator operated by the user (change corresponding to switching of the “scene memory switch” in the embodiment) or switching sequence data (data corresponding to “stream data” in the embodiment). Something that gives instructions.

  A video data processing method according to claim 3 is a video data processing method in a video data processing apparatus for inputting a video signal, processing the video data through a plurality of video input channels, and outputting the processed video data. A video recording medium that supplies a video signal recording a plurality of moving images is input to the plurality of video input channels, and each video input channel defines a range of one moving image from the plurality of moving images of the video signal. The video data of the extracted moving image is output selectively.

  As a suitable video data processing device, the video data processing device according to claim 1 may be configured such that a certain range determined by the range determining means in the range determining means can be set by a user or the like. According to this example, in addition to the same effect as in the first aspect, even a video source in which the number of moving images included in one video source is different can be easily handled by setting a certain range according to the video source. be able to.

  The video data processing apparatus according to claim 2, wherein a plurality of video data are simultaneously extracted and depicted simultaneously in an arbitrary arrangement, and each of the extracted video data is An arbitrary video effect (brightness, mosaic, black and white / color, saturation, etc.) may be added and described.

  According to the first or third aspect of the present invention, in a video data processing apparatus that mixes and processes a plurality of videos, a plurality of videos can be supplied from one video source, and a desired one can be selected from these videos. Since various processes can be performed by cutting out a plurality of video sources, workability when handling a plurality of moving images is improved, such as not requiring a plurality of video sources, and video sources can be easily managed. In addition, a plurality of moving images can be enlarged and displayed in a certain size event.

  According to the second aspect, in addition to the same effect as the first aspect, a variety of videos can be obtained by a simple operation in the case where a plurality of moving images can be supplied by one video source.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating an operation panel in the video data processing apparatus according to the embodiment. This video data processing device is a video mixer device, and can input a plurality of video signals from an external video device such as a video camera, a video tape recorder, a DVD (Digital Versatile Disk), or a personal computer. In addition, four video input channels ch1, ch2, ch3, and ch4 are provided with a video signal of one input system as a processing unit, and an arbitrary system of video signals is assigned to each of the four video input channels. be able to. In each video input channel, the video data obtained from the video signal can be processed by setting parameters or the like by operating the operation element, and the processed video data is mixed to a television monitor, a projector, It is output to a video display device such as a personal computer.

  Also, setting data (for one channel or a plurality of channels) such as various parameters for processing video data can be stored as one scene data in association with the scene memory switch. Furthermore, while reading the stored scene data and setting parameters, etc., stream data consisting of a time series set of a plurality of scene data can be created, and this stream data can be stored in correspondence with the stream memory switch. This stream data sets the switching timing (specific timing) of the video, and this stream memory switch is used when the video is sequentially updated and reproduced by the stream data.

  Here, the video signal can be input in an analog composite format from five input terminals of In1, 2, 3, 4 and Ext (external) arranged on a rear panel (not shown). The present invention is implemented by inputting one system of video signal (one video source) from one input terminal and obtaining a plurality of types (four types in this embodiment) of video from this one system of video signals. Note that a mode in which a plurality of types of video are obtained from this one-line video signal is referred to as a “single source mode” in this specification.

  In FIG. 1, each video input channel (ch1 to ch4) includes the same operators 11 to 19, respectively. Reference numeral 11 denotes an input select switch for selecting an input video signal to the video input channel, and arbitrarily selects one of the five inputs of In1, 2, 3, 4 and Ext for each video input channel. 12 is a channel on switch for setting the use / non-use (on / off) of the channel, and 13 is a negative switch for switching between positive display and negative display. 14 is a trim volume for adjusting the gains of the luminance signal and the color difference signal, 15 is a hue volume for adjusting the hue, 16 is a color gain volume for adjusting the color gain (saturation), and 17 is a parameter of a channel common control unit described later. It is an assignable volume that can be assigned. Reference numeral 18 denotes an assign switch for selecting whether the video signal of the video input channel is assigned to the A input / B input of the crossfader 42 or set to “through”. Reference numeral 19 denotes a channel fader for setting the output level of the video signal of the video input channel.

  Reference numerals 21 to 26 and 31 to 38 are operators of a channel common control unit for setting various parameters for each video input channel. Reference numeral 21 denotes a rotary encoder that changes the parameter value, 22 denotes an initialize button that returns the parameter value to an initial value, and 23 denotes a channel select switch that selects a video input channel for setting the parameter value. Reference numeral 24 is a jog shuttle for finely adjusting parameter values or changing the two scenes while interpolating them. Reference numeral 25 is an assign switch for assigning two scenes to be interpolated by the jog shuttle 24. Reference numeral 26 is an interpolation by the jog shuttle 24. This switch is used to select whether the change is valid or invalid.

  Reference numerals 31 to 38 denote parameter switches for selecting the type of parameter to be assigned to the rotary encoder 21. The switch 31 selects a parameter for determining a video display position, the switch 32 selects a parameter for determining the number of screen divisions, and the switch 33 selects a parameter for determining a reverse display mode. The switch 34 selects a parameter for determining the rate of thinning out the video frame, the switch 35 selects a parameter for determining the video display size, and the switch 36 selects a parameter for determining the video distortion mode. The switch 37 selects whether to display the video of the selected channel as a layer (layer display on / off), and the switch 38 is a switch for shifting the parameter value.

  Reference numeral 41 denotes an operator group related to a real-time scene function that gives a video effect in real time when a video signal is output, and includes a scene memory switch corresponding to each storage area of a plurality of scene data, a pattern switch for calling a preset scene, and the like. . A crossfader 42 synthesizes two video signals assigned to “A input” and “B input” by the assign switch 18 of different video input channels, and sets a mixing ratio (0 to 1) at that time. is there. A master fader 43 adjusts the output level of the mixed video signal. In addition, there are provided a switch for selecting a crossfade method, a play button for a function of sequentially updating and playing a video by stream data, a stop button, and the like.

  The central portion 1A is a system control unit that performs operations such as deleting scene data and canceling settings. The system control unit 1A is provided with a mode switch 1 and a setting switch 2. The mode switch 1 and the setting switch 2 are used to set a “single source mode” and select a mode. For example, for each video input channel, a range determining operation for determining a certain range of the image plane is performed as follows. “Single source mode” is selected by operating the mode switch 1, the video display size is determined by the switch 35 and the rotary encoder 21, the video display position is determined by the switch 31 and the rotary encoder 21, and the setting switch 2 is operated. Thus, a certain range of the image plane is determined. Then, the mode switch 1 is operated when entering the normal mode without moving from the “single source mode”, and the mode switch 1 is operated when entering the “single source mode”. When this “single source mode” is set, each video input channel treats the video signal in the predetermined range as an input signal for the video signal selected for that channel.

  FIG. 2 is a diagram showing an example of the setting by the range determining operation. First, FIG. 2A is an example of an original image by an original video signal used in the single source mode in the embodiment. One frame f is divided into four vertically and horizontally, and a moving image A and a moving image are divided into each divided region. Four moving images B, moving image C, and moving image D are recorded. This video signal is input in common to each video input channel (ch1 to ch4), and one moving image is selected from this video signal for each video input channel.

  A specific method for selecting this one moving image is the range determination operation, and the display size parameter and the display position parameter in each video input channel (ch1 to ch4) are set. For example, when the moving image A is selected in the first video input channel ch1, the display size is set so that the image of the original video signal is enlarged two times vertically and horizontally as shown in FIG. Assuming that the upper left corner of the image is the reference point of the image, the parameter of the display position in the first video input channel ch1 is a normal setting (setting that does not move), and the enlarged video A screen corresponds to the display screen. It matches the virtual screen W to be matched as it is. If the video signal of the video input channel ch1 is output as it is, the moving image A is displayed on the full display screen.

  Further, when the moving image B is selected in the second video input channel ch2, the display size is set so that the image of the original video signal is enlarged two times vertically and horizontally as shown in FIG. The display position in the second video input channel ch2 is set so that the video is moved to the left by one screen (half of the enlarged image). As a result, the screen of the enlarged video B matches the screen W. Similarly, when the moving image C is selected in the third video input channel ch3, the display size is set so as to be doubled vertically and horizontally, and the display position is set so as to move upward by one screen. In addition, when the moving image D is selected in the fourth video input channel ch4, the display size is set so as to be doubled vertically and horizontally, and the display position is moved by one screen left and by one screen upward. Set to.

  As described above, setting the display size parameter and the display position parameter in each video input channel (ch1 to ch4) corresponds to determining a certain range of the image plane. It is memorized as a set value in “source mode”. In this case, the display size and the display position according to the set parameters are set as new initial values for each video input channel, and normal video signal processing or the like is performed on the display size and display position. It can be processed as if it were entered as a source.

  The above description is an explanation corresponding to setting the display size and display position by parameters, and the process of selecting a moving image and obtaining the video data is actually to set dots on the video data in the determined range. Interpolation is performed to cut out video data. FIG. 3 is a diagram showing an example of cutting out the video data. When the moving image B is cut out from the original video data in FIG. 3 (A), only the portion of the moving image B is enlarged as shown in FIG. 3 (B). Get one enlarged movie as shown in (C). FIG. 4 is a diagram for explaining dot interpolation at the time of enlargement. When it is composed of 15 dots “a1 to c5” as shown in (i), “a1 to a5”, “ The dots “b1 to b5” and “c1 to c5” are copied and inserted beside each dot, and are enlarged twice in the scanning line direction as shown in (ii). Next, the enlarged scanning line “ a1, a1 to a5 "," b1, b1 to b5 ", and" c1, c1 to c5 "are copied and inserted between the next scanning lines and doubled vertically as shown in (iii) Expanding. In this way, the video data in the determined range is cut out.

  FIG. 5 is a block diagram of the video mixer apparatus of the embodiment. The signal processing unit 10 includes a CPU 10a, a RAM 10b, a ROM 10c, and a timer 10d. The CPU 10a executes a predetermined program stored in the ROM 10c, and uses the working area including various registers, flags, and the like of the RAM 10b. Take control. The timer 10d measures time during the execution of various programs. The input interface (I / F) 20 captures a video signal from the connected video device 100, and the output interface 30 outputs the video signal to the connected image display device 200 and displays it. The setting operator group 40 has various operations on the operation panel. The display 50 is composed of a liquid crystal panel or the like, and performs a setting state of the video mixer device, simple display of video, and the like. The storage device 60 stores the created scene data and stream data, the device setting state, or various programs.

  FIG. 6 is a diagram illustrating a signal path of a main part of the video mixer apparatus according to the embodiment. In this signal path, the functions of the signal processing unit 10, the input inverter 20, and the output interface 30 corresponding to the operations of the various operators are illustrated as equivalent electric circuits. Note that the Ext system is omitted.

  In each video input channel (ch1 to ch4), the switch section A is switched by the input select switch 11 and selects video input from the four input terminals T1 to T4. In the “single source mode”, one input terminal (eg, T1) to which the video equipment 100 is connected is selected for each channel. The image quality control unit B adjusts the image quality of the input video signal in accordance with the operations of the negative switch 13, the trim volume 14, the hue volume 15, the color gain volume 16, and the like. The image position control unit C adjusts the display position, display size, distortion, and the like according to the operation of the rotary encoder 21 or the assignable volume 17, and the volume D sets the output level of the video signal by the operation of the channel fader 19. . The on / off switch E switches the output / non-output of the video signal by operating the channel on switch 12, and the switch unit F switches the video signal to “A input”, “B input”, and the like according to the operation of the crossfader assign switch 18. Selectively output to “through”. The dual volume G outputs an “A input” video signal and a “B input” video signal at a level corresponding to the set mixing ratio in accordance with the operation of the crossfader 41. These output signals are mixed and output to the image output channel OUT. The “through” video signal is output to the image output channel OUT as it is.

  In the “single source mode”, the image position control unit C controls the position based on the display size and display position parameters set for each video input channel. That is, the video data in the range of one selected moving image is processed as if it were the video signal from one input terminal. Thus, in the “single source mode”, scene data or stream data is processed in order to perform image processing similar to that in the normal mode, or to perform switching or drawing control at a specific timing corresponding to claim 2. When playback is performed with the above, for example, four moving picture images obtained from a single source can be processed in the same manner as a plurality of video signals respectively input from four input terminals. Also, when in “Single Source Mode”, four videos obtained with a single source can be played simultaneously while switching, by turning on / off the channel or switching the channel without processing the video. You can also.

  FIG. 7 is a flowchart of the main routine of the control program in the embodiment, FIG. 8 is a flowchart of panel processing, and FIG. 9 is a flowchart of processing execution. The operation of the embodiment will be described based on FIG. When the processing of the main routine of FIG. 7 is started by turning on the power, the contents of the RAM 10b are cleared and initial settings are made in the initialization processing of step S1. Next, the panel process of FIG. 8 is performed in step S2, the process execution of FIG. 9 is performed in step S3, and the process returns to step S2.

  In the panel processing of FIG. 8, it is determined whether or not there is a panel input (switch operation) in step S11. If there is no panel input, the process returns to the main routine as it is, and if there is a panel input, that is, some setting operator operates by the user. When this is done, processing corresponding to the contents of various instructions by panel input is performed in step S12 and subsequent steps. If there is an instruction to change the video selection in step S12, the setting of the processing unit is changed in step S13, and the process returns to the original routine.

  In step S13, a process of accepting a selection by the user from one of designation of a video input channel or designation of video data stored in a storage device for a video transmitted from the outside is performed. In addition, it receives designation of which range is cut out from the specified video. In addition, it receives designation of what kind of effect processing is to be performed on the clipped video. Further, a plurality of the specified and processed videos are received, and designation of the arrangement of these videos is received. That is, a designation relating to the processing according to the operation of the operator on the operation panel is received.

  If there is a scene switching instruction in step S14, the scene selected by the scene memory switch or the like is read in step S15, and the setting of the processing unit is changed in step S13 to return to the original routine. In this case as well, in step S13, designation regarding the above-described processing according to the content of the selected scene is received.

  If there is a video output start instruction in step S16, in step S17, settings relating to the start of video output, such as setting a start flag, are made, and the process returns to the original routine. If there is a video output stop instruction in step S18, settings relating to video output stop are made in step S19, such as setting a stop flag, and the process returns to the original routine. In step S20, for example, a process related to other instructions such as an instruction related to creation of scene data is executed, and the process returns to the original routine.

  In the process execution of FIG. 9, it is determined in step S21 whether or not the start flag is set. If it is not set, the video is not started, so the process proceeds to step S28. If the start flag is set, the video is started. Therefore, image processing and output processing are performed in and after step S22. In step S22, it is determined whether there is an unprocessed video. This determination is for sequentially cutting out and processing video data for each video when a plurality of videos are synthesized and output, and the processing of steps S23, S24, and S25 is performed for all video data. When finished, the process proceeds to step S26. If there is only one video to be used, the processes of steps S23, S24, and S25 are performed once, and the process proceeds to step S26.

  In step S23, for example, the video data of the video input channels ch1 and ch2, the video data of the video input channel ch1 and the video data stored in the storage device, or the set video data is acquired. In step S24, the video data is cut out. For example, if the originally acquired video is 4 videos consisting of 2 vertically and 2 horizontally (for example, FIG. 3 (A)), if only the upper right video (video B) is used, Only the upper right image data is created by removing the lower image. In step S25, the cut out video data is processed. For example, enlargement processing (dot interpolation) similar to that described with reference to FIGS. 3 and 4 is performed. It also adds image effects such as screen brightness and color, black and white, distortion, and mosaic.

  In step S26, the video data processed in steps S23, S24, and S25 is synthesized. In step S27, the synthesized video data is output, and the process proceeds to step S28. In step S28, it is determined whether or not a stop flag is set. If it is not set, there is no stop instruction, so the process returns to the original routine. If the stop flag is set, a stop instruction is given. In S29, the start flag and the stop flag are lowered to stop the process, and the process returns to the original routine.

  In this way, a plurality of videos created for the purpose of simultaneous playback can be supplied on a medium such as a single recording disk, which is easy to handle and improves workability when handling a plurality of moving images. It is also easy to manage video sources. In addition, since a plurality of moving images can be obtained by reproducing one video source (one medium), each moving image can be simultaneously reproduced without any deviation of one frame.

  In the embodiment, an example in which four moving images are recorded as one video source to be input has been described. However, the present invention is not limited to four, and any moving image may be used as long as a plurality of moving images are recorded in one video source.

It is a figure which shows the operation panel of the video mixer control apparatus in embodiment of this invention. It is a figure which shows an example of the setting by the range determination operation in embodiment of this invention. It is a figure which shows the example of extraction of the video data in embodiment of this invention. It is a figure explaining the interpolation of the dot at the time of the image expansion in embodiment of this invention. It is a block diagram of the video mixer apparatus of embodiment of this invention. It is a figure which shows the principal signal path | route of the video mixer apparatus of embodiment of this invention. It is a flowchart of the main routine of the control program in embodiment of this invention. It is a flowchart of the panel process in embodiment of this invention. It is a flowchart of processing execution in an embodiment of the present invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Signal processing part, 20 ... Input interface, 21 ... Rotary encoder, 31 ... Parameter switch (display position), 35 ... Parameter switch (display size), 100 ... Video equipment

Claims (3)

Video signal acquisition means;
Range determining means for determining a certain range of the image plane;
Video data extraction means for continuously extracting only temporally video data within a certain range of the image plane obtained from the video signal;
Have
Control means for controlling the video data extracting means to extract a predetermined range of video data determined by the range determining means from a video signal obtained by recording a plurality of moving images in one frame acquired by the video signal acquiring means. When,
A video data processing apparatus comprising: video data output means for outputting video data controlled and extracted by the control means so as to have a fixed drawing area. The video data processing apparatus according to claim 1,
The video data processing apparatus characterized in that the control means switches the video extracted by the video data extraction means at a specific timing or performs drawing control. A video data processing method in a video data processing apparatus for inputting a video signal and performing various processing on the video obtained from the video signal through a plurality of video input channels and outputting the processed video data,
Using a video recording medium that supplies a video signal in which a plurality of moving images are recorded in one frame, the video signal reproduced on the video recording medium is input to the plurality of video input channels, and the video signal is input to each video input channel. A video data processing method comprising: selectively extracting a range of one moving image from the plurality of moving images and outputting video data of the extracted moving image.

Images