JP2009218851A - Video processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enhance the compression ratio of a segmented video, to segment the video into which an image is fitted, to apply q geometrical transformation to the segmented video, and to weight a sound source with respect to the position of segmentation, with respect to a position where the video, is segmented in a video processing apparatus which is capable of segmenting videos within an arbitrary range from captured videos. <P>SOLUTION: The video processing apparatus packages therein a video segmenting section for segmenting a video and a video output section for outputting the segmented video and packages therein a reference frame selection section and an encoding section for performing encoding by using a selected frame, in order to improve compressibility; an image fitting section in order to segment the video into which the image is fitted; an image transforming section, in order to perform geometrical transformation upon the segmented video; and a microphone sound source adjusting section, in order to provide a sound corresponding to the position of segmentation, respectively. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a video processing apparatus such as a video camera, a digital camera, a surveillance camera, and a fixed point camera having an imaging function.

  An invention relating to a video processing apparatus having a function of cutting out a part of a captured video image has been studied. For example, Patent Document 1 has an object of “allowing a single camera device to obtain an image in which direction and zoom are instantaneously switched”. Memory means for storing the video in real time, cutout range designation means for designating at least one cutout range of the image stored in the memory means, and reading out the images of the one or more cutout ranges to obtain a predetermined display size A technique is disclosed that includes a converting means for converting and an output means for outputting from the converting means, and a part of the input video is cut out and outputted.

JP-A-8-237590

  In compression encoding techniques represented by MPEG and the like, a method of referring to another frame when encoding one frame has been adopted. Also, the more similar the frame to be encoded and the reference frame, the higher the compression rate of the frame to be encoded.

  Also, for example, H. In a compression encoding technique such as H.264, a plurality of reference frames are prepared when encoding one frame. However, the number of reference frame candidates is often limited to a finite number, for example, five.

  Here, the clipping of a wide-angle image is examined. When a part of the wide-angle video is cut out and the cut out range is encoded, a situation occurs in which the same range or a close range has been encoded in the past. If the frame encoded in the past is used as a reference frame, it is conceivable to increase the compression rate when encoding. However, even if the same range or a close range is encoded, the encoded video in that range is often not a reference frame.

  In the video processing apparatus disclosed in Patent Document 1, it is possible to cut out a video from a video, but the problem of increasing the compression rate when compressing a cut out image has not been studied.

  Further, Patent Document 1 does not discuss improving the efficiency of compression processing after combining a wide-angle image with, for example, an embedded image such as a privacy mask.

  Further, in Patent Document 1, no consideration is given to changing the weight of the sound source with respect to the cut-out position.

  An object of the present invention is, for example, to increase the compression rate of a cut-out image.

  The above object can be achieved, for example, by the invention described in the claims. A typical example will be described. The video processing apparatus according to the present invention acquires position information indicating a cut-out range of a wide-angle video, and selects a reference frame using the position information.

  According to the present invention, for example, it is possible to increase the compression rate of a cut-out image.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 shows an example of the configuration of the video processing apparatus according to the present embodiment.

  The video processing apparatus according to the present embodiment can be applied to a wide range of video processing apparatuses such as a video camera, a digital camera, a surveillance camera, and a fixed point camera. Further, the video processing apparatus according to the present embodiment may be an apparatus that inputs and processes video captured by an external device in a system such as a monitoring camera.

  In FIG. 1, 0 (a) is a video processing apparatus. An image input unit 1 includes a light receiving element such as a CCD and acquires a wide-angle image. Reference numeral 2 denotes a video recording unit that records the wide-angle video input by the video input unit 1, and is configured by a recording device such as a memory. Reference numeral 3 denotes a video cutout unit that cuts out a video from the wide-angle video recorded in the video recording unit 2. Reference numeral 8 denotes a reference frame selection unit that selects an optimal reference frame for encoding the video clipped by the video clipping unit 3. Reference numeral 9 denotes an encoding unit that encodes a video clipped using the reference frame selected by the reference frame selection unit 8. Reference numeral 4 (a) denotes a cut-out video recording unit that records the video encoded by the encoding unit 9. The video cutout unit 3, the reference frame selection unit 8, and the encoding unit 9 may be configured by a signal processing circuit such as an ASIC or FPGA, or an information processing apparatus such as a CPU or a memory. Although illustrated separately, it goes without saying that any combination of these may be configured by a single device. The video recording unit 4 (a) is configured by a recording device such as an HDD, an optical disk, or a holographic memory.

  Reference numeral 5 denotes a video output unit that outputs the video recorded in the cutout video recording unit 4. The video output unit 5 includes, for example, a processing circuit that performs video processing, an interface used for video output, and the like. Reference numeral 13 denotes an operation unit for a user to issue an instruction to the video processing apparatus 0 (a). The operation unit 13 includes, for example, a button, a soft key, or an interface for inputting operation information. Reference numeral 6 denotes a CPU for controlling the whole. Reference numeral 7 denotes a memory of the CPU 6. The video output unit 5, the operation unit 13, the CPU 6, and the memory 7 are connected to the bus 10.

  The operation of the video processing apparatus 0 (a) will be described with reference to FIGS. Note that reference numeral 11 in FIG. 2 denotes a wide-angle video acquired by the video input unit 1 of the video processing device 0 (a), and 12 (a) to 12 (g) denote ranges in which the video is cut out from the wide-angle video. FIG. 2 assumes a situation where a person goes around a track at a wide angle and cuts out an image so that the person is at the center.

  First, shooting is performed with the video processing device 0 (a) fixed. Then, the wide-angle video 11 is acquired by the video input unit 1 and recorded by the video recording unit 2. Next, the video cutout unit 3 cuts out the video from the wide-angle video 11. The user can input the range to be cut out and the enlargement ratio from the operation unit 13, or output a recorded image to the display and use a touch screen to cut out the touched part. May be. In addition, the cutout range is variable in units of frames. Then, position information indicating the range to be cut out is stored in the video cutout unit 3 or the memory 7 for each frame, for example.

  The reference frame selection unit 8 selects a reference frame that is optimal when the video clipped by the video clip unit 3 is encoded. This specific method will be described below.

  Next, the encoding unit 9 performs encoding using the selected frame as a reference frame.

  Then, the video processing device 0 records the video clipped by the cutout video recording unit 4 (a) for the cut video. Next, the video output unit 5 performs processing such as decoding on the recorded video and outputs it externally.

  As a result, in this embodiment, when a video is cut out from the video and encoded, the reference frame is selected using the cut position information, so that the video compression rate can be increased.

  Next, an example of a format of information stored when the video is cut out by the video cutout unit 3 will be described with reference to FIG. Reference numeral 1200 denotes a position information table, which has an ID 1201 for identifying each imaging frame, and position information 1202 indicating a cutout range of each imaging. Further, time information 1203 indicating the time and time when each frame is imaged may be stored.

  As the ID 1201, TR (Temporal Reference) information of each frame in MPEG2, for example, may be used. Further, the position information 1202 is constituted by coordinates of a cutout range in a wide-angle video, for example. As a result, if the subject moves, it is possible to change the range to be cut out in accordance with the movement of the subject and cut out an image centered on the specific subject. The coordinates may be expressed in units of pixels in a wide-angle video, for example. That is, for example, if the wide-angle image in FIG. 2 is an image having 4000 × 2000 pixels, the position information may be expressed by setting the X coordinate from 1 to 4000 and the Y coordinate from 1 to 2000. The time information 1203 may use, for example, the GMT time when each frame is captured. If the encoding method is MPEG, TC (Time Code) may be used. Further, as the time information 1203, information indicating a relative position in a stream of a frame or a picture may be used instead of information indicating the time itself. In addition, an upper limit of the amount of information recorded in the position information table 1200 may be determined and deleted from old information. The upper limit may be, for example, an amount of information for 1000 frames or 2000 frames, but may be another amount.

  Next, operations of the reference frame selection unit 8 and the encoding unit 9 will be described in detail.

  First, the video signal cut out by the video cutout unit 3 is input to the reference frame selection unit 8 together with the position information. Next, the reference frame selection unit 8 acquires, from the memory 7 or the like, for example, position information of a frame that has been encoded before, that is, a reference candidate frame that is a reference frame candidate. Then, a clipped image having the smallest difference in position information from the frame to be encoded is selected from the plurality of clipped images.

  This operation will be described for the case where the clipped image (g) is encoded in the examples of FIGS. First, the reference frame selection unit 8 acquires position information (1800, 1800) of the cutout image (g). Further, the reference frame selection unit 8 refers to the position information table 1200 and acquires the position information 1202 of the previously encoded images, that is, the clipped images (a) to (f). Then, from the position information stored in the position information table 1202, the ID of the clipped image with a small difference between the clipped image (g) and the position information is selected. Then, the clipped image (a) having the position information (1900, 1700) is selected as a reference frame candidate. For example, although the cutout image 12 (a) and the cutout image 12 (g) are separated in time, it can be predicted that there is a possibility that the correlation is high because the cutout location is close. Therefore, the cutout image 12 (a) is a candidate for a reference frame of the cutout image 12 (g). Then, the reference frame selection unit outputs the ID (1) of the reference frame corresponding to the clipped image (a) to the encoding unit.

  The encoding unit 9 encodes the video based on the input video signal and the ID (1) of the reference frame. Specifically, the encoding unit 9 acquires a clipped image corresponding to the acquired ID (1), and encodes a video signal using the acquired clipped image as a reference frame.

  Further, as an example of recording the position information, the position information table 12 is used for storage, but the position information is not limited to the table format information. Information that can identify individual frames and pictures and information in a format that associates individual frames and pictures may be used.

  In the above-described example, the reference frame selection unit 8 has described an example in which the position information table 1200 selects an image with the smallest difference in position information from the clipped image (g) to be encoded. However, the selection method by the reference frame selection unit 8 is not limited to this example. For example, the reference frame selection unit 8 refers to the position information 1202 of the clipped image encoded in the past in order from the newest one, and the difference between the position information 1202 and the clipped image to be encoded from now is a predetermined amount. When it is determined that it is the following, a clipped image corresponding to the position information 1202 may be selected as a reference frame. For example, when encoding the cutout image (g), the reference frame selection unit 8 acquires the position information 1202 in the order of the cutout image (f), the cutout image (e), and the cutout image (d). When the difference between the acquired position information 1202 and the position information (1900, 1700) of the cutout image (g) is 50 or less in the X coordinate and 50 or less in the Y coordinate, the corresponding cutout image is used as a reference frame. A configuration may be selected. That is, if there is a clipped image having (1850 to 1950, 1650 to 1750) as the position information 1202, this clipped image may be selected as a reference frame. With this configuration, there is a case where a reference frame can be selected even when all the position information 1202 included in the position information table 1200 is not compared with the position information 1202 with the clipped image to be encoded from now. .

  Further, the reference frame selection unit 8 may be configured to use the difference in time at which the images of the individual frames are captured when selecting the reference frame. For example, even when the distance between the imaging frame 12 (g) and the frame 12 (a) is short, the frame (a) may not be a reference frame if the time difference is a predetermined amount or more. is there. The time difference can be arbitrarily set, and may be, for example, 10 minutes, 1 hour, or other amount. The time difference can be calculated from, for example, the frame rate at which imaging is performed and the difference in the number of frames, but may be calculated by other methods. Thus, by using the difference in time information, it is possible to suppress a decrease in the correlation between the reference frame and the encoded frame, which is mainly caused by a change in time. For example, in the case of shooting the ground, when the cutout image 12 (g) is captured at night and the cutout image 12 (a) is captured in the morning, the brightness and darkness of the entire frame differs. Even if a) is used as a reference frame, the compression efficiency does not increase. On the other hand, when both the cutout image 12 (a) and the cutout image 12 (g) are captured in a bright time zone, if the frame 12 (a) is the reference frame, the brightness of the entire frame is also common. In addition, encoding can be performed with an improved compression rate.

  Also, if a reference frame is determined from the cutout image 12 (g) without using position information, for example, a candidate frame among the cutout image 12 (b) to the cutout image 12 (g) Must be calculated one by one to determine which frame has the highest correlation. Therefore, when the cutout image 12 (g) and the cutout image 12 (a) are encoded in time or as the imaging location is further away, the CPU 6 or the like is required to calculate the correlation. The load increases. On the other hand, the video processing apparatus 0 can reduce the load by temporarily holding the position information of the cut out position. Further, the position information table 1200 often has a smaller amount of information than information of a plurality of frames of cut-out images. Therefore, when selecting a reference frame, the buffer included in the reference frame selection unit 8 or the memory 7 or the like. In addition, by storing the position information table, it is possible to secure more reference frame candidates than in the case where the method of the present embodiment is not used.

  In addition, this method is effective because the correlation between successive frames is lowered particularly when the region to be cut out frequently changes. An example of a case where the change of the cut-out area frequently changes includes a baseball broadcast. In baseball broadcasts, various cutouts are possible depending on the situation, such as a pitching scene, a defensive scene, a scouting scene, and a support scene.

  In addition, when the present video processing device 0 is applied to a surveillance camera that performs motion detection, it is necessary to frequently perform scene switching even when motion is detected at a plurality of points in a space to be imaged. Becomes higher.

  Needless to say, the encoding process in this embodiment can be used simultaneously with the encoding method not using the position information table 1200. For example, when the reference frame selection unit 8 cannot select a reference frame candidate, the immediately preceding I frame may be selected as the reference frame.

  Next, in the encoding system as in the first embodiment, an area is specified for the video acquired from the video input unit 1 to insert an arbitrary image, and the video is cut out from the inserted video. The case of performing will be described with reference to FIGS.

  In FIG. 3, 0 (b) is a video processing apparatus. Reference numeral 4 (b) denotes a cutout video recording unit for recording the cutout video. Reference numeral 14 denotes an image fitting portion. Other units are the same as those in the first embodiment.

  In FIG. 4, 11 (a) to 11 (e) represent wide-angle videos acquired by the video input unit 1 and are time-series frames from 11 (a) to 11 (e). Reference numerals 15 (a) to 15 (e) denote ranges to be cut out from the wide-angle images 11 (a) to 11 (e), and cut pictures are shown in 16 (a) to 16 (e). Reference numeral 17 denotes an area in which an image is inserted into the video acquired by the video input unit 1. FIG. 4 shows a situation in which a car passes by a tree and is captured by a fixed wide-angle camera, and a gray area slightly above the car shows an area where the image is fitted. It is assumed that the user cuts out an image centered on the car.

  First, shooting is performed with the video processing device 0 (b) fixed. Then, a wide-angle video is acquired by the video input unit 1 and recorded by the video recording unit 2. Then, the fitting unit 14 inserts an image into the acquired wide-angle video. Selection of an image to be inserted and designation of a range to be inserted are performed by the operation unit 13. The inset image and range may be changed in units of frames.

  Next, the video cutout unit 3 cuts out the video from the video in which the image is inserted. An inset image has already been applied to the video. For this reason, it is possible to cut out a video in which an image is inserted without calculating a region in which the image is inserted each time the video cutout range is changed. Then, as in the first embodiment, a reference frame is selected and a video is encoded.

  Finally, the video clipped by the cutout video recording unit 4 (b) is recorded, and the video output unit 5 outputs the video. The situation in which an image is inserted into the video can be a security use such as a privacy mask, or a case where an advertisement is displayed in a specific area during sports broadcasting.

  Compared to the case where an image is fitted to a specific area while changing the imaging range by panning and tilting with a single camera, in this case, it is necessary to calculate the area where the image is fitted each time the imaging range is changed. In the example, it is possible to obtain a video in which an image is inserted into a specific area without calculating an area in which the image is inserted each time the video cutout range is changed.

  In the present embodiment, it is also possible to apply the encoding method of the first embodiment. In this case, the reference frame selection unit 8 is inserted between the video cutout unit 3 and the cutout video storage unit 4 (b).

  Next, a description will be given of a case where correction is performed on a cut-out video based on the positional relationship between the cut-out position and the camera when the video is cut out, with reference to FIGS. 5, 6, and 7. In FIG. 5, 0 (c) is a video processing device. Reference numeral 18 denotes an image conversion unit. Reference numeral 4 (c) denotes a cut-out video recording unit that records the video converted by the image conversion unit 18. Other units are the same as those in the first embodiment.

  First, shooting is performed with the video processing device 0 (c) fixed. Then, a wide-angle video is acquired by the video input unit 1 and recorded by the video recording unit 2. Then, the video cutout unit 3 cuts out the video from the acquired wide-angle image. Next, from the relationship between the position of the camera and the position to be cut out by the image conversion unit 18, geometric conversion is performed so that the picture looks like a picture taken in the direction of the area to be cut out by the camera.

  For example, as shown in FIG. 6, image conversion such as perspective conversion may be performed based on the positional relationship between the region to be cut out and the camera. Here, 19 in FIG. 6 is a camera, 11 is a wide-angle image acquired by the camera 19, 20 is a range to be cut out and converted, 21 is an image obtained by geometrically converting the image of the range 20 to be cut out, and 22 is a converted region 21. The image is affine transformed to a size suitable for the output destination size.

  In this case, since the image 22 that is finally cut out may be smaller than the cut-out range 20, when the conversion is actually performed, it is necessary to determine the cut-out range 20 in consideration of this point. Then, similarly to the first embodiment, the cutout video recording unit 4 (c) performs recording, and the video output unit 5 outputs the video. An example of an image converted into an image is shown in FIG. 7 in FIG. 7 is an image cut out from the wide-angle image as it is, 24 is an image obtained by performing geometric transformation on the cut-out image 23, and 25 is resized or cut out to the output destination size by applying the geometric transformation image 24. It is the image that went.

  In this way, when the video is cut out from the video, it is possible to acquire a picture that is taken in the direction of the area to be cut out by the camera. In addition, a more three-dimensional picture can be provided.

  Next, a case where a suitable sound is provided depending on a position where the video is cut out will be described with reference to FIGS. 8 and 9. In FIG. 8, 0 (d) is a video processing device, 26 is a microphone sound source adjustment unit, and 4 (d) is a cut-out video recording unit that records output data from the video cut-out unit 3 and the microphone sound source adjustment unit 26. . Reference numeral 11 in FIG. 9 denotes a wide-angle image acquired by the video input unit 1, and 27 (a) to 27 (c) in FIG. 9 denote a range to be cut out, and 28 (a) to 28 (i) denote a microphone. Other units are the same as those in the first embodiment.

  First, shooting is performed with the video processing device 0 (d) fixed. Then, the wide-angle video 11 is acquired by the video input unit 1 and recorded by the video recording unit 2. Then, the video cutout unit 3 cuts out the video from the acquired wide-angle video 11. Next, the microphone sound source adjustment unit adjusts the microphone sound source according to the cutout range. For example, when 27 (a) in FIG. 9 is cut out, weights 28 (a), 28 (b), 28 (d), and 28 (e) are weighted as microphone sound sources, and 27 (b) ) Is weighted as microphone sound sources 28 (e) and 28 (f), and 27 (c) is weighted as microphone sound sources 28 (e). Then, the cutout video and the adjusted sound are recorded by the cutout range recording unit 4 and output by the video output unit 5.

  In this way, the video processing device 0 (d) performs weighting, so that the sound at the cutout position can be added to the video.

  Moreover, the above-mentioned weighting indicates that, for example, one or more microphone sound sources that are close to the cutout ranges 27 (a) to (c) are selected. In addition, the weighting may be configured such that after selecting a microphone sound source close to the cut-out ranges 27 (a) to (c), a sound source closer to the position increases the volume recorded on the recording medium. Here, the position information in the first embodiment is used as the position information.

  A means for outputting to a display unit such as a display which portion of the wide-angle video has been cut out will be described with reference to FIGS. In FIG. 10, reference numeral 29 denotes a cut-out position image generation unit, 30 denotes an image superimposing unit, and other units are the same as those in the second embodiment. However, in order to simplify the description, in this embodiment, means for fitting an image is omitted.

  First, the video cutout unit 3 cuts out the video from the wide-angle video acquired from the video input unit 1. Then, the cut-out position image generation unit 29 outputs an image indicating which part of the wide-angle video is cut out from the cut-out range with a frame. Then, the image created by the cutout position image generation unit 29 is superimposed on the video cut out by the image superimposing unit 30. Then, it is output by the video output unit 5. An example of the video created in this way is shown in FIG. In FIG. 11, 31 indicates a clipped video, 32 indicates a resized video of the original wide-angle video, and 33 indicates a frame indicating a range cut out in the resized video 32 in order to indicate which part is cut out.

  By doing so, it is possible to provide the user with which range of video from the wide-angle video is cut out.

  In addition, this invention is not limited to an above-described Example, Various modifications are included. For example, in the above-described embodiment, the wide-angle video from the video input unit 1 is recorded in the video recording unit 2, and the cut-out video is recorded in the video recording units 4 (a) to 4 (d). However, the video recording unit 2 or the cut-out video recording units 4 (a) to 4 (d) are not necessarily required, and the video from the video input unit 1 may be processed in real time and output externally. These units are described in detail for easy understanding of the present embodiment, and are not limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment.

  According to the video processing apparatus of each embodiment described above, it is possible to increase the compression rate compared to the conventional method when encoding the cut out video.

  In addition, in the case of fitting an image into a captured video, when operating a general video camera, it is necessary to detect the position to be fitted in accordance with the operation of the camera. Even if the range is changed, the processing can be performed without detecting the position of the embedded image again.

  In addition, when an image is cut out, the image is corrected in consideration of the position to be cut out and the position of the camera, so that a three-dimensional video can be created as compared with a case where the image is simply cut out. Finally, by connecting a plurality of microphones and changing the weight of the microphone sound source according to the cut-out position, it is possible to provide sound suitable for video.

  Moreover, the structure of this invention is not limited to the said Example, It is also possible to change freely within the scope of the invention. It is also possible to combine the contents of the embodiments.

It is a block diagram of the video processing apparatus as 1st Example. It is a figure for demonstrating a specific example as 1st Example. It is a block diagram of the video processing apparatus as 2nd Example. It is a figure for demonstrating a specific example as 2nd Example. It is a block diagram of the video processing apparatus as 3rd Example. It is a figure for demonstrating the geometric transformation of an image as 3rd Example. It is a figure which shows the example of an image conversion as 3rd Example. It is a block diagram of the video processing apparatus as 4th Example. It is a figure for demonstrating the priority which selects a microphone sound source as 4th Example. It is a block diagram of the video processing apparatus as 5th Example. It is a figure for demonstrating 5th Example concretely. It is a figure which shows the example of a position information table.

Explanation of symbols

0 (a) to 0 (e) ... video processing device 1 ... video input unit 2 ... video recording unit 3 ... video cutout units 4 (a) to 4 (d) ... cutout video Recording unit 5 ... Video output unit 6 ... CPU
7 ... Memory 8 ... Reference frame selection unit 9 ... Encoding unit 10 ... Buses 11, 11 (a) to 11 (e) ... Wide-angle video images 12 (a) to 12 (g) ... Cutout range 13 ... Operation unit 14 ... Image fitting parts 15 (a) to 15 (e) ... Cutout range 16 (a) to 16 (e) ... Cut out image 17 Image fitting range 18 ... image conversion unit 19 ... camera 20 ... range to be cut out and converted 21 ... image converted image 22 ... image 23 cut out from the image converted image ... cut out Image 24 ... geometrically transformed image 25 ... resized image 26 ... microphone sound source adjustment unit 27 (a) to 27 (c) ... clipping range 28 (a) to 28 ( i)... Microphone sound source 29... Frame indicating the picture 33 ... cutout position fit the image 32 ... wide angle image cut out image superimposing section 31 ...

Claims (9)

An image processing device that processes an image of a subject,
An imaging means for imaging a wide-angle image;
Cutting means for cutting out an image of a partial area from the wide-angle video;
Position information acquisition means for associating the image cut out by the cut-out means with the position information indicating the position of the cut-out image in the wide-angle image;
Encoding means for encoding the video clipped by the cutting means,
The video processing apparatus, wherein the encoding means includes means for selecting and encoding a reference frame based on the position information. The video processing apparatus according to claim 1
Storage means for storing position information indicating cut-out positions of a plurality of videos encoded in the past,
The encoding means refers to a clipped image having position information having the smallest difference from the position information corresponding to the image to be encoded among the position information stored in the storage means. A video processing apparatus, wherein a frame is selected and encoded. The video processing apparatus according to claim 1,
When the difference between the position information corresponding to the image encoded in the past and the position information corresponding to the image to be encoded is equal to or less than a predetermined amount, the encoding means refers to the previously encoded image as a reference frame. A video processing apparatus characterized by selecting and encoding. The video processing apparatus according to claim 1,
The encoding means is configured such that a difference between position information corresponding to a previously encoded image and position information corresponding to an image to be encoded is a predetermined amount or less, and the previously encoded image and the encoding A video processing apparatus, wherein when a difference in time taken with a video to be captured is a predetermined amount or less, the video encoded in the past is selected as a reference frame and encoded. The video processing device according to any one of claims 1 to 4,
A synthesis means for performing inset synthesis of another video in a partial area of the wide-angle video,
The video processing apparatus, wherein the cutout means cuts out a partial area of a wide-angle video synthesized with another video by the synthesis means. The video processing device according to any one of claims 1 to 5,
Voice input means for inputting voice from a plurality of sound collectors;
A video processing apparatus comprising: audio output means for changing and outputting individual volumes of audio input from the plurality of sound collectors according to the position information. The video processing device according to any one of claims 1 to 5,
Voice input means for inputting voice from a plurality of sound collectors;
Output means for outputting the video clipped by the cutting means,
The video processing apparatus characterized in that the output means changes and outputs individual weights of audio input from the plurality of sound collectors according to the position information. The video processing device according to any one of claims 1 to 7,
Using the position information cut out by the cutout means, and having cutout display output means for outputting a display indicating which range of the wide-angle video is cut out when the cutout video is output to an external display device. A video processing device. The video processing apparatus according to any one of claims 1 to 8,
A video processing apparatus comprising conversion means for converting the cut out video into a predetermined display size.

Images