JP5509986B2 - Image processing apparatus, image processing system, and image processing program - Google Patents

Description

  Creates an image with a fixed resolution of the shooting target in video data shot in a situation where the distance from the imaging means (camera) of multiple people or objects to be shot is different, such as in a video conference. The present invention relates to an image processing apparatus, an image processing system, and an image processing program.

  As a conventional image processing technique, a method of changing the resolution and compression rate of a partial area in one captured video based on the difference in the importance of information captured by the imaging unit (camera) and each imaging target in the video There is.

  For example, the video data is divided into a plurality of areas according to the distance from the photographing means, and only the areas where the object existence probability is high and the detection accuracy is necessary are associated with the high-resolution image. There is a technique for performing association using a low-resolution image (see, for example, Patent Document 1).

  In some cases, the compression strength of an image is changed between a feature region such as a human face and other background regions (see, for example, Patent Document 2).

JP 2006-038578 A JP2009-027564

  The above-described conventional technology increases the amount of video data in a partial area containing information that is highly important to the viewer of the captured video by a method such as increasing the resolution or decreasing the compression strength. However, it is unsuitable as an image processing technique in a case where, for example, a video in a conference room is transmitted to a remote display device so that the video can be viewed as in a video conference system.

  By the way, in a situation where there are a plurality of people or objects to be photographed at a remote location and the other remote location is viewing the subject, as in a video conference system, Unless you intentionally create an unusual arrangement where the distance between the camera and each of the multiple shooting targets is the same distance, the images of the multiple shooting targets will generally have the same value. However, in normal shooting, the image of the shooting target existing at a position close to the camera is large, and the image of the shooting target existing at a position far from the camera is small.

  In an image capturing unit using a general camera, the resolution of a captured video to be output is constant throughout the region. Therefore, the resolution of a larger target image increases, and the image region has a higher amount of information. This means that the distance between the imaging unit and the shooting target in the space is a major factor that determines the amount of information that the shooting target has on the shot image.

  However, in video conferencing, there are few situations where the arrangement of people and objects is determined with priority given to the factor of distance from the imaging unit. First, the purpose of the original conference, such as discussion within the conference, can be performed smoothly. Person placement is often given the highest priority. In this case, the person who is interested in the video viewer in the remote location is not necessarily located near the imaging unit in the remote location, and the interest of the viewer itself is also the progress of the conference, etc. There is a high possibility that it will change with the change of. Furthermore, when there are multiple video viewers at a remote location, or when multiple cameras are installed at a remote location, the physical distance from the imaging unit for multiple people or objects It is difficult to deal with the above location and interest issues by changing the arrangement.

  For this reason, in video conferences and other situations, the shooting target that is of interest to viewers and wants to obtain a larger amount of information is located far from the camera and appears in a small size and low resolution. If the video data is transmitted as a large amount of information due to being located near the imaging unit, there is a problem that the amount of transmission data of the video data is wasted, and such a problem is caused by changing the installation position of the camera. If it tries to solve even a little, it will lead to the problem that the installation position of an imaging part will be restrict | limited greatly. Furthermore, since a person who happens to be located near the imaging unit is always displayed in detail with high resolution and viewed, there is a problem that it is not preferable from the viewpoint of privacy protection.

  In order to solve such a problem, the present invention is directed to a person or object to be photographed in a situation where a plurality of persons or objects to be photographed are at different positions from the imaging unit for photographing. By performing processing to change the resolution in the captured video data according to the distance from the imaging unit of the object, the resolution of each shooting target in the captured video data is made uniform within a possible range. It is an object of the present invention to realize an image processing apparatus, an image processing system, and an image processing program that can perform the above processing.

For this reason, the image processing apparatus of the present invention captures an imaging target such as a person or an object and acquires video data, and distance measurement that acquires distance data by measuring a distance from the imaging unit to the imaging target. A distance between the imaging unit and the other imaging target and the imaging unit , with reference to the image information resolution of the imaging target in a predetermined area in the video data, and the distance between the imaging unit and the imaging target, An image processing unit is provided for performing resolution changing processing of each region in the video data so that a ratio of values to other video information resolutions of the imaging target is constant .

  According to the present invention as described above, it is possible to reduce the amount of video data necessary for transmission compared to the prior art, and to obtain an effect of suppressing waste of the amount of transmission data. In addition, the amount of image information generated due to the difference in the position of the imaging target with respect to the imaging unit is very small, and there are fewer restrictions when determining the position of the camera. That is, there is an effect that the degree of freedom of the installation position of the imaging unit is increased. Furthermore, there is an effect that the difference in viewing conditions of the photographing target due to the difference in the position of the photographing target with respect to the imaging unit is reduced, the unfair feeling is reduced, and the privacy protection is preferable.

Block diagram of system configuration showing first embodiment Schematic showing an example of usage image of the first embodiment Schematic diagram showing an example of image data Schematic diagram showing an example of two-dimensional distance data Flow chart showing the operation of the first embodiment Diagram showing an example of resolution change processing The figure which shows the image example of the resolution change process of video data The figure which shows the image example of the picture after image data and resolution change processing Block diagram of system configuration showing second embodiment

  Embodiments of an image processing apparatus, an image processing system, and an image processing program according to the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram of a system configuration showing a first embodiment.

  The image processing apparatus 1 includes an imaging unit 2, a distance information acquisition unit 3, a user input unit 4, and an image processing unit 5. The image processing unit 5 displays a plurality of images displayed at a remote place via a communication line. A device 6 is connected.

  Here, the imaging unit 2 is specifically realized by a camera and a signal processing unit as imaging means, and has a function capable of outputting video data as two-dimensional digital data. The video data photographed by the imaging unit 2 is expressed as a set of pixel values arranged at each two-dimensional coordinate as the simplest format.

  Hereinafter, for description, it is expressed as “lmg (x, y) = r, g, b”, and the image data at the x, y coordinates has a pixel vector whose values are r, g, b. To do.

  The distance information acquisition unit 3 has a function of measuring a distance from a position where the imaging unit 2 is arranged to each imaging target such as a person or an object, and specifically, an optical radar method or an active stereo method. , The moire method, the interferometry method, etc. are equipped with the function to measure the distance by the active measurement method of the existing three-dimensional space measurement method. This is transmitted to the image processing unit 5 as a distance data).

  This two-dimensional distance data is expressed as “Dis (X, Y) = c” below, and has distance data c for each imaging target at the X and Y coordinates. The value of c can be obtained by the above measurement method.

  In the present embodiment, in order to simplify the description, the imaging unit 2 and the distance information acquisition unit 3 are physically arranged so as to face the same direction from substantially the same position, and the video data and the two-dimensional distance data are Although it can be acquired as information about a similar spatial region, in actual use, the imaging unit 2 and the distance information acquisition unit 3 may be separately arranged, and in that case, it is generally known It is possible to acquire video data and two-dimensional distance data as information related to similar spatial regions by performing post-processing by performing transformation such that there is virtually the same optical axis by processing such as coordinate transformation and projective transformation. Is possible.

  Although two or more two-dimensional distance data designation methods are conceivable, in this embodiment, it is assumed that there are a plurality of discrete values having Cmax as a maximum value and Cmin as a minimum value.

  The distance information acquisition unit 3 can switch between the real-time measurement mode and the user-designated measurement mode. At the time of measurement in the user-designated measurement mode, an instruction to measure the distance from the user input unit 4 to each imaging target is provided. 2D distance data output instruction command is acquired, and distance measurement and output of 2D distance data to the image processing unit 5 are performed according to the command rule.

  Here, in the real-time measurement mode, although the output frequency of the two-dimensional distance data by the distance information acquisition unit 3 is equal to or higher than the video data output frequency of the imaging unit 2 or smaller than the video data output frequency, the difference is small. This mode is suitable for the situation described above, and is a mode that operates to continuously output the two-dimensional distance data at the maximum output frequency that the distance information acquisition unit 3 can implement.

  In addition, the user-designated measurement mode suppresses restrictions due to processing speed characteristics of some methods in the three-dimensional space measurement method adopted by the distance information acquisition unit 3 and energy consumption of the operation of the image processing apparatus 1. In the situation where the distance measurement and the output frequency of the two-dimensional distance data need to be lower than the output frequency of the video data by the imaging unit 2 for reasons such as the two-dimensional distance data according to the rules instructed by the user of this system Is a mode that operates to generate and output.

  The user input unit 4 is information input means realized by, for example, a keyboard or a mouse, and has a function of performing the following two inputs to the image processing unit 5.

  One of the input functions is that the user creates a two-dimensional distance data to be transmitted to the distance information acquisition unit 3 when the image processing unit 5 is in the user-designated measurement mode, and the user sends an output command transmission rule to the image processing unit 5. This is an input instruction function. The input method in this case is simply a method of instructing the image processing unit 5 to send the two-dimensional distance data at that time to the image processing unit 5 when the user presses one button of the user input unit 4 once. A method of instructing the distance information acquisition unit 3 to generate and output the two-dimensional distance data at an “interval frequency of ff times per hour between dd month to ee hour of aaa year bb month cc day”, In the case of more complicated rules, a method of inputting a self-made computer program can be considered.

  Another input function is a resolution (hereinafter referred to as user-specified resolution) for each imaging target specified by the user in the resolution changing process performed by the image processing unit 5 in the process of generating a “distance factor resolution difference invalidated image” described later. ) Is input to the image processing unit 5.

  As an example of the resolution changing process performed by the image processing unit 5, two types of methods are conceivable and the user input unit 4 is set so that either one can be selected. Will be described later.

  The image processing unit 5 receives video data and two-dimensional distance data transmitted from the imaging unit 2 and the distance information acquisition unit 3 as needed, creates a “distance information map” described later from both data, and a user According to the transmission rule input from the input unit 4, a function for generating two-dimensional distance data and transmitting an output command to the distance information acquisition unit 3 in the “measurement mode at the time of user designation”, input from the distance information map and the user input unit 4 It has a function of creating a distance factor resolution difference invalidated image in which the resolution of the video data is changed according to the area using the reference value data of the user-specified resolution and transmitting it to the video display device 6.

  The distance information map indicates the distance between the imaging unit 2 and each imaging target in the two-dimensional image of the video data created using the video data from the imaging unit 2 and the two-dimensional distance data from the distance information acquisition unit 3. It is generated at a frequency synchronized with the lower one of the output frequency of video data and the output frequency of two-dimensional distance data.

  The distance information map is created by superimposing the video data and the two-dimensional distance data. The video data and the two-dimensional distance data are obtained by shifting the two-dimensional distance data up and down, left and right, and by enlarging or reducing the data. And two-dimensional distance data is assigned to each coordinate position of the video data.

  In the following, the distance information map is expressed as “Map (x, y) = (Dis (f (x), g (y))) = d”, and the maximum value of d in the map is Dmax.

  Here, x and y are the same values as the coordinate values of the video data, and f (x) and g (y) are a shift process for superimposing the video data and the two-dimensional distance data, and an enlargement or reduction process. The function to be expressed represents the correspondence between the x and y coordinates in the video data and the X and Y coordinates in the two-dimensional distance data. It may be automatically set by image processing such as detection.

  There are two examples of video data resolution changing processing performed by the image processing unit 5 as described below. One of them is that the resolution of the area where the distance d to the object to be imaged is the maximum (Dmax) in the distance information map is set as a reference value, and the resolution of the other areas is changed to a resolution equal to this reference value. This is hereinafter referred to as “resolution fixed priority method”. Another one is a method in which the user designates a reference value for aligning the resolution to a constant value. For example, the video data output from the imaging unit 2 is displayed on the video display device 6, and the resolution desired by the user is actually set. When the user designates an arbitrary image area of the video displayed on the video display device 6 by the user input unit 4, the resolution of the designated area is set as a reference value, and the resolution is equal to the reference value. The processing is performed on the entire area of the video data, and this is hereinafter referred to as “user-specified resolution priority method”.

  This user-specified resolution priority method has an advantage that the resolution desired by the user can be set as a reference value. However, on the other hand, a region in which the value of d is larger than the region specified by the user is lower than the theoretical resolution. With the disadvantage of becoming. This occurs because the resolution of the original video data does not have enough resolution to achieve the theoretical resolution, but in the above-mentioned “resolution stabilization priority method”, the Dmax region is the one after the resolution change processing. Since this is an area that takes the maximum resolution, such a problem does not occur.

  The video display device 6 is realized by a display such as a CRT or LCD, for example, and displays the distance factor resolution difference invalidated image sent from the image processing unit 5.

  FIG. 2 is a schematic diagram showing an example of a usage image of the present embodiment. As shown in the figure, a meeting of five participants is held at the site A, and the state is photographed by the imaging unit 2 of the image processing apparatus 1. At the same time, the distance information acquisition unit 3 measures the distance to be imaged, and the distance factor resolution difference invalidated image generated by the image processing unit 5 based on the measured distance is provided at the site B remote from the site A. The image display unit 6 is displayed.

  In FIG. 2, since the imaging unit 2 is arranged at a position higher than the object to be imaged, the acquired video data is overhead video data.

  In the present embodiment, an example will be described in which the image processing apparatus 1 operates assuming a situation in which a video is shot at one base and the video is distributed to another remote base.

  3 is a schematic diagram illustrating an example of video data acquired by the imaging unit 2, FIG. 4 is a schematic diagram illustrating an example of two-dimensional distance data generated by the distance information acquisition unit 3, and x, y in FIG. 4 and FIG. 4, X and Y are coordinates, and the coordinate values of the x and X coordinates increase from left to right, and the coordinate values of the y and Y coordinates increase from top to bottom.

FIG. 5 is a flowchart showing the operation of the first embodiment having the above-described configuration. The following operation will be described according to the step indicated by S in the drawing. Note that the operation of each unit described below is controlled by a control unit (not shown) based on a program (software) stored in a storage unit (not shown).
S1: When processing of the image processing apparatus 1 is started, video data is acquired by the imaging unit 2 and transmitted to the image processing unit 5, and the distance from the position where the imaging unit 2 is arranged to each target is a distance. The two-dimensional distance data is measured by the information acquisition unit 3 and transmitted to the image processing unit 5. In this case, the distance measurement by the distance information acquisition unit 3 may be either the real-time measurement mode or the user-specified measurement mode.
S2: The image processing unit 5 creates a distance information map based on the video data from the imaging unit 2 and the two-dimensional distance data from the distance information acquisition unit 3.
S3: The image processing unit 5 divides the area of the video data for each distance using the created distance information map. That is, a process of recognizing a set of coordinate values having the same distance information as a group in the distance information map is performed so that each area can be accessed sequentially. For area division, a general method in existing image processing can be used.
S4: The image processing unit 5 selects one of the unprocessed resolution change areas for the divided area of the video data.
S5: The image processing unit 5 determines a resolution value to be newly applied in the resolution changing process by the resolution fixing priority method or the user-specified resolution priority method from the distance d of the selected region (hereinafter, selected region).

  In the case of the resolution fixed priority method, the resolution to be newly applied is obtained by the expression “Res1 = k1 * d”. Here, Res1 is a ratio (unit:%) of the resolution newly applied to the selected area and the original resolution of the video data in the case of the resolution fixed priority method, and k1 is a constant obtained by “1 / Dmax”. is there.

In the case of the user-specified resolution priority method, the resolution to be newly applied is obtained by the expression “Res2 = k2 * d”. Here, Res2 is a ratio (unit:%) of the resolution newly applied to the selection area designated by the user in the case of the resolution fixed priority method and the original resolution of the video data, and k2 is obtained by “1 / Dspu”. Dspu is a distance of the image area designated and input by the user using the user input unit 4.
S6: The image processing unit 5 uses the resolution obtained as described above, and performs a resolution changing process on the image in the selected area of the video data. This resolution changing process will be described by taking the case of the resolution fixed priority method as an example.

  FIG. 6 is a diagram showing an example of the resolution changing process. FIG. 6A shows the pixel value of the original video data, and FIG. 6B shows the video data after the resolution changing process in the case of “d = Dmax / 4”. FIG. 5C shows video data after the resolution changing process in the case of “d = Dmax / 9”.

  As shown in FIG. 6A, the pixel values of the original video data are Img11, Img12, Img13... In the x coordinate direction and Img11, Img22, Img31. A case where all the pixels have the same distance d in the same region will be described as an example.

  For example, when the distance d is Dmax / 4, the value of Res1 is “25%”. However, as shown in FIG. 6B, the pixel value of the video data after the resolution changing process is the same as the video data. By replacing four coordinates of vertical and horizontal 2 × 2 starting from the coordinates of the position as one area with the pixel value of the video data, the resolution of the original video data is reduced to “1/4 = 25%”. Convert to the new resolution.

  Similarly, when the distance d is Dmax / 9, the value of Res1 is “11%”. Therefore, as shown in FIG. 6C, the pixel value of the video data after the resolution changing process is the same as the video data. By replacing the nine coordinates 3 × 3 in length and width starting from the coordinates of the position as one area with the pixel value of the video data, the resolution of the original video data is reduced to “1/9 = 11%”. Convert to the new resolution. The nearest neighbor method is used as a resolution changing method.

  FIG. 7 is a diagram showing an image example of the video data by the resolution changing process. FIG. 7A shows an example of changing the resolution when the value of Res1 is “25% (1/4)”. ) Is an example of changing the resolution when the value of Res1 is “11% (1/9)”. 7A and 7B, the original video data is shown on the left side, the video data after the resolution change process is shown on the right side, and the flow of the resolution change process at the pixel level is shown on the upper side in an enlarged image. ing.

In the two examples described above, the pixel value after the resolution change process is replaced by the pixel in the upper left corner. However, other methods can be used for determining the pixel value. As an average value of each pixel in the image area of the video data, a value obtained by applying an average value filter to the pixel group may be output.
S7: The image processing unit 5 determines whether or not the resolution changing process has been completed for all the regions having different distances. If not, the process returns to S4 and repeats the processes up to S7.
S8: When the resolution changing process is completed, a distance factor resolution difference invalidated image, which is video data with a new resolution, is created and output to the video display device 6.

  In the above processing, when the output frequency of the video data from the imaging unit 2 is higher than the output frequency of the two-dimensional distance data from the distance information acquisition unit 3, the frequency of the resolution change process is matched with the output frequency of the video data. In addition, if the distance information map data is insufficient due to the output frequency of the two-dimensional distance data being lower than the output frequency of the video data, the distance information map data used last time can be compensated by continuing to use the data as it is And As a result, the sampling rate of the distance factor resolution difference invalidated image as a video becomes equal to that of the video data.

  FIG. 8 is a diagram showing an example of an image of the original video data and an image of the image after the resolution change process. FIG. 8A is an indoor video of a certain conference room as an example of the image of the original video data. FIG. 5B is a distance factor resolution difference invalidated image obtained by subjecting the room video to resolution changing processing by the resolution fixed priority method.

  8 (a) and 8 (b), there are two persons with similar physique and clothes, one person on the right side and one person in the back, but the original video data in FIG. 8 (a) When the viewer who browses the video on the display device 6 is only requesting video data with a resolution comparable to the image of the person in the back, the front person is shown in detail at a resolution higher than necessary, and the generated video is displayed. Data is wasted, and the person in the foreground receives more than necessary infringement of privacy by browsing.

  On the other hand, in the distance factor resolution difference invalidated image of FIG. 8B, the visual resolution of the constituent pixels of the person in the foreground and the person in the back is almost equal, and the original video data before the resolution changing process. Compared with these images, a fair visual image presentation is realized.

  As described above, in the first embodiment, the resolution change process is performed so that the ratio between the image resolution of each shooting target and the distance from the imaging unit is constant, so that the difference in distance from the imaging unit to the shooting target is obtained. Since the difference in the image resolution of the shooting target due to the image can be invalidated, the amount of data required for transmission / reception is reduced and the waste of the transmission data amount can be suppressed compared with the case where the video data is sent to the remote place as it is. An effect is obtained. In addition, the difference in the amount of information held by each image to be photographed due to the difference in position with respect to the imaging unit is reduced, and the effect of reducing the restrictions when determining the installation position of the imaging unit is obtained. Furthermore, since it is possible to reduce the unfairness of the person to be photographed in the vicinity of the image pickup unit and the person to be photographed in a distant position with respect to the viewing conditions, it is possible to obtain an effect that is preferable from the viewpoint of privacy protection.

  FIG. 9 is a block diagram of a system configuration showing a second embodiment of the present invention. The same parts as those in the first embodiment described above are denoted by the same reference numerals and description thereof is omitted.

  In the second embodiment, the distance information acquisition unit 3 (see FIG. 1) in the first embodiment is omitted, and the imaging unit 2 is provided with a distance information acquisition function. That is, the imaging unit 2 in the second embodiment has a video data output function in the same manner as the function in the first embodiment, and the distance information acquisition unit 3 performs in the first embodiment. Distance measurement and two-dimensional distance data output functions, and distance measurement from the imaging unit 2 to each imaging target is performed using video data captured and acquired by the imaging unit 2.

  As a specific distance measuring method of the imaging unit 2, the lens focusing method is used when the imaging unit 2 has an autofocus function for automatically focusing, and the monocular viewing method is not provided with an autofocus function. Is used. This lens focus method and monocular method are known as so-called passive three-dimensional space measurement methods.

  The image processing unit 5 has the same function as the first embodiment, but receives video data and two-dimensional distance data from the imaging unit 2, and creates a distance information map from the video data and two-dimensional distance data. Then, resolution change processing is performed to create a distance factor resolution difference invalidated image. The method of creating the distance information map and the distance factor resolution difference invalidated image is the same as in the first embodiment.

  The user input unit 4 and the image processing unit 5 have the same functions as in the first embodiment.

  Operations similar to those of the first embodiment, such as the operation of the second embodiment, that is, the acquisition of video data and the distance measurement to each photographing target to the output of the distance factor resolution difference invalidated image (FIG. 5). In this second embodiment, the image data is acquired by the imaging unit 2 and the distance to each target is measured in S1 in the flowchart of FIG. Data and two-dimensional distance data will be sent. The rest is the same as in the first embodiment.

  As described above, in the second embodiment, the distance information acquisition unit in the first embodiment is used by using the so-called passive three-dimensional space measurement method “lens focus method” or “monocular vision method”. This makes it possible to create a distance factor resolution difference invalidated image without the need for calibration processing operations such as coordinate transformation, projection transformation, and enlargement / reduction processing for video data and two-dimensional distance data. The same effects as those of the first embodiment can be obtained while reducing the load and simplifying the apparatus configuration by eliminating the need for the distance information acquisition unit.

  The first and second embodiments have been described above, but the present invention is not limited to this.

  That is, in the first embodiment, an example using an apparatus having a function of performing a general active three-dimensional space measurement method as the distance information acquisition unit 3 is described, but similar distance data can be obtained. Other configurations can be employed. For example, in the case of the “binocular vision” method of the stereo method which is a passive measurement method, the imaging unit 2 is obtained as a first camera and the distance information acquisition unit 3 as a second camera. It is also possible to obtain distance data by performing distance measurement calculation from the stereo image. Further, in the case of the “camera movement” method of the stereo method which is a passive measurement method, a device having a function of moving the imaging unit 2 and a distance measurement calculation function can be used as the distance information acquisition unit 3. is there.

  In the first embodiment, the user arbitrarily sets the timing of measurement as a rule for the image processing unit 5 to transmit a generation and output instruction of two-dimensional distance data to the distance information acquisition unit 3 in the measurement mode at the time of user designation. The method of instructing was given as an example, but when the image processing unit 5 has a function of automatically detecting the operation of the shooting target in the video data and a large operation of the shooting target is detected, distance information is acquired at the end of the operation An instruction for generating and outputting two-dimensional distance data may be transmitted to the unit 3 once.

  In the first embodiment, the overhead video data has been described as an example of the video data acquired by the imaging unit 2. However, if the video has similar global data, the video captured using the fisheye lens is used. Or another image such as an omnidirectional image may be used.

  Furthermore, in the first embodiment, the nearest neighbor method has been described as an example of the resolution changing method. However, a bicubic method or the like, or a method of changing the filter size of the average value filter may be used. Is possible.

  On the other hand, in the second embodiment, the “monocular vision” method is used as the three-dimensional space measurement method when the imaging unit 2 does not have the autofocus function. For example, “Self-position measurement method disclosed in Japanese Patent Laid-Open No. 2004-294421” By applying the technology shown in the "Device and device", four or more markers that are on the same plane and have a known positional relationship are arranged within the shooting angle of view, and each marker is imaged on the image recognition unit. The distance measurement of the imaging target space may be performed by recognizing and performing arithmetic processing using the positional relationship between the markers in the space or the marker size data.

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 2 Imaging part 3 Distance information acquisition part 4 User input part 5 Image processing part 6 Video display apparatus

Claims (10)

An imaging unit that captures video data by capturing a subject such as a person or an object;
A distance measuring unit that measures the distance from the imaging unit to the object to be captured and obtains distance data;
The distance between the other imaging target and the imaging unit and the other imaging using the video information resolution of the imaging target in the predetermined area in the video data and the distance between the imaging unit and the imaging target as reference values. An image processing apparatus comprising: an image processing unit that performs resolution change processing of each area in the video data so that a ratio of a value to a target video information resolution is constant . An imaging unit having a function of photographing a photographing target such as a person or an object to acquire video data and a function of measuring a distance to the photographing target using the acquired video data;
The distance between the other imaging target and the imaging unit and the other imaging using the video information resolution of the imaging target in the predetermined area in the video data and the distance between the imaging unit and the imaging target as reference values. An image processing apparatus comprising: an image processing unit that performs resolution change processing of each area in the video data so that a ratio of a value to a target video information resolution is constant . The image processing apparatus according to claim 1 or 2,
The image processing apparatus according to claim 1, wherein the reference value is a video information resolution of an imaging target having a maximum distance from the imaging unit. The image processing apparatus according to claim 1 or 2,
With user input,
The image processing apparatus according to claim 1, wherein the reference value is video information resolution of an arbitrary photographing target input from the user input unit. The image processing apparatus according to claim 2,
An image processing apparatus for measuring a distance from a photographed image data to a photographing target by recognizing a plurality of markers arranged in the photographing target space. The image processing apparatus according to claim 4.
An image processing apparatus using a nearest neighbor method for resolution change processing performed by the image processing unit. The image processing apparatus according to claim 4.
An image processing apparatus using an average value filter for resolution changing processing performed by the image processing unit. An imaging unit that captures video data by capturing a subject such as a person or an object;
A distance measuring unit that measures the distance from the imaging unit to the object to be captured and obtains distance data;
The distance between the other imaging target and the imaging unit and the other imaging using the video information resolution of the imaging target in the predetermined area in the video data and the distance between the imaging unit and the imaging target as reference values. An image processing apparatus including an image processing unit that performs resolution change processing of each region in the video data so that a ratio of values to the target video information resolution is constant ;
An image processing system comprising: a display device that is installed in a remote place away from a place where the image processing device is installed, and displays video data subjected to resolution change processing sent from the image processing unit. An imaging unit having a function of photographing a photographing target such as a person or an object to acquire video data and a function of measuring a distance to the photographing target using the acquired video data;
The distance between the other imaging target and the imaging unit and the other imaging using the video information resolution of the imaging target in the predetermined area in the video data and the distance between the imaging unit and the imaging target as reference values. An image processing apparatus including an image processing unit that performs resolution change processing of each region in the video data so that a ratio of values to the target video information resolution is constant ;
An image processing system comprising: a display device that is installed in a remote place away from a place where the image processing device is installed, and displays video data subjected to resolution change processing sent from the image processing unit. Causing the imaging unit to shoot a subject such as a person or an object to acquire video data;
Causing the distance measurement unit to measure the distance from the imaging unit to the object to be photographed to obtain distance data;
The image processing unit uses the video information resolution of the shooting target in the predetermined area in the video data and the distance between the imaging unit and the shooting target as reference values, and the distance between the other shooting target and the imaging unit. A step of performing resolution change processing of each area in the video data so that the ratio of the value to the video information resolution of other shooting targets is constant ;
An image processing program for executing

Images