JP4720626B2 - Image processing system, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing system, an image processing method, and a program used for a video camera, a digital still camera, a silver salt camera, and the like.

  Conventionally, distortion (distortion) has occurred in an image picked up by an image pickup device due to the influence of distortion characteristics of a lens used for image pickup. Although it is possible to make distortion inconspicuous by using a high-precision and high-performance lens, it is possible to completely prevent distortion from occurring when an increase in lens cost is suppressed or in an imaging device equipped with an optical zoom lens. It ’s difficult. Furthermore, a large distortion has occurred in an imaging apparatus that requires a wide-angle imaging range, such as an in-vehicle camera or a surveillance camera.

  In order to remove such distortion, in recent years, correction vectors corresponding to all pre-recorded pixels are read, and necessary information is extracted from an image memory storing images according to the correction information. Geometric correction using a two-dimensional interpolation method There has been proposed an image processing apparatus (first prior art) that corrects distortion caused by distortion characteristics of a lens that performs the above-described processing by image processing.

  However, such an image processing apparatus needs to have distortion correction information corresponding to all the pixels, and in the case of realization by hardware, there is a disadvantage that the cost increases because a large-capacity storage area is required. .

  In order to eliminate such disadvantages, the image processing system (second prior art) disclosed in Patent Document 1 includes a lens and an image sensor as image input means, and is compressed in advance in the horizontal and vertical directions. A means for selecting and encoding an appropriate correction parameter from independent correction parameters, a means for decoding the encoded parameter in real time, and a horizontal and vertical interpolation operation independently using the decoded distortion correction parameter An image processing system including means for realizing the above is provided. In other words, by devising the memory architecture and compressing the correction parameters, the signal processing circuit solves these problems and realizes distortion correction by taking advantage of the features of the memory architecture, while simultaneously performing scaling processing An interpolation circuit is also available.

  For this reason, it is necessary to store distortion correction information corresponding to all pixels, which is the greatest disadvantage of the first conventional image processing apparatus described above, and in the case of realization by hardware, a large-capacity storage area is required. In the image processing apparatus disclosed in Patent Document 1, the input image is divided into horizontal M × vertical N among enormous correction parameters, and both ends of the grid line and the grid line. This is overcome by compressing (encoding) and expanding (decoding) the distortion correction parameter on the inner dividing point n-1 obtained by dividing the minute into n, and performing distortion correction based on this.

When comparing the image processing apparatus of the first prior art with the image processing system of the second prior art described in Patent Document 1, for example, when the resolution of the input image is 800 × 600 pixels, the conventional image processing described above is performed. In the case of an apparatus, the distortion correction information requires 800 × 600 distortion correction parameters, whereas in the image processing system disclosed in Patent Document 1 of the second prior art, the distortion correction information is 8 × 8. When lattice division is performed and the number of divisions between lattice points is n = 1, since distortion correction parameters at each lattice point are used, only 8 × 8 distortion correction parameters are required. Was reduced to 1/7500.
JP 2004-80545 A

  By the way, in a video camera, a digital still camera, and the like, there are cases where a part of the screen is zoomed by electronic processing (hereinafter simply referred to as “electronic zoom”). The case where distortion correction is performed and electronic zoom is executed in the image processing system disclosed in Patent Document 1 will be described below.

When the electronic zoom is performed in the image processing system disclosed in Patent Document 1, the electronic zoom process is performed after cutting out a part of an image on which distortion correction has been performed on the entire screen.
FIG. 1 is a diagram for explaining a case where distortion correction and electronic zoom are performed in the image processing apparatus disclosed in Patent Document 1. In FIG. In FIG. 1, as an example, a case where an area of 320 × 240 pixels in an image center of 1280 × 960 pixels is electronically zoomed to obtain an image of 640 × 480 pixels will be described.

FIG. 1A shows an input image, that is, an input image before distortion correction and electronic zooming. Here, as an example, an image of 1280 × 960 pixels is used as the input image.
FIG. 1B is an image obtained by performing distortion correction processing at the same magnification on the image shown in FIG.
Next, as shown in FIG. 1C, the central portion to be subjected to the electronic zoom is cut out from the image subjected to distortion correction in FIG. The example shown in FIG. 1C is a case where the size of the center of an image of 1280 × 960 pixels is 320 × 240 pixels, and at this time, the cutout position (the upper left coordinate value of the cutout image) is (480, 360).
As shown in FIG. 1 (d), the center image cut out in FIG. 1 (c) is doubled to be an electronic zoom image of 640 × 480 pixels.

From the viewpoint of grid division, in the image processing system disclosed in Patent Document 1, for example, as shown in FIG. 2 (a), 8 × 8 grid division is performed and the number of divisions between grid points is set to 1. In this case, when an electronic zoom image is created by cutting out and enlarging the central 320 × 240 pixel region during electronic zooming, the cut out 320 × 240 pixel region is as shown in FIG. Since only 2 × 2 grid division is performed, only nine grid correction parameters, that is, nine grid correction parameters for creating a distortion correction image are acquired.
Note that the distortion correction parameter is a parameter indicating the amount of correction in the horizontal direction and the vertical direction at the pixel points constituting the input image with respect to the input image having distortion. In the image processing system disclosed in Patent Document 1, distortion correction is performed by applying a one-dimensional interpolation process to an input image using a distortion correction parameter. The distortion correction parameter is obtained by performing grid division on the input image as described above, and using the correction amount vector for correcting distortion at each grid point as the distortion correction parameter, so that the distortion correction parameter for all pixels need not be retained. Has also become better.

  In the image processing system disclosed in Patent Document 1, all the distortion correction parameters of pixels corresponding to other than the grid points are obtained by interpolation. However, when the grid is roughly divided as shown in FIG. The error increases for each distortion correction parameter. As a result, distortion in the output image (an image subjected to distortion correction and electronic zoom) is not sufficiently corrected, and a portion that should originally be a natural curve may be a broken line or unnaturally deformed. If the distortion of the lens is loose, it is not so noticeable. However, when a distortion-resistant lens used in an in-vehicle camera, a surveillance camera or the like is applied to the image processing system, this appears remarkably.

  That is, in the case of electronic zoom processing for enlarging a part of an input image, the image processing system disclosed in Patent Document 1 acquires distortion correction parameters only from a part of the zoomed image and performs distortion correction processing. Since the zoomed image is created, there is a disadvantage that the image quality is deteriorated.

  In order to eliminate the disadvantages described above, the present invention provides an image processing system, an image processing method, and a program that do not deteriorate the image quality of an output image when both distortion correction and electronic zoom processing are performed on an input image. The purpose is to provide.

  In order to achieve the above object, an image processing system according to a first aspect of the present invention is an image processing system that performs distortion correction and electronic zoom processing on an input image, and is a zoom target area that is a zoom target in the input image. Is divided into a predetermined number to extract a distortion correction parameter at a lattice point, and the first image processing apparatus compresses the distortion correction parameter to create compressed data, and the first image processing apparatus compresses the distortion correction parameter. A second image processing device that decompresses and uses the compressed data and performs distortion correction of the zoom target region and electronic zoom processing to generate an output image, and the first image processing device includes the zoom Distortion correction parameters at each grid point obtained by grid-dividing the target area, and position information of each grid point when an image having the same size as the input image is grid-divided by the same number as the predetermined number And correspondence, and the compressed data by compressing said location information and said distortion correction parameters for the lattice point in the same grid in position.

An image processing method according to a second aspect of the present invention is an image processing method of an image processing apparatus that executes distortion correction and electronic zoom processing on an input image, and sets a predetermined number of zoom target areas to be zoomed in the input image. A first step of dividing the grid, a second step of extracting distortion correction parameters at the lattice points divided in the first step, the distortion correction parameters extracted in the second step, and the input A third step of associating the position information of each lattice point when the image having the same size as the image is divided into the predetermined number of lattices with respect to the lattice points at the same position in the lattice; A fourth step of compressing the distortion correction parameter and the position information associated in the step to obtain compressed data, and a second step of expanding the compressed data obtained in the fourth step. The sixth step of enlarging the zoom target region of the input image to the same size as the input image, and the fifth step for the zoom target region enlarged in the sixth step. A seventh step of performing a distortion correction process based on the distortion correction parameter and the position information acquired by decompressing the compressed data in step, and the enlarged zoom region subjected to the distortion correction in the seventh step. And an eighth step of outputting the image after reducing it to a predetermined size.

A program according to a third aspect of the present invention is a program executed by a computer included in an image processing apparatus that performs distortion correction and electronic zoom processing on an input image, and a predetermined number of zoom target areas to be zoomed in the input image. a first procedure for grating divided into a second procedure for extracting the distortion correction parameter in the lattice divided grid points in the first procedure, and the distortion correction parameters extracted in the second procedure, the A third procedure for associating the position information of each lattice point when the image having the same size as the input image is divided into the predetermined number of lattices with respect to the lattice points at the same position in the lattice; the distortion correction parameter associated with the three steps and a fourth step in the compressed data by compressing said location information, before obtained in the fourth step A fifth step of decompressing compressed data, and a sixth step for enlarging the zoomed area of the input image to the same size as the input image, the zoom target area is enlarged in the sixth procedure On the other hand, a seventh procedure for performing distortion correction processing based on the distortion correction parameter and the position information acquired by decompressing the compressed data in the fifth procedure , and distortion correction in the seventh procedure . Causing the computer to execute an eighth procedure of outputting the enlarged zoom area after reducing the zoom area to a predetermined size.

  According to the present invention, it is possible to provide an image processing system, an image processing method, and a program in which image quality does not deteriorate when distortion correction and electronic zoom processing are performed on an input image.

The image processing system 1000 according to the embodiment of the present invention will be described below.
As shown in FIG. 3, the image processing system 1000 according to the present embodiment includes an image processing apparatus 100 (second image processing apparatus), a preprocessing apparatus 200 (first image processing apparatus), and an external recording medium 300. Is done.
FIG. 3 is a block diagram showing a configuration of the image processing system 1000 according to the present embodiment.

As illustrated in FIG. 3, the image processing apparatus 100 includes a lens 101, an image sensor 102, a data conversion unit 103, a synchronization signal generation unit 104, an image memory 105, a signal processing unit 106, a display processing unit 107, a reproduction unit 108, a recording Unit 109, distortion correction processing control unit 110, distortion correction memory 111, and correction parameter decoder 112.
Note that each configuration of the image processing apparatus 100 does not have to be realized in hardware, and can be configured in software.

The lens 101 collects the reflected light from the subject and projects it on the image sensor 102. The lens 101 is not limited to a single focus lens but has a zoom function.
The image sensor 102 is composed of a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor) sensor, or the like, and captures an image projected in accordance with an internal synchronization signal supplied from the synchronization signal generation unit 104 to generate an analog image signal. Is generated.

The data conversion unit 103 is connected to the image sensor 102 and converts the analog image signal generated by the image sensor 102 into a digital image signal in accordance with the internal synchronization signal supplied from the synchronization signal generation unit 104 to generate an input image. .
The synchronization signal generation unit 104 generates an internal generation signal according to a clock signal CLK supplied from the outside, and supplies the internal generation signal to the image sensor 102, the data conversion unit 103, and the signal processing unit 106.
The image memory 105 stores the input image output from the data conversion unit 103.

The signal processing unit 106 is connected to the data conversion unit 103, the synchronization signal generation unit 104, the image memory 105, the distortion correction processing control unit 110, and the correction parameter decoder 112, and according to a command supplied from the distortion correction processing control unit 110. The input image supplied from the data converter 103 is stored in the image memory 105, and correction processing for the input image is executed based on the correction amount vector output from the correction parameter decoder 112. Here, the correction amount vector is, for example, a vector that describes in which direction each pixel of the input image is to be moved during distortion correction and zoom processing, and the signal processing unit 106 only applies the correction amount vector corresponding to each pixel. Each pixel is moved to create a corrected image. The signal processing unit 106 supplies the corrected image obtained by the correction to the display processing unit 107 and the recording unit 109.
Further, the signal processing unit 106 executes an electronic zoom process for enlarging (reducing) a part of the input image.
The display processing unit 107 displays the corrected image output by the signal processing unit 106 on a display unit such as a CRT (Cathode Ray Tube) display or LCD (Liquid Crystal Display) not shown in FIG.

The playback unit 108 plays back an image recorded on an external recording medium 300 described later, and outputs a playback signal to the display processing unit 107.
The recording unit 109 records the corrected image output from the signal processing unit 106 on an external recording medium 300 such as a tape, a flexible disk, a DVD (Digital Versatile Disk), an HDD (Hard Disk Drive), or a memory. Note that the image signal generated by the signal processing unit 106 may be recorded on the external recording medium 300 using the Internet, wireless communication, or the like.

The distortion correction processing control unit 110 outputs a command or the like for instructing a predetermined operation to the signal processing unit 106 in response to a user input or the like via an operation unit not shown in FIG. This is supplied to the correction parameter decoder 112. This position information is used when calculating a distortion correction parameter described later.
The distortion correction memory 111 stores compressed data supplied from a correction parameter encoder 202 described later.

  The correction parameter decoder 112 is connected to the signal processing unit 106, the distortion correction processing control unit 110, the distortion correction memory 111, and a correction parameter encoder 202 described later, and the positional information of the lens 101 supplied from the distortion correction processing control unit 110. Is used to read compressed data supplied from a correction parameter encoder 202, which will be described later, from the distortion correction memory 111, expand (decode) it to obtain a distortion correction parameter (correction amount vector), and obtain the acquired correction amount vector as a signal. This is supplied to the processing unit 106.

Next, the pre-processing device 200 includes a correction parameter deriving unit 201, a correction parameter encoder 202, and a distortion correction parameter memory 203.
Each configuration of the pre-processing device 200 does not need to be realized in hardware, and can be configured on software.
The correction parameter deriving unit 201 calculates distortion correction parameters for all pixels of an image acquired by the lens 101, which are determined by distortion inherent in the lens 101, and stores them in the correction parameter memory 203. This process is executed before the image processing system performs distortion correction and zoom processing because the distortion correction parameter is unique to the lens 101.

  The distortion correction parameter is a parameter indicating the amount of correction in the horizontal direction and the vertical direction at pixel points constituting the input image with respect to the input image having distortion.

The correction parameter encoder 202 reads the distortion correction parameter calculated by the correction parameter deriving unit 201 from the correction parameter memory 203 in accordance with a user operation or the like via an operation unit (not shown), and generates compressed data by compression (encoding). Then, the compressed data is supplied to the correction parameter decoder 112. The compression method and format are not limited in the present invention.
At this time, the correction parameter encoder 202 performs grid division of the input image into M × N (M and N are arbitrary natural numbers), and internal division points n obtained by dividing the grid points and grid line segments by n. The distortion correction parameter on −1 is encoded and supplied to the image processing apparatus 100.
Thereby, distortion correction can be performed using only a part of the enormous distortion correction parameters.
The correction parameter memory 203 stores the distortion correction parameters specific to the lens 101 calculated by the correction parameter deriving unit 201 in association with each pixel of the image created by the lens 101.

  Note that the calculation of the distortion correction parameter in the correction parameter deriving unit 201 and the encoding of the distortion correction parameter by the correction parameter encoder 202 are extremely heavy operations, but before the correction parameter deriving unit 201 and the correction parameter encoder 202 are included. The processing device 200 is a computing device such as a personal computer that is independent of the image processing device 100, and these heavy computations are completed before the distortion correction processing of the image processing device 100. This does not affect the real-time distortion correction process.

Next, in the image processing system 1000 of this embodiment, an operation example when performing distortion correction and electronic zoom processing on an input image will be described.
FIG. 4 is a flowchart for explaining an operation example when the image processing system 1000 performs distortion correction and electronic zoom processing on an input image.

Step ST1:
An input image obtained by photographing the subject is obtained by the lens 101, the image sensor 102, and the data conversion unit 103.
Step ST2:
The size and position of the area to be zoomed (hereinafter referred to as the zoom area) in the input image and the size (resolution) of the output image are determined by a user operation or the like via an operation unit (not shown).

Step ST3:
The correction parameter deriving unit 201 reads out from the correction parameter memory 203 the distortion correction parameters for all the pixels in the zoom region determined in step ST2.
Step ST4:
The correction parameter encoder 202 divides the zoom area determined in step ST2 into M × N grids.

Step ST5:
The correction parameter encoder 202 extracts a distortion correction parameter at each grid point (and internal dividing point) of the zoom region divided in grid in step ST4 from the distortion correction parameters read out in step ST3.
Step ST6:
The correction parameter encoder 202 has coordinates of each grid point when the grid is divided into M × N grids in an image of the same size as the input image, and distortion correction parameters for the grid points corresponding to the zoom area grid-divided in step ST4. Associate. That is, as shown in FIG. 5, in the zoom image divided into M × N grids and the same size as the input image divided into M × N grids, the grid points of the same size image of the input image The coordinates are associated with the distortion correction parameters of the lattice points at the same position in the M × N lattice space in the zoom image. In FIG. 5, as an example, a case where the grid is divided into 8 × 8 is described, but this is an example. 5 (a) and 5 (b), the lattice point distortion correction parameters for the lattice points in FIG. 5 (a) are the coordinates of the lattice points with the same numbers in FIG. 5 (b). It is associated.

Step ST7:
The correction parameter encoder 202 compresses (encodes) the coordinates of the lattice points and distortion correction parameters associated in step ST6, and creates compressed data.
Step ST8:
The correction parameter encoder 202 transmits the compressed data compressed in step ST7 to the image processing apparatus. The transmitted compressed data is stored in the distortion correction memory 111.

Step ST9:
The correction parameter decoder 112 expands (decodes) the compressed data transmitted from the preprocessing device 200 in step ST8.
Step ST10:
The signal processing unit 106 enlarges the zoom image of the input image to the same size as the input image.

Step ST11:
The signal processing unit 106 performs distortion correction of the image enlarged in step ST10 based on the coordinates of the lattice points and the distortion correction parameters associated in step ST6 decoded in step ST9, and obtains a distortion correction enlarged image. In step ST6, the distortion correction parameter for each grid point in the zoom image is associated with the coordinates of each grid point when M × N grid division is performed with the same size as the image enlarged in step ST10. This process can be performed smoothly.
Step ST12:
The corrected image subjected to distortion correction in step ST11 is reduced to the size of the output image determined in step ST2. As a result, it is possible to perform distortion correction only on a part of the input image and zoom without deterioration in image quality.

Hereinafter, distortion correction and electronic zoom processing in the image processing system 1000 will be described with specific examples. The following steps correspond to the steps shown in the flowchart of FIG.
FIG. 6 is a diagram illustrating a specific example of an image.

Step ST1:
As shown in FIG. 6A, an input image of 1280 × 960 pixels is created.
Step ST2:
As shown in FIG. 6A, consider a case where an area of 320 × 240 pixels is zoomed to output an image of 640 × 480 pixels. Here, when considering a coordinate system in which the upper left pixel of the input image is the origin, the number of pixels in the horizontal direction is the x coordinate, and the number of pixels in the vertical direction is the y coordinate, the coordinates of the upper left pixel of the zoom area are, for example, ( 480, 360). Note that the coordinates in the following description are also coordinates in this coordinate system. Note that the method of taking the coordinate system is an example, and the method of taking the coordinate system is not limited to this in the present invention.

Step ST4:
Assume that the zoom area is divided into 8 × 8 grids as shown in FIG. In the description given in association with FIG. 6, no internal dividing point is assumed.
Step ST6:
FIG. 6C shows a case where an image having the same size as the input size (1280 × 960 pixels) is divided into 8 × 8 grids.
Here, assuming that the distortion correction parameter of the lattice point at the upper left of the zoom image is (x0, y0), the coordinates of the lattice point at the upper left of the image in FIG. 6C are (0, 0). The parameter (x0, y0) is associated with the coordinates (0, 0). Similarly, if the distortion correction parameter of the second lattice point in the horizontal direction from the upper left of the zoom image is (x1, y0), the coordinates of the second lattice point in the horizontal direction from the upper left of the image shown in FIG. Is (160, 0), the distortion correction parameter (x1, y0) is associated with the coordinates (160, 0). In this way, the distortion correction parameters for all grid points in the zoom image are associated with the coordinates of all grid points in the image shown in FIG.

Step ST12:
The corrected image that has been enlarged to 1280 × 960 pixels and corrected for distortion is reduced to the size determined in step ST2 to be an output image.

  As described above, according to the image processing system 1000 of the present embodiment, the correction parameter encoder 202 includes the coordinates of each grid point when the grid is divided into M × N grids in an image having the same size as the input image. Since the signal processing unit 106 performs distortion correction using this data by associating with the distortion correction parameters of the corresponding lattice points of the zoom area divided by the lattice, distortion is performed in the image processing system disclosed in Patent Document 1. Disadvantage of performing correction and electronic zoom processing, an image subjected to distortion correction processing and electronic zoom processing is created without acquiring distortion correction parameters from only part of the electronic zoomed image. It is possible to prevent the deterioration of the image quality of the output image due to.

  As a specific example, in the image processing system disclosed in Patent Document 1, distortion correction is performed by dividing the input image of 1280 × 960 pixels into 8 × 8 grids, and the center portion of the input image is 320 × 240. When the pixel is enlarged to 640 × 480 pixels and output, as shown in FIG. 7A, the zoom area is divided into only 2 × 2 grids, and nine grid points in the zoom area are displayed. The image quality after distortion correction and electronic zoom has been reduced with respect to the input image because only the distortion correction parameters are used for distortion correction. In the image processing system 1000 of the present embodiment, As shown in FIG. 7B, the zoom area is divided into 8 × 8 grids, and the distortion correction parameters at 81 grid points are used for the distortion correction process, so the degradation of image quality due to distortion correction is very small. .

  Further, according to the image processing system 1000 of the present embodiment, the zoom area is divided into M × N grids regardless of the size of the zoom area, and distortion correction processing is performed using the distortion correction parameters at each grid point. Therefore, the output image quality is not affected by the size of the zoom area. Similarly, once the zoom area has been enlarged and corrected for distortion to the same size as the input image, it is reduced to a predetermined size and used as the output image, so the output image quality depends on the size of the output image. There is nothing to do.

  Further, according to the image processing system 1000 of the present embodiment, grid division is performed on a captured image with optical distortion, and distortion correction is performed using only distortion correction parameters in the horizontal and vertical directions at the grid points. The required amount of data is small, and distortion correction for not only a still image but also a moving image that requires real-time processing is realized with a simple configuration, and a high-quality image without distortion can be obtained.

  Further, according to the image processing system 1000 of the present embodiment, the above-described distortion correction processing and electronic zoom processing can be performed on software, so that image distortion can be corrected in real time by signal processing. In addition, the degree of freedom in lens design can be increased, and the lens can be reduced in size and the cost of the lens can be easily realized.

The present invention is not limited to the embodiment described above.
That is, when implementing the present invention, various modifications, combinations, sub-combinations, and alternatives may be made to the components of the above-described embodiments within the technical scope of the present invention or an equivalent scope thereof.

FIG. 1 is a diagram for explaining a case where distortion correction and electronic zoom are performed in the image processing apparatus disclosed in Patent Document 1. In FIG. FIG. 2 is a diagram for explaining lattice division when distortion correction and electronic zoom are performed in the image processing apparatus disclosed in Patent Document 1. In FIG. FIG. 3 is a block diagram showing a configuration of the image processing system 1000 according to the present embodiment. FIG. 4 is a flowchart for explaining an operation example when the image processing system 1000 performs distortion correction and electronic zoom processing on an input image. FIG. 5 is a diagram for explaining the relationship between the distortion correction parameter extraction point in the zoom region and the coordinates to which the extracted distortion correction parameter is associated. FIG. 6 is a diagram illustrating a specific example of an image at each step when distortion correction and electronic zoom are performed in the image processing system 1000 of the present embodiment. FIG. 7 is a diagram for explaining the difference between the grid division of the zoom area in Patent Document 1 and the grid division of the zoom area in the present embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1000 ... Image processing system, 100 ... Image processing apparatus, 101 ... Lens, 102 ... Imaging element, 103 ... Data conversion part, 104 ... Synchronization signal generation part, 105 ... Image memory, 106 ... Signal processing part, 107 ... Display processing part , 108... Playback unit, 109... Recording unit, 110... Correction processing control unit, 111... Correction memory, 112 ... correction parameter decoder, 200. Correction parameter memory, 300 ... external recording medium

Claims (7)

An image processing system that performs distortion correction and electronic zoom processing on an input image,
A first image processing apparatus for extracting a distortion correction parameter at a grid point by dividing a zoom target area to be zoomed in an input image into a predetermined number, and compressing the distortion correction parameter to generate compressed data; ,
A second image processing apparatus that decompresses and uses the compressed data compressed by the first image processing apparatus and performs distortion correction and electronic zoom processing on the zoom target area to generate an output image;
Have
The first image processing device includes a distortion correction parameter at each grid point obtained by grid-dividing the zoom target region, and each image obtained when the image having the same size as the input image is grid-divided by the same number as the predetermined number. An image processing system that associates position information of lattice points with respect to lattice points at the same position in the lattice, and compresses the distortion correction parameter and the position information into compressed data. The image processing system according to claim 1, wherein the first image processing apparatus calculates in advance distortion correction parameters for all pixels of the input image. The first image processing apparatus divides a zoom target area to be zoomed in an input image into a predetermined number of grids, and distorts the grid points and grid line segments equally or non-uniformly. The image processing system according to claim 2, wherein a correction parameter is extracted. The first image processing device and the second image processing device are spaced apart from each other;
The first image processing apparatus transmits the compressed compressed data;
The image processing system according to claim 3, wherein the second image processing apparatus receives the compressed data transmitted by the first image processing apparatus. An image processing method of an image processing apparatus for executing distortion correction and electronic zoom processing on an input image,
A first step of dividing a zoom target region to be zoomed in an input image into a predetermined number of grids;
A second step of extracting distortion correction parameters at lattice points obtained by lattice division in the first step;
The distortion correction parameter extracted in the second step and the position information of each lattice point when the image having the same size as the input image is divided by the same number as the predetermined number are included in the same lattice. A third step of associating with respect to the grid point at the position;
A fourth step of compressing the distortion correction parameter and the position information associated in the third step into compressed data;
A fifth step of decompressing the compressed data obtained in the fourth step;
A sixth step of enlarging the zoom target area of the input image to the same size as the input image;
A seventh distortion correction process is performed on the zoom target area expanded in the sixth step based on the distortion correction parameter and the position information acquired by expanding the compressed data in the fifth step. And the process of
An eighth step of reducing and outputting the enlarged zoom region whose distortion has been corrected in the seventh step to a predetermined size;
An image processing method. The first to fourth steps are performed in the first image processing apparatus,
The fifth to eighth steps are performed in the second image processing apparatus,
The first image processing device and the second image processing device are spaced apart from each other;
A ninth step of transmitting the compressed data compressed by the first image processing device in the fourth step to the second image processing device;
A tenth step in which the second image processing apparatus receives the compressed data transmitted in the ninth step;
Further comprising
The image processing method according to claim 5, wherein the received compressed data is decompressed in the fifth step. A program executed by a computer included in an image processing apparatus that performs distortion correction and electronic zoom processing on an input image,
A first procedure for grid-dividing a zoom target area to be zoomed in an input image into a predetermined number;
A second step of extracting a distortion correction parameter in the lattice divided grid points in the first step,
The distortion correction parameter extracted in the second procedure and the positional information of each lattice point when the image having the same size as the input image is divided by the same number as the predetermined number are included in the same lattice. A third procedure for associating a grid point at a position;
A fourth procedure of the distortion correction parameter associated with said position information and the compressed data by compressing in the third step,
A fifth step of decompressing the compressed data obtained in said fourth step,
A sixth procedure for enlarging the zoom target area of the input image to the same size as the input image;
A seventh distortion correction process is performed on the zoom target area enlarged in the sixth procedure based on the distortion correction parameter and the position information acquired by expanding the compressed data in the fifth procedure . And the steps
An eighth step in the distortion-corrected the enlarged zoom regions were, and outputs the reduced to a predetermined size in said seventh step,
A program for causing the computer to execute.

Images