JP2012103805A - Image processing system and its processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system with which the distortion correction can be easily and properly performed in accordance with an optical projection method even in an image taken by a super wide-field optical system lens such as a fisheye lens.SOLUTION: An image processing system includes an image input part 200 for inputting an image to be corrected on a display device, a projection method change part 201 for changing an image which conforms to a first projection method which is a unique optical property for the image to be corrected to a second projection method based on an operation performed by an operator, an adjustment auxiliary line creating part 205 for creating an adjustment auxiliary line corresponding to the second projection method, display parts 202 and 206 for making the adjustment auxiliary line created by the adjustment auxiliary line creation part 205 together with the image changed by the second projection method displayed on the display device, and a distortion correction performing part 203 for performing the distortion correction of the image according to the second projection method based on an operation of the operator.

Description

  The present invention relates to an image processing apparatus and a processing method thereof, and more particularly to an image processing method for an image captured using a single-focus or zoom optical system of a fish-eye lens that realizes an ultra-wide field of view.

  Ultra-wide-field optical systems such as fish-eye optical systems and omnidirectional optical systems are used in various fields such as monitoring / remote control, videoconferencing, medical endoscopes, scientific surveying, and the like. Its feature is that an ultra-wide field image with an angle of view of about 180 degrees can be projected onto a finite region of the imaging surface by a special projection method. Accordingly, it is possible to capture an ultra-wide field image that cannot be theoretically captured by an image capturing apparatus that captures images by a general central projection (perspective projection) method.

  However, a special projection optical system such as a fish-eye optical system for capturing an ultra-wide-field image distorts the subject shape of the image to be captured. The difference is significant. Nevertheless, each special projection method has its own purpose and purpose of use. Especially for purposes of surveying and the like, it is desirable that the part that appears to be a distortion is an optically correct image.

  Here, mention is made of an optical projection method in a so-called ultra-wide field optical system lens including a fish-eye lens.

  A fish-eye lens is a refractive lens that can project a field of view around 180 degrees onto a photosensitive surface, but here it is referred to as a fish-eye lens, including an optical system that obtains a wide field of view using a reflector or prism. Strictly speaking, a fisheye lens is defined not by a wide angle of view but by its projection method. The projection type is briefly described.

Hereinafter, the principle of the projection method will be described with reference to FIG.
FIG. 8 is an image diagram illustrating the principle of the projection method, in particular, the principle of the orthographic projection method.

  In FIG. 8, a hemispherical surface G is a virtual spherical surface whose diameter is a range of an image formed on the imaging surface by the fisheye lens. Here, the center O of the image corresponds to the zenith of the spherical surface G in all projection methods. Then, pay attention to one point P (referred to as an image point) in the image.

  The distance (referred to as image height) from the center O to the image point P in each projection method image has a specific relationship with the zenith angle (referred to as the incident angle) of the incident light. Here, the image height is rp, the incident angle is θ, and the relationship is expressed by a mathematical expression.

(A) Equidistant Projection
The image height rp is proportional to the incident angle θ. Many common fisheye lenses.
rp ∝ θ (Formula 1)

(B) Stereographic Projection
The image height rp is proportional to the tangent of the half angle of the incident angle θ.
rp ∝ tan (θ / 2) (Formula 2)

(C) Equisolidangle Projection
The image height rp is proportional to the half angle sine of the incident angle θ.
rp ∝ sin (θ / 2) (Formula 3)
The feature is that the solid angle taken by the subject is proportional to the area of the image, and by measuring the area on the screen, the area ratio of the subject can be obtained correctly. By using this feature, it is used for surveying the amount of clouds over the whole sky and the distribution of vegetation in forests.

(D) Orthographic Projection
The image height rp is proportional to the sine of the incident angle θ.
rp ∝ sin θ (Expression 4)
This is equivalent to the celestial sphere projected directly onto the film surface and the image side. It is characterized by the fact that the area of the surface light source occupying the screen is proportional to the illuminance at the location where the image was taken.
The illustrated FIG. 8 is a projection principle image corresponding to the orthographic projection method of (d) above.

  Conventional image correction processing called distortion correction is to convert a center projected image without distortion. Ordinary optical lenses are optically designed to be imaged using the central projection method, but still, distortion may remain due to various factors such as lens characteristics and manufacturing errors in large image height areas. . The distortion correction is performed so as not to have this distortion.

  A number of ideas for dealing with images taken with a fisheye lens in distortion correction processing have also been disclosed. That is, an image without distortion is generated from an image having distortion photographed with a fisheye lens.

For example, Patent Document 1 below discloses an image conversion apparatus that converts image data captured by a fisheye lens of an equidistant projection method into an image of a central projection method.
Furthermore, Patent Document 2 discloses an image conversion device that similarly converts captured image data of a fisheye lens into a central projection method.

  As described above, in the fish-eye lens, the way the image is captured differs depending on the projection method, and the shape of the object being picked up is particularly different from the original one in the high image height portion and the central region.

  FIG. 9 is an image diagram of an image obtained by converting a photographed image by a fisheye lens into a central projection. Specifically, FIG. 9A is an image diagram of a captured image using a fisheye lens. FIG. 9B shows a conventional distortion-corrected image for the purpose of converting the image into a central projection without distortion. As can be seen from FIG. 9, the interval between concentric circles is widened at a portion where the image height is large, and the image becomes much larger in the lateral direction than the original image.

  A user interface on the image processing apparatus for supporting such fine adjustment of image distortion correction has also been devised. For example, for correction of distortion aberration for a lens at the time of shooting, this adjustment auxiliary line is displayed by overlaying (overlapping) a horizontal and vertical line as an adjustment auxiliary line while adjusting parameters such as a shooting distance. A function has been devised to adjust the correction level using straight lines as a guide.

JP 2007-156895 A JP 2008-301052 A

  Until now, the objective was to obtain an image of a central projection with no distortion. Therefore, as described above, distortion aberration correction was performed using the subject or the horizontal and vertical lines of the adjustment auxiliary line as a guide.

  Here, there is a demand for obtaining an accurate image in a special projection method such as the equidistant projection method and the flat projection method described above instead of the central projection method. In other words, an image satisfying ideal distortion required for each projection method with high accuracy, in which an error due to optical characteristics included in the fisheye lens and a calculation error due to the conversion processing of the projection method are removed may be desired. However, for such special projection images, it is normal that the horizontal and vertical lines are originally distorted, so when correcting this error with high accuracy, it is necessary to confirm the subject in the image and the adjustment confirmation. The horizontal and vertical lines of the displayed auxiliary line cannot be used as a guide.

  Furthermore, as described above, the fish-eye images obtained by each projection method may each have an academic purpose, and are not ordinary images in which distortion is completely eliminated. A geometrically correct captured image is required as the corrected image. Therefore, the importance of distortion correction as correction of optical characteristics for obtaining an ideal image of a special projection method is high. The distortion correction here refers to correction processing for eliminating distortion caused by an error from an ideal distortion obtained by a predetermined projection method. That is, this distortion correction includes not only the center projection method but also a correction process for obtaining an image of a special projection method in which ideal distortion is defined, such as an equidistant projection method and a flat projection method.

  The present invention has been made in view of such problems, and even in an image taken with a so-called ultra-wide field optical system lens such as a fisheye lens, distortion correction can be easily and appropriately performed according to the optical projection method. It is an object of the present invention to provide a mechanism that can be corrected.

An image processing apparatus according to the present invention is an image processing apparatus that corrects an image to be corrected according to an operation screen displayed on a display device, an image input unit that inputs the image to be corrected to the display device, and an operation A projection method conversion means for converting an image based on the first projection method as an optical characteristic specific to the image to be corrected into a second projection method based on an operation by a person, and a method corresponding to the second projection method Adjustment auxiliary line generating means for generating adjustment auxiliary lines, and display means for displaying the adjustment auxiliary lines generated by the adjustment auxiliary line generating means on the display device together with an image converted by the second projection method. And distortion correction execution means for performing image distortion correction by the second projection method based on the operation of the operator.
The present invention also includes an image processing method by the above-described image processing apparatus, a program for causing a computer to execute the image processing method, and a computer-readable storage medium that stores the program.

  ADVANTAGE OF THE INVENTION According to this invention, even if it is an image which is not center projection which was image | photographed with the fisheye lens, the mechanism which can correct | amend distortion correction simply and appropriately according to an optical projection system can be provided.

It is a block diagram which shows an example of schematic hardware constitutions of the image processing apparatus which concerns on embodiment of this invention. 1 is a block diagram illustrating an example of a schematic system configuration of a conversion correction apparatus of an image processing apparatus according to a first embodiment of the present invention. It is a schematic diagram which shows the 1st Embodiment of this invention and shows an example of the distortion correction operation screen displayed on a display apparatus according to starting of an image processing application program. In the image processing apparatus which concerns on the 1st Embodiment of this invention, it is a schematic diagram which shows an example of a concentric circle as an auxiliary line for adjustment displayed as an overlay with an image. 4 is a flowchart illustrating an example of image correction processing by the image processing apparatus according to the first embodiment of the present invention. It is a block diagram which shows an example of schematic system structure of the conversion correction apparatus of the image processing apparatus which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows an example of the image correction process by the image processing apparatus which concerns on the 2nd Embodiment of this invention. It is an image figure explaining the principle of a projection system, especially the principle of an orthographic projection system. It is an image figure of the image at the time of converting the picked-up image by a fisheye lens into center projection.

  Hereinafter, embodiments (embodiments) for carrying out the present invention will be described with reference to the drawings.

<Structure of image processing apparatus>
FIG. 1 is a block diagram illustrating an example of a schematic hardware configuration of an image processing apparatus according to an embodiment of the present invention. Here, the configuration of the image processing apparatus shown in FIG. 1 is a configuration common to a first embodiment and a second embodiment described later. This image processing device corrects an image to be corrected according to an operation screen displayed on a display device.

  As illustrated in FIG. 1, the image processing apparatus includes hardware of a CPU 100, a display memory 101, a memory 102, an external storage device 103, an input device 104, a display device 105, and a conversion correction device 106. .

  In this image processing apparatus, the CPU 100 expands an operating system (OS) and an image processing application program stored in the external storage device 103 in the memory 102. By executing this, the operation of the entire apparatus is controlled, and various processes executed by the apparatus are realized.

  As the memory 102, for example, a RAM or the like is used. For example, a hard disk or the like is used as the external storage device 103. Note that the OS and the image processing application program may be stored in a nonvolatile memory such as a ROM instead of the external storage device 103. The external storage device 103 stores image data. Here, it is assumed that the image stored in the external storage device 103 is a captured image captured using a digital camera.

  The CPU 100 reads out image data to be corrected from the external storage device 103, develops it in the display memory 101, and displays the image on the display device 105. As the display device 105, for example, a liquid crystal display, a CRT, or the like is used.

The operation of the operator of the image processing apparatus is performed via the input device 104 such as a keyboard, a mouse, or a touch panel. Image data of a new image generated by performing correction on the captured image read from the external storage device 103 is stored in the external storage device 103.
The image processing apparatus according to the present invention implements the image processing apparatuses according to the first and second embodiments described below, depending on software stored in the external storage device 103 and appropriately executed. .

(First embodiment)
FIG. 2 is a block diagram showing an example of a schematic system configuration of the conversion correction device 106 of the image processing apparatus according to the first embodiment of the present invention.
As shown in FIG. 2, the conversion correction device 106 has a system configuration of an image input unit 200, a projection method conversion unit 201, an image display unit 202, and a distortion correction execution unit 203. Further, as shown in FIG. 2, the conversion correction device 106 has a system configuration of an image processing control unit 204, an adjustment auxiliary line creation unit 205, an adjustment auxiliary line display unit 206, and an incidental information acquisition unit 207.

  In the processing by the various processing units shown in FIG. 2, the CPU 100 loads and executes a predetermined image processing application program stored in the external storage device 103 in the memory 102. And it implement | achieves when each part 200-207 with which the conversion correction apparatus 106 is provided performs predetermined | prescribed operation | movement based on the instruction | command from CPU100.

The image input unit 200 reads image data from the external storage device 103 into the memory 102 and performs processing for inputting an image to be corrected to the display device.
The projection method conversion unit 201 performs processing for converting an image based on the first projection method as an optical characteristic unique to the image to be corrected into a second projection method based on the operation of the operator.
The image display unit 202 performs processing for expanding an image in the display memory 101 and displaying the image on the display device 105.
The distortion correction execution unit 203 performs image processing corresponding to the operation executed by the operator according to the correction screen displayed on the display device 105. That is, the distortion correction execution unit 203 performs image distortion correction by, for example, the second projection method based on the operation of the operator.

The image processing control unit 204 controls display on the display device 105 of an operation screen for executing a series of correction processing by the projection method conversion unit 201 and the adjustment auxiliary line display unit 206.
The adjustment auxiliary line creation unit 205 is for concentric adjustment according to the angle of view and the projection method (for example, the second projection method) corresponding to the lens used from the data from the auxiliary information acquired by the auxiliary information acquisition unit 207. Create an auxiliary line. More specifically, the adjustment auxiliary line creation unit 205 recognizes the corresponding projection method from the lens type included in the auxiliary information acquired by the auxiliary information acquisition unit 207, and calculates the auxiliary line derived from the principle of the projection method. create.
The adjustment auxiliary line display unit 206 displays, together with the image display unit 202, the adjustment auxiliary line generated by the adjustment auxiliary line generation unit 205 on the display device 105, for example, together with an image converted by the second projection method. The adjustment auxiliary line display unit 206 and the image display unit 202 constitute the “display unit” of the present invention. Here, the display unit can display the image converted by the projection method conversion unit 201, for example, simultaneously with the adjustment auxiliary line.
The incidental information acquisition unit 207 performs processing for analyzing image data developed in the memory 102 and acquiring incidental information such as lens information (including lens type), field angle, and zoom position.

Next, a specific process of image processing using the image processing apparatus according to the first embodiment will be described. When an operator (editor) selects an image processing application through the input device 104, the CPU 100 reads out a corresponding image processing application program from the external storage device 103 and executes it. Accordingly, an image processing application, in this case, a user interface screen for distortion correction processing is displayed on the display device 105.
This image processing application performs distortion correction according to the projection method of the input image, and obtains an optically correct image.

  FIG. 3 is a schematic diagram illustrating an example of the distortion correction operation screen 300 displayed by the image processing control unit 204 via the display device 105 according to the activation of the image processing application program according to the first embodiment of the present invention. is there. In this embodiment, it is assumed that an image to be image-processed has already been selected before the operator selects a function of the image processing application.

  The distortion correction operation screen 300 in FIG. 3 includes a display area 310 for an image to be corrected, a display column 320 for information on the projection method of the original image before correction, and a selection column 330 for a projection method to be converted. It is prepared. Further, in the distortion correction operation screen 300 of FIG. 3, an adjustment auxiliary line display selection field 340, a distortion correction adjustment operation member 350, an OK button 360, and a cancel button 370 are prepared.

  The projection method of the original image to be corrected is uniquely determined from the lens information analyzed by the incidental information acquisition unit 207 from the incidental information of the image. Furthermore, if there is an operator's selection to display the adjustment auxiliary line based on the adjustment auxiliary line display selection field 340, it overlaps the target image and corresponds to the projection method and the angle of view of the lens. A concentric auxiliary line 380 is displayed.

  When the operator drags the distortion correction adjustment operation member 350 in the horizontal direction with the mouse included in the input device 104, the image displayed in the display area 310 is corrected for distortion according to the drag operation and re-displayed. Is displayed. Of course, the operation of the adjustment operation member 350 may be performed using a device other than a mouse.

  The concentric circle displayed as the adjustment auxiliary line 380 is obtained by mapping the image height for each incident angle onto a plane. In the case of a fish-eye lens with an angle of view of 180 °, the subject is imaged up to a diagonal of 90 °, so eight lines are drawn on the diagonal of the image in increments of 10 °. This is shown in FIG.

FIG. 4 is a schematic diagram showing an example of concentric circles as adjustment auxiliary lines for overlay display together with an image in the image processing apparatus according to the first embodiment of the present invention.
The display interval of the auxiliary line for adjustment is not in increments of 10 °, and may be larger or finer. As is apparent from the principle explanatory diagram of the projection method in FIG. 8 described above, the interval between the concentric circles of 10 ° shown in FIG. 4 is uniquely determined when the projection method is determined.

  Thus, the adjustment operation member 350 (specifically, by moving the adjustment operation member 350 so that the distortion of the peripheral portion is adjusted along the concentric auxiliary line, the “optical” in the projection system is adjusted. It is possible to adjust the image without distortion.

  Next, a description will be given of a flowchart of processing by executing an image processing application program that realizes image processing based on the above-described user interface screen.

  FIG. 5 is a flowchart showing an example of image correction processing by the image processing apparatus according to the first embodiment of the present invention. The processes in steps S500 to S580 shown in the flowchart of FIG. 5 correspond to a series of processes including an operation procedure on the user interface screen displayed by the image processing control unit 204 via the display device 105.

  Based on the control of the CPU 100, the image input unit 200 specifies image data to be corrected first and reads the image data (step S500).

  Subsequently, under the control of the CPU 100, the incidental information acquisition unit 207 analyzes incidental information such as shooting information and lens information attached to the image data read in step S500, and in particular data such as a lens type and an angle of view. Obtain (step S510). From the analyzed incidental information, it is determined which projection method the original image has.

  Subsequently, based on the control of the CPU 100, the projection method conversion unit 201 changes the projection method of the image when the operator uses the input device 104 to change the image to change the image to be corrected. A projection method is determined (step S520).

  Subsequently, the operator designates whether or not to display the adjustment auxiliary line, and the adjustment auxiliary line creation unit 205 determines whether or not to specify whether or not to display the adjustment auxiliary line (step S530). . Thereby, it is determined whether or not to display a concentric circle as an auxiliary line for adjustment.

  If the result of determination in step S530 is that there is a designation for displaying an auxiliary line for adjustment (step S530 / Yes), processing proceeds to step S540. In step S540, the adjustment auxiliary line creation unit 205 creates adjustment auxiliary line data according to the projection method determined in step S520 based on the control of the CPU 100.

  Subsequently, the adjustment auxiliary line display unit 206 draws and displays concentric circles created by the adjustment auxiliary line generation unit 205 according to the projection method based on the control of the image processing control unit 204 (step S550).

If step S550 is completed or if there is no designation for displaying the auxiliary line for adjustment in step S530 (step S530 / No), the process proceeds to step S560.
In step S560, the projection method conversion unit 201 performs geometric projection conversion processing of the original image data according to the designated projection method, and the image display unit 202 and the image processing control unit 204 perform the conversion. The image is displayed on the display device 105.

  From here, the operator moves the adjustment operation member 350 displayed on the distortion correction operation screen 300 with respect to the image displayed on the display device 105 using the concentric circle displayed as the adjustment auxiliary line as a guide. Therefore, fine adjustment of distortion correction is performed.

  Subsequently, the CPU 100 (or the distortion correction execution unit 203) determines whether or not the distortion correction has been completed by the operation of the operator (step S570). When the operator presses the OK button 360 or the cancel button 370 prepared on the distortion correction operation screen 300, the CPU 100 determines that the distortion correction is completed.

If the result of determination in step S570 is that distortion correction has not been completed (step S570 / No), processing proceeds to step S580.
In step S580, the distortion correction execution unit 203 executes distortion correction when the operator operates the operation member for correction execution. The loop of steps S560 to S580 repeats execution of distortion correction (step S580) and display (step S560) until the adjustment is completed (step S570 / Yes).

  If the operator obtains a satisfactory correction result, as a result of the determination in step S570, the distortion correction is completed, and this process ends.

  When the operator presses an OK button 360 prepared on the distortion correction operation screen 300, the result of this processing is saved. On the other hand, when the operator presses the cancel button 370, the series of operation processing is discarded.

  As described above, according to the first embodiment, the operator uses a plurality of concentric circles indicating the angle of view according to the projection method of an ultra-wide-angle image obtained by an ultra-wide-field optical system lens such as a fisheye lens. Distortion correction can be easily and appropriately corrected. In addition, correction can be easily performed again.

(Second Embodiment)
In the first embodiment, the concentric circle as the adjustment auxiliary line is displayed from the two information of the projection method and the angle of view, so that more appropriate distortion correction can be performed efficiently and optically. On the other hand, in the second embodiment, in addition to this, the size of the concentric circle displayed as the adjustment auxiliary line by the operation of the operator can be changed in the diagonal direction from the center of the image. This makes it possible to perform distortion correction processing more precisely and accurately.

  Hereinafter, an image processing apparatus according to the second embodiment of the present invention will be described with reference to FIGS. 6 and 7.

  FIG. 6 is a block diagram showing an example of a schematic system configuration of the conversion correction apparatus 106 of the image processing apparatus according to the second embodiment of the present invention.

  In the processing by the various processing units shown in FIG. 6, the CPU 100 loads and executes various image processing application programs stored in the external storage device 103 in the memory 102. And it implement | achieves when each part 200-207,610 with which the conversion correction apparatus 106 is provided performs predetermined | prescribed operation | movement based on the instruction | command from CPU100.

  The conversion correction device 106 according to the second embodiment includes an image input unit 200, a projection method conversion unit 201, an image display unit 202, a distortion correction execution unit 203, an image processing control unit 204, an adjustment auxiliary line generation unit 205, and an adjustment auxiliary. A line display unit 206 and an accompanying information acquisition unit 207 are provided. Since these are the same as those included in the conversion correction device 106 according to the first embodiment (FIG. 2), description thereof is omitted here.

In addition to these, the conversion correction apparatus 106 according to the second embodiment includes an adjustment auxiliary line display changing unit 610.
The adjustment auxiliary line display changing unit 610 can set the display interval of concentric circles determined by the operator in advance, that is, the increment of the incident angle according to preference. Specifically, the adjustment auxiliary line display changing unit 610 changes at least one of the display interval and the size of the adjustment auxiliary line that is dynamically displayed in response to an operation input by the operator such as a mouse operation. change. Further, the adjustment auxiliary line display changing unit 610 can previously register settings including the size and display interval of the adjustment auxiliary line displayed by the display unit.

  FIG. 7 is a flowchart showing an example of image correction processing by the image processing apparatus according to the second embodiment of the present invention. The processes in steps S700 to S790 shown in the flowchart of FIG. 7 correspond to a series of processes including an operation procedure on the user interface screen.

  Based on the control of the CPU 100, the image input unit 200 first designates an image to be corrected and reads the image (step S700).

  Subsequently, under the control of the CPU 100, the incidental information acquisition unit 207 analyzes incidental information such as shooting information and lens information attached to the image data read in step S700, and in particular data such as a lens type and an angle of view. Obtain (step S710). From the analyzed incidental information, it is determined which projection method the original image has.

  Subsequently, based on the control of the CPU 100, the projection method conversion unit 201 changes the projection method of the image when the operator uses the input device 104 to change the image to change the image to be corrected. A projection method is determined (step S720).

  Subsequently, the operator designates whether or not to display the adjustment auxiliary line, and the adjustment auxiliary line creation unit 205 determines whether or not to specify whether or not to display the adjustment auxiliary line (step S730). . Thereby, it is determined whether or not to display a concentric circle as an auxiliary line for adjustment.

  If the result of determination in step S730 is that there is a designation for displaying an auxiliary line for adjustment (step S730 / Yes), processing proceeds to step S740. In step S740, the adjustment auxiliary line creation unit 205 creates adjustment auxiliary line data according to the projection method determined in step S720 based on the control of the CPU 100.

  Subsequently, the adjustment auxiliary line display unit 206 draws and displays concentric circles created by the adjustment auxiliary line generation unit 205 according to the projection method based on the control of the image processing control unit 204 (step S750).

  Here, as a major feature of the second embodiment, the size of the displayed concentric circles as adjustment auxiliary lines can be finely adjusted by dragging the mouse.

  Therefore, the adjustment auxiliary line display changing unit 610 determines whether the operator is dragging the auxiliary line with the mouse (step S760).

  If the result of determination in step S760 is dragging (step S760 / No), the process returns to step S740 to calculate the radius of the concentric circle from the amount of movement of the dragged mouse and create a concentric circle as a new adjustment auxiliary line. It is displayed (steps S740 and S750).

On the other hand, as a result of the determination in step S760, when the dragging is not performed (step S760 / Yes) or when there is no designation for displaying the auxiliary line for adjustment in step S730 (step S730 / No), the following converted image is displayed. Proceed to display (step S770).
In step S770, the projection method conversion unit 201 performs geometric projection conversion processing of the original image data according to the designated projection method, and the image display unit 202 and the image processing control unit 204 perform the conversion. The image is displayed on the display device 105.

  From here, distortion correction is performed on the image displayed on the display device 105 with reference to the concentric circle displayed as the adjustment auxiliary line.

  Subsequently, the CPU 100 (or the distortion correction execution unit 203) determines whether or not the distortion correction is completed by the operation of the operator (step S780).

If the result of determination in step S780 is that distortion correction has not been completed (step S780 / No), processing proceeds to step S790.
In step S790, the distortion correction execution unit 203 executes distortion correction when the operator operates the operation member for correction execution.

The operator operates the correction execution operation member to execute the distortion correction (step S790), and repeats the execution and display of the correction until the adjustment is completed. At this time, depending on the correction result, it may be easier to adjust the correction by changing the size or position of the adjustment auxiliary line again. Therefore, after the execution of the correction in step S790, the process returns to step S760 so that the operator can readjust the concentric circles.
Thus, the adjustment auxiliary line is recalculated (steps S740 and S750), the image is displayed (step S770), and the distortion correction is executed (step S790) until the adjustment is completed.

  As described above, according to the second embodiment, in order to efficiently perform distortion correction, the operator can change the display position (radius) of the displayed concentric circles by an input operation such as a mouse. Then, it is possible to adjust the concentric circles having a desired angle of view according to the position of the subject to be imaged.

  Note that the above-described embodiments of the present invention are merely examples of implementation in practicing the present invention, and the technical scope of the present invention should not be construed as being limited thereto. It is. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof. Moreover, you may combine suitably a part of above-mentioned embodiment.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

  This program and a computer-readable recording medium storing the program are included in the present invention.

200 Image Input Unit 201 Projection Method Conversion Unit 202 Image Display Unit 203 Distortion Correction Execution Unit 204 Image Processing Control Unit 205 Adjustment Auxiliary Line Creation Unit 206 Adjustment Auxiliary Line Display Unit 207 Additional Information Acquisition Unit

Claims (5)

An image processing device for correcting an image to be corrected according to an operation screen displayed on a display device,
Image input means for inputting the image to be corrected to the display device;
A projection method conversion means for converting an image according to the first projection method as an optical characteristic specific to the image to be corrected into a second projection method based on an operation of an operator;
Adjustment auxiliary line creating means for creating an auxiliary line for adjustment according to the second projection method;
Display means for displaying an adjustment auxiliary line created by the adjustment auxiliary line creating means on the display device together with an image converted by the second projection method;
An image processing apparatus comprising: distortion correction execution means for performing image distortion correction by the second projection method based on an operation by an operator. It further has incidental information acquisition means for analyzing and acquiring incidental information incidental to the correction target image,
2. The adjustment auxiliary line creation means recognizes a corresponding projection method from a lens type included in the incidental information, and creates an auxiliary line derived from the principle of the projection method. Image processing apparatus.   The image processing apparatus according to claim 1, wherein the display unit displays the image converted by the projection method conversion unit simultaneously with the auxiliary auxiliary line for adjustment.   Regarding the adjustment auxiliary line displayed by the display means, there is further provided an adjustment auxiliary line display changing unit capable of changing a setting including at least one of the size and the display interval according to the operation of the operator. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. An image processing method by an image processing device for correcting an image to be corrected according to an operation screen displayed on a display device,
An image input step of inputting the image to be corrected to the display device;
A projection method conversion step of converting an image according to the first projection method as an optical characteristic specific to the image to be corrected into a second projection method based on an operation of the operator;
An adjustment auxiliary line creation step of creating an auxiliary line for adjustment according to the second projection method;
A display step of displaying the adjustment auxiliary line created by the adjustment auxiliary line creation step on the display device together with an image converted by the second projection method;
An image processing method comprising: a distortion correction execution step of performing distortion correction of an image by the second projection method based on an operation of an operator.

Images