JP2016092807A - Image processing apparatus and control method of image processing apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device which prevents partial blurring of a subject across the boundary of an area not wanted to be blurred, when performing image processing of diorama.SOLUTION: An image processing apparatus performing image processing of an input image has detection means for detecting a subject in an input image, specification means for specifying an attention area in the image, determination means for determining overlap of an area specified by the specification means and an area corresponding to a subject detected by the detection means, and image processing means performing different image processing of the attention area specified by the specification means and other area, and outputting a diorama image. The image processing means deforms the attention area according to the detection results from the detection means, and performs different image processing of the deformed attention area and other area.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image processing apparatus that applies a special effect to a captured image, and a control method for the image processing apparatus.

  Many imaging devices such as digital cameras in recent years have a function of performing image processing on captured images and producing various effects such as a diorama style or a toy camera style.

For example, diorama-like image processing is generally performed in the following procedure.
1. An arbitrary area (hereinafter referred to as an attention area) including the main subject of the diorama is set.
2. Blur processing is applied to areas other than the attention area.
3. Image processing is performed to increase the contrast and hue of the entire image.

  As for image processing, either a method of processing on the imaging device side at the time of image capturing or a method of processing an image captured using retouch software or the like on a personal computer or the like after shooting is generally used.

  As an example of diorama-like image processing performed at the time of shooting with an imaging device, Patent Document 1 discloses that diorama image processing is performed with a focused position as an attention area automatically.

  In Patent Document 2, a region of interest is selected as a band-shaped region when diorama photography is performed. The width and position of the attention area are determined from the distance from the original image to the subject.

JP 2011-120143 A JP 2011-010243 A

  However, in the related art disclosed in the above-described patent document, an image that looks unnatural, such that a subject straddling the boundary of a region of interest is partially blurred and the remaining portion is not blurred.

  Accordingly, an object of the present invention is to provide an imaging device that prevents only a part of a plurality of subjects straddling the boundary of a region of interest from being blurred.

  In view of the above problems, an image processing apparatus according to the present invention includes a detection unit that detects a subject in an input image, a designation unit that designates a region of interest in an image, a region that is designated by the designation unit, and the detection unit. A determination unit that determines an overlap with a region corresponding to the detected subject, and an image processing unit that outputs a diorama image by performing different image processing on the region of interest specified by the specifying unit and other than that. The image processing means is characterized in that the attention area is deformed according to a detection result by the detection means, and image processing different from the deformed attention area is performed.

  Further, an image processing apparatus according to the present invention specifies distance detection means for detecting subject distances of a plurality of areas in an input image and an attention area in the image in an image processing apparatus that performs image processing on an input image. An image processing unit that outputs a diorama image by performing different image processing in addition to the attention area specified by the specifying unit, and the image processing unit is specified by the specifying unit The attention area is deformed so as to include an area that is continuous with the attention area and corresponds to the subject distance, and image processing different from the deformed attention area is performed.

  According to the present invention, it is possible to prevent an unnatural image in which only a part of a subject is blurred by determining whether the subject is a target subject from the positional relationship between the region of interest and the subject.

1 is a block diagram of Example 1. FIG. It is a figure of the to-be-photographed object in an input image. It is a flowchart of attention object determination. It is a figure of the attention area in an input image. It is a figure which shows the overlap of the detected to-be-photographed object and attention area. It is a figure which shows an overlap flag and a deformation | transformation attention area. FIG. 5 is a diagram showing detected subjects and attention areas in an input image arranged differently from FIG. 4. It is a figure which shows the overlap flag and deformation | transformation attention area | region of FIG. FIG. 8 is a diagram showing a detected subject and a region of interest in an input image arranged differently from FIG. 4 and FIG. It is a figure which shows the overlap flag and deformation | transformation attention area | region of FIG. It is a figure which shows the shape of the attention area | regions other than a rectangle. 6 is a block diagram of Embodiment 2. FIG. 10 is a block diagram of Example 3. FIG. It is a figure which shows the distance measurement point in an attention area. It is the figure which displayed the orthogonal coordinate on the input image. It is the figure which displayed the orthogonal coordinate on the input image when the right side of an imaging device is turned down. It is the figure which displayed the orthogonal coordinate on the input image when the left side of an imaging device is turned down.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a block diagram of an imaging apparatus 1 according to an embodiment of the present invention. Each block described below is realized by, for example, the control unit 112 included in the imaging device 1 developing and executing a corresponding application program recorded in a recording device such as an HDD on a RAM or the like. It will be described as a module. However, in the embodiment of the present invention, the image processing is not limited to being realized by a program, and a part of the image processing is realized by hardware such as an information processing circuit having a function corresponding to one or more modules. May be.

The detection imaging unit 100 includes an imaging element and an imaging optical system that guides a light beam from a subject to the imaging element, and outputs digital imaging data as an input image 101. Detection The subject detection unit 102 detects the shape of each subject shown in the input image 101, and outputs subject position information represented by a two-dimensional orthogonal coordinate system as a detection result. The shape is detected by edge detection or luminance value detection.

  The orthogonal coordinate system will be described with reference to FIG. FIG. 15 is a diagram in which Cartesian coordinates are displayed on the input image.

  1500 is the origin (0, 0), 1501 is a point (x1, 0) moved from the origin by x1 in the x-axis direction, and 1502 is a point moved by y1 from the origin in the y-axis direction.

  Reference numeral 1503 denotes a point (x1, y1) moved from the origin by a distance of x1 in the x-axis direction and y1 in the y-axis direction.

  Reference numeral 1504 denotes the height of the detected subject 207 with the line formed by connecting the point (0, y1) and the point (x1, y1) as the base. 1505 is the height of the attention area 400. Here, x1 is the horizontal length of the input image 101, and y1 is the vertical length of the input image 101.

  FIG. 2 is a diagram simply showing a subject existing in the input image 101 detected by the subject detection unit 102. For the sake of explanation, the subject is represented by a simple rectangular diagram in FIG. 2, but in reality, these subjects have a complicated shape such as a person or a building.

  Here, reference numerals 200 to 209 represent subjects. 200 to 209 are detected by the subject detection unit 102.

  The operation unit 108 outputs instruction information 107 according to various inputs from the user. The instruction information 107 output to the attention area selection unit 103 is position information for setting the attention area on the screen. When the user sets an attention area using a touch panel or the like, the attention information is input to the attention area selection unit 103 as instruction information 107.

  As a method of selecting a region of interest, for example, a quadrangular region can be selected by touching two points, the upper left corner and the lower right corner.

  Alternatively, an area of an arbitrary shape may be specified by tracing the touch panel with a finger. Alternatively, an optimum region may be automatically selected and input as the instruction information 107 according to image conditions (such as an object that stands out in the center of the screen).

  The method for generating the instruction information 107 is not particularly limited in the present invention.

  The attention area selection unit 103 sets an area in the input image indicated by the instruction information 107 as an attention area, and outputs attention area position information.

  The target subject determination unit 104 outputs target subject determination information from each subject position information and target region position information. The subject-of-interest determination information includes subject position information and an overlap flag.

  The attention area deforming unit 105 deforms the attention area based on the area determined as the attention subject by the attention subject determination section 104.

  Based on the deformed attention area, the image processing unit 106 performs image processing for blurring the area other than the attention area as compared with the attention area, or changes the luminance and the color so that the input image has a diorama style. Apply image processing. In addition, general input images such as white balance processing, development processing, color space conversion, distortion correction processing, gamma correction processing, encoding, compression processing, etc., including normal input images that are not subjected to diorama-like image processing. Perform typical image processing.

  The display unit 109 outputs the image output from the image processing unit 106 to the display unit 109 and the recording unit 110, and displays and records them in predetermined data formats, respectively.

  The overlap flag will be described. When there is an area where the detected subject position information overlaps the attention area position information, the overlap flag is defined as “1”, and when there is no overlap area, the overlap flag is defined as “0”.

  The overlap flag has an information amount of 1 bit, and includes one overlap flag for each subject position information.

  The attention subject determination method will be described with reference to FIG. FIG. 3 is a flowchart for determining the subject of interest.

  In step S300, it is determined whether the subject region detected by the subject-of-interest determination unit 104 overlaps the region of interest.

  If the detected subject position information and the attention area position information have the same coordinates even in part, it is determined that they overlap, and the process proceeds to step S301. If not, the process proceeds to step S302.

  In step S302, an overlap flag “0” is given to the subject position information of the subject detected by the subject of interest determination unit 104. When the process is finished, step S305 follows.

  In step S301, it is determined whether the lowest end of the subject area detected by the target subject determination unit 104 is below the target region. In other words, in the present embodiment, the region corresponding to the detected subject and straddling the initial region of interest (continuous to the region of interest) is basically such that the entire region is included in the region of interest. Deform the region of interest. However, in the present embodiment, control is performed for each subject so that the region straddling the lower end of the region of interest is not included in the region of interest. Accordingly, a subject straddling the lower end of the attention area is determined in step S301, and the area corresponding to the subject is not regarded as the attention area (blurring target area). The determination method is to compare the distance from the straight line connecting the points 1502 and 1503 as the height in the coordinate system of the detected subject position information and attention area position information.

  When the height of the detected subject position information is lower than the height of the attention area position information, the process proceeds to step S304. When the height of the detected subject position information is higher than the height of the attention area position information, the process proceeds to step S303.

  In step S303, an overlap flag “1” is given to the subject position information of the subject detected by the subject of interest determination unit 104. When the process is finished, step S305 follows.

  In step S304, the overlap flag “0” is given to the subject position information of the subject detected by the subject of interest determination unit 104. When the process is finished, step S305 follows.

  In step S <b> 305, it is determined whether the determination has been completed for all the objects detected by the target object determination unit 104. If not completed, the process proceeds to step S300, and if completed, the flowchart ends.

  The subject-of-interest determination for each subject detected using FIG. 2, FIG. 3, FIG. 4, FIG. 5, and FIG.

  FIG. 4 is a diagram showing a region of interest 400 with respect to FIG. For simplification of explanation, FIG. 4 shows the region of interest as a rectangle. The attention area 400 is an output of the attention area selection unit 103.

  FIG. 5 is a diagram showing a portion where the subject and the attention area overlap. FIG. 6 is a diagram showing a subject to which an overlap flag is added and a deformed attention area according to the flow of the flowchart of FIG.

  FIG. 5 shows the result of determining whether or not the subjects 200 to 209 overlap with the attention area 400 in S300.

  Since the subject 200 to the subject 208 are partially overlapped, the process proceeds to S301. On the other hand, since the subject 209 does not overlap at all, the process proceeds to S302, where the overlap flag “0” is added to the subject position information of the detected subject.

  FIG. 6 shows the overlap flag added by the determination in S301 and the deformed attention area.

  Reference numerals 600 to 605 denote subjects having an overlap flag “1”, and reference numeral 606 denotes a deformation attention area.

  The subjects 203, 204, and 205 are determined in S301 that the lowest end of the subject is below the attention area 400, and in S304, the overlap flag “0” is added to the subject position information of the detected subject.

  For other subjects, since the lowest end of the subject is above the attention area 400 in S301, the overlap flag “1” is added in S303.

  First, an area where the object position information having the overlap flag “0” overlaps the attention area 400 is deleted from the attention area 400. Next, the region of subject position information having the overlap flag “1” with the attention region 400 is combined into a deformation attention region 606.

  As a result, the hatched portion shown in FIG.

  The image processing unit 106 performs different image processing on the region represented by the deformation attention region position information and the other region, and outputs a processed image.

  The image processing for diorama is performed by adjusting the brightness, saturation, and contrast of the region indicated by the deformation attention region position information 606 and the other region, and low-pass filtering the region other than the region indicated by the deformation attention region position information. It is to perform processing such as blurring by processing.

  The subject-of-interest determination and deformation of the region of interest at that time will be described with respect to the two patterns in FIGS.

  FIG. 7 shows an example in which there is a large subject such as a building that straddles the attention area 400 in the horizontal direction.

  Reference numerals 700, 701, and 702 are subjects.

  The subject 700 is arranged so as to straddle the left and right boundary lines of the attention area 400. The subject 701 is arranged so as to straddle the left and right boundary lines of the attention area 400. The subject 702 is arranged so as to straddle the left and right boundary lines of the attention area 400.

  The deformation of the attention area will be described with reference to FIG. FIG. 8 is a diagram showing the overlap flag and the deformation attention area of FIG.

  Reference numerals 801 to 802 denote subjects having an overlap flag “1”, and reference numeral 803 denotes a deformation attention area.

  Since the subject 700 and the subject 701 have an area overlapping the attention area 400 and are higher than the attention area, the overlap flag “1” is added in step S303.

  The subject 701 has an area that overlaps the attention area 400, but since there is an area that is lower than the attention area 400, an overlap flag “0” is added.

  First, an area where the object position information having the overlap flag “0” overlaps the attention area 400 is deleted from the attention area 400. Next, the region of subject position information having the overlap flag “1” with the region of interest 400 is combined into a region of interest for deformation.

  As a result, the hatched portion shown in FIG.

  FIG. 9 shows an example in which there is a large subject such as a building that straddles the attention area 400 in the vertical direction.

  Reference numerals 900, 901, and 902 denote subjects.

  The subject 900 is arranged so as to straddle the upper and lower boundary lines of the attention area 400. The subject 901 is arranged so as to straddle the upper and lower and right boundary lines of the attention area 400. The subject 902 is arranged so as to straddle the upper and lower boundary lines of the attention area 400.

  The deformation of the attention area will be described with reference to FIG. FIG. 10 is a diagram showing the overlap flag and the deformation attention area in FIG.

  Reference numerals 901 to 902 denote subjects having an overlap flag “1”, and reference numeral 1000 denotes a deformation attention area.

  Although the subject 900 to the subject 902 have a region that overlaps the region of interest 400, an overlap flag “0” is added because there is a region that is lower than the region of interest 400.

  First, an area where the subject position information having the overlap flag “0” and the attention area 400 overlap from the attention area 400 is set as a deformation attention area. As a result, the hatched portion shown in FIG.

  In FIG. 10, the region of interest is divided into a plurality of regions, but the number of regions of interest does not matter.

  As described above, for simplification of description, the case where the attention area 400 is designated by a rectangle has been described. However, as shown in FIG. 11, the attention area may not be a rectangle. Reference numeral 1100 in FIG. 11 is a region of interest shown in an arbitrary form.

  Even in such a case, a natural diorama image can be obtained by executing the processing contents shown in the flowchart of FIG.

  As described above, in the first embodiment, the attention area that restricts the blurring process is deformed from the positional relationship between the detected object and the attention area, and the diorama image processing is performed, thereby preventing the subject from being unnaturally blurred. be able to.

  Hereinafter, referring to FIG. 12, a method of deforming a region of interest in consideration of correction of the region of interest according to the vertical / horizontal detection information of the imaging apparatus, the position of the subject, the region of interest, and the region of interest by an external instruction according to the second embodiment of the present invention Will be described.

  FIG. 12 is a block diagram illustrating the second embodiment.

  Those having the same reference numerals as those in FIG.

  Reference numeral 1201 denotes a vertical / horizontal detection unit. Reference numeral 1202 denotes an attention subject determination unit. The operation of each processing unit will be described.

  The vertical / horizontal detection means 1201 detects whether the imaging device is vertical or horizontal and outputs vertical / horizontal information.

  For example, a method described in Japanese Patent Application Laid-Open No. 11-024150 is conceivable as a vertical / horizontal detection method using an imaging apparatus. In this patent, no particular reference is made to the vertical and horizontal detection method of the imaging apparatus.

  The subject-of-interest determination unit 1202 outputs the subject-of-interest determination information of each detected subject from the detected subject position information, the attention area position information, and the vertical / horizontal information.

  A method for determining the subject of interest will be described.

  The subject-of-interest determination unit 1202 uses vertical / horizontal information to check whether the imaging device is in vertical imaging.

  When the imaging device is lying down, the same processing as that in the flowchart of FIG. 3 is performed. In the vertical case, if the right side is down, processing is performed with the area on the right side as the bottom.

  The orthogonal coordinate system and the handling of the subject and the height of the attention area when the right side surface of the imaging apparatus is faced down will be described with reference to FIG.

  FIG. 16 is a diagram displaying the orthogonal coordinate system, the subject, and the height of the region of interest when the right side surface of the imaging apparatus is faced down. Each coordinate system is obtained by rotating the coordinate system of FIG. 15 by 90 ° to the left.

  Reference numeral 1600 denotes an origin (0, 0), 1601 denotes a point (y1, 0) moved from the origin by a distance y1 in the x-axis direction, and 1602 denotes a point moved from the origin by a distance x1 in the y-axis direction.

  Reference numeral 1603 denotes a point (y1, x1) moved from the origin by a distance of y1 in the x-axis direction and x1 in the y-axis direction.

  Reference numeral 1604 denotes the height to the detected object 207 with the line formed by connecting the point (0, x1) and the point (y1, x1) as the base. Reference numeral 1605 denotes the height of the attention area 400.

  On the contrary, when the left side is down, the coordinate system when the left side is down and how to handle the height of the subject and the attention area will be described with reference to FIG.

  FIG. 17 is a diagram displaying the orthogonal coordinate system, the subject, and the height of the region of interest when the right side surface of the imaging apparatus is faced down. Each coordinate system is obtained by rotating the coordinate system of FIG. 15 by 90 ° to the right.

  Reference numeral 1700 denotes an origin (0, 0), 1701 denotes a point (y1, 0) moved from the origin by a distance y1 in the x-axis direction, and 1702 denotes a point moved from the origin by a distance x1 in the y-axis direction.

  Reference numeral 1703 denotes a point (y1, x1) moved from the origin by a distance y1 in the x-axis direction and x1 in the y-axis direction.

  Reference numeral 1704 denotes the height to the detected object 207 with the line formed by connecting the point (0, x1) and the point (y1, x1) as the base. Reference numeral 1705 denotes the height of the attention area 400.

  When the imaging device is in vertical shooting, it can be handled by rotating the coordinate system.

  In the second embodiment, the diorama image processing is performed by deforming the attention area based on the vertical / horizontal information of the imaging apparatus, the positional information of the object, and the positional relation of the attention area, thereby preventing the subject from being unnaturally blurred. it can.

  Hereinafter, with reference to FIG. 13, a method for deforming a region of interest in consideration of the distance between the imaging device and the region of interest and the distance between the imaging device and each detected subject according to the third embodiment of the present invention will be described. To do.

  FIG. 13 is a block diagram illustrating the third embodiment.

  Since the processing method is the same for portions having the same reference numerals as those in FIGS.

  Reference numeral 1301 denotes a distance measuring unit. Reference numeral 1302 denotes an attention area distance measurement unit. Reference numeral 1303 denotes an attention subject distance determination unit.

  The operation of each processing unit will be described.

  The distance measuring unit 1301 detects the distance from the detected subject position information to the detected subject from the imaging apparatus 300, and outputs the detected subject distance information.

  As a method for measuring the distance using the imaging device, for example, the method described in Japanese Patent Laid-Open No. 06-331874 can be considered. This patent does not specifically mention the distance measurement method.

  The attention area distance measuring unit 1302 outputs an average distance obtained by calculating an average value of distances of a plurality of positions in the attention area from the imaging apparatus 300 based on the attention area position information.

  The measurement of the average distance of the attention area from the imaging device will be described with reference to FIG.

  FIG. 14 is a diagram showing distance measurement points in the attention area 400.

  Reference numerals 1400 to 1408 denote distance measurement points in the attention area 400.

  The attention area distance measurement unit 1202 measures the distance (subject distance) from the imaging device at each of a plurality of distance measurement points 1400 to 1408, and outputs the average of the attention area.

  The number of distance measurement points may be any number and any position.

  The target subject determination unit 1303 outputs each target subject determination information based on the detected subject position information, subject distance information, and the average distance of the target region.

  The subject-of-interest determination unit 1303 adds an overlap flag to the detected position information of the subject. The subject-of-interest determination information is a combination of detected subject position information and an overlap flag.

  A focused subject determination method will be described.

  Each detected object distance information is compared with the average distance of the attention area.

  If the detected subject distance information is within 10% of the average distance of the attention area, an overlap flag “1” is added. The overlap flag “0” is added to the other subject distance information.

  In this patent, the difference between the average distance of the attention area used for comparison and the distance information of the detected subject is not particularly limited.

  In the third embodiment, since the attention area is deformed in consideration of the average distance of the attention area and the detected distance of the object, it is possible to prevent the subject from becoming unnaturally blurred.

(Other embodiments)
The object of the present invention can also be achieved as follows. That is, a storage medium in which a program code of software in which a procedure for realizing the functions of the above-described embodiments is described is recorded is supplied to the system or apparatus. The computer (or CPU, MPU, etc.) of the system or apparatus reads out and executes the program code stored in the storage medium.

  In this case, the program code itself read from the storage medium realizes the novel function of the present invention, and the storage medium and program storing the program code constitute the present invention.

  Examples of the storage medium for supplying the program code include a flexible disk, a hard disk, an optical disk, and a magneto-optical disk. Further, a CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD-R, magnetic tape, nonvolatile memory card, ROM, or the like can also be used.

  Further, by making the program code read by the computer executable, the functions of the above-described embodiments are realized. Furthermore, when the OS (operating system) running on the computer performs part or all of the actual processing based on the instruction of the program code, the functions of the above-described embodiments are realized by the processing. Is also included.

  Furthermore, the following cases are also included. First, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

  In addition, the present invention is not limited to devices such as digital cameras, but includes built-in or external connection of imaging devices such as mobile phones, personal computers (laptop type, desktop type, tablet type, etc.), game machines, etc. It can be applied to any device. Therefore, the “imaging device” in this specification is intended to include any electronic device having an imaging function.

DESCRIPTION OF SYMBOLS 101 Input image 102 Subject detection part 103 Attention area selection part 104 Attention subject determination part 105 Attention area deformation | transformation part 106 Image processing part 107 Instruction information

Claims (10)

In an image processing apparatus that performs image processing on an input image,
Detecting means for detecting a subject in the input image;
A designation means for designating a region of interest in the input image;
Determining means for determining an overlap between the area designated by the designation means and the area corresponding to the subject detected by the detection means; and transforming the attention area according to a detection result by the detection means, Image processing means for blurring the area;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the image processing unit determines the overlap based on vertical and horizontal information of an imaging apparatus in which the input image is captured.   When the region corresponding to the subject detected by the detection unit overlaps the attention region, the image processing unit performs the deformation so that the entire region of the overlapping subject is included in the attention region. The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   When the region corresponding to the subject detected by the detection unit overlaps the target region, the image processing unit controls for each subject whether the region corresponding to the overlapping subject is included in the target region. The image processing apparatus according to claim 1, wherein the deformation is performed. In an image processing apparatus that performs image processing on an input image,
Distance detecting means for detecting subject distances of a plurality of regions in the input image;
A designation means for designating a region of interest in the input image;
Image processing means for outputting a diorama image by performing different image processing on the attention area specified by the specifying means, and other than that,
The image processing means deforms the attention area so as to include an area that is continuous with the attention area designated by the designation means and includes a subject distance, and an image different from the deformed attention area. An image processing apparatus that performs processing. The image processing apparatus according to claim 4.
The distance detection means outputs an average value of distances of a plurality of positions in the region. The image processing apparatus according to any one of claims 1 to 6,
The image processing apparatus according to claim 1, wherein the designation means designates a region of interest with a rectangle in response to designation of coordinates of two points on the screen. The image processing apparatus according to any one of claims 1 to 6,
The image processing apparatus according to claim 1, wherein the designation means uses a region connecting a plurality of coordinates shown on the screen as a region of interest. In a control method of an image processing apparatus that performs image processing on an input image,
A detection step for detecting a subject in the input image;
A designation step for designating a region of interest in the image;
A determination step of determining an overlap between the region specified in the specifying step and the region corresponding to the subject detected in the detection step;
An image processing step that outputs a diorama image by performing different image processing on the attention area specified in the specifying step;
In the image processing step, the region of interest is deformed according to the detection result of the detecting step, and image processing different from the deformed region of interest is applied to the deformed region of interest. In a control method of an image processing apparatus that performs image processing on an input image,
A distance detection step for detecting subject distances of a plurality of regions in the input image;
A designation step for designating a region of interest in the image;
An image processing step that outputs a diorama image by performing different image processing on the attention area specified in the specifying step;
In the image processing step, the attention area is deformed so as to include an area that is continuous with the attention area specified in the specifying step and the subject distance corresponds to, and an image different from the deformed attention area. A control method for an image processing apparatus, characterized by performing processing.

Images