JP5962810B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

  In the stereoscopic image display device, an image with a parallax is given to the viewer's left and right eyes to show the viewer a perspective image.

  Japanese Patent Application Laid-Open No. 6-324620

  By the way, in a stereoscopic image display device, an image is not displayed after performing processing for further enhancing or weakening perspective on an image input from the outside.

In order to solve the above-described problem, in the first aspect of the present invention, a distance information acquisition unit that acquires distance information representing a subject distance in each region measured by a camera at the time of capturing a captured image, and a captured image Without using the included distance information, a detection unit that detects a subject distance in each region of the captured image and a sense of distance of the image in the region are changed according to the subject distance detected for each region of the captured image. An image processing unit, and the image processing unit, for an area where the distance acquired by the distance information acquisition unit is longer than a predetermined distance, according to the subject distance detected by the detection unit The distance obtained by the distance information acquisition unit is changed according to the distance acquired by the distance information acquisition unit for an area where the distance acquired by the distance information acquisition unit is not longer than a predetermined distance. The image processing apparatus for changing the sense of distance range of the image, as well as to provide an image processing method, and a program.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

1 shows a configuration of an image processing apparatus 10 according to the present embodiment. An example of the original captured image before image processing is performed by the image processing apparatus 10 according to the present embodiment is shown. An example of the captured image after image processing is performed by the image processing apparatus 10 according to the present embodiment is shown. An example of a structure of the detection part 14 which concerns on this embodiment is shown. The structure of the image processing apparatus 10 which concerns on the modification of this embodiment is shown. 2 shows an exemplary hardware configuration of a computer 1900 according to the present embodiment.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 shows a configuration of an image processing apparatus 10 according to the present embodiment. The image processing apparatus 10 performs image processing on a captured image captured by a camera. As an example, the image processing apparatus 10 is provided in an image input stage of a display device. Further, the image processing apparatus 10 may be provided in the image output stage of the camera.

  The image processing apparatus 10 includes an input unit 12, a detection unit 14, a distance information acquisition unit 16, an image processing unit 18, and an output unit 20. The input unit 12 inputs a captured image captured by the camera. As an example, the input unit 12 may read a captured image stored in a recording medium, or may demodulate a captured image transmitted from a broadcasting station or the like.

  The detection unit 14 detects the subject distance in each region of the captured image. The subject distance indicates the distance from the camera to the subject at the time of imaging.

  For example, the detection unit 14 calculates the subject distance in the region according to the ratio of the blue component of each region in the captured image. For example, a subject with a long subject distance when a landscape is imaged appears with a greater proportion of the blue component than the original subject color due to the influence of the air layer from the camera to the subject. Therefore, the detection unit 14 can estimate the subject distance in the region according to the ratio of the blue component included in each region in the captured image.

  For example, the detection unit 14 calculates the average color of each region in the captured image, analyzes the calculated average color, and calculates the ratio of the blue component included in the average color. For example, the detection unit 14 determines that the subject distance is farther as the ratio of the blue component is larger for each region, and performs a process of estimating the subject distance of the region.

  The detection unit 14 may calculate the subject distance of the subject according to the spatial frequency of the contour of the subject displayed in the captured image. For example, a subject with a long subject distance when a landscape is imaged is greatly blurred due to an air layer between the camera and the subject. Therefore, the detection unit 14 can estimate the subject distance in the region according to the spatial frequency of the contour of the subject included in each region in the captured image.

  As an example, the detection unit 14 extracts the edge portion of each subject in each region in the captured image, and calculates the spatial frequency of the extracted edge. For example, the detection unit 14 determines that the subject distance is farther as the spatial frequency is lower for each region, and performs a process of estimating the subject distance of the region.

  The distance information acquisition unit 16 acquires distance information representing the subject distance in each region measured by the camera when the captured image is captured. As an example, the distance information acquisition unit 16 acquires two-dimensional information called a depth map that represents a distance from the camera to the surface of the subject in the screen.

  The image processing unit 18 changes the sense of distance of the image of the region according to the subject distance detected for each region of the captured image.

  As an example, the image processing unit 18 changes the sense of distance of the image of the region by changing the ratio of the blue component of each region according to the subject distance detected by the detection unit 14 for each region of the captured image. To do. For example, the image processing unit 18 increases the amount of blue component corresponding to the detected subject distance for each region of the captured image.

  More specifically, the image processing unit 18 may set a reference value for the subject distance in advance and increase the ratio of the blue component included in the region where the detected subject distance is larger than the reference value. For example, the image processing unit 18 sets two reference values of 1 km and 10 km. Then, the image processing unit 18 increases the ratio of the blue component by increasing the ratio of the blue component by 20% for the region where the subject distance is 1 km to 10 km, and increasing the ratio of the blue component by 40% for the region of 10 km or more. Increase.

  Further, as an example, the image processing unit 18 blurs each region according to the subject distance detected by the detection unit 14 for each region of the captured image, thereby changing the sense of distance of the image in the region. For example, the image processing unit 18 blurs the image with a blur amount corresponding to the detected subject distance for each region of the captured image.

  More specifically, the image processing unit 18 may set a subject distance reference value in advance, and blur an image in a region where the detected subject distance is larger than the reference value. For example, the image processing unit 18 sets two reference values of 1 km and 10 km. Then, the image processing unit 18 blurs the image with the first blurring degree for the region where the subject distance is 1 km to 10 km, and the image with the second blurring degree larger than the first blurring degree for the region with the distance of 10 km or more. Blur the image, such as blurring.

  By performing such processing, the image processing unit 18 can increase the difference in sense of distance between a region with a short subject distance and a region with a long subject distance. Thereby, the image processing unit 18 can emphasize the perspective of the captured image.

  Further, the image processing unit 18 may further change the sense of distance of each region of the captured image by further using the distance information acquired by the distance information acquisition unit 16. For example, for an area in which the distance acquired by the distance information acquisition unit 16 is longer than a predetermined distance, the image processing unit 18 determines the distance of the image in the area according to the subject distance detected by the detection unit 14. Change the feeling. For example, for the region detected by the distance information acquisition unit 16 as infinity, the image processing unit 18 changes the sense of distance of the image in the region according to the subject distance detected by the detection unit 14.

  Then, the image processing unit 18, for an area where the subject distance acquired by the distance information acquisition unit 16 is not longer than a predetermined distance, according to the subject distance acquired by the distance information acquisition unit 16. Change the sense of distance of the image. For example, for the region where the distance information acquisition unit 16 detects a distance that is not infinity, the image processing unit 18 gives a sense of distance of the image in the region according to the subject distance detected by the distance information acquisition unit 16. change. As a result, the image processing unit 18 can change the sense of distance of the image based on a wider range of the subject distance, and can further enhance the sense of perspective.

  The output unit 20 outputs the captured image subjected to the image processing by the image processing unit 18 to the outside. For example, when the image processing apparatus 10 is provided in a display device, the output unit 20 outputs a captured image in which the perspective is emphasized to the monitor. Further, for example, when the image processing apparatus 10 is provided in a camera, the output unit 20 stores a captured image in which a sense of perspective is emphasized in a storage medium.

  FIG. 2 shows an example of an original captured image before image processing is performed by the image processing apparatus 10 according to the present embodiment. FIG. 3 shows an example of a captured image after image processing is performed by the image processing apparatus 10 according to the present embodiment.

  The captured images shown in FIGS. 2 and 3 include, for example, a person (near view), a house (middle view), a mountain (distant view), and a sky (very distant view). Further, in FIG. 3, a cross indicates a region where the ratio of the blue component is increased.

  As an example, the image processing apparatus 10 increases the ratio of the blue component with respect to, for example, a mountain (distant view) and a sky (super distant view) included in the image illustrated in FIG. Furthermore, the image processing apparatus 10 increases the ratio of the blue component more greatly in the sky (super far view) area where the subject distance is farther than in the mountain (distant view) area.

  Further, in addition to or instead of increasing the ratio of the blue component, the image processing apparatus 10 may blur the mountain (far view) and the sky (super far view). Also in this case, the image processing apparatus 10 blurs the image with a larger blur amount in the sky (super far view) area where the subject distance is farther than in the mountain (distant view) area.

  Such an image processing apparatus 10 can make the difference in distance between a region with a close subject distance and a region with a long distance in a captured image feel larger. Thereby, according to the image processing apparatus 10, it is possible to emphasize the perspective in the captured image without changing the contour and composition of the subject in the captured image captured by the camera.

  FIG. 4 shows an example of the configuration of the detection unit 14 according to the present embodiment. For example, as illustrated in FIG. 4, the detection unit 14 includes a determination unit 22, a blue component detection unit 24, a blue component storage unit 26, and a calculation unit 28.

  The determination unit 22 determines the type of subject in each region in the captured image. As an example, the determination unit 22 compares an image pattern registered in advance with a subject included in the captured image to determine what type of subject is included in the captured image.

  The blue component detection unit 24 detects the ratio of the blue component of each region in the captured image. As an example, the blue component detection unit 24 calculates the average color of each region for each region, analyzes the calculated color of the average color, and calculates the ratio of the blue component included in the average color.

  The blue component storage unit 26 stores the proportion of the blue component that should be included in the image for each type of subject. As an example, the blue component storage unit 26 stores, for each of the types of subjects that can be detected by the determination unit 22, the ratio of the blue component originally included in the surface color of the subject of that type. As an example, the blue component storage unit 26 stores a value registered in advance by a user or the like.

  The calculation unit 28 reads, from the blue component storage unit 26, the ratio of the blue component of the type of subject determined by the determination unit 22 for each region in the captured image. Subsequently, the calculation unit 28 detects the ratio of the blue component of the type of subject determined by the determination unit 22 out of the ratio of the blue component for each subject stored in the blue component storage unit 26 and the blue component detection unit 24. The difference from the ratio of the blue component is calculated. Then, the calculation unit 28 calculates the subject distance in the area based on the calculated difference.

  For example, the calculation unit 28 determines whether the difference obtained by subtracting the ratio of the blue component for each subject stored in the blue component storage unit 26 from the ratio of the blue component detected by the blue component detection unit 24 is greater than or equal to the reference value. Calculate whether or not. Then, when the difference is smaller than the reference value, the calculation unit 28 determines that the subject distance is equal to or less than the reference distance. Further, the calculation unit 28 determines that the subject distance is equal to or greater than the reference distance when the calculated difference is equal to or greater than the reference value.

  According to such a detection unit 14, when a pre-registered type of subject is included in the captured image, the subject distance can be accurately detected.

  FIG. 5 shows a configuration of an image processing apparatus 10 according to a modification of the present embodiment. The image processing apparatus 10 according to the present modification employs substantially the same configuration and function as the image processing apparatus 10 illustrated in FIG. 1, and is therefore the same as the member having substantially the same configuration and function as those illustrated in FIG. 1. A reference numeral is attached, and the description will be omitted except for differences.

  The image processing apparatus 10 according to this modification further includes a position information acquisition unit 32 and a weather condition acquisition unit 34. The position information acquisition unit 32 acquires position information indicating the position where the captured image is captured. For example, a camera including a GPS (Global Positioning System) receiver can output a captured image to which position information indicating an imaging position is added. The position information acquisition unit 32 acquires position information included in the captured image output from such a camera.

  The weather condition acquisition unit 34 acquires the weather conditions at the time of imaging of the captured image based on the imaging date and time of the captured image and the position information acquired by the position information acquisition unit 32. For example, the camera can output a captured image with the imaging date and time added. The position information acquisition unit 32 acquires the imaging date and time included in the captured image output from such a camera. And the weather condition acquisition part 34 acquires the weather condition of the land shown by the positional information acquired by the positional information acquisition part 32 in the acquired imaging date, for example via a network.

  The detection unit 14 according to this modification detects the subject distance in each region of the captured image in accordance with the weather condition acquired by the weather condition acquisition unit 34. For example, when the weather condition at the time of capturing a captured image is “clear”, the air is clear, so that the contour of a subject with a long subject distance is clearly captured. On the other hand, when the weather condition at the time of capturing the captured image is “rain” or the like, the air is stagnant, so that the contour of the subject with a long subject distance is imaged unclearly. Therefore, as an example, in the subject distance estimation process based on the spatial frequency of the contour of the subject, the detection unit 14 sets the weather condition to “rain” when the weather condition is “clear” even when the spatial frequency is the same. The subject distance is estimated to be shorter than in the case of the above.

  In addition to the acquired weather condition or instead of the weather condition, the detection unit 14 according to the present modification calculates the subject distance in each region of the captured image according to the position information acquired by the position information acquisition unit 32. It may be detected. For example, there is a place where the air is clear and a place where it is stagnant depending on the location where the captured image is captured. In a place where the air is clear (for example, outside the city), the outline of a subject with a long subject distance is clearly imaged. On the contrary, the place where the air is stagnant (for example, the city) and the outline of the subject with a long subject distance are imaged unclearly. Therefore, as an example, in the subject distance estimation process based on the spatial frequency of the contour of the subject, the detection unit 14 is in the case of a shooting place (for example, other than a city) where the air is clear even at the same spatial frequency. The subject distance is estimated to be shorter than that in a shooting place where the air is stagnant (for example, a city).

  As described above, the image processing apparatus 10 according to the present modification can detect the subject distance more accurately and accurately emphasize the perspective in the captured image.

  Further, the detection unit 14 according to the present modification may detect the subject distance in each region of the plurality of captured images based on a plurality of captured images captured with different settings of the focus distance with respect to the same subject. In this case, for example, the detection unit 14 detects a focused area in the screen for each of the plurality of captured images. Then, the detection unit 14 estimates the subject distance of the focused area in the screen from the focus distances of the plurality of captured images. Thereby, the detection part 14 can produce | generate the distance information similar to a depth map, for example even if it is a case where distance information is not contained in a captured image.

  In addition, the detection unit 14 according to this modification may detect the subject distance in each region of the plurality of captured images based on the plurality of captured images captured with different settings of the aperture. In this case, the range where the plurality of captured images are focused on the screen gradually expands as the aperture changes from the open state to the closed state. Therefore, as an example, the detection unit 14 estimates the subject distance of each region in the screen by comparing the range in focus on the screen for each of the plurality of captured images. Thereby, the detection part 14 can produce | generate the distance information similar to a depth map, for example even if it is a case where distance information is not contained in a captured image.

  FIG. 6 shows an example of a hardware configuration of a computer 1900 according to this embodiment. A computer 1900 according to this embodiment is connected to a CPU peripheral unit having a CPU 2000, a RAM 2020, a graphic controller 2075, and a display device 2080 that are connected to each other by a host controller 2082, and to the host controller 2082 by an input / output controller 2084. Input / output unit having communication interface 2030, hard disk drive 2040, and CD-ROM drive 2060, and legacy input / output unit having ROM 2010, flexible disk drive 2050, and input / output chip 2070 connected to input / output controller 2084 With.

  The host controller 2082 connects the RAM 2020 to the CPU 2000 and the graphic controller 2075 that access the RAM 2020 at a high transfer rate. The CPU 2000 operates based on programs stored in the ROM 2010 and the RAM 2020 and controls each unit. The graphic controller 2075 acquires image data generated by the CPU 2000 or the like on a frame buffer provided in the RAM 2020 and displays it on the display device 2080. Instead of this, the graphic controller 2075 may include a frame buffer for storing image data generated by the CPU 2000 or the like.

  The input / output controller 2084 connects the host controller 2082 to the communication interface 2030, the hard disk drive 2040, and the CD-ROM drive 2060, which are relatively high-speed input / output devices. The communication interface 2030 communicates with other devices via a network. The hard disk drive 2040 stores programs and data used by the CPU 2000 in the computer 1900. The CD-ROM drive 2060 reads a program or data from the CD-ROM 2095 and provides it to the hard disk drive 2040 via the RAM 2020.

  The input / output controller 2084 is connected to the ROM 2010, the flexible disk drive 2050, and the relatively low-speed input / output device of the input / output chip 2070. The ROM 2010 stores a boot program that the computer 1900 executes at startup and / or a program that depends on the hardware of the computer 1900. The flexible disk drive 2050 reads a program or data from the flexible disk 2090 and provides it to the hard disk drive 2040 via the RAM 2020. The input / output chip 2070 connects the flexible disk drive 2050 to the input / output controller 2084 and inputs / outputs various input / output devices via, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like. Connect to controller 2084.

  A program provided to the hard disk drive 2040 via the RAM 2020 is stored in a recording medium such as the flexible disk 2090, the CD-ROM 2095, or an IC card and provided by the user. The program is read from the recording medium, installed in the hard disk drive 2040 in the computer 1900 via the RAM 2020, and executed by the CPU 2000.

  A program that is installed in the computer 1900 and causes the computer 1900 to function as the image processing apparatus 10 includes an input module, a detection module, a distance information acquisition module, an image processing module, and an output module. These programs or modules work on the CPU 2000 or the like to cause the computer 1900 to function as the input unit 12, the detection unit 14, the distance information acquisition unit 16, the image processing unit 18, and the output unit 20, respectively.

  The information processing described in these programs is read by the computer 1900, whereby the input unit 12, the detection unit 14, and distance information acquisition, which are specific means in which the software and the various hardware resources described above cooperate. Functions as the unit 16, the image processing unit 18, and the output unit 20. And the specific image processing apparatus 10 according to the intended use is constructed | assembled by implement | achieving the calculation or processing of the information according to the intended use of the computer 1900 in this embodiment by these concrete means.

  As an example, when communication is performed between the computer 1900 and an external device or the like, the CPU 2000 executes a communication program loaded on the RAM 2020 and executes a communication interface based on the processing content described in the communication program. A communication process is instructed to 2030. Under the control of the CPU 2000, the communication interface 2030 reads transmission data stored in a transmission buffer area or the like provided on a storage device such as the RAM 2020, the hard disk drive 2040, the flexible disk 2090, or the CD-ROM 2095, and sends it to the network. The reception data transmitted or received from the network is written into a reception buffer area or the like provided on the storage device. As described above, the communication interface 2030 may transfer transmission / reception data to / from the storage device by a DMA (direct memory access) method. Instead, the CPU 2000 transfers the storage device or the communication interface 2030 as a transfer source. The transmission / reception data may be transferred by reading the data from the data and writing the data to the communication interface 2030 or the storage device of the transfer destination.

  The CPU 2000 is all or necessary from among files or databases stored in an external storage device such as a hard disk drive 2040, a CD-ROM drive 2060 (CD-ROM 2095), and a flexible disk drive 2050 (flexible disk 2090). This portion is read into the RAM 2020 by DMA transfer or the like, and various processes are performed on the data on the RAM 2020. Then, CPU 2000 writes the processed data back to the external storage device by DMA transfer or the like. In such processing, since the RAM 2020 can be regarded as temporarily holding the contents of the external storage device, in the present embodiment, the RAM 2020 and the external storage device are collectively referred to as a memory, a storage unit, or a storage device. Various types of information such as various programs, data, tables, and databases in the present embodiment are stored on such a storage device and are subjected to information processing. Note that the CPU 2000 can also store a part of the RAM 2020 in the cache memory and perform reading and writing on the cache memory. Even in such a form, the cache memory bears a part of the function of the RAM 2020. Therefore, in the present embodiment, the cache memory is also included in the RAM 2020, the memory, and / or the storage device unless otherwise indicated. To do.

  In addition, the CPU 2000 performs various operations, such as various operations, information processing, condition determination, information search / replacement, etc., described in the present embodiment, specified for the data read from the RAM 2020 by the instruction sequence of the program. Is written back to the RAM 2020. For example, when performing the condition determination, the CPU 2000 determines whether the various variables shown in the present embodiment satisfy the conditions such as large, small, above, below, equal, etc., compared to other variables or constants. When the condition is satisfied (or not satisfied), the program branches to a different instruction sequence or calls a subroutine.

  Further, the CPU 2000 can search for information stored in a file or database in the storage device. For example, in the case where a plurality of entries in which the attribute value of the second attribute is associated with the attribute value of the first attribute are stored in the storage device, the CPU 2000 displays the plurality of entries stored in the storage device. The entry that matches the condition in which the attribute value of the first attribute is specified is retrieved, and the attribute value of the second attribute that is stored in the entry is read, thereby associating with the first attribute that satisfies the predetermined condition The attribute value of the specified second attribute can be obtained.

  The program or module shown above may be stored in an external recording medium. As the recording medium, in addition to the flexible disk 2090 and the CD-ROM 2095, an optical recording medium such as DVD or CD, a magneto-optical recording medium such as MO, a tape medium, a semiconductor memory such as an IC card, and the like can be used. Further, a storage device such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the computer 1900 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

The order of execution of each process such as operations, procedures, steps, and stages in the apparatus, system, program, and method shown in the claims, the description, and the drawings is particularly “before” or “prior to”. It should be noted that the output can be realized in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the description, and the drawings, even if it is described using “first”, “next”, etc. for convenience, it means that it is essential to carry out in this order. It is not a thing.
According to this specification etc., the aspect as described in each following item is also disclosed.
[Item 1-1 ] The detection unit may calculate the subject distance in the region according to the ratio of the blue component of each region in the captured image.
[Item 1-2 ] In item 1-1 , the detection unit includes a determination unit that determines the type of subject in each region in the captured image, and a blue component detection unit that detects a ratio of the blue component in each region in the captured image. A blue component storage unit that stores a ratio of a blue component to be included in the image for each type of subject, and a determination unit out of the ratio of the blue component for each subject stored in the blue component storage unit for each region in the captured image And a calculation unit that calculates a subject distance in the region based on a difference between the ratio of the blue component of the type of subject determined by the method and the ratio of the blue component detected by the blue component detection unit. .
[Item 2-1]
A detection unit for detecting a subject distance in each region of the captured image;
An image processing unit that changes a sense of distance of the image of the region according to a subject distance detected for each region of the captured image;
A weather condition acquisition unit for acquiring a weather condition at the time of imaging of the captured image based on an imaging date and time of the captured image;
With
The detection unit detects a subject distance in each region of the captured image in accordance with the acquired weather condition and a change in the spatial frequency of the contour of the subject.
Image processing device.
[Item 2-2]
A detection unit for detecting a subject distance in each region of the captured image;
An image processing unit that changes a sense of distance of the image of the region according to a subject distance detected for each region of the captured image;
A position information acquisition unit that acquires position information indicating a position where the captured image is captured;
With
The detection unit detects a subject distance in each region of the captured image according to the acquired position information and a change in a spatial frequency of the contour of the subject.
Image processing device.
[Item 2-3]
A weather condition acquisition unit for acquiring a weather condition at the time of capturing the captured image based on the position information of the captured image;
In addition,
The detection unit detects a subject distance in each region of the captured image in accordance with the acquired weather condition and a change in the spatial frequency of the contour of the subject.
The image processing device according to item 2-2.
[Item 2-4]
A detection unit for detecting a subject distance in each region of the captured image;
An image processing unit that changes a sense of distance of the image of the region according to a subject distance detected for each region of the captured image;
A distance information acquisition unit that acquires distance information representing a subject distance in each region measured by the camera at the time of capturing the captured image;
With
The detection unit calculates the subject distance of the subject according to the spatial frequency of the contour of the subject displayed in the captured image,
The image processing unit changes the sense of distance of the image in the region according to the subject distance detected by the detection unit for the region in which the distance acquired by the distance information acquisition unit is longer than a predetermined distance. And
For an area where the distance acquired by the distance information acquisition unit is not longer than a predetermined distance, the sense of distance of the image of the area is changed according to the distance acquired by the distance information acquisition unit.
Image processing device.
[Item 2-5]
The detection unit detects a subject distance in each region of the plurality of captured images based on a plurality of captured images captured by setting different focus distances.
The image processing device according to item 2-4.
[Item 2-6]
The detection unit detects a subject distance in each region of the plurality of captured images based on a plurality of captured images captured with different aperture settings.
The image processing device according to item 2-4.
[Item 2-7]
The image processing unit increases a ratio of a blue component included in an area where the detected subject distance is larger than a reference value.
Item 7. The image processing device according to any one of Items 2-1 to 6.
[Item 2-8]
The image processing unit blurs an image of an area where the detected subject distance is larger than a reference value.
Item 7. The image processing device according to any one of Items 2-1 to 6.
[Item 2-9]
The detection unit calculates the subject distance of the subject according to the spatial frequency of the contour of the subject displayed in the captured image.
Item 9. The image processing apparatus according to any one of Items 2-1 to 8.
[Item 2-10]
Detecting a subject distance in each area of the captured image;
Changing the sense of distance of the image of the region according to the subject distance detected for each region of the captured image;
Obtaining weather conditions at the time of imaging of the captured image based on the imaging date and time of the captured image;
With
The detecting step detects a subject distance in each region of the captured image in accordance with the acquired weather condition and a change in the spatial frequency of the contour of the subject.
Image processing method.
[Item 2-11]
Detecting a subject distance in each area of the captured image;
Changing the sense of distance of the image of the area according to the subject distance detected for each area of the captured image;
Obtaining position information representing a position where the captured image is captured;
With
The detecting step detects a subject distance in each region of the captured image according to the acquired position information and a change in a spatial frequency of the contour of the subject.
Image processing method.
[Item 2-12]
Detecting a subject distance in each area of the captured image;
Changing the sense of distance of the image of the area according to the subject distance detected for each area of the captured image;
Obtaining distance information representing subject distance in each region measured by the camera at the time of capturing the captured image;
With
The detecting step calculates the subject distance of the subject according to the spatial frequency of the contour of the subject displayed in the captured image,
In the step of changing the sense of distance, in the region in which the distance acquired in the step of acquiring the distance information is set to be longer than a predetermined distance, in the region according to the subject distance detected in the detecting step. Change the sense of distance of the image,
For a region where the distance acquired in the step of acquiring the distance information is not longer than a predetermined distance, the sense of distance of the image of the region is changed according to the distance acquired in the step of acquiring the distance information Do
Image processing method.
[Item 2-13]
A program for causing a computer to function as the image processing apparatus according to any one of Items 2-1 to 9.

DESCRIPTION OF SYMBOLS 10 Image processing apparatus, 12 Input part, 14 Detection part, 16 Distance information acquisition part, 18 Image processing part, 20 Output part, 22 Discrimination part, 24 Blue component detection part, 26 Blue component storage part, 28 Calculation part, 32 Position Information acquisition unit, 34 Weather condition acquisition unit, 1900 computer, 2000 CPU, 2010 ROM, 2020 RAM, 2030 communication interface, 2040 hard disk drive, 2050 flexible disk drive, 2060 CD-ROM drive, 2070 input / output chip, 2075 graphics Controller, 2080 Display device, 2082 Host controller, 2084 I / O controller, 2090 Flexible disk, 2095 CD-ROM

Claims (13)

A distance information acquisition unit that acquires distance information representing a subject distance in each region measured by the camera at the time of capturing a captured image;
A detection unit that detects a subject distance in each region of the captured image without using the distance information included in the captured image;
An image processing unit that changes a sense of distance of the image of the region according to a subject distance detected for each region of the captured image;
With
The image processing unit changes the sense of distance of the image in the region according to the subject distance detected by the detection unit for the region in which the distance acquired by the distance information acquisition unit is longer than a predetermined distance. And
An image processing apparatus that changes the sense of distance of an image of the area according to the distance acquired by the distance information acquisition unit for an area where the distance acquired by the distance information acquisition unit is not longer than a predetermined distance . The image processing apparatus according to claim 1, wherein the image processing unit increases a ratio of a blue component included in a region where the detected subject distance is larger than a reference value. The image processing apparatus according to claim 1, wherein the image processing unit blurs an image in a region where the detected subject distance is larger than a reference value. The image processing apparatus according to claim 1, wherein the detection unit calculates a subject distance in the region according to a ratio of a blue component of each region in the captured image. The detector is
A discriminator for discriminating the type of subject in each area in the captured image;
A blue component detection unit for detecting a ratio of a blue component of each region in the captured image;
A blue component storage unit that stores a ratio of a blue component to be included in an image for each type of subject;
For each area in the captured image, the ratio of the blue component of the type of subject determined by the determination unit out of the ratio of the blue component for each subject stored in the blue component storage unit and detected by the blue component detection unit A calculation unit that calculates a subject distance in the region based on a difference from the ratio of the blue component that has been performed;
The image processing apparatus according to claim 4. The image processing apparatus according to claim 1, wherein the detection unit calculates a subject distance of the subject according to a spatial frequency of a contour of the subject displayed in the captured image. A weather condition acquisition unit for acquiring weather conditions at the time of imaging of the captured image based on the imaging date and time of the captured image;
The image processing device according to claim 6 , wherein the detection unit detects a subject distance in each region of the captured image in accordance with the acquired weather condition and a change in a spatial frequency of the contour of the subject. A position information acquisition unit that acquires position information indicating a position where the captured image is captured;
The image processing device according to claim 6 , wherein the detection unit detects a subject distance in each region of the captured image in accordance with the acquired position information and a change in a spatial frequency of the contour of the subject. A weather condition acquisition unit for acquiring a weather condition at the time of capturing the captured image based on the position information of the captured image;
The image processing apparatus according to claim 8, wherein the detection unit detects a subject distance in each region of the captured image according to the acquired weather condition and a change in a spatial frequency of the contour of the subject. The image processing according to any one of claims 1 to 9, wherein the detection unit detects a subject distance in each region of the plurality of captured images based on a plurality of captured images captured with different settings of focus distances. apparatus. The image processing apparatus according to claim 1, wherein the detection unit detects a subject distance in each region of the plurality of captured images based on a plurality of captured images captured with different settings of an aperture. . Obtaining distance information representing subject distance in each region measured by the camera at the time of capturing a captured image;
Detecting the subject distance in each region of the captured image without using the distance information included in the captured image;
Changing the sense of distance of the image of the region according to the subject distance detected for each region of the captured image;
With
In the step of changing the sense of distance, according to the subject distance detected in the step of detecting the subject distance for an area where the distance obtained in the step of obtaining the distance information is longer than a predetermined distance. Change the sense of distance of the image in the area,
For a region where the distance acquired in the step of acquiring the distance information is not assumed to be longer than a predetermined distance, the sense of distance of the image of the region is changed according to the distance acquired in the step of acquiring the distance information Image processing method.   A program for causing a computer to function as the image processing apparatus according to any one of claims 1 to 11.

Images