JP2016091376A - Image processor and control method thereof, program and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor capable of generating an image added with a suitable light beam.SOLUTION: According to this invention, the image processor includes acquisition means for acquiring an image, estimation means for estimating the position of a light source when picking up an image from the image, detection means for detecting an area having a luminance value higher than a prescribed luminance value from the image as a high luminance area, and setting means for setting an area to which light beams from the light source are added in accordance with the position of the light source estimated by the estimation means and the position of the high luminance area detected by the detection means.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image processing apparatus, a control method thereof, a program, and a recording medium, and more particularly to a technique for adding a predetermined effect to an image.

  Conventionally, if a physical filter is attached to the front of the photographic optical system when shooting with a digital camera or the like, it can be obtained in normal shooting, for example, by emphasizing a specific color or producing a flow effect on a specific part of an image. It is possible to obtain an image with an effect that cannot be obtained. However, it is necessary to replace the filter, and there is a restriction that normal photographing cannot be performed in a state where the filter is used. For such a problem, Patent Document 1 discloses a technique for adding an effect by image processing.

JP 2012-999 A

  According to the above-described conventional technology, the same effect as that obtained by using the filter by image processing is used without using a physical filter called a cross filter that can obtain the effect of extending light rays from a bright spot. An added image can be generated.

  However, since the related art is a technique for adding an effect of a pattern prepared in advance, such as a cross or a radial pattern, to the detected bright spot, the position of the light beam obtained by the added effect and the extending direction are fixed. become. For this reason, with conventional technology that adds effects through image processing, the effect of the position and direction of light rays not depending on the subject and the angle of view, such as twilight rays inserted through the gaps between clouds and light inserted through windows, is not constant. In some cases, the light insertion direction may become unnatural.

  The present invention has been made in view of the above-described problems of the prior art, and provides an image processing apparatus capable of generating an image to which appropriate light is added, a control method thereof, a program, and a recording medium. With the goal.

  In order to solve this problem, for example, an image processing apparatus of the present invention has the following configuration. That is, an acquisition unit that acquires an image, an estimation unit that estimates a position of a light source when an image is captured from an image, and a detection unit that detects an area having a luminance value higher than a predetermined luminance value from the image as a high luminance area And a setting means for setting a region to which the light beam of the light source is added according to the position of the light source estimated by the estimating means and the position of the high luminance region detected by the detecting means.

  According to the present invention, it is possible to generate an image with appropriate light rays added thereto.

1 is a block diagram illustrating an example of a functional configuration of a digital camera as an example of an imaging apparatus according to an embodiment of the present invention. 1 is a block diagram illustrating a configuration of an image processing unit 105 according to the first embodiment. 7 is a flowchart showing a series of operations of light beam addition processing according to the first embodiment. (A) The figure which shows the estimated light source position and the detected high-intensity area | region which concern on Embodiment 1, (b) The figure explaining the process which determines whether it is the object which adds a light ray between high-intensity areas, (c) A light ray Diagram explaining the area to add FIG. 3 is a block diagram illustrating a configuration of an image processing unit 501 according to the second and third embodiments. 7 is a flowchart showing a series of operations of light beam addition processing according to the second embodiment. 7 is a flowchart showing a series of operations of light beam addition processing in the third embodiment.

(Embodiment 1)
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. In the following, an example in which the present invention is applied to a digital camera capable of adding an effect (light effect) to a captured image will be described as an example of an image processing apparatus. However, the image processing apparatus referred to in the present invention is not limited to a digital camera, and can be applied to any electronic device that can add an effect to an acquired image without shooting. These electronic devices may include, for example, a mobile phone, a game machine, a tablet terminal, a personal computer, a clock-type or glasses-type information terminal.

(Configuration of digital camera 100)
FIG. 1 is a block diagram illustrating a functional configuration example of a digital camera 100 as an example of an image processing apparatus according to the present embodiment. One or more of the functional blocks shown in FIG. 1 may be realized by hardware such as an ASIC or a programmable logic array (PLA), or may be realized by a programmable processor such as a CPU or MPU executing software. May be. Further, it may be realized by a combination of software and hardware. Therefore, in the following description, even when different functional blocks are described as the operation subject, the same hardware can be realized as the subject.

  The photographing optical system 101 includes a lens group including a zoom lens and a focus lens, and forms an optical image of a subject. The control unit 50 can acquire and control the zoom and focus states. The shutter 102 has an aperture function, and exposes an imaging element (not shown) of the imaging unit 103 with an aperture and time according to an instruction from the control unit 50.

  The imaging unit 103 includes an imaging element having a configuration in which a plurality of pixels each having a photoelectric conversion element are two-dimensionally arranged. The image sensor photoelectrically converts the subject optical image formed through the photographing optical system 101 and the shutter 102 at each pixel and outputs an analog signal. The imaging device may be an imaging device such as a CCD (Charge-Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor. The image sensor has, for example, a primary color Bayer color filter, and each pixel is provided with one of R (red), G (green), and B (blue) color filters.

  The A / D conversion unit 104 performs analog / digital conversion on the analog signal input from the imaging unit by an A / D conversion circuit, and outputs a digital signal (image data) in units of pixels to the image processing unit 105.

  The image processing unit 105 acquires image data from the A / D conversion unit 104 or the memory control unit 107. The image data is subjected to various image processing such as white balance color conversion processing and γ processing, and image data of Bayer RGB data or luminance / color difference signals (Y, RY, BY) is output. . The image data output from the image processing unit 105 is written into the image memory 106 via the memory control unit 107. Further, the image processing unit 105 performs predetermined calculation processing on the acquired image data and outputs the calculation result to the control unit 50. The control unit 50 performs exposure control and distance measurement control based on the input calculation result, thereby realizing TTL (through-the-lens) AF (autofocus) processing, AE (automatic exposure) processing, and the like. The image processing unit 105 further analyzes the acquired image data to estimate a light source, and performs AWB (auto white balance) processing based on the estimated light source. Further, a light beam adding process described later is performed to add a light effect for making the light in the image more impressive (also simply referred to as adding a light beam).

  The image memory 106 is a storage medium constituted by a semiconductor memory or the like, and stores image data output from the imaging unit 103 and image data to be displayed on the display unit 109. A memory control unit 107 controls the image memory 106 to control writing and reading of image data.

  The D / A conversion unit 108 converts the digital data for image display stored in the image memory 106 into an analog signal and supplies the analog signal to the display unit 109. The display unit 109 displays the display analog signal input from the D / A conversion unit 108 on a display device such as an LCD.

  The codec unit 110 performs compression encoding processing on the image data recorded in the image memory 106 in a compression format conforming to a standard such as MPEG.

  The recording medium 112 is a detachable recording medium composed of a memory card, a hard disk, or the like. The recording I / F 111 is an interface with the recording medium 112 and controls writing and reading of image data on the recording medium 112.

  The operation unit 120 is a button, dial, touch panel, or the like for operating the digital camera 100, and outputs the detected operation or operation content to the control unit 50 when detecting various operation instructions by the user. The control unit 50 controls each unit of the digital camera 100 according to the operation input from the operation unit 120.

  The power switch 121 is a switch for controlling on / off of the power of the digital camera 100. The power supply unit 123 is a power supply device that supplies power to the digital camera 100 and includes a battery or a battery. The power supply control unit 122 detects whether or not a battery is mounted in the power supply unit 123, the type of the mounted battery and the remaining amount of the battery, and outputs the detection result to the control unit 50.

  The non-volatile memory 124 is an electrically erasable / recordable recording medium including, for example, an EEPROM, etc., and after the power is turned off, such as captured image data and information on various settings used for shooting by the digital camera 100. Also stores information that needs to be retained. The system timer 125 measures the time used for various controls and the time of a built-in clock.

  The control unit 50 is, for example, a CPU or an MPU, and controls the entire system of the digital camera 100 by expanding and executing a program stored in the nonvolatile memory 124 in the work area of the system memory 126. The system memory 126 is a volatile storage medium that temporarily stores the data of the control unit 50. In addition to the program read from the nonvolatile memory 124, constants and variables for operation of the control unit 50 are expanded. .

(Configuration of the image processing unit 105)
Next, the configuration of the image processing unit 105 will be described with reference to FIG. The image processing unit 105 includes a light source position estimation unit 201, a high brightness region detection unit 202, a light beam addition region setting unit 203, and a light beam addition unit 204. Is realized. For example, when a light beam is added to light entering from a window, the direction of light entering from the window is between the bright window area and the bright area on the floor of the room, and the light beam appears between the two bright areas. It is desirable to add a light beam. For this reason, the image processing unit 105 first estimates the light source position in the image data acquired by the light source position estimating unit 201 and calculates the high luminance region in the image by the high luminance region detecting unit 202. Using these calculation results, a position (also referred to as an area) where a light beam is added is set by the light beam addition area setting unit 203, and a light beam is added to the position set by the light beam addition unit 204.

(A series of operations related to light beam addition processing according to the first embodiment)
Furthermore, with reference to FIG. 3, a series of operations related to the light beam addition processing will be described in more detail. In addition, FIG. 4 will be referred to as appropriate in order to explain a method for determining a region to which a light beam is added.

  Note that this processing is started from the time when the image processing unit 105 acquires image data that is captured by pressing a release button (not shown) of the operation unit 120 and output from the imaging unit 103, for example.

  In S301, the light source position estimation unit 201 estimates the light source position based on the acquired image data. The method for estimating the light source position can use a known technique, and thus a detailed description thereof is omitted. For example, the light source position can be estimated based on the shadow information of the object.

  In S302, the high brightness area detection unit 202 detects a high brightness area from the acquired image data. For example, the high luminance region detection unit 202 detects the high luminance region by determining whether the luminance value of each pixel included in the image data is equal to or greater than a predetermined threshold T1. The threshold value T1 is, for example, an intermediate value between the average luminance value of the entire image and the maximum luminance value of the pixels in the image, but may be a threshold value calculated by another method. The high brightness area detection unit 202 extracts a pixel having a brightness value equal to or higher than T1 from each pixel. When the extracted pixels are adjacent to each other, a high brightness area is formed by treating the adjacent pixels as the same area, and two or more high brightness areas are detected in the image. FIG. 4A shows a high brightness area when, for example, three high brightness areas are detected. In FIG. 4A, 401 indicates the estimated light source position, and 402 to 404 indicate three different high-luminance regions, respectively.

  In S303, the light ray addition area setting unit 203 calculates the respective barycentric coordinates for each high luminance area detected in S302. In FIG. 4B, barycentric coordinates 405 to barycentric coordinates 407 indicate barycentric coordinates corresponding to the respective high-luminance areas detected in S302.

  In S304, the light beam addition region setting unit 203 determines whether or not a region between two high luminance regions among the high luminance regions detected in S302 is a target to which a light beam is to be added. Specifically, the light ray addition area setting unit 203 selects two of the center coordinates of the high brightness area calculated in S303, and the selected two center coordinates and the light source position estimated in S301 are arranged on a straight line. In this case, it is determined that a light beam is to be added between the two high luminance areas. That is, the region to which light rays are to be added is a region between two high-brightness regions, and when the two high-brightness regions are included within the angle of view of the captured image, the light ray is to be added.

  More specifically, first, the light beam addition region setting unit 203 determines whether or not the barycentric coordinates of the two selected high luminance regions and the estimated light source position are aligned on a straight line. Since light rays such as twilight rays are generated by scattering of light emitted from the light source, the region to which the light rays are added may exist in a direction along the emission direction of the light from the light source. For this reason, if the barycentric coordinates and the light source positions of the two high-luminance areas are not aligned on a straight line, if a light beam is added between the two high-luminance areas, the radiation direction of the light from the light source is Light rays are added in different directions, and an uncomfortable image is generated. Therefore, if the light ray addition region setting unit 203 determines that the barycentric coordinates and the light source positions of the two high luminance regions are not aligned on a straight line, the light addition region setting unit 203 is not a target to add light between the two high luminance regions. judge.

  However, when the barycentric coordinates and the light source positions of the two high-brightness areas are not aligned with each other, but the light-added area setting unit 203 is positioned between the two high-brightness areas, the position is slightly deviated from the straight line. Is determined as a target to which light is added. For example, as illustrated in FIG. 4B, the light beam addition region setting unit 203 includes a distance d between the light source position 401 and the straight line L passing through the barycentric coordinates 405 and the barycentric coordinates 406 of the high luminance region 402 and the high luminance region 403. Is calculated. If the distance d is equal to or smaller than the predetermined threshold value T2, it is determined that the lines are aligned on a straight line, and a region between two high-luminance regions is set as a target region to which light is added. In addition, even if the barycentric coordinates and light source positions of two high-brightness areas are aligned on a straight line, if there is a light source position between the two barycentric coordinates, a light beam is added between the two high-brightness areas. It is not set as the target area.

  The light ray addition region setting unit 203 determines whether or not a region between two high luminance regions is a target to which a light ray is to be added, for all two high luminance region sets. If the light ray addition area setting unit 203 determines that there is a high-luminance area to which light rays are to be added, the process proceeds to S305. If there is no high-luminance area to which light rays are to be added, the light ray addition area setting unit 203 adds light rays. Do not do.

  In S305, the light ray addition area setting unit 203 classifies each high-luminance area as either a start point area or an end point area. The light ray addition area setting unit 203 adds the high luminance area including the barycentric coordinates close to the light source position to the two high luminance areas determined as the objects to which the light ray is added in S304, and the barycentric coordinates far from the light source position. A high-luminance region that includes a point is an end point region to which light is added.

  In S306, the light ray addition region setting unit 203 sets the region between the start point region and the end point region determined in the process of S305 as a light ray addition region. That is, an area including a part on a straight line passing through the barycentric coordinates of the start point area and the end point area is set as an area to which light rays are added. More specifically, as shown in FIG. 4C, the light beam addition region setting unit 203 calculates two tangent lines 408 and tangent lines 409 that circumscribe the start point region and the end point region, respectively. Then, a start point region, an end point region, and a region surrounded by two tangents circumscribing these regions are set as regions to which light rays are added.

In S307, the light beam adding unit 204 adds a light beam to the area set in S306. For example, if the RGB value of each pixel in the region to which light is added is (Rin, Gin, Bin) and the RGB value of the light component to be added is (Reff, Geff, Beff), the RGB of each pixel after the light is added The values (Rout, Gout, Bout) are expressed by adding the RGB values as follows.
Rout = Rin + Reff
Gout = Gin + Geff
Bout = Bin + Beff
At this time, as the RGB ratio of the added light component, the RGB ratio of the light source color calculated by a known light source color estimation method can be used, and a detailed calculation method is omitted. The ratio of RGB constituting the specular reflection component may be calculated from the difference between the pixel values of neighboring pixels, and the ratio may be calculated as the light source color.

  Further, the intensity of the added light component (RGB value of the light component) can be set as appropriate. For example, when focusing on the end point region and its peripheral region, the end point region and the peripheral region are the same subject, but there may be a difference in pixel values such as luminance depending on whether or not the light from the light source is hit. Can be assumed. Therefore, the intensity may be set by regarding the difference in luminance between the end point area and the peripheral area as the intensity of the light component.

  In the present embodiment, the case where a light beam is added to the region between the set of the start point region and the end point region determined in S305 has been described, but a plurality of end point regions may be added as one end point region. . For example, when a plurality of sets of start point areas and end point areas are determined by the processing of S305 and the start point areas of these sets are the same high-luminance area, the plurality of end point areas are A light beam may be added after being treated as one end point region.

  When finishing the processing of S307, the image processing unit 105 ends a series of operations related to the light beam addition processing.

  In the present embodiment, an example in which a light beam having a constant intensity is added from the start point region to the end point region when the light beam is added in S307 has been described. However, the intensity of the added light beam is not limited to this example. For example, when there is a difference in luminance between the start point region and the end point region, the intensity of the light beam according to the amount of change in luminance from the start point region to the end point region. May be set. In this way, a more natural light beam can be added when there is a luminance difference between the pair of high luminance regions.

  As described above, in this embodiment, an area to which light is added is set according to the estimated position of the light source and the position of the high luminance area in the image. More specifically, a light beam is added when two high-intensity areas different from the position of the light source have a predetermined relationship, that is, when the barycentric coordinates of the two high-intensity areas and the light source position are aligned in a substantially straight line. I made it. This makes it possible to appropriately add a light beam whose position and extending direction are not constant depending on the subject and the angle of view, such as a light beam inserted through a gap between clouds or light inserted from a window. . Therefore, it is possible to generate an image with appropriate light rays added.

(Embodiment 2)
Next, Embodiment 2 will be described. In the first embodiment, the processing for determining the position to add a light beam in the two-dimensional space has been described. However, the second embodiment is different in that the position to add a light beam in the three-dimensional space is determined. Unlike the first embodiment, the image processing unit 501 of the present embodiment has a configuration capable of calculating and using distance information (depth information), and the other configurations are the same as those of the first embodiment. For this reason, the same configurations and steps will be denoted by the same reference numerals, and redundant description will be omitted, and differences will be mainly described.

(Configuration of Image Processing Unit 501)
With reference to FIG. 5, the configuration of the image processing unit 501 according to the present embodiment will be described. In addition to the configuration of the image processing unit 105 according to the first embodiment, the image processing unit 501 includes a distance information acquisition unit 502 and a light beam addition region setting unit 503 according to the present embodiment.

  The distance information acquisition unit 502 acquires distance information corresponding to the acquired image from, for example, a known distance measuring sensor, and outputs the acquired distance information together with the image data. The light beam addition region setting unit 503 determines a high luminance region to which a light beam is to be added among the high luminance regions detected by the high luminance region detection unit 202, and sets a region to which a light beam is added. At this time, the light beam addition region setting unit 503 sets a region to which a light beam is added using the distance information acquired by the distance information acquisition unit 502.

(A series of operations related to light beam addition processing according to the second embodiment)
Next, a series of operations of the light beam addition processing according to the present embodiment will be described with reference to FIG.

  First, the light source position estimation unit 201 performs light source position estimation on the acquired image in the same manner as in S301 in the first embodiment.

  In step S601, the distance information acquisition unit 502 acquires distance information of the acquired image. The distance information is, for example, distance information from the digital camera 100 output from the distance measuring sensor, and can be acquired in units of pixels of the captured image. The high-intensity area detection unit 202 detects a high-intensity area from the acquired image in the same manner as S302 in the first embodiment. In S303 and S304, the light beam addition area setting unit 503 determines the barycentric coordinates of the high-intensity area. Is calculated. If the light ray addition area setting unit 503 determines that there is a high-luminance area to which light rays are to be added, the process proceeds to S602. If it is determined that there is no high-luminance area to which light rays are to be added, a series of steps are performed. End the process.

  In step S602, the light beam addition region setting unit 503 determines whether there is a subject that blocks between the two high-luminance regions. The light beam addition region setting unit 503 first calculates a straight line connecting the barycentric coordinates of the two high luminance regions. Then, using the calculated straight line and the distance information acquired in S <b> 601, it is determined whether or not a subject exists between the obtained straight line and the digital camera 100. When there is no subject between the calculated straight line and the digital camera 100, the light ray addition region setting unit 503 sets a region between two high luminance regions as a target region to which light is added. However, when it is determined that an object exists between the obtained straight line and the digital camera 100, the process of adding the light beam is not performed between the two high-brightness regions, as the target region to which the light beam is not added.

  Furthermore, the light beam addition region setting unit 503 and the light beam addition unit 204 further perform the processes shown in S305 to S307 shown in the first embodiment, and complete a series of operations related to the light beam addition process.

  In this embodiment, the light beam addition area setting unit 503 determines whether or not the two high-luminance areas and the light source position are aligned on a straight line in S304 as in the first embodiment. However, it may be determined whether or not they are arranged on a straight line in the three-dimensional space using the distance information.

  As described above, in the present embodiment, the distance information corresponding to the acquired image is acquired, the presence of the subject that blocks the light beam added between the high luminance regions is determined using the distance information, and the subject that blocks the light beam is determined. When present, no light was added. In this way, when a subject is present in front of a region to which a light beam is to be added, an unnatural light beam that adds a light beam on the subject is prevented, and a more natural light beam can be added. be able to.

(Embodiment 3)
Further, Embodiment 3 will be described. In the first embodiment and the second embodiment, the processing in the case where the start point region and the end point region to which light rays are added is included within the angle of view of the acquired image has been described. On the other hand, in the present embodiment, a process for adding a light beam when only the start point region to which the light beam is added exists within the angle of view of the acquired image will be described. The light beam addition processing of the present embodiment is different from the above-described embodiment in the method of setting a region to which light is added, but the other processing and the configuration of the digital camera 100 are the same as those of the second embodiment. For this reason, the same configurations and steps will be denoted by the same reference numerals, and redundant description will be omitted, and differences will be mainly described.

  A series of operations of the light beam addition processing according to the present embodiment will be described with reference to FIG.

  First, the light source position estimation unit 201, the distance information acquisition unit 502, and the high-luminance area detection unit 202 that configure the image processing unit 501 perform each process of S301 to S303 described in the second embodiment. However, in the process of S302 in the present embodiment, one or more high-luminance areas may be detected.

  In step S <b> 701, the light ray addition area setting unit 503 determines whether each high brightness area is a start point area to which light rays are added. Specifically, the light ray addition area setting unit 503 determines whether each high brightness area calculated in S302 is a start point area to which light is added based on the distance information acquired in S601. First, the light ray addition area setting unit 503 connects the barycentric coordinates of the high-brightness area calculated in S303 and the estimated light source position in order to extract the situation where only the start point area where the light ray is added is within the captured angle of view. Calculate the straight line. Then, a high luminance area is selected such that the barycentric coordinates of other high luminance areas do not exist on the straight line. Next, the light ray addition area setting unit 503 calculates a straight line that extends on the calculated straight line and extends from the barycentric coordinates of the high luminance area to the edge of the image in the direction opposite to the light source position. Further, the light ray addition region setting unit 503 determines whether or not a subject exists between the calculated straight line and the digital camera 100 based on the distance information acquired in S601. When it is determined that the subject does not exist, the light ray addition area setting unit 503 determines the high luminance area that is the object of determination as the start point area to which light is added. On the other hand, when it is determined that a subject exists, the high brightness area is not set as a target to which light is added.

  In S702, the light ray addition area setting unit 503 sets an area in which a light ray is added in a direction opposite to the direction of the light source position from the start point area determined in S701. More specifically, the light ray addition region setting unit 503 sets a region to which light rays are added between the start point region and the image end in the direction opposite to the light source position. For example, two straight lines circumscribing the start point area from the light source position are calculated, and an area surrounded by the obtained two straight lines, the start point area, and the edge of the image is set as an area to which light rays are added. At this time, the angle between the two straight lines circumscribing the viewpoint region may be set as appropriate based on the position of the light beam. The region to which the light beam is added is an example, and if the light source is added to the region in the direction opposite to the direction of the light source position from the start point region, the region includes a part on the straight line passing through the center of gravity of the start point region. Good.

  In S307, the light beam adding unit 204 adds a light beam to the region to which the light beam set in S702 is added by the same method as in the first embodiment.

  In the present embodiment, the processing for the high luminance region having only the start point region has been described. However, the processing may be used in combination with the processing for adding a light ray to the region between the high luminance regions which is the set described in the second embodiment. In this way, it is possible to add a light beam using both the high luminance region and the starting point region that form a pair.

  As described above, in the present embodiment, when only the light source and one high-luminance area are arranged on a straight line, a light beam inserted from the start point area to the image end is added with the high-luminance area as the start point area. In this way, even when the pair of high-luminance areas (that is, end point areas) are not included in the angle of view, a light beam can be added, and an image with an appropriate light beam added is generated. It becomes possible.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

DESCRIPTION OF SYMBOLS 105 ... Image processing part, 201 ... Light source position estimation part, 202 ... High-intensity area | region detection part, 203 ... Light beam addition area | region setting part, 204 ... Light beam addition part

Claims (16)

An acquisition means for acquiring an image;
Estimating means for estimating a position of a light source when the image is captured from the image;
Detecting means for detecting a region having a luminance value higher than a predetermined luminance value from the image as a high luminance region;
Setting means for setting a region to which light from the light source is added according to the position of the light source estimated by the estimating unit and the position of the high-intensity region detected by the detecting unit;
An image processing apparatus comprising: The detection means detects a first high-brightness region and a second high-brightness region that are different from each other,
When the position of the light source, the position of the first high-brightness region, and the position of the second high-brightness region exist on a substantially straight line, the setting means includes the first high-brightness region and the second high-brightness region. A region to which the light beam corresponding to the high luminance region is set, and the position of the light source, the position of the first high luminance region, and the position of the second high luminance region do not exist on a substantially straight line , Do not set the area to add the light beam,
The image processing apparatus according to claim 1. The setting means sets a region including a part on the substantially straight line as a region to which the light beam is added.
The image processing apparatus according to claim 2. The setting means is surrounded by two different tangents circumscribing each of the first high luminance region and the second high luminance region, and the first high luminance region and the second high luminance region. Set the region to be added as the region to which the light beam is added,
The image processing apparatus according to claim 2, wherein the image processing apparatus is an image processing apparatus. The detecting means detects one or more high-intensity regions including a first high-intensity region;
The setting means corresponds to the first high luminance region when there is no other high luminance region on a substantially straight line determined based on the position of the light source and the position of the first high luminance region. A region to which a light beam is added is set, and if another high-brightness region exists on a substantially straight line determined based on the position of the light source and the position of the first high-brightness region, the region to which the light beam is added is set. do not do,
The image processing apparatus according to claim 1. The setting means is an area including a part on the substantially straight line, and sets an area in a direction opposite to the position of the light source from the position of the first high-luminance area as an area to which the light beam is added.
The image processing apparatus according to claim 5. The setting means includes two different tangent lines circumscribing the first high-luminance region, extending from the position of the first high-luminance region in a direction opposite to the position of the light source, and the first high-luminance region. And an area surrounded by the edge of the image is set as an area to which the light ray is added.
The image processing apparatus according to claim 5, wherein the image processing apparatus is an image processing apparatus. Further comprising distance information acquisition means for acquiring distance information from the imaging device corresponding to the image;
Even if the setting unit can set the region to which the light beam is added according to the position of the light source and the position of the high luminance region, by using the distance information acquired by the distance information acquiring unit, According to the position of the subject included in the image and a part of the position on the substantially straight line, do not set the region to which the light beam is added
The image processing apparatus according to claim 2, wherein the image processing apparatus is an image processing apparatus. The setting means sets a position to add a light beam in a three-dimensional space using the distance information acquired by the distance information acquisition means.
The image processing apparatus according to claim 8. And further comprising an adding means for adding the light beam to the region set by the setting means,
The adding means adds a predetermined pixel value to the pixel value in the region as the light ray,
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. The adding means calculates a light source color of the light source from the image, and adds the predetermined pixel value obtained by using the light source color as the light beam,
The image processing apparatus according to claim 10. The adding means changes the predetermined pixel value in the region set by the setting means according to a distance from a position of the light source.
The image processing apparatus according to claim 10, wherein the image processing apparatus is an image processing apparatus. Imaging means for capturing the image;
The image processing apparatus according to any one of claims 1 to 12,
An imaging device comprising: An acquisition step in which the acquisition means acquires an image;
An estimating step for estimating a position of a light source when the image is captured from the image;
A detecting step for detecting, as a high luminance region, a region having a luminance value higher than a predetermined luminance value from the image;
A setting step for setting a region to which light from the light source is added according to the position of the light source estimated by the estimating unit and the position of the high-luminance region detected by the detecting unit;
A control method for an image processing apparatus, comprising:   The program for functioning a computer as each means of the image processing apparatus of any one of Claim 1 to 12.   A computer-readable recording medium on which a program for causing a computer to function as each unit of the image processing apparatus according to any one of claims 1 to 12 is recorded.

Images