JP2013046160A - Imaging apparatus, and control method and control program of imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly perform color correction even when a composition template and a through image are deviated from each other.SOLUTION: Each composition template comprises at least two closed regions, and includes composition contour information regulating the boundaries of the closed regions as contours and color setting information for setting the color of each closed region to each closed region. When photographing is started, a contour extraction unit 18 extracts, as extracted contour information, contour information indicating the contour with respect to image data obtained via an imaging lens. A matching determination unit 19 and a composition contour change unit 14 compare the composition contour information indicating the contour of a previously selected composition template with the extracted contour information, and change the composition contour information in accordance with the result of the comparison. When correcting the image data in accordance with the changed composition contour information, an image correction unit 15 performs color correction in accordance with the color setting information for each closed region on the basis of the changed composition contour information.

Description

  The present invention relates to an imaging apparatus capable of displaying a reference image on a display unit and performing composition setting relating to a subject at the time of shooting.

  In general, in an imaging device such as a digital camera, the outline information of a reference image is superimposed on a so-called through image displayed on a display unit such as an LCD, and composition setting relating to a subject is performed at the time of shooting. There is.

  For example, there is a display in which a composition template is displayed superimposed on a subject image displayed on a monitor display device (display unit). Here, the composition of the subject is determined using the composition template so that a photograph can be easily taken with the composition (see Patent Document 1). In Patent Document 1, measurement is performed corresponding to the composition template. There is a disclosure of a technique for embedding a distance frame or a photometric frame and using it for setting shooting conditions.

  On the other hand, when taking a picture by determining the composition using the composition template, the photographed image cannot be matched with the composition template due to insufficient wide-angle and telephoto angle specs in the imaging apparatus or the position of the photographer. There is.

  In order to deal with such a problem, the size of the composition template is changed. For example, there is one that compares the distance information included in the composition template with the distance information obtained by the imaging apparatus. Here, the size of the composition template is changed so that the similarity ratio between the composition template and the through image becomes 1: 1 based on the ratio as a comparison result (see Patent Document 2).

JP 2007-166250 A JP 2008-54031 A

  By the way, as described in Patent Document 2, when changing the size of a composition template, it is difficult to cope with the size change of the composition template unless the composition template and the composition of the through image are similar. That is, even if the subject distribution in the composition is almost the same as that in the composition template, the size can be changed only when the distance in the front-rear direction or the zoom ratio is different from the composition template.

  Therefore, an object of the present invention is to provide an imaging apparatus, a control method thereof, and a control program capable of appropriately setting shooting conditions or image processing conditions for each area even when the composition template and the through image are misaligned. Is to provide.

  In order to achieve the above object, an imaging apparatus according to the present invention is an imaging apparatus that performs shooting according to composition information selected from a plurality of pieces of composition information indicating a composition used at the time of shooting. Each has at least two closed areas, and the composition information includes composition outline information that defines a boundary of the closed area as an outline and color setting information that sets a color for each of the closed areas. When the photographing is started, the contour extracting means for extracting the contour information indicating the contour of the image data obtained through the imaging lens as the extracted contour information, and the composition indicating the contour of the pre-selected composition information The contour information is compared with the extracted contour information, and the contour information changing means for changing the composition contour information according to the comparison result, and the image data is supplemented according to the changed composition contour information. To time, and having an image correction means for performing color correction in accordance with the setting information for each of the closed region on the basis of the composition contour information after the change.

  A control method according to the present invention is a method for controlling an imaging apparatus that performs shooting according to composition information selected from a plurality of pieces of composition information indicating a composition used in shooting, and each of the composition information includes at least two pieces of composition information. The composition information includes composition contour information that defines the boundary of the closed region as a contour, and color setting information that sets the color of each of the closed regions, and shooting starts. Then, a contour extracting step for extracting the contour information indicating the contour of the image data obtained through the imaging lens as extracted contour information, the composition contour information indicating the contour of the preselected composition information, and the extraction When comparing the contour information with the contour information step for changing the composition contour information according to the comparison result and correcting the image data according to the composition contour information after the change, And having an image correction step of performing color correction in accordance with the setting information for each of the closed region on the basis of the composition contour information after.

  A control program according to the present invention is a control program used in an imaging apparatus that performs shooting according to composition information selected from a plurality of pieces of composition information indicating a composition used in shooting, and each of the composition information includes at least The composition information includes composition contour information that defines a boundary of the closed region as a contour, and color setting information that sets a color for each of the closed regions; A contour extraction step for extracting contour information indicating the contour of image data obtained via the imaging lens as extracted contour information when photographing is started in the computer included in the imaging device, and the composition information selected in advance A contour information step for comparing the composition contour information indicating the contour of the image and the extracted contour information, and changing the composition contour information according to the comparison result; When correcting the image data in accordance with the post-composition contour information, an image correction step for performing color correction in accordance with the color setting information for each of the closed regions based on the post-change composition contour information is performed. It is characterized by.

  According to the present invention, even if the contour indicated by the composition information (composition template) is shifted from the contour indicated by the image data, color correction can be reliably performed for each closed region.

1 is a block diagram illustrating a configuration of a digital camera that is an example of an imaging apparatus according to an embodiment of the present invention. It is a flowchart for demonstrating an example of a color correction process. It is a figure for demonstrating imaging | photography using a composition template, (a) is a figure which shows an example of the composition template selected by the user, (b) is a figure which shows the outline information of the composition template shown to (a), (C) is a diagram showing a through image, (d) is a diagram showing a through image on which the contour information of the composition template is superimposed, (e) is a diagram showing contour information extracted by the contour extraction unit shown in FIG. (F) is a figure which shows the outline information after performing the process by a threshold value. It is a figure for demonstrating imaging | photography using a composition template, (a) is a figure which shows the outline information after selecting the outline information after the process by a threshold value, (b) shows the outline information after a complement and a decompression | restoration. (C) is a diagram showing the relationship between the coordinates of the pixel and the amount of deviation, (d) is a diagram showing the amount of deviation between the contour of the image and the contour of the composition template, and (e) is the contour information after the coordinate change. FIG. 8F is a diagram showing a state in which the changed contour information is superimposed and displayed on the through image.

  Hereinafter, an imaging device according to an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a digital camera which is an example of an imaging apparatus according to an embodiment of the present invention.

  Referring to FIG. 1, the illustrated digital camera includes an optical unit 1 having a plurality of lenses including an imaging lens. The optical unit 1 is driven in the optical axis direction by a motor driver 13. Light from the subject incident from the optical unit 1 forms an image on the image sensor 5 as an optical image.

  The image sensor 5 photoelectrically converts the optical image and outputs an electrical signal (analog image signal) corresponding to the optical image. The AFE (analog front end) 4 drives the image sensor 5 under the control of the CPU 2 and converts an analog signal output from the image sensor 5 into a digital signal (image data). This digital signal is given to the CPU 2. The AFE 5 includes a CDS (Correlated Double Sampling) / AD converter (not shown). The CDS / AD converter performs digital sampling to generate a digital signal.

  When displaying the through image, the AFE 4 stores the image data obtained as a result of the thinning drive of the image sensor 5 under the control of the CPU 2 in the image temporary memory 6. The display image generation unit 7 converts the image data stored in the image temporary memory 6 into display data. Then, the display data is displayed on the display unit 9 as a through image by the display driver 8. Hereinafter, image data obtained by thinning driving is referred to as through image data.

  The imaging auxiliary information generation unit 10 generates imaging auxiliary information indicating the shutter speed, ISO sensitivity value, and the number of images that can be captured, and expands the imaging auxiliary information in the auxiliary information temporary memory 11. When displaying the through image on the display unit 9, the display image generating unit 7 superimposes the photographing auxiliary information on the through image and displays it on the display unit 9.

  The operation unit 12 is provided with a release button (not shown). When the user presses the release button halfway, the drive control unit 3 moves the image sensor 5 through the AFE 4 under the control of the CPU 2 (AF (autofocus)). For drive control. The drive control unit 3 controls the motor driver 13 to drive the optical unit 1 to perform AE (automatic exposure) and AF while capturing an image signal from the imaging sensor 5 by the AFE 4.

  Thereafter, when the user fully presses the release button, the drive control unit 3 performs drive control of the imaging sensor 5 for main photographing via the AFE 4 under the control of the CPU 2. As a result, the AFE 4 captures the image signal of the main photographing from the image sensor 5 and stores (decompresses) the image signal in the temporary image memory 6. Hereinafter, an image obtained by the main photographing drive is referred to as main photographing image data.

  The image correction unit 15 performs correction processing such as optical system correction processing, color correction processing, and noise reduction processing on the actual captured image data developed in the temporary image memory 6, and records it as still image data in the recording unit 16. To do.

  Here, a composition template used for shooting, which is a feature of the present embodiment, will be described. The composition template assists the photographer in photographing with a favorite composition by superimposing it on the subject image at the time of photographing. In the present embodiment, each composition template includes, as composition information, contour information indicating the boundary of each area, color information indicating each area by classification, and luminance correction and color correction for each area for each area. Has correction information. Specifically, image data as shown in FIG. 3A is stored as composition information including a set of coordinate data indicating the contour of the closed region (contour information) and color information, and as correction information for each region. A gradation correction curve, a color difference gain, and the like are associated with the position of each area and stored in the composition template storage unit 17 together with image data. A composition template is newly created using a touch panel (not shown) provided in the operation unit 12. Alternatively, the composition template stored in the composition template storage unit 17 may be edited.

  When newly creating a composition template (composition information), that is, contour information, color information, and correction information, a closed region is created on the display screen of the display unit 9 using the operation unit 12, and each closed region is created. Set the display color. When the contour information and the color information are obtained by editing, for the composition template stored in the composition template storage unit 17, the user operates the operation unit 12 to correct at least one of the contour information and the display color. The composition template obtained by new creation or the composition template obtained by editing is overwritten or newly saved in the composition template storage unit 17.

  The composition template is composed of a set of two or more closed areas, and a display color is recorded in each of the closed areas. The user can set the display color of each closed area in accordance with the color image of the captured image corresponding to each completed closed area without being particularly conscious of the color correction setting. In this embodiment, the display color of each closed region is associated with the color correction setting for the captured image corresponding to each closed region. However, the display color and the color correction setting method are not limited thereto. That is, the display color and color correction may be set individually.

  Thus, each composition template has at least two closed regions. The composition template includes contour information (composition contour information) that defines the boundary of the closed region as a contour and color setting information for setting the color of each closed region.

  The contour extracting unit (contour extracting means) 18 extracts contours from the actual captured image data developed in the image temporary memory 6 to obtain contour information (hereinafter referred to as extracted contour information). The coincidence determination unit 19 compares the contour information of the composition template (hereinafter referred to as template contour information) developed from the composition template storage unit 17 into the auxiliary information temporary memory 11 and the extracted contour information. Then, the coincidence degree determination unit 19 obtains a coincidence degree (comparison result) indicating the degree of coincidence between the template outline information (also referred to as color correction boundary information) and the extracted outline information.

  When the coincidence degree calculated by the coincidence degree determination unit 19 is lower than a predetermined coincidence degree, the composition outline changing unit 14 changes the outline information of the composition template. When the degree of coincidence calculated by the degree-of-matching determination unit 19 is equal to or higher than a predetermined degree of coincidence, the image correction unit (image correction unit) 15 uses the contour information of the changed composition template as a boundary of a new correction region. Color correction processing set in the composition template is performed for each closed region.

  Here, color correction processing when shooting using a composition template will be described with Mt. Fuji and cherry blossoms as examples of subjects.

  FIG. 2 is a flowchart for explaining an example of color correction processing when shooting is performed using the imaging apparatus shown in FIG. The flowchart shown in FIG. 2 is executed by the CPU 2 shown in FIG.

  With reference to FIGS. 1 and 2, first, the imaging apparatus prompts the user to select a composition template before the start of shooting (before shooting). At this time, for example, a screen (template selection screen) for prompting selection of a composition template is displayed on the display unit 9. When a composition template selection button is pressed on the template selection screen, a list of composition templates (template list) stored in the composition template storage unit 18 is displayed on the display unit 9.

  When the user selects a composition template to be used from the template list, the contour information of the selected composition template is expanded from the composition template storage unit 17 to the auxiliary information temporary memory 11 (step S201).

  3 and 4 are diagrams for explaining photographing using a composition template with Mt. Fuji and cherry blossoms as examples of subjects.

  Assume that the user has selected the composition template shown in FIG. The contour information shown in FIG. 3B is expanded in the auxiliary information temporary memory 11 as the contour information of the composition template shown in FIG.

  The display image generation unit 7 superimposes the contour information of the composition template on the through image data developed in the temporary image memory 6, and displays the through image on which the contour information is superimposed on the display unit 9 (step S202). FIG. 3C shows an example of a through image corresponding to the through image data, and FIG. 3D shows a state in which the outline information of the composition template is superimposed on the through image.

  Subsequently, the CPU 2 determines whether or not the user has pressed the release button halfway (step S203). If the release button is not pressed halfway (NO in step S203), CPU 2 stands by.

  On the other hand, when the release button is pressed halfway (YES in step S203), as described above, the CPU 2 stores the AF image data in the image temporary memory 6 (step S204: AF image capture). Then, the CPU 2 performs AF processing according to the AF image data (step S205).

  Subsequently, the contour information extraction unit 18 performs contour extraction processing on the AF image data to extract contour information, and obtains the extracted contour information shown in FIG. 3E (step S206). Various methods are known as contour extraction processing for extracting contour information. Here, differential feature processing is performed on AF image data to extract gradient feature points to obtain extracted contour information.

  The composition contour changing unit 14 performs threshold processing according to the brightness of the contour on the extracted contour information, and deletes a contour lower than a predetermined brightness (step S207). Then, the composition contour changing unit 14 performs a selection process for selecting the contour closest to the template contour information from the extracted contour information (step S208). FIG. 3 (f) shows the contour information after the threshold processing, and FIG. 4 (a) shows the contour after the selection processing.

  By the way, the contour after the selection processing shown in FIG. 4A becomes discontinuous by the threshold value processing performed in step S207. For this reason, the composition contour changing unit 14 performs a complementing process on the contour after the selection process based on the template contour information to restore the contour (step S209). By this restoration process, for example, contour information after complementation and restoration shown in FIG. 4B is obtained.

  Subsequently, the coincidence determination unit 19 obtains a sum D of coordinate deviations between the contour information after complement / restoration and the template contour information, and determines the coincidence. Here, the coincidence determination unit 19 determines whether or not the total sum D is larger than a predetermined threshold value Dth (step S210).

For example, the first pixel coordinate (composition pixel coordinate) in the template contour information is (X1 ₁ , Y1 ₁ ), and the pixel coordinate (extracted pixel coordinate) in the corresponding image data is (X2 ₁ , Y2 ₁ ). In this case, the shift amount of the first pixel coordinate is expressed by Expression (1).

Then, there are n pixels (n is an integer greater than or equal to 2) constituting the contour information, the pixel coordinates in the template contour information are (X1 _n , Y1 _n ), and the pixel coordinates in the corresponding image data are (X2 _n , Y2 _n ). The shift amount of the nth coordinate is expressed by Expression (2).

FIG. 4C shows the relationship between the pixel coordinates (X1 _n , Y1 _n ) in the template contour information and the pixel coordinates (X2 _n , Y2 _n ) in the image data. Then, the total sum D of the deviation amounts is obtained by Expression (3).

  At this time, the deviation amounts in the X-axis and Y-axis directions of the contour information of the corresponding image data and the template contour information are calculated as CX and CY, respectively. In the case of the nth coordinate, the shift amounts CXn and CYn are expressed by equations (4) and (5), respectively.

The relationship between the coordinates (X1 _n , Y1 _n ) and (X2 _n , Y2 _n ) and the shift amounts CX _n , CY _n , and D _n is shown in FIG.

If the amount of deviation exceeds a predetermined threshold value, that is, if it is determined that D> D _th (YES in step S210), the composition contour changing unit 14 sets the amount of deviation obtained in step S210 to zero. In this way, the coordinates of each pixel constituting the template contour information are changed (step S211). And a process returns to step S210 and the coincidence determination part 19 calculates | requires a coincidence again. FIG. 4E shows an example of template contour information after the coordinates are changed by the composition contour changing unit 14.

If it is determined that Dn ≦ _Dth (NO in step S210), the display image generating unit 7 in the CPU 2 displays the template contour information after the coordinate change on the through image and displays it on the display unit 9 (step S212). Then, the CPU 2 accepts a contour change of the composition template by the user (step S213). FIG. 4F shows a state in which the template contour information after the coordinate change is superimposed and displayed on the through image.

  The user looks at the template contour information displayed on the display unit 9 and, if the contour is not satisfactory, operates the operation unit 12 to correct the contour. As described above, since the contour is constituted by a set of a plurality of coordinate data, the user corrects the contour by moving these coordinate points with the operation unit 12.

  Next, the CPU 2 determines whether or not the release button has been fully pressed by the user (step S214). If the release button is not fully pressed (NO in step S214), CPU 2 stands by.

  On the other hand, when the release button is fully pressed (YES in step S214), the AFE 4 drives the main image for the image sensor 5 under the control of the CPU 2 and stores the main captured image data in the temporary image memory 6. (Step S215).

  Subsequently, the image correction unit 15 uses the final contour information obtained in step S213 as a color correction boundary (step S216), and the image correction unit 15 displays the display color set in the composition template for each area of the color correction boundary. And the difference between the average of the color data of all the pixels within the color correction boundary of the acquired image data and calculated for each of hue, saturation, and lightness. Correction processing is executed (step S217). The image correction unit 15 records the image data after the color correction processing in the recording unit 16 (step S218), and ends the processing.

  As described above, in the above-described embodiment, when photographing using a composition template including color correction information, the contour information of the composition template is corrected according to the contour information of the through image. Even if the outline of the through image is deviated, color correction can be performed accurately.

  As is clear from the above description, the coincidence degree determination unit 19 and the composition contour changing unit 14 function as contour information changing means. The display image generation unit 7 and the liquid crystal display driver 8 function as display control means. Further, the operation unit 12 and the CPU 2 function as setting means.

  Although the present invention has been described in detail based on the embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the present invention are also included in the present invention. It is. A part of the above-described embodiments may be appropriately combined.

  For example, in the above embodiment, the digital camera has been described as an example, but the present invention can also be applied to a digital video camera or a mobile phone with a camera.

  In the above embodiment, the composition template is input from the operation unit. However, the composition template may be downloaded from the network and stored in the composition template storage unit 17. In this case, a user-desired composition template is selected from a plurality of composition templates prepared on the network and downloaded to the composition template storage unit 17.

  Further, in the above-described embodiment, the differential method is used when performing the contour extraction process. However, a method of reversing and enhancing the luminance of an image or an extraction method by numerical calculation may be used.

  In addition, the function of the above embodiment may be used as a control method, and this control method may be executed by the imaging apparatus. Further, a program having the functions of the above-described embodiments may be used as a control program, and the control program may be executed by a computer included in the imaging apparatus.

  At this time, each of the control method and the control program has at least a contour extraction step, a contour information step, and an image correction step. The control program is recorded on a computer-readable recording medium, for example.

  The present invention can also be realized by executing the following processing. That is, software (program) for realizing the functions of the above-described embodiments is supplied to a system or apparatus via a network or various recording media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed.

4 AFE (Analog Front End)
DESCRIPTION OF SYMBOLS 5 Imaging sensor 7 Display image generation part 9 Display part 12 Operation part 14 Composition outline change part 15 Image correction part 17 Composition template preservation | save part 18 Outline extraction part 19 Matching degree determination part

Claims (8)

An imaging apparatus that performs shooting according to composition information selected from a plurality of pieces of composition information indicating a composition used for shooting,
Each of the composition information includes at least two closed regions, and the composition information includes composition contour information that defines a boundary of the closed region as a contour, and color setting information that sets a color for each of the closed regions. Is included,
Contour extraction means for extracting, as extracted contour information, contour information indicating the contour of image data obtained via the imaging lens when photographing is started;
Contour information changing means for comparing the composition contour information indicating the contour of the composition information selected in advance with the extracted contour information and changing the composition contour information according to the comparison result;
When correcting the image data according to the changed composition contour information, the image correction means includes an image correction unit that performs color correction according to the color setting information for each of the closed regions based on the changed composition contour information. An imaging device that is characterized.   The imaging apparatus according to claim 1, further comprising a display control unit configured to superimpose an outline of the selected composition information on a through image obtained through the imaging lens before shooting and to display on the display unit. .   The contour information changing unit is configured to respond to a deviation amount between an extracted pixel coordinate which is a coordinate of a pixel constituting the contour indicated by the extracted contour information and a composition pixel coordinate which is a coordinate of a pixel constituting the contour indicated by the composition contour information. The imaging apparatus according to claim 1, wherein it is determined whether or not the composition contour information is changed.   The imaging apparatus according to claim 3, wherein the contour information changing unit changes the composition contour information when the deviation amount exceeds a predetermined threshold.   5. The imaging apparatus according to claim 3, wherein when it is determined that the composition contour information is to be changed, the contour information changing unit changes the composition contour information according to the shift amount. 6. A setting means for setting a change in composition contour information;
The imaging apparatus according to claim 1, wherein the contour information changing unit changes the composition contour information according to the setting by the setting unit. A method for controlling an imaging apparatus that performs shooting according to composition information selected from a plurality of pieces of composition information indicating a composition used for shooting,
Each of the composition information includes at least two closed regions, and the composition information includes composition contour information that defines a boundary of the closed region as a contour, and color setting information that sets a color for each of the closed regions. Is included,
When photographing is started, a contour extraction step for extracting contour information indicating the contour of the image data obtained through the imaging lens as extracted contour information;
A contour information step for comparing the composition contour information indicating the contour of the composition information selected in advance with the extracted contour information and changing the composition contour information according to the comparison result;
An image correction step of performing color correction according to the color setting information for each of the closed regions based on the changed composition contour information when the image data is corrected according to the composition contour information after the change. Characteristic control method. A control program used in an imaging apparatus that performs shooting according to composition information selected from a plurality of pieces of composition information indicating a composition used in shooting,
Each of the composition information includes at least two closed regions, and the composition information includes composition contour information that defines a boundary of the closed region as a contour, and color setting information that sets a color for each of the closed regions. Is included,
In the computer provided in the imaging device,
When photographing is started, a contour extraction step for extracting contour information indicating the contour of the image data obtained through the imaging lens as extracted contour information;
A contour information step for comparing the composition contour information indicating the contour of the composition information selected in advance with the extracted contour information and changing the composition contour information according to the comparison result;
When correcting the image data according to the changed composition contour information, an image correction step is performed for performing color correction according to the color setting information for each of the closed regions based on the changed composition contour information. A control program characterized by

Images