JP2012199836A - Imaging apparatus and imaging program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging apparatus and an imaging program capable of providing a user with information serving as guidelines for selecting a special effect suitable for a control limit determined by one or more setting conditions set to the imaging apparatus, in photographing.SOLUTION: An imaging apparatus 1 is provided with an imaging part 2 for taking an image of a subject via a lens part 21 and generating electronic image data of the subject, and allows selection of at least one of plural special effect processing capable of generating visual effects by combining plural image processing with respect to the image data and is capable of executing the selected special effect processing. The imaging apparatus 1 is provided with: a recommendation part 116 which recommends at least one of the plural special effect processing according to the control limit in photographing determined by the one or more setting conditions on the imaging apparatus 1 set before the photographing; and a display control part 118 which causes a display part 7 to display information on the special effect processing recommended by the recommendation part 116.

Description

  The present invention relates to an imaging apparatus and an imaging program for imaging a subject and generating electronic image data.

  2. Description of the Related Art Conventionally, there has been known a technique capable of automatically setting exposure at the time of shooting, shooting sensitivity, and the like in an imaging apparatus such as a digital camera or a digital video camera. For example, a technique for controlling exposure adjustment using a diaphragm according to the performance of an image sensor provided in an imaging apparatus is known (see Patent Document 1). In this technique, it is possible to prevent image degradation due to a diffraction phenomenon by changing the aperture value range in accordance with the pixel pitch of the image sensor.

  Also, shooting can be easily performed by adjusting the shooting sensitivity and aperture value at the time of shooting according to the shooting mode set in the imaging device, for example, the macro shooting mode, and increasing the tolerance for focusing on the subject. An imaging device that can be used is known (see Patent Document 2).

JP 2002-176585 A JP-A-5-66454

  By the way, in the conventional imaging device, the user manually operates (manually) at the time of shooting to change parameters of the aperture value, shutter speed (SS), or shooting sensitivity (ISO sensitivity), thereby setting various setting conditions of the imaging device at the time of shooting. Can be set. However, there is an appropriate control limit determined by the various setting conditions of the imaging device, even when shooting is performed while controlling various configurations of the imaging device according to the various setting conditions of the imaging device set by manual operation. For this reason, when photographing is performed in a state where the control limit determined by various setting conditions set in the photographing apparatus is exceeded, disturbance such as camera shake, noise, or blur has occurred in the captured image.

  On the other hand, depending on the user, there may be a case where the user wants to actively enjoy an image in which a disturbance has occurred as one of the expressions. Furthermore, by applying special effect processing that produces a visual effect on the image where the disturbance has occurred, the expression may be further improved, and depending on the special effect processing, it may be set in the imaging device. It is also possible to relax control limits determined by various setting conditions.

  The present invention has been made in view of the above, and presents information to a user as a guideline for selecting a special effect suitable for a control limit determined by one or a plurality of setting conditions for an imaging device set at the time of shooting. It is an object to provide an imaging apparatus and an imaging program that can be used.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention includes an imaging unit that captures an image of a subject via a lens unit and generates electronic image data of the subject. An imaging apparatus capable of selecting and executing one or more of a plurality of special effect processes capable of producing a visual effect by combining a plurality of image processes on data, One of the plurality of special effect processing based on a display unit that displays an image corresponding to the image data, and a control limit at the time of shooting determined by one or more setting conditions for the imaging device set before shooting. A recommendation unit that recommends one or more and a display control unit that displays information on the special effect processing recommended by the recommendation unit on the display unit.

  In the imaging device according to the present invention, in the above invention, the setting condition includes a shutter speed, an aperture value, a photographing sensitivity, and a feeding amount of the lens unit, and the control limit includes the shutter speed, the aperture value, and It is characterized by an exposure limit determined by the photographing sensitivity and a close limit when focusing on the subject determined based on the contrast of the image data and the feed amount.

  Moreover, the imaging device according to the present invention is characterized in that, in the above-described invention, the imaging device further includes a control limit changing unit that changes the control limit based on a selection result of the special effect processing.

  In the image pickup apparatus according to the present invention as set forth in the invention described above, the control limit changing unit changes the aperture value in accordance with a pixel pitch when the image data is recorded.

  The imaging apparatus according to the present invention further includes a control limit determination unit that determines whether or not the control limit has been reached based on the control limit changed by the control limit change unit. Features.

  In the image pickup apparatus according to the present invention, in the above invention, the image pickup unit receives a light that is collected by the lens unit and a diaphragm unit that restricts an incident amount of light collected by the lens unit. An imaging device that performs conversion, a shutter unit that sets the state of the imaging device to an exposure state or a light shielding state, and a signal processing unit that amplifies an electrical signal output by the imaging device, and is based on the setting condition An imaging control unit that controls the lens unit, the aperture unit, the imaging device, the shutter unit, and the signal processing unit, respectively, and the control limit determination unit determines the control limit by the imaging control unit. It is characterized by doing.

  Moreover, in the imaging device according to the present invention, in the above invention, the display control unit is configured such that, when the control limit determination unit determines the control limit by the shooting control unit, the shooting control unit is the control limit. Is displayed on the display unit.

  In the imaging device according to the present invention, in the above invention, an image processing unit that performs the special effect processing on the image data, and an instruction signal that instructs selection of the special effect processing that can be executed by the image processing unit An input unit that receives the input, and a special effect setting unit that sets the special effect processing to be performed by the image processing unit in response to the instruction signal input from the input unit. To do.

  In the image pickup apparatus according to the present invention as set forth in the invention described above, the special effect processing includes at least one of blurring processing, shading addition processing, noise pattern superimposition processing, edge mixing processing, and image composition processing. And

  In the imaging device according to the present invention, in the above invention, the special effect setting unit distributes or intensifies the combination of the special effect processing to be performed by the image processing unit according to the setting condition or the subject condition. And the special effect processing unit to be performed by the image processing unit is set.

  In addition, an imaging program according to the present invention includes an imaging unit that captures an image of a subject via a lens unit and generates electronic image data of the subject, and combines a plurality of image processes on the image data. An imaging program to be executed by an imaging apparatus capable of selecting and executing any one or more of a plurality of special effect processes capable of producing a visual effect, and corresponding to the image data Recommended to recommend any one or more of the plurality of special effect processing based on a display step for displaying and a control limit at the time of shooting determined by one or a plurality of setting conditions for the imaging device set before shooting And a display control step for displaying information on the special effect processing recommended by the recommendation step in the display step. And features.

  According to the present invention, any one or more of special effect processing that can be executed by the imaging device based on a control limit at the time of shooting determined by one or a plurality of setting conditions for the imaging device set by the recommendation unit before shooting. And the display control unit displays information on the special effect processing recommended by the recommendation unit on the display unit. Accordingly, there is an effect that information serving as a guideline for selecting a special effect process suitable for a control limit determined by one or a plurality of setting conditions for the imaging apparatus set at the time of shooting can be presented to the user.

FIG. 1 is a diagram illustrating a configuration of a side facing a subject of an imaging apparatus according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration of a side facing the user of the imaging apparatus according to the embodiment of the present invention. FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus according to the embodiment of the present invention. FIG. 4 is a diagram illustrating a special effect processing information table as combination information of image processing in the special effect processing stored in the special effect information storage unit of the imaging apparatus according to the embodiment of the present invention. FIG. 5 is a diagram schematically illustrating a control limit by the imaging control unit of the imaging apparatus according to the embodiment of the present invention. FIG. 6 is a diagram illustrating an example of an image corresponding to image data generated by the image sensor under the situation illustrated in FIG. FIG. 7 is a diagram illustrating an example of an image corresponding to image data generated by the imaging device under the situation illustrated in FIG. FIG. 8 is a diagram illustrating an example of an image corresponding to the image data generated by the imaging device under the situation illustrated in FIG. FIG. 9 is a diagram illustrating an example of an image obtained by performing special effect processing on the image illustrated in FIG. 7 by the special effect processing unit. FIG. 10 is a diagram illustrating an example of an image obtained by performing special effect processing on the image illustrated in FIG. 7 by the special effect processing unit. FIG. 11 is a diagram illustrating an example of an image obtained by performing special effect processing on the image illustrated in FIG. 8 by the special effect processing unit. FIG. 12 is a flowchart illustrating an outline of processing performed by the imaging apparatus according to the embodiment of the present invention. FIG. 13 is a diagram illustrating an example of a menu screen displayed by the display unit of the imaging apparatus according to the embodiment of the present invention. FIG. 14 is a diagram illustrating an example of a special effect processing operation menu screen displayed on the display unit of the imaging apparatus according to the embodiment of the present invention. FIG. 15 is a diagram illustrating an example of an image displayed on the display unit of the imaging apparatus according to the embodiment of the present invention. FIG. 16 is a diagram illustrating an example of an image displayed on the display unit of the imaging apparatus according to the embodiment of the present invention. FIG. 17 is a diagram illustrating an example of an image displayed on the display unit of the imaging apparatus according to the embodiment of the present invention. FIG. 18 is a flowchart showing an overview of the parameter switching process shown in FIG. FIG. 19 is a diagram conceptually illustrating the control limit of the aperture value set by the control limit changing unit of the imaging apparatus according to the embodiment of the present invention. FIG. 20 is a flowchart showing an outline of the AF / AE processing shown in FIG. FIG. 21 is a flowchart showing an overview of the display process shown in FIG. FIG. 22 is a diagram illustrating an example of an image displayed on the display unit of the imaging apparatus according to the embodiment of the present invention. FIG. 23 is a diagram illustrating an example of a special effect processing information table as image processing combination information in the special effect processing stored in the special effect information storage unit of the imaging apparatus according to another embodiment of the present invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings. The present invention is not limited to the embodiments described below. In the description of the drawings, the same parts are denoted by the same reference numerals.

  FIG. 1 is a diagram illustrating a configuration of a side (front side) facing an object of an imaging apparatus according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration of a side (back side) facing the user of the imaging apparatus according to the embodiment of the present invention. FIG. 3 is a block diagram illustrating a configuration of the imaging apparatus according to the embodiment of the present invention.

  As illustrated in FIGS. 1 to 3, the imaging device 1 includes an imaging unit 2, a light emitting unit 3, a photometric unit 4, a timer 5, an operation input unit 6, a display unit 7, a touch panel 8, and a storage. Unit 9, communication unit 10, and control unit 11.

  The imaging unit 2 includes a lens unit 21, a lens driving unit 22, a diaphragm unit 23, a diaphragm driving unit 24, a shutter unit 25, a shutter driving unit 26, an imaging element 27, an imaging driving unit 28, and a signal. And a processing unit 29.

  The lens unit 21 includes a plurality of lenses that can be focused and zoomed, and collects light from a predetermined field of view. The lens driving unit 22 is configured using a stepping motor, a DC motor, or the like, and changes the focus position, the focal length, and the like of the lens unit 21 by moving the lens group of the lens unit 21 along the optical axis L1. Do.

  The diaphragm unit 23 adjusts exposure by limiting the amount of incident light collected by the lens unit 21. The aperture drive unit 24 is configured by a stepping motor or the like, and drives the aperture unit 23.

  The shutter unit 25 sets the state of the image sensor 27 to an exposure state or a light shielding state. The shutter drive unit 26 is configured by a stepping motor or the like, and drives the shutter unit 25 according to a release signal.

  The image sensor 27 is configured by a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). The image sensor 27 receives light collected by the lens unit 21 and performs photoelectric conversion to convert the light into an electrical signal (analog signal). The imaging drive unit 28 generates a timing pulse for driving the imaging device 27 and causes the signal processing unit 29 to output an electrical signal photoelectrically converted by the imaging device 27.

  The signal processing unit 29 is configured by an analog amplifier, an A / D converter, or the like. The signal processing unit 29 performs signal processing such as amplification (gain adjustment) on the electrical signal output from the image sensor 27 according to the photographing sensitivity, and then converts the electrical signal into digital image data by performing A / D conversion. To the control unit 11.

  The light emitting unit 3 is configured using a xenon lamp, an LED (Light Emitting Diode), or the like. The light emitting unit 3 irradiates strobe light that is auxiliary light toward a field of view imaged by the imaging device 1.

  The photometry unit 4 acquires image data via the control unit 11 to detect the luminance of the subject, calculates a still image or moving image exposure condition based on the detected luminance, and outputs the exposure condition to the control unit 11.

  The timer 5 has a timekeeping function and a shooting date / time determination function. The timer 5 outputs the date / time data to the control unit 11 in order to add the date / time data to the captured image data.

  The operation input unit 6 is set to the power supply switch 61 that switches the power supply state of the imaging apparatus 1 to an on state or an off state, a release switch 62 that receives an input of a release signal that gives a still image shooting instruction, and the imaging apparatus 1. A shooting mode switching switch 63 for switching various shooting modes, an operation switch 64 for switching various settings of the imaging device 1, a menu switch 65 for displaying various settings (shooting conditions) of the imaging device 1 on the display unit 7, and the imaging unit 2 A zoom switch 66 for receiving an input of an instruction signal for changing the angle of view.

  The display unit 7 is realized using a display panel made of liquid crystal, organic EL (Electro Luminescence), or the like. The display unit 7 displays an image corresponding to the image data generated by the imaging unit 2. The display unit 7 appropriately displays operation information of the imaging apparatus 1 and information related to shooting.

  The touch panel 8 is provided so as to overlap the display screen of the display unit 7 (see FIG. 2). The touch panel 8 detects a position touched by the user based on information displayed on the display unit 7 and accepts an input of an operation signal corresponding to the contact position. In general, the touch panel includes a resistance film method, a capacitance method, an optical method, and the like. In the present embodiment, any type of touch panel is applicable. In the present embodiment, the touch panel 8 functions as an input unit.

  The storage unit 9 is realized using a semiconductor memory such as a flash memory or a RAM (Random Access Memory) that is fixedly provided inside the imaging apparatus 1. The storage unit 9 includes an image data storage unit 91 that stores image data captured by the imaging unit 2, a program storage unit 92 that stores various programs and imaging programs executed by the imaging device 1, and various special effects applied to the image data. When the special effect information storage unit 93 that stores the processing (art filter) content, the pixel pitch information storage unit 94 that stores information related to the pixel pitch of the image sensor 27, and the imaging apparatus 1 performs automatic exposure (AE) control And a program diagram information storage unit 95 to be referred to.

  The communication unit 10 has a function as a communication interface, and performs bi-directional transmission and reception with an external processing device such as a server (not shown) or a personal computer via a network (not shown). The communication unit 10 acquires various program data of the imaging device 1 and data related to the recommendation degree information table by performing transmission / reception with the external processing device. The communication unit 10 is connected to a network via a wired or wireless LAN (Local Area Network).

  The control unit 11 is realized by a CPU (Central Processing Unit) or the like. The control unit 11 reads out and executes a program from the program storage unit 92 of the storage unit 9 according to operation signals from the operation input unit 6 and the touch panel 8 and transmits control signals to the respective units constituting the imaging device 1. And the operation of the image pickup apparatus 1 is controlled by transferring data.

  A detailed configuration of the control unit 11 will be described. The control unit 11 includes an image processing unit 111, a face detection unit 112, a special effect setting unit 113, a control limit change unit 114, a control limit determination unit 115, a recommendation unit 116, a photographing control unit 117, and a display. And a control unit 118.

  The image processing unit 111 performs various types of image processing on the image data output from the signal processing unit 29. Specifically, the image processing unit 111 performs image processing including at least edge enhancement, white balance, gradation correction, color correction, and γ correction on the image data. The image processing unit 111 includes a special effect processing unit 111a.

  The special effect processing unit 111a performs special effect processing for generating a visual effect by combining a plurality of image processings on the image data. As this special effect processing, edge enhancement processing, blurring processing, shading addition processing, noise pattern superimposition processing, image composition processing, contrast processing, adjacent color mixing processing, hue / saturation conversion processing, geometric conversion processing, color replacement processing, This process is a combination of one or more of tone curve processing, edge mixing processing, and contour enhancement processing. Specifically, the special effect processing unit 111a refers to the special effect information stored in the special effect information storage unit 93 and performs special effect processing on the image data.

  FIG. 4 is a diagram showing a special effect processing information table as image processing combination information in the special effect processing stored in the special effect information storage unit 93. As shown in FIG. 4, the special effect processing information table T <b> 1 describes special effect names, processing contents, and combinations of image processing.

  Here, each special effect process mentioned above is demonstrated. In the present embodiment, the special effect processing unit 111a performs watercolor, ink, beast, and stippling as special effect processing.

Watercolor is a special effect process that expresses a light finish like a watercolor paint.
Ink ink is a special effect process that expresses all outlines in black and white as if they were drawn with ink.
Beast is a special effect processing that expresses a realistic-like finish like painting an oil painting with a rough touch.
Stippling is a special effect process that expresses the finish of a stippling style.

  As shown in FIG. 4, in the special effect processing information table T1, when the special effect is “watercolor”, “special effect processing 1” is described as the processing content, and “contrast reduction processing” is combined as the image processing combination. ”,“ Adjacent color mixing process ”, and“ saturation reduction process ”, respectively. As described above, the special effect processing unit 111a performs the special effect processing selected and set by the user with reference to the combination information of the image processing in the special effect processing stored in the special effect information storage unit 93. In order to produce the stippling effect shown in FIG. 4, there is a process of appropriately superimposing random noise, but this noise superimposition amount depends on the image signal amplification factor (sensitivity) at that time and the brightness of the subject. Since there is, it may be switched according to these conditions. For example, in a dark scene with a small amount of image signal, similar noise generated from the circuit is amplified and stands out on the image. At this time, the noise pattern in the image processing of FIG. 4 is not superimposed. Similarly, when the image quality change factor that occurs in exposure and focus control is predicted, the intensity of image processing as shown in FIG. 4 may be changed.

  The face detection unit 112 detects the face of a person included in the image data by pattern matching. Note that the face detection unit 112 may detect not only a human face but also a face such as a dog or a cat. Furthermore, the face detection unit 112 may detect a human face using a known technique other than pattern matching.

  The special effect setting unit 113 refers to the special effect processing information table T1 stored in the special effect information storage unit 93 according to an operation signal from the operation input unit 6 or the touch panel 8, and the special effect processing unit 111a performs the special effect setting unit 113. Set special effect processing. Further, the special effect setting unit 113 may set special effect processing to be executed by the special effect processing unit 111a according to the detection result of the face detection unit 112. Further, the special effect setting unit 113 sets special effect processing to be executed by the special effect processing unit 111a by changing the distribution and intensity of the combination of special effect processing according to the setting conditions for the imaging device 1 or the conditions of the subject. May be. For example, when the subject is dark, the special effect setting unit 113 may change the distribution and intensity of the noise pattern superimposing process of the stippling process and set the special effect processing unit 111a.

  The control limit changing unit 114 is a shooting time determined by one or a plurality of setting conditions for the imaging device 1 set before shooting according to the content of the special effect processing set by the special effect setting unit 113 in the special effect processing unit 111a. Change the control limit. Here, the setting conditions are the shutter speed of the shutter unit 25, the aperture value of the aperture unit 23, the photographing sensitivity, the exposure value (EV value) and the exposure time, the feed amount of the lens unit 21, the depth of field, the angle of view, and the like. . The control limit includes an exposure limit determined by the shutter speed, aperture value, and shooting sensitivity, and a close limit for focusing on the subject determined based on the contrast of the image data and the amount of extension of the lens unit 21. . Further, the control limit includes other limits, for example, an imaging sensitivity limit for gain increase accompanying an increase in imaging sensitivity by the signal processing unit 29, a zoom limit for zoom operation, a manual focus limit by manual focus (hereinafter referred to as “MF”), This includes the closeness limit of the lens unit 21 when focusing on the subject, the brightness limit of the subject, and the camera shake limit.

  Based on the control limit set by the control limit change unit 114, the control limit determination unit 115 determines whether the control of various operations of the imaging apparatus 1 by the imaging control unit 117 has reached the control limit. Specifically, the control limit determination unit 115 controls the shutter speed limit, the aperture value limit, the shooting sensitivity limit, the zoom limit, the MF limit, the closeness limit, the subject brightness limit, and the camera shake under the control of the shooting control unit 117. Judge the limits.

  The recommendation unit 116 performs a plurality of special effect processing that can be executed by the special effect processing unit 111a based on a control limit at the time of shooting determined by one or a plurality of setting conditions for the imaging device 1 set before shooting. One or more of them is recommended. Specifically, the recommendation unit 116 performs special effect processing applicable to the special effect processing unit 111a based on a control limit at the time of shooting determined by one or a plurality of setting conditions for the imaging device 1 set before shooting. Recommend. For example, when the control limit determination unit 115 determines that the shooting sensitivity has reached the shooting sensitivity limit, the recommendation unit 116 recommends “stipling” from a plurality of special effect processes that can be executed by the special effect processing unit 111a. .

  When a still image release signal is input, the shooting control unit 117 performs control to start a shooting operation in the imaging device 1. Here, the imaging operation in the imaging apparatus 1 is the signal processing unit 29 and the image processing unit 111 performing predetermined processing on the image data output from the imaging element 27 by driving the shutter driving unit 26 and the imaging driving unit 28. Refers to movement. The image data processed in this way is stored in the image data storage unit 91 by the control unit 11. The imaging control unit 117 controls the lens driving unit 22, the aperture driving unit 24, the imaging driving unit 28, and the light emitting unit 3 in accordance with operation signals from the operation input unit 6 and the touch panel 8. For example, when an instruction signal for changing the angle of view is input from the zoom switch 66, the imaging control unit 117 drives the lens driving unit 22 so that the lens group contributing to the zoom of the lens unit 21 is placed on the optical axis L <b> 1. Move along.

  When an instruction signal is input from the menu switch 65, the display control unit 118 displays the operation menu screen of the imaging device 1 on the display unit 7. Further, the display control unit 118 causes the display unit 7 to display an icon as information corresponding to the content of the control limit at the time of shooting according to the determination result of the control limit determination unit 115. Further, the display control unit 118 causes the display unit 7 to display numerical values of various shooting conditions, for example, an exposure value, an aperture value, a shutter speed, and shooting sensitivity at the time of shooting. Further, the display control unit 118 causes the display unit 7 to display information related to the special effect processing recommended by the recommendation unit 116. Specifically, the display control unit 118 causes the display unit 7 to display information corresponding to applicable special effect processing recommended by the recommendation unit 116 as an icon.

  In the imaging apparatus 1 having the above configuration, an outline of the control limit by the imaging control unit 117 will be described. FIG. 5 is a diagram schematically illustrating the control by the imaging control unit 117. 6 to 8 are images corresponding to the image data generated by the image sensor 27 under the situation shown in FIG. In the following, in order to simplify the description, the lens group of the lens unit 21 is expressed by a single lens focus lens.

As shown in FIG. 5, when a state where focus is achieved in the lens unit 21 with respect to the object O ₁ (FIG. 5 (a), the feed amount = 0) is the object O ₁ from moving to the image sensor 27 side (Fig. 5 (b)), the focus of the lens unit 21 does not match the subject _{O 1.} Thus, the imaging control unit 117 drives the lens driving unit 22, as the focus of the lens unit 21 is focused on the subject O _1, toward an object O ₁ side along the lens portion 21 on the optical axis L1 (FIG. 5 (b) → FIG. 5 (c)). As a result, the image sensor 27 can generate image data focused on the subject O ₁ (see, for example, the image W1 in FIG. 6).

Further, when the subject O ₁ comes closer to the image sensor 27 side than the distance d _{1 at} which the lens unit 21 can be focused from the situation shown in FIG. 5C, the extension of the lens unit 21 is limited (for example, the extension amount = Z _1). ), The image of the subject O ₁ formed on the imaging surface of the image sensor 27 is blurred (blur amount = S ₁ ). Specifically, as shown in FIG. 7, the subject O ₁ becomes a blurred image W2. For this reason, the photographing control unit 117 reaches a close limit at which the lens unit 21 cannot be focused on the subject O ₁ . In FIG. 7, the blur is represented by a dotted line.

When reducing the blur of the subject O ₁ from the situation shown in FIG. 5D, the imaging control unit 117 drives the aperture driving unit 24 to narrow the aperture (enlarge F value) of the aperture unit 23. by (FIG. 5 (e)), it is not to lighten the blur of the object _{O 1.} At this time, the image pickup device 27 cannot obtain a sufficient exposure amount with the same exposure time because the amount of light received by the stop 23 is reduced. For this reason, the imaging control unit 117 performs control to increase the imaging sensitivity by increasing the intensity of amplification of image data by the signal processing unit 29. If the photographing sensitivity is increased too much by this control, the noise contained in the image data is strongly amplified, resulting in a noisy image, reaching an exposure limit at which an appropriate exposure cannot be obtained by the control of the photographing control unit 117. Specifically, as shown in FIG. 8, the image W3 occurring in noisy object O _1. However, depending on the user, there is a case where it is desired to express the noise in a bold manner as one of the styles, and it is a problem to simply set the control limit by the shooting control unit 117. That is, the control limit is determined according to the image expression desired by the user. In FIG. 8, noise is represented by dots.

  Furthermore, even if the blurred image W3 is generated under the situation of FIG. 5D, the special effect processing unit 111a can perform a special effect process to increase variations in the representation of the image. Depending on the contents of the effect processing, the allowable range of the control limit by the photographing control unit 117 can be expanded. For example, as shown in FIG. 9, when “watercolor” is applied as a special effect process to the blurred image W2 generated under the situation of FIG. 5D, the blurred image W2 is expressed by a soft line. It becomes a picture-like image W4, and there is no need to worry about blur. Furthermore, as shown in FIG. 10, when “Beast” is applied as a special effect process to the blurred image W2 generated under the situation of FIG. 5D, the blurred image W2 is painted with a rough touch. The image W5 is a realistic, realistic oil painting-like image, and the original blur is lost in the image, so that the blur is not noticed and the image becomes an original image.

  Further, as shown in FIG. 11, by applying “stipple” as a special effect process to the image W3 in which the noise generated under the situation of FIG. 5E is generated, the noise is buried in a stipple-like expression. As a result, the image W6 has a great painting effect, and noise becomes one of the styles.

  Therefore, in the present embodiment, based on the selection result of the special effect processing selected by the user, the control limit changing unit 114 is set at the time of shooting determined by one or a plurality of setting conditions for the imaging device 1 set before shooting. The control limit by the imaging control unit 117 is changed. Further, in the present embodiment, the display control unit 118 displays information related to the control limit by the shooting control unit 117 on the display unit 7 and is recommended by the recommendation unit 116 when the control by the shooting control unit 117 is the control limit. Information on applicable special effect processing is displayed on the display unit 7.

  Next, operations performed by the imaging apparatus 1 according to the present embodiment will be described. FIG. 12 is a flowchart illustrating an outline of processing performed by the imaging apparatus 1.

  In FIG. 12, the case where the imaging device 1 is set to the shooting mode will be described (step S101: Yes). In this case, the control unit 11 determines whether or not a menu display operation for displaying a menu screen on the display unit 7 has been performed (step S102). Specifically, it is determined whether or not an instruction signal for instructing display of the menu screen is input by operating the menu switch 65. When the menu display operation is performed (step S102: Yes), the imaging apparatus 1 proceeds to step S103 described later. On the other hand, when the menu display operation is not performed within a predetermined time (for example, within 3 seconds) (step S102: No), the imaging apparatus 1 proceeds to step S124 described later.

  A case where a menu display operation is performed in step S102 (step S102: Yes) will be described. In this case, the display control unit 118 displays a menu screen on the display unit 7 (step S103). Specifically, as illustrated in FIG. 13, the display control unit 118 causes the display unit 7 to display a menu screen W10. Menu screen W <b> 10 includes icons A <b> 1 to A <b> 5 that receive input of instruction signals for various operations of imaging device 1. The icon A1 is an icon that receives an input of an instruction signal that causes the display unit 7 to display an operation menu screen related to special effect processing (art filter). The icon A <b> 2 is an icon that receives an input of an instruction signal that causes the display unit 7 to display an operation menu screen for adjusting the exposure of the imaging apparatus 1. The icon A3 is an icon that accepts an input of an instruction signal for causing the display unit 7 to display an operation menu screen related to the strobe. The icon A4 is an icon that receives an input of an instruction signal for causing the display unit 7 to display various settings of the imaging apparatus 1, for example, an operation menu screen related to an aspect and a file format. The icon A5 is an icon that accepts an input of an instruction signal that causes the display unit 7 to display a menu screen related to self-photographing. Note that the display control unit 118 may display an icon touched by the user in a display mode that can be identified according to an instruction signal input from the touch panel 8, for example, a color or blinking.

  Subsequently, when the special effect process is selected by operating the icon A1 (step S104: Yes), the display control unit 118 displays a special effect operation menu screen for displaying a list of special effect processes. (Step S105). Specifically, as illustrated in FIG. 14, the display control unit 118 causes the display unit 7 to display a special effect processing operation menu screen W11 related to special effect processing. The watercolor icon A11 is an icon that accepts an input of an instruction signal that causes the special effect processing unit 111a to perform watercolor processing. The beast icon A12 is an icon that receives an input of an instruction signal that causes the special effect processing unit 111a to perform the beast process. The pointillistic icon A13 is an icon that accepts an input of an instruction signal that causes the special effect processing unit 111a to perform pointillistic processing. The ink icon A14 is an icon that accepts an input of an instruction signal that causes the special effect processing unit 111a to perform ink processing. The stop icon A15 is an icon that accepts an input of an instruction signal instructing to stop the special effect processing set in the special effect processing unit 111a.

  After step S105, when the stippling icon A13 is operated and stippling is selected and set as the special effect processing (step S106: Yes), the special effect setting unit 113 receives the instruction signal input from the touch panel 8 Accordingly, “stipple” is set as the special effect processing to be executed by the special effect processing unit 111a, and the special effect processing unit 111a stores the special effect processing information table T1 stored in the special effect information storage unit 93 (FIG. 4). Referring to FIG. 5, the special effect process 4 corresponding to the “stipple” process content set by the special effect setting unit 113 is executed (step S107). At this time, when shooting is performed with an operation exceeding the control limit, the noise pattern level that is predicted to be generated is reduced and the noise pattern level in the image processing is set.

  Subsequently, the display control unit 118 causes the display unit 7 to display a live view image reflecting the operation result by the user (step S108). For example, as illustrated in FIG. 15, the display control unit 118 displays a live view image W12 in which the special effect processing unit 111a performs pointilling processing on the original image with respect to the image data generated by the imaging unit 2. It is displayed on the display unit 7. Further, the display control unit 118 causes the display unit 7 to display information regarding the special effect processing applied to the live view image W12 displayed on the display unit 7 as an icon, for example, a stippled icon A21. Thus, the user can immediately confirm the content of the special effect processing selected while viewing the live view image displayed on the display unit 7.

  After that, the imaging device 1 executes a warning process and a display process for recommending a special effect process according to the control limit when the control limit of each component is reached by the control limit by the shooting control unit 117 (step S109). Details of the display process will be described later.

  Subsequently, when the special effect process is recommended by the recommendation unit 116 after the display process (step S110: Yes), the display control unit 118 displays information on the recommended special effect process on the display unit 7 (step S111). . For example, as illustrated in FIG. 16, the display control unit 118 displays an icon A31 as information on the special effect recommended by the recommendation unit 116 in the live view image W12 displayed by the display unit 7. The icon A31 is an icon that accepts an input of an instruction signal for causing the display unit 7 to display a menu screen (for example, see FIG. 17) that displays a list of special effect processes recommended by the recommendation unit 116. FIG. 17 is a diagram illustrating a display example of a menu screen. Furthermore, when the control limit determination unit 115 determines that the imaging control unit 117 is the control limit, the display control unit 118 combines the content of the control limit, for example, the icon A32 indicating the near limit with the icon A31. It is displayed on the display unit 7.

  Thereafter, the control unit 11 determines whether or not the icon A31 related to the special effect process is selected according to the instruction signal input from the touch panel 8 (step S112). When the icon A31 related to the special effect process is selected (step S112: Yes), the imaging device 1 returns to step S106. On the other hand, when the icon A31 related to the special effect process is not selected within a predetermined time (for example, within 3 seconds) (step S112: No), the imaging device 1 proceeds to step S113.

  In step S113, when the release signal is input by operating the release switch 62 (step S113: Yes), the imaging apparatus 1 stores the image data in the image of the storage unit 9 under the control of the imaging control unit 117. It records in the data storage part 91 (step S114).

  Subsequently, when the power switch 61 is operated to turn off the power of the imaging apparatus 1 (step S115: Yes), the imaging apparatus 1 ends a series of processes. On the other hand, when the power switch 61 is not operated (step S115: No), the imaging apparatus 1 returns to step S101.

  In step S113, when there is no operation of the release switch 62 within a predetermined time (for example, within 3 seconds) (step S113: No), the imaging device 1 proceeds to step S115.

  In step S106, when the stippling icon A13 is not selected (step S106: No) and the ink icon A14 is selected (step S116: Yes), the special effect setting unit 113 responds to the instruction signal input from the touch panel 8. Ink processing is set as the special effect processing to be performed by the special effect processing unit 111a, and the special effect processing unit 111a refers to the special effect processing information table T1 stored in the special effect information storage unit 93 and sets the special effect. The special effect process 2 corresponding to the contents of the ink process set by the unit 113 is executed on the image data (step S117). Thereafter, the imaging apparatus 1 proceeds to step S108.

  In step S106, when the stippling icon A13 and the ink icon A14 are not selected (step S106: No, step S116: No) and the beast icon A12 is operated (step S118: Yes), the special effect setting unit 113 displays the touch panel. 8 is set as a special effect process to be performed by the special effect processing unit 111a according to the instruction signal input from the special effect processing unit 111a. The special effect processing unit 111a stores the special effect processing information table stored in the special effect information storage unit 93. Referring to T1, special effect processing 3 set by the special effect setting unit 113 and corresponding to the content of the beast processing is executed on the image data (step S119). Thereafter, the imaging apparatus 1 proceeds to step S108.

  In step S106, when the stipple icon A13, the ink icon A14, and the beast icon A12 are not selected (step S106: No, step S116: No, step S118: No), and the watercolor icon A11 is selected (step S120: Yes). The special effect setting unit 113 sets a watercolor process as a special effect process to be performed by the special effect processing unit 111a according to the instruction signal input from the touch panel 8, and the special effect processing unit 111a includes a special effect information storage unit. Referring to the special effect processing information table T1 stored in 93, the special effect processing 1 corresponding to the contents of the watercolor processing set by the special effect setting unit 113 is executed on the image data (step S121). Thereafter, the imaging apparatus 1 proceeds to step S108.

  In step S106, the stipple icon A13, the ink painting icon A14, the beast icon A12, and the watercolor icon A11 are not selected (step S106: No, step S116: No, step S118: No, step S120: No), and the stop icon A15 is operated. If it has been performed (step S122: Yes), the imaging apparatus 1 proceeds to step S108. On the other hand, when the stop icon A15 is not selected within a predetermined time (for example, within 3 seconds) (step S122: No), the imaging device 1 returns to step S106.

  A case where the special effect icon A1 related to the special effect process is not selected in step S104 (step S104: No) will be described. In this case, the control unit 11 executes a process according to another icon operation (step S123), and the imaging device 1 proceeds to step S108.

  Next, the case where the menu display operation is not performed in step S102 (step S102: No) will be described. In this case, when a manual operation for manually adjusting the exposure, the angle of view, etc. of the imaging device 1 is performed (step S124: Yes), the control unit 11 executes a parameter switching process for switching various setting parameters ( Step S125). Details of the parameter switching process will be described later.

  Subsequently, the imaging control unit 117 performs exposure control corresponding to the various setting parameters switched by the parameter switching process (step S126), and the imaging apparatus 1 proceeds to step S108.

  A case where no manual operation is performed in step S124 (step S124: No) will be described. In this case, the imaging control unit 117 executes AE / AF processing for automatically adjusting exposure and focus (step S127), and the imaging apparatus 1 proceeds to step S108. Details of the AE / AF processing will be described later.

  Next, a case where the imaging apparatus 1 is not set to the shooting mode in step S101 (step S101: No) will be described. In this case, when the imaging device 1 is set to the reproduction mode (step S128: Yes), the display control unit 118 causes the display unit 7 to display the image data stored in the image data storage unit 91 (step S129). .

  Subsequently, when an end operation for reproducing the image data is performed (step S130: Yes), the imaging apparatus 1 proceeds to step S115. On the other hand, when the operation to end the reproduction of the image data is not performed (step S130: No), the imaging apparatus 1 returns to step S128.

  In step S128, when the imaging device 1 is not set to the reproduction mode (step S128: No), the imaging device 1 returns to step S115.

  Next, the parameter switching process in step S125 shown in FIG. 12 will be described. FIG. 18 is a flowchart showing an overview of the parameter switching process shown in FIG.

  As shown in FIG. 18, when an MF switching operation for switching the focus of the imaging unit 2 or a zoom switching operation for switching the angle of view is performed (step S201: Yes), the control limit determination unit 115 performs the imaging unit based on the MF switching operation. It is determined whether or not the focus adjustment MF limit of 2 or the zoom limit for changing the angle of view of the imaging unit 2 by the zoom switching operation (step S202). When it is the MF limit or the zoom limit (step S202: Yes), the control limit determination unit 115 determines that the imaging unit 2 is the MF limit or the zoom limit (step S203), and the imaging device 1 is illustrated in FIG. Return to the main routine.

  On the other hand, when each of the MF limit and the zoom limit is not the control limit (step S202: No), the imaging control unit 117 drives the lens driving unit 22 in accordance with the MF switching operation or the zoom switching operation, and the lens unit. By moving 21 along the optical axis L1, the focus of the imaging unit 2 is switched or the angle of view of the imaging unit 2 is switched (step S204). Thereafter, the imaging apparatus 1 returns to the main routine shown in FIG.

  In step S201, when there is no MF switching operation or zoom switching operation (step S201: No) and an aperture switching operation for switching the aperture of the imaging unit 2 is performed (step S205: Yes), the control unit 11 sets the special effect. It is determined whether or not the watercolor process or the ink process is set as the special effect process to be executed by the special effect processing unit 111a by the unit 113 (step S206). When the watercolor process or the ink process is set as the special effect process to be executed by the special effect processing unit 111a (step S206: Yes), the imaging apparatus 1 proceeds to step S207 described later. On the other hand, when the watercolor process or the ink process is not set as the special effect process to be executed by the special effect processing unit 111a (step S206: No), the imaging apparatus 1 proceeds to step S211 described later.

  A case where the watercolor process or the ink process is set as the special effect process to be executed by the special effect processing unit 111a in step S206 (step S206: Yes) will be described. In this case, the control limit changing unit 114 sets the pixel pitch width α of the image data for recording the control limit of the aperture value according to the watercolor process or the ink process set as the special effect process to be executed by the special effect processing unit 111a. Use to change and set F> 5α (step S207).

FIG. 19 is a diagram conceptually illustrating the control limit of the aperture value that is changed and set by the control limit changing unit 114. The horizontal axis shown in FIG. 19 indicates the aperture value (F value), and the vertical axis indicates the imaging spot diameter formed on the image sensor 27. The curve c ₁ indicates the relationship between the aperture and the image spot diameter. Further, K ₁ represents the theoretical aperture value, indicating the aperture value blur caused by actual diffraction limit K _2. In general, the larger the aperture value, the darker the image, and the larger the spot diameter, the worse the performance.

As shown in FIG. 19, the control limit changing unit 114 sets the control limit of the aperture value so that the aperture value becomes a region D1 in which the image deteriorates due to the influence of diffraction. Change and set the aperture value in the initial state determined by the speed. Specifically, if the imaging spot diameter is ε, the aperture value is F, and the wavelength of light to be used is λ,
ε = 1.22Fλ (1)
It becomes.
On the other hand, the pixel pitch of the image data stored in the image data storage unit 91 is represented by α (μm), and the resolution limit of the image sensor 27 is represented by 1 / 2α using α.
Therefore, in order to prevent the aperture value from exceeding the resolution limit of the image sensor 27,
1.22Fλ> 2α (2)
It is necessary to satisfy. In other words,
F> 1.64α / λ (3)
Is a condition.
Here, when the wavelength of visible light used for photographing is λ = 546 (nm),
F> 3.0 × α / 1 (4)
Thus, a conditional expression for the theoretical limit of the F value is obtained (aperture value K ₁ ).
On the other hand, when the aperture value is narrowed (aperture value F is changed from 2 → 2.8 →... → 11), a diffraction limit occurs. For this reason, the image is blurred from an aperture value (aperture value K ₂ ) that is two steps brighter than the F value in Expression (4). Therefore,
F> 1.5α (5)
Is used as a conditional expression for the limit of the F value.

  As described above, the control limit changing unit 114 changes the aperture value so as to satisfy the above formula (5) according to the content of the special effect processing set in the special effect processing unit 111a by the special effect setting unit 113. To set. For example, in the control limit changing unit 114, when the special effect processing set in the special effect processing unit 111a by the special effect setting unit 113 is pointilling processing, and the pixel pitch α of the image data to be recorded is 5 (μm), The conditional expression for the limit of the F value is changed and set so that F> 5α. Further, the control limit changing unit 114 has a special effect process set in the special effect processing unit 111a by the special effect setting unit 113 as a watercolor process or an ink process, and the pixel pitch α of the image data to be recorded is 5 (μm). In some cases, the conditional expression for the limit of the F value is changed and set so that F> 3a. Thereby, the control limit changing unit 114 changes and sets the control limit of the aperture value according to the content of the special effect processing set in the special effect processing unit 111a by the special effect setting unit 113, so that the imaging control unit The exposure limit due to 117 can be relaxed. Note that the control limit changing unit 114 may set the aperture value according to the intensity of image processing combined with the special effect processing, for example, the contrast intensity or saturation.

  Returning to FIG. 18, the description of step S208 and subsequent steps will be continued. In step S208, the control limit determination unit 115 determines whether or not the aperture value of the imaging unit 2 by the aperture switching operation has reached the aperture limit (F> 5α). When the aperture value has reached the aperture limit (step S208: Yes), the control limit determination unit 115 determines that the aperture value by the aperture switching operation is the aperture limit (step S209), and the imaging apparatus 1 in FIG. Return to the main routine shown.

  On the other hand, when the aperture value has not reached the aperture limit (step S208: No), the imaging control unit 117 drives the aperture drive unit 24 based on the operation amount corresponding to the aperture switching operation, and the aperture unit. 23 is switched (step S210), and the imaging apparatus 1 returns to the main routine shown in FIG.

  In step S206, a case where the watercolor process or the ink process is not set as the special effect process to be performed by the special effect processing unit 111a (step S206: No) will be described. In this case, the control limit determination unit 115 determines whether or not the aperture value of the imaging unit 2 by the aperture switching operation has reached the aperture limit (F> 3α) (step S211). When the aperture value has reached the aperture limit (step S211: Yes), the control limit determination unit 115 determines that the aperture value by the aperture switching operation is the aperture limit (step S212), and the imaging device 1 in FIG. Return to the main routine shown.

  On the other hand, when the aperture value has not reached the aperture limit (step S211: No), the imaging control unit 117 drives the aperture drive unit 24 based on the operation amount corresponding to the aperture switching operation, and the aperture unit. 23 is switched (step S213), and the imaging apparatus 1 returns to the main routine shown in FIG.

  Next, the case where there is no MF switching operation, zoom switching operation, and aperture switching operation (step S201: No, step S205: No) and the shutter speed switching operation of the imaging unit 2 is performed (step S214: Yes) will be described. . In this case, the control limit determination unit 115 determines whether or not the shutter speed of the imaging unit 2 by the shutter speed switching operation has reached the shutter speed limit (step S215). When the shutter speed reaches the shutter speed limit (step S215: Yes), the control limit determination unit 115 determines that the shutter speed is the shutter speed limit (step S216), and the imaging apparatus 1 performs the main processing shown in FIG. Return to the routine.

  On the other hand, when the shutter speed has not reached the shutter speed limit (step S215: No), the imaging control unit 117 switches the shutter speed based on the operation amount corresponding to the shutter speed switching operation (step S217). The imaging apparatus 1 returns to the main routine shown in FIG.

  Next, there was no MF switching operation or zoom switching operation, aperture switching operation, and shutter speed switching operation (Step S201: No, Step S205: No, Step S214: No), and the photographing sensitivity switching operation of the imaging unit 2 was performed. The case (step S218: Yes) will be described. In this case, the control unit 11 determines whether the special effect setting unit 113 has set the stippling process as the special effect process in the special effect processing unit 111a (step S219). When the stippling process is set as the special effect process in the special effect processing unit 111a (step S219: Yes), the imaging apparatus 1 proceeds to step S220 described later. On the other hand, when the stippling process is not set as the special effect process in the special effect processing unit 111a (step S219: No), the imaging device 1 proceeds to step S224 described later.

  A case will be described in which the special effect setting unit 113 sets the stippling process as the special effect process in the special effect processing unit 111a in step S219 (step S219: Yes). In this case, the control limit changing unit 114 changes the shooting sensitivity limit of the shooting sensitivity to ISO 6400 according to the stippling process set as the special effect process in the special effect processing unit 111a (step S220).

  Subsequently, the control limit determination unit 115 determines whether or not the shooting sensitivity of the imaging unit 2 by the shooting sensitivity switching operation is ISO 6400 or higher (step S221). When the imaging sensitivity of the imaging unit 2 is ISO 6400 or higher (step S221: Yes), the control limit determination unit 115 determines that the imaging sensitivity of the imaging unit 2 is the limit (step S222), and the imaging apparatus 1 is shown in FIG. Return to the main routine shown in.

  On the other hand, when the imaging sensitivity of the imaging unit 2 is not ISO 6400 or higher (step S221: No), the imaging control unit 117 outputs the signal processing unit 29 from the imaging element 27 according to the imaging sensitivity by the imaging sensitivity switching operation. The level of amplification (gain adjustment) performed on the image data to be processed is switched (step S223), and the imaging apparatus 1 returns to the main routine shown in FIG.

  A case will be described where, in step S219, the special effect setting unit 113 does not set the stippling process as the special effect process in the special effect processing unit 111a (step S219: No). In this case, the control limit determination unit 115 determines whether the imaging sensitivity of the imaging unit 2 by the imaging sensitivity switching operation is ISO 1600 or higher (step S224). When the imaging sensitivity of the imaging unit 2 is ISO 1600 or more (step S224: Yes), the control limit determination unit 115 determines that the imaging sensitivity of the imaging unit 2 is the imaging sensitivity limit (step S225), and the imaging device 1 Returning to the main routine shown in FIG.

  On the other hand, when the imaging sensitivity of the imaging unit 2 is not ISO 1600 or higher (step S224: No), the imaging control unit 117 outputs the signal processing unit 29 from the imaging element 27 according to the imaging sensitivity by the imaging sensitivity switching operation. The level of amplification performed on the image data to be processed is switched (step S226), and the imaging apparatus 1 returns to the main routine shown in FIG.

  Next, the AF / AE process in step S127 shown in FIG. 12 will be described. FIG. 20 is a flowchart showing an outline of the AF / AE processing shown in FIG.

  As shown in FIG. 20, the imaging control unit 117 drives the lens driving unit 22, starts moving the lens unit 21 along the optical axis L1 (step S301), and the image data sequentially generated by the image sensor 27. Based on the above, contrast detection is started (step S302).

  Subsequently, the control limit determination unit 115 determines whether or not the contrast of the image data sequentially generated by the image sensor 27 has increased in the vicinity of the lens unit 21 (step S303). When the contrast of the image data increases near the lens unit 21 (step S303: Yes), the control limit determination unit 115 determines that the lens unit 21 is at the close limit (step S304).

  Thereafter, the imaging control unit 117 stops driving the lens driving unit 22, stops the lens unit 21 at the closest limit position (step S305), and the imaging apparatus 1 proceeds to step S307 described later.

  A case where the contrast of the image data does not increase in the vicinity of the lens unit 21 in step S303 (step S302: No) will be described. In this case, the imaging control unit 117 drives the lens driving unit 22 and stops the lens unit 21 at a position where the contrast of the image data reaches a peak while moving the lens unit 21 along the optical axis L1 (step S306). 1 shifts to step S307 to be described later.

  In step S307, the control unit 11 detects the distance to the subject based on the image data output from the image sensor 27 via the signal processing unit 29 (step S307), and detects the brightness of the subject (step S307). S308).

  Subsequently, when the control limit determination unit 115 determines that the lens unit 21 is at the close limit (step S309: Yes), the imaging control unit 117 stores the program diagram stored in the program diagram information storage unit 95. Based on the brightness of the subject, the aperture value, shutter speed, and shooting sensitivity are set (step S310).

  Thereafter, the control unit 11 determines whether the special effect setting unit 113 has set the stippling process as the special effect process in the special effect processing unit 111a (step S311). When the stippling process is set as the special effect process in the special effect processing unit 111a (step S311: Yes), the imaging apparatus 1 proceeds to step S312 described later. On the other hand, when the stippling process is not set as the special effect process in the special effect processing unit 111a (step S311: No), the imaging apparatus 1 proceeds to step S314 described later.

  In step S312, the control limit determination unit 115 determines whether the shooting sensitivity set by the shooting control unit 117 is ISO 6400 or higher. When the shooting sensitivity is ISO 6400 or higher (step S312: Yes), the control limit determination unit 115 determines that the brightness of the subject is the brightness limit (step S313), and the imaging apparatus 1 performs the main processing shown in FIG. Return to the routine. On the other hand, when the photographing sensitivity is not ISO 6400 or higher (step S312: No), the imaging apparatus 1 returns to the main routine shown in FIG.

  In step S314, the control limit determination unit 115 determines whether or not the shooting sensitivity set by the shooting control unit 117 is ISO 1600 or higher. When the photographing sensitivity is ISO 1600 or higher (step S314: Yes), the control limit determination unit 115 determines that the brightness of the subject is the limit (step S315), and the imaging apparatus 1 performs the main routine shown in FIG. Return. On the other hand, when the photographing sensitivity is not ISO 1600 or higher (step S314: No), the imaging apparatus 1 returns to the main routine shown in FIG.

  A case will be described in which the control limit determination unit 115 does not determine that the close limit of the lens unit 21 is determined in step S309 (step S309: No). In this case, the control unit 11 determines whether the special effect setting unit 113 has set any of watercolor processing, ink processing, or stippling processing as the special effect processing in the special effect processing unit 111a (step S316). When any one of the process watercolor, ink process, or stippling process is set as the special effect process in the special effect processing unit 111a (step S316: Yes), the control limit changing unit 114 sets the aperture value of the aperture unit 23 to F> The setting is changed to 5α (step S317), and the imaging apparatus 1 proceeds to step S319 described later.

  On the other hand, when none of the watercolor process, the ink process, or the stippling process is set as the special effect process in the special effect processing unit 111a (step S316: No), the control limit changing unit 114 sets the aperture of the aperture unit 23. The value is changed and set to F> 3α (step S318), and the imaging apparatus 1 proceeds to step S319 described later.

  In step S319, the imaging control unit 117 sets the shutter speed and the imaging sensitivity based on the program diagram and the aperture value stored in the program diagram information storage unit 95.

  Subsequently, the control unit 11 determines whether or not the special effect setting unit 113 sets the stippling process as the special effect process in the special effect processing unit 111a (step S320). When the stippling process is set as the special effect process in the special effect processing unit 111a (step S320: Yes), the imaging device 1 proceeds to step S321 described later. On the other hand, when the stippling process is not set as the special effect process in the special effect processing unit 111a (step S320: No), the imaging device 1 proceeds to step S323 described later.

  In step S321, the control limit determination unit 115 determines whether the shooting sensitivity set by the shooting control unit 117 is ISO6400 or higher. When the shooting sensitivity is ISO 6400 or higher (step S322: Yes), the control limit determination unit 115 determines that the brightness of the subject is the brightness limit (step S322), and the imaging apparatus 1 performs the main processing shown in FIG. Return to the routine. On the other hand, when the imaging sensitivity is not ISO 6400 or higher (step S321: No), the imaging apparatus 1 returns to the main routine shown in FIG.

  In step S323, the control limit determination unit 115 determines whether or not the shooting sensitivity set by the shooting control unit 117 is ISO 1600 or higher. When the photographing sensitivity is ISO 1600 or higher (step S323: Yes), it is determined that the brightness of the subject is the brightness limit (step S324), and the imaging device 1 returns to the main routine shown in FIG. On the other hand, if the photographing sensitivity is not ISO 1600 or higher (step S323: No), the imaging apparatus 1 returns to the main routine shown in FIG.

  Next, the display process in step S109 shown in FIG. 12 will be described. FIG. 21 is a flowchart showing an overview of the display process shown in FIG.

  As shown in FIG. 21, when it is determined by the control limit determination unit 115 that the lens unit 21 is at the MF limit or zoom limit (step S401: Yes), the display control unit 118 is at the MF limit or zoom limit. A warning indicating this is displayed on the display unit 7 (step S402), and the imaging apparatus 1 proceeds to step S403. On the other hand, when it is determined by the control limit determination unit 115 that the MF limit or zoom limit of the lens unit 21 is not reached (step S401: No), the imaging device 1 proceeds to step S403.

  Subsequently, when the control limit determination unit 115 determines that the shutter speed limit of the shutter unit 25 is reached (step S403: Yes), the display control unit 118 displays a warning indicating that the shutter speed limit is reached on the display unit 7. The image is displayed (step S404), and the imaging apparatus 1 proceeds to step S405. On the other hand, when it is determined by the control limit determination unit 115 that the shutter speed limit of the shutter unit 25 is not reached (step S403: No), the imaging device 1 proceeds to step S405.

  Thereafter, when it is determined by the control limit determination unit 115 that the aperture limit of the aperture unit 23 is reached (step S405: Yes), the display control unit 118 displays a warning indicating that the aperture unit 23 is at the aperture limit. 7 (step S406), the imaging apparatus 1 proceeds to step S407. On the other hand, when it is determined by the control limit determination unit 115 that it is not the stop limit of the stop 23 (step S405: No), the imaging device 1 proceeds to step S407.

  Subsequently, when it is determined by the control limit determination unit 115 that the shooting sensitivity is the shooting sensitivity limit (step S407: Yes), the display control unit 118 displays a warning indicating that the shooting sensitivity is the shooting sensitivity limit. The image is displayed on the unit 7 (step S408), and the imaging apparatus 1 proceeds to step S409. On the other hand, when it is determined by the control limit determination unit 115 that the shooting sensitivity is not the shooting sensitivity limit (step S407: No), the imaging apparatus 1 proceeds to step S409.

  A case where the brightness of the subject is determined to be the brightness limit by the control limit determination unit 115 in step S409 (step S409: Yes) will be described. In this case, the control unit 11 determines whether or not the beast process is set as the special effect process in the special effect processing unit 111a by the special effect setting unit 113 (step S410). When the beast process is set as the special effect process in the special effect processing unit 111a (step S410: Yes), the imaging device 1 proceeds to step S411 described later. On the other hand, when “beast” is not set as the special effect processing in the special effect processing unit 111a (step S410: No), the imaging apparatus 1 proceeds to step S413 described later.

  In step S411, when the shutter speed of the shutter unit 25 set in the imaging device 1 is 1/10 or higher (step S411: Yes), the display control unit 118 warns that camera shake is likely to occur during shooting. Is displayed on the display unit 7 (step S412). Specifically, as shown in FIG. 22, the display control unit 118 causes the display unit 7 to display a warning indicating that camera shake is likely to occur during shooting in the image W13 displayed on the display unit 7 as an icon A31. . Thereafter, the imaging apparatus 1 proceeds to step S416 described later. On the other hand, when the shutter speed is not 1/10 or higher (step S411: No), the imaging apparatus 1 proceeds to step S416 described later.

  In step S413, when the shutter speed of the shutter unit 25 set in the imaging device 1 is 1/100 or more (step S413: Yes), the display control unit 118 warns that camera shake is likely to occur during shooting. Is displayed on the display unit 7 (step S414).

  Subsequently, the recommendation unit 116 recommends the beast process as the special effect process based on the limit information in the shooting conditions of the imaging device 1 that is set in various ways at the time of shooting (step S415), and the imaging device 1 goes to step S416 described later Transition.

  In step S413, when the shutter speed of the shutter unit 25 set in the imaging device 1 is not 1/100 or more (step S413: No), the imaging device 1 proceeds to step S416 described later.

  In step S416, the case where it is determined by the control limit determination unit 115 that the limit is the closest limit (step S416: Yes) will be described. In this case, the control unit 11 determines whether the special effect setting unit 113 has set the watercolor process or the ink process as the special effect process in the special effect processing unit 111a (step S417). When the special effect processing unit 111a is set with the watercolor process or the ink process as the special effect process (step S417: Yes), the display control unit 118 causes the display unit 7 to display a warning indicating the close limit ( In step S418), the imaging apparatus 1 returns to the main routine shown in FIG.

  A case will be described in which the watercolor processing or the ink processing is not set as the special effect processing in the special effect processing unit 111a in Step S417 (Step S417: No). In this case, the display control unit 118 causes the display unit 7 to display a warning indicating that it is the close limit (step S419).

  Subsequently, the recommendation unit 116 sets a watercolor process, an ink-jet process, or a stippling process as a special effect process recommended at the time of shooting (step S420), and the imaging apparatus 1 returns to the main routine shown in FIG.

  In step S416, when it is not determined by the control limit determination part 115 that it is a near limit (step S416: No), the imaging device 1 returns to the main routine shown in FIG.

  According to the embodiment of the present invention described above, one or more setting conditions are set for the imaging device 1 set before shooting based on the content of the special effect processing selected by the control limit changing unit 114. The control limit at the time of shooting determined by is changed. Thereby, the control limit determined by the setting conditions of the imaging device 1 set at the time of shooting can be relaxed, and the range in which shooting can be performed can be expanded.

  Furthermore, according to an embodiment of the present invention, the aperture unit is configured so that the image is defocused according to the pixel pitch when the image data captured by the control limit changing unit 114 is stored in the image data storage unit 91. 23 is set, and the special effect processing unit 111a applies special effect processing to the blurred image. Therefore, it is possible to enlarge the range that can be captured and to make the blur of the image inconspicuous by the special effect processing. it can.

  In addition, according to the embodiment of the present invention, the special effect processing unit 111a includes the special effect processing unit 111a based on a control limit at the time of shooting determined by one or more setting conditions for the imaging device 1 set by the recommendation unit 116 before shooting. One or more of the executable special effect processes are recommended, and the display control unit 118 causes the display unit 7 to display information regarding the special effect processes recommended by the recommendation unit 116. As a result, it is possible to present information to the user as a guideline for selecting a special effect process suitable for the control limit determined by the setting conditions of the imaging device 1 set at the time of shooting.

  Furthermore, according to an embodiment of the present invention, when the display control unit 118 determines that the control by the imaging control unit 117 is the control limit by the control limit determination unit 115, the display unit 7 is at the control limit. Is displayed on the display unit 7 and information related to the special effect processing recommended by the recommendation unit 116 is displayed on the display unit 7. Thereby, the user can select the special effect process or change the setting condition of the imaging apparatus 1 while viewing the live view image displayed on the display unit 7.

  In the embodiment of the present invention, watercolor, ink, beast, and stippling are given as examples of special effect processing that can be executed by the special effect processing unit 111a, but other special effect processing can also be executed. For example, as shown in FIG. 23, the special effect processing unit 111a may perform the special effect processing on the image data with reference to the special effect processing information table T2 stored in the special effect information storage unit 93. further. The recommendation unit 116 may change the recommended special effect processing according to the control limit by the imaging control unit 117 with reference to the special effect processing information table T2 stored in the special effect information storage unit 93. For example, the recommendation unit 116 recommends “rough monochrome” having substantially the same saturation, contrast, and WB (white balance) as image processing characteristics of the special effect processing instead of “ink ink” of the special effect processing. May be.

Here, each special effect process shown in FIG. 23 will be described.
Fantastic focus is a special effect process that expresses a feeling of air in a soft tone and expresses beautifully and fantastically as if it were wrapped in happy light while leaving the details of the subject.
Pop art is a special effect process that emphasizes colors colorfully and expresses them in a bright and fun atmosphere.
Rough monochrome is a special effect process that expresses the strength and harshness of monochrome photographs.

  In the embodiment of the present invention, the special effect processing unit 111a may perform special auxiliary effect processing that generates an auxiliary visual effect on the image data. This special auxiliary effect processing is processing for performing any one of blurring processing, shading addition processing, and noise pattern superimposition processing on image data. Thus, even when the shooting control unit 117 performs shooting with increased shooting sensitivity, the special effect processing unit 111a performs noise pattern superimposition processing on the image data, thereby hiding noise generated in the image. As a result, the allowable range of the control limit can be relaxed.

  In one embodiment of the present invention, the special effect information storage unit 93 is connected to an external processing device such as a personal computer or a server via the communication unit 10, and is based on information received via the communication unit 10. The special effect processing information table T1 may be updated or rewritten. Further, the processing contents of the special effect processing newly added to a storage medium that can be attached to the storage section 9, for example, a memory card, are stored, and the control section 11 stores the processing contents of the special effect newly added from the storage medium. The special effect processing information table may be updated or rewritten by acquiring and storing the processing content of the acquired special effect processing in the special effect information storage unit 93.

  In the embodiment of the present invention, the imaging apparatus 1 has been described as a digital camera. However, the imaging apparatus 1 has a shooting function and a display function of, for example, a digital single-lens reflex camera, a digital video camera, a mobile phone, and a tablet-type mobile device. It can be applied to various electronic devices.

DESCRIPTION OF SYMBOLS 1 Imaging device 2 Imaging part 3 Light emission part 4 Photometry part 5 Timer 6 Operation input part 7 Display part 8 Touch panel 9 Memory | storage part 10 Communication part 11 Control part 21 Lens part 22 Lens drive part 23 Diaphragm part 24 Diaphragm drive part 25 Shutter part 26 Shutter drive unit 27 Image sensor 28 Image drive unit 29 Signal processing unit 61 Power switch 62 Release switch 63 Shooting mode switch 64 Operation switch 65 Menu switch 66 Zoom switch 91 Image data storage unit 92 Program storage unit 93 Special effect information storage unit 94 Pixel pitch information storage unit 95 Program diagram information storage unit 111 Image processing unit 111a Special effect processing unit 112 Face detection unit 113 Special effect setting unit 114 Control limit change unit 115 Control limit determination unit 116 Recommendation unit 117 Shooting control unit 118 Display Control unit

Claims (11)

An imaging unit that captures an image of a subject through a lens unit and generates electronic image data of the subject is provided, and a visual effect can be generated by combining a plurality of image processings on the image data. An imaging apparatus capable of selecting and executing any one or more of a plurality of special effect processes,
A display unit for displaying an image corresponding to the image data;
Based on a control limit at the time of shooting determined by one or a plurality of setting conditions for the imaging device set before shooting, a recommendation unit recommending one or more of the plurality of special effect processing,
A display control unit for displaying information on the special effect processing recommended by the recommendation unit on the display unit;
An imaging apparatus comprising: The setting conditions include a shutter speed, an aperture value, shooting sensitivity, and an extension amount of the lens unit,
The control limit is an exposure limit determined by the shutter speed, the aperture value, and the photographing sensitivity, and a close limit when focusing on the subject determined based on the contrast of the image data and the feed amount. The imaging apparatus according to claim 1.   The imaging apparatus according to claim 1, further comprising a control limit changing unit that changes the control limit based on a selection result of the special effect processing.   The imaging apparatus according to claim 3, wherein the control limit changing unit changes the aperture value in accordance with a pixel pitch at the time of recording the image data.   The imaging apparatus according to claim 3, further comprising a control limit determination unit that determines whether the control limit has been reached based on the control limit changed by the control limit change unit. The imaging unit
A diaphragm for limiting the amount of incident light collected by the lens unit;
An image sensor that receives light collected by the lens unit and performs photoelectric conversion;
A shutter unit for setting the state of the image sensor to an exposure state or a light shielding state;
A signal processing unit for amplifying an electrical signal output by the imaging device;
Have
Based on the setting condition, further includes an imaging control unit that controls the lens unit, the diaphragm unit, the imaging device, the shutter unit, and the signal processing unit,
The imaging apparatus according to claim 5, wherein the control limit determination unit determines the control limit by the imaging control unit.   The display control unit causes the display unit to display information indicating that the imaging control unit is the control limit when the control limit determination unit determines the control limit by the imaging control unit. The imaging device according to claim 6. An image processing unit for performing the special effect processing on the image data;
An input unit for receiving an input of an instruction signal for instructing selection of the special effect processing executable by the image processing unit;
A special effect setting unit that sets the special effect processing to be performed by the image processing unit in response to the instruction signal input from the input unit;
The imaging apparatus according to claim 1, further comprising:   The special effect processing includes at least one of blurring processing, shading addition processing, noise pattern superimposition processing, edge mixing processing, and image composition processing. Imaging device.   The special effect setting unit changes the distribution or intensity of the combination of the special effect processing to be performed by the image processing unit according to the setting condition or the condition of the subject, and the special effect to be performed by the image processing unit. The imaging apparatus according to claim 8, wherein a processing unit is set. An imaging unit that captures an image of a subject through a lens unit and generates electronic image data of the subject is provided, and a visual effect can be generated by combining a plurality of image processings on the image data. An imaging program to be executed on an imaging apparatus capable of selecting and executing any one or more of a plurality of special effect processes,
A display step for displaying an image corresponding to the image data;
A recommended step for recommending any one or more of the plurality of special effect processing based on a control limit at the time of shooting determined by one or a plurality of setting conditions for the shooting device set before shooting;
A display control step of displaying information on the special effect processing recommended by the recommendation step in the display step;
The imaging program characterized by performing.

Images