JP2012142978A - Image processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor in which an operation for attaching a blur to a photographed image is optimized.SOLUTION: The imaging apparatus, when a half depression operation signal is input (positive determination in a step S101), attaches an image blur to a through-image (step S104), and when the half depression operation signal is no longer input (negative determination in a step S111), releases the attachment of the image blur to the through-image. The imaging apparatus automatically permits attachment of the image blur when a photographing scene mode is set to a portrait mode. The imaging apparatus applies the image blur to a background region of a principal object. The imaging apparatus attaches, to a main photographing image obtained in accordance with a full depression operation signal, an image blur similar to the image blur having been attached to the through-image just before the full depression operation signal is input (a target region and an attachment rate of an image blur are made similar) (step S114).

Description

  The present invention relates to an image processing apparatus that adds blur to an image.

  Electronic cameras that have a smaller imaging area compared to 35 mm cameras have become widespread. Since this type of camera has a short actual focal length, it is difficult to obtain a photographed image with a blurred background like a 35 mm version camera even if a photographing lens having the same F value (optical aperture value) as that of a 35 mm version camera is used. . Patent Document 1 discloses a technique for adding blur to an image by image processing.

JP 2003-125281 A

  In the processing disclosed in Patent Document 1, it cannot be said that the operation of adding blur to an image at the time of shooting (or reproduction) is optimized.

An image processing apparatus according to a first aspect of the present invention includes a recording unit that records an image signal, a blur adding unit that processes the image signal read from the recording unit and adds blur to a predetermined area of the image, and a recording Display means for displaying a reproduced image read from the means and blurred, and extraction means for extracting, as a reference area, an area containing the most high-frequency spatial frequency component in the display screen of the display device; , An operation member for changing an electrical enlargement display magnification of the reproduction image displayed on the display screen of the display means, and an instruction to electrically enlarge the reproduction image displayed on the display screen of the display means by operating the operation member The extraction means is controlled to extract the reference area from the image signal corresponding to the next display area to be displayed next on the display screen of the display means, and the image corresponding to the next display area Among items, characterized in that it comprises a control means for controlling the blur adding means so as to be added to blur in the area excluding the reference area.
2. The image processing apparatus according to claim 1, wherein when the control unit extracts the reference area from the image signal corresponding to the next display area, the control unit is configured to capture the image in the image signal corresponding to the next display area. When there is a focus detection area used in the automatic focusing operation, it is preferable to control the extraction means so that the focus detection area is the reference area.
According to a third aspect of the present invention, there is provided an image processing apparatus for recording an image signal, a blur adding unit for processing the image signal read from the recording unit and adding blur to a predetermined area of the image, and a recording Display means for displaying the reproduced image read from the means and blurred, an extraction means for extracting the reference area in the display screen of the display device, and the electric power of the reproduced image displayed on the display screen of the display means. When the operation member that changes the magnification ratio and the operation member are operated and an electric enlargement of the reproduced image displayed on the display screen of the display means is instructed, the display is next displayed on the display screen of the display means. Control the extraction means to extract the reference area from the image signal corresponding to the next display area to be performed, and add blur to the area excluding the reference area in the image signal corresponding to the next display area Let And a controlling means for controlling the blur adding means as.
Preferably, the image processing apparatus according to claim 1 or 3 further includes a rotation operation member that changes an amount of blur added to the reproduced image displayed on the display unit.
4. The image processing apparatus according to claim 1 or 3, wherein the control means adds an amount of blur added by the blur adding means every time an operation member instructs to change the electrical enlargement display magnification of the reproduction signal. Is preferably changed.
An image processing apparatus according to a sixth aspect of the present invention includes an image sensor that captures a subject image and outputs an image signal, a blur adding unit that processes the image signal and adds blur to a predetermined area of the image, When a display means for displaying an image corresponding to the added image signal in parallel with the image pickup operation by the image pickup device and an instruction to enlarge the image displayed by the display means during the image pickup operation are given, Controls the resolution conversion means that performs resolution conversion on the image signal, and the blur addition means that processes the image signal converted by the resolution conversion means and adds blur when an enlargement instruction is given during an imaging operation. And a control means.
7. The image processing apparatus according to claim 6, wherein when an instruction to reduce the image displayed by the display unit is given during an imaging operation, the control unit applies the image signal to which the blur is added by the blur addition unit. On the other hand, it is preferable to control the resolution conversion means to perform resolution conversion for reduction.
According to an eighth aspect of the present invention, there is provided an image processing apparatus that captures a subject image and outputs an image signal, a display unit that displays an image based on the image signal, and a predetermined area of an image displayed on the display unit A blur adding unit for adding blur, an instruction unit for instructing electrical enlargement of an image displayed on the display unit, and resolution conversion of the image signal according to an instruction from the instruction unit to correspond to the image signal Resolution conversion means for performing an electrical enlargement process of the image, and blurring when an instruction for enlargement is given by the instruction means to an image captured by the image sensor and displayed on the display means before the photographing instruction The image that has been blurred by the means is subjected to electrical enlargement processing by the resolution converting means and displayed on the display means, and the image taken after the shooting instruction is blurred. When the instruction means gives an enlargement instruction while the added image is displayed on the display means, an electric enlargement process is performed on the image signal before blurring is added by the resolution conversion means. In addition, the image processing apparatus is characterized by comprising control means for controlling to display on the display means the image added with the blur by the blur adding means.
An image processing apparatus according to a ninth aspect of the invention includes a recording unit that records an image signal, a display unit that displays an image corresponding to the image signal read from the recording unit, and an image displayed on the display unit. A blur adding unit for adding blur to a predetermined area, an instruction unit for instructing electrical enlargement of an image displayed on the display unit, and a resolution conversion process on the recorded image signal in accordance with an instruction from the instruction unit A resolution conversion unit that performs a general enlargement process, and a recording image signal before blurring is added by the blur addition unit when the instruction unit instructs to continuously enlarge the image displayed on the display unit. And a control unit that controls the display unit to display the image subjected to the resolution conversion process.
An image processing apparatus according to a tenth aspect of the present invention includes an image sensor that captures a subject image and outputs an image signal, a blur addition unit that processes the image signal and adds blur to a predetermined area of the image, Display means for displaying an image corresponding to the added image signal in parallel with the imaging operation by the imaging device, and when an instruction to change the display magnification of the image displayed by the display means is given during the imaging operation, Resolution conversion means for performing resolution conversion on a signal based on an image signal, and blur addition means for changing the amount of blur added according to the changed display magnification when a change instruction is given during an imaging operation And a control means for controlling.
The image processing apparatus according to a tenth aspect may further include a zoom photographing optical system having different optical aperture amounts at the short focal point and the long focal point. The blur adding means in this case is a blur corresponding to an aperture value further narrowed down than the optical aperture value at the long focal end when the zoom photographing optical system is in the long focal end state and an instruction to change the display magnification is given. It is preferable to add a blur to a predetermined area of the image so as to obtain an image.
An image processing apparatus according to a twelfth aspect of the present invention provides an image pickup device that picks up a subject image and outputs an image signal via a zoom photographing optical system, and processes the image signal to add blur to a predetermined region of the image. Blur adding means, display means for displaying an image corresponding to the blurred image signal in parallel with the image pickup operation by the image sensor, and enlargement of the display magnification of the image displayed by the display means during the image pickup operation When the change instruction is continuously made, the focal length of the zoom photographing optical system is changed to the long focal length end, and further, the magnifying means for continuously converting the resolution based on the image signal, and during the imaging operation, When an instruction to change the display magnification is given and the focal length reaches a predetermined value, blur is added to the image signal, and blur is added so that the image signal with blur is output to the display means. And a controlling means for controlling the stage.
An image processing apparatus according to a thirteenth aspect of the present invention includes a blur adding unit that processes an image signal to add blur to a predetermined area of the image, an instruction unit that instructs electrical enlargement of the image based on the image signal, And an enlarging unit that performs an electrical enlarging process by resolution conversion, and a control unit that performs control so that blurring is not added by the blurring unit when an instruction for enlarging a predetermined magnification or more is instructed by the instruction unit. Features.
An image processing apparatus according to a fourteenth aspect of the present invention is an image pickup device that picks up a subject image via a photographing optical system and outputs an image signal, and performs processing on the image signal to add blur to a predetermined area of the image. And a blur adding means for controlling and a control means for prohibiting the addition of the blur by the blur means in a detection mode for detecting adhesion or scratches of foreign matter to the photographing optical system or the image pickup device based on the image signal. To do.
15. The image processing apparatus according to claim 14, wherein the control unit controls the blur adding unit to add blur to a region including a foreign object or a flaw image on a captured image captured in a shooting mode other than the detection mode. It is preferable.
15. The image processing apparatus according to claim 14, wherein the blur adding unit adds blur according to a contrast level of a region including a foreign object or a flaw image on a captured image captured in a shooting mode other than the detection mode. It is preferable to change the amount.

  According to the present invention, it is possible to provide an image processing apparatus that optimizes the operation of adding blur to a captured image.

It is a block diagram which shows an example of the imaging device by embodiment of this invention. It is a flowchart explaining the flow of the imaging | photography process in which a control circuit adds image blur. It is a figure which illustrates the through image acquired at different time. (a) It is a figure which illustrates a through image, without adding image blur. (b) It is a figure which illustrates the through image to which the image blur was added. (c) It is a figure which illustrates other display modes. It is a perspective view which illustrates a camera. It is a perspective view which illustrates a camera. It is a perspective view which illustrates a camera. It is a perspective view which illustrates a camera. It is a perspective view which illustrates a video camera. It is a perspective view which illustrates a video camera. It is a perspective view which illustrates a video camera.

The best mode for carrying out the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram illustrating an example of an imaging apparatus according to an embodiment of the present invention. In FIG. 1, an imaging device includes an imaging device 1, a photographing lens 2, a lens driving circuit 3, a control circuit 5, an operation member 7, an imaging device driving circuit 8, a signal processing circuit 9, and a data processing circuit. 10, a compression / expansion circuit 11, a monitor 13, a display control circuit 14, and a photometry circuit 15, and a recording medium 12 is further provided. The recording medium 12 includes a memory card, a small hard disk, an optical disk such as a DVD, and the like. The recording medium 12 may be built in the imaging apparatus or may be detachably mounted. Further, it may be provided outside the imaging apparatus. In that case, the recording medium 12 and the imaging device are electrically connected by wire or wirelessly.

  The taking lens 2 is composed of a plurality of lens groups constituting a taking optical system, and forms a subject image on the image pickup surface of the image pickup device 1. The photographic lens 2 includes a focus lens (not shown), and the lens driving circuit 3 drives the focus lens to move back and forth in the optical axis direction, thereby adjusting the focus of the photographic lens 2. The photographing lens 2 includes a zoom lens (not shown), and the lens driving circuit 3 drives the zoom lens to move back and forth in the optical axis direction, thereby adjusting the zoom of the photographing lens 2. The lens driving circuit 3 generates a lens driving signal in accordance with a lens driving command output from the control circuit 5, and moves each lens by driving a lens driving mechanism (not shown) with the generated lens driving signal.

The image sensor 1 can capture a still image as well as continuous images of a still image and a moving image. The image sensor 1 is configured by, for example, a CCD image sensor or a CMOS image sensor.

  The image sensor drive circuit 8 generates a drive signal at a predetermined timing in response to a command output from the control circuit 5 and supplies the generated drive signal to the image sensor 1. The image sensor 1 controls charge accumulation (imaging) and reading of accumulated charge by the supplied drive signal. The control circuit 5 obtains information on the brightness of the object scene using the photometry data of the subject obtained by the photometry circuit 15, and based on the information on the brightness, the charge accumulation time of the image sensor 1, the aperture of the photographing lens 2, and The amplification degree of the image signal output from the image sensor 1 is determined. The information on the brightness of the object scene may be obtained from a signal output from the image sensor 1. In this case, the image sensor 1 controls the function of the photometry circuit 15.

The image signal read from the image sensor 1 is input to the signal processing circuit 9. The signal processing circuit 9 performs signal processing such as amplification, direct current reproduction, A / D conversion, white balance, and gamma conversion on the input signal in accordance with a command from the control circuit 5, and the data after the signal processing is used as image data. Output to the data processing circuit 10.

  The data processing circuit 10 outputs the image data output from the signal processing circuit 9 to the compression / expansion circuit 11 in accordance with a command from the control circuit 5 and also has a resolution necessary for displaying the reproduced image on the monitor 13. Conversion (pixel number conversion) processing is performed on the image data, and the image data after the resolution conversion processing is output to the display control circuit 14. Note that the data processing circuit 10 performs resolution (number of pixel) conversion processing on input image data when performing electronic zoom processing to be described later, to the compression / expansion circuit 11 and the display control circuit 14 respectively. Output.

  In response to a command from the control circuit 5, the display control circuit 14 performs predetermined signal processing on the image data input from the data processing circuit 10 and outputs it to the monitor 13. The display control circuit 14 further performs processing for superimposing overlay image data such as a shooting menu and a cursor on the image data. Thereby, the subject image on which the overlay image is superimposed is displayed on the monitor 13.

The compression / decompression circuit 11 performs a compression process on the image data input from the data processing circuit 10 in a predetermined format in response to a command from the control circuit 5, and records the compressed data on the recording medium 12. When image data is recorded on the recording medium 12 during shooting, a reproduced image corresponding to the image data to be recorded is displayed on the monitor 13. When the operation member 7 instructs to record the image data in the non-compressed state, the compression / decompression circuit 11 performs the recording on the recording medium 12 without performing the compression process. Also in this case, a reproduced image corresponding to the image data to be recorded is displayed on the monitor 13.

Further, the imaging apparatus is configured to be able to display a reproduction image based on image data recorded on the recording medium 12 on the monitor 13 (reproduction mode). Compression / decompression circuit 1 in this case
1 reads image data recorded on the recording medium 12 in response to a command from the control circuit 5, performs decoding processing on the read data, and sends the decoded data to the data processing circuit 10. . During reproduction, the data processing circuit 10 performs resolution conversion processing on the decoded data and outputs it to the display control circuit 14, whereby a reproduced image is displayed on the monitor 13. Note that when uncompressed image data recorded on the recording medium 12 is read, the decoding process, which is the reverse process of the compression process, is not performed. The compression / decompression circuit 11 is configured to be able to perform lossless compression (so-called lossless encoding).

  The operation member 7 includes a release button and outputs an operation signal corresponding to the operation content to the control circuit 5. When a release operation signal based on the pressing operation of the release button is input from the operation member 7, the control circuit 5 sets a focus detection area set in advance in the imaging screen in the image signal read from the imaging device 1. A known contrast AF (autofocus) operation is performed using the corresponding signal.

  Specifically, among the image data signal-processed by the signal processing circuit 9, the lens drive command is set so as to maximize the integrated value (so-called focus evaluation value) of the high frequency component for the data corresponding to the focus detection area. (Focus adjustment signal) is sent to the lens driving circuit 3. The position of the focus lens that maximizes the focus evaluation value is a focus position that eliminates blurring of the edge of the subject image captured by the image sensor 1 and maximizes the contrast of the image (increases sharpness).

  In the present embodiment, image data (video signal) sequentially obtained while moving the focus lens in the imaging lens 2 is analyzed for each of a plurality of focus detection areas in the shooting screen, and the contrast value of the image corresponding to each area is analyzed. The (relative) shooting distance of the subject located in each area can be acquired based on the focus lens position that maximizes the angle.

  In addition to the contrast AF operation, a phase difference AF operation by a known pupil division method may be performed. Also in this case, the shooting distance of the subject located in each region can be obtained.

  The operation member 7 also includes a zoom operation member. When a zoom operation signal based on a zoom operation is input from the operation member 7, the control circuit 5 generates the lens drive command described above, and causes the lens drive circuit 3 to drive the zoom lens forward and backward. Thereby, the subject image formed on the imaging surface of the imaging device 1 is enlarged or reduced, and the zoom is optically adjusted.

  Further, when a zoom operation signal based on the zoom operation is input from the operation member 7, the control circuit 5 outputs a command to the data processing circuit 10 to change the conversion ratio of the resolution conversion processing for the image data according to the operation signal. Thereby, the image displayed on the monitor 13 is enlarged or reduced, and the zoom is electrically adjusted (electronic zoom). The resolution conversion ratio corresponds to the electronic zoom magnification. When the data processing circuit 10 changes the conversion ratio in the direction of increasing the electronic zoom magnification, a part of the reproduced image is enlarged and displayed on the monitor 13 (while the enlargement ratio is increased, the display range of the reproduced image is narrowed). On the contrary, when the data processing circuit 10 changes the conversion ratio in the direction of decreasing the electronic zoom magnification, the enlargement ratio of the reproduced image displayed on the monitor 13 is lowered, but the display range of the reproduced image is widened. When the photographing mode by the image sensor 1 is set, photographed image data corresponding to the image displayed on the monitor 13 can be recorded on the recording medium 12.

Next, a through image shooting operation, a still image main shooting operation, and a moving image main shooting operation performed when the imaging apparatus is set to the shooting mode will be described. Through image shooting is preliminary shooting performed as a pre-stage of still image main shooting, and still image main shooting is shooting performed in response to a release button full-press operation signal (shooting instruction). The moving image main shooting operation is shooting performed in response to an operation signal (shooting and recording instruction) of the REC button.

<Through image shooting operation>
When the image pickup apparatus of the present embodiment performs a still image main shooting operation, if a half-press operation signal based on a half-press operation of the release button is input from the operation member 7 to the control circuit 5, the AF operation described above is performed. Perform a through image shooting operation. The through image capturing operation is repeatedly performed at a predetermined frame rate. During the half-press operation of the release button, the above-described AF operation is performed in parallel with the through image capturing operation, and the captured through image is displayed on the monitor 13. Is displayed.

The control circuit 5 sends an instruction to the image sensor drive circuit 8 to output a drive signal for executing a through image photographing operation. The imaging device 1 receives a drive signal for a through image shooting operation and continuously outputs accumulated charges at a high frame rate of, for example, 30 frames / second. The exposure conditions for through image shooting are determined based on the photometric data from the photometric circuit 15. The signal processing circuit 9 performs the above-described signal processing on the input signal, adds the signals of the same color pixels (in the case of a single-plate color image sensor) located in the vicinity on the image sensor 1, and creates a still image to be described later. The video signal is output to the data processing circuit 10 as a video signal having a lower resolution (lower number of pixels) than at the time of actual photographing.

  When the data processing circuit 10 outputs the image data subjected to the resolution conversion process to the display control circuit 14, the through image is displayed on the monitor 13. As a result, the photographer can observe the state of the object scene to be photographed from now on the screen of the monitor 13. That is, in the through image shooting operation, the imaging operation and the display operation are performed in parallel.

<Still image shooting>
When the release button is fully pressed following the through image shooting operation, a full press operation signal is input to the control circuit 5. The imaging device starts a still image book shooting operation in response to the full-press operation signal.

  When the control circuit 5 detects a full-press operation signal from the operation member 7 (release button), it sends an instruction to the image sensor drive circuit 8 to output a drive signal for executing the main photographing operation. The image sensor 1 receives a drive signal for the still image main photographing operation, performs charge accumulation for main photographing based on the exposure calculation result, and outputs the accumulated charge. The exposure condition for the main photographing is determined based on the brightness information of the object scene obtained from the signal value of the latest live view image data. The signal processing circuit 9 performs the above-described signal processing on the input signal and outputs the image data to the data processing circuit 10 as image data with a higher resolution (higher number of pixels) than when a through image is captured.

The data processing circuit 10 outputs the image data subjected to the resolution conversion processing to the display control circuit 14, so that the still image main captured image is displayed on the monitor 13. The compression / decompression circuit 11
The image data compressed by the above is recorded on the recording medium 12.

<Video recording operation>
Next, the main video shooting operation will be described. The main moving image shooting operation is a shooting operation in which a moving image shot by the image sensor 1 is recorded on the recording medium 12 while being displayed on the monitor 13. This moving image main shooting operation is a part of the operation member 7 and is executed while the REC button is instructed to take a moving image. When the REC button constituting a part of the operation member 7 is pressed, the control circuit 5 continuously performs the automatic focusing operation described above and executes the moving image main photographing operation by the image sensor 1. Note that the automatic focusing operation in this case is performed even if the automatic focusing operation is performed while tracking the specific subject so that the specific subject moving in the screen is focused. It may be controlled to always focus on an object at a distance. Also,
In particular, the in-focus state may be changed according to the photographer's intention by manually operating a focus operation member (focus adjustment member) that constitutes a part of the operation member 7 without performing the focus operation.

When detecting the pressing operation of the REC button, the control circuit 5 instructs the image sensor driving circuit 8 to output a driving signal for executing the moving image main photographing operation. The image sensor 1 receives a drive signal for the main moving image shooting operation and continuously outputs a video signal at a high frame rate of, for example, 30 frames / second. The video signal output from the image sensor 1 in this manner is subjected to predetermined processing by the signal processing circuit 9 and the data processing circuit 10 and then sequentially supplied to the monitor 13 via the display control circuit 14. The data is recorded on the recording medium 12 via the compression / decompression circuit 11.

Note that when the recording of the recording medium 12 in the non-compressed state is instructed by the operation of the operation member 7, the compression / decompression circuit 11 does not perform the compression process, and the recording to the recording medium 12 is performed. . In addition, when performing a recording operation on the recording medium 12, the compression rate may be changed by operating the operation member 7.

  Further, the shooting distance information acquired in the above-described automatic focusing operation is recorded on the recording medium 12 together with the image data in association with each of a plurality of still image frames constituting the moving image. The photographer can confirm the state of the object scene to be photographed and the image recorded on the recording medium 12 by viewing the moving image displayed on the monitor 13. The number of pixels of one frame of a moving image recorded on the recording medium 12 is larger than the number of pixels of the monitor 13. Therefore, in the present embodiment, when the moving image is displayed on the monitor 13, resolution (pixel number) conversion processing is performed by the data processing circuit 10 so as to match the number of pixels of the monitor 13.

<Blur addition processing>
An operation of adding an electrical blur that is a feature of the present invention to an image (that is, adding a blur to the image) will be described. The process of electrically blurring an image (hereinafter referred to as adding an image blur) is to process an image by image processing and generate a pseudo-focused image. In the imaging apparatus according to the present embodiment, a low-pass filter (LPF) is added to the image data.
By performing processing to degrade the high frequency spatial frequency component of the image, the edge of the image becomes unclear and the contrast of the image is lowered.

  When the shooting mode is set to portrait mode or macro mode, the imaging device is allowed to add image blur (and change the added content), and the shooting mode is set to distant view mode. If it is, addition of image blur (and change of the added content) is prohibited. Here, the portrait mode is a shooting mode in which a person is a main subject, the macro mode is a shooting mode in which close-up shooting is performed, and the distant view mode is a shooting mode in which a landscape is a subject. The control circuit 5 determines whether to permit or prohibit. Based on this prohibition / permission determination of image blur, it is possible to add / prohibit image blur to at least one of the through image data and the still image captured image data based on the full press operation of the release button. Be controlled. In other words, the addition of image blur is permitted in shooting modes (portrait mode, macro mode, etc.) in which it is determined that adding image blur to a shot image increases the artistry of the image, and in other shooting modes. Since the image blur addition is prohibited, it is possible to prevent the image blur from being erroneously added to an image in which the image blur is not preferable.

In addition, even when the shooting mode is set to the night scene portrait mode, and there is an area having a brightness of a predetermined level or more in the background area of the image, the imaging apparatus adds (and adds) image blur. (Change of contents) is permitted. On the other hand, when the night scene portrait mode is set and there is no area having a brightness of a predetermined level or higher (for example, a bright spot area such as illumination) in the background area of the image, Addition (and modification of additional contents) is prohibited. Whether or not a brightness area of a predetermined level or more exists in the background area of the image is determined using a video signal for a through image input to the data processing circuit 10.

  The control circuit 5 may be configured to prohibit the above-described image blur addition (and change of the added content), at least at the time of photographing, and at the time of reproduction.

  A flow of photographing processing in which the control circuit 5 adds image blur will be described with reference to a flowchart of FIG. The shooting process shown in FIG. 2 is started when the addition of image blur (and change of the added content) is permitted based on the shooting mode set as described above and the shot image data.

  In step S101 in FIG. 2, the control circuit 5 determines whether or not the release button has been pressed halfway. When a half-press operation signal is input from the operation member 7 (release button), the control circuit 5 makes an affirmative determination in step S101 and proceeds to step S102. If no half-press operation signal is input, the control circuit 5 makes a negative determination in step S101. The determination process is repeated. In the present embodiment, it is assumed that a through image shooting operation has already started before step S101.

  In step S102, the control circuit 5 sets the exposure mode to the aperture priority auto mode and starts the above-described AF operation while performing the through image shooting operation, and proceeds to step S103. In the aperture priority auto mode, change of the aperture value is prohibited, and at least one of the electronic shutter speed (charge accumulation time) of the image sensor 1 and the amplification degree with respect to the image signal output from the image sensor 1 is set to be changeable. . By setting to the aperture priority auto mode, the currently set aperture value is not changed during the photographing process, and it is possible to easily adjust and confirm the image blur addition amount described later. In the AF operation, for example, the focus evaluation value is maximized for each of the plurality of focus detection areas in the moving process while moving the focus lens from the position corresponding to infinity toward the position corresponding to the closest end at a predetermined speed. The focus lens position (focus position) to be detected is detected, and shooting distance information corresponding to each focus lens position is acquired. Thereby, distance information to a subject existing in each of the plurality of focus detection areas can be obtained.

  The control circuit 5 sequentially displays the through image on the monitor 13 at the above frame rate during the AF operation, and superimposes and displays the AF marks indicating a plurality of focus detection areas on the through image. The control circuit 5 sends a command to the display control circuit 14 to change and display the display color of the AF mark corresponding to the focus detection area where the in-focus position is detected (focus detection) from red to green. The display for notifying the photographer of the focus detection may be displayed by another LED or the like instead of the monitor 13 in a superimposed manner.

In step S103, the control circuit 5 performs subject extraction (recognition) processing from the through-image video signal that is a focused image with no image blur added, and proceeds to step S104. In the extraction (recognition) of the subject, for example, the focus state is adjusted so that each subject existing in each focus detection area is focused using a plurality of images captured in the course of the AF operation in step S103. In this state, each subject image in the imaging screen is extracted (recognized). Thus, the process of step S104 is performed in parallel with the process of step S103. The main subject is extracted from the subjects extracted in this way using the extraction method described later (
recognize. In addition, a configuration may be employed in which subject extraction (recognition) is performed using images of a plurality of frames having different focal states or images of a plurality of frames having different focal lengths. As an extraction method, a technique for extracting a known specific contour, a technique for extracting a known specific color (skin color, etc.) region, a technique for recognizing a face, or a combination of these extraction techniques may be used. When there are a plurality of extracted subjects, for example, the subject closest to the imaging device is extracted as the main subject using distance information to the plurality of subjects acquired by the AF operation. The control circuit 5 drives the focus lens to a position where the extracted (recognized) main subject is focused.

Note that the specific contour extraction and the specific color extraction may be omitted, and in this case, the subject closest to the imaging apparatus is set as the main subject using the distance information to the plurality of subjects acquired by the AF operation. Image blur, which will be described later, is added to the region excluding the main subject region extracted in this way. The extraction (recognition) result of the extracted main subject (the type of the subject and the position on the imaging screen) is used as follows, for example. Depending on the extraction (recognition) result of the main subject (the type of the subject and the position on the imaging screen), the contents of the image processing performed on the through image or the subsequent captured still image are changed. For example, an image blur is added only to an image in which a face is recognized in a through image to which no image blur is added, or the color of the face area is changed to a predetermined color.

  Further, the extraction (recognition) result as described above may be recorded on the recording medium 12 together with the through image or the image data of the subsequent captured still image. The photographer can inspect the image data recorded in association with each other based on the recognition result recorded in the recording medium 12. According to the above configuration, subject extraction and subject recognition are performed using an image (through image) to which no image blur is added, so that accurate extraction and recognition can be performed. In this case, the results of subject extraction and subject recognition are not limited to those reflected in the through image, but may be reflected in the subsequent still image taken. In addition, since each subject is extracted (recognized) using an image focused on each subject, accurate extraction and recognition can be performed.

  In step S104, the control circuit 5 instructs the data processing circuit 10 to add image blur to the region other than the main subject extracted in step S103 (ie, the background region) in the through image video signal, and then proceeds to step S105. move on. The data processing circuit 10 outputs a signal subjected to image blur addition and resolution conversion processing to the display control circuit 14, so that a through image with image blur is displayed on the monitor 13.

The data processing circuit 10 adds image blur by selectively performing LPF processing on the data corresponding to the background area of the input through image data. The characteristics of LPF processing (number of filter taps, cutoff frequency, attenuation, etc.) are changed according to the distance information acquired in the focus detection area. Specifically, the shooting distance acquired in the focus detection area in the main subject area is compared with the shooting distance acquired in the focus detection area in the background area, and the difference in shooting distance between the two is large. The cutoff frequency of LPF processing for the background area is lowered. As a result, a stronger blur effect is added to the background area having a larger difference from the shooting distance of the main subject.

Note that instead of causing the data processing circuit 10 to perform LPF processing, convolution calculation processing using a point spread function is performed to suppress high-frequency spatial frequency components in the screen (add image blur). Good.

In step S105, the control circuit 5 determines whether or not there is a motion on the shooting screen. The control circuit 5 determines that the motion vector between frames calculated from through-image data of a plurality of frames acquired every 1/30 seconds by through-image shooting is the entire shooting screen (a block obtained by dividing the shooting screen into a predetermined number). (Ie, the deviation of the direction and the magnitude of the motion vector between the blocks is within a predetermined range), and the average value of the magnitude of the motion vector in each block in the shooting screen is predetermined. If it is greater than or equal to the value, an affirmative decision is made in step S105 and the process proceeds to step S106.

  On the other hand, the control circuit 5 determines whether the motion vector between frames calculated from through-image data of a plurality of frames is not commonly detected in each region of the shooting screen, or the size of the motion vector in each block in the shooting screen. If the average value is less than the predetermined value, a negative determination is made in step S105, and the process proceeds to step S107. In step S107, the control circuit 5 determines whether or not there is a movement in some subjects in the shooting screen. The control circuit 5 detects a motion vector between frames calculated from through image data of a plurality of frames acquired every 1/30 seconds by through image shooting in at least one of the predetermined number of divided blocks. In step S107, an affirmative determination is made, and the process proceeds to step S108.

When the process proceeds to step S106, it is determined that there has been a movement of the photographing range due to the movement of the imaging device. In step S106, the control circuit 5 moves the target area (background area) to which image blur is to be added from the position of the additional target area of the previous frame in accordance with the direction and size of the motion vector, and proceeds to step S109. Here, for the area newly added to the shooting range as the shooting range moves, a blur equivalent to the blur amount added at the corresponding screen edge of the frame before the shooting range moves is added. (Same LPF treatment is applied). The movement of the target area to which image blur is added is reflected in the display image of the monitor 13 in real time. As described above, according to the above configuration, control is performed so that the image blur amount is changed and the image blur addition position is automatically moved in accordance with the movement of the subject in the moving image (change in the image signal). .

  The amount of blur added to the area newly added to the shooting range with the movement of the shooting range is calculated by extrapolation from the distribution of the blur amount in the shooting screen added before the shooting range moves, The calculated blur amount may be added. Also in this case, the movement of the target area to which the image blur is added is reflected on the display image of the monitor 13 in real time.

  On the other hand, when the motion vector between frames calculated from through image data of a plurality of frames acquired every 1/30 seconds by through image shooting is not detected in any of the predetermined number of divided blocks, the control circuit 5 Makes a negative determination in step S107 and proceeds to step S109. In this case, the process proceeds to step S109 without changing the target area to which the image blur is added.

  When the process proceeds to step S108, it is determined that there is a movement for a part of the subject in the shooting screen. In step S108, the control circuit 5 adds a target region or image blur to which image blur is added according to the direction and size of the motion vector in the divided block in which motion is detected or in the divided block in which motion is not detected. The target area not to be moved (area corresponding to a part of the subject) is moved to step S109.

  FIG. 3 is a diagram illustrating through images acquired at times T0, T1, and T2. In the current frame screen at time T1, the amount of blur added to the partial subject area O1 in which the motion has been detected is the same as the partial subject area O0 in the frame screen (time T0) before the partial subject moves. The amount of blur to be added to the region P in the current frame screen (time T1) corresponding to the position of the region O0 is interpolated from the distribution of the amount of blur added to the periphery of the region P. Calculate by processing. The movement of the target area to which image blur is added is reflected in the display image of the monitor 13 in real time.

You may determine as follows about the blur addition amount with respect to the area | region which existed before the one subject moved. That is, assuming that the current frame is time T2, the amount of blur added to the area O2 of the partial subject whose movement has been detected in the current frame screen is the same as that in the frame screen (time T1) before the partial subject moves. The blur amount added to the area Q in the current frame screen (time T2) corresponding to the position of the area O1 is set to be the same as the blur amount added to the area O1 of the partial subject. The blur amount added to the corresponding region R in the previous frame screen (time T0) is the same. If the region to which the same amount of image blur is added is moved with time using motion information between frames as in step S106 and step S108, the amount of blur to be added differs depending on the region in the screen. In such a case, it is possible to quickly generate an image with electric blur as compared with the case where the amount of image blur in each region is calculated for each frame image. When the image generated in this way is displayed on the monitor 13, the delay time until display can be reduced.

  In step S109, the control circuit 5 determines whether or not an operation for changing the image blur addition amount has been performed. The control circuit 5 makes an affirmative determination in step S109 when a blur amount change operation signal is input from the operation member 7, and proceeds to step S110. If a blur amount change operation signal is not input, the control circuit 5 makes a negative determination in step S109. Proceed to step S111. The blur amount changing operation is configured such that both a changing operation performed by designating a specific area on the screen of the monitor 13 and a changing operation performed in common on the entire screen can be performed.

In step S110, the control circuit 5 instructs the data processing circuit 10 to change the characteristics of the LPF processing in accordance with the blur amount changing operation signal, and proceeds to step S111. Thereby, the amount of blur added is changed. In addition, when performing a convolution operation process instead of the LPF process, the point spread function is changed according to the change operation signal. The image after the blur amount change is displayed on the monitor 13 in real time.

  In step S111, the control circuit 5 determines whether or not the half-press operation of the release button is continued. When the half-press operation signal is continuously input from the operation member 7, the control circuit 5 makes an affirmative decision in step S111 and proceeds to step S112. On the other hand, the control circuit 5 when the half-press operation signal is not input proceeds to step S115 in order to make a negative determination in step S111 and cancel the addition of image blur. In step S115, the addition of the image blur is canceled and an image without the image blur is displayed on the monitor 13. Even in this case, the through image shooting operation is continued. Therefore, the photographer can reset the image blur addition (amount, position, etc.) by releasing the half-press operation of the release button.

  That is, a negative determination is made in step S111 and the process proceeds to step S115, and after the next half-press operation signal is input, the automatic focusing operation is completed and the main subject extraction is performed. The through image not to be displayed is displayed on the monitor 13. With such a configuration, it is possible to cancel the added image blur (return to the state before adding the image blur) by a simple operation. In addition, since a focused image with no image blur is displayed on the monitor 13 every time shooting is performed, whether or not image blur should be added can be determined for each image to be shot. In addition, when image blur that has been added as described above is not canceled, subject extraction is performed using a non-focused image when the shooting range is changed and automatic focusing is performed for the next shooting. May result in improper image blur. According to the above configuration, in order to perform the automatic focusing operation, image blur is not added at the stage where the release button is half-pressed, and this is prevented.

  In step S112, the control circuit 5 determines whether or not the release button has been fully pressed. The control circuit 5 makes an affirmative decision in step S112 when a full-press operation signal is input from the operation member 7, and proceeds to step S113. If a full-press operation signal is not input, the control circuit 5 makes a negative determination in step S112, and step S105. Return to.

In step S113, the control circuit 5 starts the still image book photographing operation and proceeds to step S114. The control circuit 5 performs an automatic exposure (AE) operation for main photographing using the brightness information of the through image signal (data) displayed on the monitor 13 immediately before the full-press operation signal is input. Thereby, when the image blur is added to the latest through image data, the exposure for the main photographing is determined based on the brightness information of the signal (data) value including the added image blur. Therefore, for example, even when image blur is added to an image having a high-level bright spot region locally, the actual shooting is performed based on the bright spot image data whose level is reduced by the addition of the image blur. Since the exposure of the motion is determined, a final image with accurate brightness can be obtained. Based on the determined exposure, the imaging device sets an electronic shutter speed (charge accumulation time) of the imaging device 1, a diaphragm, an amplification degree of an image signal output from the imaging device 1, and performs an imaging operation. When no image blur is added to the latest through image signal (data), the exposure for the main photographing is determined based on the signal (data) value not added with the image blur.

In step S114, the control circuit 5 adds an image blur similar to the image blur added to the through image immediately before the full-press operation signal is input to the image signal obtained in the actual photographing ( The target area to which image blur is to be added and the amount of image blur to be added are made the same). This point will be described. The number of pixels is different between an image obtained by actual photographing and a through image. Usually, the spatial frequency of an image is defined by the number of stripes between unit distances (for example, 1 mm). The above-mentioned “add similar image blur” means normalization of the spatial frequency with reference to the screen size of the image (the above unit distance is the screen size. The number of stripes in the area is normalized based on the vertical and horizontal dimensions of one screen, for example, when there are vertical stripes in a certain area of the screen, This means that the spatial frequency characteristics including optical blur of both images after adding the image blur are set to be substantially the same.

Here, setting the spatial frequency characteristics of both images to be substantially the same means that the point spread characteristics including the optical blur of both images (that is, the screen of the point image of the output image when the points are imaged). This is the same as setting so that the spread characteristics normalized with respect to the size of are substantially the same. According to the concept of the spatial frequency normalized with respect to the screen size as described above, since the number of pixels of both images is different, for example, the maximum spatial frequency that can be expressed by both images is always different. In order to make the degree of image blurring of images having different numbers of pixels the same, the image blurring is performed so that the spatial frequency characteristics normalized with respect to the screen size after the addition processing of each image blurring are the same. Set parameters for additional processing. Specifically, since the number of pixels of both images is different, the processing for adding image blur to both image data (low pass filter coefficients, parameters such as convolution coefficients, and processing characteristics) is different. . The through image here can be replaced with a reproduced image read from the recording medium 12 and displayed on the monitor 13.

  In this way, it is possible to set an image blur addition process for each image so that the degree of image blur is the same between a through image or a reproduced image having a different number of pixels and the actual captured image. Even if the photographer does not actually see the high-resolution pixel-captured actual captured image, the photographer captures the actual captured image with the actual pixel count from the through image displayed on the monitor 13 or the reproduced image displayed on the monitor 13. The degree of image blur addition can be determined.

Here, the through image is displayed on the monitor 13 as described above. However, in order to reduce the size of the apparatus, the display screen of the monitor 13 is generally small. For this reason, in order to facilitate the visual recognition of the degree of image blur addition on the monitor 13, the amount of image blur added to the display image by the monitor 13 having a small display surface area and a small display area is set to the actual captured image. You may comprise so that it may become larger than the addition amount of an image blur. Even if the images are displayed on the same monitor 13, the display areas of the through images (or quick view images) and the thumbnail images are different. For this reason, as described above, it is preferable that the amount of blurring of the thumbnail image is set to be larger than the amount of blurring of the through image (or quick view image).

  In addition, when the aperture state differs between the still image main shooting and the previous through-image shooting, the blur corresponding to the amount of change in the aperture is electrically applied to the still image obtained by the still image main shooting operation. It is good also as a structure added to. For example, if the aperture is reduced by one step in the process of moving from through image shooting to still image main shooting, the still image obtained by the still image main shooting operation is blurred by one step from the previous image. Has been reduced. Therefore, an image blur of one stop is electrically added to the still image obtained by the still image main photographing operation so that the degree of image blur of both images is the same. In this way, even when the aperture changes between the still image shooting and the immediately preceding through shooting, the image blur is adjusted based on the amount of change in the aperture, so the same image as the through image It is possible to obtain an actual photographing still image with a degree of blur.

  Further, the control circuit 5 records the actual captured image data compressed after the image blur is added to the recording medium 12, returns the aperture priority auto mode to the most recent setting mode, and then ends the processing of FIG.

  When the control circuit 5 records the actual captured image data on the recording medium 12, the thumbnail image and the quick view image are recorded together with the actual captured image. The thumbnail image is an image for displaying the captured image on the monitor 13 in a reduced size, and is obtained by further reducing the number of pixels from the actual captured image to the number of pixels of the monitor 13 for the thumbnail. The quick view image is an image that is generated and recorded from the actual captured still image in accordance with the number of pixels of the monitor 13 in order to reproduce and display a captured image of one frame on the monitor 13 in a large and rapid manner. This is an image obtained by reducing the number of pixels from the main image in accordance with the number of display pixels. The thumbnail image and the quick view image are each recorded on the recording medium 12 as a still image in association with the actual captured image.

  Since the image data with the image blur added has a higher spatial frequency component suppressed than the image data before the image blur is added, the compressed data of the image whose data size after the compression process does not add the image blur is added. Smaller than size. When the addition of image blur (and change of the added content) is permitted, the control circuit 5 uses a coefficient for calculating the number of shootable images as a coefficient when addition of image blur is permitted (a predetermined amount of image blur). The average compression code amount per frame of the still image obtained by the main photographing operation that is permitted to be added is calculated. Since the high frequency spatial frequency component is suppressed in the image data to which the image blur is added, the code amount after the compression processing is reduced. As a result, when the addition of image blur is permitted, the number of shootable images for the same remaining capacity (the free capacity of the recording medium) increases as compared with the case where it is prohibited. Such a shootable number is displayed, for example, on the monitor 13 in the shooting mode, and the display differs depending on the shooting mode that allows the addition of image blur and the shooting mode that does not allow the blurring. In addition, when the additional amount of image blur can be changed and set, the display of the number of shootable images that can be recorded in the remaining capacity may be changed according to the set additional amount.

The data processing circuit 10 generates thumbnail images and quick view images under the control of the control circuit 5. The amount of blur added to the still image captured image, thumbnail image, and quick view image is in the order of increasing the size of the output image as described above, that is, in the order of thumbnail image, quick view image, still image captured image. Similarly, the amount of blur is adjusted so that the amount of blur is reduced, or the apparent amount of blur of each image (the spatial frequency characteristics of the amount of blur normalized by the size of the image on the output medium (printed paper, monitor display, etc.)) The amount of image blur to be added is adjusted as follows. In this case, the resolution of the actual still image data is converted to a data size corresponding to the quick view image and the thumbnail image, and the image is converted so that an appropriate blur is obtained for each converted image. It is preferable to add blur. With such a configuration, the amount of image blur added to each image can be individually adjusted.

  Alternatively, the data processing circuit 10 may be configured to generate thumbnail image data and quick view image data from the data of the actual captured image to which the image blur is added or the data of the through image to which the image blur is added. With such a configuration, an image corresponding to the number of pixels of each of the thumbnail image and the quick view image is generated from the actual captured still image data, and an image blur is added to the actual captured still image. It is possible to quickly generate a thumbnail image and a quick view image to which image blur has been added, with a small amount of computation compared to the case where image blur addition processing is performed on both generated images. it can.

<Display example of monitor>
A display mode when an image with added image blur is displayed on the monitor 13 will be described with reference to FIG. FIG. 4A is a diagram illustrating a monitor 13 that displays a through image without adding image blur. In FIG. 4A, the subject 301 exists behind the main subject 300, and the subject 302 exists further behind the subject 301. The imaging apparatus is focused by the AF operation, and is focused on the main subject 300 closest to the imaging apparatus.

When image blur is added to the through image illustrated in FIG. 4A, the main subject 3 in focus
An image blur is added to a subject area located farther from 00. The amount of blur to be added is larger for the subject 302 than for the subject 301 that has a larger difference (positioned farther) from the shooting distance of the main subject 300. The imaging apparatus of the present embodiment displays a through image with such image blur added on the monitor 13 as shown in FIG.

According to FIG. 4 (b), the boundary portion of the region to which no image blur is added (in this case, the region of the main subject 300) so that the photographer can easily recognize the region to which the image blur has been added / the region to which the image blur has not been added. To highlight. In the present embodiment, the outline of the main subject 300 is displayed with a bold line to indicate emphasis. Further, the added amount of image blur may be increased as the subject is located far away, and the difference in emphasis can be expressed by changing the thickness of the outline of each main subject. FIG. 4B shows an example in which the area where image blur is not added and the area of the main subject (300) are the same, but image blur is not added even if the subject is not in focus. There may be cases. That is, the area where no image blur is added is not necessarily the main subject in focus.

  The monitor display described above is a target to which image blur is added when the imaging range is moved (Yes in step S105) and when some subject is moved (Yes in step S107). The movement of the area is reflected in real time.

  Although an example in which a through image with blurred image is displayed on the monitor 13 has been described, a reproduction corresponding to a main shooting moving image, a main shooting still image, a thumbnail image, a quick view image, or image data recorded on the recording medium 12 The same applies to the case where image blur is added to the image and each is displayed on the monitor 13.

Thus, an image with image blur added includes an area to which no image blur is added (in this case, an area of the main subject 300), and an area to which image blur is added (in this case, an area including the main subjects 301 and 302). Is displayed on the monitor 13 during a photographing operation or in a reproduction mode in which image data is read from the recording medium 12 and a reproduced image is displayed. The image displayed on the monitor 13 is displayed by enlarging an arbitrary area in the entire area image during the photographing operation or the reproduction mode based on the display enlargement operation from the operation member 7 (electronic zoom). Can be configured.

<Electronic zoom>
The electronic zoom operation is performed by zooming from the operation member 7 so as to complement the optical enlargement operation (optical zoom) by the photographing lens 2 in order to change the display magnification when the monitor 13 displays an image. This is performed based on an operation (enlargement / reduction operation) signal. In the electronic zoom operation, since the interpolation process is further performed on the image generated by the interpolation calculation process, the image quality after zoom-up deteriorates as the enlargement magnification increases. The image quality deterioration is observed as, for example, aliasing of the oblique edge portion of the image on the monitor 13. Therefore, a maximum enlargement magnification by electronic zoom is determined in advance so that the degree of image quality deterioration falls within an allowable range.

  In addition, when both image blur addition and electronic zoom operation are performed, the image blur is added after electronic zoom in order to suppress image quality deterioration. In the case where the image blur addition amount is not changed by the enlargement magnification by the electronic zoom, for example, when the continuous enlargement by the electronic zoom is instructed, the image blur addition process at a certain time point is electrically The enlarged image data to which image blur is not added is further electrically expanded, and image blur addition processing is performed. Such processing can be realized by storing image data to which image blur before the enlargement processing is not added at any time when performing electrical enlargement. According to such a configuration, since the high frequency component of the image is suppressed by the image blur addition process, the influence of aliasing is reduced even with the same enlargement magnification (electronic zoom magnification), and the image quality is improved. That is, in this configuration, the image blur addition processing also serves as aliasing reduction processing. As a result, the maximum magnification of the electronic zoom can be set higher in the configuration in which image blur is added after the electronic zoom operation than in the configuration in which image blur is added before the electronic zoom operation.

  For the above reason, the maximum enlargement magnification by electronic zoom may be different between an image with image blur added and an image without image blur.

  Further, the electronic zoom magnification setting range may be changed according to the degree of image blur to be added, such as setting the maximum enlargement magnification of the electronic zoom higher as the degree of image blur to be added is larger.

  On the other hand, when the image data is reduced by the electronic zoom, the above-described problem of image quality degradation due to aliasing does not occur. Therefore, the image blur addition process is performed before or after the reduction process by the electronic zoom. It doesn't matter. The electronic zoom described above can perform the same operation during shooting and during playback for reading out and displaying image data recorded on the recording medium 12.

  On the other hand, it is known that the amount of optical blur varies depending on the focal length of the photographing lens 2. When the photographic lens 2 is a zoom lens, the amount of optical blur varies depending on the zoom level (magnification level). Therefore, not only when the electronic zoom processing is performed following the optical zoom operation by continuous operation of the same operation member, but also when the electronic zoom operation is not accompanied by the optical zoom operation in the playback mode, for example. In addition, if the configuration is such that the amount of blur that is electrically added during electronic zoom processing, which is an electrical enlargement operation, is changed according to the display magnification that is changed each time an instruction to change the enlargement magnification is given, Operation that does not feel uncomfortable for the user.

Hereinafter, a zoom lens (zoom imaging optical system) having different F-numbers at the long focal length end (telephoto end) and the short focal length end (wide angle end) is used as the photographing lens 2 in the zoom state at the long focal length end. Addition of image blur when an electrical enlargement by electronic zoom is instructed will be described. For example, a zoom lens capable of changing the focal length between 8 mm (optical aperture F1.4) to 23 mm (optical aperture F2) is used as the photographic lens 2 to enlarge the photographic image displayed on the monitor 13. Is instructed, the photographic lens 2 is driven to a focal length of 23 mm, which is the long focal length end, and thereafter, an electric enlargement process by electronic zoom (resolution (number of pixels) conversion) is performed. The optical aperture value of the photographic lens 2 changes in a binary manner between F1.4 and F2, for example, in conjunction with the focal length change drive.

When the focal length of the taking lens 2 reaches the long focal length end (predetermined value) and the electronic zoom operation is started, the addition of electrical image blur is automatically started. For example, when the enlarged image by the electronic zoom enlargement instruction is an electrical enlarged image corresponding to a focal length of 38 mm, the aperture is further reduced from the optical aperture F2.8, that is, the optical aperture value at the long focal length end. Blur is added so as to correspond to a virtual aperture value. Of course, in this case, the optical aperture value at the long focal length end (F
An image blur equivalent to 2) may be added.

Conversely, an image blur corresponding to the aperture value changed in the open direction may be added from the optical aperture value (F2) at the long focal length end. The blur amount added in these cases is a virtual focal length of the photographing lens 2 determined from the electric magnification (3 in the above example).
8mm) is taken into consideration. In other words, an increase in the electric magnification means that the virtual focal length is increased, and the blurring amount added thereby is set to be increased.

  Furthermore, when a zoom lens capable of setting an optical aperture value is used as the photographic lens 2, and in the zoom state at the long focal length end, as in the case described above, when electrical enlargement by electronic zoom is instructed. The image blur corresponding to the set optical aperture value may be electrically added. In addition to this, a virtual aperture value exceeding the change range of the above-described optical aperture value is set, and an image blur corresponding to the virtual aperture value is electrically added during an enlargement operation by electronic zoom. It is good also as a structure.

  In the above description, when the focal length of the taking lens 2 reaches the long focal length end and the electronic zoom operation is started, an example in which the addition of electrical image blur is started is described. When the focal length of the photographic lens 2 is largely changed by an instruction to change the display magnification), if the focal length becomes a predetermined value less than the longest focal length that the photographic lens 2 can realize, image blur is automatically added. It is good also as a structure which starts to. According to such a configuration, since the process of adding image blur is automatically started only by an operation for changing the enlargement magnification without particularly instructing the photographer to add image blur, a comfortable operation feeling can be realized. .

(Delayed processing)
As described above, when both image blur addition and electronic zoom-up (display magnification enlargement) operations are performed, when image blur is added after electronic zoom, electronic zoom-up is performed on the original image without image blur. After performing the processing, a two-step processing is required to add image blur to the zoomed-up image. On the other hand, in the case of the electronic zoom down (display magnification reduction) operation, since the electronic zoom down process may be directly performed on the image with the blurred image, the process is performed at the time of the electronic zoom up and the electronic zoom down. There is a difference in time.

  The control circuit 5 delays the electronic zoom-down process so that the time required for the electronic zoom-down operation at the time of shooting is equivalent to the time required for the electronic zoom-up operation. Thereby, the difference in response between the electronic zoom-up and the electronic zoom-down when both the image blur addition and the electronic zoom operation are performed can be suppressed, and the photographer can be prevented from feeling uncomfortable.

  The delay of the electronic zoom-down process can be performed by simply inserting a weight process between time series processes performed by the control circuit 5 or performing an electronic zoom-down process on an original image without adding image blur. A two-stage process of adding image blur to an image after down may be performed.

  The configuration for adding the image blur after the electronic zoom may be performed only on the still image captured in the main photographing. When an electronic enlargement / reduction is instructed for an image displayed on the monitor 13 during live view shooting, an electronic zoom-up or electronic zoom-down process is performed on the image with the image blur added, A still image obtained by full-pressing the release button is displayed on the monitor 13 with image blur added, and when electronic enlargement is instructed, no image blur is added. An image blur is added after an electronic zoom-up process is applied to the original image. In addition, the above delay processing is included at the time of electronic zoom down at the time of actual photographing. When shooting through images, image quality degradation due to aliasing is unlikely to be a problem, so priority is given to responses during enlargement / reduction operations. On the other hand, the still image captured in the main shooting is subjected to blur addition processing after the electronic zoom (after the resolution conversion) to give priority to maintaining the image quality of the main shooting image.

<Defocusing amount change operation member>
The blur amount changing operation member constituting the operation member 7 will be described. It is desirable to change the LPF characteristic (or point spread function) for changing the image blur addition amount in real time without delay in accordance with the frame rate of the moving image (through image). For this reason, the blur amount changing operation member does not determine the output value (that is, the amount of blur to be added) according to the operation time, but is preferably an operation member that outputs a different value according to the operation amount.

1. Defocus amount change operation during shooting Since it is assumed that an optical zoom operation is performed during shooting, it is preferable to provide a blur amount change operation member separately from the zoom operation member.
(1-1) FIG. 5 is a perspective view illustrating an example of a camera that constitutes the blur amount changing operation member 51 by a pressing operation member. In FIG. 5, a blur amount changing operation member 51 is disposed on the upper portion of the monitor 13 configured to be rotatable with respect to the camera housing. An operation member [increase] that emits three or more kinds of operation signals that differ according to the pressing amount (operation amount) as an operation signal for increasing the amount of blur, and an operation signal that varies according to the pressing amount The operation member [decreasing] that is issued as an operation signal for reducing the amount of blur makes a pair. Unlike the case where the operation members are shared by disposing the blur amount change operation members 51 [increase] and [decrease] separately from the zoom operation members 54 [T] and [W], the blur amount change operation is performed while performing the zoom operation. Can be done. Further, since the pressing operation member is used, it is possible to suppress the swing of the imaging device that occurs during the operation as compared with the rotation operation member.

(1-2) FIG. 6 is a perspective view for explaining another example of a camera that configures the blur amount changing operation member 51 by a pressing operation member that outputs the same operation signal as in the example of FIG. In FIG. 6, a pair of blur amount changing operation members 51 [decrease] and [increase] are disposed in the vicinity of the pair of zoom operation members 54 [T] and [W].

(1-3) FIG. 7 is a perspective view for explaining an example of a camera that constitutes the blur amount changing operation member and the zoom operation member by the jog dial 52. In FIG. 7, the jog dial 52 issues a zoom operation signal (the rotation direction indicates zoom up or zoom down and the rotation amount indicates the zoom operation amount) according to the rotation operation, and increases or decreases the blur amount according to the pressing amount. An operation signal is issued to The jog dial 52 is urged in the rear direction of the camera of FIG. 7 by a spring member (not shown). When the jog dial 52 is pushed in, a signal for increasing the amount of blur (an operation signal having three or more different sizes depending on the pressing amount). ) And a signal to reduce the amount of blur when a jog dial is pulled out. When the photographer operates the jog dial 52 to obtain a desired amount of blur, the photographer operates a decision button provided separately to determine the amount of blur to be added. By making the zoom operation direction different from the blur amount changing operation direction, the operation member (jog dial 52) can be shared by two systems of operation.

(1-4) FIG. 8 is a perspective view illustrating an example of a camera that forms a blur amount changing operation member by the virtual diaphragm ring 53. In FIG. 8, a virtual diaphragm ring 53 that is rotatable about an axis parallel to the optical axis of the photographic lens 2 is disposed in the lens barrel of the photographic lens 2. In the virtual aperture ring 53, an index indicating the rotation angle is displayed for each predetermined virtual aperture level (for example, every aperture level or every 1/2 level) together with the virtual aperture value display (for example, F1, F2.8, etc.). It is provided and has a structure that produces a click feeling at each aperture position. For example, when the virtual aperture ring 53 is rotated by two stages in the direction in which the virtual aperture value is opened, image blur corresponding to the case where the optical diaphragm is opened by two stages is added. When the virtual diaphragm ring 53 is rotated, an operation signal for increasing or decreasing the amount of blur according to the rotation angle (virtual diaphragm stage number) is generated. By disposing the virtual diaphragm ring 53 separately from the pair of zoom operation members 54 [T] and [W] disposed at the upper part of the housing, it is possible to change the blur amount with the left hand while performing the zoom operation with the right hand. is there.

(1-5) FIG. 9 is a perspective view illustrating an example of a camera that configures the blur amount changing operation member 51 by a pressing operation member that outputs the same operation signal as in the example of FIG. In FIG. 9, a pair of blur amount changing operation members 51 [decrease] and [increase] are arranged on the left side surface of the camera casing. The point that each generates an operation signal for increasing or decreasing the blur amount according to the amount of pressing is the same as in the case of FIGS. A pair of zoom operation members 54 [T] and [W] are disposed on the upper right surface of the camera casing. According to the configuration of FIG. 9, the blur amount changing operation can be performed with the left hand while performing the zoom operation with the right hand.

(1-6) FIG. 10 is a diagram showing a modification of FIG. In FIG. 9, a pair of blur amount changing operation members 51 [decrease] and [increase] are arranged on the left side surface of the camera casing, and a pair of zoom operation members 54 [T] and [ W] is arranged. Even in the configuration of FIG. 10, the zoom operation with the right hand and the blur amount changing operation with the left hand can be performed simultaneously.

(1-7) FIG. 11 is a diagram for explaining an example of a camera in which an operation blur amount changing operation member 51A and a zoom operation member 54A, which are slide members that output operation signals similar to those in the example of FIG. It is. The blur amount changing operation member 51A is configured to generate an operation signal (an operation signal having three or more different sizes) for increasing or decreasing the blur amount in accordance with the slide amount (direction). The zoom operation member 54A is configured to issue an operation signal for zooming up / down according to the slide amount (direction). By making both operation members close to each other and aligning the operation direction, it is possible to simultaneously perform a zoom operation and a blur amount change operation using different fingers. In the example of FIGS. 5 to 11 described above, the case has been described in which an operation member that generates operation signals of three or more different sizes depending on the operation amount is used as the operation member that changes the amount of blurring. With such a configuration, the amount of blur added to an image can be changed well with time, and is particularly suitable when adding image blur to a moving image and a through image. Of course, instead of this, a member that emits a binary output signal may be employed as the operation member, and the amount of blur added to the image may be changed according to the operation time. For example, if the operation member for instructing zoom-up / zoom-down is combined with the blur amount changing operation member, the number of operation members can be reduced and the apparatus can be downsized. For example, it can be configured to function as an operation member for instructing zoom-up / zoom-down when shooting a through image and a moving image, and to function as a blur amount changing operation member in the playback mode. Further, a configuration using a quadruple switch 55 described later may be used. The quadruple switch 55 in this case functions as a blur amount changing operation member during shooting, and does not function as an operation member for menu selection.

2. Blur amount change operation during playback During playback (when recorded images are played back with the addition of electrical image blur enabled), it is possible to change the blur amount and perform electronic zoom operations. Zoom operation is not performed. The control circuit 5 reads the image data recorded on the recording medium 12, performs a decoding process on the read data, and sends the decoded data to the data processing circuit 10. The control circuit 5 performs a main subject extraction process from the decoded data (similar to step S103), and instructs the data processing circuit 10 to perform an image blur addition process on a region other than the extracted main subject (that is, the background region). (Similar to step S104). The control circuit 105 further changes the blur amount when the blur amount changing operation is performed (similar to steps S109 and S110).

(2-1) When the camera illustrated in FIGS. 5 and 6 and FIGS. 9 to 11 is played back, the blur amount changing operation member 51 (51A in FIG. 11) [increase] and [decrease] is pressed. And an operation signal for increasing or decreasing the amount of blur.

(2-2) At the time of reproduction of the camera illustrated in FIG. 7, an operation signal for increasing or decreasing the amount of blur is generated by rotating the jog dial 52. In other words, the operation of the jog dial 52 for changing the blur amount is different from that at the time of shooting so that the rotation direction corresponds to the increase / decrease of the blur amount and the rotation amount corresponds to the increase / decrease amount. Is limited.

(2-3) In the case of the camera illustrated in FIGS. 5 to 7, a quadruple switch (SW) 55 provided as an operation member for menu selection may be used as a blur amount changing operation member during reproduction.

(2-4) At the time of playback of the camera illustrated in FIG. 8, the amount of image blur added to the playback image may be changed based on the operation of the virtual aperture ring 53. In this case, the virtual aperture ring 53 may be an operation member that actually changes the aperture value of the optical aperture. An operation signal output from the operation member is input to the control circuit 5, and under the control of the control circuit 5, the amount of image blur added to the reproduced image is changed. It goes without saying that even if the optical aperture is driven and the optical aperture value is changed by the operation of the operating member, the reproduced image is not affected at all. From the viewpoint of power consumption, when this operating member is operated in the playback mode, it is preferable to change the amount of image blur added to the playback image without driving the optical aperture.

(2-5) In addition, image blur is not added at the time of through image shooting, and the still image that is actually shot is recorded on the recording medium 12 before or after being recorded and then displayed on the monitor 13 to add image blur. In such a case, the zoom operation and the image blur addition / change operation are not necessarily performed simultaneously. Accordingly, the operation members 51, 52, 53, 51A for changing the blur amount in FIGS.
Is not always necessary, and the operation member used for other purposes such as the zoom operation member 54 can also be used. For example, if the switch [T] of the zoom operation member 54 is pressed while the still image that has been actually captured is displayed on the monitor 13, the amount of image blur increases according to the operation time, and the switch [W] is pressed. Then, the amount of image blur is reduced according to the operation time. Further, when the switch [T] and the switch [W] are pressed simultaneously, the image blur added on the monitor 13 can be reset (the image blur is not added). Such an operation may be performed by the quadruple switch 55. If the amount of image blur to be added is changed using the quad switch 55, the image on the monitor 13 can be electrically enlarged by operating the zoom operation member 54 and the like, and image blur is added. However, it is possible to perform image confirmation over details.

Along with the blur amount changing operation as described above, the virtual aperture value may be superimposed and displayed on the monitor 13 together with the image. The virtual aperture value is an optical aperture value that gives an optical blur equivalent to the amount of image blur to be added. The virtual aperture value may be calculated, for example, as a function of data indicating an LPF characteristic (or a point spread function) that determines the image blur addition amount, and may be read from the lookup table using the image blur addition amount as an argument. You may make a table in advance. By displaying the virtual aperture value calculated in this way, the photographer can intuitively grasp the amount of image blur to be added.

  When the virtual aperture value is displayed on the monitor 13, when the actual optical aperture value of the photographing lens 2 is displayed on the monitor 13, the optical aperture value and the virtual aperture value are displayed in different modes (for example, different display colors). This is even more preferable. By displaying the images in different modes, the photographer can easily identify both.

  When an electronic zoom operation is performed in the playback mode for image editing work such as trimming, a part of the playback image is displayed on the display screen of the monitor 13. In this case, the main subject focused at the time of shooting may not be included in the electronic zoom range being displayed. In this case, a region that maximizes the integrated value (so-called focus evaluation value) of high-frequency components for the image signal corresponding to the display range of the monitor 13 is extracted, and this region is regarded as the main subject on the zoom screen. The area including the maximum focus evaluation value is an area that is considered to be in focus most in the electronic zoom screen being displayed (the sharpness of the image is high). With such a configuration, even if the focus detection area in the automatic focusing operation at the time of shooting is not included in the range that the monitor 13 intends to display in an enlarged manner, an area that does not add image blur is appropriate. Can be judged. When the focus detection area used for the automatic focusing operation is in the range to be enlarged and displayed by the monitor 13, an image blur may be added to an area other than this area on the basis of this area. In this case, the above-described calculation process of the integrated value of the high frequency components is not performed. The control circuit 5 instructs the data processing circuit 10 to add an image blur to a region other than the extracted region (that is, the background region) with reference to the extracted region (similar to step S104). The control circuit 5 further changes the blur amount when the blur amount changing operation is performed (similar to steps S109 and S110).

  If the region including the maximum focus evaluation value cannot be extracted from the image signal corresponding to the display range of the monitor 13, or if the instruction is made to use the center of the electronic zoom screen as a reference, the display is in progress. The center of the electronic zoom screen is regarded as the in-focus area. The control circuit 5 instructs the data processing circuit 10 to add an image blur to an area other than the center with reference to the center. With such a configuration, image blur is added to an area other than the center of the screen where there is a high possibility that the subject of interest is present, and thus the possibility of image blur being added to an incorrect place is reduced. To do.

According to the embodiment described above, the following effects can be obtained.
(1) An imaging device (an image reproduction device or an image processing device) calculates an integrated value of high-frequency components of an image signal to detect a region where the sharpness of the image is high, and is different from the detection region in the image signal. Since the image blur is added to the signal corresponding to the area, it is possible to appropriately extract the area where the image blur should be added (the background area different from the in-focus area) and add the blur.

(2) The imaging device (image reproduction device) of (1) corresponds to the display range of the monitor 13 when performing resolution conversion in the direction of increasing the electronic zoom magnification and displaying a part of the reproduction image on the monitor 13 in an enlarged manner. Since a region with high image sharpness is detected from the image signal to be processed, a region to be blurred (background region different from the focused region) in the display range is appropriately extracted and blurred. Can be added. The electronic zoom operation described above is not limited to the one that is performed continuously, but includes a case where the zoom operation is performed only once, such as an enlargement operation after trimming.

(3) When the imaging device (image reproduction device) of (1) performs resolution conversion in a direction to increase the electronic zoom magnification and enlarges and displays a part of the reproduction image on the monitor 13, the center of the display range of the monitor 13 Since the area corresponding to the portion is detected, it is possible to add blur to the center of the display range when there is no focused area in the display range.

(4) If the size of the image blur to be added is changed according to the resolution conversion ratio (electronic zoom magnification), the same operation as the optical blur added in the conventional optical zoom operation is realized. it can. In particular, even when the electronic zoom operation is performed following the optical zoom operation, an image without a sense of incongruity can be obtained.

(5) When both image blur addition and resolution conversion (electronic zoom) are performed and resolution conversion is performed at least in the direction of increasing the electronic zoom magnification, image blur is added after resolution conversion. As a result, image quality deterioration is suppressed, and the maximum enlargement magnification of the electronic zoom can be set higher than in a configuration in which image blur is added before resolution conversion.

(6) Since the operation signal for increasing / decreasing the blur amount is generated from the operation blur amount changing operation member 53 which is a dial member, the blur size can be changed by a simple operation maintaining the conventional operability. .

(7) If the virtual aperture value (the optical aperture value that gives an optical blur equivalent to the added image blur amount) is displayed on the monitor 13 together with the image, the photographer can set the added image blur amount. It can be grasped intuitively. At this time, it is even more preferable to display a virtual focal length corresponding to the electronic zoom magnification.

(Modification 1)
In addition to changing the added amount of image blur according to the operation of the blur amount changing operation member, the image blur amount set in the default state is set according to the distance (shooting distance) information between the subject and the imaging device. It is good also as a structure to change. As the distance information, distance information acquired during the AF operation is used. The control circuit 5 considers that the distance between the moving subject and the stationary background has increased when the shooting distance between the moving subject and the imaging apparatus becomes shorter than a certain point. When performing an AF operation on a moving subject, the focus adjustment state for the moving subject does not change because the operation of focusing on the moving subject is continuously performed. In this case, the control circuit 5 performs control so that the amount of blur added to the background area is increased compared to the certain time point.

  On the other hand, when the shooting distance between the moving subject and the imaging device becomes longer than a certain point, the control circuit 5 considers that the distance between the moving subject and the stationary background is reduced. The control circuit 5 controls the amount of blur added to the background area to be smaller than the certain time point.

  In the first modification, the example in which the image blur amount is changed according to the distance between the moving subject and the background has been described. However, distance information is acquired for each of the plurality of moving subjects, and the distance between the plurality of moving subjects is determined. The amount of blur added to each subject area may be dynamically changed. As the distance information for a plurality of moving subjects, for example, distance information to a subject existing in each of the plurality of focus detection regions may be acquired.

(Modification 2)
In the above description, when the half-press operation is canceled after adding the image blur (determination is negative in step S111), the addition of the image blur is canceled, but the optical aperture of the taking lens 2 is changed. Alternatively, it may be configured to cancel the addition of image blur. The optical diaphragm is changed by, for example, a diaphragm ring (not shown) or an operation signal from the operation member 7. In response to such an instruction to change the optical aperture, the control circuit 5 temporarily cancels the image blur added at the present time. As a result, both optical blur and electrically added image blur can be quickly reset.

(Modification 3)
In the description of step S105, it is determined whether or not there is a motion on the shooting screen by detecting a motion vector between frames. Instead, any one of motion sensors such as an angular velocity sensor, an angular acceleration sensor, and an acceleration sensor may be provided in the imaging apparatus, and a determination may be made using a detection result of the sensor.

(Modification 4)
As described above, when both the determinations in step S105 and step S107 are performed using motion vectors, the determination process in step S105 and the determination process in step S107 may be performed in parallel.

(Modification 5)
In the case of an imaging apparatus that is set to display a through image on the monitor 13 without adding image blur and is set to add image blur only to a main captured image obtained by main shooting, Instead of the contents described in step S113, the exposure for the main photographing may be determined as follows. That is, the exposure for the main photographing is calculated based on the signal value (brightness information) of the latest through image data to which no image blur is added, and this calculated value is used as the amount of image blur added to the main photographed image. The exposure is corrected accordingly, and the exposure for the main photographing is determined based on the calculated value after the correction. Based on the determined exposure, the imaging device sets an electronic shutter speed (charge accumulation time) of the imaging device 1, a diaphragm, an amplification degree of an image signal output from the imaging device 1, and performs an imaging operation. As a result, for example, when a spot photometry area includes a bright spot, and image blur is added to the bright spot, the image blur area becomes larger than the photometry area. Even when the determination of the brightness of the image changes, a real captured image with appropriate brightness can be obtained.

(Modification 6)
In the process of determining permission / prohibition of image blur addition (and change of the added content), for example, when there is no area having a brightness of a predetermined level or more in the background area of the image even in the night view portrait mode. The example of prohibiting the addition of image blur (and the change of the added content) has been described, but it may be as follows. In other words, when displaying a through image or an actual captured image on the monitor 13, prohibiting the addition of image blur is set as a default setting, and an operation signal instructing the addition of image blur is input to the control circuit 5 from the operation member 7. Only when the image is blurred. Of course, in a state where the addition of image blur is permitted, the data added with the image blur can be recorded on the recording medium 12.

(Modification 7)
Whether or not a human face is recognized in the through image, instead of the process for determining whether to allow or prohibit the addition of image blur (and change of the added content) according to the setting state of the shooting mode such as the portrait mode The permission / prohibition of the addition of image blur (and the change of the added content) may be determined according to. In this case, the control circuit 5 performs a known face recognition process using a through image that is captured after the above-described AF operation and has no image blur, and extracts a face area. The control circuit 5 sets the subject including the extracted face area as the main subject. Only the image in which the human face is recognized may be configured to allow image blurring by the control circuit 5. With such a configuration, it is possible to automatically perform portrait photography when a human face is recognized. Further, the image blur may be added when the conditions of the number of human faces (for example, two or less) and the size (a predetermined value or more) are satisfied.

  Note that even when it is set to add image blur (and change of the added content) only to the actual captured image (not added to the through image), the through image without the image blur is used. It may be configured to perform face recognition processing and permit addition of image blur (and change of the added content) to the actual captured image when a face area is recognized. With such a configuration, subject recognition processing can be performed accurately and quickly.

(Modification 8)
Instead of setting the aperture priority auto mode when addition of image blur is permitted (step S102), the optical aperture of the taking lens 2 may be set to a predetermined aperture value (for example, an open value). Since the optical blur caused by the optical aperture is maintained in a predetermined state, it is possible to prevent the blur amount of the main image (the sum of the optical blur and the added image blur) from fluctuating as the subject luminance varies. This facilitates an operation for changing the setting of the image blur addition amount. In addition, by setting the optical aperture to a predetermined aperture value, the charge of the image sensor 1 is real-time according to the number of stages of the optical aperture change so that the brightness of the through image displayed on the monitor 13 does not change before and after the setting. It is preferable to vary the accumulation time (or the amplification factor of the signal output from the image sensor 1).

  When the predetermined aperture value is fixed to the open value, the depth of field becomes shallow, and the confirmation and designation operation of the area to which the image blur is added becomes easy.

(Modification 9)
Although the image blur is added to the background area of the main subject extracted from the through image, the image blur is added to the area indicated by the operation signal of the operation member 7 (for example, a signal indicating the cursor position). It may be configured to do. An image blur is added to the subject indicated by the cursor, and a shooting effect that enhances the main subject is obtained.

(Modification 10)
In the above description, when the release button is pressed halfway (Yes in step S101), image blur is added to the image displayed on the monitor 13, but the operation member 7 (for example, a view switch) is used. You may comprise so that the monitor 13 may display the image which added the image blur when operated. When displaying an image to which image blur is added according to the operation of the view switch on the monitor 13, it is preferable to display the same imaging screen (through image) continuously while the operation signal from the view switch continues. It is. The photographer can check the display screen (freeze screen) slowly. In addition, as a result, only when the photographer wants to check the image blur, the image blur is added, so the signal processing load is small. In addition, the same usability as a conventional single-lens reflex camera can be realized.

  When the display on the monitor 13 is off, the operation signal from the view switch is invalidated. In this case, the addition of image blur to the through image is omitted as in the case where addition of image blur (and change of the added content) is set to be performed only on the actual captured image.

(Modification 11)
Contrary to the modification 10, the monitor 13 may be turned on (activated) when an operation signal is input from the view switch while the display of the monitor 13 is turned off. In this case, the monitor 13 is activated in accordance with the operation of the view switch, and an image with image blur is displayed on the monitor 13. While the operation signal from the view switch continues, it is preferable to display the same through image as a still image.

(Modification 12)
Although an example in which addition of image blur (and change of addition contents) is permitted when the shooting mode at the time of shooting is set to portrait mode and macro mode has been described, the following configuration may be used. That is, when the operation menu mode when the portrait mode and the macro mode are set includes a menu item related to “image blur”, and the menu item is instructed to “add” “image blur”. Allows adding image blur (and changing the added content). On the other hand, even if the shooting mode is portrait mode or macro mode, if the menu item is instructed not to add “image blur”, it is prohibited to add image blur (and change the added content). To do. Even in the portrait mode or the macro mode, an imaging apparatus that can fulfill the photographer's desire to decide whether or not to add image blur can be obtained. On the other hand, even if the setting to allow / do not allow image blur is higher than the shooting mode setting (prioritized setting) and the shooting mode is not portrait mode or macro mode, If the setting is to permit the addition of blur, the configuration may be made to allow the addition of image blur.

(Modification 13)
When changing the amount of image blur to be added, the image blur amount to be added is changed (determined) according to the pressing amount (or rotation amount) of the blur amount changing operation member. The image blur amount to be added may be changed according to the virtual aperture value indicated by the operation signal. In this case, the control circuit 5 superimposes the virtual aperture value corresponding to the operation signal from the blur amount changing operation member on the monitor 13 together with the image, and performs data processing so as to add the image blur corresponding to the virtual aperture value. An instruction is sent to the circuit 10. The virtual aperture value is an optical aperture value that gives an optical blur equivalent to the image blur amount added to the current image. By configuring the blur amount changing operation as a virtual aperture value (for example, F11 → F5.6) changing operation, the photographer intuitively grasps the amount of image blur added to the current image. be able to.

(Modification 14)
When changing the amount of image blur to be added, the image blur amount to be added may be changed (determined) according to the number of virtual aperture stages indicated by the operation signal from the blur amount changing operation member. In this case, the control circuit 5 superimposes the virtual diaphragm step number corresponding to the operation signal from the blur amount changing operation member on the monitor 13 together with the image, and performs data processing so as to add the image blur corresponding to the virtual diaphragm step number. An instruction is sent to the circuit 10. The number of virtual aperture steps is the number of optical aperture steps that gives an optical blur equivalent to the amount of image blur added to the current image. By configuring the blur amount changing operation as a virtual aperture step (for example, -2 step) changing operation, the photographer can intuitively grasp the amount of image blur added to the current image. it can.

(Modification 15)
In both cases of adding image blur and electronic zoom operation, the point to add image blur after electronic zoom to suppress image quality degradation, and the maximum enlargement magnification of electronic zoom as the degree (amount) of added image blur increases However, the degree (amount) of image blur to be added may be changed according to the electronic zoom magnification. When the electronic zoom magnification is small, the amount of added image blur is kept small. Usually, the longer the focal length of the taking lens 2 (the larger the magnification), the greater the amount of optical blur. According to said structure, the image similar to this operation | movement can be obtained also by electronic zoom operation | movement.

On the contrary, when the electronic zoom magnification is large, the image blur addition amount is increased, but when the enlargement magnification by the electronic zoom processing on the image before the electronic zoom is a predetermined magnification (for example, 3 times) or more, addition of the image blur is omitted. (Addition amount is set to 0). Thereby, it is possible to stop adding unnecessary image blur to an image whose image quality has deteriorated at a high electronic zoom magnification. Such a configuration can be similarly applied to an apparatus that performs electronic zoom processing after adding image blur.

(Modification 16)
When the imaging apparatus is set to perform AE bracketing shooting that obtains a plurality of image data at each exposure value by gradually changing the exposure conditions during actual shooting, the aperture value of the shooting lens 2 is changed. A plurality of image data may be obtained by changing the exposure condition. In this case, the control circuit 5 determines the amount of image blur to be added to each image so that the blur amount of the still image (the sum of optical blur and added image blur) between the plurality of images becomes substantially constant. Make them different. Thus, when normal AE bracketing is performed with the optical aperture value changed, the brightness and subject depth (blurred state) differ between the images, but in the modified example 16, only the brightness differs between the images. Thus, an image with the same depth of field can be obtained.

(Modification 17)
It may be configured to perform an image blur bracketing shooting in which a plurality of image data is obtained with each additional amount by changing the additional amount of image blur at the time of main photographing stepwise. The control circuit 5 varies the added amount of image blur step by step between a plurality of images. Thereby, it is possible to obtain images having different subject depths between the respective images without changing the exposure conditions during the main photographing.

(Modification 18)
Instead of setting the aperture priority auto mode when image blur addition is permitted (step S102) or setting the optical aperture of the photographic lens 2 to a predetermined value (modified example 8), the imaging apparatus determines. The size of the image blur to be added may be determined according to the control aperture value. In the imaging apparatus in this case, the exposure mode is set to the program auto mode or the shutter speed priority auto mode. The program auto mode is an exposure mode in which a combination of a control aperture value and a control shutter time (charge accumulation time) is determined according to brightness information. At this time, the amplification degree of the image signal may be further changed. A combination of the control aperture value and the control shutter time (charge accumulation time) is stored in the control circuit 5 in advance as program diagram data. The shutter speed priority auto mode is an exposure mode in which a control aperture value and the like are determined according to brightness information so that proper exposure can be obtained at a set shutter time (charge accumulation time).

  When the exposure mode is the program auto mode or the shutter speed priority auto mode, the optical aperture value of the taking lens 2 at the time of shooting is controlled to the control aperture value, so that the optical aperture value is set according to the detected brightness information of the subject. The size of the resulting optical blur is different. Specifically, the optical blur increases when the control aperture value approaches the open value, and the optical blur decreases when the control aperture value is reduced. Therefore, if the configuration is such that the size of the image blur to be added is determined according to the control aperture value so as to cancel such a fluctuation in the size of the optical blur, the blur amount of the main image (optical blur is added). The sum of the blurred images) can be kept constant.

<Modified example 1 of monitor display>
Another display mode for displaying an image on the monitor 13 will be described with reference to FIG. According to FIG. 4 (c), an area where image blur is not added (in this case, the area of the main subject 300) is another area so that the photographer can easily visually recognize the area where the image blur is added / the area where the image blur is not added. Display brighter than the area. In FIG. 4C, the difference in brightness is represented by changing the thickness of the contour line of each main subject. The thicker the line, the brighter the brightness is displayed. That is, the main subject 300 is displayed brightest, and the subject 301 and the subject 302 are displayed in the order of the subject 301 and the subject 302 darker as the amount of added image blur (the magnitude of the blur effect) increases. By displaying the subject with the brightness changed in this way, the photographer can easily visually recognize the region where the image blur is added / the region where the image blur is not added, and intuitively determine the image blur amount added based on the brightness of the display. Can be grasped. Note that the subject may be displayed brighter as the amount of added image blur increases.

<Modified example 2 of monitor display>
When an image with added image blur is displayed on the monitor 13, a difference in the added amount of image blur may be represented by coloring. In this case, the control circuit 5 normally displays a monochrome image on the monitor 13, and when displaying an image with an image blur, the control circuit 5 displays the image blur-added region with a color. At this time, the greater the amount of added image blur (the magnitude of the blur effect), the darker the subject is displayed. Thus, by displaying the subject with different shades of color, the photographer can easily visually recognize the areas where the image blur has been added / the areas where the blur has not been added, and intuitively understand the amount of image blur added based on the shade of the color. Can be grasped.

<Modified example 3 of monitor display>
In addition, in order to improve the photographer's visibility in the region where the image blur is added, the display image on the monitor 13 may be displayed with the added amount of the image blur larger than the actual amount. Further, when the size of the monitor 13 is limited due to the downsizing of the image pickup device, the additional area of the image blur may be expanded and highlighted so that the photographer can easily see even from a small screen. . When the screen of the monitor 13 is small or the number of display pixels on the monitor 13 is small, the added amount of the image blur and the added region are highlighted so that the photographer can easily understand the region where the image blur is added / the region where the image blur is not added. Can be displayed.

  The display modes according to the first to third modifications of the monitor display described above may be configured to be switchable between normal display modes (display modes described in the embodiment) in accordance with an operation signal from the operation member 7. Good. For example, if the highlighting switch (not shown) is configured to display only in the above-described manner, the blur added area can be confirmed immediately when the photographer needs it, which is even more preferable. It is.

  In the above description, an example in which image blur is added to a background area different from the main subject has been described. In addition, an image blur may be added to an area on the imaging screen including an image due to dust (foreign matter) or scratches attached to the imaging optical system such as the imaging lens 2 or the imaging surface of the imaging element 1. Good.

  The amount of image blur added to the area on the imaging screen including the image due to dust (foreign matter) or scratches is changed according to the contrast between the area including the image due to dust (foreign matter) or scratches and the background area. When the contrast is large, the additional amount is increased, and when the contrast is small, the additional amount is decreased. By adopting such a configuration, it is possible to prevent image blur that is more than necessary from being added to a dust (foreign matter) adhering region and the like and to prevent loss of image information that is originally required.

The imaging apparatus has an operation mode for detecting dust (foreign matter) and scratches attached to the imaging surface and the imaging optical system from an image signal output from the imaging element 1, and when the operation mode is set, Then, an image corresponding to an image signal (data) without image blur is displayed on the monitor 13. In this operation mode, addition of image blur may be prohibited. The photographer can take an image of, for example, white paper and check a dust or scratch image based on the image displayed on the monitor 13. In this state, the data processing circuit 10 can analyze the image data to obtain information about the size of dust, scratch images, and the position on the screen. In this way, based on the image signal (data) without image blurring, dust (
By adopting a configuration that detects foreign matter) and scratches, more accurate detection can be performed.

In addition, the image pickup apparatus has an operation mode for automatically detecting dust (foreign matter) and scratches attached to the image pickup surface of the image sensor 1, and when the operation mode is set, the dust (foreign matter) is included. Dust (foreign matter) and scratches may be detected using an image signal (data) corresponding to an area on the imaging surface and before the image blur is added.

  In the above embodiment, the imaging apparatus has been described as an example. However, the present invention can also be applied to an image reproduction apparatus that displays a reproduction image based on recorded image data on the monitor 13 or an image processing apparatus. In this case, in place of the image signal from the image sensor 1, resolution conversion or image blur is added to the image data read from a memory card or a hard disk device.

  The above description is merely an example, and the interpretation of the invention is not limited to the correspondence between the components of the above-described embodiment and the components of the present invention.

DESCRIPTION OF SYMBOLS 1 ... Imaging device 2 ... Shooting lens 5 ... Control circuit 7 ... Operation member 9 ... Signal processing circuit 10 ... Data processing circuit 11 ... Compression / decompression circuit 12 ... Recording medium 13 ... Monitor 14 ... Display control circuit

An image processing apparatus according to the present invention includes a blur adding unit that processes an image signal to add blur to a predetermined area of the image, a display unit that displays an image with the blur added thereto, and a resolution conversion process performed on the image signal. Resolution conversion means that performs electrical display magnification change processing, and an image signal that has not been blurred by the blur addition means when both blur addition and display magnification expansion are performed on the image signal And a control means for controlling each of the blur adding means and the resolution converting means so as to add the blur after performing the resolution conversion processing for enlargement.

Claims (16)

A recording means for recording an image signal;
A blur adding unit that processes the image signal read from the recording unit and adds a blur to a predetermined area of the image;
Display means for displaying the reproduced image read from the recording means and added with the blur;
In the display screen of the display device, extraction means for extracting a region containing the most high frequency spatial frequency component as a reference region;
An operation member for changing an electrical enlargement display magnification of the reproduced image displayed on the display screen of the display means;
Corresponding to the next display area to be displayed next on the display screen of the display means when the operation member is operated and an instruction to electrically enlarge the reproduction image displayed on the display screen of the display means is given. The extraction means is controlled so as to extract the reference area from the image signal, and the blur is added to the area excluding the reference area in the image signal corresponding to the next display area. An image processing apparatus comprising: control means for controlling the blur adding means. The image processing apparatus according to claim 1.
The control means, when extracting the reference area from the image signal corresponding to the next display area, automatic focusing operation at the time of shooting the image in the image signal corresponding to the next display area When there is a focus detection area used at the time, the image processing apparatus controls the extraction means so that the focus detection area is the reference area. A recording means for recording an image signal;
A blur adding unit that processes the image signal read from the recording unit and adds a blur to a predetermined area of the image;
Display means for displaying the reproduced image read from the recording means and added with the blur;
In the display screen of the display device, extraction means for extracting a reference region;
An operation member for changing an electrical enlargement display magnification of the reproduced image displayed on the display screen of the display means;
Corresponding to the next display area to be displayed next on the display screen of the display means when the operation member is operated and an instruction to electrically enlarge the reproduction image displayed on the display screen of the display means is given. The extraction means is controlled so as to extract the reference area from the image signal, and the blur is added to the area excluding the reference area in the image signal corresponding to the next display area. An image processing apparatus comprising: control means for controlling the blur adding means. The image processing apparatus according to claim 1 or 3,
An image processing apparatus comprising: a rotation operation member that changes an amount of the blur added to a reproduced image displayed on the display unit. The image processing apparatus according to claim 1 or 3,
The control means changes the amount of blur added by the blur adding means every time the operation member instructs to change the electrical enlargement display magnification of the reproduction signal. . An image sensor that captures a subject image and outputs an image signal;
Blur adding means for processing the image signal and adding blur to a predetermined area of the image;
Display means for displaying an image corresponding to the blurred image signal in parallel with an imaging operation by the imaging device;
Resolution conversion means for performing resolution conversion on the image signal when an instruction to enlarge the image displayed by the display means is given during the imaging operation;
Control means for controlling the blur adding means to process the image signal whose resolution has been converted by the resolution converting means and add the blur when the enlargement instruction is given during the imaging operation. An image processing apparatus. The image processing apparatus according to claim 6.
When the reduction display of the image displayed by the display unit is instructed during the imaging operation, the control unit performs the resolution on the image signal to which the blur is added by the blur addition unit. An image processing apparatus, wherein the conversion means controls to perform resolution conversion for reduction. An image sensor that captures a subject image and outputs an image signal;
Display means for displaying an image based on the image signal;
Blur addition means for adding blur to a predetermined area of an image displayed on the display means;
Instruction means for instructing electrical enlargement of an image displayed on the display means;
In accordance with an instruction from the instruction unit, resolution conversion unit that performs resolution conversion on the image signal and performs electrical enlargement processing of an image corresponding to the image signal;
When an enlargement instruction is given by the instruction means to an image that is captured by the image sensor and displayed on the display means before the photographing instruction, the image that has been blurred by the blur addition means And controlling the display to be displayed on the display unit by performing an electrical enlargement process by the resolution conversion unit, and displaying the image obtained by adding the blur to the image shot after the shooting instruction on the display unit. When the enlargement instruction is given by the instructing unit, the blurring process is performed after an electrical enlargement process is performed on the image signal before the blurring is added by the resolution conversion unit. An image processing apparatus comprising: a control unit configured to control the display unit to display an image blurred by the addition unit. A recording means for recording an image signal;
Display means for displaying an image corresponding to the image signal read from the recording means;
Blur addition means for adding blur to a predetermined area of an image displayed on the display means;
Instruction means for instructing electrical enlargement of an image displayed on the display means;
In accordance with an instruction from the instruction unit, a resolution conversion unit that performs a resolution conversion process on the recorded image signal to perform an electrical enlargement process;
When the instruction means instructs to continuously enlarge the image displayed on the display means, the resolution conversion process is performed on the recorded image signal before the blur is added by the blur addition means. An image processing apparatus comprising: control means for controlling an image to be displayed on the display means. An image sensor that captures a subject image and outputs an image signal;
Blur adding means for processing the image signal and adding blur to a predetermined area of the image;
Display means for displaying an image corresponding to the blurred image signal in parallel with an imaging operation by the imaging device;
Resolution conversion means for performing resolution conversion on a signal based on the image signal when an instruction to change the display magnification of the image displayed by the display means is given during the imaging operation;
And a control unit that controls the blur adding unit to change the amount of blur added according to the changed display magnification when the change instruction is given during the imaging operation. An image processing apparatus. The image processing apparatus according to claim 10.
It further includes a zoom photographing optical system with different optical aperture amounts at the short focal end and the long focal end,
The blur adding means corresponds to an aperture value that is further reduced than the optical aperture value at the long focal end when the zoom photographing optical system is in the long focal end state and when an instruction to change the display magnification is given. An image processing apparatus, wherein the blur is added to a predetermined area of the image so as to be a blurred image. An image sensor that captures a subject image via a zoom photographing optical system and outputs an image signal;
Blur adding means for processing the image signal and adding blur to a predetermined area of the image;
Display means for displaying an image corresponding to the blurred image signal in parallel with an imaging operation by the imaging device;
During the imaging operation, when instructions for enlarging and changing the display magnification of the image displayed by the display means are continuously made, the focal length of the zoom photographing optical system is changed to the long focal length end, and Enlarging means for continuously performing resolution conversion on the signal based on the image signal;
During the imaging operation, when an instruction to change the display magnification is given and the focal length reaches a predetermined value, addition of blur is started to the image signal, and the image signal with blur is added. An image processing apparatus comprising: control means for controlling the blur adding means so as to output to the display means. Blur adding means for processing the image signal and adding blur to a predetermined area of the image;
Instruction means for instructing electrical enlargement of an image based on the image signal;
Enlarging means for performing the electrical enlarging process by resolution conversion;
An image processing apparatus comprising: a control unit configured to perform control so that blurring by the blur unit is not performed when enlargement of a predetermined magnification or more is instructed by the instruction unit. An image sensor that captures an image of a subject and outputs an image signal via an imaging optical system;
A blur adding means for applying a processing to the image signal to add blur to a predetermined area of the image;
Control means for prohibiting the addition of the blur by the blur means in a detection mode for detecting adhesion or scratches of foreign matter to the imaging optical system or the image sensor based on the image signal. Image processing device. The image processing apparatus according to claim 14.
The control unit controls the blur adding unit to add the blur to a region including the foreign object or the image of the scratch on a captured image captured in a shooting mode other than the detection mode. Image processing device. The image processing apparatus according to claim 14.
The blur adding means changes the amount of blur to be added in accordance with the size of contrast of an area including the foreign object or the scratch image on a captured image captured in a shooting mode other than the detection mode. A featured image processing apparatus.

Images