JP2007142702A - Image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus capable of properly adding gradation to a panoramic image obtained by joining multiple images with each other. <P>SOLUTION: When adding image gradation to the panoramic image obtained by joining two-frame images with each other, the image pickup device adds the image gradation by a frame unit to each image of an image of a first frame and that of a second frame. Image gradation addition processing is executed by a data processing circuit 10 under the control of a control circuit 5 so as to make a gradation amount added to a joint between both images almost equal. When the gradation amount is changed in one of images of a plurality of the frames constituting the panoramic image; the data processing circuit 10 automatically changes a gradation amount to be added so as to make an image gradation amount added to a mutual joint almost equal, even in the image gradation added to images of the other frames joined with the images in which the gradation amount is changed. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus that adds blur to an image.

  Electronic cameras that have a smaller imaging area compared to 35 mm cameras have become widespread. Since this type of camera has a short actual focal length, it is difficult to obtain a photographed image with a blurred background like a 35 mm version camera even if a photographing lens having the same F value (optical aperture value) as that of a 35 mm version camera is used. . Patent Document 1 discloses a technique for adding blur to an image by image processing.

JP 2003-125281 A

  Patent Document 1 does not disclose blurring addition to a wide-field image obtained by joining a plurality of images.

The image processing apparatus according to the first aspect of the present invention includes a blur addition unit that processes an image signal to add blur to an image, and a wide-field image generation unit that generates a wide-field image by joining a plurality of image signals. And a control means for controlling the wide-field image generation means and the blur addition means so as to process the wide-field image signal generated by the wide-field image generation means when adding blur to the wide-field image. It is characterized by that.
An image processing apparatus according to a second aspect of the present invention includes a blur addition unit that processes an image signal to add blur to an image, and a wide-field image generation unit that generates a wide-field image by joining a plurality of image signals. When blurring a wide-field image, each of the plurality of image signals is processed so as to align the blur of the image at the joint, and the processed image signals are joined to form a wide-field image. And a control means for controlling the blur addition means and the wide-field image generation means so as to generate them.
The image processing apparatus according to claim 2, wherein when the blurring amount added to the wide-field image is changed, the control unit changes the region excluding the joint portion in each of the plurality of image signals to be joined. Is preferably allowed.
3. The image processing apparatus according to claim 2, wherein when the blurring amount added to the wide-field image is changed, the control unit changes the blurring amount of the joint portion for any of the plurality of image signals to be joined. Then, it is preferable to change so that the blurring amount is also uniform for the joint portion of another image signal joined to the joint portion.

  The image processing apparatus according to the present invention can appropriately blur a wide-field image obtained by joining a plurality of images.

The best mode for carrying out the present invention will be described below with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram showing an example of an imaging apparatus according to the first embodiment of the present invention. In FIG. 1, an imaging device includes an imaging device 1, a photographing lens 2, a lens driving circuit 3, a control circuit 5, an operation member 7, an imaging device driving circuit 8, a signal processing circuit 9, and a data processing circuit. 10, a compression / expansion circuit 11, a monitor 13, a display control circuit 14, and a photometry circuit 15, and a recording medium 12 is further provided. The recording medium 12 includes a memory card, a small hard disk, an optical disk such as a DVD, and the like. The recording medium 12 may be built in the imaging apparatus or may be detachably mounted. Further, it may be provided outside the imaging apparatus. In that case, the recording medium 12 and the imaging device are electrically connected by wire or wirelessly.

  The taking lens 2 is composed of a plurality of lens groups constituting a taking optical system, and forms a subject image on the image pickup surface of the image pickup device 1. The photographic lens 2 includes a focus lens (not shown), and the lens driving circuit 3 drives the focus lens to move back and forth in the optical axis direction, thereby adjusting the focus of the photographic lens 2. The photographing lens 2 includes a zoom lens (not shown), and the lens driving circuit 3 drives the zoom lens to move back and forth in the optical axis direction, thereby adjusting the zoom of the photographing lens 2. The lens driving circuit 3 generates a lens driving signal in accordance with a lens driving command output from the control circuit 5, and moves each lens by driving a lens driving mechanism (not shown) with the generated lens driving signal.

  The image sensor 1 can capture a still image as well as continuous images of a still image and a moving image. The image sensor 1 is configured by, for example, a CCD image sensor or a CMOS image sensor.

  The image sensor drive circuit 8 generates a drive signal at a predetermined timing in response to a command output from the control circuit 5 and supplies the generated drive signal to the image sensor 1. The image sensor 1 controls charge accumulation (imaging) and reading of accumulated charge by the supplied drive signal. The control circuit 5 obtains information on the brightness of the object scene using the photometry data of the subject obtained by the photometry circuit 15, and based on the information on the brightness, the charge accumulation time of the image sensor 1, the aperture of the photographing lens 2, and The amplification degree of the image signal output from the image sensor 1 is determined. The information on the brightness of the object scene may be obtained from a signal output from the image sensor 1. In this case, the image sensor 1 controls the function of the photometry circuit 15.

  The image signal read from the image sensor 1 is input to the signal processing circuit 9. The signal processing circuit 9 performs signal processing such as amplification, direct current reproduction, A / D conversion, white balance, and gamma conversion on the input signal in accordance with a command from the control circuit 5, and the data after the signal processing is used as image data. Output to the data processing circuit 10.

  The data processing circuit 10 outputs the image data output from the signal processing circuit 9 to the compression / expansion circuit 11 in accordance with a command from the control circuit 5 and also has a resolution necessary for displaying the reproduced image on the monitor 13. Conversion (pixel number conversion) processing is performed on the image data, and the image data after the resolution conversion processing is output to the display control circuit 14. Note that the data processing circuit 10 performs resolution (number of pixel) conversion processing on input image data when performing electronic zoom processing to be described later, to the compression / expansion circuit 11 and the display control circuit 14 respectively. Output.

  In response to a command from the control circuit 5, the display control circuit 14 performs predetermined signal processing on the image data input from the data processing circuit 10 and outputs it to the monitor 13. The display control circuit 14 further performs processing for superimposing overlay image data such as a shooting menu and a cursor on the image data. Thereby, the subject image on which the overlay image is superimposed is displayed on the monitor 13.

  The compression / decompression circuit 11 performs a compression process on the image data input from the data processing circuit 10 in a predetermined format in response to a command from the control circuit 5, and records the compressed data on the recording medium 12. When image data is recorded on the recording medium 12 during shooting, a reproduced image corresponding to the image data to be recorded is displayed on the monitor 13. When the operation member 7 instructs to record the image data in the non-compressed state, the compression / decompression circuit 11 performs the recording on the recording medium 12 without performing the compression process. Also in this case, a reproduced image corresponding to the image data to be recorded is displayed on the monitor 13.

  Further, the imaging apparatus is configured to be able to display a reproduction image based on image data recorded on the recording medium 12 on the monitor 13 (reproduction mode). In this case, the compression / decompression circuit 11 reads the image data recorded on the recording medium 12 in accordance with a command from the control circuit 5, performs a decoding process on the read data, and then performs the decrypted data. Is sent to the data processing circuit 10. During reproduction, the data processing circuit 10 performs resolution conversion processing on the decoded data and outputs it to the display control circuit 14, whereby a reproduced image is displayed on the monitor 13. Note that when uncompressed image data recorded on the recording medium 12 is read, the decoding process, which is the reverse process of the compression process, is not performed. The compression / decompression circuit 11 is configured to be able to perform lossless compression (so-called lossless encoding).

  The operation member 7 includes a release button and outputs an operation signal corresponding to the operation content to the control circuit 5. When a release operation signal based on the pressing operation of the release button is input from the operation member 7, the control circuit 5 sets a focus detection area set in advance in the imaging screen in the image signal read from the imaging device 1. A known contrast AF (autofocus) operation is performed using the corresponding signal.

  Specifically, among the image data signal-processed by the signal processing circuit 9, the lens drive command is set so as to maximize the integrated value (so-called focus evaluation value) of the high frequency component for the data corresponding to the focus detection area. (Focus adjustment signal) is sent to the lens driving circuit 3. The position of the focus lens that maximizes the focus evaluation value is a focus position that eliminates blurring of the edge of the subject image captured by the image sensor 1 and maximizes the contrast of the image (increases sharpness).

  In the present embodiment, image data (video signal) sequentially obtained while moving the focus lens in the imaging lens 2 is analyzed for each of a plurality of focus detection areas in the shooting screen, and the contrast value of the image corresponding to each area is analyzed. The (relative) shooting distance of the subject located in each area can be acquired based on the focus lens position that maximizes the angle.

  In addition to the contrast AF operation, a phase difference AF operation by a known pupil division method may be performed. Also in this case, the shooting distance of the subject located in each region can be obtained.

  The operation member 7 also includes a zoom operation member. When a zoom operation signal based on a zoom operation is input from the operation member 7, the control circuit 5 generates the lens drive command described above, and causes the lens drive circuit 3 to drive the zoom lens forward and backward. Thereby, the subject image formed on the imaging surface of the imaging device 1 is enlarged or reduced, and the zoom is optically adjusted.

  Further, when a zoom operation signal based on the zoom operation is input from the operation member 7, the control circuit 5 outputs a command to the data processing circuit 10 to change the conversion ratio of the resolution conversion processing for the image data according to the operation signal. Thereby, the image displayed on the monitor 13 is enlarged or reduced, and the zoom is electrically adjusted (electronic zoom). The resolution conversion ratio corresponds to the electronic zoom magnification. When the data processing circuit 10 changes the conversion ratio in the direction of increasing the electronic zoom magnification, a part of the reproduced image is enlarged and displayed on the monitor 13 (while the enlargement ratio is increased, the display range of the reproduced image is narrowed). On the contrary, when the data processing circuit 10 changes the conversion ratio in the direction of decreasing the electronic zoom magnification, the enlargement ratio of the reproduced image displayed on the monitor 13 is lowered, but the display range of the reproduced image is widened. When the photographing mode by the image sensor 1 is set, photographed image data corresponding to the image displayed on the monitor 13 can be recorded on the recording medium 12.

  Next, a through image shooting operation, a still image main shooting operation, and a moving image main shooting operation performed when the imaging apparatus is set to the shooting mode will be described. Through image shooting is preliminary shooting performed as a pre-stage of still image main shooting, and still image main shooting is shooting performed in response to a release button full-press operation signal (shooting instruction). The moving image main shooting operation is shooting performed in response to an operation signal (shooting and recording instruction) of the REC button.

<Through image shooting operation>
When the image pickup apparatus of the present embodiment performs a still image main shooting operation, if a half-press operation signal based on a half-press operation of the release button is input from the operation member 7 to the control circuit 5, the AF operation described above is performed. Perform a through image shooting operation. The through image capturing operation is repeatedly performed at a predetermined frame rate. During the half-press operation of the release button, the above-described AF operation is performed in parallel with the through image capturing operation, and the captured through image is displayed on the monitor 13. Is displayed.

  The control circuit 5 sends an instruction to the image sensor drive circuit 8 to output a drive signal for executing a through image photographing operation. The imaging device 1 receives a drive signal for a through image shooting operation and continuously outputs accumulated charges at a high frame rate of, for example, 30 frames / second. The exposure conditions for through image shooting are determined based on the photometric data from the photometric circuit 15. The signal processing circuit 9 performs the above-described signal processing on the input signal, adds the signals of the same color pixels (in the case of a single-plate color image sensor) located in the vicinity on the image sensor 1, and creates a still image to be described later. The video signal is output to the data processing circuit 10 as a video signal having a lower resolution (lower number of pixels) than at the time of actual photographing.

  When the data processing circuit 10 outputs the image data subjected to the resolution conversion process to the display control circuit 14, the through image is displayed on the monitor 13. As a result, the photographer can observe the state of the object scene to be photographed from now on the screen of the monitor 13. That is, in the through image shooting operation, the imaging operation and the display operation are performed in parallel.

<Still image shooting>
When the release button is fully pressed following the through image shooting operation, a full press operation signal is input to the control circuit 5. The imaging device starts a still image book shooting operation in response to the full-press operation signal.

  When the control circuit 5 detects a full-press operation signal from the operation member 7 (release button), it sends an instruction to the image sensor drive circuit 8 to output a drive signal for executing the main photographing operation. The image sensor 1 receives a drive signal for the still image main photographing operation, performs charge accumulation for main photographing based on the exposure calculation result, and outputs the accumulated charge. The exposure condition for the main photographing is determined based on the brightness information of the object scene obtained from the signal value of the latest live view image data. The signal processing circuit 9 performs the above-described signal processing on the input signal and outputs the image data to the data processing circuit 10 as image data with a higher resolution (higher number of pixels) than when a through image is captured.

  The data processing circuit 10 outputs the image data subjected to the resolution conversion processing to the display control circuit 14, so that the still image main captured image is displayed on the monitor 13. The image data compressed by the compression / decompression circuit 11 is recorded on the recording medium 12.

<Video recording operation>
Next, the main video shooting operation will be described. The main moving image shooting operation is a shooting operation in which a moving image shot by the image sensor 1 is recorded on the recording medium 12 while being displayed on the monitor 13. This moving image main shooting operation is a part of the operation member 7 and is executed while the REC button is instructed to take a moving image. When the REC button constituting a part of the operation member 7 is pressed, the control circuit 5 continuously performs the automatic focusing operation described above and executes the moving image main photographing operation by the image sensor 1. Note that the automatic focusing operation in this case is performed even if the automatic focusing operation is performed while tracking the specific subject so that the specific subject moving in the screen is focused. It may be controlled to always focus on an object at a distance. Further, the in-focus state may be changed according to the intention of the photographer by manual operation of a focus operation member (focus adjustment member) constituting a part of the operation member 7 without performing a focusing operation.

  When detecting the pressing operation of the REC button, the control circuit 5 instructs the image sensor driving circuit 8 to output a driving signal for executing the moving image main photographing operation. The image sensor 1 receives a drive signal for the main moving image shooting operation and continuously outputs a video signal at a high frame rate of, for example, 30 frames / second. The video signal output from the image sensor 1 in this manner is subjected to predetermined processing by the signal processing circuit 9 and the data processing circuit 10 and then sequentially supplied to the monitor 13 via the display control circuit 14. The data is recorded on the recording medium 12 via the compression / decompression circuit 11.

  Note that when the recording of the recording medium 12 in the non-compressed state is instructed by the operation of the operation member 7, the compression / decompression circuit 11 does not perform the compression process, and the recording to the recording medium 12 is performed. . In addition, when performing a recording operation on the recording medium 12, the compression rate may be changed by operating the operation member 7.

  Further, the shooting distance information acquired in the above-described automatic focusing operation is recorded on the recording medium 12 together with the image data in association with each of a plurality of still image frames constituting the moving image. The photographer can confirm the state of the object scene to be photographed and the image recorded on the recording medium 12 by viewing the moving image displayed on the monitor 13. The number of pixels of one frame of a moving image recorded on the recording medium 12 is larger than the number of pixels of the monitor 13. Therefore, in the present embodiment, when the moving image is displayed on the monitor 13, resolution (pixel number) conversion processing is performed by the data processing circuit 10 so as to match the number of pixels of the monitor 13.

<Blur addition processing>
An operation of adding electrical blur to an image (that is, adding blur to an image) will be described. The process of electrically blurring an image (hereinafter referred to as adding an image blur) is to process an image by image processing and generate a pseudo-focused image. In the imaging apparatus according to the present embodiment, the image data is subjected to low-pass filter (LPF) processing to degrade the high-frequency spatial frequency component of the image, thereby blurring the edge of the image and lowering the contrast of the image.

  When the shooting mode is set to portrait mode or macro mode, the imaging device is allowed to add image blur (and change the added content), and the shooting mode is set to distant view mode. If it is, addition of image blur (and change of the added content) is prohibited. Here, the portrait mode is a shooting mode in which a person is a main subject, the macro mode is a shooting mode in which close-up shooting is performed, and the distant view mode is a shooting mode in which a landscape is a subject. The control circuit 5 determines whether to permit or prohibit. Based on this prohibition / permission determination of image blur, it is possible to add / prohibit image blur to at least one of the through image data and the still image captured image data based on the full press operation of the release button. Be controlled. In other words, the addition of image blur is permitted in shooting modes (portrait mode, macro mode, etc.) in which it is determined that adding image blur to a shot image increases the artistry of the image, and in other shooting modes. Since the image blur addition is prohibited, it is possible to prevent the image blur from being erroneously added to an image in which the image blur is not preferable.

  In addition, even when the shooting mode is set to the night scene portrait mode, and there is an area having a brightness of a predetermined level or more in the background area of the image, the imaging apparatus adds (and adds) image blur. (Change of contents) is permitted. On the other hand, when the night scene portrait mode is set and there is no area having a brightness of a predetermined level or higher (for example, a bright spot area such as illumination) in the background area of the image, Addition (and modification of additional contents) is prohibited. Whether or not a brightness area of a predetermined level or more exists in the background area of the image is determined using a video signal for a through image input to the data processing circuit 10.

  The control circuit 5 may be configured to prohibit the above-described image blur addition (and change of the added content), at least at the time of photographing, and at the time of reproduction.

  A flow of photographing processing in which the control circuit 5 adds image blur will be described with reference to a flowchart of FIG. The shooting process shown in FIG. 2 is started when the addition of image blur (and change of the added content) is permitted based on the shooting mode set as described above and the shot image data.

  In step S101 in FIG. 2, the control circuit 5 determines whether or not the release button has been pressed halfway. When a half-press operation signal is input from the operation member 7 (release button), the control circuit 5 makes an affirmative determination in step S101 and proceeds to step S102. If no half-press operation signal is input, the control circuit 5 makes a negative determination in step S101. The determination process is repeated. In the present embodiment, it is assumed that a through image shooting operation has already started before step S101.

  In step S102, the control circuit 5 sets the exposure mode to the aperture priority auto mode and starts the above-described AF operation while performing the through image shooting operation, and proceeds to step S103. In the aperture priority auto mode, change of the aperture value is prohibited, and at least one of the electronic shutter speed (charge accumulation time) of the image sensor 1 and the amplification degree with respect to the image signal output from the image sensor 1 is set to be changeable. . By setting to the aperture priority auto mode, the currently set aperture value is not changed during the photographing process, and it is possible to easily adjust and confirm the image blur addition amount described later. In the AF operation, for example, the focus evaluation value is maximized for each of the plurality of focus detection areas in the moving process while moving the focus lens from the position corresponding to infinity toward the position corresponding to the closest end at a predetermined speed. The focus lens position (focus position) to be detected is detected, and shooting distance information corresponding to each focus lens position is acquired. Thereby, distance information to a subject existing in each of the plurality of focus detection areas can be obtained.

  The control circuit 5 sequentially displays the through image on the monitor 13 at the above frame rate during the AF operation, and superimposes and displays the AF marks indicating a plurality of focus detection areas on the through image. The control circuit 5 sends a command to the display control circuit 14 to change and display the display color of the AF mark corresponding to the focus detection area where the in-focus position is detected (focus detection) from red to green. The display for notifying the photographer of the focus detection may be displayed by another LED or the like instead of the monitor 13 in a superimposed manner.

  In step S103, the control circuit 5 performs subject extraction (recognition) processing from the through-image video signal that is a focused image with no image blur added, and proceeds to step S104. In the extraction (recognition) of the subject, for example, the focus state is adjusted so that each subject existing in each focus detection area is focused using a plurality of images captured in the course of the AF operation in step S103. In this state, each subject image in the imaging screen is extracted (recognized). Thus, the process of step S104 is performed in parallel with the process of step S103. The main subject is extracted (recognized) from the subjects extracted in this manner using an extraction method described later. In addition, a configuration may be employed in which subject extraction (recognition) is performed using images of a plurality of frames having different focal states or images of a plurality of frames having different focal lengths. As an extraction method, a technique for extracting a known specific contour, a technique for extracting a known specific color (skin color, etc.) region, a technique for recognizing a face, or a combination of these extraction techniques may be used. When there are a plurality of extracted subjects, for example, the subject closest to the imaging device is extracted as the main subject using distance information to the plurality of subjects acquired by the AF operation. The control circuit 5 drives the focus lens to a position where the extracted (recognized) main subject is focused.

  Note that the specific contour extraction and the specific color extraction may be omitted, and in this case, the subject closest to the imaging apparatus is set as the main subject using the distance information to the plurality of subjects acquired by the AF operation. Image blur, which will be described later, is added to the region excluding the main subject region extracted in this way. The extraction (recognition) result of the extracted main subject (the type of the subject and the position on the imaging screen) is used as follows, for example. Depending on the extraction (recognition) result of the main subject (the type of the subject and the position on the imaging screen), the contents of the image processing performed on the through image or the subsequent captured still image are changed. For example, an image blur is added only to an image in which a face is recognized in a through image to which no image blur is added, or the color of the face area is changed to a predetermined color.

  Further, the extraction (recognition) result as described above may be recorded on the recording medium 12 together with the through image or the image data of the subsequent captured still image. The photographer can inspect the image data recorded in association with each other based on the recognition result recorded in the recording medium 12. According to the above configuration, subject extraction and subject recognition are performed using an image (through image) to which no image blur is added, so that accurate extraction and recognition can be performed. In this case, the results of subject extraction and subject recognition are not limited to those reflected in the through image, but may be reflected in the subsequent still image taken. In addition, since each subject is extracted (recognized) using an image focused on each subject, accurate extraction and recognition can be performed.

  In step S104, the control circuit 5 instructs the data processing circuit 10 to add image blur to the region other than the main subject extracted in step S103 (ie, the background region) in the through image video signal, and then proceeds to step S105. move on. The data processing circuit 10 outputs a signal subjected to image blur addition and resolution conversion processing to the display control circuit 14, so that a through image with image blur is displayed on the monitor 13.

  The data processing circuit 10 adds image blur by selectively performing LPF processing on the data corresponding to the background area of the input through image data. The characteristics of LPF processing (number of filter taps, cutoff frequency, attenuation, etc.) are changed according to the distance information acquired in the focus detection area. Specifically, the shooting distance acquired in the focus detection area in the main subject area is compared with the shooting distance acquired in the focus detection area in the background area, and the difference in shooting distance between the two is large. The cutoff frequency of LPF processing for the background area is lowered. As a result, a stronger blur effect is added to the background area having a larger difference from the shooting distance of the main subject.

  Note that instead of causing the data processing circuit 10 to perform LPF processing, convolution calculation processing using a point spread function is performed to suppress high-frequency spatial frequency components in the screen (add image blur). Good.

  In step S105, the control circuit 5 determines whether or not there is a motion on the shooting screen. The control circuit 5 determines that the motion vector between frames calculated from through-image data of a plurality of frames acquired every 1/30 seconds by through-image shooting is the entire shooting screen (a block obtained by dividing the shooting screen into a predetermined number). (Ie, the deviation of the direction and the magnitude of the motion vector between the blocks is within a predetermined range), and the average value of the magnitude of the motion vector in each block in the shooting screen is predetermined. If it is greater than or equal to the value, an affirmative decision is made in step S105 and the process proceeds to step S106.

  On the other hand, the control circuit 5 determines whether the motion vector between frames calculated from through-image data of a plurality of frames is not commonly detected in each region of the shooting screen, or the size of the motion vector in each block in the shooting screen. If the average value is less than the predetermined value, a negative determination is made in step S105, and the process proceeds to step S107. In step S107, the control circuit 5 determines whether or not there is a movement in some subjects in the shooting screen. The control circuit 5 detects a motion vector between frames calculated from through image data of a plurality of frames acquired every 1/30 seconds by through image shooting in at least one of the predetermined number of divided blocks. In step S107, an affirmative determination is made, and the process proceeds to step S108.

  When the process proceeds to step S106, it is determined that there has been a movement of the photographing range due to the movement of the imaging device. In step S106, the control circuit 5 moves the target area (background area) to which image blur is to be added from the position of the additional target area of the previous frame in accordance with the direction and size of the motion vector, and proceeds to step S109. Here, for the area newly added to the shooting range as the shooting range moves, a blur equivalent to the blur amount added at the corresponding screen edge of the frame before the shooting range moves is added. (Same LPF treatment is applied). The movement of the target area to which image blur is added is reflected in the display image of the monitor 13 in real time. As described above, according to the above configuration, control is performed so that the image blur amount is changed and the image blur addition position is automatically moved in accordance with the movement of the subject in the moving image (change in the image signal). .

  The amount of blur added to the area newly added to the shooting range with the movement of the shooting range is calculated by extrapolation from the distribution of the blur amount in the shooting screen added before the shooting range moves, The calculated blur amount may be added. Also in this case, the movement of the target area to which the image blur is added is reflected on the display image of the monitor 13 in real time.

  On the other hand, when the motion vector between frames calculated from through image data of a plurality of frames acquired every 1/30 seconds by through image shooting is not detected in any of the predetermined number of divided blocks, the control circuit 5 Makes a negative determination in step S107 and proceeds to step S109. In this case, the process proceeds to step S109 without changing the target area to which the image blur is added.

  When the process proceeds to step S108, it is determined that there is a movement for a part of the subject in the shooting screen. In step S108, the control circuit 5 adds a target region or image blur to which image blur is added according to the direction and size of the motion vector in the divided block in which motion is detected or in the divided block in which motion is not detected. The target area not to be moved (area corresponding to a part of the subject) is moved to step S109.

  FIG. 3 is a diagram illustrating through images acquired at times T0, T1, and T2. In the current frame screen at time T1, the amount of blur added to the partial subject area O1 in which the motion has been detected is the same as the partial subject area O0 in the frame screen (time T0) before the partial subject moves. The amount of blur to be added to the region P in the current frame screen (time T1) corresponding to the position of the region O0 is interpolated from the distribution of the amount of blur added to the periphery of the region P. Calculate by processing. The movement of the target area to which image blur is added is reflected in the display image of the monitor 13 in real time.

  You may determine as follows about the blur addition amount with respect to the area | region which existed before the one subject moved. That is, assuming that the current frame is time T2, the amount of blur added to the area O2 of the partial subject whose movement has been detected in the current frame screen is the same as that in the frame screen (time T1) before the partial subject moves. The blur amount added to the area Q in the current frame screen (time T2) corresponding to the position of the area O1 is set to be the same as the blur amount added to the area O1 of the partial subject. The blur amount added to the corresponding region R in the previous frame screen (time T0) is the same. If the region to which the same amount of image blur is added is moved with time using motion information between frames as in step S106 and step S108, the amount of blur to be added differs depending on the region in the screen. In such a case, it is possible to quickly generate an image with electric blur as compared with the case where the amount of image blur in each region is calculated for each frame image. When the image generated in this way is displayed on the monitor 13, the delay time until display can be reduced.

  In step S109, the control circuit 5 determines whether or not an operation for changing the image blur addition amount has been performed. The control circuit 5 makes an affirmative determination in step S109 when a blur amount change operation signal is input from the operation member 7, and proceeds to step S110. If a blur amount change operation signal is not input, the control circuit 5 makes a negative determination in step S109. Proceed to step S111. The blur amount changing operation is configured such that both a changing operation performed by designating a specific area on the screen of the monitor 13 and a changing operation performed in common on the entire screen can be performed.

  In step S110, the control circuit 5 instructs the data processing circuit 10 to change the characteristics of the LPF processing in accordance with the blur amount changing operation signal, and proceeds to step S111. Thereby, the amount of blur added is changed. In addition, when performing a convolution operation process instead of the LPF process, the point spread function is changed according to the change operation signal. The image after the blur amount change is displayed on the monitor 13 in real time.

  In step S111, the control circuit 5 determines whether or not the half-press operation of the release button is continued. When the half-press operation signal is continuously input from the operation member 7, the control circuit 5 makes an affirmative decision in step S111 and proceeds to step S112. On the other hand, the control circuit 5 when the half-press operation signal is not input proceeds to step S115 in order to make a negative determination in step S111 and cancel the addition of image blur. In step S115, the addition of the image blur is canceled and an image without the image blur is displayed on the monitor 13. Even in this case, the through image shooting operation is continued. Therefore, the photographer can reset the image blur addition (amount, position, etc.) by releasing the half-press operation of the release button.

  That is, a negative determination is made in step S111 and the process proceeds to step S115, and after the next half-press operation signal is input, the automatic focusing operation is completed and the main subject extraction is performed. The through image not to be displayed is displayed on the monitor 13. With such a configuration, it is possible to cancel the added image blur (return to the state before adding the image blur) by a simple operation. In addition, since a focused image with no image blur is displayed on the monitor 13 every time shooting is performed, whether or not image blur should be added can be determined for each image to be shot. In addition, when image blur that has been added as described above is not canceled, subject extraction is performed using a non-focused image when the shooting range is changed and automatic focusing is performed for the next shooting. May result in improper image blur. According to the above configuration, in order to perform the automatic focusing operation, image blur is not added at the stage where the release button is half-pressed, and this is prevented.

  In step S112, the control circuit 5 determines whether or not the release button has been fully pressed. The control circuit 5 makes an affirmative decision in step S112 when a full-press operation signal is input from the operation member 7, and proceeds to step S113. If a full-press operation signal is not input, the control circuit 5 makes a negative determination in step S112, and step S105. Return to.

  In step S113, the control circuit 5 starts the still image book photographing operation and proceeds to step S114. The control circuit 5 performs an automatic exposure (AE) operation for main photographing using the brightness information of the through image signal (data) displayed on the monitor 13 immediately before the full-press operation signal is input. Thereby, when the image blur is added to the latest through image data, the exposure for the main photographing is determined based on the brightness information of the signal (data) value including the added image blur. Therefore, for example, even when image blur is added to an image having a high-level bright spot region locally, the actual shooting is performed based on the bright spot image data whose level is reduced by the addition of the image blur. Since the exposure of the motion is determined, a final image with accurate brightness can be obtained. Based on the determined exposure, the imaging device sets an electronic shutter speed (charge accumulation time) of the imaging device 1, a diaphragm, an amplification degree of an image signal output from the imaging device 1, and performs an imaging operation. When no image blur is added to the latest through image signal (data), the exposure for the main photographing is determined based on the signal (data) value not added with the image blur.

  In step S114, the control circuit 5 adds an image blur similar to the image blur added to the through image immediately before the full-press operation signal is input to the image signal obtained in the actual photographing ( The target area to which image blur is to be added and the amount of image blur to be added are made the same). This point will be described. The number of pixels is different between an image obtained by actual photographing and a through image. Usually, the spatial frequency of an image is defined by the number of stripes between unit distances (for example, 1 mm). The above-mentioned “add similar image blur” means normalization of the spatial frequency with reference to the screen size of the image (the above unit distance is the screen size. The number of stripes in the area is normalized based on the vertical and horizontal dimensions of one screen, for example, when there are vertical stripes in a certain area of the screen, This means that the spatial frequency characteristics including optical blur of both images after adding the image blur are set to be substantially the same.

  Here, setting the spatial frequency characteristics of both images to be substantially the same means that the point spread characteristics including the optical blur of both images (that is, the screen of the point image of the output image when the points are imaged). This is the same as setting so that the spread characteristics normalized with respect to the size of are substantially the same. According to the concept of the spatial frequency normalized with respect to the screen size as described above, since the number of pixels of both images is different, for example, the maximum spatial frequency that can be expressed by both images is always different. In order to make the degree of image blurring of images having different numbers of pixels the same, the image blurring is performed so that the spatial frequency characteristics normalized with respect to the screen size after the addition processing of each image blurring are the same. Set parameters for additional processing. Specifically, since the number of pixels of both images is different, the processing for adding image blur to both image data (low pass filter coefficients, parameters such as convolution coefficients, and processing characteristics) is different. . The through image here can be replaced with a reproduced image read from the recording medium 12 and displayed on the monitor 13.

  In this way, it is possible to set an image blur addition process for each image so that the degree of image blur is the same between a through image or a reproduced image having a different number of pixels and the actual captured image. Even if the photographer does not actually see the high-resolution pixel-captured actual captured image, the photographer captures the actual captured image with the actual number of pixels from the through image displayed on the monitor 13 or the reproduced image displayed on the monitor 13. The degree of image blur addition can be determined.

  Here, the through image is displayed on the monitor 13 as described above. However, in order to reduce the size of the apparatus, the display screen of the monitor 13 is generally small. For this reason, in order to facilitate the visual recognition of the degree of image blur addition on the monitor 13, the amount of image blur added to the display image by the monitor 13 having a small display surface area and a small display area is set to the actual captured image. You may comprise so that it may become larger than the addition amount of an image blur. Even if the images are displayed on the same monitor 13, the display areas of the through images (or quick view images) and the thumbnail images are different. For this reason, as described above, it is preferable that the amount of blurring of the thumbnail image is set to be larger than the amount of blurring of the through image (or quick view image).

  In addition, when the aperture state differs between the still image main shooting and the previous through-image shooting, the blur corresponding to the amount of change in the aperture is electrically applied to the still image obtained by the still image main shooting operation. It is good also as a structure added to. For example, if the aperture is reduced by one step in the process of moving from through image shooting to still image main shooting, the still image obtained by the still image main shooting operation is blurred by one step from the previous image. Has been reduced. Therefore, an image blur of one stop is electrically added to the still image obtained by the still image main photographing operation so that the degree of image blur of both images is the same. In this way, even when the aperture changes between the still image shooting and the immediately preceding through shooting, the image blur is adjusted based on the amount of change in the aperture, so the same image as the through image It is possible to obtain an actual photographing still image with a degree of blur.

  Further, the control circuit 5 records the actual captured image data compressed after the image blur is added to the recording medium 12, returns the aperture priority auto mode to the most recent setting mode, and then ends the processing of FIG.

  When the control circuit 5 records the actual captured image data on the recording medium 12, the thumbnail image and the quick view image are recorded together with the actual captured image. The thumbnail image is an image for displaying the captured image on the monitor 13 in a reduced size, and is obtained by further reducing the number of pixels from the actual captured image to the number of pixels of the monitor 13 for the thumbnail. The quick view image is an image that is generated and recorded from the actual captured still image in accordance with the number of pixels of the monitor 13 in order to reproduce and display a captured image of one frame on the monitor 13 in a large and rapid manner. This is an image obtained by reducing the number of pixels from the main image in accordance with the number of display pixels. The thumbnail image and the quick view image are each recorded on the recording medium 12 as a still image in association with the actual captured image.

  Since the image data with the image blur added has a higher spatial frequency component suppressed than the image data before the image blur is added, the compressed data of the image whose data size after the compression process does not add the image blur is added. Smaller than size. When the addition of image blur (and change of the added content) is permitted, the control circuit 5 uses a coefficient for calculating the number of shootable images as a coefficient when addition of image blur is permitted (a predetermined amount of image blur). The average compression code amount per frame of the still image obtained by the main photographing operation that is permitted to be added is calculated. Since the high frequency spatial frequency component is suppressed in the image data to which the image blur is added, the code amount after the compression processing is reduced. As a result, when the addition of image blur is permitted, the number of shootable images for the same remaining capacity (the free capacity of the recording medium) increases as compared with the case where it is prohibited. Such a shootable number is displayed, for example, on the monitor 13 in the shooting mode, and the display differs depending on the shooting mode that allows the addition of image blur and the shooting mode that does not allow the blurring. In addition, when the additional amount of image blur can be changed and set, the display of the number of shootable images that can be recorded in the remaining capacity may be changed according to the set additional amount.

  The data processing circuit 10 generates thumbnail images and quick view images under the control of the control circuit 5. The amount of blur added to the still image captured image, thumbnail image, and quick view image is in the order of increasing the size of the output image as described above, that is, in the order of thumbnail image, quick view image, still image captured image. Similarly, the amount of blur is adjusted so that the amount of blur is reduced, or the apparent amount of blur of each image (the spatial frequency characteristics of the amount of blur normalized by the size of the image on the output medium (printed paper, monitor display, etc.)) The amount of image blur to be added is adjusted as follows. In this case, the resolution of the actual still image data is converted to a data size corresponding to the quick view image and the thumbnail image, and the image is converted so that an appropriate blur is obtained for each converted image. It is preferable to add blur. With such a configuration, the amount of image blur added to each image can be individually adjusted.

  Alternatively, the data processing circuit 10 may be configured to generate thumbnail image data and quick view image data from the data of the actual captured image to which the image blur is added or the data of the through image to which the image blur is added. With such a configuration, an image corresponding to the number of pixels of each of the thumbnail image and the quick view image is generated from the actual captured still image data, and an image blur is added to the actual captured still image. It is possible to quickly generate a thumbnail image and a quick view image to which image blur has been added, with a small amount of computation compared to the case where image blur addition processing is performed on both generated images. it can.

<Display example of monitor>
A display mode when an image with added image blur is displayed on the monitor 13 will be described with reference to FIG. FIG. 4A is a diagram illustrating a monitor 13 that displays a through image without adding image blur. In FIG. 4A, the subject 301 exists behind the main subject 300, and the subject 302 exists further behind the subject 301. The imaging apparatus is focused by the AF operation, and is focused on the main subject 300 closest to the imaging apparatus.

  When the image blur is added to the through image illustrated in FIG. 4A, the image blur is added to a region of a subject located far from the focused main subject 300. The amount of blur to be added is larger for the subject 302 than for the subject 301 that has a larger difference (positioned farther) from the shooting distance of the main subject 300. The imaging apparatus of the present embodiment displays a through image with such image blur added on the monitor 13 as shown in FIG.

  According to FIG. 4 (b), the boundary portion of the region to which no image blur is added (in this case, the region of the main subject 300) so that the photographer can easily recognize the region to which the image blur has been added / the region to which the image blur has not been added. To highlight. In the present embodiment, the outline of the main subject 300 is displayed with a bold line to indicate emphasis. Further, the added amount of image blur may be increased as the subject is located far away, and the difference in emphasis can be expressed by changing the thickness of the outline of each main subject. FIG. 4B shows an example in which the area where image blur is not added and the area of the main subject (300) are the same, but image blur is not added even if the subject is not in focus. There may be cases. That is, the area where no image blur is added is not necessarily the main subject in focus.

  The monitor display described above is a target to which image blur is added when the imaging range is moved (Yes in step S105) and when some subject is moved (Yes in step S107). The movement of the area is reflected in real time.

  Although an example in which a through image with blurred image is displayed on the monitor 13 has been described, a reproduction corresponding to a main shooting moving image, a main shooting still image, a thumbnail image, a quick view image, or image data recorded on the recording medium 12 The same applies to the case where image blur is added to the image and each is displayed on the monitor 13.

  Thus, an image with image blur added includes an area to which no image blur is added (in this case, an area of the main subject 300), and an area to which image blur is added (in this case, an area including the main subjects 301 and 302). Is displayed on the monitor 13 during a photographing operation or in a reproduction mode in which image data is read from the recording medium 12 and a reproduced image is displayed. The image displayed on the monitor 13 is displayed by enlarging an arbitrary area in the entire area image during the photographing operation or the reproduction mode based on the display enlargement operation from the operation member 7 (electronic zoom). Can be configured.

<Electronic zoom>
The electronic zoom operation is performed by zooming from the operation member 7 so as to complement the optical enlargement operation (optical zoom) by the photographing lens 2 in order to change the display magnification when the monitor 13 displays an image. This is performed based on an operation (enlargement / reduction operation) signal. In the electronic zoom operation, since the interpolation process is further performed on the image generated by the interpolation calculation process, the image quality after zoom-up deteriorates as the enlargement magnification increases. The image quality deterioration is observed as, for example, aliasing of the oblique edge portion of the image on the monitor 13. Therefore, a maximum enlargement magnification by electronic zoom is determined in advance so that the degree of image quality deterioration falls within an allowable range.

  In addition, when both image blur addition and electronic zoom operation are performed, the image blur is added after electronic zoom in order to suppress image quality deterioration. In the case where the image blur addition amount is not changed by the enlargement magnification by the electronic zoom, for example, when the continuous enlargement by the electronic zoom is instructed, the image blur addition process at a certain time point is electrically The enlarged image data to which image blur is not added is further electrically expanded, and image blur addition processing is performed. Such processing can be realized by storing image data to which image blur before the enlargement processing is not added at any time when performing electrical enlargement. According to such a configuration, since the high frequency component of the image is suppressed by the image blur addition process, the influence of aliasing is reduced even with the same enlargement magnification (electronic zoom magnification), and the image quality is improved. That is, in this configuration, the image blur addition processing also serves as aliasing reduction processing. As a result, the maximum magnification of the electronic zoom can be set higher in the configuration in which image blur is added after the electronic zoom operation than in the configuration in which image blur is added before the electronic zoom operation.

  For the above reason, the maximum enlargement magnification by electronic zoom may be different between an image with image blur added and an image without image blur.

  Further, the electronic zoom magnification setting range may be changed according to the degree of image blur to be added, such as setting the maximum enlargement magnification of the electronic zoom higher as the degree of image blur to be added is larger.

  On the other hand, when the image data is reduced by the electronic zoom, the above-described problem of image quality degradation due to aliasing does not occur. Therefore, the image blur addition process is performed before or after the reduction process by the electronic zoom. It doesn't matter. The electronic zoom described above can perform the same operation during shooting and during playback for reading out and displaying image data recorded on the recording medium 12.

  On the other hand, it is known that the amount of optical blur varies depending on the focal length of the photographing lens 2. When the photographic lens 2 is a zoom lens, the amount of optical blur varies depending on the zoom level (magnification level). Therefore, not only when the electronic zoom processing is performed following the optical zoom operation by continuous operation of the same operation member, but also when the electronic zoom operation is not accompanied by the optical zoom operation in the playback mode, for example. In addition, if the configuration is such that the amount of blur that is electrically added during electronic zoom processing, which is an electrical enlargement operation, is changed according to the display magnification that is changed each time an instruction to change the enlargement magnification is given, Operation that does not feel uncomfortable for the user.

  Hereinafter, a zoom lens (zoom imaging optical system) having different F-numbers at the long focal length end (telephoto end) and the short focal length end (wide angle end) is used as the photographing lens 2 in the zoom state at the long focal length end. Addition of image blur when an electrical enlargement by electronic zoom is instructed will be described. For example, a zoom lens capable of changing the focal length between 8 mm (optical aperture F1.4) to 23 mm (optical aperture F2) is used as the photographic lens 2 to enlarge the photographic image displayed on the monitor 13. Is instructed, the photographic lens 2 is driven to a focal length of 23 mm, which is the long focal length end, and thereafter, an electric enlargement process by electronic zoom (resolution (number of pixels) conversion) is performed. The optical aperture value of the photographic lens 2 changes in a binary manner between F1.4 and F2, for example, in conjunction with the focal length change drive.

  When the focal length of the taking lens 2 reaches the long focal length end (predetermined value) and the electronic zoom operation is started, the addition of electrical image blur is automatically started. For example, when the enlarged image by the electronic zoom enlargement instruction is an electrical enlarged image corresponding to a focal length of 38 mm, the aperture is further reduced from the optical aperture F2.8, that is, the optical aperture value at the long focal length end. Blur is added so as to correspond to a virtual aperture value. Of course, in this case, an image blur corresponding to the optical aperture value (F2) at the long focal length end may be added.

  Conversely, an image blur corresponding to the aperture value changed in the open direction may be added from the optical aperture value (F2) at the long focal length end. The blurring amount added in these cases is determined in consideration of the virtual focal length (38 mm in the above example) of the photographing lens 2 that is further determined from the electric magnification. In other words, an increase in electrical magnification means an increase in the virtual focal length, which is set so that the amount of blur added is increased.

  Furthermore, when a zoom lens capable of setting an optical aperture value is used as the photographic lens 2, and in the zoom state at the long focal length end, as in the case described above, when electrical enlargement by electronic zoom is instructed. The image blur corresponding to the set optical aperture value may be electrically added. In addition to this, a virtual aperture value exceeding the change range of the above-described optical aperture value is set, and an image blur corresponding to the virtual aperture value is electrically added during an enlargement operation by electronic zoom. It is good also as a structure.

  In the above description, when the focal length of the taking lens 2 reaches the long focal length end and the electronic zoom operation is started, an example in which the addition of electrical image blur is started is described. When the focal length of the photographic lens 2 is largely changed by an instruction to change the display magnification), if the focal length becomes a predetermined value less than the longest focal length that the photographic lens 2 can realize, image blur is automatically added. It is good also as a structure which starts to. According to such a configuration, since the process of adding image blur is automatically started only by an operation for changing the enlargement magnification without particularly instructing the photographer to add image blur, a comfortable operation feeling can be realized. .

(Delayed processing)
As described above, when both image blur addition and electronic zoom-up (display magnification enlargement) operations are performed, when image blur is added after electronic zoom, electronic zoom-up is performed on the original image without image blur. After performing the processing, a two-step processing is required to add image blur to the zoomed-up image. On the other hand, in the case of the electronic zoom down (display magnification reduction) operation, since the electronic zoom down process may be directly performed on the image with the blurred image, the process is performed at the time of the electronic zoom up and the electronic zoom down. There is a difference in time.

  The control circuit 5 delays the electronic zoom-down process so that the time required for the electronic zoom-down operation at the time of shooting is equivalent to the time required for the electronic zoom-up operation. Thereby, the difference in response between the electronic zoom-up and the electronic zoom-down when both the image blur addition and the electronic zoom operation are performed can be suppressed, and the photographer can be prevented from feeling uncomfortable.

  The delay of the electronic zoom-down process can be performed by simply inserting a weight process between time series processes performed by the control circuit 5 or performing an electronic zoom-down process on an original image without adding image blur. A two-stage process of adding image blur to an image after down may be performed.

  The configuration for adding the image blur after the electronic zoom may be performed only on the still image captured in the main photographing. When an electronic enlargement / reduction is instructed to the image displayed on the monitor 13 during the through image shooting, an electronic zoom-up or electronic zoom-down process is performed on the image with the image blur added thereto, A still image obtained by full-pressing the release button is displayed on the monitor 13 with image blur added, and when electronic enlargement is instructed, no image blur is added. An image blur is added after an electronic zoom-up process is applied to the original image. In addition, the above delay processing is included at the time of electronic zoom down at the time of actual photographing. When shooting through images, image quality degradation due to aliasing is unlikely to be a problem, so priority is given to responses during enlargement / reduction operations. On the other hand, the still image captured in the main shooting is subjected to a blur addition process after the electronic zoom (after the resolution conversion) to give priority to maintaining the image quality of the main shooting image.

<Defocusing amount change operation member>
The blur amount changing operation member constituting the operation member 7 will be described. It is desirable to change the LPF characteristic (or point spread function) for changing the image blur addition amount in real time without delay in accordance with the frame rate of the moving image (through image). For this reason, the blur amount changing operation member does not determine the output value (that is, the amount of blur to be added) according to the operation time, but is preferably an operation member that outputs a different value according to the operation amount.

1. Defocus amount change operation during shooting Since it is assumed that an optical zoom operation is performed during shooting, it is preferable to provide a blur amount change operation member separately from the zoom operation member.
(1-1) FIG. 5 is a perspective view illustrating an example of a camera that constitutes the blur amount changing operation member 51 by a pressing operation member. In FIG. 5, a blur amount changing operation member 51 is disposed on the upper portion of the monitor 13 configured to be rotatable with respect to the camera housing. An operation member [increase] that emits three or more kinds of operation signals that differ according to the pressing amount (operation amount) as an operation signal for increasing the amount of blur, and an operation signal that varies according to the pressing amount The operation member [decreasing] that is issued as an operation signal for reducing the amount of blur makes a pair. Unlike the case where the operation members are shared by disposing the blur amount change operation members 51 [increase] and [decrease] separately from the zoom operation members 54 [T] and [W], the blur amount change operation is performed while performing the zoom operation. Can be done. Further, since the pressing operation member is used, it is possible to suppress the swing of the imaging device that occurs during the operation as compared with the rotation operation member.

(1-2) FIG. 6 is a perspective view for explaining another example of a camera that configures the blur amount changing operation member 51 by a pressing operation member that outputs the same operation signal as in the example of FIG. In FIG. 6, a pair of blur amount changing operation members 51 [decrease] and [increase] are disposed in the vicinity of the pair of zoom operation members 54 [T] and [W].

(1-3) FIG. 7 is a perspective view for explaining an example of a camera that constitutes the blur amount changing operation member and the zoom operation member by the jog dial 52. In FIG. 7, the jog dial 52 issues a zoom operation signal (the rotation direction indicates zoom up or zoom down and the rotation amount indicates the zoom operation amount) according to the rotation operation, and increases or decreases the blur amount according to the pressing amount. An operation signal is issued to The jog dial 52 is urged in the rear direction of the camera of FIG. 7 by a spring member (not shown). When the jog dial 52 is pushed in, a signal for increasing the amount of blur (an operation signal having three or more different sizes depending on the pressing amount). ) And a signal to reduce the amount of blur when a jog dial is pulled out. When the photographer operates the jog dial 52 to obtain a desired amount of blur, the photographer operates a decision button provided separately to determine the amount of blur to be added. By making the zoom operation direction different from the blur amount changing operation direction, the operation member (jog dial 52) can be shared by two systems of operation.

(1-4) FIG. 8 is a perspective view illustrating an example of a camera that forms a blur amount changing operation member by the virtual diaphragm ring 53. In FIG. 8, a virtual diaphragm ring 53 that is rotatable about an axis parallel to the optical axis of the photographic lens 2 is disposed in the lens barrel of the photographic lens 2. In the virtual aperture ring 53, an index indicating the rotation angle is displayed for each predetermined virtual aperture level (for example, every aperture level or every 1/2 level) together with the virtual aperture value display (for example, F1, F2.8, etc.). It is provided and has a structure that produces a click feeling at each aperture position. For example, when the virtual aperture ring 53 is rotated by two stages in the direction in which the virtual aperture value is opened, image blur corresponding to the case where the optical diaphragm is opened by two stages is added. When the virtual diaphragm ring 53 is rotated, an operation signal for increasing or decreasing the amount of blur according to the rotation angle (virtual diaphragm stage number) is generated. By disposing the virtual diaphragm ring 53 separately from the pair of zoom operation members 54 [T] and [W] disposed at the upper part of the housing, it is possible to change the blur amount with the left hand while performing the zoom operation with the right hand. is there.

(1-5) FIG. 9 is a perspective view illustrating an example of a camera that configures the blur amount changing operation member 51 by a pressing operation member that outputs the same operation signal as in the example of FIG. In FIG. 9, a pair of blur amount changing operation members 51 [decrease] and [increase] are arranged on the left side surface of the camera casing. The point that each generates an operation signal for increasing or decreasing the blur amount according to the amount of pressing is the same as in the case of FIGS. A pair of zoom operation members 54 [T] and [W] are disposed on the upper right surface of the camera casing. According to the configuration of FIG. 9, the blur amount changing operation can be performed with the left hand while performing the zoom operation with the right hand.

(1-6) FIG. 10 is a diagram showing a modification of FIG. In FIG. 9, a pair of blur amount changing operation members 51 [decrease] and [increase] are arranged on the left side surface of the camera casing, and a pair of zoom operation members 54 [T] and [ W] is arranged. Even in the configuration of FIG. 10, the zoom operation with the right hand and the blur amount changing operation with the left hand can be performed simultaneously.

(1-7) FIG. 11 is a diagram for explaining an example of a camera in which an operation blur amount changing operation member 51A and a zoom operation member 54A, which are slide members that output operation signals similar to those in the example of FIG. It is. The blur amount changing operation member 51A is configured to generate an operation signal (an operation signal having three or more different sizes) for increasing or decreasing the blur amount in accordance with the slide amount (direction). The zoom operation member 54A is configured to issue an operation signal for zooming up / down according to the slide amount (direction). By making both operation members close to each other and aligning the operation direction, it is possible to simultaneously perform a zoom operation and a blur amount change operation using different fingers. In the example of FIGS. 5 to 11 described above, the case has been described in which an operation member that generates operation signals of three or more different sizes depending on the operation amount is used as the operation member that changes the amount of blurring. With such a configuration, the amount of blur added to an image can be changed well with time, and is particularly suitable when adding image blur to a moving image and a through image. Of course, instead of this, a member that emits a binary output signal may be employed as the operation member, and the amount of blur added to the image may be changed according to the operation time. For example, if the operation member for instructing zoom-up / zoom-down is combined with the blur amount changing operation member, the number of operation members can be reduced and the apparatus can be downsized. For example, it can be configured to function as an operation member for instructing zoom-up / zoom-down when shooting a through image or a moving image, and to function as a blur amount changing operation member in the playback mode. Further, a configuration using a quadruple switch 55 described later may be used. The quadruple switch 55 in this case functions as a blur amount changing operation member during shooting, and does not function as an operation member for menu selection.

2. Blur amount change operation during playback During playback (when recorded images are played back with the addition of electrical image blur enabled), it is possible to change the blur amount and perform electronic zoom operations. Zoom operation is not performed. The control circuit 5 reads the image data recorded on the recording medium 12, performs a decoding process on the read data, and sends the decoded data to the data processing circuit 10. The control circuit 5 performs a main subject extraction process from the decoded data (similar to step S103), and instructs the data processing circuit 10 to perform an image blur addition process on a region other than the extracted main subject (that is, the background region). (Similar to step S104). The control circuit 105 further changes the blur amount when the blur amount changing operation is performed (similar to steps S109 and S110).

(2-1) When the camera illustrated in FIGS. 5 and 6 and FIGS. 9 to 11 is played back, the blur amount changing operation member 51 (51A in FIG. 11) [increase] and [decrease] is pressed. And an operation signal for increasing or decreasing the amount of blur.

(2-2) At the time of reproduction of the camera illustrated in FIG. 7, an operation signal for increasing or decreasing the amount of blur is generated by rotating the jog dial 52. In other words, the operation of the jog dial 52 for changing the blur amount is different from that at the time of shooting so that the rotation direction corresponds to the increase / decrease of the blur amount and the rotation amount corresponds to the increase / decrease amount. Is limited.

(2-3) In the case of the camera illustrated in FIGS. 5 to 7, a quadruple switch (SW) 55 provided as an operation member for menu selection may be used as a blur amount changing operation member during reproduction.

(2-4) At the time of playback of the camera illustrated in FIG. 8, the amount of image blur added to the playback image may be changed based on the operation of the virtual aperture ring 53. In this case, the virtual aperture ring 53 may be an operation member that actually changes the aperture value of the optical aperture. An operation signal output from the operation member is input to the control circuit 5, and under the control of the control circuit 5, the amount of image blur added to the reproduced image is changed. It goes without saying that even if the optical aperture is driven and the optical aperture value is changed by the operation of the operating member, the reproduced image is not affected at all. From the viewpoint of power consumption, when this operating member is operated in the playback mode, it is preferable to change the amount of image blur added to the playback image without driving the optical aperture.

(2-5) In addition, image blur is not added at the time of through image shooting, and the still image that is actually shot is recorded on the recording medium 12 before or after being recorded and then displayed on the monitor 13 to add image blur. In such a case, the zoom operation and the image blur addition / change operation are not necessarily performed simultaneously. Therefore, the operation members 51, 52, 53, and 51A for changing the blur amount shown in FIGS. 5 to 11 are not always necessary, and can be used as operation members used for other purposes such as the zoom operation member 54. For example, if the switch [T] of the zoom operation member 54 is pressed while the still image that has been actually captured is displayed on the monitor 13, the amount of image blur increases according to the operation time, and the switch [W] is pressed. Then, the amount of image blur is reduced according to the operation time. Further, when the switch [T] and the switch [W] are pressed simultaneously, the image blur added on the monitor 13 can be reset (the image blur is not added). Such an operation may be performed by the quadruple switch 55. If the amount of image blur to be added is changed using the quad switch 55, the image on the monitor 13 can be electrically enlarged by operating the zoom operation member 54 and the like, and image blur is added. However, it is possible to perform image confirmation over details.

  Along with the blur amount changing operation as described above, the virtual aperture value may be superimposed and displayed on the monitor 13 together with the image. The virtual aperture value is an optical aperture value that gives an optical blur equivalent to the amount of image blur to be added. The virtual aperture value may be calculated, for example, as a function of data indicating an LPF characteristic (or a point spread function) that determines the image blur addition amount, and may be read from the lookup table using the image blur addition amount as an argument. You may make a table in advance. By displaying the virtual aperture value calculated in this way, the photographer can intuitively grasp the amount of image blur to be added.

  When displaying the virtual aperture value on the monitor 13, when the actual optical aperture value of the photographing lens 2 is displayed on the monitor 13, the optical aperture value and the virtual aperture value are displayed in different modes (for example, different display colors). This is even more preferable. By displaying the images in different modes, the photographer can easily identify both.

  When an electronic zoom operation is performed in the playback mode for image editing work such as trimming, a part of the playback image is displayed on the display screen of the monitor 13. In this case, the main subject focused at the time of shooting may not be included in the electronic zoom range being displayed. In this case, a region that maximizes the integrated value (so-called focus evaluation value) of high-frequency components for the image signal corresponding to the display range of the monitor 13 is extracted, and this region is regarded as the main subject on the zoom screen. The area including the maximum focus evaluation value is an area that is considered to be in focus most in the electronic zoom screen being displayed (the sharpness of the image is high). With such a configuration, even if the focus detection area in the automatic focusing operation at the time of shooting is not included in the range that the monitor 13 intends to display in an enlarged manner, an area that does not add image blur is appropriate. Can be judged. When the focus detection area used for the automatic focusing operation is in the range to be enlarged and displayed by the monitor 13, an image blur may be added to an area other than this area on the basis of this area. In this case, the above-described calculation process of the integrated value of the high frequency components is not performed. The control circuit 5 instructs the data processing circuit 10 to add an image blur to a region other than the extracted region (that is, the background region) with reference to the extracted region (similar to step S104). The control circuit 5 further changes the blur amount when the blur amount changing operation is performed (similar to steps S109 and S110).

  If the region including the maximum focus evaluation value cannot be extracted from the image signal corresponding to the display range of the monitor 13, or if the instruction is made to use the center of the electronic zoom screen as a reference, the display is in progress. The center of the electronic zoom screen is regarded as the in-focus area. The control circuit 5 instructs the data processing circuit 10 to add an image blur to an area other than the center with reference to the center. With such a configuration, image blur is added to an area other than the center of the screen where there is a high possibility that the subject of interest is present, and thus the possibility of image blur being added to an incorrect place is reduced. To do.

According to the first embodiment described above, the following operational effects can be obtained.
(1) An imaging device (an image reproduction device or an image processing device) calculates an integrated value of high-frequency components of an image signal to detect a region where the sharpness of the image is high, and is different from the detection region in the image signal. Since the image blur is added to the signal corresponding to the area, it is possible to appropriately extract the area where the image blur should be added (the background area different from the in-focus area) and add the blur.

(2) The imaging device (image reproduction device) of (1) above corresponds to the display range of the monitor 13 when performing resolution conversion in the direction of increasing the electronic zoom magnification and displaying a part of the reproduction image on the monitor 13 in an enlarged manner. Since a region with high image sharpness is detected from the image signal to be processed, a region to be blurred (background region different from the focused region) in the display range is appropriately extracted and blurred. Can be added. The above-described electronic zoom operation is not limited to the one that is performed continuously, but includes a case where trimming and enlarging operation is performed only once.

(3) When the imaging device (image reproduction device) of (1) performs resolution conversion in the direction of increasing the electronic zoom magnification and enlarges and displays a part of the reproduction image on the monitor 13, the center of the display range of the monitor 13 is displayed. Since the area corresponding to the portion is detected, it is possible to add blur to the center of the display range when there is no focused area in the display range.

(4) If the size of the image blur to be added is changed according to the resolution conversion ratio (electronic zoom magnification), the same operation as the optical blur added in the conventional optical zoom operation is realized. it can. In particular, even when the electronic zoom operation is performed following the optical zoom operation, an image without a sense of incongruity can be obtained.

(5) When both image blur addition and resolution conversion (electronic zoom) are performed and resolution conversion is performed at least in the direction of increasing the electronic zoom magnification, the image blur is added after resolution conversion. As a result, image quality deterioration can be suppressed, and the maximum enlargement magnification of the electronic zoom can be set higher than in a configuration in which image blur is added before resolution conversion.

(6) Since the operation signal for increasing / decreasing the blur amount is issued from the operation blur amount changing operation member 53 which is a dial member, the size of the blur can be changed by a simple operation maintaining the conventional operability. .

(7) If a virtual aperture value (an optical aperture value that gives an optical blur equivalent to the amount of image blur to be added) is superimposed on the monitor 13 together with the image, the photographer can set the amount of image blur to be added. It can be grasped intuitively. In this case, it is even more preferable to display a virtual focal length corresponding to the electronic zoom magnification.

(Modification 1)
In addition to changing the added amount of image blur according to the operation of the blur amount changing operation member, the image blur amount set in the default state is set according to the distance (shooting distance) information between the subject and the imaging device. It is good also as a structure to change. As the distance information, distance information acquired during the AF operation is used. The control circuit 5 considers that the distance between the moving subject and the stationary background has increased when the shooting distance between the moving subject and the imaging apparatus becomes shorter than a certain point. When performing an AF operation on a moving subject, the focus adjustment state for the moving subject does not change because the operation of focusing on the moving subject is continuously performed. In this case, the control circuit 5 performs control so that the amount of blur added to the background area is increased compared to the certain time point.

  On the other hand, when the shooting distance between the moving subject and the imaging device becomes longer than a certain point, the control circuit 5 considers that the distance between the moving subject and the stationary background is reduced. The control circuit 5 controls the amount of blur added to the background area to be smaller than the certain time point.

  In the first modification, the example in which the image blur amount is changed according to the distance between the moving subject and the background has been described. However, distance information is acquired for each of the plurality of moving subjects, and the distance between the plurality of moving subjects is determined. The amount of blur added to each subject area may be dynamically changed. As the distance information for a plurality of moving subjects, for example, distance information to a subject existing in each of the plurality of focus detection regions may be acquired.

(Modification 2)
In the above description, when the half-press operation is canceled after adding the image blur (determination is negative in step S111), the addition of the image blur is canceled, but the optical aperture of the taking lens 2 is changed. Alternatively, it may be configured to cancel the addition of image blur. The optical diaphragm is changed by, for example, a diaphragm ring (not shown) or an operation signal from the operation member 7. In response to such an instruction to change the optical aperture, the control circuit 5 temporarily cancels the image blur added at the present time. As a result, both optical blur and electrically added image blur can be quickly reset.

(Modification 3)
In the description of step S105, it is determined whether or not there is a motion on the shooting screen by detecting a motion vector between frames. Instead, any one of motion sensors such as an angular velocity sensor, an angular acceleration sensor, and an acceleration sensor may be provided in the imaging apparatus, and a determination may be made using a detection result of the sensor.

(Modification 4)
As described above, when both the determinations in step S105 and step S107 are performed using motion vectors, the determination process in step S105 and the determination process in step S107 may be performed in parallel.

(Modification 5)
In the case of an imaging apparatus that is set to display a through image on the monitor 13 without adding image blur and is set to add image blur only to a main captured image obtained by main shooting, Instead of the contents described in step S113, the exposure for the main photographing may be determined as follows. That is, the exposure for the main photographing is calculated based on the signal value (brightness information) of the latest through image data to which no image blur is added, and this calculated value is used as the amount of image blur added to the main photographed image. The exposure is corrected accordingly, and the exposure for the main photographing is determined based on the calculated value after the correction. Based on the determined exposure, the imaging device sets an electronic shutter speed (charge accumulation time) of the imaging device 1, a diaphragm, an amplification degree of an image signal output from the imaging device 1, and performs an imaging operation. As a result, for example, when a spot photometry area includes a bright spot, and image blur is added to the bright spot, the image blur area becomes larger than the photometry area. Even when the determination of the brightness of the image changes, a real captured image with appropriate brightness can be obtained.

(Modification 6)
In the process of determining permission / prohibition of image blur addition (and change of the added content), for example, when there is no area having a brightness of a predetermined level or more in the background area of the image even in the night view portrait mode. The example of prohibiting the addition of image blur (and the change of the added content) has been described, but it may be as follows. In other words, when displaying a through image or an actual captured image on the monitor 13, prohibiting the addition of image blur is set as a default setting, and an operation signal instructing the addition of image blur is input to the control circuit 5 from the operation member 7. Only when the image is blurred. Of course, in a state where the addition of image blur is permitted, the data added with the image blur can be recorded on the recording medium 12.

(Modification 7)
Whether or not a human face is recognized in the through image, instead of the process for determining whether to allow or prohibit the addition of image blur (and change of the added content) according to the setting state of the shooting mode such as the portrait mode The permission / prohibition of the addition of image blur (and the change of the added content) may be determined according to. In this case, the control circuit 5 performs a known face recognition process using a through image that is captured after the above-described AF operation and has no image blur, and extracts a face area. The control circuit 5 sets the subject including the extracted face area as the main subject. Only the image in which the human face is recognized may be configured to allow image blurring by the control circuit 5. With such a configuration, it is possible to automatically perform portrait photography when a human face is recognized. Further, the image blur may be added when the conditions of the number of human faces (for example, two or less) and the size (a predetermined value or more) are satisfied.

  Note that even when it is set to add image blur (and change of the added content) only to the actual captured image (not added to the through image), the through image without the image blur is used. It may be configured to perform face recognition processing and permit addition of image blur (and change of the added content) to the actual captured image when a face area is recognized. With such a configuration, subject recognition processing can be performed accurately and quickly.

(Modification 8)
Instead of setting the aperture priority auto mode when addition of image blur is permitted (step S102), the optical aperture of the taking lens 2 may be set to a predetermined aperture value (for example, an open value). Since the optical blur caused by the optical aperture is maintained in a predetermined state, it is possible to prevent the blur amount of the main image (the sum of the optical blur and the added image blur) from fluctuating as the subject luminance varies. This facilitates an operation for changing the setting of the image blur addition amount. In addition, by setting the optical aperture to a predetermined aperture value, the charge of the image sensor 1 is real-time according to the number of stages of the optical aperture change so that the brightness of the through image displayed on the monitor 13 does not change before and after the setting. It is preferable to vary the accumulation time (or the amplification factor of the signal output from the image sensor 1).

  When the predetermined aperture value is fixed to the open value, the depth of field becomes shallow, and the confirmation and designation operation of the area to which the image blur is added becomes easy.

(Modification 9)
Although the image blur is added to the background area of the main subject extracted from the through image, the image blur is added to the area indicated by the operation signal of the operation member 7 (for example, a signal indicating the cursor position). It may be configured to do. An image blur is added to the subject indicated by the cursor, and a shooting effect that enhances the main subject is obtained.

(Modification 10)
In the above description, when the release button is pressed halfway (Yes in step S101), image blur is added to the image displayed on the monitor 13, but the operation member 7 (for example, a view switch) is used. You may comprise so that the monitor 13 may display the image which added the image blur when operated. When displaying an image to which image blur is added according to the operation of the view switch on the monitor 13, it is preferable to display the same imaging screen (through image) continuously while the operation signal from the view switch continues. It is. The photographer can check the display screen (freeze screen) slowly. In addition, as a result, only when the photographer wants to check the image blur, the image blur is added, so the signal processing load is small. In addition, the same usability as a conventional single-lens reflex camera can be realized.

  When the display on the monitor 13 is off, the operation signal from the view switch is invalidated. In this case, the addition of image blur to the through image is omitted as in the case where addition of image blur (and change of the added content) is set to be performed only on the actual captured image.

(Modification 11)
Contrary to the modification 10, the monitor 13 may be turned on (activated) when an operation signal is input from the view switch while the display of the monitor 13 is turned off. In this case, the monitor 13 is activated in accordance with the operation of the view switch, and an image with image blur is displayed on the monitor 13. While the operation signal from the view switch continues, it is preferable to display the same through image as a still image.

(Modification 12)
Although an example in which addition of image blur (and change of addition contents) is permitted when the shooting mode at the time of shooting is set to portrait mode and macro mode has been described, the following configuration may be used. That is, when the operation menu mode when the portrait mode and the macro mode are set includes a menu item related to “image blur”, and the menu item is instructed to “add” “image blur”. Allows adding image blur (and changing the added content). On the other hand, even if the shooting mode is portrait mode or macro mode, if the menu item is instructed not to add “image blur”, it is prohibited to add image blur (and change the added content). To do. Even in the portrait mode or the macro mode, an imaging apparatus that can fulfill the photographer's desire to decide whether or not to add image blur can be obtained. On the other hand, even if the setting to allow / do not allow image blur is higher than the shooting mode setting (prioritized setting) and the shooting mode is not portrait mode or macro mode, If the setting is to permit the addition of blur, the configuration may be made to allow the addition of image blur.

(Modification 13)
When changing the amount of image blur to be added, the image blur amount to be added is changed (determined) according to the pressing amount (or rotation amount) of the blur amount changing operation member. The image blur amount to be added may be changed according to the virtual aperture value indicated by the operation signal. In this case, the control circuit 5 superimposes the virtual aperture value corresponding to the operation signal from the blur amount changing operation member on the monitor 13 together with the image, and performs data processing so as to add the image blur corresponding to the virtual aperture value. An instruction is sent to the circuit 10. The virtual aperture value is an optical aperture value that gives an optical blur equivalent to the image blur amount added to the current image. By configuring the blur amount changing operation as a virtual aperture value (for example, F11 → F5.6) changing operation, the photographer intuitively grasps the amount of image blur added to the current image. be able to.

(Modification 14)
When changing the amount of image blur to be added, the image blur amount to be added may be changed (determined) according to the number of virtual aperture stages indicated by the operation signal from the blur amount changing operation member. In this case, the control circuit 5 superimposes the virtual diaphragm step number corresponding to the operation signal from the blur amount changing operation member on the monitor 13 together with the image, and performs data processing so as to add the image blur corresponding to the virtual diaphragm step number. An instruction is sent to the circuit 10. The number of virtual aperture steps is the number of optical aperture steps that gives an optical blur equivalent to the amount of image blur added to the current image. By configuring the blur amount changing operation as a virtual aperture step (for example, -2 step) changing operation, the photographer can intuitively grasp the amount of image blur added to the current image. it can.

(Modification 15)
In both cases of adding image blur and electronic zoom operation, the point to add image blur after electronic zoom to suppress image quality degradation, and the maximum enlargement magnification of electronic zoom as the degree (amount) of added image blur increases However, the degree (amount) of image blur to be added may be changed according to the electronic zoom magnification. When the electronic zoom magnification is small, the amount of added image blur is kept small. Usually, the longer the focal length of the taking lens 2 (the larger the magnification), the greater the amount of optical blur. According to said structure, the image similar to this operation | movement can be obtained also by electronic zoom operation | movement.

  Conversely, when the electronic zoom magnification is large, the image blur addition amount is increased. However, when the enlargement magnification by the electronic zoom processing on the image before the electronic zoom is a predetermined magnification (for example, 3 times) or more, the addition of image blur is omitted. (Addition amount is set to 0). Thereby, it is possible to stop adding unnecessary image blur to an image whose image quality has deteriorated at a high electronic zoom magnification. Such a configuration can be similarly applied to an apparatus that performs electronic zoom processing after adding image blur.

(Modification 16)
When the imaging apparatus is set to perform AE bracketing shooting that obtains a plurality of image data at each exposure value by gradually changing the exposure conditions during actual shooting, the aperture value of the shooting lens 2 is changed. A plurality of image data may be obtained by changing the exposure condition. In this case, the control circuit 5 determines the amount of image blur to be added to each image so that the blur amount of the still image (the sum of optical blur and added image blur) between the plurality of images becomes substantially constant. Make them different. Thus, when normal AE bracketing is performed with the optical aperture value changed, the brightness and subject depth (blurred state) differ between the images, but in the modified example 16, only the brightness differs between the images. Thus, an image with the same depth of field can be obtained.

(Modification 17)
It may be configured to perform an image blur bracketing shooting in which a plurality of image data is obtained with each additional amount by changing the additional amount of image blur at the time of main photographing stepwise. The control circuit 5 varies the added amount of image blur step by step between a plurality of images. Thereby, it is possible to obtain images having different subject depths between the respective images without changing the exposure conditions during the main photographing.

(Modification 18)
Instead of setting the aperture priority auto mode when image blur addition is permitted (step S102) or setting the optical aperture of the photographic lens 2 to a predetermined value (modified example 8), the imaging apparatus determines. The size of the image blur to be added may be determined according to the control aperture value. In the imaging apparatus in this case, the exposure mode is set to the program auto mode or the shutter speed priority auto mode. The program auto mode is an exposure mode in which a combination of a control aperture value and a control shutter time (charge accumulation time) is determined according to brightness information. At this time, the amplification degree of the image signal may be further changed. A combination of the control aperture value and the control shutter time (charge accumulation time) is stored in the control circuit 5 in advance as program diagram data. The shutter speed priority auto mode is an exposure mode in which a control aperture value and the like are determined according to brightness information so that proper exposure can be obtained at a set shutter time (charge accumulation time).

  When the exposure mode is the program auto mode or the shutter speed priority auto mode, the optical aperture value of the taking lens 2 at the time of shooting is controlled to the control aperture value, so that the optical aperture value is set according to the detected brightness information of the subject. The size of the resulting optical blur is different. Specifically, the optical blur increases when the control aperture value approaches the open value, and the optical blur decreases when the control aperture value is reduced. Therefore, if the configuration is such that the size of the image blur to be added is determined according to the control aperture value so as to cancel such a fluctuation in the size of the optical blur, the blur amount of the main image (optical blur is added). The sum of the blurred images) can be kept constant.

<Modified example 1 of monitor display>
Another display mode for displaying an image on the monitor 13 will be described with reference to FIG. According to FIG. 4 (c), an area where image blur is not added (in this case, the area of the main subject 300) is another area so that the photographer can easily visually recognize the area where the image blur is added / the area where the image blur is not added. Display brighter than the area. In FIG. 4C, the difference in brightness is represented by changing the thickness of the contour line of each main subject. The thicker the line, the brighter the brightness is displayed. That is, the main subject 300 is displayed brightest, and the subject 301 and the subject 302 are displayed in the order of the subject 301 and the subject 302 darker as the amount of added image blur (the magnitude of the blur effect) increases. By displaying the subject with the brightness changed in this way, the photographer can easily visually recognize the region where the image blur is added / the region where the image blur is not added, and intuitively determine the image blur amount added based on the brightness of the display. Can be grasped. Note that the subject may be displayed brighter as the amount of added image blur increases.

<Modified example 2 of monitor display>
When an image with added image blur is displayed on the monitor 13, a difference in the added amount of image blur may be represented by coloring. In this case, the control circuit 5 normally displays a monochrome image on the monitor 13, and when displaying an image with an image blur, the control circuit 5 displays the image blur-added region with a color. At this time, the greater the amount of added image blur (the magnitude of the blur effect), the darker the subject is displayed. Thus, by displaying the subject with different shades of color, the photographer can easily visually recognize the areas where the image blur has been added / the areas where the blur has not been added, and intuitively understand the amount of image blur added based on the shade of the color. Can be grasped.

<Modified example 3 of monitor display>
In addition, in order to improve the photographer's visibility in the region where the image blur is added, the display image on the monitor 13 may be displayed with the added amount of the image blur larger than the actual amount. Further, when the size of the monitor 13 is limited due to the downsizing of the image pickup device, the additional area of the image blur may be expanded and highlighted so that the photographer can easily see even from a small screen. . When the screen of the monitor 13 is small or the number of display pixels on the monitor 13 is small, the added amount of the image blur and the added region are highlighted so that the photographer can easily understand the region with or without the image blur added. Can be displayed.

  The display modes according to the first to third modifications of the monitor display described above can be switched between a normal display mode (the display mode described in the first embodiment) according to the operation signal from the operation member 7. May be. For example, if the highlighting switch (not shown) is configured to display only in the above-described manner, the blur added area can be confirmed immediately when the photographer needs it, which is even more preferable. It is.

(Second embodiment)
In the second embodiment, image blur is added to an image whose size is increased by joining a plurality of images. A technology is known that uses a plurality of frames of still images taken at different times under the same shooting conditions, and generates a composite image with a wide viewing angle by joining a part of these still images so that they overlap. It has been. The imaging apparatus according to the present embodiment controls the amount of image blur added to the composite image generated in this way (hereinafter referred to as a panoramic image) as follows.

  The imaging device is set in advance to a panorama mode (an operation mode in which a plurality of frames of images are joined to obtain a panoramic image with a wide viewing angle) by menu operation, and image blurring by the imaging device is added (and additional content is added). Change) is permitted. Here, a case will be described as an example where the left side image forming the panoramic image is shot by the first frame shooting and the right side image forming the panoramic image is shot by the second frame shooting.

<First frame>
When the imaging device performs a still image main shooting operation under predetermined shooting conditions in response to a full-press operation signal based on a full-press operation of the release button, the imaging device performs a resolution conversion for display on the first frame. The area about 1/3 to the right of the quick view image) is displayed on the area about 1/3 to the left of the display area of the monitor 13. The photographer presses the release button halfway to display on the monitor 13 a through image (image data that has been subjected to display resolution conversion) before the second frame still image is captured. The photographer matches the captured image of the first frame displayed in the approximately 1/3 left area of the monitor 13 with the through image displayed in the approximately 2/3 right area of the monitor 13. The imaging range by the imaging device is moved.

<Second frame>
The imaging apparatus performs a still image main shooting operation for the second frame under the same shooting conditions as the first frame in response to a full pressing operation signal based on the full pressing operation of the release button. The imaging apparatus records the first frame image data and the second frame image data thus captured in the recording medium 12 in association with each other.

<Blur addition processing>
In this embodiment, when adding image blur to a panoramic image, image blur is added to each of the first frame image and the second frame image described above in units of frames. The imaging apparatus adds image blur to the image of the first frame and then adds image blur to the image of the second frame. At this time, the blur amount set in the right end region (about 1/3 right) of the first frame image is also applied to the blur amount added in the left end region (about 1/3 left) of the second frame image. The amount of blur added to the joint between both images is made to be substantially equal. Such image blur addition processing is performed by the data processing circuit 10 under the control of the control circuit 5.

  When the blur amount is changed with respect to the image of one frame in a state where the blur amount is added to each of the plurality of frames constituting the panorama image as described above, the data processing circuit 10 As for the image blur added to the image of other frames to be joined with the image whose image has been changed, the amount of blur to be added is automatically set so that the amount of image blur added at each joint is substantially equal. change.

<Monitor display of panoramic image>
The imaging device displays a panoramic image on the monitor 13 when operated as follows. In the state where a plurality of thumbnail images (for example, nine images) are displayed on the monitor 13, an operation for selecting any one thumbnail image (for example, the ENTER switch is operated with the cursor placed on one of the thumbnail images) ) Is performed, the imaging apparatus displays a panoramic image including a frame image (still image main captured image) corresponding to the thumbnail image on the monitor 13. Thus, the panoramic image can be easily displayed on the monitor 13 by selecting only one thumbnail image corresponding to any one of the images of the plurality of frames constituting the panoramic image.

  When the panorama image is displayed on the monitor 13, the display mode is a display mode in which the entire panoramic image after joining is displayed on the monitor 13 (the number of pixels in the horizontal direction of the panorama image is matched with the number of pixels in the horizontal direction of the monitor 13. The resolution (number of pixels) is converted and margins are provided in the upper and lower display areas of the monitor 13), and a part of the panoramic image after the joining is displayed on the monitor 13, and the display range is horizontal according to the horizontal scrolling operation The display mode of moving in the direction (the resolution (number of pixels) is converted so that the number of pixels in the vertical direction of the panoramic image matches the number of pixels in the vertical direction of the monitor 13 and a part of the panoramic image is displayed) can be selected. Composed. The former display mode is suitable for display in the case of Modification 20 described later, and the latter display mode is suitable for the case of the second embodiment. The imaging device switches display according to the display mode set by the menu operation.

As described above, according to the second embodiment, the following operational effects can be obtained.
(1) When data of a plurality of images constituting a composite image are individually recorded on the recording medium 12 like a panoramic image, the amount of blur added to the joint portion is uniformed between the plurality of frames to be joined. Thus, the continuity of image blur at the joint portion of the panoramic image is maintained, and a panoramic image without a sense of incongruity is obtained.

(2) When the amount of image blur added to one of the frame images constituting the panoramic image is changed, the amount of image blur added to another frame image joined to the frame image is automatically set. Changed to keep the continuity of image blur at the junction of panoramic images. Thereby, it is not necessary to change the amount of image blur for each frame image constituting the panoramic image, and an imaging device that is easy for the user to handle is obtained.

(Modification 19)
When changing the amount of image blur to be added to one of the frame images constituting the panoramic image, the configuration is such that the change of the amount of image blur added to the joint portion joined to the other frame image is prohibited. May be. For the other areas excluding the joint portion, the change in the amount of image blur is allowed for each frame image. Even with this configuration, it is possible to maintain the continuity of the image blur at the joint portion of the panoramic image.

(Modification 20)
When panorama mode and image blur addition are permitted, instead of adding image blur in units of frames to each of a plurality of frames constituting the panorama image as in the second embodiment, the image is as follows: You may add blur. That is, when adding image blur to a panoramic image, addition of image blur in units of frames is prohibited, and image blur is added to the entire panoramic image after joining. With such a configuration, it is possible to prevent the image blur amount from becoming discontinuous at the joint portion of the panoramic image, and to obtain a panoramic image without a sense of incongruity.

  The recording format of the image data to be recorded on the recording medium 12 in the state of the modified example 20 (that is, the state in which panorama node and image blur addition are permitted) is the panorama image data to which image blur is added and is joined. The original image data for each previous frame may not be left on the recording medium 12. In this case, when the process of adding image blur to the panoramic image after joining is completed, the control circuit 5 deletes the data of the still image main photographed image of each frame before joining from the recording medium 12. However, the thumbnail image data is retained. When an operation for displaying a panoramic image on the monitor 13 is performed, the control circuit 5 reads the panoramic image data with the image blur added from the recording medium 12 and displays the panoramic image on the monitor 13.

(Modification 21)
Further, the panorama image to which image blur is added in the entire panorama image may be divided at the joint portion of the panorama image, and the data of the divided images may be associated with each other and recorded on the recording medium 12. When an operation for displaying a panoramic image on the monitor 13 is performed, the control circuit 5 reads the divided image data divided and added in association with the image blur from the recording medium 12, and stores these data. The rejoined panoramic image is displayed on the monitor 13.

(Modification 22)
In panorama mode, there is a demand to view the original image of each frame before joining without joining them. In order to meet this demand, the data of the still image of each frame is recorded as two types of files for single viewing and panoramic viewing, and image blur is added to one file (single viewing). The image data in a state may be recorded, and the image data in a state in which no image blur is added may be recorded in the other file (for panoramic viewing).

(Modification 23)
In the second embodiment described above, an example has been described in which the overlapped field area is imaged in the first frame and the second frame, and the obtained image is synthesized. It is not necessary to be in contact with each other. In this case, the amount of blurring of the right edge of the captured image of the first frame is made equal to the amount of blurring of the left edge of the captured image of the second frame, so that the image blur on the panoramic image is reduced. The continuity of the added amount can be maintained. In the second embodiment and each modified example, an example in which a panoramic image is generated by synthesizing two frames of images has been described. However, a case where a wide-field image is obtained by synthesizing three or more frames is also illustrated. The same can be applied. Furthermore, the present invention can be similarly applied to a case where a wide-field image is obtained in the vertical direction of the screen.

  In the above description, an example in which image blur is added to a background area different from the main subject has been described. In addition, an image blur may be added to an area on the imaging screen including an image due to dust (foreign matter) or scratches attached to the imaging optical system such as the imaging lens 2 or the imaging surface of the imaging element 1. Good.

  The amount of image blur added to the area on the imaging screen including the image due to dust (foreign matter) or scratches is changed according to the contrast between the area including the image due to dust (foreign matter) or scratches and the background area. When the contrast is large, the additional amount is increased, and when the contrast is small, the additional amount is decreased. By adopting such a configuration, it is possible to prevent image blur that is more than necessary from being added to a dust (foreign matter) adhering region and the like and to prevent loss of image information that is originally required.

  The imaging apparatus has an operation mode for detecting dust (foreign matter) and scratches attached to the imaging surface and the imaging optical system from an image signal output from the imaging element 1, and when the operation mode is set, Then, an image corresponding to an image signal (data) without image blur is displayed on the monitor 13. In this operation mode, addition of image blur may be prohibited. The photographer can take an image of, for example, white paper and check a dust or scratch image based on the image displayed on the monitor 13. In this state, the data processing circuit 10 can analyze the image data to obtain information about the size of dust, scratch images, and the position on the screen. In this way, more accurate detection is possible by adopting a configuration that detects dust (foreign matter) and scratches attached to the imaging surface and imaging optical system based on image signals (data) without image blurring. It can be carried out.

  In addition, the image pickup apparatus has an operation mode for automatically detecting dust (foreign matter) and scratches attached to the image pickup surface of the image sensor 1, and when the operation mode is set, the dust (foreign matter) is included. Dust (foreign matter) and scratches may be detected using an image signal (data) corresponding to an area on the imaging surface and before the image blur is added.

  In each of the embodiments described above, the imaging apparatus has been described as an example. However, the present invention can also be applied to an image reproduction apparatus or an image processing apparatus that displays a reproduction image based on recorded image data on the monitor 13. In this case, in place of the image signal from the image sensor 1, resolution conversion or image blur is added to the image data read from a memory card or a hard disk device.

  The above description is merely an example, and the interpretation of the invention is not limited to the correspondence between the components of the above-described embodiment and the components of the present invention.

It is a block diagram which shows an example of the imaging device by embodiment of this invention. It is a flowchart explaining the flow of the imaging | photography process in which a control circuit adds image blur. It is a figure which illustrates the through image acquired at different time. (a) It is a figure which illustrates a through image, without adding image blur. (b) It is a figure which illustrates the through image to which the image blur was added. (c) It is a figure which illustrates other display modes. It is a perspective view which illustrates a camera. It is a perspective view which illustrates a camera. It is a perspective view which illustrates a camera. It is a perspective view which illustrates a camera. It is a perspective view which illustrates a video camera. It is a perspective view which illustrates a video camera. It is a perspective view which illustrates a video camera.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Imaging device 2 ... Shooting lens 5 ... Control circuit 7 ... Operation member 9 ... Signal processing circuit 10 ... Data processing circuit 11 ... Compression / decompression circuit 12 ... Recording medium 13 ... Monitor 14 ... Display control circuit

Claims (4)

Blur addition means for processing the image signal and adding blur to the image;
A wide-field image generating means for generating a wide-field image by joining a plurality of image signals;
Control means for controlling the wide-field image generation means and the blur addition means so as to process the wide-field image signal generated by the wide-field image generation means when adding blur to the wide-field image; An image processing apparatus comprising: Blur addition means for processing the image signal and adding blur to the image;
A wide-field image generating means for generating a wide-field image by joining a plurality of image signals;
When blurring the wide-field image, each of the plurality of image signals is processed so as to align the blur of the image at the joint, and the processed multiple-image signals are joined to form a wide-field image. An image processing apparatus comprising: a control unit that controls the blur addition unit and the wide-field image generation unit to generate the image. The image processing apparatus according to claim 2,
When the blur amount added to the wide-field image is changed, the control means allows a change in a region excluding the joint portion in each of the plurality of image signals to be joined. An image processing apparatus. The image processing apparatus according to claim 2,
When the blurring amount added to the image with the wide field of view is changed, when the blurring amount of the joint portion is changed for any of the plurality of image signals to be joined, the control unit joins the joint portion. The image processing apparatus is characterized in that the other image signal joints are also changed so as to have the same amount of blurring.

Images