JP5418020B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus.

  There is an imaging device that performs image processing on an image after imaging (see Patent Document 1).

JP 2006-067521 A

  Since the imaging device is designed in consideration of operability in imaging, there are few user interfaces that can be used for operations when image processing is executed on the imaging device. For this reason, when performing image processing such as applying a miniature effect to an image, there is a case where the user does not have a means for changing a parameter value.

  Therefore, in order to solve the above-described problem, as one aspect of the present invention, an input unit (390) that receives instructions for the width and position of the attention area in the original image for the band-shaped attention area (580) included in the original image; An imaging apparatus is provided that includes a processing unit (420) that performs image processing that lowers the spatial frequency of the background region (590) obtained by removing the instructed attention region from the original image to be lower than the spatial frequency of the attention region.

It is the perspective view which looked at imaging device 100 from the front side. 2 is a rear view of the imaging apparatus 100. FIG. 2 is a schematic diagram illustrating an internal structure of the imaging apparatus 100. FIG. 3 is a block diagram showing a structure of a main control unit 300. FIG. It is a block diagram which shows the structure and function of ASIC400. It is a figure which shows an example of the display image 501 in case image processing is selected. It is a figure which shows an example of the display image 502 when image processing is selected. It is a flowchart which shows the flow of the image data in image processing. 5 is a diagram illustrating an example of a mask pattern 601. FIG. It is a flowchart which shows the operation procedure in image processing. It is a figure which shows the display image 503 containing the attention area | region 580 from which the position was changed. It is a figure which shows the mask pattern 602 corresponding to the display image 503. FIG. It is a figure which shows the display image 504 containing the attention area | region 580 from which the position was changed. It is a figure which shows the mask pattern 603 corresponding to the display image 504. FIG. It is a figure which shows the display image 505 from which direction differs. It is a figure which shows the mask pattern 604 corresponding to the display image 505. FIG. It is a figure which shows the display image 506 from which inclination differs. It is a figure which shows the mask pattern 605 corresponding to the display image 506. FIG. It is a figure which shows the display image 507 containing the attention area 580 from which the width | variety was changed. It is a figure which shows the mask pattern 606 corresponding to the display image 507. FIG. It is a figure which shows the other mask pattern 607. FIG. It is a figure which shows the display image 508 containing the attention area | region 580 where the width | variety was changed. It is a figure which shows the mask pattern 608 corresponding to the display image 508. FIG. It is a figure which shows the other mask pattern 609. FIG.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  FIG. 1 is a perspective view of the imaging system 101 as viewed from the front side. The imaging system 101 includes an imaging device 100 and a lens unit 200. In the imaging system 101 of FIG. 1, the lens unit 200 is detachable from the imaging apparatus 100 by a user, but is not limited thereto, and the imaging system 101 in which the lens unit 200 cannot be detached from the imaging apparatus 100 may be used.

  The imaging apparatus 100 is provided with switches such as a power switch 161, a release switch 191, and a dial switch 180. The power switch 161 is used for powering on and off the imaging apparatus 100, and the release switch 191 is used for instructing the timing of imaging. The dial switch 180 is used to switch a plurality of options of various functions and imaging conditions of the imaging apparatus 100.

  FIG. 2 is a rear view of the imaging apparatus 100. A main display unit 172 capable of color display is disposed on the back surface of the imaging apparatus 100. The main display unit 172 has a high resolution and a wide display area, and is used when a captured image is reproduced.

  The main display unit 172 is also used as part of the interface for the user when setting the operating conditions of the imaging apparatus 100 and the like. Further, it is used as a user interface in image processing to be described later.

  A cross key 193 is disposed on the back surface of the imaging apparatus 100. The cross key 193 includes at least four switches arranged vertically and horizontally.

  Furthermore, on the rear surface of the imaging device, there is a function assigned to a push button switch arranged around the main display unit 172 in accordance with the setting of the operation mode of the imaging device 100 such as an imaging mode, a playback mode, and a setting mode. Change. In an operation mode for executing image processing to be described later, an OK button 195, a reduced display button 197, a playback button 199, and a cross key 193 are used as operation buttons.

  FIG. 3 is a schematic diagram illustrating the internal structure of the imaging apparatus 100. A lens unit 200 is mounted on the mount 130 on the front surface of the imaging apparatus 100 to form the imaging system 101.

  The imaging apparatus 100 houses an optical system including a main mirror 240, a pentaprism 270, and an eyepiece optical system 290, and a control system including a main control unit 300. In the optical system, the main mirror 240 moves between a standby position inclined on the optical path of incident light and a photographing position (indicated by a dotted line in the figure) that rises while avoiding the incident light.

  The primary mirror 240 in the standby position guides most of the incident light to the focusing screen 272 disposed above. The focusing screen 272 is disposed at a focus position of the imaging optical system 230 of the lens unit 200 and forms an image formed by the imaging optical system 230.

  The image formed on the focusing screen 272 is observed from the eyepiece optical system 290 via the pentaprism 270. As a result, the image on the focusing screen 272 can be viewed as a normal image from the eyepiece optical system 290.

  Between the pentaprism 270 and the eyepiece optical system 290, a half mirror 292 that superimposes the display image formed on the finder LCD 294 on the image of the focusing screen 272 is disposed. Thereby, at the exit end of the eyepiece optical system 290, the image on the focusing screen 272 and the image on the finder LCD 294 can be seen together. Note that information such as shooting conditions and setting conditions of the imaging system 101 is displayed on the finder LCD 294.

  Further, part of the light emitted from the pentaprism 270 is guided to the photometry unit 330. The photometric unit 330 measures the intensity of incident light, its distribution, and the like, and refers to the measurement result when determining imaging conditions. The photometry unit 330 is included in the main control unit 300 described later.

  On the other hand, a secondary mirror 242 is disposed on the back surface of the primary mirror 240 with respect to the incident light incident surface. The secondary mirror 242 guides the incident light transmitted through a part of the primary mirror 240 to the phase difference detection type focus detection unit 310 disposed below. The phase difference detection type focus detection unit 310 is included in the main control unit 300 to be described later, and detects a position where the focus of the imaging optical system 230 is on the subject when the main mirror 240 is in the standby position. When the primary mirror 240 is moved to the photographing position, the secondary mirror 242 is also retracted from the optical path of the incident light.

  A shutter 250, an optical filter 282, and an image sensor 280 are disposed along the optical axis X behind the primary mirror 240 with respect to incident light from the lens unit 200. When the shutter 250 is released, the primary mirror 240 moves to the photographing position immediately before the shutter 250 is released, so that the incident light travels straight and enters the image sensor 280. As a result, the image formed by the incident light is converted into an electrical signal in the image sensor 280.

  The main control unit 300 comprehensively controls the various operations as described above. The main control unit 300 also exchanges signals with the lens unit 200 to control opening and closing of the diaphragm unit 162 and the like. Further, the main control unit 300 contributes to automating exposure, execution of a scene mode, execution of bracket photography, and the like.

  Further, the main control unit 300 executes image processing when an image processing to be described later is instructed as an operation mode of the imaging apparatus 100. The detailed structure of the main control unit 300 will be described later with reference to FIG.

  The lens unit 200 includes a lens barrel 210 coupled to the mount 130 of the imaging device 100, a diaphragm device 220 and an imaging optical system 230 housed in the lens barrel 210. The aperture device 220 opens and closes in response to an instruction from the imaging device 100 to change the depth of field of the imaging optical system 230.

  The imaging optical system 230 includes a plurality of lens groups 231, 232, and 233. By moving a part of the lens groups 231, 232, and 233 in the direction of the optical axis X, the focal position of the imaging optical system changes, so that the subject can be focused. Further, by moving part or all of the lens groups 231, 232, and 233, the focal length of the imaging optical system 230 is changed to change the imaging magnification.

  The lens unit 200 is also electrically coupled to the imaging device 100 via a connection terminal (not shown). Thereby, the lens unit 200 is supplied with power from the imaging device 100. Further, when the lens unit 200 is operated along with imaging, imaging information such as a focal length and subject depth is transmitted to the main control unit 300 of the imaging apparatus 100 as an electrical signal.

  FIG. 4 is a block diagram showing the structure of the main control unit 300. In addition to the phase difference detection type focus detection unit 310 and the photometry unit 330 described above, the main control unit 300 includes an inclination detection unit 320, a lens unit communication circuit 350, a processor 360, a main storage circuit 380, an input reception unit 390, and an ASIC 400. Have In addition, the nonvolatile storage medium 382 attached to the imaging apparatus 100 is also under the control of the main control unit 300.

  The inclination detection unit 320 detects the posture of the imaging device 100 with respect to the direction of gravity using an acceleration sensor, a gyro sensor, or the like. As a result, it is detected and recorded whether the captured image is shot at a horizontal position that is a horizontally long image or a vertical position that is a vertically long image. In addition, when the image capturing apparatus 100 is photographed at any position but the image capturing apparatus 100 is tilted with respect to the horizontal or vertical direction, the magnitude of the tilt is also detected. The detection result is referred to the processor 360 as a part of the imaging information. In addition, the tilt information is recorded along with the captured image as part of the imaging information (may be included in the image file).

  The lens communication circuit 350 manages communication with the lens unit 200 and transmits a drive signal to the lens unit 200 according to the calculation result of the phase difference detection type focus detection unit 310. In addition, when the lens unit 200 is operated, information regarding imaging conditions such as imaging magnification is received.

  The input receiving unit 390 receives an instruction from the outside. The instructions here include, for example, instructions such as the position of the region of interest, the width of the region of interest, and the distribution of the reduction amount of the spatial frequency in the background region in image processing described later. The instruction received by the input receiving unit 390 is also transferred to, for example, the ASIC 400 via the processor 360 and the main memory circuit 380.

  When the release switch 191 is pressed halfway with the power switch 161 turned on, the photometry unit 330 starts photometry of the subject. Further, the phase difference detection type focus detection unit 310 calculates a condition for driving the lens unit 200 to focus the imaging optical system 230. The timing generator 374 synchronizes the analog signal processing circuit 376 and the analog / digital converter 378.

  When the release switch 191 is pushed further deeply than halfway, the lens unit 200 is driven to focus the imaging optical system 230. In addition, the diaphragm device 220 is narrowed down with the imaging condition set with reference to the measurement result of the photometry unit 330. Further, the shutter 250 is opened and the image sensor 280 is exposed.

  For example, the image sensor 280, which is a CCD, accumulates charges corresponding to incident light. Further, the image sensor 280 driven by the vertical driving circuit 372 in synchronization with the timing generator 374 outputs the accumulated charges.

  The analog signal processing circuit 376 includes an OB clamp circuit, an automatic gain control circuit, a double correlation sampling circuit, and the like, and outputs the analog image signal after processing such as black level reproduction, waveform shaping, and noise removal. The output analog image signal is converted into a digital image signal by an analog / digital converter 378.

  The digital image signal is stored in the buffer 410 and is subjected to image processing to be described later by the ASIC 400. Image processing in the ASIC 400 will be described later.

  In addition to the phase difference detection type focus detection unit 310, the main control unit 300 includes a contrast detection type focus detection unit 309 that detects a focus by detecting a spatial frequency contrast from an image obtained from the image sensor 280. Have. Thereby, an image obtained from the image sensor 280 can be captured while referring to the main display unit 172.

  FIG. 5 is a block diagram showing the structure and function of the ASIC 400. The ASIC 400 executes image processing associated with imaging by the imaging apparatus 100 and image processing after imaging on an image obtained by imaging.

  The ASIC 400 acquires and processes the input image 411 from the buffer 410 serving as a work area. The buffer 410 is connected to the analog / digital converter 378, the processor 360, and the main display unit 172. The buffer 410 also becomes a work area in image post-processing described later.

  The ASIC 400 includes an image processing unit 420 that can access the buffer 410, a compression module 430, a writing / reading module 440, an α blend module 450, and a low-pass module 460. The write / read module 440 is responsible for reading / writing information to / from the non-volatile storage medium 382 disposed outside the ASIC 400 in addition to data input / output to / from the main memory circuit 380. Further, the ASIC 400 includes a position initial value generation unit 470 having an input to the image processing unit 420, a width initial value generation unit 480, and a decrease amount initial value generation unit 490.

  The digital image signal generated in the analog / digital converter 378 is stored as an input image 411 in the buffer 410. The image processing unit 420 refers to the white balance adjustment value extracted from the input image 411 and stores it again in the buffer 410 as a processed image 412 in which the white balance and the like are adjusted.

  Subsequently, the processed image 412 is compressed by the compression module 430. For example, the compressed image 413 formatted in the JPEG format by the compression module 430 is stored in the buffer 410 again.

  Further, from the compressed image 413, a display image to be displayed on the main display unit 172 is generated and displayed on the main display unit 172. Further, the compressed image 413 is recorded on the nonvolatile storage medium 382 such as a flash memory card by the writing / reading module 440 via the main storage circuit 380.

  Depending on the setting of the imaging apparatus 100, the digital image signal transferred from the analog / digital converter 378 to the buffer 410 may be stored in the nonvolatile storage medium 382 as a RAW file without performing image processing. Further, when a compressed RAW file is stored, the RAW file and the compressed image may be stored together.

  The ASIC 400 performs image processing on the target image 414 read from the nonvolatile storage medium 382 in addition to the image processing on the captured image as described above. When executing such image processing, the image processing instruction received by the input receiving unit 390 is transferred to the ASIC 400. Hereinafter, image processing using the target image 414 as an original image will be described.

  FIG. 6 shows an example of a display image 501 displayed on the main display unit 172 when the contents of image processing to be executed by the ASIC 400 are designated. The display image 501 displays a small picture 511, an image composition 512, a RAW development 513, a simple retouch 514, and a miniature effect 515 as options.

  For example, by pressing an area instructing the up and down direction of the cross key 193 on the display image 501, the highlight frame 516 of the display image 501 can be moved to specify the image processing to be selected. In the illustrated example, a miniature effect 515 is surrounded by a highlight frame 516. Further, by pressing an OK button 195 in the state shown in the figure, the image processing content can be confirmed.

  It should be noted that buttons that can be operated and their functions are displayed as a guide 520 on the periphery of the main display unit 172. Thereby, since the next operation is guided, it is prevented that the user unfamiliar with the operation gets lost.

  FIG. 7 shows a display image 502 displayed on the main display unit 172 when the image processing content is confirmed to the miniature effect 515 in the display image shown in FIG. The display image 502 displays a target image 414 including a tree and a person, and displays an area designation frame 582 that surrounds a horizontally long belt-like attention area 580 on the image.

  Note that the miniature effect reduces the spatial frequency of the image of the background area 590, which is the other area, with respect to the horizontal band-shaped attention area 580, thereby making the image appear as if a miniature model has been taken. Image processing. For this reason, in image processing in which a miniature effect is obtained, a higher effect can be obtained by appropriately specifying the position and area of the attention area 580 and the degree of blur of the background area 590.

  When the designation of the image processing for obtaining the miniature effect is input and the display image 501 shown in FIG. 7 is displayed, the initial values of the position, width, and processing strength of the attention area 580 are the positions. The initial value generation unit 470, the initial width generation unit 480, and the decrease initial value generation unit 490 are provided to the image processing unit 420. Thereby, the ASIC 400 can generate an image including the area designation frame 582 shown in FIG.

  FIG. 8 is a flowchart showing processing executed by the ASIC 400 when the spatial frequency of the background region 590 is lowered. As shown in the figure, when the image signal of the target image 414 is input (S101), the low-pass module 460 executes low-pass filter processing on the image signal of the target image (original image) 414 (S102).

  Since the spatial frequency of the image signal of the target image 414 that has undergone the low-pass filter processing (hereinafter referred to as a signal after the low-pass processing) is lowered, blur such as an image captured with the focus shifted in the imaging apparatus 100 occurs. Further, the image processing unit 420 generates a mask pattern 601 that masks the attention area 580 designated by the area designation frame 582 when the image subjected to the low-pass filter processing is blended with the original target image (S103). .

  FIG. 9 is a diagram illustrating an example of the generated mask pattern 601. In the drawing, the darkest part indicates an area where the weighted average ratio for the low-pass-processed signal generated in S102 is 0%, which is performed in an α blending process described later. The degree of blackness indicates a weighted average ratio (corresponding to a weighted average weight) with respect to the low-pass processed signal, and the ratio (weight) decreases as the black becomes darker (reversely shown in the figure). 9, the area where the mask pattern is white (transparent) is higher in the ratio of the weighted average of the low-pass processed signal (the weight is heavier). As shown in the figure, the mask pattern 601 masks the vicinity of the center in the height direction of the image, and the transmittance (white) of the mask pattern becomes closer to the periphery (upper end or lower end) along the height (up and down) direction of the image. Is high). For reference, the transmittance profile of the mask pattern 601 is shown on the right side of the mask pattern 601.

  Referring to FIG. 8 again, the α blend module 450 blends the original target image 414 and the low-pass filtered image according to the mask pattern 601 (S104).

  Here, the processing performed by the α blend module 450 will be described in detail. The α blend module 450 sets the original image of the target image 414 and the low-pass filtered image obtained by performing low-pass filtering on the original image 414 for each pixel (in units of pixels) with the mask pattern 601. A weighted average (pixel mixture) processing is performed at a ratio.

  For example, the case of performing weighted average (pixel mixture) processing based on the mask pattern shown in FIG. 9 will be described. In the mask pattern of FIG. 9, the signal of the original image 414 (hereinafter referred to as “original image signal” for the central pixel). ”) Is set to 100%, and the low-pass processed signal generated in step S102 is set to 0%, and the signals of the pixels at corresponding positions between the image signals are weighted (mixed). On the other hand, in the mask pattern of FIG. 9, the transmittance (whiteness) increases as it approaches the peripheral part (upper and lower ends). On the contrary, the weight of the original picture signal when performing weighted averaging is reduced in the peripheral part. The weight of the signal after the low pass processing is increased.

  As a result, an image with a miniature effect is generated in which the background (peripheral) region 590 is strongly influenced by the low-pass filter processing while the change in the spatial frequency of the attention region 580 is reduced.

  FIG. 10 is a flowchart showing the flow of the entire image processing. As illustrated, in the operation procedure of the imaging apparatus 100 described below, first, an instruction to specify the position of the attention area 580 is input (S201). The location of the attention area 580 is specified by, for example, determining the position of the upper side of the attention area 580 in the height direction in the image. Further, as will be described later, when an inclination is found in the attention area 580, it is designated as part of the position designation (S202).

  Next, an instruction for designating a width orthogonal to the longitudinal direction of the attention area 580 is input (S203). Thereby, the size of the attention area 580 is designated. Subsequently, the strength of processing for the background (peripheral) region (the low-pass degree of the low-pass filter) is designated as the strength of the miniature effect (S204). When all image processing conditions are input, the imaging apparatus 100 starts image processing that provides a miniature effect.

  FIG. 11 is a diagram showing an operation of moving the area designation frame 582 for designating the attention area 580 downward. In FIG. 11, a display image 503 in which the position of the area designation frame 582 is lowered when compared with the display image 502 shown in FIG. 7 is displayed.

  The user refers to the guide 521 and knows that the operation of moving the area designation frame 582 downward is pressing a downward area of the cross key 193. Thus, when the user presses the area of the cross key 193, the area designation frame 582 gradually moves and stops when the cross key 193 is released. However, when the cross key 193 is pressed again, it moves. Finally, the position of the area designation frame 582 is saved and confirmed by pressing the OK button 195.

  By pressing the OK button 195 according to the guide 522 before pressing the OK button 195, the image when the miniature effect is applied to the target image 414 according to the designation of the area designation frame 582 displayed at that time can be previewed. Thereby, before the position of the area designation frame 582 is determined, the effect obtained at that position can be confirmed.

  FIG. 12 is a diagram showing a mask pattern 602 generated corresponding to the display image 503 shown in FIG. The dark area of the mask pattern 602 in FIG. Thereby, a lower region is masked when compared with the mask pattern 601 shown in FIG.

  FIG. 13 is a diagram showing an operation of moving the area designation frame 582 for designating the attention area 580 upward. When compared with the display image 502 shown in FIG. 7, a display image 504 in which the position of the area designation frame 582 is increased is displayed in FIG. 13.

  The user refers to the guide 523 and knows that the operation of moving the area designation frame 582 upward is pressing the upward area of the cross key 193. Thus, when the user presses the area of the cross key 193, the area designation frame 582 moves upward and stops when the cross key 193 is released. When the user presses the cross key 193 again, the area designation frame 582 rises. Finally, the position of the area designation frame 582 is saved and confirmed by pressing the OK button 195.

  FIG. 14 is a diagram showing a mask pattern 603 generated in response to designation by the display image 503 shown in FIG. As shown in the drawing, the dark (black) region of the mask pattern 602 is shifted upward. Thereby, when compared with the mask pattern 601 shown in FIG. 9, a higher region is masked.

  As described above, the mask patterns 602 and 603 have asymmetric transmittance profiles. Thereby, in the target image to which the miniature effect is applied, an effect of looking up at the subject (in the case of the mask pattern 603) or looking down (in the case of the mask pattern 602) can be obtained.

  FIG. 15 is a diagram illustrating a display image 505 in which a vertically long target image 415 is displayed on the main display unit 172. Whether the target image (original image) 415 is vertically long is determined by the detection result of the tilt detection unit 320 when the target image 415 is captured, which is recorded as imaging information (the camera's shooting posture is a so-called vertical position shooting posture). If this is the case, this can be determined from the detection result of the inclination detector 320).

  Even when the target image 415 is vertically long, the region designation frame 582 indicates a strip-like region that is long in the horizontal direction (lateral direction) with respect to the vertically long image 415. In the image shot in the vertical position shooting posture, information indicating that the vertical position shooting is performed is recorded along with the image as described above. Therefore, the camera is shown in FIG. 15 based on this information. The area designation frame 582 is automatically set in such an arrangement.

  FIG. 16 is a diagram showing a mask pattern 604 corresponding to the display image 505 shown in FIG. As shown in the drawing, the mask pattern 604 forms a vertically long rectangle as a whole, and forms the darkest (black) mask at the center in the height direction. The mask pattern 604 has a pattern in which the transmittance gradually increases toward the upper end and the lower end. By using the mask pattern 604 and processing the α blend process as described above with reference to FIG. 8 as the original image 415, the spatial frequency hardly decreases inside the attention area 580 shown in FIG. A miniature effect image in which the spatial frequency is reduced in the region 590 can be output.

  By the way, when the initial value of the position of the area designation frame 582 is simply the center of the image or one end of the image, whether the area surrounded by the area designation frame 582 is an appropriate area as the attention area 580 or not. It is unknown. For this reason, the user must search for the position of the area designation frame 582 where the miniature effect can be reflected. Further, in the case of a user unfamiliar with image processing, there is no criterion for determining the position of the attention area 580, and the position of the area designation frame 582 cannot be easily designated.

  Therefore, for example, the position initial value generation unit 470 selects the position initial value so that the boundary between the attention area 580 and the background area 590 is located in an area where the spatial frequency changes sharply in the processing target image. Good. Thereby, a position initial value close to the final designated position of the area designation frame 582 can be provided. In addition, there is an advantage that a user who is not familiar with the operation can obtain a certain miniature effect even if image processing is performed with the region designation frame 582 in the default position.

  The phase difference detection type focus detection unit 310 detects a focus shift at a certain point designated on the screen and calculates a driving amount of the lens required for focusing. For this reason, the spatial frequency distribution of the entire target image cannot be grasped. However, since the contrast detection type focus detection unit 309 monitors the contrast of the entire image, it can grasp the spatial frequency distribution. The detected distribution can be stored in the imaging information.

  FIG. 17 is a diagram showing a display image 506 including a tilted target image 416. As shown in the figure, the user may take an image in an inclined state in which the imaging device 100 is neither in the vertical position nor in the horizontal position. Therefore, by recording the detection result of the inclination detection unit 320 included in the main control unit 300 as a part of the imaging information in the captured image and referring to this in the image processing, the position initial value generation unit 470 performs processing. A band-shaped area designation frame 582 that is horizontal to the horizontal direction in the image is generated. As a result, the area designation frame 582 with an appropriate orientation is displayed without the user performing an additional operation to rotate the area designation frame 582.

  FIG. 18 is a diagram showing a mask pattern 605 corresponding to the display image 506 shown in FIG. As shown in the drawing, a dark (black) mask pattern is arranged at the substantially same center of the mask pattern 605 with the same inclination as the region designation frame 582. By using the mask pattern 605 and performing the α blending process as described above with reference to FIG. 8 as the original image 416, the target image 416 is optimal regardless of the inclination of the image (the horizontal direction of the image). Can be given a miniature effect (depending on the degree).

  Note that the tilt in the image of the band-shaped region designation frame 582 may be arbitrarily changed by inputting information for designating the tilt to the input receiving unit 390. Furthermore, the position initial value generation unit 470 may detect the inclination of the target image 416 and generate an initial value with the area designation frame 582 inclined. In this case, the position initial value generation unit 470 detects the edge by performing high-pass processing on the target image 416, detects the presence or absence of a straight edge having a predetermined length, and if a straight line is detected, the position initial value generation unit 470 It recognizes the vertical or horizontal indicated by (for example, a building or the horizon), and generates the initial value. As a result, the user's operation is omitted by one step, so that the image processing can be started quickly. Even when the position initial value generation unit 470 automatically tilts and displays the area designation frame 582, the user can further change the inclination of the area designation frame 582.

  FIG. 19 is a diagram showing a display image 507 including the attention area 580 whose width has been changed. For example, the width of the area designation frame 582 is changed by operating the dial switch 180 of the imaging apparatus 100 according to the display of the guide 524. In the illustrated example, the width of the area designation frame 582 that overlaps the image to be processed is reduced by moving the front side edge of the dial switch 180 toward the left side.

  FIG. 20 is a diagram showing a mask pattern 606 corresponding to the area designation frame 582 displayed in the display image 507 shown in FIG. Compared with the mask pattern 601 shown in FIG. 9, the mask pattern 606 has a significantly narrower width at the center in the height direction. Thereby, the miniature effect is more strongly applied to the target image 414.

  Note that by pressing the reduction display button 197 before the OK button 195 is pressed, an image when the miniature effect is applied to the target image 414 according to the specification of the area specification frame 582 displayed at that time can be previewed. Thereby, before the width of the area designation frame 582 is determined, the effect obtained at that position can be confirmed.

  FIG. 21 is a diagram showing another mask pattern 607 corresponding to the region designation frame 582 shown in FIG. In the mask pattern 607 as well, the width (height) of the dark pattern at the center is not significantly different from the mask pattern 606 shown in FIG. However, as can be seen from the profile shown on the right side of the mask pattern 607, the mask pattern 607 has a suppressed change in transmittance at both ends. By performing image processing using the mask pattern 607 having such a profile, a gentler miniature effect can be obtained for the target image 414.

  FIG. 22 is a diagram showing a display image 508 including the attention area 580 whose width has been changed. For example, the width of the area designation frame 582 is changed by operating the dial switch 180 of the imaging apparatus 100 in accordance with the display of the guide 525. In the illustrated example, by moving the front side edge of the dial switch 180 toward the right side, the width of the area designation frame 582 that overlaps the image to be processed becomes wider.

  FIG. 23 is a diagram showing a mask pattern 608 corresponding to the area designation frame 582 displayed in the display image 508 shown in FIG. Compared with the mask pattern 601 shown in FIG. 9, the mask pattern 608 has a remarkably wide width at the center in the height direction. Thereby, the miniature effect is more gently applied to the target image 414.

  FIG. 24 is a diagram showing another mask pattern 609 corresponding to the area designation frame 582 shown in FIG. In the mask pattern 609 as well, the width (height) of the dark pattern at the center is not significantly different from the mask pattern 608 shown in FIG. However, as can be seen from the profile shown on the right side of the mask pattern 607, the mask pattern 607 has a large change in transmittance at both ends. By performing image processing using the mask pattern 607 having such a profile, a slightly strong miniature effect can be given to the target image 414.

  As described above, the user can change the width (height) of the area designation frame 582. When the width of the area designation frame 582 reaches the width desired by the user, the user can confirm the width of the area designation frame 582 by pressing the OK button 195 of the imaging apparatus 100.

  When the initial value of the width of the area designation frame 582 is constant, there is little correlation as to whether or not the initial width of the area designation frame 582 is an appropriate width as the width of the attention area 580. For this reason, the user has to search for the width of the area designation frame 582 where the miniature effect stands out. In addition, it is difficult for a user unfamiliar with image processing to determine the width of the attention area 580.

  Therefore, for example, the width initial value generation unit 480 may change the initial value to be generated with reference to the distance to the subject acquired from the imaging information of the processing target image. That is, the initial value of the width to be generated may be narrowed as the distance to the subject is short, and the initial value of the width to be generated may be widened as the distance to the subject is long.

  Thereby, a position initial value close to the specified width of the area specifying frame 582 to be obtained can be provided. Further, even when the user is not in image processing, effective image processing can be performed even with the default setting.

  Further, regarding the selection of the mask patterns 606, 607 or the selection of the mask patterns 608, 609, the user must search for the mask patterns 606, 607, 608, 609 where the miniature effect stands out. In addition, it is difficult for a user who is unfamiliar with image processing. Therefore, it is preferable that the reduction amount initial value generation unit 490 presents mask patterns 606, 607, 608, and 609 having higher probability from the beginning.

  Thus, for example, referring to the focal length of the imaging optical system acquired from the imaging information of the target image 414, the decrease amount initial value generation unit 490 increases the amount of change in the spatial frequency as the focal length is shorter. May be selected. Further, referring to the depth of field of the imaging optical system acquired from the imaging information of the image to be image-processed, the mask pattern in which the amount of decrease in the spatial frequency in the image processing unit is larger as the depth of field is shallower. 606 and 609 may be selected.

  In any case, the input reception unit 390 receives the change of the mask patterns 606 and 607 presented by the decrease initial value generation unit 490 to another one. As a result, the miniature effect desired by the user can be finally obtained.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

DESCRIPTION OF SYMBOLS 100 Imaging device, 101 Imaging system, 130 Mount, 161 Power switch, 162 Aperture part, 172 Main display part, 180 Dial switch, 191 Release switch, 193 Cross key, 195 OK button, 197 Reduced display button, 199 Playback button, 200 Lens unit, 210 Lens barrel, 220 Aperture device, 230 Imaging optical system, 231, 232, 233 Lens group, 240 Primary mirror, 242 Secondary mirror, 250 Shutter, 270 Pentaprism, 272 Focusing screen, 280 Image sensor, 282 Optics Filter, 290 eyepiece optical system, 292 half mirror, 294 finder LCD, 300 main control unit, 309 contrast detection type focus detection unit, 310 phase difference detection type focus detection unit, 320 tilt detection , 330 photometry unit, 350 lens unit communication circuit, 360 processor, 372 vertical drive circuit, 374 timing generator, 376 analog signal processing circuit, 378 analog / digital converter, 382 nonvolatile storage medium, 380 main storage circuit, 390 input Reception unit, 400 ASIC, 410 buffer, 411 input image, 412 processed image, 413 compressed image, 414, 415, 416 target image, 420 image processing unit, 430 compression module, 440 write / read module, 450 α blend module, 460 Low-pass module, 470 Position initial value generation unit, 480 Width initial value generation unit, 490 Decrease amount initial value generation unit, 501, 502, 503, 504, 505, 506, 507, 508 Display image, 511 Small picture, 512 Image composition, 513 Raw development, 514 Easy retouch, 515 Miniature effect, 516 Highlight frame, 520, 521, 522, 523, 524, 525 Guide, 580 Region of interest, 582 Region designation frame, 590 Background region, 601, 602 , 603, 604, 605, 606, 607, 608, 609 mask pattern

Claims (9)

Image processing in which the spatial frequency in a region other than the region of interest in the one image is lower than the spatial frequency in a band-shaped region of interest extending in the horizontal direction of the one image that is partially set in one image And an image processing apparatus including a processing unit that imparts a miniature effect to the one image ,
In the one image, a determination unit that determines a width and a position of the region of interest in a direction perpendicular to the horizontal direction based on information acquired from the one image,
The image processing apparatus, wherein the processing unit performs the image processing on the one image based on the attention area determined by the determination unit. The determination unit
Claims based on the distance to the subject acquired from the imaging information of the one image, the more the distance is short, further comprising a width initial value generating unit for narrowing the initial value of the width of the region of interest, it is characterized by Item 8. The image processing apparatus according to Item 1. The determination unit
The position initial value generation unit that sets an initial value of the position of the region of interest in a region where the change in spatial frequency is steep in the one image is further provided . Image processing device . An input unit that receives an instruction for at least one of a width and a position of the region of interest in a direction perpendicular to the horizontal direction within the one image ;
The determination unit according to claim 1, wherein the determination unit arbitrarily determines at least one of a width and a position of the region of interest in a direction perpendicular to the horizontal direction based on an instruction from the input unit. The image processing apparatus according to any one of the above . The determination unit
Based on the information indicating the inclination of the first image acquired from the imaging information of the one image, further comprising a tilt determining unit determining a tilt of the region of interest, it claims 1-4, characterized in that one The image processing apparatus according to item . The image processing apparatus according to claim 5, characterized in that further have a tilt input unit for accepting an instruction to change the tilt. The processor is
Based on the focal length of the imaging optical system acquired from the imaging information of the one image, the higher the short focal length, further comprising a processing amount determining section to increase the amount of reduction in spatial frequency in the processing unit, and characterized in that the image processing apparatus according to any one of claims 1 to 6 for. The processor is
Based on the depth of field of the imaging optical system acquired from the imaging information of the one image, the processing unit further includes a processing amount determination unit that increases the amount of decrease in spatial frequency in the processing unit as the depth of field is shallower. the image processing apparatus according to any one of claims 1-7, characterized in that. The image processing apparatus according to any one of claims 1-8, characterized by further comprising an input unit for accepting an instruction to change the reduction amount of the spatial frequency in the processing unit.

Images