JP6504240B2 - Electronic device, image processing method, and image processing program - Google Patents

Description

  The present invention relates to an electronic device, an image processing method, and an image processing program.

  There is known a camera which detects, on a screen, parameter change information for detecting a type of a subject specified by a user and changing an image quality parameter according to the type of the detected subject (see Patent Document 1).

JP, 2011-10273, A

  In the above-described conventional technology, even if a plurality of subjects are present in the captured image, only one subject is designated by the user, so only image quality parameters can be changed according to the designated subject type. The appropriate image quality parameters could not be changed for other subjects. As described above, in the above-described conventional technology, when there are a plurality of subjects in the captured image, it is not possible to perform appropriate image processing on each subject.

According to a first aspect of the present invention, an electronic apparatus includes a display unit for displaying an image and a first plurality of first image processing set for the partial image of the image displayed on the display unit at least two image processing relating to the ratio to perform the first operation image for changing the first parameter is displayed on the display unit, against the second partial image in the image displayed on the display unit of the A display control unit for displaying on the display unit a second operation image for changing a second parameter relating to a ratio of performing at least two image processing among the plurality of set second image processing; change the first parameter in response to the operation on the operation image, and a control unit that performs control for changing the second parameter in response to the operation on the second operation image, relative to the first partial image the Te first path Ramee Performs image processing based on, and an image processing section performing image processing based on the second parameter to the second partial image.
Multiple According to a second aspect of the present invention, an image processing method comprises a first display step of displaying an image on a display unit, which is set for the first partial image of the image displayed on the display unit A first operation image for changing a ratio of applying at least two of the first image processing to the first partial image in the first image processing is displayed on the display unit; displaying a second operation image for changing the ratio of the at least two image processing performed on the second partial image of the second plurality of second image processing set for the partial image on the display unit second display step, the first to change the first parameter Ri by the operation on the operation image, changing step of changing the second parameter Ri by the operation with respect to the second operating image for If, on the first parameter to the first partial image It performs image processing Zui, having an image processing step of performing image processing based on the second parameter to the second partial image.
According to a third aspect of the present invention, an image processing program causes a computer to execute an image processing method according to the second aspect.

  According to the present invention, even when a plurality of subjects are present in a captured image, it is possible to perform appropriate image processing on each subject.

It is a block diagram explaining the example of composition of the digital camera by one embodiment of the present invention. It is a figure explaining a ring image. It is a figure explaining the image processing according to the position of the cursor. It is a figure explaining the combination of the image processing according to the kind of to-be-photographed object. It is a figure explaining the process which divides | segments a captured image into the area | region for every object, and displays a ring image for every divided area. It is a figure explaining a mode that the display position of a ring image is moved. It is a figure explaining the image processing given to the boundary part of division fields. It is a flowchart explaining the flow of processing in creative mode. It is a flowchart explaining the flow of the process following FIG. 5 is a flowchart illustrating the flow of image processing according to the position of a cursor. It is a figure explaining the mode of provision of a program.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing the configuration of a digital camera 1 according to the present embodiment. The digital camera 1 includes an imaging optical system 11, an imaging element 12, a lens drive circuit 13, a control unit 14, an operation member 16, and a display unit 17. A recording medium 18 such as, for example, a memory card is removable from the digital camera 1.

  The imaging optical system 11 includes a plurality of lens groups including a zoom lens and a focusing lens, and forms an object image on the light receiving surface of the imaging element 12. In addition, in order to simplify FIG. 1, the imaging optical system 11 is illustrated as a single lens.

  The lens drive circuit 13 drives the zoom lens of the imaging optical system 11 to adjust the focal length under the control of the control unit 14 and drives the focusing lens of the imaging optical system 11 to perform focus adjustment.

  The imaging device 12 is an image sensor such as a CMOS imaging device, for example, and captures an object image formed by the imaging optical system 11 and outputs an obtained image signal to the control unit 14.

  The control unit 14 includes a display control unit 14a, a parameter change unit 14b, an image processing unit 14c, and a region division unit 14d. The control unit 14 includes a CPU, a memory, and their peripheral circuits, and realizes the functions of these units by executing a control program stored in the memory. The contents of the functions of each part will be described in detail later.

  The display unit 17 is configured by a liquid crystal monitor (rear monitor) or the like mounted on the rear surface of the digital camera 1 and displays a captured image captured by the image sensor 12 and various setting menus.

  The operation member 16 includes a shutter button 16 a and a touch panel 16 b disposed on the display unit 17. In addition, the operation member 16 includes a recording button, a mode switching button, an arrow key, an OK button, a display button, and the like. The operation member 16 outputs an operation signal corresponding to the operation to the control unit 14 when each operation member is operated.

  When the imaging mode is set according to the operation signal from the operation member 16, the control unit 14 causes the imaging element 12 to perform imaging processing for a through image at a predetermined frame rate, and is obtained from the imaging element 12 in time series. A frame image for display is generated from each frame image to be output and output to the display unit 17. As a result, the through image is displayed on the display unit 17 in real time.

  Then, when a photographing instruction is issued by pressing the shutter button, the control unit 14 causes the imaging element 12 to perform imaging processing for recording, and a predetermined image is generated for the image signal acquired from the imaging element 12 Processing is performed to generate still image data, compression processing is performed according to a predetermined method such as JPEG, and recording is performed on the recording medium 18.

  When the reproduction mode is set according to the operation signal from the operation member 16, the control unit 14 reads and reproduces still image data recorded on the recording medium 18 and displays the data on the display unit 17.

  In addition to the normal mode, the digital camera 1 according to the present embodiment is provided with a creative mode capable of obtaining a captured image subjected to various image processing, in addition to the normal mode. The following describes this creative mode.

  In the creative mode, as shown in FIG. 2, the display control unit 14 a of the control unit 14 displays an image (hereinafter referred to as a ring image) 50 for changing an image processing parameter of image processing applied to a captured image. Display on 17. The ring image 50 is an image for displaying the ring 51 and the cursor 52. The cursor 52 indicates the currently selected position on the ring 51. The display control unit 14 a moves the display position (that is, the selection position) of the cursor 52 along the ring 51 in response to the touch operation on the touch panel 16 b by the user. The display control unit 14a moves the cursor 52, for example, in response to a drag operation on the cursor 52 (an operation of touching the display position of the cursor 52 with, for example, a finger, and then moving the finger while touching).

  The parameter changing unit 14 b of the control unit 14 sets an image processing parameter of the image processing to be performed on the captured image according to the position (that is, the selection position) of the cursor 52 on the ring 51. That is, in response to the movement of the cursor 52, the parameter changing unit 14b changes the image processing parameter of the image processing to be performed on the captured image. The image processing unit 14c of the control unit 14 performs image processing on the captured image based on the image processing parameter set by the parameter changing unit 14b. The display control unit 14a causes the display unit 17 to display a captured image after image processing by the image processing unit 16c.

  In the present embodiment, among the four image processes (hereinafter, referred to as first to fourth image processes) set as the ring image 50, the image processing parameter is which image process at a ratio of how much. It is a parameter indicating whether to perform. The details of the first to fourth image processes will be described later in detail.

  In the ring image 50, 66 positions from the 0th position to the 65th position are set clockwise from the top point P0 of the ring 51, and a scale indicating the position is displayed inside the ring 51. . The top point P0 of the ring 51 is the zeroth position, and the position P1 next to the right is the first position. A seventeenth position is a position P17 that is 90 degrees away from the zeroth position P0 in the clockwise direction. Between the first position P1 to the seventeenth position P17, fifteen positions from the second position to the sixteenth position are set at equal intervals. The position P33 which is 180 degrees away from the zeroth position P0 is the 33rd position. Between the seventeenth position P17 and the thirty-third position P33, fifteen positions from the eighteenth position to the thirty-second position are set at equal intervals. A position P49 which is separated by 270 degrees clockwise from the 0th position P0 is a 49th position. Between the thirty-third position P33 and the forty-ninth position P49, fifteen positions from the thirty-fourth position to the forty-eighth position are set at equal intervals. The position P65 adjacent to the left of the zeroth position P0 is the 65th position. Between the 49th position P49 and the 65th position P65, 15 positions of the 50th position to the 64th position are set at equal intervals. FIG. 3 is a diagram for explaining image processing parameters set at each position. In FIG. 3, the numbers 0 to 65 indicate the 0th position to the 65th position, and the contents of the image processing parameters set at the positions indicated by the numbers are described below the numbers.

  When the display of the ring image 50 is started, the display control unit 14 a displays the cursor 52 at the top point (0th position) P 0 of the ring 51. At this time, the parameter changing unit 14 b is set to perform neither the first image processing nor the fourth image processing. Therefore, the display unit 17 displays a captured image in a state in which neither the first image processing nor the fourth image processing has been performed, that is, the original image.

  When the cursor 52 is at the first position P1 on the right of the zeroth position P0, the parameter change unit 14b sets only the first image processing (that is, the first image processing at a ratio of 100%). Therefore, when the cursor 52 moves clockwise from the zero position P 0 to the first position P 1, the captured image displayed on the display unit 17 changes from the state of the original image to the state where only the first image processing is performed. .

  When the cursor 52 is at the seventeenth position P17 that is 90 degrees clockwise from the zeroth position P0, the parameter changing unit 14b performs only the second image processing (that is, the second image processing at a ratio of 100%) Set to Therefore, when the cursor 52 moves clockwise from the first position P1 to the seventeenth position P17, the captured image displayed on the display unit 17 is subjected to only the second image processing from the state where only the first image processing is applied. Change to the At this time, the captured image displayed on the display unit 17 is gradually transitioned from the state in which only the first image processing is performed to the state in which only the second image processing is performed in 15 steps. That is, while the cursor 52 is from the second position to the sixteenth position, the parameter changing unit 14b performs both the first image processing and the second image processing (that is, overlaps the first image processing and the second image processing) Set as). At this time, the parameter changing unit 14b increases the ratio of the first image processing as the cursor 52 approaches the first position P1 and lowers the ratio of the second image processing, and the second as the cursor 52 approaches the seventeenth position P17. The ratio of image processing is set high and the ratio of first image processing is set low. For example, when the cursor 52 is at the fifth position, the parameter changing unit 14b performs the first image processing at a ratio of 75% and the second image processing at a ratio of 25%. When the cursor 52 is at the 13th position at a ratio of 50% for one image processing and 50% for the second image processing, the first image processing is performed at a ratio of 25% and the second image processing is for 75%. Set Note that performing the first image processing at a ratio of 75% means, for example, the degree of change in the captured image when only the first image processing is performed on the captured image (that is, when 100% of the first image processing is performed). The first image processing is performed such that the captured image changes by about 75% of the degree, where

  When the cursor 52 is at the 33rd position P33 which is 180 degrees away from the 0th position P0, the parameter changing unit 14b sets only the third image processing (that is, the third image processing at a ratio of 100%). . Therefore, when the cursor 52 moves clockwise from the 17th position P17 to the 33rd position P33, the captured image displayed on the display unit 17 is subjected to only the third image processing from the state where only the second image processing is applied. Change to the At this time, the captured image displayed on the display unit 17 gradually transitions from the state in which only the second image processing is performed to the state in which only the third image processing is performed in 15 steps. That is, while the cursor 52 is from the eighteenth position to the thirty-second position, the parameter changing unit 14b performs both the second image processing and the third image processing (that is, overlaps the second image processing and the third image processing) Set as). At this time, the parameter changing unit 14b increases the ratio of the second image processing to lower the ratio of the second image processing as the cursor 52 approaches the seventeenth position P17 and lowers the ratio of the third image processing, and the third as the cursor 52 approaches the 33rd position P33. The ratio of the image processing is set high and the ratio of the second image processing is set low.

  When the cursor 52 is at the 49th position P49, which is 270 degrees clockwise from the 0th position P0, the parameter changing unit 14b performs only the fourth image processing (that is, the fourth image processing at a ratio of 100%) Set to Therefore, when the cursor 52 is moved clockwise from the 33rd position P33 to the 49th position P49, the captured image displayed on the display unit 17 is only subjected to the fourth image processing from the state where only the third image processing is performed. Change to the state where At this time, the captured image displayed on the display unit 17 is gradually transitioned from the state in which only the third image processing is performed to the state in which only the fourth image processing is performed in 15 steps. That is, while the cursor 52 is from the 34th position to the 48th position, the parameter changing unit 14b performs both the third image processing and the fourth image processing (that is, overlaps the third image processing and the fourth image processing) Set as). At this time, the parameter changing unit 14b increases the ratio of the third image processing to lower the ratio of the third image processing as the cursor 52 approaches the 33rd position P33, and lowers the ratio of the fourth image processing. The ratio of the image processing is set high and the ratio of the third image processing is set low.

  When the cursor 52 is at the 65th position P65 next to the 0th position P0, the parameter changing unit 14b sets only the first image processing (that is, the first image processing at a ratio of 100%). Therefore, when the cursor 52 moves clockwise from the 49th position P49 to the 65th position P65, the captured image displayed on the display unit 17 is subjected to only the first image processing from the state where only the fourth image processing is applied. Change to the At this time, the captured image displayed on the display unit 17 gradually transitions from the state in which only the fourth image processing is performed to the state in which only the first image processing is performed in 15 steps. That is, while the cursor 52 is from the 50th position to the 64th position, the parameter changing unit 14b performs both the fourth image processing and the first image processing (that is, overlaps the fourth image processing and the first image processing) Set as). At this time, the parameter changing unit 14b increases the ratio of the fourth image processing to lower the ratio of the fourth image processing as the cursor 52 is closer to the 49th position P49 and lowers the ratio of the first image processing. The ratio of the image processing is set high and the ratio of the fourth image processing is set low.

  When the cursor 52 moves clockwise from the 65th position P65 to the 0th position P0, the captured image displayed on the display unit 17 returns from the state where only the first image processing is performed to the state of the original image.

  As described above, when the cursor 52 rotates clockwise from the zero position P0, the image processing performed on the captured image is the first image processing, the second image processing, the third image processing, the fourth from the original image. After being sequentially changed in the order of image processing, the process returns to the first image processing again to return to the original image. When the cursor 52 rotates one turn counterclockwise, the image processing applied to the captured image changes in the reverse order of the case where the cursor 52 rotates one turn. In addition, the cursor 52 does not necessarily have to make one rotation, and for example, it is possible to return the change in image processing by moving the cursor 52 counterclockwise after rotating it clockwise by half.

  As described above, in the ring image 50, by moving the cursor 52 on the ring 51, which image processing of the first to fourth image processings is to be performed at what ratio with respect to the image processing applied to the captured image Can be changed.

  Next, the contents of the first to fourth image processings set in the ring image 50 will be described in detail. In the present description, for image processing, for example, processing for creating an image by changing parameters such as saturation, contrast, white balance, etc., for example, applying a filter or blurring or darkening the periphery to make it a toy camera It is assumed that processing such as applying an image effect is included. In the creative mode, the type of subject is determined, and four image processes according to the type of subject are set in the ring image 50 as first to fourth image processes. That is, the contents of the first to fourth image processes set in the ring image 50 differ depending on the type of subject.

  The types of subjects to be determined include "person", "landscape", "sky" and the like. Note that this is an example, and in addition to this, it is also possible to determine the types of various subjects such as “close-up” and “evening scene” that are nearby subjects. FIG. 4 is a diagram for explaining combinations of first to fourth image processing according to the type of subject. For each type of subject, four image processing suitable for each type are preset as first to fourth image processing. For example, in the ring image 50p for the subject "person", "portrait" as the first image processing, "monochrome" as the second image processing, "high key" as the third image processing, and "cross process as the fourth image processing" (R) is set. The ring image 50g for the subject "scenery" is "cross process (G)" as the first image processing, "scenery" as the second image processing, "filter monochrome (sepia)" as the third image processing, the fourth image "Avant-garde" is set as the process. The ring image 50s for the subject "sky" is "bivid" as the first image processing, "high key" as the second image processing, "monochrome" as the third image processing, and "cross process (B) as the fourth image processing. "Is set.

  "Portrait" is image processing for creating an image that makes the skin of a person look clean. "Monochrome" is image processing for creating an image of only black and white shades. The "high key" is image processing for creating an image that is bright on the entire screen and has few shadows. "Cross Process (R)", "Cross Process (G)", and "Cross Process (B)" are similar to the cross process (a method of silver salt photography that uses a positive film to develop for negatives) Image processing for obtaining an image effect. In addition, an image with strong redness is obtained in "Cross Process (R)", an image with strong greenness is obtained in "Cross Process (G)", and an image with strong blue color is obtained in "Cross Process (B)" . "Vivid" is image processing for creating a vivid image with enhanced contrast. "Landscape" is image processing for creating an image suitable for a landscape such as nature or a cityscape. "Filtered monochrome (sepia)" is image processing for creating an image of sepia only with shades of light. "Avant-garde" is an image processing to create a unique picture by increasing the contrast and saturation more than "vivid".

  Information on the combination of the first image processing to the fourth image processing for each type of subject is stored in advance in a memory (not shown) in the digital camera 1.

  Next, processing in which a captured image is divided into areas for each subject in the creative mode and image processing is performed for each divided area will be described. FIG. 5A shows an example of a captured image. As illustrated in FIG. 5B, the area dividing unit 14d of the control unit 14 divides the captured image into a predetermined number (for example, 2 × 2 equal parts of 4) of areas. The number, shape, and size of the areas to be divided here are determined in advance. The area division unit 14d executes subject determination processing for determining the type of subject in each of the divided areas 71 to 74. In addition, since a known method may be used for the subject discrimination process, the detailed description will be omitted. FIG. 5C shows an example of the result of the subject discrimination process. For example, in the areas 71 and 73, it is determined that the subject is "landscape", in the area 72 it is determined that the subject is "sky", and in the area 74 it is determined that the subject is "person".

  When the area division unit 14d detects a plurality of types of subjects in the captured image as a result of the subject determination process, the area division unit 14d next performs a process of dividing the captured image into areas for each subject. The area dividing unit 14d detects an area for each subject by determining that areas having the same feature amount include the same subject, for example. In addition, since a well-known method may be used also for such processing, detailed description will be omitted. FIG. 5D shows an example of the area divided for each subject. For example, the captured image is divided into three areas: a divided area 80g including the subject "landscape", a divided area 80s including the subject "sky", and a divided area 80p including the subject "person".

  The display control unit 14a sets, as through images, ring images 50g, 50s, and 50p for setting image processing according to the type of the subject for each of the divided regions 80g, 80s, and 80p divided by the region dividing unit 14d. Overlap and display. For example, as shown in FIG. 5E, the display control unit 14a displays the ring image 50g for "landscape" on the divided area 80g of "landscape", and in the vicinity of the ring image 50g for "landscape". , A landscape icon 90g indicating that this is for "landscape" is displayed. In addition, the display control unit 14a displays the ring image 50s for "sky" on the "sky" divided area 80s, and indicates that the ring image 50s for "sky" is for "sky" in the vicinity of the ring image 50s for "sky". Display a blank icon 90s shown. In addition, the display control unit 14a displays the ring image 50p for "person" on the divided area 80p for "person", and indicates that the ring image 50p for "person" is for "person" in the vicinity of the ring image 50p for "person". Display the person icon 90p shown.

  The user moves the cursor 52g of the ring image 50g for "landscape", the cursor 52g of the ring image 50s for "sky", and the cursor 52p of the ring image 50p for "person" by the drag operation on the touch panel 16b. be able to. The parameter changing unit 14 b sets an image processing parameter to be applied to the divided area 80 g of “landscape” according to the position of the cursor 52 g of the ring image 50 g for “landscape”. The parameter changing unit 14 b sets an image processing parameter to be applied to the “empty” divided area 80 s according to the position of the cursor 52 s of the “empty” ring image 50 s. The parameter changing unit 14 b sets an image processing parameter to be applied to the divided area 80 p of “person” according to the position of the cursor 52 p of the ring image 50 p for “person”.

  The image processing unit 14c performs image processing based on the image processing parameters set in the ring image 50g for "landscape" on the divided area 80g of "landscape". The image processing unit 14 c performs image processing based on the image processing parameter set in the ring image 50 s for “sky” on the divided area 80 s of “sky”. The image processing unit 14 c performs image processing based on the image processing parameters set in the ring image 50 p for “person” on the divided region 80 p of “person”.

  Note that such image processing is performed on a captured image displayed as a through image (that is, on each frame image captured by the imaging element 12 at a predetermined frame rate). Every time the cursor 52 is moved in any of the plurality of ring images 50 by the user operation, the digital camera 1 changes the image processing parameter of the corresponding divided area according to the movement, and the image processing parameter after the change Is displayed on the display unit 17 in real time.

  With the above configuration, the digital camera 1 can perform image processing suitable for "scenery" on the "scenery" division area 80g, and "sky" for the "sky" division area 80s. Image processing suitable for “person” can be performed on the division region 80 p of “person”. In addition, in the ring image 50g for "scenery", the user can change the image processing to be applied to the "scenery" divided area 80g among the four image processes suitable for the "scenery". The same applies to the ring image 50s for "sky" and the ring image 50p for "person".

  Further, in the creative mode, the display position of the ring image 50 itself is displayed by the user performing a drag operation on the ring 51 of the ring image 50 (for example, an operation of touching the ring 51 with a finger and moving the finger while touching). It can move freely within the display screen of the section 17. For example, as shown in FIG. 6, when a drag operation is performed on the ring 51g of the ring image 50g for "landscape", the display control unit 14a responds to the drag operation for the ring image 50g for "landscape". Move the display position of. 6 (a) shows the state before the movement of the ring image 50g for "landscape", and FIG. 6 (b) shows the state after the movement.

  The image processing unit 14c is configured to perform predetermined image processing on the boundary between two divided areas, and the image processing unit 14c is configured to perform the image processing according to the distance between the two ring images 50 corresponding to these two divided areas. It is designed to adjust the degree of image processing. Therefore, the user moves the display position of the ring image 50 to change the distance between the ring images 50, thereby adjusting the degree of image processing to be applied to the boundary between divided areas corresponding to the ring images 50. it can.

  For example, the image processing unit 14c determines that the divided area 80g of "landscape" and "sky" according to the distance Lgs between the center of the ring image 50g for "landscape" and the center of the ring image 50s for "sky". The degree of image processing to be applied to the boundary with the divided area 80s of The image processing unit 14c divides the “sky” division area 80s and the “person” according to the distance Lsp between the center of the “sky” ring image 50s and the center of the “person” ring image 50p. The degree of image processing to be applied to the boundary with the region 80p is adjusted. The image processing unit 14c divides the divided area 80p of the “person” and the “landscape” according to the distance Lpg between the center of the ring image 50p for “person” and the center of the ring image 50g for “landscape”. The degree of image processing to be applied to the boundary with the area 80g is adjusted.

  FIG. 7 is a diagram for explaining the contents of image processing applied to the boundary between divided areas. For example, the case where image processing is performed on the boundary 81pg between the divided area 80p of "person" and the divided area 80g of "landscape" shown in FIG. 7A will be described as an example. FIG. 7B is a diagram for explaining an example in which gradation processing is performed on the boundary between divided areas. As described above, the image processing unit 14c performs image processing for the “person” set in the ring image 50p for the “person” on the divided area 80p of the “person”, and divides the “landscape”. Image processing for “landscape” set by the ring image 50 g for “landscape” is performed on the area 80 g. In the case shown in FIG. 7B, the image processing unit 14c performs image processing for "person" on the boundary 81pg between the division region 80p of "person" and the division region 80g of "landscape". The image processing is performed so as to change stepwise (that is, with gradation) to a state where image processing for “landscape” is performed from the normal state. At this time, the image processing unit 14c lengthens the gradation width as the distance between the ring image 50p for “person” and the ring image 50g for “landscape” is longer. On the other hand, the image processing unit 14c shortens the width of gradation as the distance between the ring image 50p for “person” and the ring image 50g for “landscape” is shorter. When the ring image 50p for "person" and the ring image 50g for "scenery" come closest to each other, the image processing unit 14c performs no gradation (that is, does not change the image processing in stages, Change at a stretch at the boundary 81pg).

  FIG. 7C is a view for explaining an example in which the border portion between the divided areas is subjected to the border trimming. The image processing unit 14c performs bordering on a boundary portion 81pg between the divided region 80p of the “person” and the divided region 80g of the “landscape”. At this time, the image processing unit 14c thickens the border of the boundary portion 81pg as the distance between the ring image 50p for “person” and the ring image 50g for “landscape” is longer. On the other hand, as the distance between the ring image 50p for “person” and the ring image 50g for “landscape” is shorter, the image processing unit 14c makes the border of the boundary portion 81pg thinner.

  As to whether to perform gradation processing as shown in FIG. 7 (b) or border processing as shown in FIG. 7 (c) on the boundary between divided areas, which processing is used. You may go. For example, the setting may be made beforehand by the user using a setting menu or the like.

  Next, the flow of processing executed by the control unit 14 in the creative mode will be described using the flowcharts shown in FIGS. 8 and 9. The processes shown in FIGS. 8 and 9 are repeated while the shooting mode is set to the creative mode. When the shooting mode is switched to the creative mode, the control unit 14 starts the processing for displaying the through image and starts the program for performing the processing shown in FIG. 8 and FIG. 9 recorded in the memory (not shown). Start processing

  In step S1 of FIG. 8, as described above, the area division unit 14d divides the captured image obtained from the imaging device 12 into a predetermined number of areas, and determines the type of subject in each of the divided areas. After the process, the process proceeds to step S2.

  In step S2, the area division unit 14d determines whether or not a plurality of types of subjects have been detected in the captured image as a result of the subject determination process in step S1. If only one type of subject is detected (that is, the type of the determined subject is the same in all the divided areas), the area division unit 14d makes a negative decision in step S2 and proceeds to step S13. On the other hand, when a plurality of types of subjects are detected (that is, there are divided areas in which the types of the determined subjects are different from each other), the area division unit 14d makes an affirmative determination in step S2 and proceeds to step S3.

  In step S3, as described above, the area division unit 14d performs a process of dividing the captured image into areas for each subject, and proceeds to step S4.

  In step S4, the display control unit 14a displays, for each of the divided areas divided in step S3, a ring image 50 for setting image processing according to the type of the subject, and the process proceeds to step S5.

  In step S5, the control unit 14 determines whether an operation for moving the cursor 52 of the ring image 50 displayed in step S4 (that is, a drag operation on the cursor 52) is performed on the touch panel 16b. The control unit 14 proceeds to step S6 when the operation is performed, and proceeds to step S7 when the operation is not performed.

  In step S6, as described above, the control unit 14 performs image processing in accordance with the position of the cursor 52 of the ring image 50 for each divided area. The flow of this process will be described using the flowchart shown in FIG. In step S51, the display control unit 14a moves the display position of the cursor 52 in accordance with the drag operation on the cursor 52, and proceeds to step S52.

  In step S52, the parameter changing unit 14b changes the image processing parameter of the divided area corresponding to the ring image 50 on which the drag operation has been performed according to the movement of the cursor 52 in step S51, and the process proceeds to step S53.

  In step S53, the image processing unit 14c performs image processing on the divided area corresponding to the ring image 50 subjected to the drag operation in the captured image, based on the image processing parameter changed in step S52. The process proceeds to step S54.

  In step S54, the display control unit 14a causes the display unit 17 to display the captured image after the image processing in step S53 as a through image on the display unit 17, ends the process shown in FIG. 10, and proceeds to step S7 in FIG.

  In step S7 of FIG. 8, the control unit 14 determines whether or not an operation for moving the ring image 50 displayed in step S4 (that is, a drag operation on the ring 51 of the ring image 50) is performed on the touch panel 16b. Determine When the operation is performed, the control unit 14 proceeds to step S8, and when the operation is not performed, the control unit 14 proceeds to step S9.

  In step S8, the display control unit 14a moves the display position of the ring image 50 in accordance with the drag operation on the ring 51, and proceeds to step S9 (FIG. 9).

  In step S9 in FIG. 9, the control unit 14 determines whether the user has issued a shooting instruction (that is, the shutter button 16a has been pressed). The control unit 14 proceeds to step S10 when the imaging instruction is issued, and returns to step S5 when the imaging instruction is not issued. That is, the control unit 14 repeats the processes of steps S5 to S9 until the photographing instruction is issued.

  In step S10, the display control unit 14a calculates the distances between the ring images 50 at the time of the photographing instruction, and the process proceeds to step S11. For example, as shown in FIG. 5E, when three ring images 50g, 50s, and 50p for "landscape", "sky", and "person" are displayed, the ring for "landscape" is displayed. The distance between the image 50g and the "sky" ring image 50s, the distance between the "sky" ring image 50s and the "person" ring image 50p, the "person" ring image 50p and the "landscape" ring The distances to the image 50g are respectively calculated.

  In step S11, the image processing unit 14c determines the degree of image processing to be performed on the boundary between divided areas corresponding to the ring images 50 according to the distance between the ring images 50 calculated in step S10. And go to step S12.

  In step S12, the control unit 14 causes the imaging device 12 to perform imaging processing for recording. The image processing unit 14 c performs image processing based on the image processing parameter set in each divided area at the time of the photographing instruction in the captured image data obtained by the imaging process on each divided area. Then, the control unit 14 records the captured image data subjected to the image processing in the recording medium 18 as still image data, and ends the processing illustrated in FIGS. 8 and 9.

  On the other hand, when only one type of subject is detected in the captured image, the display control unit 14a performs image processing according to the type of the detected subject in step S13 (FIG. 8) that proceeds with a negative determination in step S2 Are displayed, and the process proceeds to step S14.

  In step S14, the control unit 14 determines whether an operation for moving the cursor 52 of the ring image 50 displayed in step S13 (that is, a drag operation on the cursor 52) is performed on the touch panel 16b. When the operation is performed, the control unit 14 proceeds to step S15. When the operation is not performed, the control unit 14 proceeds to step S16.

  In step S15, the control unit 14 performs image processing on the entire captured image according to the position of the cursor 52 of the ring image 50, and the process proceeds to step S16. Note that this process is the same as the process of step S6 (the process shown in FIG. 10) except that the ring image 50 is one and image processing is uniformly performed on the entire captured image. , I omit the explanation.

  In step S16, the control unit 14 determines whether the user has issued a shooting instruction (that is, the shutter button 16a has been pressed). The control unit 14 proceeds to step S17 when the imaging instruction is issued, and returns to step S14 when the imaging instruction is not issued. That is, the control unit 14 repeats the processes of steps S14 to S16 until the photographing instruction is issued.

  In step S17, the control unit 14 causes the imaging element 12 to perform an imaging process for recording. The image processing unit 14 c performs image processing on the captured image data obtained by the imaging processing based on the image processing parameter set at the time of the imaging instruction. Then, the control unit 14 records the captured image data subjected to the image processing in the recording medium 18 as still image data, and ends the processing illustrated in FIGS. 8 and 9.

According to the embodiment described above, the following effects can be obtained.
(1) In the digital camera 1, the area dividing unit 14d divides the captured image captured by the imaging element 12 into a plurality of areas (for example, the “landscape” divided area 80g, “sky” divided according to the type of subject) Region 80s, divided region 80p of "person" is divided. The display control unit 14a controls, for each divided area, a ring image 50 (for example, a ring image 50g for “landscape”, for changing image processing parameters related to image processing according to the type of subject included in the divided area). The ring image 50s for "sky" and the ring image 50p for "person" are displayed. The parameter changing unit 14 b changes an image processing parameter corresponding to the ring image 50 on which the user operation has been performed, in accordance with the user operation on the ring image 50 (drag operation on the cursor 52). The image processing unit 14 c performs image processing on the divided area corresponding to the ring image 50 on which the user operation has been performed, based on the image processing parameter changed by the parameter changing unit 14 b. Thereby, the digital camera 1 can perform image processing according to the subject included in the divided area for each divided area divided for each subject. Therefore, the digital camera 1 can perform appropriate image processing on each subject even when a plurality of subjects are present in the captured image.

(2) In the digital camera 1, the display control unit 14 a changes the display position of the ring image 50 in response to a drag operation on the ring 51 of the ring image 50. The image processing unit 14 c performs image processing according to the distance between the display positions of the two ring images 50 corresponding to the two divided areas on the boundary between the two divided areas. Thus, the user moves the display position of the ring image 50 to change the distance between the two ring images 50, thereby applying an image to the boundary between two divided areas corresponding to the two ring images 50. The degree of treatment can be adjusted.

(3) In the digital camera 1, in the ring image 50, one or two of the first image processing to the fourth image processing according to the subject included in the divided area corresponding to the ring image 50 is applied to the divided area It can be set as image processing, and when setting two image processing, the ratio can be set. Thereby, the digital camera 1 can allow the user to select desired image processing from among a plurality of image processing suitable for the subject.

(4) In the digital camera 1, the ring image 50 for changing the image processing parameter is selected from the ring 51 and the selected position selected from the plurality of positions (first position to 65th position) on the ring 51. It is set as the image which displays the cursor 52 shown. The parameter changing unit 14 b changes the image processing parameter corresponding to the ring image 50 on which the user operation has been performed by changing the selected position (the position of the cursor 52) in accordance with the user operation. . Thereby, when the cursor 52 moves by one rotation along the ring 51, the original image is subjected to the first image processing, the second image processing, the third image processing, the fourth image processing, and then returns to the first image processing. It is intuitively easy for the user to change the image processing to return to.

(5) In the digital camera 1, the display control unit 14a displays, near the ring image 50, an icon indicating the type of the subject included in the corresponding divided area. This makes it easy to understand which subject area the ring image 50 corresponds to.

(Modification 1)
In the embodiment described above, when the display position of a ring image 50 is moved and superimposed on the display position of another ring image 50, two divided areas corresponding to these ring images 50 are combined together 1 It may be regarded as one divided area. For example, when the ring image 50g for "landscape" is moved and superimposed on the ring image 50s for "sky", these ring images 50 are hidden and the ring image shared by "sky" and "landscape" is displayed. Display 50 anew. The first to fourth image processing set to the ring image 50 common to "sky" and "scenery" is set to, for example, the ring image of the moved one (here, the ring image for "scenery") 50 The first to fourth image processing is performed. The parameter changing unit 14 b regards the “sky” divided area 80 s and the “landscape” divided area 80 g as one combined area, and the image processing parameter of the image processing to be applied to this one divided area is “ It sets according to the position of the cursor 52 of the ring image 50 of "sky" and "scenery" common use.

  Further, the control unit 14 performs a pinch-out operation (for example, an operation of touching two fingers and widening the distance between the “sky” and “landscape” shared ring image 50). In the case, the ring image 50g for the "scenery" and the ring image 50s for the "sky" are displayed separately, and the "sky" split area 80s and the "landscape" split area 80g are displayed separately. May be restored).

(Modification 2)
In the embodiment described above, an example has been described in which the image processing parameter that can be changed by the ring image 50 is a parameter indicating which image processing is to be performed at what ratio among the first to fourth image processing. However, the image processing parameters that can be changed by the ring image 50 may be other parameters.

  For example, the image processing parameter that can be changed by the ring image 50 may be the intensity of one image processing. In this case, it is assumed that only one image processing is set for each type of subject. For example, when only the "high key" is set for the subject "person", the parameter changing unit 14b sets the divided area 80p of the "person" according to the position of the cursor 52 in the ring image 50p for "person". Set the strength of the "high key" to be applied.

  Further, for example, the image processing parameter that can be changed by the ring image 50 may be a parameter indicating only which image processing is to be performed among a plurality of image processing. For example, it is assumed that eight types of image processing are set for the ring image 50 for “person”. In this case, the parameter changing unit 14b selects the image processing to be applied to the divided area 80p of the “person” from the eight types of image processing according to the position of the cursor 52 on the ring image 50p for “person”. .

(Modification 3)
In the embodiment described above, when a photographing instruction is issued, the distance between the display positions of the ring images 50 is calculated, and the degree of image processing performed on the boundary between divided areas corresponding to the ring images 50. An example of determining However, whenever the display position of the ring image 50 is changed, the distance between the display positions of the ring images 50 is calculated, and the boundary portion between the divided areas corresponding to the ring images 50 is calculated according to the calculated distance. The degree of image processing to be performed may be determined, and the image processing corresponding to the determined degree may be performed on the boundary portion.

(Modification 4)
In the embodiment described above, an example in which the area division unit 14d divides the captured image into areas for each subject has been described, but the method of dividing the captured image into a plurality of areas is not limited to this. For example, the captured image may be divided into a plurality of areas based on the subject distance (the distance from the digital camera 1 to the subject) detected by AF (Auto Focus) processing. Alternatively, for example, the user may input the outline of the area to be divided through the touch panel 16b, and the captured image may be divided into a plurality of areas based on the input outline.

(Modification 5)
In the embodiment described above, an example in which one or two image processings can be selected from the four types of image processing (first to fourth image processing) in the ring image 50 has been described. However, the number of image processing options to be selectable in the ring image 50 is not limited to this, and may be two or three, or five or more.

(Modification 6)
In the embodiment described above, an example in which the position (selected position) of the cursor 52 on the ring 51 is changed by moving the display position of the cursor 52 has been described. However, the selected position may be changed by rotating the ring 51 without moving the cursor 52 and changing the relative position between each position on the ring 51 and the cursor 52.

(Modification 7)
In the embodiment described above, the example in which the cursor 52 is displayed as a mark indicating the selected position has been described. However, the mark indicating the selected position is not limited to the cursor 52, and may be, for example, an icon. Further, for example, the color of the scale of the ring image 50 may be changed or blinked to function as a mark indicating the selected position.

(Modification 8)
In the embodiment described above, an example in which the ring image 50 is displayed as parameter change information that enables change of an image processing parameter has been described. However, the parameter change information need not be limited to the image for displaying the ring, and may be, for example, an image for displaying a bar or an icon, or text information.

(Modification 9)
In the above-described embodiment, the control unit 14 of the digital camera 1 executes the program stored in the memory (not shown) to perform the processes in FIGS. 8 to 10 described above. This program may be recorded in advance at the time of product shipment, or may be provided via a recording medium such as a memory card or a data signal such as the Internet after product shipment. FIG. 11 shows the situation. The digital camera 1 receives provision of a program via a recording medium 18 such as a memory card. The digital camera 1 also has a connection function with the communication line 101. The computer 102 is a server computer that provides the above program, and stores the program in a recording medium such as the hard disk 103. The communication line 101 is a communication line such as the Internet, personal computer communication, or a dedicated communication line. The computer 102 reads the program using the hard disk 103, and transmits the program to the digital camera 1 via the communication line 101. That is, the program is transmitted as a data signal via the communication line 101 via a carrier wave. Thus, the program can be supplied as various forms of computer readable computer program products such as a recording medium and a data signal (carrier wave).

(Modification 10)
Although the embodiment described above describes an example in which the present invention is applied to a digital camera, the present invention is not limited to this, and other imaging devices (for example, electronic devices having an imaging unit such as a mobile terminal with a camera) may be used. The invention may be applied.

  Although various embodiments and modifications have been described above, the present invention is not limited to these contents. Other embodiments considered within the scope of the technical idea of the present invention are also included within the scope of the present invention.

Reference Signs List 1 digital camera 11 imaging optical system 12 imaging element 14 control unit 14a display control unit 14b parameter change unit 14c image processing unit 14d area division unit 16 operation member 17 ... display unit, 18 ... recording medium

Claims (9)

A display unit for displaying an image;
First operation of changing the first parameter relating the ratio to perform at least two image processing of the first partial image of the plurality of set for the first image processing in the image displayed on the display unit displays use image on the display unit, the related proportions of applying at least two image processing among the plurality of second image processing set for the second partial image in the image displayed on the display unit A display control unit for displaying on the display unit a second operation image for changing the parameter of 2;
A control unit for controlling said response to the operation on the first operation image changes the first parameter, to change the second parameter in response to the operation on the second operating image,
Said performing image processing based on the first parameter relative to the first partial image, the image processing unit which performs image processing based on the second parameter to the second partial image,
An electronic device comprising the A display unit for displaying an image;
A first operation image for changing a first parameter related to a plurality of first image processing on a first partial image in the image displayed on the display unit is displayed on the display unit, and displayed on the display unit A display control unit for displaying on the display unit a second operation image for changing a second parameter related to a plurality of second image processing on a second partial image in the selected image;
A control unit configured to change the first parameter by the operation on the first operation image, and change the second parameter by the operation on the second operation image;
Image processing is performed on the first partial image based on the first parameter, image processing is performed on the second partial image based on the second parameter, and the first partial image is processed. Image processing unit that performs image processing according to the distance between the display position of the first operation image and the display position of the second operation image with respect to the boundary between the first partial image and the second partial image When,
An electronic device comprising the In the electronic device according to claim 1 or 2 ,
The display control unit is an electronic device that sets at least one image processing of the plurality of first image processing to an image processing different from the plurality of second image processing. The electronic device according to any one of claims 1 to 3 .
The display control unit changes the display position of the first operation image by the operation on the first operation image, and the display position of the second operation image by the operation on the second operation image. Change electronic equipment. The electronic device according to any one of claims 1 to 4 .
The display control unit displays information indicating the type of the first subject image included in the first partial image in the vicinity of the first operation image, and the second control unit includes the second information included in the second partial image. The electronic device which displays the information which shows the kind of to-be-photographed object image in the vicinity of the said 2nd image for operation. The electronic device according to any one of claims 1 to 5 .
The first operation image is a first annular image that displays an annular first image and a mark indicating a position selected from a plurality of positions on the first image,
The second operation image is a second annular image that displays an annular second image and a mark indicating a position selected from a plurality of positions on the second image,
The control unit changes the first parameter by changing the selected position in the first ring image by an operation, and the selected position in the second ring image is changed by the operation The electronic device which performs control which changes the said 2nd parameter by this. A first display step of displaying an image on a display unit;
First varying the ratio of applying at least two image processing of the first plurality of first image processing set for the partial image in the image displayed on the display unit in the first partial image of the operation image displayed on the display unit, the at least two image processing of the second plurality of second image processing set for the partial image in the image displayed on the display unit first A second display step of displaying a second operation image for changing a ratio to be applied to the partial image of 2 on the display unit;
A changing step of the first changes the first parameter Ri by the operation on the operation image, changing the second parameter Ri by the operation with respect to the second operating image,
An image processing step of performing image processing based on the second parameter to the performing image processing based on the first parameter relative to the first partial image, the second partial image,
An image processing method having: A first display step of displaying an image on a display unit;
A first operation image for changing a plurality of first parameters for a first partial image in the image displayed on the display unit is displayed on the display unit, and the first operation image displayed on the display unit is displayed on the display unit. A second display step of displaying on the display unit a second operation image for changing a plurality of second parameters for the two partial images ;
A changing step of changing the first parameter by the operation on the first operation image, and changing the second parameter by the operation on the second operation image;
Image processing is performed on the first partial image based on the first parameter, image processing is performed on the second partial image based on the second parameter, and the first partial image is processed. Image processing step of performing image processing according to the distance between the display position of the first operation image and the display position of the second operation image with respect to the boundary portion between the second partial image and the second partial image When,
An image processing method having: An image processing program that causes a computer to execute the image processing method according to claim 7 or 8.

Images