JP5182054B2 - Image processing apparatus and image processing program - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing program for displaying thumbnail images.

In the conventional film type camera, there is a print service called index print that displays a list of photographed images on one print. As a conventional example of such an index print, there is known an index print creation method that makes it easy to distinguish a main subject by extracting a main subject such as a person from image data and changing image processing between the main subject and the background. (For example, refer to Patent Document 1).
JP 2001-75183 A

  On the other hand, digital cameras include so-called thumbnail images (hereinafter referred to as thumbnail images) in which a plurality of captured images are displayed in a list on one screen. This thumbnail image can be output to various display devices such as a monitor screen of a PC (personal computer), a rear liquid crystal monitor of a camera, or a TV screen. On the other hand, since the index print of the above prior art is premised on printer output, it is difficult to make image processing conform to the output conditions of various display devices, and it is not easy to distinguish the scene and main subject. It was.

  An object of the present invention is to provide an image processing apparatus and an image processing program that can always display a thumbnail image that easily distinguishes a scene and a main subject regardless of output conditions of an image output destination.

The present invention solves the above problems by the following means. In addition, in order to make an understanding easy, although the code | symbol corresponding to embodiment of this invention is attached | subjected and demonstrated, it is not limited to this.
The invention of claim 1 includes an image acquisition means to obtain the captured image, in accordance with the display size of the image per one thumbnail in the image output destination, the image processing with different emphasis effect on the image an image setting means to set and an image analysis means to identify the main subject from the acquired image by said image acquiring means, the relative main subject region including a main subject specified by the image analysis unit and implementing the image processing that has been set by the image setting unit, and an image processing means to convert the image including the main object area in which the image processing has been applied to the thumbnail image, the converted image thumbnail by the image processing unit and a storage means to store the image setting unit, the display size for one thumbnail image in the image output destination is less than a threshold, and emphasizing effect It sets the image processing to increase the magnification of the main object, if the display size is equal to or greater than the threshold, that, to set different image processing and image processing to increase the magnification of the main object as enhancement effect Ru image processing apparatus der characterized.
The invention according to claim 2, an image processing apparatus according to claim 1, wherein the image settings manually stage as long ago Symbol display size is equal to or larger than the threshold, the correction regarding the color tone of the main object as enhancement effect An image processing apparatus characterized by setting image processing for increasing a coefficient.
The invention according to claim 3, an image processing apparatus according to claim 2, wherein the image settings manually stage, in the image processing when the display size is smaller than the threshold, the magnification of the main object The image processing apparatus is characterized by being enlarged within the range of the display size.
Invention of claim 4, an image processing apparatus according to claim 2 or 3, wherein the image settings manually stage, in the image processing when the display size is greater than or equal to the threshold, the main object color An image processing apparatus characterized in that the correction coefficient for correction and gradation correction is set to be large.
The invention of claim 5 is the image processing apparatus according to claim 4, wherein the image settings manually stage, in the image processing when the display size is greater than or equal to the threshold, the main object color correction and An image processing apparatus characterized in that a correction coefficient for gradation correction is set to have a different value depending on a type of an image output destination.
Invention according to claim 6, an image processing apparatus according to claim 4 or 5, wherein the image settings manually stage, as the image processing when the display size is greater than or equal to the threshold, the main object color An image processing apparatus is characterized in that correction coefficients for correction and gradation correction are set to different values.
Invention according to claim 7, comprising an image acquisition means to acquire the photographed image, and the image setting hand stage, an image analysis hand stage, an image processing hand stage, a storage Hand stage, and a control unit an image processing equipment the image processing program of, in the image setting unit, in accordance with the display size of the image per one thumbnail in the image output destination, sets a different image processing with emphasis effect on the image An image setting step; an image analysis step for specifying a main subject from the images acquired by the image acquisition step in the image analysis unit; and a main subject specified by the image analysis step in the image processing unit. The image processing set in the image setting step is performed on the main subject area including the image, and the image including the main subject area subjected to the image processing is used for the thumbnail. An image processing step of converting the image, in the storage means, wherein the image storing step of storing the converted image thumbnail by the image processing step, in the image setting step, a thumbnail image in the image output destination If the display size per sheet is less than the threshold, image processing for increasing the enlargement ratio of the main subject is set as an enhancement effect. An image processing program that causes the control unit to execute setting of image processing different from image processing for increasing the image processing .
In addition, the said structure may be improved suitably, and at least one part may substitute for another structure.

  According to the present invention, it is possible to provide an image processing apparatus and an image processing program that can always display a thumbnail image that easily distinguishes a scene and a main subject regardless of output conditions of an image output destination.

  Embodiments of an image processing apparatus and an image processing program according to the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram illustrating a configuration of an image processing apparatus 1 according to the present embodiment. For example, the image processing apparatus 1 is built in an electronic device including a display device such as a digital camera, a PC, or a TV. However, the image processing device 1 may be configured to be connected to the electronic device by wire or wirelessly. .

  As shown in FIG. 1, the image processing apparatus 1 according to the present embodiment is configured around a CPU 10, and includes a display unit 20, an operation unit 30, an external device I / F 40, a memory 50, and a media reading unit 60. Hereinafter, each part will be described.

  The display unit 20 is a display device serving as an image output destination, and for example, a liquid crystal display is used. In addition to the captured main image and thumbnail image, an operation screen is displayed on the display unit 20. The image output destination is not limited to the display unit 20 and may be a display device or a printer connected via an external device I / F 40 described later.

  The operation unit 30 is an input device operated by a user, and acquires operation inputs such as designation of the number of thumbnail divisions per screen, transmission of images displayed on the display unit 20, and setting of an external output destination. .

  The external device I / F (interface) 40 is an interface circuit for transmitting image data to an external device (not shown).

  The memory 50 temporarily stores the image data of the main image read from the outside and the image data of the thumbnail image, as well as programs necessary for various processes performed by the CPU 10 to be described later, initial values necessary for executing the programs, It is a storage device that stores setting values and the like. The memory 50 of this embodiment functions as a storage unit that stores thumbnail images converted by the image processing unit 14 described later. In addition to the program necessary for the operation and control of the image processing apparatus 1, the memory 50 stores initial values and setting values necessary for the execution of this program.

  The media reading unit 60 is a device that reads a main image from a medium 70 serving as a storage medium, and includes a memory card slot (not shown) in which the medium 70 is detachably mounted. The media reading unit 60 of the present embodiment functions as a main image acquisition unit that acquires a main image.

  The CPU 10 is an integrated circuit that controls the operation of the entire apparatus, and includes a microprocessor. The CPU 10 operates according to the control program stored in the memory 50, thereby executing the functions of the control unit 11, the image setting unit 12, the image analysis unit 13, the image processing unit 14, and the thumbnail processing unit 15.

  In addition to the display unit 20, the operation unit 30, the external device I / F 40, the memory 50, and the media reading unit 60, the control unit 11 includes an image setting unit 12, an image analysis unit 13, an image processing unit 14, and thumbnail processing described later. The operation of the unit 15 is controlled in an integrated manner.

  The image setting unit 12 sets image processing with different emphasis effects on the main image stored in the medium 70 according to the display size per thumbnail image on the display unit 20 serving as an image output destination. Specifically, the display size per thumbnail image is calculated according to the output condition of the display unit 20, and the image processing is set by comparing the display size with a threshold value.

  Here, the output conditions are the type (for example, PC monitor screen, TV screen, etc.) of the display unit 20 that is the image output destination, the screen size, the number of thumbnail divisions (per screen), and the like. These pieces of information are read into the image setting unit 12 via the operation unit 30 (or may be stored in the memory 50 as specified values).

  The image setting unit 12 calculates the display size per thumbnail image according to the output conditions. The display size h (height) * w (width) is calculated from the screen size H (height) * W (width) of the display unit 20 and the thumbnail division number D. If the display size h * w is less than the threshold, image processing for increasing the enlargement ratio S of the main subject is set as an enhancement effect. If the display size h * w is equal to or larger than the threshold value, image processing for increasing the correction coefficient V for color correction and gradation correction of the main subject is set as an enhancement effect.

  Here, a correspondence relationship between the display size h * w, the enlargement ratio S, and the correction coefficient V will be described. FIG. 2A is an explanatory diagram showing a correspondence relationship between the display size h * w and the enlargement ratio S. FIG. As shown in FIG. 2A, when the display size h * w is less than the threshold T (for example, when the thumbnail division number D is large, or the thumbnail division number D is not large but the screen size is small), Since there is a high possibility that the main subject is displayed small, image processing is set so that the enlargement ratio S of the main subject is increased as the enhancement effect as the display size h * w of one image is reduced. However, the enlargement ratio S is increased within the range (Max) of the display size h * w. Further, when the position of the main subject exists at the end of the screen, it is moved to the center of the screen as an emphasis effect. On the other hand, when the display size h * w is equal to or larger than the threshold value T, the enlargement ratio S is set to 100%.

Further, as shown in FIG. 2B, when the display size h * w is equal to or larger than the threshold T (for example, when displayed on an external device having a large screen size or when the division number D is small), the enhancement effect is obtained. Since the need for “enlarging” is low, image processing is set to increase the correction coefficient V of “color correction” and “tone correction” of the main subject as the enhancement effect as the display size h * w of one image increases. To do. Here, as color correction, for example, saturation is emphasized, and output saturation = input saturation * (1 + V). As gradation correction, for example, contrast enhancement is performed, and output value = input value ^{{1/1 + V}} .

  It should be noted that the correction coefficient V for color correction and gradation correction is made large in a range where no color saturation or gradation collapse occurs. On the other hand, when the display size h * w is less than the threshold value T, the correction coefficient V = 1 (no correction) is set.

  2A and 2B are stored in advance in the memory 50 and read into the CPU 10 as necessary.

  The image analysis unit 13 specifies a main subject by performing scene recognition processing on the main image read from the medium 70. Then, an area including the identified main subject is cut out from the main image as the main subject area.

  The image processing unit 14 performs image processing having an enhancement effect such as “enlargement” or “color correction” and “tone correction” set by the image setting unit 12 for the main subject region cut out by the image analysis unit 13. To implement. Then, the main image subjected to the image processing is resized to a display size h * w per thumbnail image and converted into a thumbnail image. The image data of the thumbnail image is temporarily stored in the memory 50.

  The thumbnail processing unit 15 reads the image data of the thumbnail image from the memory 50 and creates a thumbnail image that is a list display screen of the resized images. Further, the thumbnail image is displayed on the display unit 20.

  Next, a processing procedure for creating a thumbnail image in the image processing apparatus 1 configured as described above will be described with reference to a flowchart shown in FIG. The image processing based on this flowchart is executed by starting an image processing program stored in the memory 50.

  First, the image setting unit 12 acquires the screen size H * W of the display unit 20 serving as an image output destination and the number of thumbnail divisions D (steps S101 and S102). Based on these H, W, and D, the image setting unit 12 The display size h * w per image is calculated (step S103). Then, it is determined whether or not the display size h * w is less than the threshold value T (step S104). Here, if Yes, the image setting unit 12 sets the image processing of the main subject to “enlargement” of the image and sets the enlargement ratio S (steps S105 and S106). On the other hand, if No in step S104, the image setting unit 12 sets the image processing of the main subject to “color correction” and “tone correction”, and sets the correction coefficient V (steps S107 and S108). The enlargement ratio S in step S106 and the correction coefficient V in step S108 are set by referring to the data indicating the correspondence relationship in FIG. 2 described above.

  When the process of step S106 or step S108 is completed, the control unit 11 sets the main image number k = 1 and the counter i = 1, and the main image No. k is read (steps S109 and S110). Next, the image analysis unit 13 performs scene recognition processing on the read main image to identify the main subject, and cuts out the region including the identified main subject from the main image as the main subject region (steps S111 and S112). ). Subsequently, the image processing unit 14 performs the image processing set in step S105 or step S107 on the main subject region, and the thumbnail image No. i is temporarily stored in the memory 50 (steps S113 and S114).

  When the process of step S114 ends, the control unit 11 determines whether the counter i is less than the thumbnail division number D or the main image number k is less than the total number of main images (step S115). If No, the control unit 11 sets the main image number k = k + 1 and the counter i = i + 1 (step S116), and returns to step S111. That is, the processing from step S111 to step S114 by the image analysis unit 13 and the image processing unit 14 is performed until the total number of thumbnail divisions D or the main image in the medium 70 is read as the number of images necessary for displaying thumbnail images. Run repeatedly.

  If the determination in step S115 is Yes, the control unit 11 clears all the values of the main image number k and the counter i (step S117). Next, the thumbnail processing unit 15 reads out the image data of the thumbnail image from the memory 50 and creates a thumbnail image that is a list display screen of the resized main images (steps S118 and S119). Then, the thumbnail image is displayed on the display unit 20 (step S120), and the processing of this routine is finished.

  Note that when an operation input for image forwarding is acquired in the operation unit 30, the thumbnail image is updated by repeating the processing in steps S109 to S115 for the main image to be updated.

  Next, a specific example of thumbnail images created by the image processing apparatus 1 according to the present embodiment will be described. 4A to 4C are explanatory diagrams illustrating display examples of thumbnail images. FIG. 4A shows a display example when one screen is divided into four. FIG. 4B shows a display example when one screen is divided into nine in the conventional display method. As shown in FIG. 4B, when one screen is divided into nine, more images can be displayed than when divided into four. However, in the conventional display method, if the number of divisions is increased, the main subject is displayed. Therefore, depending on the image, it becomes difficult to determine the scene and main subject. However, in the present embodiment, as shown in FIG. 4C, when the display size per thumbnail image is small, the main subject is enlarged. According to this, the size of the main subject in the case of 9 divisions can be maintained at the same size as in the case of 4 divisions as shown in FIG. It becomes easy.

According to this embodiment, the following effects can be obtained.
(1) Since image processing with different enhancement effects is set for the main image in accordance with the display size per thumbnail image at the image output destination, enhancement suitable for the display size is applied to the main subject. The effect will be given. Therefore, it is possible to display a thumbnail image that is always easy to determine the scene and main subject regardless of the output condition of the image output destination.
(2) When the display size per thumbnail image at the image output destination is smaller than the threshold value, the enlargement ratio of the main subject is increased as an enhancement effect, so the display size depends on the output conditions of the image output destination. The main subject does not become small even if the image becomes small, and the user can easily identify the main subject. Further, since the enlargement ratio of the main subject is increased within the range of the display size per thumbnail image, the detail of the main subject is not impaired even when the display size is reduced. In addition, when the position of the main subject is present at the end of the screen, the main subject is moved to the center of the screen as an emphasis effect, which makes it easier to identify the main subject.
(3) When the display size per thumbnail image at the image output destination is larger than the threshold value, the correction factor for color correction and gradation correction of the main subject is increased as the enhancement effect. When is large, the main subject does not become unnecessarily large, and the user can easily identify the main subject.
(Deformation)

Without being limited to the embodiment described above, the present invention can be variously modified and changed as described below, and these are also within the scope of the present invention.
(1) In this embodiment, in the enhancement effect when the display size per thumbnail image at the image output destination is larger than the threshold, the correction factors for color correction and gradation correction of the main subject are the same. However, the correction coefficient may be different for each correction process. In addition, the correction coefficient for color correction and gradation correction of the main subject may be different depending on the image output destination. For example, the emphasis effect suitable for the image output destination can be obtained by changing the correction coefficient of the gradation correction between the TV screen and the print output by the printer.
(2) In this embodiment, image processing with different emphasis effects is set according to the display size per thumbnail image at the image output destination, but the same image processing is set uniformly. Also good. For example, the enlargement ratio of the main subject is increased regardless of the display size. Alternatively, a plurality of threshold values for determining the size of the display size h × w may be set, and image processing may be set more finely.
(3) In the present embodiment, an example in which “enlargement”, “color correction” + “gradation correction” of the main subject is set as the image processing having the enhancement effect has been described. Image processing such as “cut out area”, “move”, “reduce”, and “deform” of the main subject may be set.
(4) In the present embodiment, an example of creating a highlighted thumbnail image based on a captured main image has been described. However, the present invention is not limited to this example, and the thumbnail image recorded in the tag information of the main image is used. A thumbnail image highlighted based on the image may be created. The thumbnail image recorded in the tab information may be a normal divided thumbnail image or a display thumbnail image for displaying one image on the entire monitor screen. .
(5) In the present embodiment, an example is shown in which image processing for creating a highlighted thumbnail image is executed by starting an image processing program stored in the memory 50 of the image processing apparatus 1. However, the present invention is not limited to this example, and a storage medium in which program data corresponding to a part or all of the image processing program executed by the control unit 11 is prepared, and the recording medium is used as necessary. The image processing program recorded in the storage medium may be read via an operating system or the like of the other device mounted on an electronic device such as another camera or PC. That is, the image processing in the present embodiment can be executed not only on a specific camera, PC, TV, or other electronic device, but also on another electronic device equipped with a display device.
(6) In the present embodiment, the case of creating a thumbnail image has been described as an example. However, the present invention is not limited to this. It can be applied to all possible display media.

  Moreover, although the said embodiment and modification can be used in combination suitably, since the structure of each embodiment is clear by illustration and description, detailed description is abbreviate | omitted. Furthermore, the present invention is not limited by the embodiment described above.

It is a block diagram which shows the structure of the image processing apparatus concerning embodiment. (A), (b) is explanatory drawing which shows the correspondence of a display size, a magnification, and a correction coefficient. It is a flowchart which shows the process sequence in the case of producing a thumbnail image in the image processing apparatus of embodiment. (A)-(c) is explanatory drawing which shows the example of a display of a thumbnail image.

Explanation of symbols

  1: image processing apparatus, 10: CPU, 11: control unit, 12: image setting unit, 13: image analysis unit, 14: image processing unit, 15: thumbnail processing unit, 20: display unit, 30: operation unit, 40 : External device I / F, 50: Memory, 60: Media reading unit, 70: Media

Claims (7)

Image acquisition means for acquiring a captured image;
Image setting means for setting image processing with different enhancement effects for the image according to the display size per thumbnail image at the image output destination;
Image analysis means for identifying a main subject from the images acquired by the image acquisition means;
The image processing set by the image setting unit is performed on the main subject region including the main subject specified by the image analysis unit, and the image including the main subject region subjected to the image processing is converted into a thumbnail image. Image processing means,
Storage means for storing thumbnail images converted by the image processing means;
With
The image setting means includes
If the display size per thumbnail image at the image output destination is less than the threshold, image processing for increasing the enlargement ratio of the main subject is set as an enhancement effect. If the display size is greater than or equal to the threshold, the enhancement effect is set. Setting image processing different from the image processing for increasing the enlargement ratio of the main subject as
An image processing apparatus. The image processing apparatus according to claim 1,
The image setting means includes
If the threshold ago Symbol display size, setting the image processing to increase a correction factor for the color tone of the main object as enhancement effect,
An image processing apparatus. The image processing apparatus according to claim 2,
The image setting means includes
In the image processing in the case where the display size is less than a threshold value, the enlargement ratio of the main subject is increased within the range of the display size.
An image processing apparatus. The image processing apparatus according to claim 2 or 3,
The image setting means includes
In image processing when the display size is equal to or larger than a threshold value, setting is performed so that correction coefficients for color correction and gradation correction of the main subject are increased.
An image processing apparatus. The image processing apparatus according to claim 4,
The image setting means includes
In image processing when the display size is greater than or equal to a threshold value, the correction coefficient for color correction and gradation correction of the main subject is set to be different depending on the type of image output destination.
An image processing apparatus. The image processing apparatus according to claim 4 or 5,
The image setting means includes
As image processing when the display size is greater than or equal to a threshold value, the correction coefficients for color correction and gradation correction for the main subject are set to different values, respectively.
An image processing apparatus. An image processing program for an image processing apparatus including an image acquisition unit that acquires a captured image, an image setting unit, an image analysis unit, an image processing unit, a storage unit, and a control unit,
In the image setting means, an image setting step for setting image processing with different enhancement effects for the image according to a display size per thumbnail image at the image output destination;
In the image analysis means, an image analysis step for identifying a main subject from the images acquired by the image acquisition step;
The image processing means performs image processing set in the image setting step on the main subject area including the main subject specified in the image analysis step, and includes the main subject area subjected to the image processing. An image processing step for converting the image to a thumbnail image;
An image storage step for storing the thumbnail image converted by the image processing step in the storage means ,
In the image setting step,
If the display size per thumbnail image at the image output destination is less than the threshold, image processing for increasing the enlargement ratio of the main subject is set as an enhancement effect. If the display size is greater than or equal to the threshold, the enhancement effect is set. Setting image processing different from the image processing for increasing the enlargement ratio of the main subject as
Is executed by the control unit.

Images