JP2010072934A - Album creation device and album creation method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an album creation device for automatically creating an album in which an image having such features as monochrome/gradation is arranged or an album in which an image whose main object is conspicuous is arranged even when any image having features for layout does not exist in the album in a selected image. <P>SOLUTION: A template in which the position/size of each layout frame and the features of image data to be arranged in each layout frame and a correction working processing method to be performed to the image data arranged in each layout frame are described is designated, and the designated features of the image data are analyzed, and the analyzed features of the image data are compared with the featured values of the image data arranged in each layout frame described in the designated template information, and candidate images as candidates to be arranged in each layout frame are determined, and the described correction working processing is applied so that the pixel values of the image data can be changed, and that the images whose correction working processing has been performed can be arranged in layout. Thus, it is possible to create an album. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an album creating apparatus and method for laying out a plurality of images taken with a digital camera or the like using layout information described in a template and creating a photo album.

  There is known an album creating apparatus that lays out a plurality of images taken by a digital camera or the like and creates a photo album.

  When placing an image selected by the user, it is known that the position / size for laying out the image is determined in advance as layout information, the images are automatically placed in order, or the image is placed manually by the user. ing. By preparing a plurality of templates having different layout information and switching the templates, an album having a plurality of variations can be created.

  Further, the following method is known for arranging an image selected by the user. In addition to the position and size at which the image is laid out, the characteristics of the image laid out there are also determined in advance by the layout information.

  Analyzes the selected image, obtains the characteristics of the image, and describes the characteristics of the described image and the analyzed image based on the layout information (information indicating the position / size at which the image is laid out and the characteristics of the image to be laid out) Images that match the features of are automatically placed. This technique is known (for example, refer to Patent Document 1).

  There is already a page layout where the main subject is conspicuous, can be seen at a glance, and images (monochrome / blurring etc.) having different tendencies with respect to surrounding images are arranged to give an accent. By arranging the main subject in the large layout area, sub-subjects in the small layout area, and arranging the subjects with different histograms, a layout that makes the main subject stand out is realized ( For example, see Patent Document 1).

Also, wedding photo albums add accents to albums that effectively use monochrome photos.
JP 2008-52326 A

  In the invention described in Patent Document 1, image features are described, images that match the described features are selected, laid out, and a photo album is created. If there is no image that satisfies the image features, Only describes creating a layout. Further, if there is no image satisfying the feature, an image that does not satisfy the feature may be substituted. However, in this case, the effect that the layout originally intended to be realized may not be sufficient.

  When it is desired to arrange a person image, the person is described in the image feature as layout information. Similarly, when a monochrome image is to be arranged, monochrome is described in the feature of the image as layout information. If the selected image includes a monochrome image, the characteristics of the image described in the layout information match the characteristics of the analyzed image, and the monochrome image can be arranged in the album. However, since a monochrome photograph cannot be obtained unless the photographing function of the camera is changed, the user rarely shoots a monochrome photograph and usually a color photograph. For this reason, it is highly possible that a monochrome photograph is not included in the selected image.

  An image having a feature such as sepia / illustration / blurring / sharp as well as monochrome is similar to the above, and in the prior art, it is highly possible that the image is not included in the selected image. In many cases, layouts that include cannot be created automatically.

  When it is considered to arrange images having different histograms, it is also possible to describe features with different histograms in the template, such as high saturation and low saturation, for adjacent layout frames. However, an image of a person shooting the same scene with the same camera is often an image of the same color and atmosphere, and the histograms of the main subject and other images are often close to each other. In this case, the difference between the histograms of adjacent images is small, and the degree that the main subject is noticeable may be low.

  If the selected image does not have an image with the feature you want to lay out in the album, an album with an image with features such as monochrome / blurring or an album with an image where the main subject is conspicuous is automatically created. Can not do it.

  In the present invention, an album in which an image having characteristics such as monochrome / blurring or an image in which a main subject is conspicuous is arranged, even if an image having a characteristic desired to be laid out in the album does not exist among the selected images. An object of the present invention is to provide an album creating apparatus that can be automatically created.

  The present invention relates to image data designating means for designating a plurality of image data used for creating an album, the position / size of each layout frame, the characteristics of image data arranged in each layout frame, and the images arranged in each layout frame. Template designating means for designating a template describing a correction processing method to be applied to data, image data analyzing means for analyzing characteristics of designated image data, and characteristics of image data analyzed by the image data analyzing means A candidate image determination unit that compares a feature amount of image data arranged in each layout frame described in the specified template information and determines a candidate image that is a candidate to be arranged in each layout frame; If there are multiple candidate images determined for, the evaluation value for the correction processing described in the template is obtained. By applying the correction processing described to the image determination means for determining one image from a plurality of candidate images and the image determined for each layout frame based on the obtained evaluation value An album creating apparatus comprising: correction processing means for changing pixel values of image data; and album creation means for arranging an image subjected to the correction processing in a layout to create an album.

  According to the present invention, even if there is no feature image desired to be laid out in the album in the selected image, an album in which an image having features such as monochrome / blur is arranged, or an image in which the main subject is conspicuous The arrangement album can be automatically created.

  The best mode for carrying out the invention is the following embodiment.

  FIG. 1 is a block diagram showing a schematic configuration of an album creating apparatus AM1 that is Embodiment 1 of the present invention.

  The album creating apparatus AM1 includes a host computer 100, an input device scanner 103, a digital camera 104, an output device printer 105, and a monitor.

  The host computer 100 is connected to a scanner, a digital camera, a monitor, and a printer, and not all devices are necessarily connected, and only some devices may be connected.

  The host computer 100 has an OS (Operating System) 101 and an application 102 for creating an album under the management of the OS 101.

  The host computer 100 includes a CPU 107 and a RAM 108 as various hardware that can be operated by the software and the like. The CPU 107 is a central processing unit, and the RAM 108 is a random access memory.

  Furthermore, it has a storage device such as a hard disk HD and a CD, a storage media reading device 109 and the like. The CPU 107 executes signal processing related to processing according to the software and the like. Various kinds of software are stored in advance in a storage device such as the hard disk HD, CD, DVD, etc. and the storage media reading device 109, and read out and used as necessary. The RAM 108 is used as a work area for executing signal processing by the CPU 107.

  Further, the host computer 100 can be connected to another computer via the network 110 to acquire data stored on the other computer.

  The image data is taken into the host computer 100 as needed from an input device such as a scanner or a digital camera. Further, the image data can be captured in advance from the input device and stored in the storage device and the storage medium reading device 109. Further, the image data may be image data stored in a storage medium of another host computer (including a server) connected to the host computer 100 via the network 110.

  Image data can be transferred from the input device to the host computer by a card reader, cable connection, infrared communication means, or wireless communication means. The input device may be connected to the host computer, connected by a card reader, cable connection, infrared communication means, or wireless communication means, and image data may be directly read from a memory card held by the input device or a built-in memory. .

  A monitor or printer as an output device outputs the created photo album.

  FIG. 4 is a diagram illustrating an example of an album created by the album creating apparatus AM1.

  In the example shown in FIG. 4, four images are laid out on one page. A portion where each image is arranged is called a layout frame. A first layout frame 401, a second layout frame 402, a third layout frame 403, and a fourth layout frame 404 are provided.

  The image arranged in the first layout frame 401 is a landscape image and a high-saturation image. The image arranged in the second layout frame 402 is a landscape image. The image arranged in the third layout frame 403 is a person image and is an image facing the front. The image arranged in the fourth layout frame 404 is an image of a person, and is an image in which the person is shown small.

  FIG. 2 is a functional block showing the album creating apparatus AM1.

  The album creating apparatus AM1 includes an image data storage unit 202, an image data designation unit 203, a template storage unit 205, and a template designation unit 206.

  The album creating apparatus AM1 can designate image data and a template necessary for creating an album. The album creating apparatus AM1 includes an image data analyzing unit 207, a feature holding unit 208, a candidate image determining unit 209, an evaluation value calculating unit 210, an image determining unit 211, and a correction processing unit 212. The album creating apparatus AM1 has an album creating unit 213 and an album output unit 214, and creates and outputs an album.

  The image data storage unit 202 stores a plurality of image data 201. The image data specifying unit 203 allows the user to specify a plurality of image data used for creating an album from the image data stored in the image data storage unit 202.

  The template storage unit 205 stores a plurality of types of templates 204. The template is a format in which information (layout information) necessary for creating an album is described. The “layout information” is information indicating the position and size of a layout frame in which an image is arranged, the characteristics of the image arranged in the layout frame, and the correction processing method applied to the image.

  The characteristics of the image described as the layout information are the characteristics indicating the shooting scene such as a person / landscape / night view, the characteristics indicating the size, direction and number of subjects, the color of the entire image, and the shooting time “morning / day / evening / In the case of a person at night, the name of the subject.

  The correction processing methods described as the layout information are monochrome processing, sepia processing, illustration processing, blurring processing, sharpness processing, saturation enhancement, smile correction, skin correction, and the like.

  Furthermore, the template designating unit 206 allows the user to designate a template to be used for album creation from the templates stored in the template storage unit 205. The template designating unit 206 presents and designates only a template in which a number equal to or smaller than the number of designated image data is presented to the user according to the number of image data designated by the image data designating unit 203. You may do it. A template may be specified for each page of the album. You may make it designate the template which defines the layout of the whole album.

  The image data designation unit 203 is an example of an image data designation unit that designates a plurality of image data used for album creation.

  The template designating unit 206 designates a template that describes the position / size of each layout frame, the characteristics of the image data arranged in each layout frame, and the correction processing method applied to the image data arranged in each layout frame. It is an example of the template designation | designated means to perform.

  The image data analysis unit 207 is an example of an image data analysis unit that analyzes the characteristics of designated image data.

  The candidate image determination unit 209 compares the feature of the image data analyzed by the image data analysis unit with the feature amount of the image data to be arranged in each layout frame described in the designated template information. A candidate image that is a candidate to be placed in is determined.

  If there are a plurality of candidate images determined for the layout frame, the image determination unit 211 obtains an evaluation value for the correction processing described in the template, and based on the obtained evaluation value, from the plurality of candidate images, It is an example of the candidate image determination means which determines one image.

  The correction processing unit 212 is an example of a correction processing unit that changes a pixel value of image data by applying the described correction processing to an image determined for each layout frame. By changing the pixel value, the RGB value of the image before and after the correction process changes. Specific examples of the correction processing include monochrome processing, sepia processing, blurring processing, sharpness processing, saturation enhancement processing, smile correction processing, and beautiful skin correction processing.

  In addition, a storage unit (not shown) is provided. This storage unit is an example of an application result storage unit that stores the result of applying the correction processing described in the layout frame to the image data specified by the specification unit. is there.

  The album creating unit 213 is an example of an album creating unit that arranges images subjected to correction processing in a layout and creates an album.

  The correction processing means is means for changing the correction processing intensity in accordance with the position and size of the layout frame. Further, the correction processing means is means for increasing the correction processing strength for an image arranged in a layout frame having a larger layout frame size. Further, the correction processing means is means for increasing the correction processing strength as the image is arranged in the layout frame whose position of the layout frame is closer to the center. In addition, the correction processing means is means for changing the correction processing intensity in accordance with the determined evaluation value of the image. The correction processing means is means for changing the correction processing intensity in accordance with the determined subject of the image or the shooting mode.

  Further, the correction processing intensity is changed according to the difference between the determined subject of the image and the main subject or the sub subject. Further, the correction processing intensity is changed according to whether the determined subject or the shooting mode of the image is a person or the other. Moreover, the correction processing means is means for applying the correction processing of the opposite effect to the image determined for the surrounding layout frame. In the correction processing means, the correction processing strength is changed in accordance with the position and size of the layout frame to give variations to the same processing correction processing images in the same page.

  The candidate image determining means is means for applying the correction processing described in the image data or the thumbnail image data of the image data to obtain the evaluation value based on the image data after the correction processing. Further, the candidate image determining means is means for obtaining an evaluation value by analyzing image data.

  The image data analysis unit 207 is an example of an image data analysis unit that analyzes the image data stored in the application result storage unit and analyzes the characteristics of the image data.

  Next, a template for realizing the layout shown in FIG. 4 will be described.

  FIG. 5 is a diagram illustrating an example of a template used in the album creating apparatus AM1.

  The layout frame name column 501 is a column describing the name or number of the layout frame. The image data arrangement position column 502 is a column describing the position where the image data is arranged corresponding to the layout frame. The upper left coordinate of the whole is set to (0, 0), and the upper left coordinate of the layout frame in which the image is arranged is described.

  The image data size column 503 is a column that describes the size of image data to be arranged corresponding to the layout frame. This is a column describing the width and height of the layout frame. The image data feature column 504 is a column that describes the image features corresponding to the layout frame.

  The first layout frame 401 and the second layout frame 402 are characterized in that the shooting scene is a landscape. The third layout frame 403 and the fourth layout frame 404 are characterized in that the shooting scene is a person. The third layout frame 403 is characterized in that the orientation of the person is the front. The fourth layout frame 404 is characterized in that the size of a person is small.

  Further, in the first layout frame 401, saturation enhancement is described as a correction processing method in the correction processing column 505 of the image data in order to arrange an image with high saturation.

  The image data analysis means 207 analyzes the designated image data and obtains the characteristics of the image data.

  Image features include features that can be acquired from information added to an image, such as Exif (Exchangeable image file format), and image data may be dynamically analyzed to calculate image features. The image characteristics to be calculated are image characteristics that can be described as layout information.

  Features representing a scene such as a person / landscape / night view may be acquired from information described in Exif as a shooting mode when shooting with a camera. Alternatively, it is assumed that the face is detected for the image data, and the image data from which the face is detected is the shooting scene “person”. The detected data that has not been detected is examined in a histogram, and image data with a lot of dark data may be a shooting scene “night view”, and other image data may be a shooting scene “landscape”.

  As described above, an image can be analyzed and a shooting scene can be estimated. In addition, an estimated rate of a scene when a captured scene is analyzed may be described as a feature. The estimation rate is a quantity representing the estimated accuracy of the scene. For example, when thinking about a person, if a part of the face is hidden by hands or hair, the estimation rate is made lower than when the entire face is photographed. Further, when considering the night view, it can be considered that the dark image is more like the night view. Therefore, the estimation rate of the dark image is increased by examining the histogram.

  When the subject is a person, characteristics representing the size, orientation, and number of subjects can be obtained as follows. Face detection is performed, the size of the detected face is compared with the size of the image data, and the ratio can be set as the size of the subject. Further, if the face direction can be detected in the face detection, the direction can be determined to be the direction of the subject. When the orientation of the face is considered as the feature amount, it is conceivable to use a value of 0 to 360 degrees as the orientation of the face as well as the lateral orientation, the front orientation, and the oblique orientation.

  Furthermore, the number of subjects can be obtained by counting the number of detected faces. When obtaining the color of the entire image, a histogram may be obtained and it may be determined that the same color as the most frequent color is the color of the entire image. The shooting time “morning / daytime / evening / night” is the shooting time “morning” from 5:00 to 10:00 according to the shooting time described in Exif and the like. It may be determined that it is “daytime”, the shooting time is “evening” from 16:00 to 19:00, and the shooting time “night” is from 15:00 to 15:00. In addition, since the subject can be identified by using the face recognition technology, information indicating who the subject is can be used as a feature of the image.

  The feature holding unit 208 holds the features of the image data analyzed by the image data analysis unit 207 for each image.

  Candidate image determination means 209 compares the feature of the image data obtained by analysis with the feature amount of the image data described in the template as layout information, and matches the matching image with the candidate image corresponding to the layout frame. Determine as.

  The evaluation value calculation unit 210 can calculate an evaluation value when the correction processing is performed on the image data. Even in the same correction processing, the result varies depending on the image, and therefore there are images that are suitable for the correction processing and images that are not suitable. The evaluation value is calculated so that the evaluation value of the image suitable for the correction process becomes higher. An evaluation value can be calculated by applying correction processing to image data and analyzing the image after application.

  Next, examples of evaluation values will be described according to the correction processing.

  In monochrome processing or sepia processing, an image is monochromatic, and thus an image is expressed with brightness and luminance components. For this reason, an image with high contrast looks good. The evaluation value in monochrome processing or sepia processing is actually monochrome processing or sepia processing, the contrast of the image after this processing is calculated, and the evaluation value is obtained so that the higher the contrast, the higher the evaluation value. Can do.

  Further, since the image is monochromatic, the gradation of the image is different before and after processing. The gradation value is analyzed before and after the processing, and the evaluation value can be obtained so that the evaluation value becomes higher for the images having the same gradation property before and after the processing. In the case of illustration processing, for example, in processing in which edges are emphasized, it can be determined that an image with more edges has a higher evaluation value for illustration processing.

  In the case of the blurring process, for example, a process of blurring only the background of a person's face is not conceivable. In this case, the degree of sharpness of the person's face (calculated by frequency analysis or the like) is compared with the degree of sharpness of the blurred background after processing, and the greater the difference, the more the blurred effect is obtained. It can be judged that it is expensive.

  The degree of sharpness (calculated by frequency analysis or the like) of the image after the sharpness processing is obtained, and it can be determined that the evaluation value is higher as the degree of sharpness is higher. When the saturation enhancement process is performed, the average saturation of the image after the saturation enhancement process is calculated, and an image having a higher average saturation can be determined to have a higher evaluation value. When smile correction is performed, the degree of smile can be calculated based on the condition of eyes, mouth, and eyelids. The smile level of the corrected smile face image can be calculated, and an evaluation value can be obtained according to the smile level. When skin beautification is corrected, the color and smoothness of the corrected skin can be calculated, and the evaluation value can be increased for an image whose color is close to a predetermined skin color or a smooth skin image.

  As described above, the correction processing once described is applied to the image data, and the evaluation value is obtained by analyzing the processed image.

  In the above embodiment, the correction processing is performed on the image data. However, considering the processing speed, a thumbnail image with a smaller image size is created instead of the original image data, the correction processing is performed on the thumbnail image, and the evaluation value May be requested. In the above-described embodiment, the correction processing is performed, and the processed image is analyzed to obtain the evaluation value. However, the evaluation value can be calculated based on the original image data before the processing.

  In the case of monochrome processing or sepia processing, the brightness and brightness do not change greatly depending on the processing. Therefore, the contrast of the image before processing is calculated, and the evaluation value is calculated so that the higher the contrast is, the higher the evaluation value is. May be. A result almost equivalent to the case where the evaluation value is obtained based on the processed image can be obtained.

  When the illustration process is performed, the edge of the image before the process may be obtained, and it may be determined that the evaluation value of the illustration process is higher as the image has more edges. Even when saturation enhancement processing is performed, an image with high saturation after saturation enhancement processing has high saturation even in the image before processing, so the average saturation of the image before saturation enhancement processing is calculated and the average saturation is calculated. It may be determined that the higher the image, the higher the evaluation value.

  When smile correction is performed, the pre-processing image is analyzed, and the original smile image has a high evaluation value, and the crying image has a low evaluation value. Further, the evaluation value may be determined to be higher as the number of smiles of surrounding people increases. It is desirable to actually perform the described correction processing, analyze the processed image, and calculate the evaluation value. However, considering the processing speed, analyze the image before processing and calculate the evaluation value. It may be.

  The image determining unit 211 determines one image to be arranged in the layout frame from a plurality of candidates to be arranged in the layout frame according to the evaluation value. It is conceivable to select an image having the highest evaluation value as an image to be arranged in the layout frame.

  The correction processing unit 212 applies the correction processing described in the layout frame to the image data determined by the image determination unit 211 for each layout frame. Further, when it is necessary to perform correction processing on candidate image data or thumbnail images in order for the evaluation value calculation unit 210 to obtain an evaluation value, the correction processing unit 212 is used.

  When applying the correction processing described in the layout frame, the correction processing may be applied with a constant correction processing strength, but the correction processing strength is changed according to the position and size of the layout frame. It is also possible. For example, when the saturation is emphasized, the saturation of the processed image increases as the correction processing intensity increases. For example, the correction processing strength of an image having a large layout frame is increased. The larger the layout frame, the more conspicuous the layout is, so the stronger the strength, the more noticeable.

  Similarly, attention is paid to the fact that the layout frame is closer to the center, so that the correction processing strength is increased as the position of the layout frame is closer to the center. The closer to the center, the more noticeable it is. If the subject of the image is the main subject, I want to make the layout stand out. For this reason, in the case of the main subject, a more conspicuous layout can be realized by increasing the correction strength.

  In addition, when the correction processing strength is increased for the sub subject, the sub processing is conspicuous as much as the main subject, so it is desirable to slightly reduce the correction processing strength. That is, a better layout can be realized by changing the correction processing intensity depending on whether the subject of the image data is a main subject or a sub subject.

  It is also conceivable to change the correction processing strength in accordance with the evaluation value calculated by the evaluation value calculation unit 210. The smaller the evaluation value, the smaller the effect of correcting the processed image even with the same correction processing strength. For this reason, the correction processing strength is increased for an image having a small evaluation value. Thereby, even for an image having a small evaluation value, a sufficient correction effect can be obtained for the processed image.

  It is also conceivable to change the correction intensity depending on the subject or the shooting mode. When the subject or the shooting mode is a person, if the correction processing strength is increased more than a certain level as compared with the case other than the person, the image may not be preferable. For this reason, a better correction effect can be obtained by changing the correction processing strength for the person and the others.

  As described above, a better layout can be realized by changing the correction processing intensity according to the position and size of the layout frame, the subject of the image, the shooting mode, the evaluation value, and the like.

  The album creating unit 213 arranges the image data determined based on the image characteristics or the image data corrected and processed by the correction processing unit 212 according to the position and size of the layout frame described in the designated template. And create an album.

  The album output unit 214 outputs the created album via a monitor or a printer.

  Next, processing of the album creating apparatus AM1 will be described.

  FIG. 3 is a flowchart showing the processing of the album creating apparatus AM1.

  First, in S301, the user designates a plurality of image data used for album creation from the image data stored in the image data storage unit 202. In S302, the user designates a template used for album creation from a plurality of templates stored in the template storage unit 205. In step S303, the designated image data is analyzed to obtain image characteristics. Since a plurality of images are designated, the features of all designated images are calculated and stored in the feature holding unit 208. In S304, the feature amount of the image of each layout frame described in the template is compared with the feature of the analyzed image, and a matching image is selected as a candidate image to be placed in each layout frame.

  In S305, it is checked whether there are a plurality of candidate images. If there is only one candidate image to be arranged in the layout frame, it is determined that one image is the image to be arranged, and the process proceeds to S308.

  If there are a plurality of matching candidate images, it is checked in step S306 whether correction processing information is described in the layout frame. If correction processing information is not described in the layout frame, one image is selected as a candidate image, and the process proceeds to S308.

  It is also conceivable to compare the feature amount of the analyzed image with the feature amount of the image in the layout frame and determine one sheet based on the comparison result. For example, if the estimated rate of the shooting scene is obtained as the analyzed feature amount, an image with a high estimated rate is selected. When the orientation of the subject is obtained as an angle, an image whose angle is close to the image feature of the layout frame is searched. In this way, by comparing the feature amount of the analyzed image with the feature amount of the image in the layout frame and determining one image based on the comparison result, it is possible to select an image that is more preferable to be arranged. If correction processing information is described in the layout frame, an evaluation value of the correction processing described by the evaluation value calculation unit 210 is obtained for a candidate image in S307. According to the evaluation value, one image to be arranged in the layout frame is determined from a plurality of candidate images.

  In step S308, it is checked whether images have been assigned to all layout frames. If not assigned, the process of S304 is executed for the next layout frame. After determining the images to be arranged in all the layout frames, if the correction processing corresponding to the layout frame is described in the template, the correction processing is performed on the images in S309. If the correction processing corresponding to the layout frame is described, the correction processing image is arranged based on the position / size of the image arranged in the layout frame. For all the layout frames, images are arranged and an album is created. When the number of designated images is greater than the number of layout frames of the designated template, images with low feature matching and low correction processing evaluation values are not laid out in the album.

  Next, processing for creating a layout album will be described.

  FIG. 6 is a diagram illustrating an example of image data designated by the user used in the album creating apparatus AM1 according to the first embodiment.

  In S301, the user designates four images shown in FIG. In S302, the user designates the template shown in FIG. In S303, four images are analyzed. Since the human image data 601 and the image data 602 of the person and the landscape can detect a face as a result of the face detection, the shooting mode is analyzed as a person. Since the image data 603 and 604 of the landscape cannot detect a face, the shooting mode is analyzed as landscape. Further, as a result of face detection, it is determined that the face image data 601 of the person is facing the front, and the face image data 602 of the person and the landscape is determined to be small.

  Other features are also analyzed, but are omitted here. In step S304, the feature described in the template is compared with the feature of the image for the first layout frame 401. The image feature of the first layout frame 401 is a landscape, and the image data 603 and 604 match. Since there are multiple items in S305, the process proceeds to S306. In the first layout frame 401, information on correction processing is described. Since it is saturation enhancement, thumbnail images of the image data 603 and 604 are created and the saturation enhancement processing is actually performed. Compare the average saturation of the processed images. Since the image data 603 has higher average saturation, the evaluation value is also higher. Assume that the image data 603 having a high evaluation value is an image of the first layout frame 401.

  In S308, the layout frame still remains, so the process returns to S304. A feature of the image of the second layout frame 402 is a landscape. The image data 603 and 604 correspond to the image of the second layout frame 402, but since the image data 603 is already used in the first layout frame 401, the image data 604 is used as the image of the second layout frame 402. And Similarly, the third layout frame 403 is determined as the image data 601, and the fourth layout frame 404 is determined as the image data 602. When images are determined for all layout frames, the process proceeds to S309. The image of the first layout frame 401 is subjected to saturation enhancement as the correction processing, and the processed image is arranged. The images of the second layout frame 402, the third layout frame 403, and the fourth layout frame 404 are arranged as they are according to the layout information, and the album is completed.

  According to the above-described embodiment, first, correction processing equivalent to the feature desired to be laid out in the album is designated as the layout information of the template. In addition, if multiple images satisfying the characteristics are selected and multiple images are candidate images, an evaluation value is obtained, an image having the highest evaluation value is selected, correction processing is performed, and the image subjected to the correction processing is used as a template layout. Arrange according to the information and create an album. Regardless of whether or not the image of the feature you want to lay out in the album originally exists or not, the image is created by correction processing. An album can be created automatically.

  In the conventional example, an image to be arranged can only be described as a feature in the layout information. If there is no image that satisfies the feature, an album as intended cannot be created. However, in the first embodiment, it is possible to create an album as intended by the template regardless of whether or not an image having a characteristic desired to be laid out exists in the album.

  In the first embodiment, saturation enhancement is performed only on the first layout frame 401 in which correction processing is described as layout information in the template.

  In the second embodiment, the following process is performed in order to create a more conspicuous album. When performing the correction processing in S309 and arranging the correction processing, the correction processing for obtaining an effect opposite to the described processing for the image around the layout frame in which the correction processing is described based on the layout information. Apply. In the case of saturation enhancement, monochrome processing is performed. In the case of blurring processing, sharpness processing is performed.

  By performing the correction processing of the opposite effect on the surrounding image, the image that has been subjected to the correction processing described can be more emphasized.

  In the first embodiment, saturation enhancement is performed only on the first layout frame 401 in which correction processing is described as layout information in the template.

  FIG. 7 is a diagram illustrating an example of an album created by the album creating apparatus AM3 according to the third embodiment.

  FIG. 8 is a diagram illustrating an example of a template.

  The album shown in FIG. 7 is created using the template shown in FIG. Monochrome processing is described as correction processing for three images in the same page.

  As described in the first embodiment, the described correction processing may be applied. Furthermore, in order to emphasize the effect of the correction processing, the correction processing strength can be changed according to the position of the layout frame, and the display of the entire page can be changed. For example, the correction processing intensity for monochrome processing is output in pure black when intensity = 0, output in cool black when intensity = -50, and output in warm black when intensity = + 50. In this way, the three images in the page have different shades even in the same monochrome process, so the atmosphere of the entire page changes and the layout becomes interesting for the user. Thus, an effective album can be created by changing the correction processing strength according to the position of the layout frame and performing the correction processing.

  In the first embodiment, the second embodiment, and the third embodiment, when a user designates an image and a template that the user wants to use for album creation, an album is automatically created according to the designated image and template. The automatically created album is output to the monitor, presented on the monitor, and if there is a part to be changed, the user can manually change the album to create a better album.

  If the user does not like the album with the specified template, the template can be changed via the template specifying means 206. When changing the template, it may be changed on a page-by-page basis or on the entire album.

  After changing the template, a new album can be created by processing according to the procedure in the first embodiment. If the image to be specified does not change, if the feature of the previously analyzed image held by the feature holding unit 208 is used as it is, there is no need to execute the processing by the image data analyzing unit 207, and the feature is compared with the previous one. The processing speed is fast and an album can be created. Similarly, once-analyzed image features may be retained after album creation and used again when the image is specified.

  Further, when changing the template, the correction processing strength may be changed instead of changing the template. If the user can change the correction processing strength and the user desires to create a more conspicuous album or an accented album, the correction processing strength is set strongly.

  Conversely, if the impression of the image subjected to the correction processing is too strong, the correction processing strength is set weak and the album is recreated.

  By doing so, it is possible to create a better album by further manually adjusting the album after automatically creating the album according to the image and template designated by the user.

  In the first embodiment, the second embodiment, the third embodiment, and the fourth embodiment, the image data is analyzed from the designated image data, and the image is analyzed with the feature amount of each layout frame described in the template. Are compared with each other and a matching image is selected. Thereafter, if correction processing information is described in the image of the layout frame, an evaluation value of the correction processing is further obtained from the image to determine the image.

  In the fifth embodiment, the presence / absence of the correction processing described in the image of the layout frame is analyzed, and if there is a description of the correction processing, it is applied to all designated image data. Similarly, an evaluation value for correction processing is obtained in advance. Next, the image data is analyzed from the designated image data, and a feature amount 1 is obtained. Thereafter, an image whose feature value 1 is closest to the feature value of the image in the layout frame is determined as an image to be arranged in the layout from images having a high evaluation value of the correction processing.

  Next, processing of the album creating apparatus AM5 that is Embodiment 5 will be described.

  FIG. 9 is a flowchart illustrating processing of the album creating apparatus AM5 according to the fifth embodiment.

  Note that the block configuration of the album creating apparatus AM5 is the same as that of the album creating apparatus AM1, and therefore, description will be made using the components in the album creating apparatus AM1.

  In the album creating apparatus AM5, in step S901, the user designates a plurality of image data used for creating an album from the image data stored in the image data storage unit 202. In step S <b> 902, the user designates a template to be used for album creation from the templates stored in the template storage unit 205. In step S903, the designated image data is analyzed to obtain a feature amount 1 of the original image. Since a plurality of images are designated, the features of all designated images are calculated and stored in the feature holding means 208. In step S904, it is checked whether correction processing is described in the layout frame.

  If correction processing is not described, an image is selected in which the feature described in the layout frame matches the feature value 1 of the original image by image analysis.

  If the correction processing is described, in S905, the correction processing described in the template is applied to all the image data. In S906, all the corrected processing data created in S905 are analyzed, and the feature amount 2 of the corrected processed image is obtained. Since a plurality of images are designated, the features of all designated images are calculated and stored in the feature holding means 208. As described in the first embodiment, in S907, the evaluation value calculation unit 210 calculates an evaluation value when the correction processing is performed. In S908, an image having the feature amount 2 closest to the feature amount described in the layout frame is selected from the images having the high evaluation value calculated in S907.

  In step S909, the selected image is arranged based on the position and size of the image arranged in the layout frame. In step S910, it is determined whether images have been selected for all layout frames. If selection has not been completed, the process returns to step S904 to perform image selection processing. If all layout frame images have been selected, the process ends and an album is created.

  In the fifth embodiment, since the image feature amount 2 obtained based on the corrected processed image actually used for the album is used, and an image close to the layout characteristic is selected, the result of the corrected processing is obtained. It is possible to select the optimum image to be reflected.

  If each means in the above embodiment is replaced with a process, the above embodiment can be grasped as a method invention.

  In addition, a storage medium (or recording medium) that stores software program codes that implement the functions of the above embodiments may be supplied to the system or apparatus. If the computer of the system or apparatus reads and executes the program code stored in the storage medium, the object of the present invention can be achieved.

  In this case, the program code itself read from the storage medium realizes the functions of the above embodiments, and the storage medium storing the program code constitutes the present invention.

  The functions of the above embodiments are not only realized by executing the program code read by the computer. That is, when the operating system (OS) running on the computer executes part or all of the actual processing based on the instruction of the program code, the functions of the above embodiments are realized by the processing. Is also included.

  Further, the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. After that, the CPU of the function expansion card or function expansion unit performs part or all of the actual processing based on the instruction of the program code, and the functions of the above embodiments are realized by the processing. Such cases are also included in the present invention.

1 is a block diagram showing a schematic configuration of an album creating apparatus AM1 that is Embodiment 1 of the present invention. FIG. It is a functional block showing the album creating apparatus AM1. It is a flowchart which shows the process of album production apparatus AM1. It is a figure which shows an example of the album produced with album production apparatus AM1. It is a figure which shows the example of the template used with album production apparatus AM1. It is a figure which shows the example of the image data designated by the user used with album production apparatus AM1. It is a figure which shows an example of the album produced with the album production apparatus AM3 which is Example 3. FIG. 10 is a diagram illustrating an example of a template used in Example 3. FIG. 14 is a flowchart illustrating processing of the album creating apparatus AM5 according to the fifth embodiment.

Explanation of symbols

100: Host computer,
103 ... Scanner,
104 ... Digital camera,
105 ... Printer,
107 ... CPU,
108 ... RAM,
109 ... HD / CD,
201 ... image data,
202 ... image data storage means,
203 ... image data designation means,
204 ... template,
205: Template storage means,
206 ... Template designation means,
207 ... Image data analysis means,
208 ... feature retaining means,
209 ... Candidate image determination means,
210 ... evaluation value calculation means,
211 ... Image determining means,
212 ... Correction processing means,
213 ... Album creation means,
214 ... Album output means,
401 ... first layout frame,
402 ... the second layout frame,
403 ... Third layout frame,
404 ... the fourth layout frame,
501 ... Layout frame name field,
502 ... Image data arrangement position field,
503 ... Image data size column,
504 ... Image data feature column,
505 ... Image data correction processing column,
601 ... person image data,
602 ... image data of a person and a landscape,
603 ... Scenery image data,
604 ... Scenery image data.

Claims (14)

Image data specifying means for specifying a plurality of image data used for creating an album;
A template designating unit for designating a template describing the position and size of each layout frame, the characteristics of image data arranged in each layout frame, and the correction processing method applied to the image data arranged in each layout frame;
Image data analysis means for analyzing the characteristics of the designated image data;
A candidate that is a candidate to be placed in each layout frame by comparing the feature of the image data analyzed by the image data analysis means with the feature amount of the image data placed in each layout frame described in the specified template information Candidate image determining means for determining an image;
If there are a plurality of candidate images determined for the layout frame, an evaluation value having a higher value for an image suitable for the correction processing described in the template is obtained, and a plurality of evaluation images are obtained based on the obtained evaluation value. Image determining means for determining one image from the candidate images;
Correction processing means for applying the described correction processing to the image determined for each layout frame;
An album creating means for arranging the corrected image in the layout and creating an album;
An album creating apparatus characterized by comprising: In claim 1,
The album creating apparatus, wherein the correction processing means is means for changing the correction processing strength in accordance with the position and size of the layout frame. In claim 2,
The album creating apparatus according to claim 1, wherein the correction processing means is means for increasing the correction processing strength for an image arranged in a layout frame having a larger layout frame size. In claim 2,
The album creating apparatus according to claim 1, wherein the correction processing means is means for increasing the correction processing strength for an image arranged in a layout frame whose position of the layout frame is closer to the center. In claim 1,
The album creating apparatus, wherein the correction processing means is means for changing the correction processing intensity in accordance with the determined evaluation value of the image. In claim 1,
The album creating apparatus, wherein the correction processing means is means for changing the correction processing intensity in accordance with the subject of the determined image or the photographing mode. In claim 6,
An album creating apparatus, wherein the correction processing intensity is changed according to a difference between a determined subject of an image being a main subject and a sub subject. In claim 6,
An album creating apparatus characterized in that the correction processing intensity is changed according to whether the determined subject or photographing mode of the image is a person or the other. In claim 1,
The album apparatus according to claim 1, wherein the correction processing means is means for applying correction processing of the opposite effect with respect to an image determined for a surrounding layout frame. In claim 1 or claim 2,
In the above correction processing means, the album creation is characterized in that the correction processing strength is changed in accordance with the position and size of the layout frame, and variations are given to images of the same processing correction processing in the same page apparatus. In any one of Claims 1 to 10,
The image determination means is means for applying the correction processing described in the image data or the thumbnail image data of the image data, and obtaining an evaluation value based on the image data after the correction processing. apparatus. In any one of Claims 1 to 10,
The album creating apparatus, wherein the candidate image determining means is means for obtaining an evaluation value by analyzing image data. Image data specifying means for specifying a plurality of image data used for creating an album;
A template designating unit for designating a template describing the position and size of each layout frame, the characteristics of image data arranged in each layout frame, and the correction processing method applied to the image data arranged in each layout frame;
Application result saving means for saving the result of applying the correction processing described in the layout frame to the image data designated by the designation means;
Image data analysis means for analyzing image data stored in the application result storage means and analyzing characteristics of the image data;
Analyzes the specified image data, compares the characteristics of the obtained image data with the feature values of the image data to be placed in each layout frame described in the specified template information, and places them in each layout frame Candidate image determining means for determining a candidate image;
If there are a plurality of determined candidate images for the layout frame, an evaluation value for the described correction processing is obtained, and one image data is determined from the plurality of candidate image data based on the obtained evaluation value. Image determining means to perform;
Correction processing means for changing the pixel value of the image data by applying a description correction processing to the image determined for each layout frame;
An album creating means for arranging the corrected image in the layout and creating an album;
An album creating apparatus characterized by comprising: An image data specifying step for specifying a plurality of image data used for creating an album;
A template designating step for designating a template describing the position / size of each layout frame, the characteristics of the image data arranged in each layout frame, and the correction processing method applied to the image data arranged in each layout frame;
An image data analysis process for analyzing the characteristics of the specified image data;
It is a candidate to be placed in each layout frame by comparing the feature of the image data analyzed in the image data analysis step with the feature amount of the image data placed in each layout frame described in the specified template information. A candidate image determining step for determining a candidate image;
If there are a plurality of candidate images determined for the layout frame, an evaluation value for the correction processing described in the template is obtained, and one image is determined from the plurality of candidate images based on the obtained evaluation value. A candidate image determination step;
A correction processing step of changing the pixel value of the image data by applying the described correction processing to the image determined for each layout frame;
An album creation step of arranging the corrected image in the layout and creating an album;
An album creation method characterized by comprising:

Images