JP4860342B2 - Album creating apparatus, album creating method, and album creating program - Google Patents

Description

  The present invention relates to an album creating apparatus, an album creating method, and an album creating program. In particular, the present invention relates to an album creating apparatus, an album creating method, and an album creating program for creating an album in which a main object does not overlap a page boundary line.

After detecting the length of the image area in the sub-scanning direction for each original, the magnification is scaled so that the length of the image area in each original in the sub-scanning direction is constant based on the detected length. Then, a partition line image is formed at the boundary of each image region on the long paper. Thus, there has been proposed a method for preventing a crease, that is, a page boundary line from overlapping an image portion such as a character portion when a document having a plurality of pages is recorded on a long sheet and folded for each page.
Japanese Patent Laid-Open No. 09-080976

  However, since the invention described in Patent Document 1 can be used only for long paper such as roll paper, it cannot be used for creating an album in which an image is printed on a spread page. In addition, since an image that does not have a problem even if it overlaps the page boundary line is processed so as not to overlap the page boundary line, there is a problem that the degree of freedom of layout in album creation is limited.

  Therefore, an object of the present invention is to provide an album creation apparatus, an album creation method, and an album creation program that can solve the above-described problems. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  In order to solve the above-described problem, according to the first aspect of the present invention, an album creating apparatus, an image layout unit for laying out a plurality of images on each page of an album, and a crease page that is a page including a crease. The boundary position storage unit that stores the position of the page crease in the image and whether the main object in the image laid out on the crease page by the image layout unit overlaps the position of the page fold stored in the boundary position storage unit. When the boundary determination unit and the boundary determination unit determine that the main object overlaps the page fold, the main object does not overlap the page fold. A main object moving unit that moves the position.

  In addition, the image layout unit further categorizes a plurality of images for each spread page that is a crease page, and the image layout unit lays out the images classified by the spread page for each spread page on each spread page of the album. The boundary position storage unit stores the position of the page boundary line between the right page and the left page in the spread page, and the boundary determination unit stores the boundary position of main objects in the image laid out on the spread page by the image layout unit. The main object moving unit determines whether the main object is overlaid when the boundary determining unit determines that the main object overlaps the page boundary. You can move the position of the main object relative to the facing page so that it doesn't overlap the page border. .

  Further, the image layout unit lays out a plurality of images on a cover including an album cover, spine, and back cover, and the boundary position storage unit stores the position of the fold of the album cover, and the boundary determination unit Determines whether the main object in the image laid out on the cover by the image layout unit overlaps the position of the fold of the cover stored in the boundary position storage unit, and the main object moving unit When it is determined that the main object overlaps the position of the cover fold, the position of the main object relative to the cover may be moved so that the main object does not overlap the position of the cover fold.

  In addition, a title frame position information storage unit that stores, as title frame position information, a position of a title frame in which character string information arranged on an album cover including at least one of a front cover, a back cover, and a back cover is laid out Further, the image layout unit lays out a plurality of images on the cover of the album, and the boundary determination unit stores main objects in the image laid out on the cover by the image layout unit in the title frame position information storage unit. The main object moving unit determines whether the main object overlaps the title frame position when the boundary determining unit determines that the main object overlaps the title frame position. The position of the main object relative to the cover may be moved so as not to overlap.

  The title frame position information storage unit stores the position of the title frame on which the character string information arranged on the back cover of the album is laid out as title frame position information, and the image layout unit stores a plurality of images in the back of the album. The boundary determination unit determines whether or not the main object in the image laid out on the back cover by the image layout unit overlaps the position of the title frame stored in the title frame position information storage unit. The main object moving unit, when the boundary determining unit determines that the main object overlaps the title frame position, prevents the main object from overlapping the title frame position. The position may be moved.

  Further, the main object moving unit moves the image that the boundary determining unit determines that the main object overlaps the page fold so that the main object does not overlap the page fold. The main object moving unit may move the position of the main object with respect to the crease page, and the main object moving unit detects that the boundary determining unit determines that the main object overlaps the page fold. The position of the main object relative to the crease page may be moved so that the main object does not overlap the crease of the page by moving the main object that is determined to overlap the fold.

  Further, there are an object extraction unit that extracts an object included in an image laid out by the image layout unit, an object type specification unit that specifies the type of the object extracted by the object extraction unit, and an object type specified by the object type specification unit. A main object determining unit that determines an object that is a person as a main object may be further included. In the main object moving unit, the main object that the boundary determination unit determines to overlap the page fold is a person. If it is determined, the position of the person relative to the crease page may be moved so that the face of the person does not overlap the crease of the page.

  According to the second aspect of the present invention, there is provided an album creating method, an image layout stage in which a plurality of images are laid out on each page of an album, and a fold position of a page in a fold page that is a page including a fold. Whether the main object in the image laid out on the crease page in the image layout stage overlaps the fold of the page referenced in the boundary position reference stage. A boundary determination stage for determining whether or not the main object overlaps the page fold when it is determined that the main object overlaps the page fold at the boundary determination stage. Main object movement stage to move the position of the object Equipped with a.

  According to a third aspect of the present invention, there is provided an album creating program for an album creating apparatus for creating an album, the album creating apparatus including an image layout unit for laying a plurality of images on each page of an album, The boundary position storage unit that stores the position of the crease of the page in the crease page that is a page including the main object in the image laid out on the crease page by the image layout unit is the crease of the page stored in the boundary position storage unit Boundary determination unit that determines whether or not they overlap, and when the boundary determination unit determines that the main object overlaps the crease of the page, the main object for the crease page is prevented from overlapping the crease of the page. As the main object moving part that moves the position of the object To function.

  Further, in the fourth embodiment of the present invention, the album creating apparatus is an image layout unit that lays out a plurality of images on a previously generated album template, and a template image arranged in the album template, The template image position storage unit that stores the position of the album in the template, and whether the main object in the image laid out by the image layout unit on the album template overlaps the position of the template image stored in the template image position storage unit If the overlap determination unit determines whether or not the main object overlaps the position of the template image, the main determination for the album page is performed so that the main object does not overlap the template image. Object position And a main object moving section for moving the.

  In addition, the main object moving unit moves the image that the overlap determining unit determines that the main object overlaps the position of the template image stored in the template image position storage unit with respect to the template image, The position of the main object with respect to the template image may be moved so that the main object does not overlap the template image. The main object moving unit is configured so that the overlap determining unit determines the position of the template image for the image that the overlap determining unit determines that the main object overlaps the position of the template image stored in the template image position storage unit. The position of the main object relative to the template image may be moved so as to prevent the main object from overlapping the template image by moving the main object determined to overlap with the template image.

  Further, in the fifth embodiment of the present invention, there is provided an album creating method, an image layout stage for laying out a plurality of images on a previously generated album template, and a template image arranged in the album template, A template image position reference stage that references a template image position storage section that stores the position in the album template, and main objects in the images laid out in the album template in the image layout stage are referenced in the template image position reference stage. An overlap determination stage for determining whether or not the template object overlaps the position of the template image, and if it is determined in the overlap determination stage that the main object overlaps the position of the template image, the main object is So as not to overlap with the image, and a main object moving step of moving the position of the main object for the album page.

  According to a sixth aspect of the present invention, there is provided an album creating program for an album creating apparatus for creating an album, wherein the album creating apparatus lays out a plurality of images on a previously generated album template. A template image position storage unit that stores the position of the template image arranged in the album template in the album template, and the main object in the image laid out by the image layout unit in the album template is the template image position storage unit. The overlap determination unit that determines whether or not the position of the stored template image overlaps, and when the overlap determination unit determines that the main object overlaps the position of the template image, the main object is added to the template image. If heavy Oddly, to function as the main object moving section for moving the position of the main object for the album page.

  According to a seventh aspect of the present invention, there is provided an album creating apparatus for creating an album by laying out an image on an album template having a page template in which a layout frame in which an image is to be arranged is previously arranged. A crease position storage unit that stores a position of a crease included in the page template with respect to a layout frame arranged in advance in the page template of the page including the main object area determination that determines an area of a main object of the image in the image The image is placed in the layout frame by comparing the crease position with respect to the layout frame stored in the fold position storage unit and the main object area in the image determined by the main object area determination unit for each image. Page template crease and image main When the image is arranged in the layout frame based on the determination result of the image comparison unit and whether the image comparison unit determines whether or not the object overlaps, the crease of the page template and the main object of the image do not overlap An image selection unit that selects an image, and an image layout unit that lays out the image selected by the image selection unit in a layout frame.

  According to an eighth aspect of the present invention, there is provided an album creating method for creating an album by laying out an image on an album template having a page template in which a layout frame in which an image is to be placed is arranged in advance. A fold position reference stage for referring to a fold position storage section that stores a fold position included in the page template with respect to a layout frame arranged in advance in the page template of the page including the image, and a main object of the image in the image The main object area determination stage for determining the area of the image, the position of the crease relative to the layout frame referenced in the fold position reference stage, and the main object area in the image determined in the main object area determination stage are compared for each image. To place the image in the layout frame. If the image template is placed in the layout frame based on the image comparison stage for determining whether or not the crease of the page template and the main object of the image overlap, and the determination result in the image comparison stage, the page template An image selection stage for selecting an image in which the crease and the main object of the image do not overlap, and an image layout stage for laying out the image selected in the image selection stage in a layout frame.

  In the ninth embodiment of the present invention, an album creating program for an album creating apparatus that lays out an image and creates an album on an album template having a page template in which a layout frame in which an image is to be placed is arranged in advance. A fold position storage unit for storing the position of a fold included in the page template with respect to a layout frame previously arranged in the page template of the page including the fold, and the main object of the image in the image The main object area determination unit for determining the area of the image and the crease position with respect to the layout frame stored in the fold position storage unit are compared with the main object area in the image determined by the main object area determination unit for each image. If you place an image in the layout frame, In addition, when the image is arranged in the layout frame based on the determination result of the image comparison unit and the image comparison unit that determines whether or not the crease of the page template overlaps with the main object of the image, the fold of the page template An image selection unit that selects an image that does not overlap with main objects of the image, and an image layout unit that lays out the image selected by the image selection unit in a layout frame.

  According to a tenth aspect of the present invention, there is provided an album creating apparatus for creating an album by laying out an image on an album template having a page template in which a layout frame in which an image is to be arranged is arranged in advance. A template image position storage unit that stores the position of a template image included in the page template with respect to a layout frame previously arranged in the page template of the page including the image, and a main that determines a region of a main object of the image in the image Compare the position of the template image with respect to the layout frame stored in the object area determination unit, the template image position storage unit, and the main object area in the image determined by the main object area determination unit An image in the frame When the image is arranged in the layout frame based on the determination result of the image comparison unit that determines whether or not the template image of the page template and the main object of the image overlap, and the determination result of the image comparison unit, An image selection unit that selects an image in which a template image of the page template and a main object of the image do not overlap each other, and an image layout unit that lays out the image selected by the image selection unit in a layout frame.

  According to an eleventh aspect of the present invention, there is provided an album creating method for creating an album by laying out an image on an album template having a page template in which a layout frame in which an image is to be arranged is previously arranged. A template image position reference stage that refers to a template image position storage unit that stores a position of a template image included in the page template with respect to a layout frame previously arranged in the page template of the page including the image, and the image in the image The main object area determination stage for determining the main object area of the image, the position of the template image with respect to the layout frame referred to in the template image position reference stage, and the main object area in the image determined in the main object area determination stage. An image comparison stage for determining whether or not the template image of the page template and the main object of the image overlap when the image is compared with the image area for each image and the image is arranged in the layout frame. The image selection stage for selecting an image in which the template image of the page template and the main object of the image do not overlap when the image is arranged in the layout frame based on the determination result in, and the image selected in the image selection stage And an image layout stage for laying out the layout frame.

  In the twelfth aspect of the present invention, an album creating program for an album creating apparatus that lays out an image and creates an album on an album template having a page template in which layout frames in which images are to be placed is arranged in advance. An album creating apparatus is a template image position storage unit that stores a position of a template image included in the page template with respect to a layout frame previously arranged in a page template of the page including the template image. A main object area determination unit for determining a main object area, a position of the template image with respect to the layout frame stored in the template image position storage unit, and a main object area in the image determined by the main object area determination unit; Based on the determination result of the image comparison unit and the image comparison unit that determine whether or not the template image of the page template overlaps the main object of the image when the image is arranged in the layout frame as compared for each image When an image is placed in the layout frame, an image selection unit that selects an image in which the template image of the page template and the main object of the image do not overlap, and an image layout that lays out the image selected by the image selection unit in the layout frame Function as a part.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  According to the present invention, when the main object included in the captured image overlaps the page boundary of the album, the album can be created by automatically moving the position of the main object with respect to the spread page. .

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows an overview of an album creating apparatus 100 according to an embodiment of the present invention. The album creating apparatus 100 according to the present embodiment creates an album by moving the position of the main object with respect to the spread page when the main object included in the captured image overlaps the page boundary of the album. Objective. The spread page is an example of a fold page that is a page including a fold, and the page boundary line of the spread page is an example of a fold of the page in the fold page. The crease page may include an album page, an album insert page, an album cover, an album spine, and an album back cover.

  For example, the user 600 images the subject 610 with the imaging device 150. The imaging device 150 stores a captured image. Then, the imaging device 150 supplies the captured images to the album creating device 100 via a memory and a network such as the Internet. The album creating apparatus 100 classifies the received plurality of captured images according to a predetermined standard. Then, the album creating apparatus 100 selects an image including a main object from the plurality of classified captured images. Subsequently, the album creating apparatus 100 lays out a plurality of captured images including the selected image on the spread page 200 of the album. Here, the main object may be an object that frequently appears among the objects included in the classified images. Further, among the objects included in the classified image, an object with more movement may be set as a main object. Furthermore, when a plurality of objects are included in the classified image, an object whose type is a person may be set as a main object.

  A case is considered in which the page boundary line 208 of the album page overlaps the image of a person as a main object included in the captured image 204 on the spread page 200 of the album after the image is laid out. In such a case, the album creating apparatus 100 moves the position of the main object with respect to the spread page 200 so that the image of the person who is the main object does not overlap the page boundary line 208. Then, the album creating apparatus 100 creates a spread page 202. The album creating apparatus 100 creates the album 220 by outputting the created spread page 202 to a printer, a display, or the like.

  According to the album creating apparatus 100 according to the present embodiment, when an image is laid out on an album page, even if a fold of the page included in the album page overlaps with a main object included in the image, the image is included in the image. The album can be created by automatically moving the position of the main object to a position where the main object does not overlap the page fold. As a result, the viewer of the album can clearly recognize the main object that the viewer wants to watch, and can increase the satisfaction of the viewer.

  FIG. 2 shows an example of a functional configuration of the album creating apparatus 100 according to the present embodiment. The album creating apparatus 100 includes an image storage unit 10, an image classification unit 20, an image layout unit 30, an object extraction unit 40, an object type identification unit 42, a main object determination unit 44, a boundary position storage unit 50, and a title frame position information storage unit. 52, a boundary determination unit 60, a main object moving unit 70, a printing unit 80, and a display unit 84. The image storage unit 10 stores a plurality of images received from the imaging device 150. The image storage unit 10 stores an image in association with an identifier that can uniquely identify the image. The image storage unit 10 may store an image, a position where the image is captured, and a time when the image is captured in association with the identifier. Further, the image storage unit 10 may store an image, a focusing distance when the image is captured, a hue of the captured image, and the like in association with the identifier. The image may be accompanied by information indicating the position of the main object included in the image with respect to the image, and the image storage unit 10 further stores the position of the main object relative to the image in association with the identifier. May be. The image storage unit 10 supplies a plurality of images to the image classification unit 20 and the object extraction unit 40.

  The image classification unit 20 classifies the plurality of images received from the image storage unit 10 for each page of the album. The image classification unit 20 may classify a plurality of images for each spread page in the album. Further, the image classification unit 20 may receive a main object determined for each of the plurality of captured images from the main object determination unit 44. For example, the image classification unit 20 may classify a plurality of images based on the position where the captured image is captured, the imaging time, and the like. Further, a plurality of captured images may be classified based on the main object determined by the main object determination unit 44. The captured image is an example of an image.

  Here, the image classification unit 20 may set a theme for each of the plurality of spread pages, and classify the plurality of images along each theme. The theme may be content that is of great interest to album viewers. The theme may be, for example, travel, athletic meet, pet or the like. That is, when the theme is travel, the image classification unit 20 classifies a plurality of images captured by the user at the travel destination for each place. Further, when the theme is athletic meet, the image classification unit 20 extracts images related to the athletic meet from a plurality of images, and classifies them for each competition or for each person. Furthermore, the theme may be a theme related to a pet, a theme related to a specific object, or the like. In either case, the spread page theme may be determined based on the types of main objects included in the captured image. The image classification unit 20 supplies the plurality of classified images to the image layout unit 30.

  The image layout unit 30 lays out a plurality of images on each page of the album. Specifically, the image layout unit 30 lays out a plurality of images on a crease page that is a page including a crease. The image layout unit 30 lays out the plurality of classified images received from the image classification unit 20 on each of the spread pages of the album. The image layout unit 30 may lay out an image on a page template in which a layout frame in which the image is to be arranged is arranged in advance when the classified image is laid out on the spread page of the album. In this case, a layout frame in which an image including a main object should be laid out may be determined in advance in the page template. Further, the image layout unit 30 may lay out a plurality of images on a cover including an album cover, a back cover, and a back cover. For example, the image layout unit 30 may lay out images on the back cover of an album. Further, the image layout unit 30 may lay out the image on a template having a shape such as a CD-ROM or a DVD. The image layout unit 30 supplies the image laid out on the album page to the object extraction unit 40.

  The object extraction unit 40 extracts the image of the object included in the image laid out on the spread page of the album received from the image layout unit 30. The object extraction unit 40 extracts an object image by image processing such as contour extraction processing and color distribution analysis processing. Then, the object extracting unit 40 supplies the extracted object image and the image laid out on the spread page of the album to the object type specifying unit 42. The object type identification unit 42 identifies the type of the extracted object received from the object extraction unit 40.

  The object type identification unit 42 includes, for example, an image of an object received from the object extraction unit 40 and a pattern image of a person's body, a pattern image of animals and plants, a vehicle such as an automobile, which the object type identification unit 42 has in advance. The type of object may be specified by pattern matching with a pattern image, a building pattern image, or the like. When the specified object is a person, the object type specifying unit 42 may further specify the face area of the person. The face area of a person can be specified based on the contour shape of the person's face, the shape of a characteristic part of the face such as the eyes, nose, mouth, and eyebrows, and the position of each part in the face. Further, the object type specifying unit 42 may specify a human face region by skin color extraction or the like. The object type identification unit 42 supplies the identified object type and the image laid out on the album page to the main object determination unit 44.

  When the object type received from the object type specifying unit 42 is a person, the main object determination unit 44 determines the object as a main object. In addition, among the objects included in the plurality of captured images classified by the image classification unit 20, an object that is imaged with a frequency equal to or higher than a predetermined reference value among the plurality of classified captured images is mainly used. May be determined as a simple object. Thereby, the main object determination unit 44 can determine a person and an object that are frequently imaged as main objects.

  Further, the main object determination unit 44 calculates position information indicating the position occupied by the main object in the captured image. Here, the position information may be calculated in association with the coordinates. For example, the main object determination unit 44 calculates the range occupied by the main object in the captured image in association with the coordinates. The range occupied by the main object may be calculated as, for example, the coordinates of the range occupied by the main object on the coordinate axis by setting a coordinate axis for the captured image. Furthermore, when the main object is a person, the main object determination unit 44 may calculate the position of the person's face in association with the coordinates.

  Furthermore, the main object determination unit 44 may determine main objects as follows. First, the imaging device 150 captures a preliminary image at a plurality of focusing distances. Then, the main object determination unit 44 receives a plurality of preliminary images from the imaging device 150 and calculates a spatial frequency component of each preliminary image. Then, the main object determination unit 44 may determine the object included in the captured image captured at the focal distance at which the high-frequency component is higher than a predetermined level as the main object. . Note that the preliminary image may be an image acquired by the imaging device 150 in order to determine an imaging condition such as a focus position. For example, the preliminary image may be an image captured at each in-focus position and having a lower resolution than the captured image. The main object determination unit 44 includes an image including the object determined as the main object, position information indicating the position of the main object with respect to the image, and an image laid out on the album page in the image layout unit 30 as a boundary determination unit. 60 and the image classification unit 20.

  The boundary position storage unit 50 stores the fold position of the page in the fold page. Further, the boundary position storage unit 50 may store the position of the fold of the cover of the album. Further, the boundary position storage unit 50 stores the position of the page boundary line between the right page and the left page in the spread pages of the album. The boundary position storage unit 50 may set a coordinate axis for a spread page and store the position of the page boundary line in association with the coordinates. Further, the boundary position storage unit 50 may store coordinates indicating positions of different page boundary lines in association with the type of album format. Note that the page boundary line of the spread page, the crease line of the page crease, the crease line of the cover crease, and the like are examples of the crease of the page. In addition to the right and left pages of the album of the book type, the spread pages may be a plurality of pages with a fold between the folded pages. For example, when an album is created by double folding, not only the page boundary line between the right page and the left page in the spread page but also the fold line at the center of the right page and the left page may be used as the page boundary line. Furthermore, when creating a bellows-folded page or inserting a folded page between pages, the fold of each page may be a page boundary line. In addition, the boundary position storage unit 50 may store the positions of holes such as CD-ROM and DVD when the template on which the image layout unit 30 lays out an image is a template such as CD-ROM and DVD. . The boundary position storage unit 50 supplies the position of the page fold to the boundary determination unit 60 based on the control of the boundary determination unit 60.

  The title frame position information storage unit 52 stores, as title frame position information, the position of the title frame where the character string information arranged on the cover of the album including at least one of the front cover, the back cover, and the back cover is laid out. . For example, the title frame position information storage unit 52 may store, as title frame position information, the position of the title frame in which character string information arranged on the back cover of the album is laid out. Note that the character string information laid out in the title frame may be a character string indicating the theme of the album. For example, when the theme of the album is an athletic meet, the character string information may be a character string indicating the athletic meet. When the theme of the album is travel, the character string information may be character string information including a place name of the travel destination. The title frame position information storage unit 52 supplies the title frame position information to the boundary determination unit 60 based on the control of the boundary determination unit 60.

  The boundary determination unit 60 determines whether the main object in the image laid out on the crease page by the image layout unit 30 overlaps the position of the fold of the page received from the boundary position storage unit 50. When the image layout unit 30 lays out the image on the cover of the album, the boundary determination unit 60 determines whether or not a main object in the image overlaps the position of the fold of the cover. The boundary determination unit 60 may determine whether or not main objects in the image laid out on the cover by the image layout unit 30 overlap the position of the title frame received from the title frame position information storage unit. For example, when the image layout unit 30 lays out the image on the back cover, the boundary determination unit 60 determines whether or not main objects included in the image overlap the position of the title frame arranged on the back cover. You can judge. Note that, when the template is a template such as a CD-ROM or DVD, the boundary determination unit 60 may determine whether or not a main object overlaps a hole in the template of the CD-ROM. The boundary determination unit 60 supplies the main object moving unit 70 with information indicating whether or not the main object in the image overlaps the position of the fold of the page, and the image laid out on the page.

  Further, the boundary determination unit 60 overlaps the position of the page boundary line received from the boundary position storage unit 50 with the main object in the image laid out on the page in the image layout unit 30 received from the main object determination unit 44. It may be determined whether or not. For example, the boundary determination unit 60 matches the coordinate axis of the page with the coordinate axis of the captured image. The boundary determination unit 60 compares the coordinates associated with the page boundary line with the coordinates associated with the range occupied by the main object included in the image. When the range occupied by the main object overlaps the page boundary line, the boundary determination unit 60 includes information indicating that the main object overlaps the page boundary line together with the image laid out by the image layout unit 30. This is supplied to the main object moving unit 70. On the other hand, when the range occupied by the main object does not overlap the page boundary line, the boundary determination unit 60 transfers the image laid out on the album page in the image layout unit 30 to the printing unit 80 and the display unit 84. Supply.

  The main object moving unit 70, when the boundary determining unit 60 determines that the main object overlaps the page fold, the main object moving unit 70 prevents the main object from overlapping the page fold. Move position. Further, when the image layout unit 30 lays out the image on the cover of the album and the boundary determining unit 60 determines that the main object overlaps the position of the cover fold, the main object moving unit 70 The position of the main object with respect to the cover is moved so that the correct object does not overlap the position of the fold of the cover. Further, the main object moving unit 70, when the boundary determining unit 60 determines that the position of the title frame and the main object overlap, the main object moving unit 70 prevents the main object from overlapping the title frame position. The position of the object may be moved. For example, when the image layout unit 30 lays out the image on the back cover of the album, when the boundary determination unit 60 determines that the position of the main object included in the image overlaps the position of the title frame of the back cover, The main object moving unit 70 may move the position of the main object with respect to the title frame of the back cover. The direction in which the main object moving unit 70 moves the main object may be a direction away from the title frame. For example, the main object moving unit 70 may be any of the upper, lower, left, and right directions with respect to the position of the title frame.

  In addition, when the main object moving unit 70 receives information indicating that the page boundary line of the spread page and the main object overlap from the boundary determination unit 60, the main object and the page boundary line do not overlap. Next, the position of the main object with respect to the spread page is moved. For example, the main object moving unit 70 moves the image including the main object in a direction in which the main object moves away from the page boundary with respect to the spread page, thereby overlapping the main object and the page boundary. Can be avoided. When the main object moving unit 70 receives information from the boundary determining unit 60 that the main object overlaps the page boundary line, the main object moving unit 70 is included in the image without moving the position of the image on the spread page. The position of the main object may be spread and moved relative to the page so that the main object does not overlap the page boundary.

  Further, the main object moving unit 70 trims the partial area occupied by the main object included in the image. Then, the main object moving unit 70 enlarges the trimmed partial area to a size that fits the layout frame in which the captured image before trimming was fitted. Then, the main object moving unit 70 may insert the enlarged partial area into the layout frame of the spread page. When the main object determining unit 44 determines that the main object is a person and the boundary determining unit 60 determines that the face of the person overlaps the page boundary line, the main object moving unit 70 may move the position of the person relative to the facing page so that the face of the person does not overlap the page boundary. The main object moving unit 70 supplies the page after moving the position of the main object to the printing unit 80 and the display unit 84.

  When the template is a template such as a CD-ROM or DVD, the main object moving unit 70 prevents the main object included in the image from overlapping the hole of the CD-ROM or DVD. The position of may be moved. Specifically, the main object moving unit 70 does not overlap the hole when the boundary determining unit 60 determines that the main object overlaps the position of the hole in the template of the CD-ROM. As described above, the position of the main object with respect to the hole may be moved.

  The printing unit 80 prints the pages received from the main object moving unit 70 and the boundary determination unit 60 to create an album. The printing unit 80 may print a page on the surface of a CD-ROM, DVD, or the like. Further, the page may be displayed as an electronic album on the display unit 84 including a display device such as a monitor.

  According to the album creating apparatus 100 according to the present embodiment, it is possible to automatically prevent a main object such as a person included in a captured image from overlapping a page fold in the fold page of the album. Thereby, the viewer can appreciate the album in which the crease is not overlapped with the main object which is highly interested for the viewer, and the satisfaction of the viewer can be increased.

  Furthermore, according to the album creating apparatus 100 according to the present embodiment, an album laid out by the image layout unit 30 can be created when the main object and the page boundary line do not overlap. As a result, it is possible to secure a degree of freedom with respect to the layout of the image, so that it is possible to create an album that the viewer can watch and never get tired of.

  FIG. 3 shows an example of an image moving method in the main object moving unit 70 according to the present embodiment. The main object moving unit 70 moves the image determined by the boundary determining unit 60 that the main object overlaps the page boundary line with respect to the spread page. In addition, the main object moving unit 70 may move the position of the layout frame predetermined on the spread page to a position where the main object does not overlap the page boundary line, and may fit an image including the main object. Furthermore, the main object moving unit 70 may select a page having a layout in which the main object does not overlap the page boundary line, and fit an image including the main object in the layout frame.

  For example, when a main object included in the image 310 overlaps the page boundary line 304 with respect to the spread page 300, the main object moving unit 70 moves the position of the image 310 with respect to the spread page 300. Then, the main object moving unit 70 moves the image 312 like the spread page 302, thereby avoiding the main object included in the image 312 from overlapping the page boundary line 306.

  According to the album creating apparatus 100 according to the present embodiment, when the main object included in the captured image overlaps the page boundary line of the album, the position of the image can be automatically moved. Thereby, since it is possible to avoid the main object included in the image from overlapping the fold of the album, it is possible to avoid impairing the appearance of the main object.

  FIG. 4 shows an example of an image moving method in the main object moving unit 70 according to the present embodiment. The main object moving unit 70 detects the main image that has been determined by the boundary determining unit 60 as being overlapped by the page boundary line, for the image that is determined by the boundary determining unit 60 to be overlapped by the page boundary line. Move the object. The main object moving unit 70 moves the position of the main object with respect to the spread page so that the main object does not overlap the page boundary line.

  For example, consider a case where the main object 414, which is a main object included in the image 410, overlaps a part of the page boundary line 404 in the spread page 400. In such a case, the main object moving unit 70 sets the partial region by dividing the image 410 into a predetermined range. Then, the main object moving unit 70 calculates a spatial frequency for each set partial region. Subsequently, the main object moving unit 70 selects a partial region where the level of the high frequency component of the spatial frequency is small. Then, the main object moving unit 70 extends the selected partial area in a predetermined direction. The direction in which the main object moving unit 70 extends the partial area may be, for example, the longitudinal direction or the short direction of the partial area. In addition, the amount by which the main object moving unit 70 extends the partial area covers the area where the main object 414 before trimming existed when the main object 414 is trimmed to a position that does not overlap the page boundary 404. It can be as much as possible. When the partial region is stretched, interpolation processing may be performed on the pixels in the stretched direction using a nearest neighbor method, a linear interpolation method, or the like.

  Then, the main object moving unit 70 trims the main object 414 and moves it to a position that does not overlap the page boundary line 404 of the spread page 400. Subsequently, the main object moving unit 70 superimposes the stretched partial area on the area where the main object 414 before trimming was present. Thereby, it is possible to avoid the main object 416 included in the image 412 from overlapping the page boundary line 406 in the spread page 402 after the main object 414 is moved.

  FIG. 5 shows an example of an image moving method in the main object moving unit 70. The main object moving unit 70 trims a partial area including the main object of the image. Then, the main object moving unit 70 may enlarge the trimmed partial area and fit the partial area into the layout frame of the spread page. The area to be trimmed by the main object moving unit 70 may be determined so that the main object does not overlap the page boundary line when the trimmed partial area is enlarged to fit the layout frame. .

  For example, when the person who is the main object included in the image 510 overlaps the page boundary line 504 in the spread page 500, the main object moving unit 70 includes the partial area 512 including the person who is the main object. To trim. Subsequently, the main object moving unit 70 enlarges the trimmed partial region 512 to a size that is set in advance on the spread page 502 and fits a layout frame in which an image is inserted. Then, the main object moving unit 70 inserts the partial area including the person who is the enlarged main object into the layout frame of the spread page 502. Then, the main object moving unit 70 creates a spread page 502 in which the image 514 is inserted.

  According to the album creating apparatus 100 according to the present embodiment, when the main object included in the captured image overlaps the fold of the album, the main object can be automatically moved with respect to the page. As a result, the main object does not become difficult to see due to the crease, so that the viewer's desire to view the main object can be fully satisfied.

  FIG. 6 shows an example of an image moving method in the main object moving unit 70 according to the present embodiment. Consider a case where the image layout unit 30 lays out an image on the back cover of an album. In such a case, the image layout unit 30 lays out the image 720 on the template 700 of the back cover of the album. That is, the image layout unit 30 lays out the image 720 in a layout frame preset in the template 700. Here, in the back cover template 700 of the album, a fold line 702 and a fold line 704 when creating the back cover of the album are set. Further, a title frame 710 that is an area to which the title of the album is attached is set in the back cover template 700. In the title frame 710, predetermined character string information is arranged according to the theme of the album. For example, a character string such as “Athletic meet” may be arranged in the title frame 710.

  Here, when the image layout unit 30 lays out the image 720 on the template 700, the boundary determination unit 60 displays the title frame position indicated by the title frame position information stored in the title frame position information storage unit 52 and the image frame 720. From the position of the main object in the image 720, it is determined that the main object 730 included in the image overlaps the title frame 710. If the album cover 750 is created in this state, an album cover 750 in which the main object in the image overlaps the title frame 710 is created, which is undesirable for the viewer. Accordingly, in such a case, the main object moving unit 70 moves the position of the main object 730 in the image 720 relative to the image 720 to generate the image 722. Then, the main object moving unit 70 moves the position of the main object 730 with respect to the image 720, so that an image 722 that does not overlap any of the fold line 702, the fold line 704, and the title frame 710 of the template 700 is arranged in the template 700. The Rukoto. Thereby, the image 722 including the main object 730 can be clearly displayed on the cover 752 of the album.

  FIG. 7 shows an example of the flow of processing in the album creating apparatus 100 according to the present embodiment. First, the album creating apparatus 100 stores a plurality of captured images received from the image capturing apparatus 150 in the image storage unit 10. Subsequently, the plurality of captured images are supplied from the image storage unit 10 to the image classification unit 20. Then, the image classification unit 20 classifies the plurality of captured images for each page of the album based on the imaging position, the imaging time, the main objects included in the captured image, and the like (S1000). Then, the image classification unit 20 supplies the plurality of classified images to the image layout unit 30. Subsequently, the image layout unit 30 selects an album page template (S1010). The page template may be a template such as an album spread page, an album cover, an album spine, and an album back cover.

  Then, the image layout unit 30 lays out a plurality of images received from the image classification unit 20 in a template layout frame (S1020). The image layout unit 30 may lay out a plurality of images in a template layout frame. Subsequently, the image layout unit 30 supplies the image laid out on the album page to the object extraction unit 40. The object extraction unit 40 extracts objects included in the images laid out on the album page (S1030). Then, the object extracted by the object extraction unit 40 is supplied to the object type identification unit 42. The object type identification unit 42 identifies the type of the object received from the object extraction unit 40 (S1040). The type of the object specified by the object type specifying unit 42 is supplied to the main object determining unit 44.

  If the object received from the object type identification unit 42 is a person, the main object determination unit 44 determines the object as a main object (S1050). Further, the main object determination unit 44 calculates position information of main objects in the image. Then, the main object determination unit 44 supplies the image laid out on the album page and the position information on the main object image to the boundary determination unit 60. The boundary determination unit 60 determines whether or not the fold of the album page overlaps the main object received from the main object determination unit 44 (S1060).

  If the main object overlaps the crease of the page (S1060: Yes), the boundary determination unit 60 supplies information indicating that and an image laid out on the album page to the main object moving unit 70. Then, the main object moving unit 70 moves the position of the main object with respect to the page to a position where the main object does not overlap the crease of the page (S1070). On the other hand, when the main object does not overlap the crease of the page (S1060: No), the boundary determination unit 60 supplies the image laid out on the album page to the printing unit 80. The boundary determination unit 60 may supply an image laid out on the album page to the display unit 84.

  The printing unit 80 then prints the images laid out on the album page received from the boundary determination unit 60 and the main object moving unit 70 to create an album (S1080). Thereby, the album creating apparatus 100 can automatically determine whether or not the main object included in the image overlaps the fold of the page, and can prevent the main object from overlapping the fold of the page.

  FIG. 8 shows an example of a functional configuration of the album creating apparatus 102 according to the second embodiment of the present invention. The album creating apparatus 102 includes an image storage unit 10, an image classification unit 20, an image layout unit 30, an object extraction unit 40, an object type identification unit 42, a main object determination unit 44, a template image position storage unit 54, an overlap determination unit 62, A main object moving unit 70, a printing unit 80, and a display unit 84 are provided. Of the members included in the album creating apparatus 102 according to the present embodiment, members denoted by the same reference numerals as those described in the above description of FIGS. 1 to 7 are members in the above description of FIGS. Since it has substantially the same function, detailed description is omitted. Further, the album creating apparatus 102 according to the present embodiment may further include some or all of the functions and configurations of the album creating apparatus 100 described in the above description of FIGS.

  First, the image layout unit 30 lays out a plurality of images received from the image storage unit 10 into a previously generated album template. Here, the album template may include a page template, which is a template for each page of the album, and an album cover template. The page template and the cover template may include a layout frame in which images are laid out and a template image that is arranged at a predetermined position with respect to the template. The template image may be a design icon arranged in the album template, a cutout object arrangement frame, a text frame in which a character string is arranged, or the like. Specifically, the template image may be a predetermined image that is arranged at a predetermined position of an album template and gives a predetermined visual effect to a user who has viewed the album. For example, the template image may be an image having ribbons, speech bubbles, stars, and other geometric shapes.

  The clipped object arrangement frame may be a frame in which an object image extracted from an image is arranged. For example, the main object determination unit 44 may generate a cut-out image by cutting out objects other than the object determined as the main object from the image stored in the image storage unit 10. Then, the clipped image generated by the main object determination unit 44 may be laid out in the cutout object placement frame of the template in the image layout unit 30. The text frame may be a frame in which character string information suitable for the theme of the album template is arranged. That is, the text frame may be an example of a title frame. The image layout unit 30 supplies the album template after the image layout to the object extraction unit 40. In addition, the image layout unit 30 may supply the overlap determination unit 62 with the template of the album after the image is laid out.

  The template image position storage unit 54 stores the position of the template image arranged in the album template in the album template. The template image position storage unit 54 may set a coordinate axis for an album template and store the position of the template image in the template as coordinate data. When a plurality of template images are arranged in the album template, the template image position storage unit 54 stores the position of each template image in the album template in association with each of the plurality of template images. The template image position storage unit 54 supplies information indicating the position of the template image in the template to the overlap determination unit 62 based on the control of the overlap determination unit 62.

  The overlap determination unit 62 determines whether or not the main object in the image laid out in the album template in the image layout unit 30 overlaps the position of the template image stored in the template image position storage unit 54. Specifically, the overlap determination unit 62 compares the position of the template image arranged in the album template with the position of the main object in the image arranged in the layout frame. Here, the position of the main object in the image may be calculated as follows. That is, first, the object extraction unit 40 calculates the position of the object to be extracted in the image when extracting the object from the image. Subsequently, the object type specifying unit 42 specifies the type of the object extracted by the object extracting unit 40.

  When the main object determination unit 44 determines a main object based on the identification result of the object type identification unit 42, the main object determination unit 44 determines the position of the object in the image calculated by the object extraction unit 40. It may be the position in the image of the main object. The main object determination unit 44 supplies the overlap determination unit 62 with the position of the main object in the image laid out in the template layout frame. The overlap determination unit 62 compares the position of the template image acquired from the template image position storage unit 54 with the position of the main object received from the main object determination unit 44. Then, the overlap determination unit 62 determines whether or not the position of the main object in the image overlaps the position of the template image. The overlap determination unit 62 supplies the determination result to the main object moving unit 70.

  When the overlap determination unit 62 determines that the main object overlaps the position of the template image, the main object moving unit 70 sets the main object for the album page so that the main object does not overlap the template image. Move position. For example, the main object moving unit 70 moves the position of the main object with respect to the template image so that the main object does not overlap the template image. That is, the main object moving unit 70 may prevent the main object from overlapping the template image by moving an image including the main object in the direction away from the template image.

  The main object moving unit 70 determines that the overlap determining unit 62 overlaps the position of the template image with respect to the image that the overlap determining unit 62 determines that the main object overlaps the position of the template image. The main object may be moved. For example, the main object moving unit 70 may move the main object with respect to the template image by trimming the main object included in the image. Accordingly, the main object moving unit 70 can prevent the template image and the main object from overlapping each other by moving the position of the main object included in the image without moving the position of the image with respect to the template.

  According to the album creating apparatus 102 according to the present embodiment, when an image is laid out in the layout frame of the album template, the template image arranged in the template and the main object included in the image overlap each other. The main object can be automatically moved to a position where the image and the main object do not overlap. Accordingly, it is possible to prevent the main object from being unable to be viewed because the main object in the image overlaps the template image.

  FIG. 9 shows an example of an image moving method in the main object moving unit 70 according to the present embodiment. Consider a case where the main object 840 included in the image 810 overlaps the template image 830 when the image layout unit 30 lays out the image 810 on the page template 800. First, the overlap determination unit 62 receives the position of the main object 840 included in the image 810 laid out on the page template 800 from the main object determination unit 44. Further, the overlap determination unit 62 acquires the position of the template image 830 arranged in the page template 800 in the page template 800 from the template image position storage unit 54. Then, the overlap determination unit 62 compares the position of the main object 840 with the position of the template image 830 and determines that the main object 840 and the template image 830 overlap.

  The main object moving unit 70 moves the position of the main object 840 included in the image 810 to a position that does not overlap the template image 830 according to the result of the overlap determination unit 62. For example, the main object moving unit 70 may prevent the main object 840 and the template image 830 from overlapping by moving the position of the image 810 in the page template 800. The main object moving unit 70 may generate an image 812 obtained by trimming the main object 840 at a position where the main object 840 and the template image 830 do not overlap with each other, and lay out the image 812 on the page template 800. The main object moving unit 70 may move the main object 840 with respect to the template image 830 in the same manner as the main object moving unit 70 described in the above description of FIGS.

  FIG. 10 shows an example of a functional configuration of the album creating apparatus 104 according to the third embodiment of the present invention. The album creating apparatus 104 includes an image storage unit 10, an image layout unit 30, an image comparison unit 64, a main object area determination unit 66, an image selection unit 75, a printing unit 80, a display unit 84, and an album template storage unit 90. The album template storage unit 90 includes a page template storage unit 900, a fold position storage unit 910, a layout frame position storage unit 920, an arrangement position storage unit 930, and a template image position storage unit 940. Of the members included in the album creating apparatus 104 according to the present embodiment, members denoted by the same reference numerals as those described in the above description of FIGS. 1 to 9 are members in the above description of FIGS. Since it has substantially the same function, detailed description is omitted. The album creating apparatus 104 according to the present embodiment may further include some or all of the functions and configurations of the album creating apparatus 100 described in the above description of FIGS. Furthermore, the album creating apparatus 104 according to the present embodiment may further include some or all of the functions and configurations of the album creating apparatus 102 described in the above description of FIGS.

  The image storage unit 10 stores a plurality of images. The image storage unit 10 supplies an image to the main object region determination unit 66 and the image selection unit 75 based on the control of the main object region determination unit 66 and the image selection unit 75. The main object area determination unit 66 determines the area of the main object of the image in the image. Specifically, first, the main object area determination unit 66 extracts objects included in the image stored in the image storage unit 10. For example, the main object region determination unit 66 extracts an object included in the image by image processing such as contour extraction processing and color distribution analysis processing. In this case, the main object area determination unit 66 calculates the position of the extracted object in the image. Then, the main object area determination unit 66 determines whether or not the extracted object is a main object. For example, the main object region determination unit 66 may determine whether or not the extracted object is a person by skin color extraction, pattern matching using an image of a human face part, or the like. Then, when the extracted object is a person, the main object area determination unit 66 may determine that the object is a main object. In addition, the main object region determination unit 66 may determine that the extracted object is a main object when the position of the extracted object in the image is within a predetermined range from the center of the image.

  Further, the main object area determination unit 66 calculates an object size that is the size of the extracted object with respect to the image. For example, the main object region determination unit 66 may calculate the largest distance among the distances from a predetermined edge of the object included in the image to the other edge of the object as the object size. When the object is a person, the main object may be the face area of the person. Then, the main object area determination unit 66 may calculate the size of the face area with respect to the image as the object size. In such a case, the object size may be a radius of a circumscribed circle of the human face area. Then, the main object area determination unit 66 may determine that the extracted object is a main object when the object size of the extracted object is equal to or larger than a predetermined value. The main object area determination unit 66 supplies information indicating the area of the main object in the image, for example, the position of the main object in the image and the information indicating the size of the main object with respect to the image to the image comparison unit 64.

  The album template storage unit 90 stores album templates. The album template stored in the album template storage unit 90 may be an album template set for each predetermined theme. The album template storage unit 90 associates with the theme of the album, a page template that is an album page, a fold position of a crease page that is a page including a crease, and a position of a layout frame arranged in advance in the page template. Information such as a position where a main object in the layout frame is to be arranged and a position of the template image arranged in advance in the page template with respect to the page template is stored. Specifically, the album template storage unit 90 may include a page template storage unit 900, a fold position storage unit 910, a layout frame position storage unit 920, an arrangement position storage unit 930, and a template image position storage unit 940. The various information may be stored in each storage unit.

  For example, the page template storage unit 900 stores a page template which is a page template included in an album template. The page template stored in the page template storage unit 900 may be an album page, a spread page, and a cover page template. The page template storage unit 900 may store a template having a shape such as a CD-ROM or a DVD. The fold position storage unit 910 stores the position of the fold included in the page template with respect to the layout frame previously arranged in the page template including the fold. When a plurality of creases exist in the page template, the crease position storage unit 910 may store a plurality of crease positions. In the case where the template has a shape such as CD-ROM or DVD, the fold position storage unit 910 cannot place an image on the CD-ROM or the like in place of the fold position included in the page template. May be stored, for example, the positions of holes such as CD-ROMs and DVDs.

  The layout frame position storage unit 920 stores the position of the layout frame included in the page template in the page template as the layout frame position. The layout frame may be a frame in which an image stored in the image storage unit 10 is laid out and a frame in which an object extracted from the image stored in the image storage unit 10 is laid out. Also, the arrangement position storage unit 930 stores the position in the layout frame where the main object should exist as the main object arrangement position. The template image position storage unit 940 stores the position of the template image included in the page template with respect to the layout frame arranged in advance in the page template of the page including the template image. The fold position storage unit 910 included in the album template storage unit 90 supplies the fold position of the page template to the image comparison unit 64 based on the control of the image comparison unit 64. Further, the template image position storage unit 940 supplies the position of the template image to the image comparison unit 64 based on the control of the image comparison unit 64. Furthermore, the album template storage unit 90 supplies the page template, the layout frame position, the arrangement position, and the template image position to the image layout unit 30 based on the control of the image layout unit 30.

  The image comparison unit 64 compares the crease position with respect to the layout frame received from the crease position storage unit 910 and the main object region in the image received from the main object region determination unit 66 for each image. Then, the image comparison unit 64 determines whether or not the crease of the page template and the main object of the image overlap when the image is arranged in the layout frame. In addition, when the shape of the template is a shape such as a CD-ROM, the image comparison unit 64 determines whether or not the hole position of the CD-ROM or the like overlaps the main object region in the image. Also good. The image comparison unit 64 may compare the position of the template image received from the template image position storage unit 940 with the main object region in the image received from the main object region determination unit 66 for each image. Then, the image comparison unit 64 may determine whether or not the template image and the main object of the image overlap when the image is arranged in the layout frame. The image comparison unit 64 supplies the determination result to the image selection unit 75.

  Based on the determination result received from the image comparison unit 64, the image selection unit 75 displays an image in which the fold of the page template and the main object of the image do not overlap when the image is arranged in the layout frame. Select from. Note that when the template shape is a shape such as a CD-ROM, the image selection unit 75 may select an image in which the position of the hole such as the CD-ROM does not overlap with the main object of the image. Further, the image selection unit 75 selects an image in which the template image of the page template and the main object of the image do not overlap when the image is arranged in the layout frame based on the determination result received from the image comparison unit 64. May be. The image layout unit 30 lays out the image received from the image selection unit 75 in the layout frame of the page template, and creates album page or album cover data. The image layout unit 30 supplies the created album page or album cover to the printing unit 80 or the display unit 84.

  The printing unit 80 creates an album by printing the album page received from the image layout unit 30 or the cover of the album on a paper medium or the like. Note that the printing unit 80 may print an image on the surface of a CD-ROM or the like. The display unit 84 displays the album page or the album cover received from the image layout unit 30 as an electronic album on a display device such as a monitor. The album creating apparatus 104 according to the present embodiment may further include an output unit that records the album data created by the image layout unit 30 on a recording medium such as a DVD.

  According to the album creating apparatus 104 according to the present embodiment, the position of the page fold with respect to the album layout frame is compared with the area of the main object included in the image, and the image in which the main object does not overlap the page fold. Can be selected automatically. As a result, when creating an album, even if the page crease overlaps the page layout frame, you can automatically select and lay out images that do not overlap the main object in the page crease. Is not divided by the crease of the page, you can create a good-looking album.

  Further, according to the album creating apparatus 104 according to the present embodiment, the position of the template image with respect to the album layout frame is compared with the area of the main object included in the image, and the image in which the main object does not overlap the template image. Can be selected automatically. As a result, when creating an album, even if the template image overlaps the layout frame of the page, it is possible to automatically select and lay out an image in which the main object does not overlap the template image. It is possible to prevent the image from being overlaid on the image.

  11 and 12 show an example of the image selection method of the image selection unit 75 according to the present embodiment. In the page template 1000 shown in FIG. 11, a layout frame 1020 in which images are arranged is arranged in advance. In the layout frame 1020, a main object arrangement position 1030 is determined in advance as a position where a main object is to be arranged in the layout frame 1020. In the page template 1000, a page fold 1010 is set. Here, a distance from the main object placement position 1030 to the crease 1010 is a crease distance 1040. The distance from the main object arrangement position 1030 to the end of the layout frame 1020 is defined as a layout distance 1050. On the other hand, a main object 1062 is included in the image 1060 shown in FIG. Here, the size of the main object 1062 with respect to the image 1060 is set as an object size 1042. The distance from the position of the main object 1062 with respect to the image 1060 to the end of the image 1060 is defined as an image distance 1052.

  The image comparison unit 64 compares the position of the fold line 1010 with the area of the main object 1062 in the image 1060 and determines whether the main object 1062 overlaps the fold line 1010 when the image 1060 is laid out in the layout frame 1020. Judging. For example, the image comparison unit 64 may calculate a value obtained by dividing the crease distance 1040 by the object size 1042 and the image distance 1052 as the composition suitability evaluation value. Note that the image comparison unit 64 may include a composition appropriate evaluation value calculation unit that calculates a composition appropriate evaluation value. Then, the image comparison unit 64 compares the calculated composition appropriateness evaluation value with the value indicated by the layout distance 1050. When the calculated composition suitability evaluation value is larger than the value indicated by the layout distance 1050, the image comparison unit 64 determines that the main object 1062 does not overlap the crease 1010 even if the image 1060 is laid out in the layout frame 1020. To do. Then, the image comparison unit 64 supplies the determination result to the image selection unit 75. The image selection unit 75 selects the image 1060 as an image to be laid out in the layout frame 1020 based on the determination result of the image comparison unit 64. Subsequently, the image layout unit 30 lays out the image 1060 selected by the image selection unit 75 in the layout frame 1020.

  The image comparison unit 64 determines whether the main object of the image overlaps the fold line 1010 for each image using the comparison method described in the above description. For example, in the image 1080 shown in FIG. 12, the image comparison unit 64 evaluates composition appropriateness from the image distance 1054 and the object size 1044 obtained from the position of the main object 1082 in the image 1080, and the crease distance 1040 and the layout distance 1050. Calculate the value. In this case, the composition suitability evaluation value calculated by the image comparison unit 64 is smaller than the value indicated by the layout distance 1050. Therefore, the image comparison unit 64 determines that the main object 1082 included in the image 1080 overlaps the fold line 1010. In the case of the image 1070 shown in FIG. 12, the image comparison unit 64 may determine as follows. For example, consider a case where the region 1074 is trimmed from the image 1070 to enlarge the size of the region 1074 to the size of the image 1070. In this case, the image comparison unit 64 calculates the composition suitability evaluation value using the enlarged image in the same manner as described above. When the calculated composition suitability evaluation value is larger than the layout distance 1050, the image comparison unit 64 determines that the area of the main object 1072 included in the trimmed image does not overlap the crease 1010. Good.

  FIG. 13 shows an example of the hardware configuration of the album creating apparatus 100, the album creating apparatus 102, and the album creating apparatus 104 according to this embodiment. The album creating apparatus 100, the album creating apparatus 102, and the album creating apparatus 104 according to the present embodiment are a CPU peripheral unit having a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582. An input / output unit having a communication interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560 connected to the host controller 1582 by the input / output controller 1584; a ROM 1510 connected to the input / output controller 1584; a flexible disk drive 1550 and a legacy input / output unit having an input / output chip 1570.

  The host controller 1582 connects the RAM 1520 to the CPU 1505 and the graphic controller 1575 that access the RAM 1520 at a high transfer rate. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 to control each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 or the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the communication interface 1530, the hard disk drive 1540, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The communication interface 1530 communicates with other devices via a network. The hard disk drive 1540 stores programs and data used by the album creating apparatus 100, the album creating apparatus 102, and the CPU 1505 in the album creating apparatus 104. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the album creating apparatus 100, the album creating apparatus 102, and the album creating apparatus 104 are started, a program depending on the hardware of the album creating apparatus 100, the album creating apparatus 102, the album creating apparatus 104, and the like. Is stored. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 such as a parallel port, a serial port, a keyboard port, and a mouse port.

  The album creation program provided to the hard disk drive 1540 via the RAM 1520 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The album creating program is read from the recording medium, installed on the album creating apparatus 100, the album creating apparatus 102, and the hard disk drive 1540 in the album creating apparatus 104 via the RAM 1520 and executed by the CPU 1505. The album creating program installed in the album creating apparatus 100, the album creating apparatus 102, and the album creating apparatus 104 is executed by the CPU 1505 and the like, and the album creating apparatus 100 and the album creating apparatus 102 described with reference to FIGS. , And album creating apparatus 104, image storage unit 10, image classification unit 20, image layout unit 30, object extraction unit 40, object type identification unit 42, main object determination unit 44, boundary position storage unit 50, title frame position information Storage unit 52, template image position storage unit 54, boundary determination unit 60, overlap determination unit 62, image comparison unit 64, main object region determination unit 66, main object moving unit 70, image selection unit 75, printing unit 80, display unit 84, album template storage unit 9 , Page template storage section 900, the fold position storage section 910, a layout frame position storage section 920, position storage section 930, and to function as a template image position storage section 940.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

1 is a conceptual diagram of an album creating apparatus 100. FIG. 3 is a block diagram showing a functional configuration of an album creating apparatus 100. FIG. FIG. 5 is a diagram illustrating an image moving method in a main object moving unit 70. FIG. 5 is a diagram illustrating an image moving method in a main object moving unit 70. FIG. 5 is a diagram illustrating an image moving method in a main object moving unit 70. FIG. 5 is a diagram illustrating an image moving method in a main object moving unit 70. 3 is a flowchart showing a processing flow of the album creating apparatus 100. 3 is a block diagram showing a functional configuration of an album creating apparatus 102. FIG. FIG. 5 is a diagram illustrating an image moving method in a main object moving unit 70. 3 is a block diagram showing a functional configuration of an album creating apparatus 104. FIG. It is a figure which shows the image selection method of the image selection part 75. FIG. It is a figure which shows the image selection method of the image selection part 75. FIG. 2 is a block diagram showing a hardware configuration of an album creating apparatus 100, an album creating apparatus 102, and an album creating apparatus 104. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Image storage part 20 Image classification part 30 Image layout part 40 Object extraction part 42 Object type specific part 44 Main object determination part 50 Boundary position storage part 52 Title frame position information storage part 54 Template image position storage part 60 Boundary judgment part 62 Overlap Determination unit 64 Image comparison unit 66 Main object region determination unit 70 Main object moving unit 75 Image selection unit 80 Printing unit 84 Display unit 90 Album template storage unit 100, 102, 104 Album creation device 150 Imaging device 200, 202 Spreading page 204, 206 Image 208, 210 Page border 220 Album 300, 302 Spread page 304, 306 Page border 310, 312 Image 400, 402 Spread page 404, 406 Page border 410, 412 Image 414, 416 Main object 500, 502 Spreading page 504, 506 Page border 510, 514 Image 512 Partial area 600 User 610 Subject 700 Template 702, 704 Crease 710 Title frame 720, 722, 810, 812 Image 730, 840 Main Objects 750, 752 Album cover 800, 1000 Page template 830 Template image 900 Page template storage unit 910 Fold position storage unit 920 Layout frame position storage unit 930 Arrangement position storage unit 940 Template image position storage unit 1010 Fold 1020 Layout frame 1030 Main Object placement position 1040 Crease distance 1042, 1044 Object size 1050 Layout distance 10 2,1054 image distance 1060,1070,1080 image 1062,1072,1082 major object 1074 area 1505 CPU
1510 ROM
1520 RAM
1530 Communication interface 1540 Hard disk drive 1550 Flexible disk drive 1560 CD-ROM drive 1570 Input / output chip 1575 Graphic controller 1580 Display device 1582 Host controller 1584 Input / output controller 1590 Flexible disk 1595 CD-ROM

Claims (14)

An image layout section that lays out multiple images on each page of the album;
A boundary position storage unit that stores a position of a crease of a page in a crease page that is a page including a crease;
An object extraction unit for extracting an object included in the image laid out by the image layout unit;
An object type specifying unit for specifying the type of object extracted by the object extracting unit;
A main object determining unit that determines an object whose type of object specified by the object type specifying unit is a person as a main object;
A boundary determination unit that determines whether or not the main object in the image laid out on the crease page by the image layout unit overlaps the position of the fold of the page stored in the boundary position storage unit;
If the boundary determination unit determines that overlap the main object the fold of the page, without moving the position of the image definitive in the page, so the main object is not overlapped to the fold of the page, An album creating apparatus comprising: a main object moving unit that moves a position of a main object with respect to a crease page.   The main object moving unit trims the main object and moves the main object to a position that does not overlap the crease of the page, and the level of the high-frequency component of the spatial frequency from among the plurality of divided regions set in the image 2. The album creating apparatus according to claim 1, wherein a partial area smaller than a predetermined level is selected, the selected partial area is stretched, and the stretched partial area is overlaid on the area where the main object before trimming was present. . The main object moving unit is configured such that when the image is enlarged to fit a predetermined layout frame of the page on which the image is laid out, the main object is positioned so as not to overlap a fold of the page. a partial area including the object, trimmed from the image, an enlarged cropped the partial regions, the album creating apparatus according to claim 1 fitted to the layout frame. An image classification unit that classifies a plurality of images for each spread page that is a crease page,
The image layout unit lays out the images classified by the image classification unit for each spread page on each spread page of the album,
The boundary position storage unit stores the position of the page boundary line between the right page and the left page in the spread page,
The boundary determination unit determines whether or not a main object in the image laid out on the spread page by the image layout unit overlaps a page boundary stored in the boundary position storage unit;
The main object moving unit determines the position of the main object with respect to the facing page so that the main object does not overlap the page boundary when the boundary determination unit determines that the main object overlaps the page boundary. The album creating apparatus according to claim 1, wherein the album creating apparatus is moved. The image layout unit lays out a plurality of images on a cover including an album cover, a back cover, and a back cover,
The boundary position storage unit stores the position of the fold of the cover of the album,
The boundary determining unit determines whether or not a main object in the image laid out on the cover by the image layout unit overlaps a position of a fold of the cover stored in the boundary position storage unit;
The main object moving unit, when the boundary determining unit determines that the main object overlaps the position of the cover fold, prevents the main object from overlapping the position of the cover fold. The album creating apparatus according to claim 1, wherein the position of the object is moved. A title frame position information storage unit for storing, as title frame position information, a position of a title frame in which character string information arranged on an album cover including at least one of a front cover, a back cover, and a back cover is laid out; ,
The image layout unit lays out a plurality of images on the cover of the album,
The boundary determination unit determines whether or not a main object in the image laid out on the cover by the image layout unit overlaps a position of the title frame stored in the title frame position information storage unit;
The main object moving unit, when the boundary determining unit determines that the main object overlaps the position of the title frame, prevents the main object from overlapping the position of the title frame. The album creating apparatus according to claim 1, wherein the position is moved. The title frame position information storage unit stores, as title frame position information, the position of the title frame where the character string information arranged on the back cover of the album is laid out
The image layout unit lays out a plurality of images on the back cover of the album,
The boundary determination unit determines whether or not a main object in the image laid out on the back cover by the image layout unit overlaps the position of the title frame stored in the title frame position information storage unit,
The main object moving unit, when the boundary determining unit determines that the main object overlaps the position of the title frame, the main object for the spine so that the main object does not overlap the position of the title frame The album creating apparatus according to claim 6, wherein the position of the album is moved. The main object moving unit is configured to select a main object determined by the boundary determination unit as overlapping a page fold with respect to an image determined by the boundary determination unit as overlapping a page fold. The album creating apparatus according to claim 1, wherein the position of the main object with respect to the crease page is moved by moving the main object so that the main object does not overlap the crease of the page. The main object moving unit is configured to prevent the person's face from overlapping the page fold when the boundary determining unit determines that the main object determined to overlap the page fold is a person. The album creating apparatus according to claim 1, wherein the position of the person with respect to the page is moved. A program for causing a computer to function as the album creating apparatus according to any one of claims 1 to 9 . A method of creating an album in which a computer having the CPU creates an album in which images are laid out by executing a program read into a RAM.
An image layout step of laying out a plurality of images on each page of the album by the CPU operating based on the program and controlling the hardware of the computer;
The CPU operates based on the program and controls the hardware of the computer, thereby referring to a boundary position storage unit that stores the position of the fold of the page in the fold page that is a page including the fold. A boundary position reference stage;
An object extraction step of extracting objects included in the image laid out in the image layout step by the CPU operating based on the program and controlling the hardware of the computer;
The CPU operates based on the program and controls the hardware of the computer, thereby identifying the type of the object extracted in the object extraction step,
Main object determination in which the CPU operates based on the program and controls the hardware of the computer to determine an object whose type of object specified in the object type specifying step is a person as a main object Stages,
The CPU operates based on the program and controls the hardware of the computer, whereby main objects in the image laid out on the crease page in the image layout stage are referred to in the boundary position reference stage. A boundary determination stage for determining whether or not the page folds overlap,
When the CPU operates based on the program and controls the hardware of the computer to determine that the main object overlaps the page crease in the boundary determination step, the CPU adds to the page . And a main object moving step of moving the position of the main object with respect to the crease page so that the main object does not overlap the crease of the page without moving the position of the image. An image layout unit that lays out a plurality of images on a pre-generated album template;
A template image position storage unit for storing a position of the template image arranged in the template of the album in the template of the album;
An object extraction unit for extracting an object included in the image laid out in the template by the image layout unit;
An object type specifying unit for specifying the type of object extracted by the object extracting unit;
A main object determining unit that determines an object whose type of object specified by the object type specifying unit is a person as a main object;
An overlap determination unit that determines whether or not the main object overlaps the position of the template image stored in the template image position storage unit;
When the overlap determination unit determines that the main object is overlapped with the position of the template image, the position of the album is set so that the main object does not overlap the template image without moving the position of the image with respect to the template. An album creating apparatus comprising: a main object moving unit that moves a position of a main object with respect to a page. A method of creating an album in which a computer having the CPU creates an album in which images are laid out by executing a program read into a RAM.
An image layout stage in which the CPU operates based on the program and controls the hardware of the computer to lay out a plurality of images on a pre-generated album template;
Template image position storage that stores the position of the template image arranged in the album template in the album template by the CPU operating based on the program and controlling the hardware of the computer A template image position reference stage for referring to a part;
An object extraction step of extracting an object included in the image laid out in the template in the image layout step by the CPU operating based on the program and controlling the hardware of the computer;
The CPU operates based on the program and controls the hardware of the computer, thereby identifying the type of the object extracted in the object extraction step,
Main object determination in which the CPU operates based on the program and controls the hardware of the computer to determine an object whose type of object specified in the object type specifying step is a person as a main object Stages,
The CPU operates based on the program and controls the hardware of the computer, so that main objects in the image laid out in the album template in the image layout stage are changed in the template image position reference stage. An overlap determination stage for determining whether or not the position of the referenced template image overlaps;
When the CPU operates based on the program and controls the hardware of the computer to determine that the main object overlaps the position of the template image in the overlap determination step, the template And a main object moving step of moving the position of the main object with respect to the album page so that the main object does not overlap the template image without moving the position of the image with respect to the image. An album creating program for an album creating device for creating an album,
An image layout unit that lays out a plurality of images in a pre-generated album template;
A template image position storage unit for storing the position of the template image arranged in the template of the album in the template of the album;
An object extraction unit for extracting an object included in the image laid out in the template by the image layout unit;
An object type specifying unit for specifying the type of object extracted by the object extracting unit;
A main object determining unit that determines an object whose type of object specified by the object type specifying unit is a person as a main object;
An overlap determination unit that determines whether or not a main object in an image laid out by the image layout unit on the template of the album overlaps a position of a template image stored in the template image position storage unit;
When the overlap determination unit determines that the main object is overlapped with the position of the template image, the position of the album is set so that the main object does not overlap the template image without moving the position of the image with respect to the template. An album creation program for causing a computer to function as a main object moving unit that moves the position of a main object with respect to a page.

Images