JP2007026387A - Album image creation device and album image creation program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an album image with no sense of incongruity, which is obtained by inserting a static image into a layout region of a template image. <P>SOLUTION: Auxiliary information indicative of direction of the static image inserted into each layout region is attached to the template image. Directions of a main photographic object of the static image and the analyzed main photographic object are analyzed. For example, when the static image P4 to which the direction of the main photographic object is not attached and the static image P5 of which main photographic object is in the C-direction in the drawing are selected, a template image TP2 comprising the layout region LA3 without information indicative of the direction of the static image to be inserted and the layout region LA4 with information indicating that direction of the static image to be inserted is in the D-direction in the figure is selected, and the static images and the selected template image are synthesized. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an album image creating apparatus that creates album image data using a plurality of still images, and an album image creating program.

  There is provided software for creating an album image by taking still image data such as a photographic image obtained by a digital camera or video camera into a personal computer (PC). Also, an album image using the image data of the still image described above on the Internet, a service for creating an album using the image, and a storage medium storing the still image data are entrusted to a service provider, and the album or There is also a service for creating album images.

For example, when using software for creating an album image, an intended template image is selected from the template images displayed on the monitor, and still images are sequentially arranged in the layout area of the selected template image. It is common to create. In this case, the layout area provided in the template image is fixed in advance or can be adjusted in position when a still image is arranged (Patent Document 1). As described above, when the software for creating the album image is used, the operation for creating the album image is easy, and the album image can be easily created. The same applies to the case of creating an album image or an album based on the album image on the Internet connected by a PC.
Japanese Patent No. 2982149

  For example, in the case of an album image created using the above-mentioned software or an album image created using the above-mentioned still image data on the Internet, it can be created at a low price and the time required for creating the album image There is an advantage of being short. However, when two still images are combined with a template image, the still image is combined with the direction of the main subject of the still image being different, and an album image with a sense of incongruity and an unpleasant album image can be formed. is there. As a method of solving such drawbacks, it is possible to let the user select a still image to be combined with the template image depending on the position of the layout area provided in the template image, but select the still image to be combined with each template image. There is a problem that it takes time to work.

  The present invention has been made to solve the above problems, and an album image obtained by fitting a still image into a layout area of a template image can be made into an album image having no sense of incongruity. A creation apparatus and an album image creation program are provided.

  The album image creating apparatus of the present invention is an album image creating apparatus that creates an album image by combining a still image including a main subject having a line of sight with a template image, wherein the template image includes at least one layout area; Direction information for comparison with the direction of the main subject's line of sight in the still image, which is predetermined for each layout area, and whether or not the direction of the main object's line of sight matches the incidental information. A direction determination unit for determining and an image synthesis unit for synthesizing, in the layout area, a still image in which the direction of the line of sight of the main subject and the directionality information match by the direction determination unit. .

  The template image includes a plurality of layout areas, and the directionality information is direction information defined by a relative positional relationship between the layout areas.

  Further, the still image is fitted in each of the plurality of layout areas, so that the line of sight of the main subject in one still image coincides with the line of sight of the main subject in the other still image.

  The template image has a pattern as a background of the layout area, and the directionality information is direction information defined by a relative positional relationship between the layout area and the pattern.

  In addition, when a still image is combined with the layout area, the picture is positioned in the direction of the line of sight of the main subject.

  In the template image, a pattern is arranged in addition to the layout area, and the directionality information is a direction of the pattern.

  Further, it is characterized by comprising direction analysis means for analyzing the direction of the line of sight of the main subject.

  In addition, an operation input unit for inputting a direction of the line of sight of the main subject is provided.

  In addition, the image processing apparatus includes a display device that displays the still image, and the display device simultaneously displays an index indicating a direction of a main subject's line of sight in the still image and the still image.

  In addition, when a template image to be used for the album image is selected, an image selection unit is provided that selects, from the plurality of still images, a still image including a main subject having a line of sight that matches the directionality information. It is characterized by being.

  In addition, when a still image used for the album image is selected, template image selection means is provided for selecting a template image having directionality information that matches the direction of the main subject's eye line in the still image. Features.

  Further, the image processing device may further include an image editing unit that edits either the still image or the template image when the direction of the line of sight of the main subject does not match the directionality information.

  Further, the album image creation program of the present invention is an album image creation program for creating an album image by combining a still image including a main subject having a line of sight with a template image, and the direction of the line of sight of the main subject, Direction determining means for determining whether or not direction information for comparison with the direction of the line of sight of the main subject in the still image, which is determined in advance in a layout area provided in the template image, and the direction determining means; Thus, the computer is caused to function as an image synthesizing unit that synthesizes a still image in which the direction of the line of sight of the main subject matches the directionality information with the layout region.

  According to the album image creating apparatus of the present invention, in the album image creating apparatus for creating an album image by combining a still image including a main subject having a line of sight and a template image, the template image has at least one layout area. And directionality information for comparison with the direction of the main subject's line of sight in the still image, which is predetermined for each layout area, and whether the direction of the main subject's line of sight matches the incidental information. Since there is a direction determination unit that determines whether or not the direction determination unit includes a still image in which the direction of the line of sight of the main subject and the directionality information match, the image synthesis unit includes It is easy to create attractive album images that do not feel strange due to the orientation of the still images in the album images. Kill.

  Further, since the template image includes a plurality of the layout areas, and the directionality information is direction information defined by the relative positional relationship between the layout areas, the template image is generated depending on the orientation of the still image in one album image. An attractive album image can be easily created without any sense of incongruity.

  In addition, since still images are respectively fitted in the plurality of layout areas, the line of sight of the main subject in one still image and the line of sight of the main subject in the other still image match. An album image with a story can be created by the still image.

  Further, the template image has a pattern as a background of the layout area, and the directionality information is direction information defined by a relative positional relationship between the layout area and the pattern. It is possible to easily create an attractive album image that does not have a sense of incongruity caused by the orientation of the still image.

  Further, when a still image is synthesized in the layout area, the picture is positioned in the direction of the eye line of the main subject, so that an album image having a story property is created by, for example, a still image fitted in the layout area. be able to.

  In addition, since the template image has a pattern arranged in addition to the layout area, and the directionality information is the direction of the pattern, there is no sense of incongruity caused by the orientation of the still image in one album image. Images can be created easily.

  Further, it is possible to easily and surely analyze the direction of the main subject's line of sight in the still image provided with the direction analysis means for analyzing the direction of the main subject's line of sight.

  Further, since the operation input unit for inputting the direction of the line of sight of the main subject is provided, for example, the direction of a still image can be input by the user himself, and the sense of the user can be reflected.

  In addition, the image processing apparatus includes a display device that displays the still image, and the display device displays an index indicating the direction of the main subject's eye line in the still image and the still image at the same time. For example, a process of creating an album image Thus, when a still image designated by the user or the like is inserted into the template image or when editing an album image, it is possible to easily select a still image to be inserted into the template image.

  In addition, when a template image to be used for the album image is selected, an image selection unit is provided that selects, from the plurality of still images, a still image including a main subject having a line of sight that matches the directionality information. Therefore, it is possible to omit a user's operation of selecting a still image and to easily create an attractive album image.

  In addition, when a still image used for the album image is selected, template image selection means is provided for selecting a template image having directionality information that matches the direction of the main subject's eye line in the still image. For example, an attractive album image can be easily created simply by selecting a still image without selecting a template image.

  Also, since the image editing means for editing either the still image or the template image is provided when the direction of the line of sight of the main subject does not match the directionality information, for example, the layout of the template image is liked. However, you can edit the still image if you do not like the placement of the inserted still image, or you can edit the template image if the layout of the template image is not good, but still image is good, An attractive album image can be easily created.

  In FIG. 1, an album image creating apparatus 10 to which the present invention is applied includes a CPU 13 that executes an album creating program PG 1 stored in a ROM 11. An image data reading unit 14, an image display unit 15, and an operation panel 16 are connected to the CPU 13. The image data reading unit 14 includes a connector for reading still image data from a memory card, and a disk drive for reading still image data from an optical disk such as a CD. The image display unit 15 includes a liquid crystal display 15a (see FIG. 5), and displays a still image read as still image data, an album image created using the still image, and the like. The operation panel 16 detects a user input operation required when creating an album image, and sends a detection signal to the CPU 13. Examples of the still image include a design image, an illustration image, and a CG (Computer Graphics) image in addition to a photographic image.

  The ROM 11 stores an album creation program PG1. A template image folder TF is created in the ROM 11, and a plurality of template image data used for album creation are stored in the template image folder TF. In the RAM 17, a still image folder PF in which still image data read from the image data reading unit 14 is stored and an album image folder AF in which album image data created by the CPU 13 is stored are created. The CPU 13 executes the album creation program PG1 to thereby execute a control unit 19, an image content analysis unit 20, a direction analysis unit 21, an image selection unit 22, a template selection unit 23, a comparison determination unit 24, an image editing unit 25, an album image. It functions as the synthesis unit 26.

  The image content analysis unit 20 analyzes the image content of the still image to detect what the main subject is, that is, whether it is a person, an animal such as a cat or a dog, or a landscape. The ROM 11 stores an analysis database (DB) 27 used when detecting a main subject. The analysis DB 27 is a database of features of still image data corresponding to the contents of the main subject. Thereby, for example, it is analyzed whether the main subject of the still image is a person, an animal, or a landscape. Data obtained by this analysis is stored in the RAM 17.

  The direction analysis unit 21 analyzes the direction in the still image. For example, when the main subject of the still image is a person or an animal in the image content analysis unit 20 described above, the direction of the main subject's line of sight is analyzed from the orientation of the face. The ROM 11 stores a large number of mask image data obtained by changing the angle of the face of a person or animal in the mask image folder MF, and by collating the mask image data with the still image data, the main object of the still image is identified. Analyze the direction of the line of sight. When the direction of the line of sight of the main subject is analyzed, information indicating the direction of the line of sight is added to the still image data. Note that the analysis direction of the eye direction of the main subject described above is only an example, and other analysis methods such as analyzing the eye direction by analyzing the eye position can be used.

  On the other hand, when the main subject of the still image is a landscape, the direction analysis program PG2 stored in the ROM 11 is read to analyze the direction of the still image. The direction analysis program PG2 is a program that calculates the intensity of the spatial frequency by, for example, Fourier transforming still image data, and obtains polar coordinates from the calculated spatial frequency. By using this program PG2, it is possible to obtain a graph with the angle on the horizontal axis and the strength on the vertical axis from still image data. As illustrated in FIG. 2, for example, in the case of the still image P <b> 1, when the direction analysis program PG <b> 2 is executed, a graph in which the angle is 72 degrees and the maximum intensity is obtained. As a result, the angle of the still image P1 is 72 degrees. On the other hand, as shown in FIG. 3, in the case of the still image P2, a graph having the maximum strength when the angle is 0 is obtained. In this case, the angle of the still image P2 is zero. Information obtained by using the direction analysis program PG2 is added to still image data.

  For example, when template image data is selected, the image selection unit 22 selects still image data to be combined with the template image data. As shown in FIG. 4, when template image data is displayed on the image display unit 15, a template image TP1 composed of layout areas LA1 and LA2 and a non-layout area BA1 provided on the outer periphery of these layout areas is displayed. Is displayed. The layout areas LA1 and LA2 are areas into which still images are inserted. On the other hand, the non-layout area BA1 is an area in which a still image is not inserted, and is provided with a pattern, coloring, or the like, for example. Information indicating the relative direction between the layout area LA1 and the layout area LA2 is attached to the template image data that is the basis of such a template image as additional information. That is, when the layout area LA2 is arranged in the A direction in FIG. 4 with respect to the layout area LA1, the direction indicated by the supplementary information in the layout area LA1 is the A direction in FIG. 4, and the direction indicated by the supplementary information in the layout area LA2 Is the B direction in FIG. Note that the auxiliary information is provided with an allowable range. For example, when the A direction (an angle of 37 ° with respect to the horizontal direction) in FIG. 4 is the direction indicated by the auxiliary information of the layout area LA1, the allowable range is 17 It will be from -57 degrees.

  The template image selection unit 23 selects the corresponding template image data from the template image folder TF stored in the ROM 11 when still image data is selected. As described above, the incidental information attached to the template image data is composed of the angle of the still image fitted in each layout area and the allowable range of the angle. Therefore, the template image selection unit 23 determines the direction of the still image. Is selected from the template image folder TF within the allowable range set in the layout area.

  The comparison determination unit 24 refers to the selected still image data and the template image data, and the direction of the line of sight of the main subject added to the still image data is within the allowable range of the angle indicated by the accompanying information of the template image data. It is determined whether or not. For example, when the direction of the line of sight of the main subject added to the still image data is within the allowable range of the angle indicated by the auxiliary information of the template image data, the direction of the still image and the still image to be fitted in the layout area It is determined that the direction matches. In this case, the album image composition unit 26 performs composition processing of still image data and template image data. On the other hand, when the direction of the eye of the main subject added to the still image data is outside the allowable range of the angle indicated by the auxiliary information of the template image data, the direction of the still image and the direction of the still image that is inserted into the layout area Are inconsistent. In this case, the image editing unit 25 performs an editing process on either the still image data or the template image data.

  When the comparison determination unit 24 determines that the direction in the still image and the direction of the still image fitted in the layout area do not match, the image editing unit 25 determines the direction of the still image and the still image inserted in the layout area. Edit processing is performed on either still image data or template image data so that the directions match. For example, when editing processing is performed on still image data, the angle data added to the still image data is newly rewritten. Similarly, when the editing process is performed on the template image data, the angle indicated by the supplementary information of the template image data and the allowable range set for the angle are newly rewritten.

  The album image synthesis unit 25 synthesizes the selected still image and template image. At this time, the still image that is fitted in each layout area of the template image is fitted according to the accompanying information. The still image is combined with the template image after being subjected to trimming processing in accordance with the layout area. The synthesized album image is stored in the album image folder AF created in the RAM 17.

  In such an album creating apparatus 10, when the album creating program PG1 is executed, as shown in FIG. 5, the liquid crystal display 15a of the image display unit 15 automatically detects the direction of the still image or is manually input. A selection screen appears. The user selects “determination by automatic detection” when the direction of the still image is determined by automatic detection, and selects “determined manually” when the direction is determined manually. For example, when the execution button 30 is selected after selecting “determination by automatic detection”, the direction of the still image is determined by automatic detection. Reference numeral 31 denotes a “cancel” button selected when canceling album creation, and reference numeral 32 denotes a pointer.

  As shown in FIG. 6, when the directions of all still images are automatically detected, thumbnail images using still images are displayed on the liquid crystal display 15a. At this time, an index indicating the direction of the automatically detected still image is displayed on each thumbnail image. For example, when still images P4 to P9 are displayed on the liquid crystal display 15a, indicators 35 to 38 are simultaneously displayed for the still images P5 to P8, respectively. The user looks at the thumbnail images and determines whether the direction in all the still images is the direction indicated by the index. If the direction indicated by the index is acceptable, the user clicks the “Yes” button 40. select. If it is desired to correct the result of automatic detection, the direction of the still image can be corrected by selecting the corresponding still image.

  On the other hand, as shown in FIGS. 7 and 8, when the direction of the still image is determined, when “manually determined” is selected and the execution button 30 is selected, the liquid crystal display 15 a has a direction relative to the still image. A display screen for manually entering is displayed. On this display screen, one still image is displayed, and a direction is selected on a direction selection tab 41 provided on the side of the still image. When the direction of the still image is selected on the selection tab and the “Next” button 42 is selected, an index 43 indicating the determined direction with respect to the still image is displayed on the still image. For example, when the still image P5 is manually input, the index 43 is displayed when the direction is selected. If the index 43 is displayed and the direction of the index is good, when the “Yes” button 44 is operated, the next still image is displayed. On the other hand, in order to correct the direction of the index, if the “No” button 45 is operated, the selection screen shown in FIG. 7 is displayed again, and the direction is selected on the selection tab 41. If this still image is manually input for all still images, a thumbnail image using all still images is displayed as shown in FIG.

  As shown in FIG. 9, when the determined direction of the still image is confirmed, a template image selection screen is displayed on the liquid crystal display 15a. When “Manual selection” is selected on the template image selection screen and the execution button 46 is selected, a thumbnail image using the template image is displayed. As shown in FIG. 10, the user selects one or a plurality of template images to be used for the album image from the thumbnail images. Then, when the execution button 47 is selected, album creation processing is executed.

  On the other hand, when “automatic selection” is selected on the template image selection screen, a still image selection screen used for the album image is displayed on the liquid crystal display. As shown in FIG. 11, when “automatic selection” is selected, a thumbnail image using a still image is displayed on the liquid crystal display, and a still image used for album creation is selected from the thumbnail images. When a still image to be used for an album image is selected and the execution button 48 is operated, an album creation process is executed.

  Next, the operation of the album image creating apparatus 10 of the present invention will be described based on the flowcharts shown in FIGS. The still image data stored in the storage medium is read by the data reading unit 14, and the read still image data is copied to the still image folder PF in the RAM 17. After all the still image data has been copied, the direction of the still image is determined by automatic detection or manually, and the template image or still image to be used is selected. Is created.

  For example, when the direction of a still image is determined by automatic detection, the image content analysis unit 20 reads out still image data stored in the still image folder PF of the RAM 17 and refers to the analysis database 26 stored in the ROM 11. Analysis of the still image based on the read still image data, that is, whether the main subject of the still image is a person, an animal, or a landscape is analyzed. When the image content is analyzed from the still image data, the analysis result is stored in the RAM 17. The above-described analysis is performed on all still image data.

  Next, the direction analysis unit 21 analyzes the direction of the main subject in the still image. For example, when the main subject is a human being or an animal, the direction analysis unit 21 sequentially reads out the mask image data from the mask image folder MF in the ROM 11 and compares the mask image data with the still image data. By this comparison, the direction of the face of the main subject in the still image is analyzed, and the direction of the line of sight of the main subject is analyzed. On the other hand, when the main subject is a landscape, the direction analysis unit 21 executes the direction analysis program PG2 stored in the ROM 11. When the direction in the still image is analyzed by executing the direction analysis program PG2, data indicating the direction is added to the still image data on which the still image is based. When the direction analysis is completed for all still image data, a thumbnail image using the still image data is displayed on the liquid crystal display 15a, and an index using the analyzed angle is simultaneously displayed for each image. Is displayed.

  On the other hand, when manually determining the direction of a still image, information indicating an angle is added to each still image data based on an input signal from an operation panel or the like. When the direction analysis is completed for all still image data, a thumbnail image using the still image data is displayed on the liquid crystal display 15a, and an index using the analyzed angle is simultaneously displayed for each image. Is displayed.

  When a template image is automatically selected when creating an album image, it is necessary to select a still image to be used when creating an album image. Therefore, if a user selects a still image to be used when creating an album image, the template image The selection unit 23 selects template image data based on the selected still image data from the template image folder TF. When the template image data is selected, the comparison / determination unit 24 determines whether or not the direction of the still image matches the direction of the still image fitted in the layout area. Then, when the direction of the still image matches the direction of the still image fitted in the layout area, the template image data and the still image data are combined in the album image combining unit 26.

  For example, as shown in FIG. 14, a case where still images P4 and P5 are selected will be described. In this case, information indicating the direction is not added to the still image P4, and the still image P5 has, for example, the layout region LA3 and the layout when the direction of the line of sight of the main subject is the C direction in FIG. A template image TP2 having a layout area LA4 in which the position of the area LA3 is in the D direction in FIG. 14 is selected. The album image synthesis unit 26 creates an album image AP1 by synthesizing the selected template image TP2 and the still images P4 and P5. For example, when the still image P4 is an image of a coastal landscape and the still image P5 is an image of a person looking obliquely upward, the created album image AP1 is an album image that images a person looking at the coastal landscape. Become. Note that the album image data on which the album image AP1 is based is stored in an album image folder AF created in the RAM 17. In FIG. 14, for the sake of explanation, the still images P4 and P5 and the directions in the respective still images are shown separately, but actually data indicating the direction is added to the still image data. It is a thing, not a display.

  When manual selection of a template image is selected when creating an album image, the image selection unit 22 refers to the additional information attached to the template image data, and still image data that matches the additional information Select. Since the incidental information includes information indicating the direction of the still image fitted in the layout area, the image selection unit 22 refers to the incidental information, and determines the still image data in which the direction of the main subject is an angle within an allowable range, It is selected as still image data to be inserted into the layout area. This still image data is selected for each layout area of the template image data.

  For example, as shown in FIG. 15, when the template image TP3 including the layout areas LA5 and LA6 of the template image TP3 is selected, the layout area LA6 has the direction E in FIG. With reference to the area LA6, the direction of the layout area LA5 is the F direction in FIG. In this case, for example, in the layout area LA5, a still image P7 in which the direction of the line of sight of the main subject is the G direction in FIG. 15, and in the layout area LA6, a still image P5 in which the direction of the main subject is the C direction in FIG. Selected. The album image synthesizing unit 25 synthesizes the template image TP3 and the still images P5 and P7 so that the selected still image P7 is fitted in the layout area LA5 and the still image P5 is fitted in LA6. Thereby, an album image AP3 is created, and album image data based on the album image AP3 is stored in the album image folder AF of the RAM 17. When this album image data is displayed, for example, an album image AP3 that is an image of a person watching a cat playing with a sphere is displayed on the liquid crystal display 15a as a preview image.

  For example, when still image data and template image data are selected, and the angle of the main subject in the still image data is outside the allowable range of the angle attached to the template image data, the image editing unit In 25, an editing process is performed on one of the template image data and the still image data. After the editing process is performed, the album image composition unit 26 synthesizes the still image data and the template image data.

  For example, as shown in FIG. 16, a case where still images P4 and P5 are selected for the template image TP4 will be described. In this case, with reference to the layout area LA8, the direction of the layout area LA7 is the H direction in FIG. On the other hand, information indicating the direction of the main subject is not added to the selected still image P4, and information indicating that the direction of the line of sight of the main subject is the C direction in FIG. 16 is added to the still image P5. . For example, the still image P4 is fitted in the layout area LA7, and the still image P5 is fitted in the layout area LA8. However, since the direction of the main subject of the still image P5 does not match the direction indicated by the layout area LA8, the image editing unit 25 performs, for example, mirror image processing on the template image data, and performs the layout area LA8 of the template image TP4. The direction of the still image that is fitted into the I is converted to the I direction in FIG. As a result, the direction of the still image fitted in the layout area LA8 ′ matches the direction of the main subject of the still image P5, and the album image composition unit 26 adds the layout image LA7 ′ of the mirror image-processed template image TP4 ′. These image data are synthesized so that the still image P4 and the still image P5 are fitted in the layout area LA8 ′. As a result, the layout of the layout area of the obtained album image P4 is changed. For example, when the still image P4 is an image of a coastal landscape and the still image P5 is an image of a person looking diagonally upward, the created album image AP4 is an album image that images a person looking at the coastal landscape. It becomes.

  In addition to the mirror image processing of the template image, the image editing processing in the image editing unit 25 may be the following editing processing. For example, as shown in FIG. 17, the template image TP5 includes the layout areas LA9 and LA10, and a decoration is applied to the area 60 indicated by the two-dot chain line in FIG. 17 of the non-layout area BA5. The direction of the layout area LA9 is based on the J direction in FIG. On the other hand, in the selected still images P4 and P6, there is no direction of the main subject for the still image P4, and the direction of the main subject in the still image P6 is the K direction in FIG. In this case, the still image P4 is fitted in the layout area LA9 and the still image P6 is fitted in the layout area LA10. However, the direction of the layout area LA9 with respect to the layout area LA10 and the direction of the main subject's line of sight of the still image P6 are It does not match. In this case, the image editing unit 25 changes the direction of the still image inserted into the layout area LA10 of the template image TP5 to the decoration direction (L direction in FIG. 17). After this change, the template image TP5 and the still images P4 and P6 are synthesized. For example, when the still image P4 is an image showing a seaside landscape and the still image P6 is a dog image, the album image AP5 obtained is a decoration 60 applied to the seaside landscape and the non-layout area BA5 of the template image. The album image consists of two images with the dog watching.

  In the present embodiment, in the case of a template image having a plurality of layout areas, the relative direction of the layout area is attached to the template image data as auxiliary information. However, the present invention is not limited to this. In the case of a template image in which a region is decorated, the direction of the decoration with respect to the layout region may be added to the template image data as additional information, or the direction of decoration in the template image may be used as additional information.

  When the decoration direction in the template image is supplementary information, the direction of the line of sight of the main subject in the selected still image may be different. For example, as shown in FIG. 18, when the strip-shaped patterns 61 and 62 that are inclined in the M direction in FIG. 18 are provided at a predetermined interval in the non-layout area BA6 of the template image TP6, the accompanying information indicates. The direction is the M direction in FIG. On the other hand, the direction of the line of sight of the main subject in the selected still image P7 is the G direction in FIG. 18, so the direction of the main subject and the directions of the patterns 61 and 62 of the template image TP do not match.

  In this case, the image editing unit 26 performs a mirror image process on the template image TP6. As a result, the direction of the patterns 61 ′ and 62 ′ applied to the non-layout area BA6 of the template image TP6 is converted from the M direction in FIG. 18 to the O direction in FIG. 18, and thus the direction of the main subject of the still image P7 The direction indicated by the decoration is the same direction. The album image composition unit 25 composes the still image P7 and the edited template image TP6 'so that the still image P7 fits in the layout area LA11', and creates an album image. In this case, only the decoration may be subjected to mirror image processing without performing mirror image processing on all template images.

  In the present embodiment, the template image is edited by the image editing unit 25. However, the present invention is not limited to this, and a still image can be edited. For example, as shown in FIG. 19, the template image is provided with layout areas LA12 and LA13, and the direction of the layout area LA12 with respect to the layout area LA13 is the P direction in FIG. On the other hand, when the selected still images P6 and P7 are combined with the template image TP7, the still image P7 is combined with the layout region LA12 of the template image TP7 and the still image P6 is combined with the layout region LA13 of the template image TP7. However, since the direction of the still image P6 is the K direction in FIG. 19, it does not coincide with the direction of the layout area LA13.

  In this case, the image editing unit 25 performs a mirror image process on the still image P6 to match the direction of the layout area LA13. That is, the direction of the line of sight of the main subject in the still image P6 'after the mirror image processing is the Q direction in FIG. 19, and the direction of the layout area LA12 with respect to the layout area LA13 is the same. Thereby, the album image composition unit 26 synthesizes the still image P6 'and the template image TP7 to create an album image AP7. In this case, for example, when the still image P6 is an image of a dog and the still image P7 is an image of a cat playing with a sphere, the obtained album image AP7 is a dog watching a cat playing with the sphere. It becomes an album image of the image.

  If the direction of the layout area does not match the direction of the still image, the image editing unit 25 changes the position of the layout area provided in the template image, or changes the direction of the still image to the layout area. It is also possible to synthesize so as to match the direction. As shown in FIG. 20, for example, the template image TP8 includes layout areas LA14 and LA15, and the direction of the layout area LA15 relative to the layout area LA14 is the R direction in FIG. 20, and among the selected still images P4 and P6, the still image When the direction of the line of sight of the main subject of P6 is the K direction in FIG. 20, for example, the image editing unit 25 combines the template image with the still image data that is the basis of the still image P6 when it is fitted into the layout area LA14. The rotation amount at the time of calculation is calculated, and the calculated value is added to the still image data that is the basis of the still image P6. The album image combining unit 26 rotates the still image P6 based on the calculated rotation amount and then combines it with the template image TP7.

  As mentioned above, although embodiment of this invention was described, this invention is not restricted to the said embodiment, A suitable change is possible. For example, the album image creation device 10 of the above embodiment is configured as a dedicated device for creating an album image, but creates an album image by a digital still camera in which the album creation program PG1 is incorporated or a personal computer. It may be.

In the present embodiment, either the template image or the still image is edited. However, the present invention is not limited to this, and each of the template image and the still image may be edited.
In this embodiment, only the direction of the main subject in the still image is analyzed, but in addition to this, for example, how much the still image can be rotated when the still image is combined with the template image, or mirror image processing is performed. It is also possible to analyze whether or not inconvenience will occur. For example, when the still image is composed of an image of a person or animal face, there is no inconvenience even if the image is rotated by a predetermined amount and combined with the template image. On the other hand, when the still image is an image of the whole body of a person or an image of the whole body of an animal, it may become unnatural if the still image is rotated and combined with the template image. Therefore, if an allowable rotation angle is obtained for each still image in advance, fine adjustment can be automatically performed when the template image and the still image are combined, and the layout area of the template image can be adjusted. A width can be given to the configuration.

It is a functional block diagram which shows the structure of the album image creation apparatus of this invention. It is explanatory drawing which shows an example of the graph obtained by Fourier-transforming a still image and this still image. It is explanatory drawing which shows an example of the graph obtained by Fourier-transforming a still image and this still image. It is explanatory drawing which shows the structure of a template image. It is an explanatory view showing an example of a display screen when determining the direction of a still image, which is a display screen of a liquid crystal display when creating an album image. An example of a display screen of a liquid crystal display at the time of creating an album image, in which when a still image direction is analyzed, a thumbnail image using the still image and an index indicating the direction in the image are displayed simultaneously. It is explanatory drawing. It is explanatory drawing which shows an example of the display screen of a liquid crystal display in the case of determining a direction manually with respect to a still image. It is explanatory drawing which shows an example of the display screen of a liquid crystal display at the time of displaying a still image and the parameter | index which shows the direction input manually. It is explanatory drawing which shows an example of the display screen of a liquid crystal display at the time of determining whether selection of a template image is performed by automatic selection or manual selection. It is explanatory drawing which shows an example of the display screen of a liquid crystal display when selecting a template image by manual selection. It is explanatory drawing which shows an example of the display screen of a liquid crystal display at the time of selecting the still image used at the time of preparation of an album image. It is a flowchart which shows the flow of album image creation. It is a follow chart which shows the flow at the time of analyzing the direction of a still image. It is explanatory drawing which shows the flow of album image creation when a still image is selected. It is explanatory drawing which shows the flow of album image creation when a template image is selected. It is explanatory drawing which shows the flow of album image creation in the case of combining a still image after editing the selected template image. It is explanatory drawing which shows the flow of album image creation in the case of combining a still image after editing the selected template image. It is explanatory drawing which shows the flow of album image creation in the case of creating an album image using the decoration of the non-layout area | region of a template image. It is explanatory drawing which shows the flow of album image creation in the case of combining with a template image after performing an edit process with respect to the selected still image. It is explanatory drawing which shows the flow of album image creation in the case of inserting a still image according to the direction attached to the layout area | region provided in the template image.

Explanation of symbols

10 Album image creation device 13 CPU
DESCRIPTION OF SYMBOLS 14 Data reading part 15 Image display part 16 Operation panel 19 Control part 20 Image content analysis part 21 Direction analysis part 22 Image selection part 23 Template selection part 24 Comparison determination part 25 Image editing part 26 Album image composition part 27 Analysis database PG1 Album Creation program PG2 Direction analysis program TF Template image folder MF Mask image folder PF Still image folder AF Album image folder

Claims (13)

In an album image creation device that creates an album image by combining a still image including a main subject with a line of sight and a template image,
The template image includes at least one layout area, and directionality information for comparing with the direction of the main subject's eye line in the still image, which is predetermined for each layout area,
Direction determining means for determining whether or not the direction of the eye of the main subject and the auxiliary information match;
An album image creating apparatus comprising: an image composition unit for composing a still image in which the direction of the line of sight of the main subject and the directionality information match with the layout region by the direction determination unit.   The album image creating apparatus according to claim 1, wherein the template image includes a plurality of the layout areas, and the directionality information is direction information defined by a relative positional relationship between the layout areas.   3. The album according to claim 2, wherein the still image is fitted in each of the plurality of layout areas so that the line of sight of the main subject in one still image coincides with the line of sight of the main subject in the other still image. Image creation device.   2. The template image according to claim 1, wherein the template image has a pattern as a background of the layout area, and the directionality information is direction information defined by a relative positional relationship between the layout area and the pattern. Album image creation device.   5. The album image creating apparatus according to claim 4, wherein, when a still image is combined with the layout area, the picture is positioned in a direction of a line of sight of the main subject.   The album image creating apparatus according to claim 1, wherein a pattern is arranged in the template image in addition to the layout area, and the directionality information is a direction of the pattern.   The album image creating apparatus according to claim 1, further comprising a direction analyzing unit that analyzes a direction of a line of sight of the main subject.   The album image creating apparatus according to claim 1, further comprising an operation input unit configured to input a direction of a line of sight of the main subject. A display device for displaying the still image;
The album image creating apparatus according to claim 1, wherein the display device simultaneously displays an index indicating a direction of a main subject's eye line in the still image and the still image.   When a template image used for the album image is selected, an image selection unit is provided that selects a still image including a main subject having a line-of-sight direction that matches the directionality information from the plurality of still images. The album image creating apparatus according to claim 1.   When a still image used for the album image is selected, a template image selection unit is provided that selects a template image having directionality information that matches the direction of the main subject's line of sight in the still image. The album image creating apparatus according to claim 1.   The image editing means for editing either the still image or the template image when the direction of the line of sight of the main subject does not match the directionality information. Or an album image creating device. In an album image creation program that creates an album image by combining a still image including a main subject with a line of sight and a template image,
It is determined whether or not the direction of the line of sight of the main subject matches the directionality information for comparison with the direction of the line of sight of the main subject in the still image, which is determined in advance in a layout area provided in the template image. And a direction determination unit that causes the computer to function as an image synthesis unit that synthesizes a still image in which the direction of the line of sight of the main subject matches the directionality information with the layout region. Album image creation program.

Images