JP7292895B2 - Information processing device, information processing method, and program - Google Patents

Description

The present invention relates to a technology for arranging information in slots.

Conventional methods for creating a photo album include a method in which the user selects images to be laid out and arranges them in the photo album, and a method in which images in a folder specified by the user are automatically analyzed and selected and automatically laid out in the photo album. There was. In the latter automatic layout method, the user simply selects images and image storage folders, so that a photo album can be created without user effort. Furthermore, a method of automatically selecting a background image and a template based on the shooting location and shooting date associated with the image, in addition to laying out the image, has been proposed (Patent Document 1). A method has also been proposed for automatically arranging the date and the number of days in the time divisions of the laid-out photos (Patent Document 2). With these suggestions, it is possible to automatically create a more attractive photo album.

JP 2018-124737 A Japanese Patent No. 4987538

When a user selects images to be used for a layout and arranges them in an album, there is a method of using a template in which the layout positions of background images and images are designed in advance, and arranging the images in slots within the template. For example, the user arranges images in templates designed for each season or event. Conventionally, it is necessary for the user to properly arrange images suitable for the template. Therefore, if the template contains the text "January" or an illustration reminiscent of January, the user can select the photo of January or use the photo of another month by selecting the text "January" or an illustration associated with January. I had to rewrite the illustration manually.

The present invention provides techniques for, based on an image placed in an image slot within a template, arranging related content appropriate for that image.

One aspect of the present invention includes identifying means for identifying a content slot associated with an image slot in which an image is placed in a template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means ;
The identifying means determines whether the content slot is associated with an image slot other than the image slot,
When the content slot is not associated with an image slot other than the image slot, the placement means places content related to the image according to the additional information acquired by the acquisition means in the content slot. It is characterized by

According to the configuration of the present invention, based on an image placed in an image slot within a template, related content suitable for the image can be placed.

FIG. 2 is a block diagram showing a system configuration example; The figure which shows an example of a template. FIG. 3 is a view showing slot arrangement information (data table) indicating arrangement positions of respective slots in the template of FIG. 2; The figure which shows an example of the data table of a text. FIG. 4 is a diagram showing an example of a data table of stamp images; FIG. 4 is a diagram showing an example of a stamp image; 4 is a flowchart showing the operation of the information processing apparatus 1004; The figure which shows the structural example of template selection UI. FIG. 4 is a diagram showing a configuration example of an editing UI; The figure which shows an example of a data table. The figure which shows an example of the data table of a text. 4 is a flowchart showing the operation of the information processing apparatus 1004; The figure which shows an example of a data table. FIG. 4 is a diagram showing an example of a data table of stamp images; 4 is a flowchart showing the operation of the information processing apparatus 1004; The figure which shows an example of a data table. A diagram for explaining image analysis and tagging for images. 4 is a flowchart showing the operation of the information processing apparatus 1004; The figure which shows an example of a data table. The figure which shows an example of a data table.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. It should be noted that the following embodiments do not limit the invention according to the scope of claims. Although multiple features are described in the embodiments, not all of these multiple features are essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant description is omitted.

[First embodiment]
First, a configuration example of a system according to this embodiment will be described using the block diagram of FIG. As shown in FIG. 1, the system according to this embodiment has an information processing device 1004 and an external server 1002, and the information processing device 1004 and the external server 1002 exchange data with each other via a wireless and/or wired network 1003. configured for communication.

First, the information processing device 1004 will be described. The information processing device 1004 is a computer device such as a PC (personal computer), a smart phone, or a tablet terminal device. The information processing apparatus 1004 can create album (photo album, photo book) data from the input image, generate print data from the album data, and output the print data. The information processing device 1004 can also upload the album data to the external server 1002 via the network 1003 . An album application for generating album data is pre-installed in the information processing apparatus 1004, and the user uses this album application to instruct generation and output of album data. However, the album application of this embodiment is not limited to being pre-installed like a native application, and may be a web application executed on a web browser. In the case of a web application, a program is read by accessing a predetermined website.

The CPU 1011 executes various processes using computer programs and data stored in the RAM 1010 and ROM 1009 . As a result, the CPU 1011 controls the operation of the information processing apparatus 1004 as a whole, and executes or controls each process described later as what the information processing apparatus 1004 performs.

The RAM 1010 has areas for storing computer programs and data loaded from the ROM 1009 and computer programs and data loaded from the storage device 1008 connected to the information processing device 1004 . The RAM 1010 also has a work area used when the CPU 1011 executes various processes. Thus, the RAM 1010 can provide various areas as appropriate. The ROM 1009 stores setting data and a boot program for the information processing apparatus 1004 .

A printer 1005 connected to the information processing apparatus 1004 has a function of printing images and characters on a print medium such as paper based on print data output from the information processing apparatus 1004 . For example, when print data for an album is output from the information processing apparatus 1004 to the printer 1005, the printer 1005 prints images and characters on a print medium based on the print data to print each page of the album. to print.

A monitor 1006 connected to the information processing apparatus 1004 has a liquid crystal screen or a touch panel screen, and can display the results of processing by the CPU 1011 as images or characters. For example, any GUI (graphical user interface), which will be described later, is displayed on the monitor 1006 .

An input device 1007 connected to the information processing apparatus 1004 is a user interface such as a keyboard, a mouse, and a touch panel, and can input various instructions to the CPU 1011 by the user's operation. Note that the monitor 1006 and the input device 1007 may be integrated to form a device, such as a touch panel screen, which has a function of receiving user operation input and a display function.

A storage device 1008 connected to the information processing device 1004 is a large-capacity information storage device such as a hard disk drive. The storage device 1008 stores an OS (operating system), and computer programs and data for causing the CPU 1011 to execute or control each process described later as performed by the information processing apparatus 1004 . Computer programs and data stored in the storage device 1008 are appropriately loaded into the RAM 1010 under the control of the CPU 1011 and are processed by the CPU 1011 .

Next, the external server 1002 will be explained. As described above, the information processing apparatus 1004 can upload the created album data to the external server 1002 via the network 1003 . The external server 1002 holds album data uploaded from the information processing apparatus 1004 , generates print data of the album according to instructions from the user, and sends the print data to the printer 1001 connected to the external server 1002 . Output for The external server 1002 is, for example, an album order reception/management server. The external server 1002 uploads the data of the album created by the user on his/her own information processing device 1004 to the external server 1002, and when it confirms that the necessary album purchase procedures have been taken, it generates the print data of the album. Output to the printer 1001 . After that, the printed matter output from the printer 1001 is bound and delivered to the user as an album. Note that depending on the form, the created album may be printed by the user's own printer 1005 and bound by the user to complete the album. Note that the external server 1002 is a computer device having a CPU 1011, a RAM 1010, a ROM 1009, and the like, similarly to the information processing device 1004. FIG.

Note that the configuration of the system is not limited to the configuration shown in FIG. For example, in FIG. 1, the information processing device 1004, the monitor 1006, the input device 1007, and the storage device 1008 are separate devices, but two or more of them may be integrated. Further, each of the printers 1001 and 1005 may be a printing device having a printing function, a printing device having a printing function and a scanning function, or a printing device having multiple functions including a printing function and a scanning function. It may be a compound machine.

Next, templates prepared in advance will be described with reference to FIGS. 2 and 3. FIG. It is assumed that the template itself is prepared in advance by the manufacturer or the like that provides the album application. This template determines the position of the image slot (area for placing an image), text slot (area for placing text), stamp slot (area for placing a stamp image), and other decorations for the size of the album you want to print. Decided to place it. In the following description common to various slots such as image slots, text slots, stamp slots, etc., these slots are simply referred to as slots.

The "slot arrangement information indicating the arrangement position of each slot on the page of the album" defined by the template is binary data formatted so that the application software running on the information processing device 1004 can read it, or xml data. Save in a structured document such as /json. Also, it is determined in advance which text slot and stamp slot are associated with a specific image slot. By placing (setting) an image, text, and stamp image in each of the image slot, text slot, and stamp slot, the image, text (text data), and stamp image are placed in the positions determined in advance by the template. becomes possible. Note that the stamp image here refers to an image such as an illustration, unlike an image such as a photograph placed in the image slot.

FIG. 2 shows an example of a template in which an image slot 2001, an image slot 2002, a text slot 2003 and a stamp slot 2004 are arranged. FIG. 3 shows slot arrangement information (data table) indicating the arrangement position of each slot (the arrangement position of the image slot, the arrangement position of the text slot, and the arrangement position of the stamp slot) in the template of FIG.

"ID" is the identification number of the slot (reference number here), "Type" is the slot type (image, text, stamp), "x" and "y" are the x coordinates of the slot on the template, and y coordinates. 'w' and 'h' are the width and height of the slot, respectively, 'correspondence' is the ID of the other slot associated with the slot, and 'content' is the data table specified for the slot. The data table of FIG. 3 is stored in the binary data and structured document described above. This binary data and structured document are stored in the storage device 1008 .

The data table in FIG. 3 specifies that the image slot 2001 and the text slot 2003 are related, and that the image slot 2002 and the stamp slot 2004 are related, as shown in the "correspondence" column. there is Further, in the data table of FIG. 3, as shown in the "content" column, it is specified that the text specified for the text slot 2003 is the data table of FIG. 4, which will be described later. Further, in the data table of FIG. 3, as shown in the "contents" column, it is specified that the stamp image specified for the stamp slot 2004 is the data table of FIG. 5, which will be described later.

FIG. 4 shows an example of a data table of texts specified for text slots. "Period" indicates the range of shooting date and time of the image. "Item1", "Item2", and "Item3" are texts corresponding to shooting dates (periods). In this embodiment, three texts are assigned to the same period, but the number of texts to be assigned is not limited to three, and may be one, two, or four or more. Note that when a plurality of texts are assigned to one period as in the present embodiment, it is necessary to determine columns to be selected by default. Columns can be specified individually, or the first column can be set as the default column. In this embodiment, it is assumed that the column of Item1 is the default selected column. This is the same for other data tables to be described later.

In this embodiment, the period is described so that it can correspond to periods other than calendar months, but if calendar months and text correspond one-to-one, the period column is not a range However, it is also possible to write the number of months.

You can also create prioritized texts with multiple time periods. For example, the period from 1/1 to 1/3 may be set as "New Year", and the period from 1/1 to 1/31 may be set as "January". In this case, if the shooting date and time of the photo is 1/1, the text "New Year" is selected, and if it is 1/4, the text "January" is selected.

In addition, although the data shown in this embodiment are texts for calendar months, the twenty-four solar terms may be assigned. In order to assign text to a specific date, it is necessary to select an image for that date, but if you select a casual everyday image, text related to the twenty-four solar terms will be automatically assigned to the specific date. can be done. In addition, when using the twenty-four solar terms, the date to be set must be a year, month, and day including the year, because the date differs depending on the year. In addition, since periods and dates related to the calendar can be set, it is possible to assign names of constellations used in horoscopes for periods and names of national holidays for dates.

Furthermore, in the present embodiment, texts corresponding to periods and dates are assigned, but dates can be composed of numbers such as "1/1". In this case, even if you don't have a text data table, you can have text like "m/d", where "m" is assigned the calendar month number and "d" is programmatically assigned the day number. It is also possible to generate Since the day of the week can be calculated by a program, it is possible to calculate the day of the week and create a text.

FIG. 5 shows an example of a data table of stamp images designated for stamp slots. "Period" indicates the range of shooting date and time of the image. "Item1", "Item2", and "Item3" are the path names of the stamp images corresponding to the shooting date and time.

In the case of the data table of FIG. 4, the text registered in the data table is drawn directly in the album, but in the case of the data table of FIG. 5, the stamp image of the path name registered in the data table is accessed. to draw the stamp image in the album. Since there is no other difference, the stamp image may be assigned to the twenty-four seasons, or to a specific date, in addition to the calendar month.

FIG. 6 shows an example of a stamp image. The stamp image in FIG. 6 is an example of a stamp image with a path name of "01 — 01.png", and it is possible to set expressions and illustrations that cannot be expressed by text or the like. This illustration may be switched according to the area where the user lives. For example, it is conceivable to set an illustration according to the season in the stamp image. In this case, even if the months are the same, the seasons are reversed between the northern and southern hemispheres. Considering such a case, the illustration may be switched according to the region operated by the user. Alternatively, after having the user set the region or cultural sphere in advance, the illustration may be switched to an appropriate illustration. For example, if the illustration is strongly religious, the illustration may be switched between a strongly religious illustration and a weakly religious illustration after confirmation before the user's work.

Next, the operation of the information processing device 1004 will be described according to the flowchart of FIG. In step S7001, the CPU 1011 selects a template designated by the user using the input device 1007 from a plurality of templates. There are various selection methods for selecting a template by a user. An example will be described here. For example, a GUI (template selection UI) illustrated in FIG. 8 is displayed on the monitor 1006 . Four templates are displayed on the template selection UI. When the user designates a desired template from among these four templates using the input device 1007 and then designates an OK button, the CPU 1011 selects the designated template as a template to be used in subsequent processing.

When the template designated by the user operation is selected, the CPU 1011 displays the GUI (editing UI) illustrated in FIG. 9 on the monitor 1006 . FIG. 9 shows a configuration example of an editing UI when the template in FIG. 2 is selected. A region 9001 of the edit UI displays a plurality of images (photographs) that can be placed in the image slots, and a region 9002 displays the template of FIG.

At the stage of FIG. 9, none of the slots has an image, text, or stamp image placed therein, and the contents are empty. In the next step, an image is placed in the image slot according to the user's operation. Note that a notification such as "Please place an image" may be displayed near the image slot so that the user can understand that the image needs to be placed. In the text slot and the stamp slot, the text and the stamp are arranged based on the information of the image arranged in the image slot, so the above notification to the user is unnecessary. However, for example, in the case of a template with an image of spring, it is preferable to set an image taken in the spring season in the image slot. In this case, you may draw sample text or stamps to show what text or stamps are included.

In step S7002, the CPU 1011 arranges the images in the image slots according to the user's operation. For example, the user selects a desired image from the images displayed in the area 9001 using the input device 1007, and drops the selected image into a desired image slot by a drag-and-drop operation or the like. Based on the drop position at this time, the CPU 1011 identifies the image slot in which the image is arranged.

In step S7003, the CPU 1011 searches for a slot (text slot, stamp slot) associated with the image slot in which the image was dropped (the image slot in which the image was placed in step S7002). For example, assume that an image is dropped into the image slot 2001 according to a user operation. At this time, the CPU 1011 searches the data table of FIG. 3 for slots associated with the image slot 2001 . In the data table of FIG. 3, the text slot 2003 is associated with the image slot 2001, as shown in the "correspondence" column.

In step S7004, the CPU 1011 searches for other image slots (other image slots) (other than the image slot in which the image was placed in step S7002) associated with the text slot. Note that this processing is performed when a plurality of image slots are set for a text slot, and can be omitted if it is obvious that the text slots and image slots have a one-to-one correspondence. CPU 1011 also searches for other image slots associated with the stamp slot. Note that this processing is performed when a plurality of image slots are set for a stamp slot, and can be omitted if it is obvious that the stamp slot and the image slot have a one-to-one correspondence.

In step S7005, the CPU 1011 acquires the shooting date and time of the image placed in the image slot in which the image was dropped (the image slot in which the image was placed in step S7002). Furthermore, the CPU 1011 acquires the shooting date and time of the image placed in the image slot (the image slot associated with the text slot and the image slot associated with the stamp slot) specified by the search in step S7004.

Images captured by many digital cameras have a file format standardized as an exchangeable image file format (hereafter referred to as EXIF), and the shooting date and time are embedded (added) in the image file. In step S7005, the photographing date and time embedded in the image file according to the EXIF standard are read. In addition to the EXIF standard, the shooting date and time may be obtained from the Extensible Metadata Platform (XMP) standard or a data format established for each vendor. In addition, if there is no shooting date and time embedded in the file, the shooting date and time may be obtained based on the time stamp added to the file managed by the OS. However, since the time stamp information may not be accurate, if the image does not have the shooting date and time, the process ends in step S7005, and the user manually selects text data or an image that matches the shooting date and time. good too. Also, when reading images arranged in a plurality of image slots, there may be cases where the target image slot does not contain an image. In this case, the processing may be interrupted, or the period may be obtained only from the included images.

In step S7006, the CPU 1011 acquires the text and stamp image to be placed in the slot associated with the image slot into which the image was dropped based on the shooting date and time acquired in step S7005.

When an image is dropped in image slot 2001 in step S7002, image slot 2001 is associated with text slot 2003 as shown in FIG. Accordingly, the text (content) to be placed in the text slot 2003 is obtained from the data table in FIG.

Assume that the date and time the image dropped into the image slot 2001 was taken is January 31 (January 31). In this case, from the data table in FIG. 4, the text "January" indicating the period including the shooting date and time "January 31" is obtained as the text (content) to be placed in the text slot 2003. FIG.

Now suppose that the text slot associated with image slot 2001 is associated with multiple image slots. In this case, in step S7005, the photographing date and time of the image dropped in the image slot 2001 and the photographing date and time of the images arranged in other image slots associated with the text slot associated with the image slot 2001 are displayed. , to get Then, if all of the obtained multiple shooting dates and times are in the same calendar month (for example, January), "January" is obtained as the text (content) to be placed in the text slot 2003 from the data table in FIG.

On the other hand, the period indicated by the acquired multiple shooting dates (the period between the earliest shooting date and time among the multiple shooting dates and the latest shooting date and time among the multiple shooting dates) straddles a calendar month, for example , 1/30 to 2/3. In this case, "January" and "February" are acquired from the data table in FIG. In this case, a character string combining the two obtained characters with "-" such as "January-February" may be obtained as the text (content) to be arranged in the text slot 2003. FIG. In addition, in the case of 2018/1 to 2019/2, the notation does not match, so if the length of the period is within a certain period, use the combined character string, and if it exceeds the certain period, do not display the character string Alternatively, only the first calendar month may be displayed as "January-".

Also, when an image is dropped in image slot 2002 in step S7002, image slot 2002 is associated with stamp slot 2004 as shown in FIG. Therefore, the stamp image (content) to be placed in the stamp slot 2004 is obtained from the data table in FIG.

Assume that the date and time when the image dropped into the image slot 2002 was taken is January 31st. In this case, from the data table in FIG. 5, as the stamp image (content) to be placed in the stamp slot 2004, the stamp image with the path name "01_01.png" corresponding to the period including the shooting date and time "January 31" is obtained.

Now suppose that the stamp slot associated with image slot 2002 is associated with multiple image slots. In this case, in step S7005, the photographing date and time of the image dropped in the image slot 2002 and the photographing date and time of the images arranged in other image slots associated with the stamp slot associated with the image slot 2002 are displayed. , to get Then, if all of the acquired multiple photographing dates and times are in the same calendar month (for example, January), the stamp image (content) to be placed in the stamp slot 2004 from the data table of FIG. png” stamp image. On the other hand, the period indicated by the acquired multiple shooting dates (the period between the earliest shooting date and time among the multiple shooting dates and the latest shooting date and time among the multiple shooting dates) straddles a calendar month, for example , 1/30 to 2/3. In this case, even if a plurality of stamp images corresponding to periods spanning a plurality of calendar months are obtained from the data table of FIG. 5, it is difficult to combine and display the obtained plurality of stamp images. In such a case, any one of the obtained stamp images is displayed, such as displaying the stamp image corresponding to the image with the oldest shooting date and time. If no text or stamp image corresponding to the period is found, the text slot or stamp slot may be empty, or the user may be warned.

For example, when a bright-colored template background or stamp image representing spring is prepared, it is preferable that the period of the corresponding image includes images shot from approximately March to May. Therefore, a period of about March to May is set for stamp slots and stamp images. If an image taken in another season such as January or August is placed in this template, the corresponding text or stamp image cannot be found. In such a case, it would be desirable to issue a warning message to the user indicating that images suitable for the selected template are images taken between March and May. Also, if the region in which the user is operating is in the southern hemisphere, the season will be off by about six months, so it is preferable to warn the user in consideration of the seasonal shift.

In step S7007, if the slot associated with the image slot into which the image was dropped is a text slot, the CPU 1011 arranges (sets) the text acquired in step S7006 for the text slot in the text slot. If the slot associated with the image slot into which the image was dropped is a stamp slot, the CPU 1011 arranges (sets) the stamp image acquired in step S7006 for the stamp slot in the stamp slot.

If the CPU 1011 determines in step S7008 that the placement of the images in the image slots has been completed, the processing according to the flowchart of FIG. 7 ends. On the other hand, if the CPU 1011 determines that the placement of the images in the image slots has not been completed yet, the process returns to step S7002. For example, if there are still image slots in which no images have been arranged, it is determined that the arrangement of images in the image slots has not been completed. Further, for example, when the user inputs an instruction using the input device 1007 to replace the image arranged in the image slot with another image, it is determined that the arrangement of the image in the image slot has not been completed yet. do.

Thus, according to this embodiment, the user simply selects a desired template and arranges the desired image in the image slot in the template, and the text and stamp image suitable for the designed template are automatically generated. can be placed.

In other words, the user simply selects a template based on the design and places the desired image in the image slot in that template. Therefore, the user can easily create a highly designed photo album. The placed image automatically determines the text and stamp image to be embedded in the template. In other words, since the text and the stamp image can be automatically arranged according to the date and time information which is the additional information of the arranged image, it is possible to reduce the mistake that the date and time of the image and the date text do not match. In addition, errors that are likely to occur during manual input, such as spelling mistakes, can be prevented.

As shown in the data table shown in FIG. 4, multiple texts can be assigned to the texts determined to be arranged. For example, if the period is between 9/1 and 9/30, text such as "September", "Sep.", and "Sept." can be obtained from the data table in FIG. In such a case, after automatic assignment, the user may select the desired month name or directly edit to change the text. Further, when "Jan." is selected in January, if the image arranged in another template is February, it is preferable to display the corresponding "Feb." instead of displaying "February." .

[Second embodiment]
In each of the following embodiments, including the present embodiment, differences from the first embodiment will be explained, and the same as the first embodiment unless otherwise specified. In the first embodiment, text and stamp images are acquired as additional information of images based on information on the shooting date and time. It is also possible to acquire images. In the present embodiment, a method of automatically setting a text and a stamp image related to a shooting location such as a shooting location name based on shooting location information added to an image will be described.

First, templates prepared in advance will be described with reference to FIGS. 2, 10, and 11. FIG. FIG. 2 is as described above. In the data table shown in FIG. 10, the image slot 2001 and text slot 2003 are associated, and the image slot 2002 and stamp slot 2004 are associated, as shown in the "correspondence" column. The data specified in the text slot 2003 becomes the data table shown in FIG. 11, which will be described later. In this embodiment, only the text slot will be described, but as for the stamp slot, the path of the stamp image is stored and processed instead of the text as in the first embodiment, so detailed contents will be omitted.

FIG. 11 shows an example of a data table of texts specified in text slots. For each row of the data table, the "longitude" and "latitude" described in the row and the image are calculated using the "longitude" and "latitude" described in the row and the longitude and latitude embedded in the shooting location information of the image. Find the distance between the shooting position of "Range" indicates the range that the distance must satisfy in order to regard the photographing position of the image as the place name (text) described in "Item1". For example, in the case of the second line, if the distance between the "longitude" and "latitude" described in the line and the image shooting position is within 50 km, the image shooting position is regarded as "Osaka", Assume that the text corresponding to the shooting position of the image is "Osaka". This is the same for other rows. The "range" is narrower for specific tourist spots, and broader for large areas such as natural parks. Although only one text is used in this embodiment, a plurality of texts may be assigned and switched arbitrarily as in the first embodiment.

In this embodiment, the shooting location information is embedded in the image in the format of longitude and latitude. may be used to determine the text to be set in the text slot. In this case, place names and addresses are set in the data table of FIG. 11 instead of longitude, latitude and range.

In this embodiment, longitude, latitude, and range are used to simplify processing and to facilitate text creation. good.

The amount of text data for the shooting location information is enormous, and in the case of building names, etc., there is a possibility that they will be demolished and lost. For this reason, the text data is stored in the external server 1002 instead of being stored in the storage device 1008, and the information processing device 1004 acquires the text data from the external server 1002 as necessary. good. Alternatively, address information may be obtained by querying a Web server capable of searching an address based on publicly available longitude and latitude information, and the text to be set in the text slot may be determined from the text data.

The operation of the information processing apparatus 1004 according to this embodiment will be described with reference to the flowchart of FIG. In FIG. 12, the processes in steps S12001 to S12004 and S12008 are the same as the processes in steps S7001 to S7004 and S7008 in FIG.

In step S12005, the CPU 1011 acquires shooting location information of the image placed in the image slot into which the image was dropped (the image slot in which the image was placed in step S12002). Further, the CPU 1011 acquires shooting location information of images placed in the image slots (image slots associated with the text slot and image slots associated with the stamp slot) specified in the search in step S12004. Images shot with many digital cameras have shooting location information embedded in the EXIF data format as longitude and latitude. In this step, the shooting location information embedded in the EXIF standard is read. In addition to the EXIF standard, the shooting location information may be acquired from the XMP standard or a data format established for each vendor.

When reading images placed in multiple image slots, there may be cases where the target image slot does not contain an image. In this case, the processing may be interrupted, or the photographing location information may be obtained from only the included images.

In step S12006, the CPU 1011 acquires the text or stamp image to be placed in the slot associated with the image into which the image was dropped based on the shooting location information acquired in step S12005. An example of processing in step S12006 will be described with reference to FIG.

First, the latitude and longitude in the first row of the data table in FIG. 11 are referenced, and the distance between the referenced latitude and longitude and the latitude and longitude indicated by the shooting location information acquired in step S12005 is obtained. For example, the distance may be obtained using a half-positive function or the like, or if the distance is around 35 degrees north latitude, one minute may be roughly calculated as 1.5 km, and an approximate value may be obtained as a planar distance. If the obtained distance is within the range "100 Km" described in the first line, the shooting position of the image is Item 1 "Tokyo" described in the first line, and this "Tokyo" is placed in the text slot. be the text. On the other hand, if the obtained distance is outside the range "100 Km" described in the first line, the second line of the data table in FIG. .

If the text corresponding to the shooting location information cannot be found, the text slot may be left blank, or a warning may be given to the user. For example, if a dialect image of the Kyushu region is prepared, the corresponding image is preferably an image shot in the Kyushu region. Therefore, the text is set with the longitude and latitude indicating each location in the Kyushu region. If you use an image taken in another region such as Hokkaido in this template, the corresponding text or stamp image cannot be found. In such a case, it is desirable to issue a warning message to the user indicating that the images suitable for the selected template were taken in the Kyushu region.

In step S12007, if the slot associated with the image slot into which the image was dropped is a text slot, CPU 1011 arranges (sets) the text acquired in step S12006 for the text slot in the text slot. If the slot associated with the image slot into which the image was dropped is a stamp slot, the CPU 1011 arranges (sets) the stamp image acquired in step S12006 for the stamp slot in the stamp slot.

As described above, according to this embodiment, the user can automatically generate text and stamp images suitable for the designed template and the placed images simply by selecting a desired template and arranging the desired image in the image slot of the template. It is possible to place In other words, since the text and the stamp image can be automatically arranged according to the shooting location information, which is the additional information of the arranged image, it is possible to reduce errors in which the shooting location of the image and the text do not match. In addition, errors that are likely to occur during manual input, such as spelling mistakes, can be prevented.

[Third embodiment]
In the first embodiment, the text and stamp image are obtained based on the shooting date and time of the image, but it is also possible to obtain the text and stamp image based on the EXIF information. In this embodiment, a method for automatically setting text data and stamp images based on EXIF information added to images will be described.

First, templates prepared in advance will be described with reference to FIGS. 2, 13, and 14. FIG. FIG. 2 is as described above. In the data table shown in FIG. 13, the image slot 2001 and the text slot 2003 are related, and the image slot 2002 and the stamp slot 2004 are related, as shown in the "correspondence" column. The text specified in the text slot 2003 is described only as "shooting information", and the text is set programmably based on the EXIF information included in the image. The stamp image specified in the stamp slot 2004 is the data table shown in FIG. 14, which will be described later.

FIG. 14 shows an example of a data table of stamp images designated in stamp slots. "Model" is the model name of the camera (image capturing device) that captured the image, and "Item" is the path name of the stamp image. In the present embodiment, one stamp image is assigned to one model, but a plurality of stamp images, such as a live-action icon or an illustration-like icon, may be set and switched.

The operation of the information processing apparatus 1004 according to this embodiment will be described with reference to the flowchart of FIG. In FIG. 15, the processes in steps S15001 to S15004 and S15008 are the same as the processes in steps S7001 to S7004 and S7008 in FIG.

In step S15005, the CPU 1011 acquires EXIF information (including shooting information and shooting model information) of the image placed in the image slot in which the image was dropped (the image slot in which the image was placed in step S15002). Furthermore, the CPU 1011 acquires EXIF information of images placed in the image slots (the image slot associated with the text slot and the image slot associated with the stamp slot) specified by the search in step S15004.

Images taken with many digital cameras are EXIF standard, and the files contain shooting information that indicates shooting parameters such as shutter speed, aperture value, and sensitivity, and camera model information such as camera model name and model name. Embedded. In this step, the photographing information and the photographing model information embedded in the EXIF standard are read. In addition to the EXIF standard, the XMP standard and the data format established for each vendor may be used to acquire the shooting information and the shooting model information.

In step S15006, the CPU 1011 acquires the text and stamp image to be placed in the slot associated with the image into which the image was dropped, based on the shooting information and camera model information acquired in step S15005.

For example, the text to be placed in the text slot 2003 is acquired according to the shooting information acquired in step S15005. Based on this shooting information, according to a predetermined text format, text describing ISO sensitivity, aperture value, shutter speed, focal length, etc. is generated and placed in the text slot 2003 . Alternatively, based on the acquired values, an icon image resembling an indicator displayed by the photographing equipment during photographing may be generated.

The stamp image to be placed in the stamp slot 2004 is obtained by searching the data table in FIG. get.

In step S15007, if the slot associated with the image slot into which the image was dropped is a text slot, the CPU 1011 arranges (sets) the text obtained for the text slot in step S15006 in the text slot. If the slot associated with the image slot into which the image was dropped is a stamp slot, the CPU 1011 arranges (sets) the stamp image acquired in step S15006 for the stamp slot in the stamp slot.

As described above, according to this embodiment, the user simply selects a desired template and arranges a desired image in an image slot in the template, and automatically generates text and stamp images suitable for the designed template and the arranged image. It is possible to place That is, it is possible to automatically arrange the text and the stamp image according to the EXIF information, which is the additional information of the arranged image. Therefore, a highly designed layout can be generated.

[Fourth embodiment]
In the first embodiment, text and stamp images are obtained from information embedded in image files, but it is also possible to obtain text and stamp images from image analysis and tagged information. In this embodiment, a method of automatically setting text data and a stamp image as additional information based on image analysis and tagging information for an image will be described.

First, templates prepared in advance will be described with reference to FIGS. 2, 16, and 17. FIG. FIG. 2 is as described above. In the data table shown in FIG. 16, image slots 2001 and text slots 2003 are associated, and image slots 2002 and stamp slots 2004 are associated, as shown in the "correspondence" column. The data specified in the text slot 2003 becomes the data table shown in FIG. 17, which will be described later. In this embodiment, only the text slot will be described, but as for the stamp slot, the path of the stamp image is stored and processed instead of the text as in the first embodiment, so detailed contents will be omitted.

Here, image analysis and tagging for images will be described with reference to FIG. In this embodiment, tagging an image is a technique of manually embedding text or numerical values in an image based on the photographed content, and image analysis is a technique of automating the tagging. For example, consider tagging an image with the name of the person in the image. Tagging is done by the user looking at each photo and setting the name of the person in the photo. Image analysis technology analyzes the image to detect the face and determine if it is the same person. Tagging is possible. Also, if the same person is tagged with a name or the like, it is possible to collectively tag the birthday or the like.

FIG. 17 shows the results (table) tagged for each image. "Image" is the file name of the image, and "name tag" is the name of the person appearing in the image. "Birthday tag" is the birthday of the person appearing in the image. As for this tagging, the user may manually tag each image, or the tagging may be performed by automating a part of processing through image analysis. That is, the method of generating tags for each image illustrated in FIG. 17 is not limited to a specific generation method.

The operation of the information processing apparatus 1004 according to this embodiment will be described with reference to the flowchart of FIG. In FIG. 18, the processes in steps S18001 to S18004 and S18008 are the same as the processes in steps S7001 to S7004 and S7008 in FIG.

In step S18005, the CPU 1011 acquires the tag of the image placed in the image slot into which the image was dropped (the image slot in which the image was placed in step S18002) from the table in FIG. Also, the CPU 1011 acquires the tag of the image placed in the image slot (the image slot associated with the text slot and the image slot associated with the stamp slot) specified by the search in step S18004 from the table in FIG. do.

In step S18006, the CPU 1011 acquires the text or stamp image to be placed in the slot associated with the image into which the image was dropped based on the tag acquired in step S18005.

If the acquired tag is a person's name, the person's name is used as the text to be placed in the text slot. If the acquired tag is a birthday, the birthday may be used as text to be placed in the text slot, or the age in months and age of the person is calculated from the date and time when the image was taken and the birthday, and the calculated age in months. - It is also possible to use the age as the text to be placed in the text slot. For example, you can tell from the tagged name and birthday that the photo was taken on your birthday or in your birth month, so text such as "Ichiro's 3rd birthday" can be placed in the text slot. may be generated. In the case of a stamp image, for example, if the tag is a birthday and the date and time of photographing of the image match the birthday, a stamp image suitable for the birthday may be used as the stamp image to be placed in the stamp slot.

In step S18007, if the slot associated with the image slot into which the image was dropped is a text slot, the CPU 1011 arranges (sets) the text obtained for the text slot in step S18006 in the text slot. Also, if the slot associated with the image slot into which the image was dropped is a stamp slot, the CPU 1011 arranges (sets) the stamp image obtained for the stamp slot in step S18006 in the stamp slot.

Thus, according to this embodiment, the user simply selects a desired template and arranges the desired image in the image slot in the template, and the text and stamp image suitable for the designed template are automatically generated. can be placed.

[Fifth embodiment]
In the first embodiment, an example of arranging an image in an image slot of a predesigned template has been described, but there are cases where it is desired to add an image slot to a designed template. In this way, even when the user adds an image slot to the template, a configuration for automatically setting the text slot and stamp slot corresponding to the image slot will be described. Since the template prepared in advance is the same as in the first embodiment, the explanation thereof will be omitted.

FIG. 19 shows an example of a data table that defines text slots that are automatically set on the template by the information processing device 1004 when the user sets (arranges) image slots on the template using the input device 1007 . . The data table shown in FIG. 19 is generated, for example, when an image slot corresponding to ID=19001 is set. In the example of FIG. 19, the image slot corresponding to ID=19001 is associated with the text slot corresponding to ID=19002. The x- and y-coordinates of the image slot corresponding to ID=19001 are not set. This is because when the user adds an image slot, it is set to an arbitrary position, and the x and y coordinates are not set by the user. On the other hand, "x" and "y" for the text slot corresponding to ID=19002 represent relative distances (relative positions) from "x" and "y" of the image slot corresponding to ID=19001, respectively. That is, when the x- and y-coordinates of the image slot corresponding to ID=19001 are determined, the x- and y-coordinates of the text slot corresponding to ID=19002 are automatically determined.

FIG. 20 shows an example of a data table that defines stamp slots that are automatically set on the template by the information processing device 1004 when the user sets (arranges) image slots on the template using the input device 1007 . . The data table shown in FIG. 20 is generated, for example, when an image slot corresponding to ID=20001 is set. In the example of FIG. 20, the image slot corresponding to ID=20001 is associated with the stamp slot corresponding to ID=20002. The x- and y-coordinates of the image slot corresponding to ID=20001 are not set. This is for the same reason as the data table in FIG. On the other hand, "x" and "y" for the stamp slot corresponding to ID=20002 represent relative distances (relative positions) from "x" and "y" of the image slot corresponding to ID=20001, respectively. That is, when the x- and y-coordinates of the image slot corresponding to ID=20001 are determined, the x- and y-coordinates of the stamp slot corresponding to ID=20002 are automatically determined.

Note that the other items in the data table of FIG. 19 and the data table of FIG. 20 that have not been mentioned in the above description are as described in the first embodiment, and descriptions thereof will be omitted here.

In this embodiment, a simple example in which an image slot is associated with one text slot and one stamp slot is shown. is also possible. Also, in FIGS. 19 and 20, the contents associated with the text slot and stamp slot are the data tables of FIGS. 4 and 5, respectively, as in the first embodiment. Any other data table may be used. Furthermore, if there is no image information, processing is possible even if the text slot and stamp slot are empty. Alternatively, a stamp image may be set in the stamp slot. Alternatively, in consideration of the possibility that both the shooting date and time and the shooting location information are stored, it is possible to give priority to the contents to be set and set only one of them.

When the user sets up an image slot, decide in advance whether the image slot is associated with a text slot or a stamp slot, and adds the data tables of FIGS. 19 and 20 to the designed template. do. When the data table is added, the data tables shown in FIGS. 19 and 20 are added to the end of the data table shown in FIG. The added data table has the same format data as the original data table in FIG. Therefore, by performing the processing described in the first embodiment, the text and stamp slots associated with the image slot can be processed in the same manner, whether the existing data or the data added this time. A stamp image is set.

In this embodiment, only addition of an image slot has been described, but when deleting an image slot, text slots and stamp slots associated with the corresponding image slot are deleted from the data table of FIG.

As described above, according to this embodiment, the user simply selects a desired template and arranges a desired image in an image slot in the template, and automatically generates text and stamp images suitable for the designed template and the arranged image. It is possible to place

[Sixth embodiment]
Numerical values and character strings used in the above description are used for specific explanation, and the above embodiments are not intended to be limited to the numerical values and character strings used.

In the above description, text and stamp images are used as non-image content “image-related content,” but non-image content is not limited to text and stamp images. For example, decorations such as patterns may be used as related content of the image. In other words, the information of the image arranged in the image slot is acquired according to the user's operation, and the content related to the image according to the acquired information is arranged in another slot (content slot) different from the image slot. .

Also, some or all of the embodiments described above may be used in combination as appropriate. Moreover, you may selectively use a part or all of each embodiment demonstrated above.

(Other embodiments)
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in the computer of the system or apparatus reads and executes the program. It can also be realized by processing to It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the claims are appended to make public the scope of the invention.

1001: Printer 1002: External Server 1003: Network 1004: Information Processing Device 1005: Printer 1006: Monitor 1007: Input Device 1008: Storage Device 1009: ROM 1010: RAM 1011: Information Processing Device

Claims (20)

identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means ;
The identifying means determines whether the content slot is associated with an image slot other than the image slot,
When the content slot is not associated with an image slot other than the image slot, the placement means places content related to the image according to the additional information acquired by the acquisition means in the content slot. An information processing device characterized by: 2. An information processing apparatus according to claim 1, wherein said acquisition means acquires said additional information included in said image file. identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
with
The identifying means determines whether the content slot is associated with an image slot other than the image slot,
When the content slot is associated with an image slot other than the image slot, the acquisition means acquires additional information of an image arranged in the other image slot in addition to the additional information,
Information characterized in that, when the other image slot is associated with the content slot, the placement unit places related content corresponding to the plurality of pieces of additional information acquired by the acquisition unit in the content slot. processing equipment. The arranging means arranges the text corresponding to the period represented by the plurality of additional information acquired by the acquiring means or the text obtained by combining the plurality of texts corresponding to the period as the related content in the text slot as the content slot. 4. The information processing apparatus according to claim 3 , wherein: The arranging means arranges a stamp image corresponding to a period represented by the plurality of additional information acquired by the acquiring means or one of a plurality of stamp images corresponding to the period as the related content, and as the content slot. 5. The information processing apparatus according to claim 3 , wherein the stamp slot is arranged in the stamp slot of . identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
with
The information processing apparatus, wherein the arranging means arranges, as the related content, text related to the shooting location of the image indicated by the additional information acquired by the acquiring means in a text slot as the content slot. identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
with
The information processing apparatus, wherein the arranging means arranges, as the related content, a stamp image related to the shooting location of the image indicated by the additional information acquired by the acquiring means in a stamp slot as the content slot. identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
with
The information processing apparatus, wherein the arranging means arranges, as the related content, text related to the shooting parameters of the image represented by the additional information acquired by the acquiring means in a text slot as the content slot. identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
with
The information processing apparatus, wherein the arranging means arranges, as the related content, a stamp image of information relating to a photographing device of the image represented by the additional information acquired by the acquiring means in a stamp slot as the content slot. identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
with
The information processing apparatus, wherein the arranging means arranges the text based on the tag of the image indicated by the additional information acquired by the acquiring means as the related content in a text slot as the content slot. identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
with
The information processing apparatus, wherein the arranging means arranges, as the related content, a stamp image based on the tag of the image represented by the information acquired by the acquiring means in a stamp slot as the content slot. identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
adding means for adding at least one of a text slot and a stamp slot associated with the image slot when a new image slot is added to the template in response to a user operation ;
An information processing device comprising: identifying means for identifying a content slot associated with the image slot in which the image is placed in the template;
Acquisition means for acquiring additional information of the arranged image;
placement means for acquiring content related to the image based on the additional information acquired by the acquisition means and placing the content in the content slot specified by the specifying means;
deletion means for deleting at least one of a text slot and a stamp slot associated with an image slot when the image slot is deleted from the template in response to a user operation;
An information processing device comprising: 14. The information processing apparatus according to claim 6, wherein said acquisition means acquires said additional information included in said image file. The identifying means determines whether the content slot is associated with an image slot other than the image slot,
When the content slot is associated with an image slot other than the image slot, the acquisition means acquires additional information of an image arranged in the other image slot in addition to the additional information,
wherein, when the other image slot is associated with the content slot, the placement unit places related content corresponding to the plurality of pieces of additional information acquired by the acquisition unit in the content slot. Item 15. The information processing apparatus according to any one of Items 6 to 14. Furthermore,
16. The information processing apparatus according to any one of claims 1 to 15 , further comprising output means for outputting page data in which an image is arranged in the image slot and the related content is arranged in the content slot. . 17. An information processing apparatus according to claim 16 , wherein said output means generates print data for said page and outputs the generated print data to a device having a print function. 18. An information processing apparatus according to claim 16 , wherein said output means uploads the data of said page to an external server. An information processing method performed by an information processing device,
identifying a content slot associated with the image slot in which the image is placed in the template;
an acquisition step of acquiring additional information of the arranged image;
an arrangement step of acquiring content related to the image based on the additional information acquired in the acquisition step and arranging it in the content slot specified in the specifying step ;
determining whether the content slot is associated with an image slot other than the image slot in the identifying step;
In the placement step, if the content slot is not associated with an image slot other than the image slot, content related to the image according to the additional information acquired in the acquisition step is placed in the content slot. An information processing method characterized by: A computer program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 18 .

Images