JP6337678B2 - Program, information processing apparatus, and control method for information processing apparatus - Google Patents

Description

  The technology disclosed in the present specification relates to a program for displaying a plurality of images on a display unit.

  A technique for synthesizing various first images such as photographs and messages at predetermined positions of second images such as template images and frame images is known. Moreover, patent document 1 is disclosed as a related technique.

JP 2001-111809 A

  When there are a plurality of types of second images, it may be a burden on the user to select an appropriate second image for the first image.

  The program described in the present specification is a program that is read by an information processing apparatus including a display unit and a processor, and first image data acquisition means that acquires first image data indicating a first image; First attribute information acquisition means for acquiring first attribute information indicating a plurality of attributes relating to the first image data, and a second image that is an image that can be combined with the first image represented by the first image data is displayed. A first means for acquiring a plurality of second image data for specifying the second image data and a degree of conformity to the first image data for each of the specified second image data. The first determination means for determining based on the attribute information and the plurality of second images represented by the plurality of second image data are displayed with priority given to the second image having a higher degree of matching determined by the first determination means. Part In response to selection of either the display control means for displaying or the second image displayed by the display control means as the selected second image, the selected second image is acquired by the first image data acquiring means. The processor is made to function as combining means for combining the first image represented by the first image data.

  According to the program described in this specification, the second image having a higher degree of matching with the first image can be preferentially displayed on the display unit. Thereby, since it becomes easy to select a suitable 2nd image with respect to a 1st image, a user's convenience can be improved.

  According to the program described in the present specification, the first attribute information indicating a plurality of attributes related to the first image data and the second attribute information indicating the plurality of attributes related to the second image data are used. The degree of matching of the second image with respect to one image can be determined appropriately.

  According to the program described in this specification, the user can preferentially display the second image related to the designated area on the display unit by designating the predetermined area in the first image. User convenience can be improved.

  According to the program described in this specification, it is possible to appropriately determine the degree of suitability of the second image with respect to the first image based on the date / time information indicating the generation date / time of the first image data.

  According to the program described in the present specification, it is possible to appropriately determine the degree of suitability of the second image with respect to the first image based on the position information indicating the position related to the first image data.

  According to the program described in the present specification, based on the person characteristic that is the characteristic of the person image included in the first image and the group characteristic that is the characteristic of the group formed by a plurality of person images. The degree of matching of the second image with respect to one image can be determined appropriately.

  According to the program described in the present specification, it is possible to appropriately determine the degree of suitability of the second image with respect to the first image based on the acquisition path information indicating the acquisition path from which the first image data has been acquired. it can.

  According to the program described in the present specification, the second image having a higher degree of conformity to the first image can be displayed earlier, the display area can be increased, and can be highlighted. Thereby, since it becomes easy to select a suitable 2nd image with respect to a 1st image, a user's convenience can be improved.

An information processing apparatus having the above function and a computer-readable recording medium storing the computer program are also new and useful.
Examples of disclosure are listed below.
[Disclosure Example 1]
A program that is read into an information processing device including a display unit and a processor,
First image data acquisition means for acquiring first image data indicating the first image;
First attribute information acquisition means for acquiring first attribute information indicating a plurality of attributes relating to the first image data;
Specifying means for specifying a plurality of second image data for displaying a second image that is an image that can be combined with the first image represented by the first image data;
First determination means for determining, for each of the plurality of specified second image data, a degree of conformity to the first image data based on the first attribute information acquired by the first attribute information acquisition means; ,
Display control means for preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined by the first determination means;
The first image acquired by the first image data acquiring unit is selected as the selected second image in response to any one of the second images displayed by the display control unit being selected as the selected second image. Combining means for combining the first image represented by the image data;
A program for causing the processor to function.
[Disclosure Example 2]
The second image data includes second attribute information indicating a plurality of attributes related to the second image data,
The first determination means determines that the second image data including more second attribute information related to the first attribute information acquired by the first attribute information acquisition means has a higher degree of matching with the first image data. The program according to the first disclosure, characterized in that:
[Disclosure Example 3]
After the display control means displays the second image, the program further causes the processor to function as accepting means for accepting designation of a predetermined area in the first image indicated by the first image data,
The first attribute information acquisition unit acquires first attribute information indicating a plurality of attributes based on a predetermined image included in the predetermined area specified by the reception unit,
The first determination means determines the degree of conformity based on first attribute information acquired based on the first image data and first attribute information acquired based on the predetermined image. The program according to disclosure example 2.
[Disclosure Example 4]
The first attribute information acquisition unit acquires date and time information indicating a generation date and time of the first image data as the first attribute information,
In the disclosure example 2 or 3, the first determination unit determines that the second image data including the date and time related to the date and time information as the second attribute information matches the first image data. The listed program.
[Disclosure Example 5]
The first image is a photographic image;
The first attribute information acquisition means acquires position information indicating a position where the photographic image represented by the first image data is taken as the first attribute information,
In the disclosure examples 2 to 4, the first determination unit determines that the second image data including the position related to the position information as the second attribute information matches the first image data. The program according to any one of the above items.
[Disclosure Example 6]
A person having the characteristics of a person image included in the first image represented by the first image data by performing a face recognition process on the first image data acquired by the first image data acquisition unit. As a second determination means for determining characteristics, the program further causes the processor to function,
The first attribute information acquisition means acquires person characteristic information, which is information indicating the person characteristic determined by the second determination means, as the first attribute information,
The first determining means determines that the second image data including the person characteristic related to the person characteristic information as the second attribute information is suitable for the first image data. 6. The program according to any one of 5 above.
[Disclosure Example 7]
When the first image includes a plurality of person images, the second determination unit determines the person characteristics for each of the plurality of person images, and determines relevance of the determined plurality of person characteristics. By determining the group characteristics that are the characteristics of the group formed by a plurality of person images,
The first attribute information acquisition unit acquires group characteristic information, which is information indicating the group characteristic determined by the second determination unit, as the first attribute information,
According to Disclosure Example 6, wherein the first determination unit determines that the second image data including the group characteristic related to the group characteristic information as the second attribute information matches the first image data. The listed program.
[Disclosure Example 8]
The program according to the disclosure example 6 or 7, wherein the person characteristic indicated by the person characteristic information includes at least one of gender, age, and type of facial expression.
[Disclosure Example 9]
The first attribute information acquisition unit acquires, as the first attribute information, acquisition path information indicating an acquisition path from which the first image data acquisition unit has acquired the first image data.
The first determination means determines that the second image data including the acquisition route related to the acquisition route information as the second attribute information is suitable for the first image data. 9. The program according to any one of items 8.
[Disclosure Example 10]
After the display control means displays the second image, the program further causes the processor to function as accepting means for accepting designation of a predetermined area in the first image indicated by the first image data,
The first attribute information acquisition means acquires size information indicating the size of the predetermined area as the first attribute information,
The first determination means determines that the second image data having an image composition area having a size approximate to the size information matches the first image data,
The program according to any one of disclosure examples 2 to 9, wherein the image composition area is an area included in the second image data and is an area for compositing the first image. .
[Disclosure Example 11]
Any one of Disclosure Examples 1 to 10, wherein the display control unit accelerates the display order to be displayed on the display unit as the second image having a higher degree of matching determined by the first determination unit. The program described in the section.
[Disclosure Example 12]
The display control unit increases the display area of the second image displayed on the display unit as the second image having a higher degree of matching determined by the first determination unit. The program according to any one of 10.
[Disclosure Example 13]
The display control unit highlights the second image displayed on the display unit as the second image having a higher degree of matching determined by the first determination unit. The program according to any one of the above items.
[Disclosure Example 14]
An information processing apparatus including a display unit,
First image data acquisition means for acquiring first image data indicating the first image;
First attribute information acquisition means for acquiring first attribute information indicating a plurality of attributes relating to the first image data;
Specifying means for specifying a plurality of second image data for displaying a second image that is an image that can be combined with the first image represented by the first image data;
First determination means for determining, for each of the plurality of specified second image data, a degree of conformity to the first image data based on the first attribute information acquired by the first attribute information acquisition means; ,
Display control means for preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined by the first determination means;
The first image acquired by the first image data acquiring unit is selected as the selected second image in response to any one of the second images displayed by the display control unit being selected as the selected second image. Combining means for combining the first image represented by the image data;
An information processing apparatus comprising:
[Disclosure Example 15]
A method for controlling an information processing apparatus including a display unit and a processor,
A first image data acquisition step of acquiring first image data indicating a first image;
A first attribute information acquisition step of acquiring first attribute information indicating a plurality of attributes relating to the first image data;
A specifying step of specifying a plurality of second image data for displaying a second image, which is an image that can be combined with the first image represented by the first image data;
A first determination step of determining, for each of the plurality of specified second image data, a degree of conformity to the first image data based on the first attribute information acquired in the first attribute information acquisition step; ,
A display control step of preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined in the first determination step;
When any one of the second images displayed in the display control step is selected as the selected second image, the first image data acquired in the first image data acquiring step is added to the selected second image. A combining step of combining the first image represented by the image data;
An information processing apparatus control method comprising:

1 is a schematic diagram of a printing system 1. FIG. It is a flowchart which shows operation | movement of information processing apparatus. It is a flowchart which shows operation | movement of information processing apparatus. It is a flowchart which shows operation | movement of information processing apparatus. It is a flowchart which shows operation | movement of information processing apparatus. An example of a target image is shown. An example of a template image is shown. An example of a template image is shown. An example of a method for determining the degree of suitability will be described. An example of a composite image is shown.

  FIG. 1 shows a schematic diagram of a printing system 1 exemplified as the present embodiment. The printing system 1 includes an information processing apparatus 10, an access point 51, an MFP (abbreviation for Multifunction Peripheral) 52, a server 60, and the Internet 70. The information processing apparatus 10 and the MFP 52 can communicate with each other via the access point 51. The information processing apparatus 10 and the server 60 can communicate with each other via the access point 51 and the Internet 70.

  The information processing apparatus 10 is an apparatus capable of causing the MFP 52 to execute print processing for printing a print image on a print sheet by outputting print data to the MFP 52. Examples of the information processing apparatus 10 include a PC (abbreviation of personal computer), a tablet terminal, and a smartphone. The information processing apparatus 10 mainly includes a mouse 5, a CPU (abbreviation of central processing unit) 11, a storage unit 12, a wireless transmission / reception unit 15, a wireless antenna unit 16, a button input unit 17, a panel 18, and a coordinate detection unit 19. ing. The button input unit 17 receives an operation by the user of the information processing apparatus 10. An example of the button input unit 17 is a keyboard. The panel 18 displays various function information of the information processing apparatus 10. The coordinate detection unit 19 is a part that detects indicated coordinates, which are coordinates indicating a position where an indicator (eg, a user's fingertip) is in contact with or close to the display area of the panel 18. The coordinate detection unit 19 functions as the touch panel 20 by being configured integrally with the panel 18. The coordinate detection unit 19 can detect a plurality of designated coordinates at the same time. The wireless transmission / reception unit 15 performs wireless communication conforming to the infrastructure mode of the wireless LAN via the wireless antenna unit 16.

  The CPU 11 executes processing according to the program 21 in the storage unit 12. Hereinafter, the CPU 11 that executes a program, such as the image editing application 30 or the operating system 21e, may be simply described as a program name. For example, the description “operating system 21e” may mean “the CPU 11 executing the operating system 21e”.

  The storage unit 12 is configured by combining a RAM (abbreviation of random access memory), a ROM (abbreviation of read only memory), a flash memory, an HDD (abbreviation of hard disk), a buffer provided in the CPU 11, and the like. The storage unit 12 can store target image data and template image data described later. The storage unit 12 stores a program 21. The program 21 includes an operating system 21e and an image editing application 30. The operating system 21e is a program that provides basic functions that are commonly used by the image editing application 30 and the like.

  The image editing application 30 is an application for synthesizing the target image represented by the target image data with the image synthesis area included in the template image represented by the template image data. The image editing application 30 is an application that executes processing for transmitting print data to the MFP 52 and causing the MFP 52 to execute printing.

  The MFP 52 is a device having a print function, a scan function, and the like. The MFP 52 includes a storage unit 53. The storage unit 53 can store target image data and template image data described later. The server 60 includes a storage unit 61. The server 60 may be a storage server that can store various types of data via the Internet 70. The storage unit 61 can store target image data and template image data described later.

<Target image>
The target image is an image that is combined with the template image. The target image may be various images, for example, images such as photographs, pictures, and character strings. The target image is displayed by target image data. The target image data includes date information and position information. The date information is information indicating the date when the target image is generated. For example, when the target image is a photographic image, the date / time information is information indicating the shooting date / time of the photo. The position information is information indicating the position where the target image is generated. For example, when the target image is a photographic image, the position information may be information indicating the latitude and longitude at which the photograph was taken. The target image data can be stored in the storage unit 12 of the information processing apparatus 10, the storage unit 53 of the MFP 52, the storage unit 61 of the server 60, and the like.

  FIG. 6 shows a target image P1 displayed by the target image data D1 as an example. The target image data D1 includes date information DI1 and position information PI1. An example of the date / time information DI1 is “January 3, 2014, 15:30”. An example of the position information PI1 is “latitude: xxx.xxxxxx, longitude: ΔΔΔ.ΔΔΔΔ”.

<Template image>
The template image is an image having an image synthesis area for synthesizing the target image. The template image may be various images, for example, a photograph, a picture, a character string, and a combination thereof. The template image is displayed by template image data. The template image data includes a plurality of second attribute information. The second attribute information is information indicating a plurality of attributes related to the template image. The second attribute information may be given by the template image creator. The template image data can be stored in the storage unit 12 of the information processing apparatus 10, the storage unit 53 of the MFP 52, the storage unit 61 of the server 60, and the like.

  FIG. 7 shows a template image P2 displayed by the template image data D2 as an example. The template image P2 includes an image composition area SR1 for compositing the target image. The template image data D2 includes the second attribute information A2 shown in FIG. FIG. 8 shows a template image P3 displayed by the template image data D3 as an example. The template image P3 includes an image composition area SR2 for compositing the target image. The template image data D3 includes the second attribute information A3 shown in FIG.

<Operation of information processing apparatus>
The operation of the information processing apparatus 10 according to the present embodiment will be described using the flowcharts of FIGS. When the user inputs an operation for starting the image editing application 30 via the button input unit 17, the CPU 11 reads the image editing application 30 and starts the image editing process. The activation operation of the image editing application 30 may be performed, for example, by tapping an activation reception image (for example, an icon image) for receiving an activation instruction for the image editing application 30. Thereby, the flow of FIG. 2 is started.

  In S <b> 110, the CPU 11 displays a list of thumbnail images indicating each of the plurality of target images on the panel 18. For example, an operation of selecting a storage unit from which the target image is acquired from among the storage unit 12, the storage unit 53, and the storage unit 61 may be received. At this time, two or more storage units may be selected. Then, thumbnail images indicating each of the plurality of target images stored in the selected storage unit may be displayed on the panel 18 as a list.

  In S115, the CPU 11 determines whether or not an operation for selecting any target image has been accepted. In S115, an operation for selecting a plurality of target images may be accepted. When a negative determination is made (S115: NO), the process returns to S115, and when an affirmative determination is made (S115: YES), the process proceeds to S117.

  In S117, the CPU 11 acquires selection target image data from the selected storage unit. The selection target image data is data for displaying the selection target image that is the target image selected in S115.

  In S120, the CPU 11 executes a first first attribute information acquisition process. The first first attribute information acquisition process is a process for acquiring first attribute information indicating a plurality of attributes related to the selection target image data acquired in S117. Examples of the plurality of attributes include person characteristics, group characteristics, date / time information, position information, and the like.

  The content of the first first attribute information acquisition process will be described with reference to FIG. In S215 to S225, a process of determining a person characteristic that is a characteristic of a person image included in the selection target image is executed. Examples of personal characteristics include gender, age, facial expression, and the like. In S210, the CPU 11 performs face detection processing on the selection target image. Since the face detection process may be executed using a known face recognition technique, the description thereof is omitted. Thereby, any one person image can be specified among one or a plurality of person images included in the selection target image.

  In S215, the CPU 11 determines the gender of the specified person image. In S220, the CPU 11 determines the approximate age of the specified person image. In S225, the CPU 11 determines the facial expression of the specified person image. The determinations in S215 to S225 may be performed by image analysis of the face image detected in S210. For example, gender may be determined by analyzing hairstyles, or facial expressions may be analyzed by analyzing mouth corners.

  In S230, the CPU 11 determines whether or not the process of determining the person characteristics has been completed for all the person images included in the selection target image. If a negative determination is made (S230: NO), the process returns to S210. If an affirmative determination is made (S230: YES), the process proceeds to S240.

  In S240, the CPU 11 executes a process of excluding persons other than the predetermined person from the target of the first first attribute information acquisition process. In order to execute the process, for example, a person characteristic of a predetermined person such as a user of the information processing apparatus 10 or a family may be registered in advance. Then, of the person characteristics determined in S210 to S225, persons having person characteristics that do not match the person characteristics of the predetermined person may be excluded. Thereby, it is possible to perform control so that the first first attribute information acquisition process is not performed on a person image that is not intended to be photographed but is reflected in the background.

  In S243, the CPU 11 acquires personal characteristics such as gender, age, and facial expression indicated by the personal characteristic information as first attribute information.

  In S245, the CPU 11 acquires group characteristics as first attribute information. The group characteristic is a characteristic of a group formed by a plurality of persons. The group characteristics can be acquired by determining the relationship between the plurality of person characteristics when the person characteristics for the plurality of persons can be acquired in S210 to S230. Examples of group characteristics include couples, families, friends, and the like.

  In S250, the CPU 11 acquires information related to the date and time information included in the selection target image data as first attribute information. In S255, the CPU 11 acquires information related to the position information included in the selection target image data as first attribute information.

  In S260, the CPU 11 acquires acquisition path information indicating the acquisition path from which the selection target image data has been acquired as first attribute information. For example, when the selection target image data is acquired from the server 60, the URL of the server 60 may be used as the acquisition path information. Further, for example, when the selection target image data is acquired as an attached image of an email, the transmission source address may be used as acquisition path information.

  In S <b> 265, the CPU 11 acquires image characteristic information indicating the image characteristic of the selection target image data as first attribute information. Examples of the image characteristic information include image direction information indicating the direction (landscape or portrait) of the selection target image represented by the selection target image data, size information indicating the size (large, medium, or small). Thereby, the first first attribute information acquisition process is completed. And it returns to S125 of FIG.

  In S125, the CPU 11 determines whether or not the first first attribute information acquisition process in S120 has been executed for all the selection target image data. For example, when a plurality of selection target image data is acquired in S117, it is determined whether or not the first first attribute information acquisition process has been executed for all of the plurality of selection target image data. If a negative determination is made (S125: NO), the process proceeds to S130. In S130, the CPU 11 selects the next selection target image data as a processing target. Then, the process returns to S120.

  On the other hand, when a positive determination is made in S125 (S125: YES), the process proceeds to S135. In S <b> 135, the CPU 11 selects a storage unit from which the template image data is acquired from the storage unit 12, the storage unit 53, and the storage unit 61. The acquisition destination storage unit may be determined in advance or may be determined by a user's selection. Two or more storage units may be selected. Then, a degree of matching with each of the plurality of template image data stored in the selected storage unit with respect to the selection target image data is determined.

  A specific example of a method for determining the degree of suitability for selection target image data will be described. As described above, the template image data includes a plurality of second attribute information. Then, it is determined that the template image data including more second attribute information related to the first attribute information acquired in the first first attribute information acquisition process (S120) has a higher degree of matching with the selection target image data. A specific determination example will be described later with reference to FIG.

  In S140, the CPU 11 displays a list of thumbnail images indicating each of the plurality of template image data on the panel 18. At this time, the thumbnail images of the template image data having a higher degree of matching with the selection target image data are preferentially displayed on the panel 18. Specifically, the thumbnail image of the template image data having a higher degree of matching may be displayed earlier in the scroll display.

  In S145, the CPU 11 determines whether or not a region of interest has been designated in the selection target image. The operation for designating the attention area may be accepted by the touch panel 20 or the mouse 5. For example, in the target image P1 of FIG. 6, the region R3 is designated as the attention region. The attention area image specified in the area R3 includes the character string “Kaminarimon”.

  When a positive determination is made in S145 (S145: YES), the process proceeds to S147. In S147, the CPU 11 executes a second first attribute information acquisition process. The second first attribute information acquisition process is a process of updating the first attribute information indicating a plurality of attributes based on the attention area image included in the attention area specified in S145.

  The contents of the second first attribute information acquisition process will be described with reference to FIG. In S310, the CPU 11 determines whether or not a face is detected in the attention area. If a positive determination is made (S310: YES), the process proceeds to S315. In S <b> 315, the CPU 11 acquires person characteristics and group characteristics as first attribute information. Since the processing content of S315 is the same as the processing content of S210-S245 mentioned above, description is abbreviate | omitted. In S320, the CPU 11 updates the first attribute information acquired in S210 to S245 to the first attribute information acquired in S315. Then, the process returns to S160 of FIG.

  On the other hand, when a negative determination is made in S310 (S310: NO), the process proceeds to S330. In S330, the CPU 11 determines whether or not a character string is detected in the attention area. The determination may be made by a well-known OCR technique. If a negative determination is made (S330: NO), the process returns to S160. If an affirmative determination is made (S330: YES), the process proceeds to S335.

  In S335, the CPU 11 acquires the detected character string as new first attribute information. For example, in the target image P1 of FIG. 6, a character string “Kaminarimon” is newly acquired as the first attribute information. The character string is a characteristic character string related to the shooting location of the target image P1. Then, the process returns to S160.

  On the other hand, if a negative determination is made in S145 of FIG. 3 (S145: NO), the process proceeds to S150.

  In S150, the CPU 11 determines whether or not the selection target image has been trimmed. The trimming process is a process of cutting out a trimming area that is a part of the selection target image as a new selection target image. The operation for designating the trimming area may be accepted by the touch panel 20 or the mouse 5. For example, in the target image P1 of FIG. 6, the regions R1 and R2 including the face image may be designated as the trimming region.

  If a negative determination is made in S150 (S150: NO), the process proceeds to S170, and if a positive determination is made (S150: YES), the process proceeds to S155. In S155, the CPU 11 newly acquires size information indicating the size of the trimming area as the first attribute information. Then, the size information of the selection target image acquired in S265 is updated to the size information of the newly acquired trimming region. Then, the process proceeds to S160.

  In S160, the CPU 11 determines again the degree to which each of the plurality of template image data matches the selection target image data.

  In S <b> 165, the CPU 11 displays a list of thumbnail images indicating each of the plurality of template image data on the panel 18. At this time, the thumbnail images of the template image data determined in S160 that the degree of matching with the selection target image data is high are preferentially displayed on the panel 18. Note that the processing content of S160 is the same as the processing content described in S140, and thus the description thereof is omitted.

  In S <b> 170, the CPU 11 determines whether an operation for selecting any one of the thumbnail images has been accepted. If a negative determination is made (S170: NO), the process returns to S145. If an affirmative determination is made (S170: YES), the process proceeds to S175.

  In S175, the CPU 11 combines the template image corresponding to the thumbnail image selected in S170 and the selection target image acquired in S117. Then, the flow ends.

<Specific operation example>
As an example, a case where target image data D1 representing the target image P1 (FIG. 6) is stored in the storage unit 61 of the server 60 will be described. A case will be described in which the target image P1 (FIG. 6) is selected as the selection target image in S115. Further, a case will be described in which when the template images P2 (FIG. 7) and P3 (FIG. 8) are stored in the storage unit 12, the storage unit 12 is selected as a template image data acquisition destination in S135.

  When the user selects the target image P1 (FIG. 6) (S115: YES), the CPU 11 acquires target image data D1 representing the target image P1 (S117). Then, the CPU 11 executes a first first attribute information acquisition process (S120). In S210, face detection processing is executed for the two person images M1 and M2 included in the target image P1 (regions R1 and R2). Then, it is determined that the person images M1 and M2 are male and female (S215), are in their twenties (S220), and are smiling (S225). Thereby, the first attribute information “male and female”, “20s”, and “smile” can be acquired (S243). Further, group characteristic information “couple” can be acquired as the first attribute information (S245).

  The first attribute information “New Year” and “Daytime” is acquired from the date information DI1 “January 3, 2014 15:30” included in the target image data D1 representing the target image P1 (FIG. 6). (S250). From the position information PI1 “latitude: xxx.xxx” and longitude: ΔΔΔ.ΔΔΔΔ included in the target image data D1 representing the target image P1 (FIG. 6), “Japan”, “ The first attribute information “Tokyo” and “sightseeing spot” can be acquired (S255). Since the target image data D1 is acquired via the Internet 70, the first attribute information “http://xxx.co.jp” that is the URL of the server 60 can be acquired (S260). Further, the first attribute information “landscape” and “medium image size” can be acquired from the image characteristic information of the target image P1 (S265). Thereby, as shown in FIG. 9, twelve pieces of first attribute information A11 can be acquired.

  The user selects the storage unit 12 of the information processing apparatus 10 as a template image data acquisition destination (S135). The CPU 11 determines the degree of matching of the template image data D2 and D3 stored in the storage unit 12 with the target image data D1. A specific determination method will be described with reference to FIG.

  The first attribute information A11 and the second attribute information A2 are compared to determine the degree of suitability of the template image data D2 with respect to the target image data D1. Person characteristics related to each other are included (arrow Y1). Also included are group characteristic information (arrow Y2), date / time information (arrow Y3), position information (arrow Y4), image direction information (arrow Y5), and size information (arrow Y6) that match each other. Therefore, it can be seen that the second attribute information A2 includes six pieces of information related to the target image data D1.

  Further, the first attribute information A11 and the second attribute information A3 are compared to determine the degree of suitability of the template image data D3 with respect to the target image data D1. Person characteristics related to each other are included (arrow Y11). Also, image direction information (arrow Y12) that matches each other is included. Therefore, it can be seen that the second attribute information A3 includes two pieces of information related to the target image data D1.

  From the above, it can be seen that the template image data D2 contains more second attribute information related to the target image data D1 than the template image data D3. Therefore, it is determined that the template image data D2 is more suitable for the target image data D1 than the template image data D3 (S135).

  It is displayed on the panel 18 so that the display order of the thumbnails of the template image data D2 is earlier than the display order of the thumbnails of the template image data D3 (S140). When the user selects the template image data D2 (S170: YES), the template image data D2 and the target image data D1 are combined (S175). Thereby, the composite image P4 is completed as shown in FIG.

<Effect>
According to the image editing application 30 described in this specification, it is possible to determine the degree of conformity with respect to the selection target image data for each of the plurality of template image data (S135). Then, a thumbnail image of a template image having a higher degree of matching with the selection target image can be preferentially displayed on the panel 18 (S140). As a result, it becomes easy to select an appropriate template image for the selection target image, and the convenience for the user can be improved.

  According to the image editing application 30 described in the present specification, it can be determined that template image data including a lot of second attribute information related to selection target image data has a higher degree of matching with the selection target image data. Yes (S135). Thereby, since the degree of conformity can be determined numerically, appropriate determination is possible.

  According to the image editing application 30 described in this specification, a thumbnail image of a template image having a high degree of matching with the selection target image is preferentially displayed on the panel 18 (S140), and then the attention area is designated (S145). ) Can be accepted. Based on the designated attention area, the first attribute information can be updated (S320), or new first attribute information can be added (S335). Based on the updated first attribute information and the first attribute information to which new information is added, it is possible to determine again the degree to which the template image data matches the selection target image data (S160). Then, the thumbnail images of the template image data determined in S160 that the degree of matching with the selection target image data is high can be preferentially displayed on the panel 18 (S165). Thereby, a template image having a higher degree of matching can be displayed on the panel 18 after further narrowing down from among template images extracted as having a high degree of matching with the selection target image. User convenience can be improved.

  According to the image editing application 30 described in this specification, the thumbnail image of the template image having a high degree of matching with the selection target image is preferentially displayed on the panel 18 (S140), and then the trimming process (S150) is performed. Can be accepted. The size information of the selection target image can be updated to the size information of the newly acquired trimming area (S155). Based on the first attribute information including the updated size information, the degree to which the template image data matches the selection target image data can be determined again (S160). As a result, a template image having a high degree of matching with the selection target image after trimming can be further narrowed down and displayed on the panel 18. User convenience can be improved.

  According to the image editing application 30 described in this specification, when the person characteristics for a plurality of persons can be acquired in S210 to S225, the relevance between the plurality of person characteristics can be determined ( S245). Thereby, the group characteristic which is the characteristic of the group which a several person forms can be acquired as 1st attribute information. Since the content of the first attribute information can be enriched, it is possible to appropriately determine the degree of matching of the template image with the first image.

  Specific examples of the present invention have been described in detail above, but these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and changes of the specific examples illustrated above. For example, the following modifications are included.

<Modification>
In S <b> 135 and S <b> 160, there may be various methods for determining the degree of matching with respect to the selection target image data for each of the plurality of template image data. For example, in FIG. 9, the first attribute information A11 and the second attribute information A2 are compared with the second attribute information A2 when comparing the first attribute information A11 and the second attribute information A2 in order to determine the degree of matching of the template image data D2 with the target image data D1. A similarity ratio with the attribute information A2 may be calculated as a percentage. There are various methods for calculating the similarity ratio. For example, the existence ratio of similar keywords may be calculated. A known algorithm may be used.

  The target image is not limited to a photograph. It may be an image such as a picture or a character string. When the target image is an image of a picture or character string, the date / time information may be information indicating the creation date / time of the picture or character string. When the target image is an image of a picture or character string, the position information may be information indicating the latitude and longitude of a place related to the picture or character string. For example, when the target image is a landscape image, the position information may be information indicating the place where the image is drawn.

  In S140 and S165, the form in which the thumbnail image of the template image data is preferentially displayed may be various. For example, the thumbnail image displayed preferentially may have a larger display area on the panel 18. Further, for example, the thumbnail images that are displayed preferentially may be highlighted (for example, the color is displayed darker, the frame is displayed thicker, etc.).

  In S140 and S165, the image displayed on the panel 18 is not limited to a thumbnail image. A character string indicating each of a plurality of template image data (for example, a name of the template image, a keyword indicating the content of the template image, etc.) may be displayed.

  The template image is not limited to the form including one image composition area, and may include two or more image composition areas. For example, if the template image includes N (N is a natural number of 2 or more) image composition areas, the selection of N target images may be accepted in S115.

  The template image data and the target image data are not limited to the form stored in the storage unit 12, the storage unit 53, the storage unit 61, and the like. Template image data and target image data may be generated by a scanning process in the MFP 52.

  The process of narrowing down the template image can be omitted. In this case, S145 to S165 can be omitted. The process of acquiring the person characteristic and the group characteristic as the first attribute information can be omitted. In this case, S210 to S245 can be omitted. As described above, generally speaking, the image editing application 30 includes a “first image data acquisition unit”, a “first attribute information acquisition unit”, a “first determination unit”, a “display control unit”, It is sufficient that at least the “combining means” is provided. As a specific example, the image editing application 30 may execute at least S117 or S130, S120 or S147 or S155, S135 or S160, S140 or S165, and S175.

  In the present embodiment, the case where the CPU 11 of the information processing apparatus 10 executes processing according to software has been described, but the present invention is not limited to this form. At least a part of the functions realized according to the software may be realized by hardware such as a logic circuit.

  The panel 18 is an example of a display unit. The CPU 11 is an example of a processor. The information processing apparatus 10 is an example of an information processing apparatus. The image editing application 30 is an example of a program. The target image is an example of a first image. The target image data is an example of first image data. The CPU that executes S117 and S130 is an example of a first image data acquisition unit. The CPU that executes S120, S147, and S155 is an example of a first attribute information acquisition unit. The template image data is an example of second image data. The CPU that executes S135 and S160 is an example of a first determination unit. The CPU that executes S140 and S165 is an example of a display control unit. The CPU that executes S175 is an example of a combining unit. The attention area and the trimming area are examples of predetermined areas. The CPU that executes S145 and S150 is an example of a reception unit. The CPU that executes S210 to S225 is an example of a second determination unit.

  DESCRIPTION OF SYMBOLS 10 Information processing apparatus, 11: CPU, 18: Panel, 30: Image editing application, 60: Server, P1: Target image, P2 and P3: Template image, A11: First attribute information, A2 and A3: Second attribute information

Claims (13)

A program that is read into an information processing device including a display unit and a processor,
First image data acquisition means for acquiring first image data indicating the first image;
First attribute information acquisition means for acquiring first attribute information indicating a plurality of attributes relating to the first image data;
Second image data for displaying a second image that is an image that can be combined with the first image represented by the first image data , the second attribute indicating a plurality of attributes relating to the second image data A specifying means for specifying a plurality of the second image data containing information ;
First determination means for determining the degree of conformity to the first image data for each of the plurality of specified second image data based on the first attribute information acquired by the first attribute information acquisition means . The second image data including more second attribute information related to the first attribute information acquired by the first attribute information acquisition means is determined to have a higher degree of conformity to the first image data. 1 judgment means ,
Display control means for preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined by the first determination means;
The first image acquired by the first image data acquiring unit is selected as the selected second image in response to any one of the second images displayed by the display control unit being selected as the selected second image. Combining means for combining the first image represented by the image data;
A person having the characteristics of a person image included in the first image represented by the first image data by performing a face recognition process on the first image data acquired by the first image data acquisition unit. A second determination unit configured to determine characteristics, wherein when the first image includes a plurality of person images, the person characteristics are determined for each of the plurality of person images, and the plurality of person characteristics determined Determining a group characteristic that is a characteristic of a group formed by a plurality of person images by determining a relationship between the second determination unit,
The program causes the processor to function ,
The first attribute information acquisition unit acquires group characteristic information, which is information indicating the group characteristic determined by the second determination unit, as the first attribute information,
The first determining means determines that second image data including a group characteristic associated with the group characteristic information as second attribute information matches the first image data . A program that is read into an information processing device including a display unit and a processor,
First image data acquisition means for acquiring first image data indicating the first image;
1st attribute information acquisition means which acquires the 1st attribute information which shows a plurality of attributes about the 1st image data, Comprising: The acquisition path which shows the acquisition course where the 1st image data acquisition means acquired the 1st image data The first attribute information acquisition means for acquiring information as the first attribute information ;
Second image data for displaying a second image that is an image that can be combined with the first image represented by the first image data , the second attribute indicating a plurality of attributes relating to the second image data A specifying means for specifying a plurality of the second image data containing information ;
First determination means for determining the degree of conformity to the first image data for each of the plurality of specified second image data based on the first attribute information acquired by the first attribute information acquisition means . The first image data that is determined to have a higher degree of conformity to the first image data as the second image data includes more second attribute information related to the first attribute information acquired by the first attribute information acquisition unit. A first judging means for judging that the second image data including the acquisition route related to the acquisition route information as the second attribute information is suitable for the first image data ;
Display control means for preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined by the first determination means;
The first image acquired by the first image data acquiring unit is selected as the selected second image in response to any one of the second images displayed by the display control unit being selected as the selected second image. Combining means for combining the first image represented by the image data;
A program for causing the processor to function. After the display control means displays the second image, the program further causes the processor to function as accepting means for accepting designation of a predetermined area in the first image indicated by the first image data,
The first attribute information acquisition unit acquires first attribute information indicating a plurality of attributes based on a predetermined image included in the predetermined area specified by the reception unit,
The first determination means determines the degree of conformity based on first attribute information acquired based on the first image data and first attribute information acquired based on the predetermined image. The program according to claim 1 or 2. The first attribute information acquisition unit acquires date and time information indicating a generation date and time of the first image data as the first attribute information,
The said 1st judgment means judges that the 2nd image data which contains the date and time relevant to the said date and time information as 2nd attribute information matches with the said 1st image data . The program according to any one of the above items . The first image is a photographic image;
The first attribute information acquisition means acquires position information indicating a position where the photographic image represented by the first image data is taken as the first attribute information,
Wherein the first determination means, the second image data that contains the location associated with the location information as the second attribute information, claims 1-4 in which and determines that conforms to the first image data The program according to any one of the above items. After the display control means displays the second image, the program further causes the processor to function as accepting means for accepting designation of a predetermined area in the first image indicated by the first image data,
The first attribute information acquisition means acquires size information indicating the size of the predetermined area as the first attribute information,
The first determination means determines that the second image data having an image composition area having a size approximate to the size information matches the first image data,
Wherein said image combining region, a program according to any one of claims 1 to 5, an area for synthesizing the first image a region included in the second image data, characterized in that . Wherein the display control unit, as the high degree compatible it is determined by the first determining means second image, any one of claims 1-6, characterized in that to speed up display order for displaying on the display unit 1 The program described in the section. The display control unit increases the display area of the second image displayed on the display unit as the second image having a higher degree of matching determined by the first determination unit. 6. The program according to any one of 6 . Wherein the display control unit, the higher the second image is high degree compatible it is determined by the first determining means, according to claim 1-6, characterized in that to highlight the second image displayed on the display unit The program according to any one of the above items. An information processing apparatus comprising a display unit and a processor,
First image data acquisition means for acquiring first image data indicating the first image;
First attribute information acquisition means for acquiring first attribute information indicating a plurality of attributes relating to the first image data;
Second image data for displaying a second image that is an image that can be combined with the first image represented by the first image data , the second attribute indicating a plurality of attributes relating to the second image data A specifying means for specifying a plurality of the second image data containing information ;
First determination means for determining the degree of conformity to the first image data for each of the plurality of specified second image data based on the first attribute information acquired by the first attribute information acquisition means . The second image data including more second attribute information related to the first attribute information acquired by the first attribute information acquisition means is determined to have a higher degree of conformity to the first image data. 1 judgment means ,
Display control means for preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined by the first determination means;
The first image acquired by the first image data acquiring unit is selected as the selected second image in response to any one of the second images displayed by the display control unit being selected as the selected second image. Combining means for combining the first image represented by the image data;
A person having the characteristics of a person image included in the first image represented by the first image data by performing a face recognition process on the first image data acquired by the first image data acquisition unit. A second determination unit configured to determine characteristics, wherein when the first image includes a plurality of person images, the person characteristics are determined for each of the plurality of person images, and the plurality of person characteristics determined Determining a group characteristic that is a characteristic of a group formed by a plurality of person images by determining a relationship between the second determination unit and the second determination unit;
Equipped with a,
The first attribute information acquisition unit acquires group characteristic information, which is information indicating the group characteristic determined by the second determination unit, as the first attribute information,
The information processing apparatus according to claim 1, wherein the first determination unit determines that second image data including a group characteristic related to the group characteristic information as second attribute information matches the first image data . An information processing apparatus comprising a display unit and a processor,
First image data acquisition means for acquiring first image data indicating the first image;
1st attribute information acquisition means which acquires the 1st attribute information which shows a plurality of attributes about the 1st image data, Comprising: The acquisition path which shows the acquisition course where the 1st image data acquisition means acquired the 1st image data The first attribute information acquisition means for acquiring information as the first attribute information ;
Second image data for displaying a second image that is an image that can be combined with the first image represented by the first image data , the second attribute indicating a plurality of attributes relating to the second image data A specifying means for specifying a plurality of the second image data containing information ;
First determination means for determining the degree of conformity to the first image data for each of the plurality of specified second image data based on the first attribute information acquired by the first attribute information acquisition means . The first image data that is determined to have a higher degree of conformity to the first image data as the second image data includes more second attribute information related to the first attribute information acquired by the first attribute information acquisition unit. A first judging means for judging that the second image data including the acquisition route related to the acquisition route information as the second attribute information is suitable for the first image data ;
Display control means for preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined by the first determination means;
The first image acquired by the first image data acquiring unit is selected as the selected second image in response to any one of the second images displayed by the display control unit being selected as the selected second image. Combining means for combining the first image represented by the image data;
An information processing apparatus comprising: A method for controlling an information processing apparatus including a display unit and a processor,
A first image data acquisition step of acquiring first image data indicating a first image;
A first attribute information acquisition step of acquiring first attribute information indicating a plurality of attributes relating to the first image data;
Second image data for displaying a second image that is an image that can be combined with the first image represented by the first image data , the second attribute indicating a plurality of attributes relating to the second image data A specifying step of specifying a plurality of the second image data containing information ;
In a first determination step of determining, for each of the plurality of specified second image data, a degree of conformity to the first image data based on the first attribute information acquired in the first attribute information acquisition step . The second image data including more second attribute information related to the first attribute information acquired in the first attribute information acquisition step is determined to have a higher degree of conformity to the first image data. 1 judgment step ;
A display control step of preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined in the first determination step;
When any one of the second images displayed in the display control step is selected as the selected second image, the first image data acquired in the first image data acquiring step is added to the selected second image. A combining step of combining the first image represented by the image data;
A person having the characteristics of the person image included in the first image represented by the first image data by performing a face recognition process on the first image data acquired in the first image data acquisition step. A second determination step of determining characteristics, wherein when the first image includes a plurality of person images, the person characteristics are determined for each of the plurality of person images, and the determined plurality of person characteristics Determining a group characteristic that is a characteristic of a group formed by a plurality of person images by determining the relationship between the second determination step and the second determination step;
Equipped with a,
The first attribute information acquisition step acquires group characteristic information as information indicating the group characteristic determined by the second determination step as the first attribute information,
In the information processing apparatus, the first determination step determines that second image data including group characteristics related to the group characteristic information as second attribute information matches the first image data . Control method. A method for controlling an information processing apparatus including a display unit and a processor,
A first image data acquisition step of acquiring first image data indicating a first image;
A first attribute information acquisition step for acquiring first attribute information indicating a plurality of attributes relating to the first image data , wherein the first image data acquisition step indicates an acquisition path indicating the acquisition path of the first image data. The first attribute information acquisition step of acquiring information as the first attribute information ;
Second image data for displaying a second image that is an image that can be combined with the first image represented by the first image data , the second attribute indicating a plurality of attributes relating to the second image data A specifying step of specifying a plurality of the second image data containing information ;
In a first determination step of determining, for each of the plurality of specified second image data, a degree of conformity to the first image data based on the first attribute information acquired in the first attribute information acquisition step . The first image data is determined to have a higher degree of conformity to the first image data as the second image data includes more second attribute information related to the first attribute information acquired in the first attribute information acquisition step. A first determination step for determining that second image data including an acquisition route related to the acquisition route information as second attribute information is compatible with the first image data ;
A display control step of preferentially displaying the plurality of second images represented by the plurality of second image data on the display unit in preference to a second image having a higher degree of matching determined in the first determination step;
When any one of the second images displayed in the display control step is selected as the selected second image, the first image data acquired in the first image data acquiring step is added to the selected second image. A combining step of combining the first image represented by the image data;
An information processing apparatus control method comprising:

Images