JP6650364B2 - Image processing apparatus, image processing method, program, and recording medium - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, a program, and a recording medium that create a composite image using a plurality of images obtained from a plurality of users.

  Currently, a service is provided that acquires a plurality of images (image data) owned by a user via the Internet or the like and creates a photo album having a layout desired by the user using the plurality of images acquired from the user. I have.

  In recent years, in addition to creating a photo album using only a plurality of images owned by one user, one photo album is created using a plurality of images owned by a plurality of users (Patent Documents 1 and 2). 2) are known.

  Further, based on registration information of an image service using a network, an image group of a plurality of users belonging to the same group is extracted and used for a composite image (Patent Document 3), and messages from a plurality of participants are used. A method of accepting and creating a side note (Patent Document 4) and receiving an evaluation of a specific user with respect to an evaluation target, comparing the evaluation of the specific user with an evaluation standard of a general user, and identifying and specifying the evaluation criterion of the specific user A device that creates an evaluation target that is highly evaluated by a user (Patent Document 5) is known.

JP 2008-257308 A JP-A-2015-069431 JP-A-2015-069431 JP 2015-133000 A Japanese Patent No. 3177746

  However, when a plurality of users can simultaneously edit a layout when a plurality of users jointly create a composite image such as a photo album, if a plurality of users edit the layout at the same time, collection may become impossible. There is.

  For example, as the number of users who edit the layout increases, the layout is frequently changed, so that it becomes difficult to edit the layout. Further, when a plurality of users edit conflicting layouts, synchronization cannot be achieved. It is difficult to understand the goal of editing the final layout, and there is a problem that the burden on a secretary user who is a coordinator when creating a composite image such as a photo album among a plurality of users is large.

An object of the present invention is to provide an image processing apparatus and an image processing method capable of creating a composite image that can be satisfied by a large number of users by using a plurality of images obtained from a plurality of users without editing the layout by the user. , A program and a recording medium.

In order to achieve the above object, the present invention provides an image acquisition unit that acquires a plurality of images from a plurality of users,
An individual image analysis unit that analyzes each of the plurality of images,
An individual image evaluation value calculation unit that calculates an individual image evaluation value obtained by evaluating each image with respect to one or more individual image evaluation conditions based on an analysis result of each image;
An image extraction unit that extracts one or more images corresponding to one or more image extraction conditions from a plurality of images based on an individual image evaluation value of each image;
A composite image creation unit that creates a composite image obtained by combining one or more images based on one or more composite image creation conditions;
A composite image analysis unit that analyzes the composite image;
A composite image evaluation value calculation unit that calculates each of one or more composite image analysis evaluation values that evaluate the composite image for each of one or more composite image evaluation items based on the analysis result of the composite image;
A composite image user evaluation value acquisition unit configured to acquire one or more composite image user evaluation values obtained by evaluating the composite image for each of the one or more composite image evaluation items from a plurality of users;
For each composite image evaluation item, a composite image user evaluation value calculation unit that calculates a composite image user evaluation total value based on composite image user evaluation values from a plurality of users;
For each composite image evaluation item, when the difference between the composite image user evaluation total value and the composite image analysis evaluation value is larger than the threshold, the individual image is calculated so that the composite image analysis evaluation value approaches the composite image user evaluation total value. A synthesizing condition changing unit that creates a changing condition in which at least one of the evaluation condition, the image extraction condition, and the synthesized image creating condition is changed according to the difference;
The combined image creating unit provides an image processing device that re-creates a combined image based on the change condition created by the combining condition changing unit.

  Here, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, the combining condition changing unit may reduce the combined image analysis evaluation value according to the combined image user evaluation total value. Or, when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the individual image evaluation condition, such that the combined image analysis evaluation value increases according to the combined image user evaluation total value. It is preferable to create a change condition by changing at least one of the image extraction condition and the composite image creation condition.

The composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for the number of images used in the composite image,
The combining condition changing unit is configured such that, when the combined image user evaluation total value is larger than the threshold value for the combined image analysis evaluation value, the combined image analysis evaluation value is reduced according to the combined image user evaluation total value, or A template used to create a composite image so that when the composite image user evaluation total value is smaller than the threshold value for the composite image analysis evaluation value, the composite image analysis evaluation value increases in accordance with the composite image user evaluation total value. Change the number of placed images in,
It is preferable that the composite image creating unit re-creates the composite image using the template whose number of arranged images has been changed by the combining condition changing unit.

Further, the composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for the number of human images used in the composite image,
The combining condition changing unit is configured such that, when the combined image user evaluation total value is larger than the threshold value for the combined image analysis evaluation value, the combined image analysis evaluation value is reduced according to the combined image user evaluation total value, or When the composite image user evaluation total value is smaller than the threshold value for the composite image analysis evaluation value, one or more of the plurality of images are set so that the composite image analysis evaluation value increases in accordance with the composite image user evaluation total value. Change the weight of the person image when extracting the image of
It is preferable that the composite image creation unit re-creates a composite image using one or more images extracted from the plurality of images according to the weight of the person image changed by the synthesis condition change unit.

The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for the atmosphere of the composite image,
The combining condition changing unit is configured such that, when the combined image user evaluation total value is larger than the threshold value for the combined image analysis evaluation value, the combined image analysis evaluation value is reduced according to the combined image user evaluation total value, or A template used to create a composite image so that when the composite image user evaluation total value is smaller than the threshold value for the composite image analysis evaluation value, the composite image analysis evaluation value increases in accordance with the composite image user evaluation total value. Change the background image of
It is preferable that the composite image creation unit re-creates the composite image using the template whose background image has been changed by the synthesis condition changing unit.

  Further, it is preferable that the composite image user evaluation value calculation unit calculates the sum, average, or product of the composite image user evaluation values from a plurality of users as the composite image user evaluation total value.

Further, a weight calculation unit that calculates the weight of each of the plurality of users,
The composite image user evaluation value calculation unit preferably calculates, as the composite image user evaluation total value, the sum, average, or product of the composite image user evaluation values from a plurality of users weighted according to the weight of each user. .

In addition, a personal information acquisition unit that acquires personal information of each user is provided,
It is preferable that the weight calculator calculates the weight of each of the plurality of users based on the personal information of each user.

  In addition, it is preferable that the weight calculation unit calculates the weight of each of the plurality of users so that the weight of the user from which more images have been obtained by the image obtaining unit becomes heavier.

  The weight calculation unit may calculate the weight of each of the plurality of users such that the weight of the user whose composite image user evaluation value is acquired earlier by the composite image user evaluation value acquisition unit is heavier. preferable.

A combining condition storage unit that stores a plurality of changing conditions obtained by changing at least one of the individual image evaluation condition, the image extracting condition, and the combined image creating condition according to the difference;
A combining condition selecting unit that selects one changing condition corresponding to a combined image evaluation item having a difference greater than the threshold from a plurality of changing conditions stored in the combining condition storage unit;
It is preferable that the composite image creation unit re-creates the composite image based on the change condition selected by the combination condition selection unit.

A synthesizing condition storage unit for storing a plurality of changing conditions obtained by changing at least one of the individual image evaluation condition, the image extracting condition, and the synthesized image creating condition according to the difference;
It is preferable that the composite image creation unit re-creates a composite image based on one change condition selected by each of the plurality of users from the plurality of change conditions stored in the synthesis condition storage unit.

The combining condition changing unit creates two or more changing conditions in which at least one of the individual image evaluation condition, the image extraction condition, and the combined image creating condition is changed according to the difference.
The composite image creation unit re-creates two or more composite images based on the two or more change conditions created by the synthesis condition change unit,
A composite image selection number acquisition unit that acquires the number of each of the two or more composite images selected by a plurality of users for two or more composite images;
It is preferable to include a composite image information acquisition unit that acquires information of a selected composite image having the largest number selected by a plurality of users from two or more composite images.

Further, the composite image user evaluation value calculation unit further calculates a standard deviation of the composite image user evaluation values from a plurality of users,
The combining condition changing unit creates two or more changing conditions in which at least one of the individual image evaluation condition, the image extraction condition, and the combined image creating condition is changed according to the difference and the standard deviation,
The composite image creation unit re-creates two or more composite images based on the two or more change conditions created by the synthesis condition change unit,
A composite image selection number acquisition unit that acquires the number of each of the two or more composite images selected by a plurality of users for two or more composite images;
It is preferable that the image processing apparatus further includes a composite image information acquisition unit that acquires information on a selected composite image having the largest number selected by a plurality of users from two or more composite images.

Further, the present invention, an image acquisition unit for acquiring a plurality of images from a plurality of users,
An individual image analysis unit that analyzes each of the plurality of images,
An individual image evaluation value calculation unit that calculates an individual image evaluation value obtained by evaluating each image with respect to one or more individual image evaluation conditions based on an analysis result of each image;
An image extraction unit that extracts one or more images corresponding to one or more image extraction conditions from a plurality of images based on an individual image evaluation value of each image;
A composite image creation unit that creates a composite image obtained by combining one or more images based on one or more composite image creation conditions;
A composite image user evaluation value acquisition unit configured to acquire one or more composite image user evaluation values obtained by evaluating the composite image for each of the one or more composite image evaluation items from a plurality of users;
For each composite image evaluation item, a composite image user evaluation value calculation unit that calculates the standard deviation of the composite image user evaluation values from a plurality of users,
For each composite image evaluation item, when the standard deviation is greater than a threshold, two or more change conditions that change at least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition according to the standard deviation. A synthesis condition changing unit for creating
Acquisition of the number of selected composite images for obtaining the number of each of the two or more composite images selected by a plurality of users for two or more composite images recreated based on two or more change conditions by the composite image creation unit Department and
Provided is an image processing apparatus including a composite image information acquisition unit that acquires information of a selected composite image having the largest number selected by a plurality of users from two or more composite images.

Here, the composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for the number of images used in the composite image,
When the standard deviation is larger than the threshold, the combining condition changing unit changes the number of arranged images in the template used to create the combined image according to the standard deviation,
It is preferable that the composite image creating unit re-creates the composite image using the template whose number of arranged images has been changed by the combining condition changing unit.

Further, the composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for the number of human images used in the composite image,
When the standard deviation is larger than the threshold, the synthesis condition changing unit changes the weight of the human image when extracting one or more images from the plurality of images according to the standard deviation,
It is preferable that the composite image creation unit re-creates a composite image using one or more images extracted from the plurality of images according to the weight of the person image changed by the synthesis condition change unit.

The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for the atmosphere of the composite image,
The synthesis condition changing unit changes the background image of the template used to create the synthesized image according to the standard deviation when the standard deviation is larger than the threshold,
It is preferable that the composite image creation unit re-creates the composite image using the template whose background image has been changed by the synthesis condition changing unit.

A combining condition storage unit that stores a plurality of change conditions obtained by changing at least one of the individual image evaluation condition, the image extraction condition, and the combined image creation condition according to the standard deviation;
A combining condition selecting unit that selects two or more changing conditions corresponding to a combined image evaluation item whose standard deviation is larger than a threshold from a plurality of changing conditions stored in the combining condition storage unit;
It is preferable that the composite image creation unit re-creates the composite image based on the change condition selected by the combination condition selection unit.

A synthesis condition storage unit that stores a plurality of change conditions obtained by changing at least one of the individual image evaluation condition, the image extraction condition, and the synthesized image creation condition according to the standard deviation;
It is preferable that the composite image creation unit recreates a composite image based on two or more change conditions selected by each of the plurality of users from the plurality of change conditions stored in the synthesis condition storage unit.

Also, based on the analysis results of each image, an object detection unit that detects objects other than the person appearing in each image, and creates a list of objects that appear in a plurality of images,
An object number acquisition unit that acquires the number of each object selected by a plurality of users from a list of objects,
The synthesizing condition changing unit further includes an object for extracting one or more images from the plurality of images according to the number of each object selected by the plurality of users from the list of objects. Change the weight of the image
It is preferable that the composite image creation unit recreates a composite image using one or more images extracted from the plurality of images according to the weight of the object changed by the synthesis condition change unit.

A composite image evaluation item storage unit that stores one or more composite image evaluation items;
It is preferable that the composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for each of one or more composite image evaluation items stored in the composite image evaluation item storage unit.

A composite image evaluation item storage unit that stores one or more composite image evaluation items;
The composite image user evaluation value acquisition unit is configured to evaluate the composite image for the composite image evaluation item selected by each of the plurality of users from one or more composite image evaluation items stored in the composite image evaluation item storage unit. Preferably, a user evaluation value is obtained.

  In addition, when the composite image analysis evaluation value exceeds the threshold, the composite image evaluation value calculation unit evaluates the composite image for the composite image evaluation item exceeding the threshold by at least one of the plurality of users. It is preferable to recommend to users.

The image processing apparatus further includes a composite image evaluation item creating unit that creates a composite image evaluation item for an object whose appearance frequency in the composite image is greater than a threshold from one or more objects based on the individual image evaluation value of each image. ,
The composite image user evaluation value acquisition unit preferably acquires a composite image user evaluation value obtained by evaluating the composite image for the composite image evaluation item created by the composite image evaluation item creation unit.

A composite image information storage unit that stores information on the selected composite image;
The combining condition changing unit is configured to use the individual combined image information stored in the combined image information storage unit so as to match the tendency of a plurality of users to select a combined image to be used for creating the next combined image. It is preferable to change at least one of the image evaluation condition, the image extraction condition, and the composite image creation condition.

In addition, for each composite image evaluation item, a composite image user evaluation value storage unit that stores an average of composite image user evaluation values from a plurality of users,
The composite image creation unit is configured to generate, for each composite image evaluation item, an individual image so that the composite image analysis evaluation value approaches the average of the composite image user evaluation values from a plurality of users stored in the composite image user evaluation value storage unit. It is preferable to create the next composite image under the condition that at least one of the evaluation condition, the image extraction condition, and the composite image creation condition is determined.

Further, according to the present invention, the image acquisition unit acquires a plurality of images from a plurality of users,
An individual image analysis unit for analyzing each of the plurality of images;
An individual image evaluation value calculating unit that calculates an individual image evaluation value that evaluates each image with respect to one or more individual image evaluation conditions based on an analysis result of each image;
An image extracting unit for extracting one or more images corresponding to one or more image extraction conditions from the plurality of images based on an individual image evaluation value of each image;
A step in which the combined image creating unit creates a combined image obtained by combining one or more images based on one or more combined image creation conditions;
A composite image analysis unit for analyzing the composite image;
A step in which the composite image evaluation value calculation unit calculates each of one or more composite image analysis evaluation values obtained by evaluating the composite image for each of the one or more composite image evaluation items based on the analysis result of the composite image;
A step in which the synthesized image user evaluation value obtaining unit obtains, from the plurality of users, each of one or more synthesized image user evaluation values obtained by evaluating the synthesized image for each of the one or more synthesized image evaluation items;
A step of calculating a combined image user evaluation value based on the combined image user evaluation values from a plurality of users, for each combined image evaluation item,
When the difference between the composite image user evaluation total value and the composite image analysis evaluation value is greater than the threshold for each composite image evaluation item, the composite condition changing unit sets the composite image analysis evaluation value to the composite image user evaluation total value. Creating a change condition in which at least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition is changed according to the difference,
A step of re-creating a composite image based on the change condition created by the step of creating the change condition.

Further, according to the present invention, the image acquisition unit acquires a plurality of images from a plurality of users,
An individual image analysis unit for analyzing each of the plurality of images;
An individual image evaluation value calculating unit that calculates an individual image evaluation value that evaluates each image with respect to one or more individual image evaluation conditions based on an analysis result of each image;
An image extracting unit for extracting one or more images corresponding to one or more image extraction conditions from the plurality of images based on an individual image evaluation value of each image;
A step in which the combined image creating unit creates a combined image obtained by combining one or more images based on one or more combined image creation conditions;
A step in which the synthesized image user evaluation value obtaining unit obtains, from the plurality of users, each of one or more synthesized image user evaluation values obtained by evaluating the synthesized image for each of the one or more synthesized image evaluation items;
A step of calculating a standard deviation of a composite image user evaluation value from a plurality of users for each composite image evaluation item,
For each composite image evaluation item, when the standard deviation is larger than the threshold, the composition condition changing unit changes at least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition according to the standard deviation. Creating two or more change conditions,
Each of the two or more composite images selected by the plurality of users is compared with the two or more composite images recreated based on the two or more change conditions by the composite image selection number acquiring unit in the step of creating the composite image. Obtaining the number of
A step of acquiring information on a selected composite image selected by a plurality of users from two or more composite images, the number being the largest among the two or more composite images.

  Further, the present invention provides a program for causing a computer to execute each step of the image processing method described above.

  The present invention also provides a computer-readable recording medium on which a program for causing a computer to execute each step of the image processing method described above is recorded.

  In the present invention, instead of a plurality of users directly editing a layout of a composite image created using a plurality of images obtained from a plurality of users, a composite image analysis evaluation value is calculated, and each user , The composite image user evaluation value is obtained from the data, the composite image user evaluation total value is calculated, and the composite image is re-created based on the difference between the composite image user evaluation total value and the composite image analysis evaluation value.

  As described above, according to the present invention, since the plurality of users do not directly edit the layout of the composite image, even when the number of users increases, the composite image is re-created, that is, the layout of the composite image is edited. can do. Further, since the image processing apparatus, not the user, re-creates the composite image, it is possible to create a composite image that can be satisfied by the majority of users on average without putting a large burden on the secretary user.

  Further, in the present invention, a composite image user evaluation value is obtained from each user, a standard deviation of a composite image user evaluation total value from a plurality of users is calculated, and two or more composite images are created based on the standard deviation. Do it again. Then, information on a selected combined image that is the largest number of combined images selected by a plurality of users from the two or more combined images is acquired, and the selected combined image is adopted from the two or more combined images.

  As described above, by re-creating the composite image based on the standard deviation, according to the present invention, even if the distribution of the composite image user evaluation values from a plurality of users varies, a large number of users Can generate a composite image that can be satisfied on average.

FIG. 1 is a block diagram illustrating an embodiment of an image processing apparatus according to the present invention. FIG. 2 is a block diagram of an embodiment illustrating a configuration of a server illustrated in FIG. 1. FIG. 2 is a block diagram of an embodiment showing a configuration of a user terminal device shown in FIG. 1. 3 is a flowchart of an embodiment showing an operation of the image processing apparatus shown in FIG. 1. It is a conceptual diagram of one embodiment showing the screen which evaluates a synthetic image about the number of images used in a synthetic image. It is a conceptual diagram of one Embodiment showing the screen which evaluates a synthetic image about the atmosphere of a synthetic image. 6 is a flowchart of another embodiment showing the operation of the image processing apparatus shown in FIG.

  Hereinafter, an image processing apparatus, an image processing method, a program, and a recording medium of the present invention will be described in detail based on preferred embodiments shown in the accompanying drawings.

  FIG. 1 is a block diagram of an embodiment showing a configuration of an image processing apparatus according to the present invention. The image processing apparatus 10 shown in FIG. 1 includes a server 12 and terminal devices (clients) 14 of a plurality of users connected to the server 12 via a network 16. The image processing device 10 creates a composite image such as a photo album by using a plurality of images of a plurality of users obtained from the terminal device 14 of each of the plurality of users via the network 16.

  The server 12 performs various data processing for creating a composite image based on an instruction from the terminal device 14, and is configured by, for example, a desktop PC (Personal Computer) or a workstation. .

  The terminal device 14 gives various instructions to the server 12 to perform various data processing, and is configured by, for example, a smartphone, a tablet PC, a notebook PC, or the like.

  The network 16 is, for example, a telephone line or an Internet line, and interconnects the server 12 and the terminal device 14 by wire or wirelessly, and is capable of two-way communication.

  FIG. 2 is a block diagram of one embodiment showing the configuration of the server shown in FIG. The server 12 shown in the figure includes an image acquisition unit 18, an individual image analysis unit 20, an individual image evaluation value calculation unit 22, an image extraction unit 24, a composite image creation unit 26, a composite image analysis unit 28, A combined image evaluation value calculation unit 30, a combined image user evaluation value acquisition unit 32, a combined image user evaluation value calculation unit 34, a combination condition change unit 36, a personal information acquisition unit 38, a weight calculation unit 40, The condition storage unit 42, the combination condition selection unit 44, the combination image selection number acquisition unit 46, the combination image information acquisition unit 48, the combination image information storage unit 50, the object detection unit 52, and the object number acquisition unit 54 , A composite image evaluation item storage unit 56, a composite image evaluation item creation unit 58, and a composite image user evaluation value storage unit 59.

  In the server 12, the image acquisition unit 18 acquires a plurality of images from the terminal devices 14 of a plurality of users via the network 16.

  Subsequently, the individual image analysis unit 20 analyzes each of the plurality of images acquired by the image acquisition unit 18.

  The individual image analysis unit 20 analyzes, for example, image quality such as image brightness, color tone, blur and blur, and image size analysis, as well as Exif (Exchangeable Image File Format). Format), analysis of the shooting date and time, shooting location, etc. included in the supplementary information of the image, analysis of the person and other objects in the image, face recognition of the person in the image, identification of the hero and important persons And analysis of image scenes.

  Subsequently, the individual image evaluation value calculation unit 22 calculates an individual image evaluation value that evaluates each image under one or more individual image evaluation conditions based on the analysis result of each image by the individual image analysis unit 20.

  The individual image evaluation conditions are conditions for evaluating each image, and include the image quality of the image, that is, the brightness, hue, blur, blur degree of the image, and the like. The individual image evaluation value calculation unit 22 calculates, for example, an individual image evaluation value obtained by evaluating the combined image for the degree of blur and blur of the image based on the analysis result of the degree of blur and blur of the image. For example, the calculation is performed such that the smaller the degree of blur and blur of the image, the higher the individual image evaluation value of the degree of blur and blur of the image.

  Subsequently, based on the individual image evaluation value of each image calculated by the individual image evaluation value calculation unit 22, the image extraction unit 24 selects one or more images corresponding to one or more image extraction conditions from the plurality of images. Extract the image. Note that extracting all of the plurality of images is also included in the image extraction.

  The image extraction condition is a condition for extracting one or more images from a plurality of images, and includes image quality, that is, brightness, hue, degree of blur and blur of the image, and the like. The image extracting unit 24 may, for example, select one or more images from among a plurality of images whose individual image evaluation values of the degree of blur and blur are higher than the threshold based on the individual image evaluation values of the degree of blur and blur of the image. Is extracted.

Subsequently, the composite image creation unit 26 creates a composite image in which one or more images extracted by the image extraction unit 24 are combined based on one or more composite image creation conditions.
Further, the composite image creation unit 26 re-creates a composite image based on at least one of a change condition created by a synthesis condition change unit 36 described later and a change condition selected by the synthesis condition selection unit 44. .

  The composite image creation condition is a condition for creating a composite image, and includes, for example, the number of images used in the composite image, the number of person images used in the composite image, and objects other than the person appearing in the image used in the composite image. , And a template used in the composite image.

  In the template, the number of images used in the composite image, the arrangement position of the images, the background image, and the like are determined in advance. For example, when a composite image is created using five images, the composite image can be created by arranging the five images at predetermined positions of the template. Also, by changing the background image of the template, the atmosphere of the composite image can be changed.

  The composite image creating unit 26 creates, for example, a composite image obtained by arranging one or more images in a template, and a postcard with an image obtained by combining one image. Further, the composite image creation unit 26 can create a composite image in which not only an image but also a stamp, a user comment, and the like are combined.

  Subsequently, the composite image analysis unit 28 analyzes the composite image created by the composite image creation unit 26.

The composite image analysis unit 28 includes, for example, the number of images used in the composite image, the number of person images used in the composite image, objects other than the person appearing in the image used in the composite image, and the composite Analyze the atmosphere of the image.
Further, as the atmosphere of the composite image, various atmospheres can be assumed, for example, whether the atmosphere is bright or dark, or the atmosphere is pop or chic.

  Subsequently, the composite image evaluation value calculation unit 30 evaluates the composite image for one or more composite image evaluation items based on the analysis result of the composite image by the composite image analysis unit 28. Is calculated.

The composite image evaluation items include, for example, the number of images used in the composite image, the number of person images used in the composite image, the atmosphere of the composite image, and a person other than the person appearing in the image used in the composite image. And the like of the object.
For example, if the composite image evaluation item is the number of images used in the composite image, and the result of image analysis of the composite image indicates that the number of images used in the composite image is 5, this corresponds to 5 images. Is calculated.

  Subsequently, the composite image user evaluation value acquisition unit 32 evaluates the composite image for each of the one or more composite image evaluation items from the plurality of user terminal devices 14 via the network 16. Get each of the values.

For example, when the composite image evaluation item is the number of images used in the composite image, the user can select “too little”, “small”, “just right”, “large”, or “ To evaluate if it is too much. The evaluation may be at least two stages.
When the composite image analysis evaluation value of the number of images used in the composite image is five and it is evaluated that the number of images is large, a composite image user evaluation value corresponding to the large number of images is obtained.

Subsequently, the composite image user evaluation value calculation unit 34 calculates a composite image user evaluation value for each composite image evaluation item based on the composite image user evaluation values from a plurality of users acquired by the composite image user evaluation value acquisition unit 32. Calculate the total value.
The composite image user evaluation value calculation unit 34 calculates the standard deviation of the composite image user evaluation values from a plurality of users for each composite image evaluation item.

  The composite image user evaluation total value is a total value of composite image user evaluation values from a plurality of users, and is, for example, a sum, an average, or a product of composite image user evaluation values from a plurality of users. The composite image user evaluation total value may be the sum, average, or product of composite image user evaluation values from a plurality of users weighted according to the weight of each user calculated by the weight calculation unit 40 described later.

  Subsequently, the synthesizing condition changing unit 36 calculates the synthesized image user evaluation total value calculated by the synthesized image user evaluation value calculating unit 34 and the synthesized image calculated by the synthesized image evaluation value calculating unit 30 for each synthesized image evaluation item. When the difference from the image analysis evaluation value is larger than a threshold value (including the case where the threshold value is 0), the individual image evaluation condition, the image extraction condition, and the A change condition is created by changing at least one of the synthetic image creation conditions according to a difference between the synthetic image user evaluation total value and the synthetic image analysis evaluation value.

  When the standard deviation calculated by the synthesized image user evaluation value calculation unit 34 is larger than the threshold for each synthesized image evaluation item, the synthesis condition changing unit 36 sets the individual image evaluation condition, the image extraction condition, and the synthesized image At least one of the creation conditions is changed according to the standard deviation, and two or more change conditions are created.

  The change condition created by the combining condition changing unit 36 is used when the combined image creating unit 26 creates a combined image again.

  Subsequently, the personal information acquisition unit 38 acquires personal information of each user from the terminal device 14 of each of the plurality of users via the network 16.

The personal information is, for example, personal information of each user including information such as the name, age, face image, and hobby of the user. When the weight calculating unit 40 described later calculates the weight of each user, used.
The personal information acquisition unit 38 may acquire, for example, registration information in the SNS (Social Networking Service: social network system) of the user of the terminal device 14 from which the image acquisition unit 18 has acquired each image as the personal information.

  Subsequently, the weight calculator 40 calculates the weight of each of the plurality of users.

  The weight calculation unit 40 can calculate the weight of each of the plurality of users based on the personal information of each user acquired by the personal information acquisition unit 38, for example. For example, based on personal information, if the hobby of user A is a photograph and the hobby of user B is not a photo, that is, if user A is considered to have more detailed knowledge of a photo than user B, The weight of A is made heavier than the weight of user B.

In addition, the weight calculation unit 40 can calculate the weight of each of the plurality of users such that the weight of the user from which more images have been obtained by the image obtaining unit 18 becomes heavier.
Further, the weight calculation unit 40 calculates the weight of each of the plurality of users such that the weight of the user whose composite image user evaluation value is acquired at an earlier timing by the composite image user evaluation value acquisition unit 32 becomes heavier. be able to.

  As described above, when calculating the sum, average, or product of the composite image evaluation values from a plurality of users weighted according to the weight of each user as the composite image user evaluation total value, as described above. Used for

Subsequently, the combination condition storage unit 42 changes at least one of the individual image evaluation condition, the image extraction condition, and the combination image creation condition according to the difference between the combined image user evaluation total value and the combined image analysis evaluation value. The plurality of changed conditions are stored.
Further, the synthesis condition storage unit 42 stores a plurality of change conditions in which at least one of the individual image evaluation condition, the image extraction condition, and the synthesized image creation condition is changed according to the standard deviation.

  The change condition stored in the combination condition storage unit 42 is used as a condition when the combined image creation unit 26 creates a combined image again.

Subsequently, the synthesizing condition selecting unit 44 selects, from the plurality of changing conditions stored in the synthesizing condition storage unit 42, the synthesized image evaluation result in which the difference between the synthesized image user evaluation total value and the synthesized image analysis evaluation value is larger than the threshold. Select one change condition corresponding to the item.
In addition, the combining condition selecting unit 44 selects two or more changing conditions corresponding to the combined image evaluation items whose standard deviation is larger than the threshold from the plurality of changing conditions stored in the combining condition storage unit 42.

  The change condition selected by the combination condition selection unit 44 is used when the combined image creation unit 26 creates a combined image again.

  Subsequently, the composite image selection number acquiring unit 46 outputs information on the composite image selected by each user to the two or more composite images recreated based on the two or more change conditions by the composite image creation unit 26. , The number of each of two or more composite images selected by a plurality of users is obtained.

  Subsequently, based on the number of each of the two or more synthesized images selected by the plurality of users, the synthesized image information obtaining unit 48 obtains 2 The information of the selected composite image that is the composite image selected by the plurality of users from the two or more composite images recreated based on the above change conditions is acquired.

  Subsequently, the composite image information storage unit 50 stores the information of the selected composite image acquired by the composite image information acquisition unit 48.

  The information of the selected synthesized image stored in the synthesized image information storage unit 50 is used by the synthesizing condition changing unit 36 to generate the individual synthesized image used for creating the next synthesized image so as to match the tendency of a plurality of users to select the synthesized image. It is used to change at least one of the image evaluation condition, the image extraction condition, and the composite image creation condition.

  Subsequently, based on the analysis result of each image, the object detection unit 52 detects objects other than the person appearing in each image, and creates a list of objects appearing in a plurality of images.

  Subsequently, the object number acquiring unit 54 determines, for each object selected by a plurality of users, from the list of objects created by the object detecting unit 52, based on information on the object selected by each user. Get the number.

  The number of objects acquired by the number-of-objects acquiring unit 54 is determined by the combination condition changing unit 36 when changing the weight of an image in which each object appears when extracting one or more images from a plurality of images. Used for

  Subsequently, the composite image evaluation item storage unit 56 stores one or more composite image evaluation items.

  One or more composite image evaluation items stored in the composite image evaluation item storage unit 56 are used as composite image evaluation items when the composite image user evaluation value acquisition unit 32 acquires a composite image user evaluation value.

  Subsequently, based on the individual image evaluation value of each image, the composite image evaluation item creation unit 58 selects, from the one or more objects, a composite image evaluation item for an object whose appearance frequency in the composite image is greater than the threshold. create.

  The composite image evaluation item created by the composite image evaluation item creation unit 58 is used as a composite image evaluation item when the composite image user evaluation value acquisition unit 32 acquires a composite image user evaluation value.

  Finally, the composite image user evaluation value storage unit 59 stores the composite image user evaluation values from the plurality of users calculated by the composite image user evaluation value calculation unit 34 as the composite image user evaluation total value for each composite image evaluation item. Store the average of the values.

  The average of the composite image user evaluation values from a plurality of users stored in the composite image user evaluation value storage unit 59 is determined by the individual image evaluation condition and the image extraction condition when the composite image creation unit 26 creates the next composite image. And at least one of the composite image creation conditions.

  Image acquisition unit 18, individual image analysis unit 20, individual image evaluation value calculation unit 22, image extraction unit 24, composite image creation unit 26, composite image analysis unit 28, composite image evaluation value calculation unit 30, acquisition of composite image user evaluation value Unit 32, composite image user evaluation value calculation unit 34, composition condition changing unit 36, personal information acquisition unit 38, weight calculation unit 40, composition condition storage unit 42, composition condition selection unit 44, composition image selection number acquisition unit 46, composition The image information acquisition unit 48, the composite image information storage unit 50, the object detection unit 52, the number of objects acquisition unit 54, the composite image evaluation item storage unit 56, the composite image evaluation item creation unit 58, and the composite image user evaluation value storage unit 59 For example, it is realized by a control device such as a CPU (Central Processing Unit) executing a program loaded in the memory. The data stored by each part is stored in a storage device such as a hard disk drive (HDD), a solid state drive (SSD), and a secure digital (SD) card. Is done.

  Next, FIG. 3 is a block diagram of one embodiment showing the configuration of the user terminal device shown in FIG. The user terminal device 14 shown in FIG. 1 includes an image display unit 60 and an instruction input unit 62.

  In the terminal device 14, the image display unit 60 displays various images, a setting screen, a selection screen, a confirmation screen, an input screen, a creation screen, and the like, and includes, for example, a display device such as a liquid crystal display.

  Subsequently, the instruction input unit 62 acquires various setting instructions, selection instructions, confirmation instructions, input instructions, creation instructions, and the like input by the user, and includes, for example, input devices such as a keyboard and a mouse. You.

  In the case of the present embodiment, the image display unit 60 and the instruction input unit 62 are configured by a device in which a display device and an input device are integrated, such as a touch panel.

  Although not shown, the server 12 and the terminal device 14 include, for example, a transmitting and receiving unit such as a communication device for transmitting and receiving various data between the server 12 and the terminal device 14, a CPU for controlling the operation of each unit, and the like. And the like.

  Next, the operation of the image processing apparatus 10 when re-creating a composite image based on the difference between the composite image user evaluation total value and the composite image analysis evaluation value will be described with reference to the flowchart shown in FIG.

  First, the image acquisition unit 18 acquires a plurality of images from the terminal devices 14 of a plurality of users via the network 16 (step S1).

  Subsequently, each of the plurality of images acquired by the image acquiring unit 18 is analyzed by the individual image analyzing unit 20 (Step S2).

  Subsequently, the individual image evaluation value calculating unit 22 calculates an individual image evaluation value obtained by evaluating each image under one or more individual image evaluation conditions based on the analysis result of each image (step S3).

  Subsequently, the image extraction unit 24 extracts one or more images corresponding to one or more image extraction conditions from the plurality of images based on the individual image evaluation values of each image (Step S4).

  Subsequently, the combined image creating unit 26 creates a combined image in which one or more images extracted by the image extracting unit 24 are combined based on one or more combined image creation conditions (step S5).

  Subsequently, the composite image created by the composite image creation unit 26 is sent to the terminal device 14 of each user via the network 16 and displayed on the image display unit 60.

  Each user refers to the composite image displayed on the image display unit 60 of the terminal device 14 of each user, and evaluates the composite image for each composite image evaluation item via the instruction input unit 62.

  On the other hand, in the server 12, the combined image created by the combined image creation unit 26 is analyzed by the combined image analysis unit 28 (step S6).

  Subsequently, the composite image evaluation value calculating unit 30 calculates one or more composite image analysis evaluation values obtained by evaluating the composite image for each of the one or more composite image evaluation items based on the analysis result of the composite image. (Step S7).

  When the evaluation of the synthesized image by the user is completed, the synthesized image user evaluation value acquiring unit 32 evaluates the synthesized image for each of one or more synthesized image evaluation items from the terminal devices 14 of a plurality of users via the network 16. Each of one or more composite image user evaluation values is obtained (step S8).

  If the user does not obtain an evaluation of the composite image for the specific composite image evaluation item, for example, the evaluation of the composite image for the composite image evaluation item may be ignored, or “just right”. May be considered as an evaluation.

  Subsequently, the composite image user evaluation value calculation unit 34 calculates a composite image user evaluation total value for each composite image evaluation item based on the composite image user evaluation values from a plurality of users (step S9).

  Subsequently, the combining condition changing unit 36 checks whether or not the difference between the combined image user evaluation total value and the combined image analysis evaluation value is greater than a threshold value for each combined image evaluation item (step S10).

  As a result, when the difference between the composite image user evaluation total value and the composite image analysis evaluation value is larger than the threshold value (Yes in step S10), the individual image evaluation condition, the image extraction condition, and the composite image A change condition is created in which at least one of the creation conditions is changed according to the difference between the composite image user evaluation total value and the composite image analysis evaluation value (step S11).

  For example, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, the combining condition changing unit 36 reduces the combined image analysis evaluation value according to the combined image user evaluation total value. Or, when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the individual image evaluation condition, such that the combined image analysis evaluation value increases according to the combined image user evaluation total value. A change condition is created by changing at least one of the image extraction condition and the composite image creation condition.

  On the other hand, if the difference between the composite image user evaluation total value and the composite image analysis evaluation value is equal to or smaller than the threshold (No in step S10), the composite image user evaluation total value and the composite image analysis evaluation It is confirmed whether the confirmation as to whether the difference from the value is larger than the threshold value has been completed or not (step S12).

  As a result, if the confirmation has not been completed for all the composite image evaluation items (No in step S11), it is confirmed whether the difference between the composite image user evaluation total value and the composite image analysis evaluation value is larger than a threshold value. Will continue.

On the other hand, when confirmation of all the composite image evaluation items is completed (Yes in step S11), the composite image is re-created by the composite image creation unit 26 based on the change condition created by the synthesis condition change unit 36 ( Step S13).
If the change condition has not been created by the synthesis condition changing unit 36, the synthesis image is not re-created.

  For example, when the composite image evaluation item is the number of images used in the composite image, each user uses the slider bar 64 to determine the number of images used in the composite image as shown in FIG. The composite image can be evaluated.

  In the case of the example of FIG. 5, from the left end to the right end of the slider bar 64, there are five levels of evaluations (evaluation values: "too little", "less", "just right", "too much", and "too much". ) Is arranged. Each user evaluates the number of images used in the composite image by moving the slider 66 left and right along the slider bar 64 and selecting one of five levels of evaluation.

  In this case, when the evaluation of the composite image by the user is completed, the composite image user evaluation value acquisition unit 32 obtains the number of images used in the composite image from the terminal devices 14 of a plurality of users via the network 16. Is obtained.

  Subsequently, the composite image user evaluation value calculation unit 34 calculates a composite image user evaluation total value based on composite image user evaluation values from a plurality of users for the number of images used in the composite image.

  Subsequently, the synthesizing condition changing unit 36 checks whether or not the difference between the synthesized image user evaluation total value and the synthesized image analysis evaluation value is larger than a threshold value for the number of images used in the synthesized image.

  As a result, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value by the combining condition changing unit 36, the combined image analysis evaluation value is reduced according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value is increased in accordance with the combined image user evaluation total value. The number of arranged images in the template to be used is changed.

  Then, the combined image creating unit 26 creates a combined image again using the template whose number of arranged images has been changed by the combining condition changing unit 36.

  When the composite image evaluation item is the number of person images used in the composite image, similarly to the case of the example in FIG. 5, each user uses the slider bar to change the person used in the composite image. The composite image can be evaluated for the number of images.

  In this case, when the evaluation of the synthesized image by the user is completed, the synthesized image user evaluation value acquisition unit 32 synthesizes the number of person images used in the synthesized image from the terminal devices 14 of a plurality of users via the network 16. A composite image user evaluation value obtained by evaluating the image is obtained.

  Subsequently, the composite image user evaluation value calculation unit 34 calculates a composite image user evaluation total value based on the composite image user evaluation values from a plurality of users for the number of human images used in the composite image.

  Subsequently, the synthesizing condition changing unit 36 checks whether or not the difference between the synthetic image user evaluation total value and the synthetic image analysis evaluation value is greater than a threshold value for the number of human images used in the synthetic image.

  As a result, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value by the combining condition changing unit 36, the combined image analysis evaluation value is reduced according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, so that the combined image analysis evaluation value increases in accordance with the combined image user evaluation total value. The weight of the person image when one or more images are extracted from the image is changed.

  Then, the combined image creating unit 26 creates a combined image again using one or more images extracted from the plurality of images according to the weight of the human image changed by the combining condition changing unit 36.

  Similarly, when the composite image evaluation item is the atmosphere of the composite image, each user can evaluate the composite image for the atmosphere of the composite image using the slider bar as shown in FIG.

  In the case of the example of FIG. 6, five-level evaluations of “too dark”, “dark”, “just right”, “bright” and “too bright” are arranged from the left end to the right end of the slider bar 64. You. Similarly, each user evaluates the atmosphere of the composite image by moving the slider 66 left and right along the slider bar 64 and selecting one of the five levels of evaluation.

  In this case, when the evaluation of the composite image by the user is completed, the composite image user evaluation value acquiring unit 32 evaluates the composite image for the atmosphere of the composite image from the terminal devices 14 of a plurality of users via the network 16. A user evaluation value is obtained.

  Subsequently, the composite image user evaluation value calculation unit 34 calculates a composite image user evaluation total value for the atmosphere of the composite image based on the composite image user evaluation values from a plurality of users.

  Subsequently, the synthesizing condition changing unit 36 checks whether or not the difference between the synthetic image user evaluation total value and the synthetic image analysis evaluation value is larger than a threshold value for the atmosphere of the synthetic image.

  As a result, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value by the combining condition changing unit 36, the combined image analysis evaluation value is reduced according to the combined image user evaluation total value. When the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value is increased in accordance with the combined image user evaluation total value. The background image of the template used for is changed.

  Then, the combined image creating unit 26 creates a combined image again using the template whose background image has been changed by the combining condition changing unit 36.

  When the composite image evaluation item is a type of an object other than a person appearing in an image used in the composite image, the object detection unit 52 uses the annotation of the object based on an analysis result of each image. Then, objects other than the person appearing in each image are detected, a list of objects appearing in a plurality of images is created, and displayed on the image display unit 60 of the terminal device 14 of each user.

  Each user refers to the list displayed on the image display unit 60 of the terminal device 14 of each user, and selects an object appearing in the image that the user wants to use actively in the composite image from the list of objects. .

  When the object is selected by each user, the number-of-objects obtaining unit 54 obtains the number of each object selected by the plurality of users from the list of objects.

  Subsequently, according to the number of objects selected by a plurality of users from the list of objects, for example, as the number of objects selected by a plurality of users increases, the When one or more images are extracted from a plurality of images, the weight of the image in which each object is captured is changed so that the weight of the image in which the object is captured is increased.

  Then, the combined image creating unit 26 creates a combined image again using one or more images extracted from the plurality of images according to the weight of the object changed by the combining condition changing unit 36.

  Further, evaluations of a plurality of users regarding the appearance frequency of a specific object may be acquired. For example, for a photo album created at a food-and-dining club, the user specifies the object as “cooking” and evaluates whether the image of the cooking corresponds to “too little” or “too much” as a plurality of users. Get an evaluation of. In this case, if the average value is biased toward “too much”, the composition is changed by changing the conditions so as to reduce the number of images of the dish, and the composite image is re-created, so that the majority of the plurality of users are satisfied. Images can be created.

  In the present embodiment, a plurality of users do not directly edit the layout of a composite image created using a plurality of images obtained from a plurality of users, but calculate a composite image analysis evaluation value, and The composite image user evaluation value is obtained from the user, the composite image user evaluation total value is calculated, and the composite image is re-created based on the difference between the composite image user evaluation total value and the composite image analysis evaluation value.

  As described above, since a plurality of users do not directly edit the layout of the composite image, even when the number of users increases, the composite image can be re-created, that is, the layout of the composite image can be edited. In addition, since the image processing apparatus 10 recreates the composite image instead of the user, it is possible to create a composite image that can be satisfied by the majority of users on average without putting a large burden on the secretary user.

Note that, instead of the synthesis condition changing unit 36 creating a change condition, the synthesis condition selection unit 44 selects a synthesis image user evaluation total value and a synthesis image analysis value from a plurality of change conditions stored in the synthesis condition storage unit 42. One change condition corresponding to the composite image evaluation item whose difference from the evaluation value is larger than the threshold value may be selected.
In this case, the combined image is re-created by the combined image creation unit 26 based on the change condition selected by the combination condition selection unit 44.

Alternatively, each of the plurality of users may select one change condition from the plurality of change conditions stored in the synthesis condition storage unit 42.
In this case, the composite image creation unit 26 recreates a composite image based on one change condition selected by each of the plurality of users from the plurality of change conditions stored in the synthesis condition storage unit 42. .

Further, the synthesizing condition changing unit 36 may create not only one changing condition but also two or more changing conditions.
In this case, the composite image creation unit 26 recreates two or more composite images based on the two or more change conditions created by the composite condition change unit 36.
Subsequently, for the two or more composite images recreated by the composite image creation unit 26, the number of each of the two or more composite images selected by the plurality of users is acquired by the composite image selection number acquisition unit 46. You.
Then, the synthesized image information obtaining unit 48 obtains the information of the selected synthesized image having the largest number selected by the plurality of users from the two or more synthesized images obtained by the synthesized image selection number obtaining unit 46. .

  Next, the operation of the image processing apparatus 10 when re-creating a composite image based on the standard deviation will be described with reference to the flowchart shown in FIG.

  The operations of steps S21 to S25 and step S26 are the same as the operations of steps S1 to S5 and step S8 shown in the flowchart of FIG.

  Subsequently, the standard deviation of the composite image user evaluation values from a plurality of users is calculated for each composite image evaluation item by the composite image user evaluation value calculation unit 34 (step S27).

  Subsequently, the combining condition changing unit 36 confirms whether or not the standard deviation calculated by the combined image user evaluation value calculating unit 34 is larger than the threshold for each of the combined image evaluation items (step S28).

  As a result, when the standard deviation is larger than the threshold value (Yes in step S28), the combining condition changing unit 36 sets at least one of the individual image evaluation condition, the image extraction condition, and the combined image creation condition to the standard deviation. Two or more change conditions changed accordingly are created (step S29).

  For example, when the distribution of synthesized image user evaluation values from a plurality of users is largely divided into two groups, the synthesis condition changing unit 36 sets the synthesized image analysis evaluation value for each of the two groups. , At least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition is set to the standard deviation so as to approach the average of the composite image user evaluation values from a plurality of users. Two change conditions changed accordingly are created.

  On the other hand, if the standard deviation is equal to or smaller than the threshold (No in step S28), it is confirmed whether the confirmation as to whether the standard deviation is larger than the threshold has been completed for all the composite image evaluation items (step S28) S30).

  As a result, if the confirmation has not been completed for all the composite image evaluation items (No in Step S30), the confirmation as to whether or not the standard deviation is larger than the threshold is continuously performed.

On the other hand, when the confirmation has been completed for all the composite image evaluation items (Yes in step S30), the composite image creation unit 26 sets the two or more composite images based on the two or more change conditions created by the composite condition change unit 36. Is re-created (step S31).
If the change condition has not been created by the synthesis condition changing unit 36, the synthesis image is not re-created.

  Subsequently, the two or more composite images recreated by the composite image creation unit 26 are sent to the terminal devices 14 of the respective users via the network 16 and displayed on the image display unit 60.

  Each user refers to two or more composite images displayed on the image display unit 60 of the terminal device 14 of each user, and via the instruction input unit 62, selects one composite image from the two or more composite images. Select

  Subsequently, for the two or more composite images, the number of each of the two or more composite images selected by a plurality of users is acquired by the composite image selection number acquisition unit 46 (step S32).

  Subsequently, the synthesized image information obtaining unit 48 obtains information of a selected synthesized image that is the synthesized image selected by a plurality of users from among the two or more synthesized images (Step S33).

  For example, when the composite image evaluation item is the number of images used in the composite image, as in the case of the example in FIG. 5, each user uses the slider bar to select the image used in the composite image. The composite image can be evaluated for a number.

  In this case, when the evaluation of the composite image by the user is completed, the composite image user evaluation value acquisition unit 32 obtains the number of images used in the composite image from the terminal devices 14 of a plurality of users via the network 16. Is obtained.

  Subsequently, the standard deviation of the composite image user evaluation values from a plurality of users is calculated by the composite image user evaluation value calculation unit 34 for the number of images used in the composite image.

  Subsequently, the synthesizing condition changing unit 36 checks whether or not the standard deviation of the number of images used in the synthesized image is larger than a threshold.

  As a result, when the standard deviation is larger than the threshold, the number of arranged images in the template used to create the composite image is changed by the synthesis condition changing unit 36 according to the standard deviation.

  Then, the combined image creating unit 26 creates a combined image again using the template whose number of arranged images has been changed by the combining condition changing unit 36.

  When the composite image evaluation item is the number of human images used in the composite image, as in the case of the example shown in FIG. 5, each user is used in the composite image using the slider bar. The composite image can be evaluated for the number of portrait images.

  In this case, when the evaluation of the synthesized image by the user is completed, the synthesized image user evaluation value acquisition unit 32 synthesizes the number of person images used in the synthesized image from the terminal devices 14 of a plurality of users via the network 16. A composite image user evaluation value obtained by evaluating the image is obtained.

  Subsequently, the standard deviation of the composite image user evaluation values from a plurality of users is calculated by the composite image user evaluation value calculation unit 34 for the number of human images used in the composite image.

  Subsequently, the synthesizing condition changing unit 36 checks whether the standard deviation of the number of human images used in the synthesized image is larger than a threshold value.

  As a result, when the standard deviation is larger than the threshold, the combining condition changing unit 36 changes the weight of the person image when extracting one or more images from the plurality of images.

  Then, the combined image creating unit 26 creates a combined image again using one or more images extracted from the plurality of images according to the weight of the human image changed by the combining condition changing unit 36.

  When the composite image evaluation item is the atmosphere of the composite image, similarly to the example shown in FIG. 6, each user can evaluate the composite image for the atmosphere of the composite image using the slider bar. .

  In this case, when the evaluation of the composite image by the user is completed, the composite image user evaluation value acquiring unit 32 evaluates the composite image for the atmosphere of the composite image from the terminal devices 14 of a plurality of users via the network 16. A user evaluation value is obtained.

  Subsequently, the standard deviation of the composite image user evaluation values from a plurality of users is calculated by the composite image user evaluation value calculation unit 34 for the atmosphere of the composite image.

  Subsequently, the combining condition changing unit 36 checks whether the standard deviation of the atmosphere of the combined image is larger than a threshold value.

  As a result, when the standard deviation is larger than the threshold, the background image of the template used to create the composite image is changed by the synthesis condition changing unit 36 according to the standard deviation.

  Then, the combined image creating unit 26 creates a combined image again using the template whose background image has been changed by the combining condition changing unit 36.

  In the present embodiment, a composite image user evaluation value is obtained from each user, a standard deviation of the composite image user evaluation values from a plurality of users is calculated, and two or more composite images are re-created based on the standard deviation. . Then, information on a selected combined image that is the largest number of combined images selected by a plurality of users from the two or more combined images is acquired, and the selected combined image is adopted from the two or more combined images.

As described above, by re-creating the composite image based on the standard deviation, even when the distribution of the composite image user evaluation values from a plurality of users varies, the majority of users can be satisfied on average. A composite image can be created.
For example, if the average of the evaluations from a plurality of users regarding the atmosphere of the composite image is “too bright”, how to specifically change the value of the condition for determining the brightness of the composite image is “just I don't know for sure how good it can be. For example, even when lowering the brightness of the composite image, there is a possibility that the brightness will be lowered too much or the amount of reduction in the brightness will be too small.
Therefore, by re-creating two or more composite images in which the values of the conditions for determining the brightness of the composite image have been changed and determining the composite image to be adopted by majority decision by a plurality of users, the majority of the plurality of users can be determined. It is also possible to clarify the value of the condition that determines the brightness of the synthesized image, which can know the desired brightness and can make the synthesized image “just right” for the majority of users. it can.

It should be noted that instead of the synthesizing condition changing unit 36 creating the changing condition, the synthesizing condition selecting unit 44 selects the synthesizing image evaluation standard deviation larger than the threshold value from the plurality of changing conditions stored in the synthesizing condition storage unit 42. Two or more change conditions corresponding to the item may be selected.
In this case, the combined image is re-created by the combined image creation unit 26 based on the change condition selected by the combination condition selection unit 44.

Alternatively, each of the plurality of users may select two or more change conditions from the plurality of change conditions stored in the synthesis condition storage unit 42.
In this case, the composite image creation unit 26 re-creates the composite image based on two or more change conditions selected by each of the plurality of users from the plurality of change conditions stored in the synthesis condition storage unit 42. It is.

Note that the combining condition changing unit 36 may create the changing condition based on both the difference between the combined image user evaluation total value and the combined image analysis evaluation value and the standard deviation.
For example, when evaluating the atmosphere of a composite image, even if the difference between the composite image user evaluation total value and the composite image analysis evaluation value is equal to or smaller than the threshold, the evaluations from a plurality of users are “too dark” and “too bright”. May be numerous. In this case, since the composite image is not re-created, the majority of users cannot be satisfied if re-creation of the composite image is determined based on the difference between the composite image user evaluation total value and the composite image analysis evaluation value. There is a fear.
On the other hand, when calculating the average of the composite image user evaluation values from a plurality of users as the composite image user evaluation total value, for example, three values corresponding to the average, the average + standard deviation, and the average-standard deviation By recreating the composite image and determining the composite image to be adopted by majority decision by a plurality of users, it is possible to create a composite image incorporating opinions of a plurality of users to some extent.

  In addition, each user may evaluate the combined image recreated by the combined image creation unit 26 for each combined image evaluation item, and may further create the combined image again. That is, the composite image may be recreated two or more times.

The one or more composite image evaluation items may be designated (input) by a secretary user.
In this case, the composite image user evaluation value acquisition unit 32 acquires a composite image user evaluation value obtained by each user evaluating the composite image for each of one or more composite image evaluation items designated by the secretary user.

Further, one or more composite image evaluation items may be stored in the composite image evaluation item storage unit 56.
In this case, the composite image user evaluation value acquisition unit 32 acquires a composite image user evaluation value obtained by each user evaluating the composite image for each of one or more composite image evaluation items stored in the composite image evaluation item storage unit 56. Is done.

Further, each of the plurality of users may select a composite image evaluation item to be evaluated from one or more composite image evaluation items stored in the composite image evaluation item storage unit 56.
In this case, the synthesized image user evaluation value acquisition unit 32 sets each of the synthesized image evaluation items selected by the plurality of users from one or more synthesized image evaluation items stored in the synthesized image evaluation item storage unit 56. A composite image user evaluation value obtained by the user evaluating the composite image is obtained.
For example, when the secretary user selects a composite image evaluation item to be evaluated, the composite image user evaluation value acquisition unit 32 selects one or more composite image evaluation items stored in the composite image evaluation item storage unit 56 from the secretary. For each of the composite image evaluation items selected by the user, the composite image user evaluation value obtained by each user evaluating the composite image is obtained.
In addition, when the composite image analysis evaluation value exceeds the threshold, the composite image evaluation value calculation unit 30 recommends that the composite image evaluation item be evaluated for the composite image evaluation item exceeding the threshold to the secretary user. Good. In addition, the user of the secretary is not limited to one user, and may be at least one user among a plurality of users.

In addition, the composite image evaluation item creation unit 58 automatically selects, from one or more objects, a composite image evaluation item for an object in which the number of appearances in the composite image is larger than a threshold, based on the individual image evaluation value of each image. May be created.
In this case, the composite image user evaluation value acquisition unit 32 acquires a composite image user evaluation value obtained by each user evaluating the composite image for the composite image evaluation item created by the composite image evaluation item creation unit 58.

  In addition, the information of the selected combined image is stored in the combined image information storage unit 50, and the combining condition changing unit 36 allows a plurality of users to perform the selection based on the information of the selected combined image stored in the combined image information storage unit 50. At least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition used for creating the next composite image may be changed so as to match the tendency of selection of the composite image.

  In addition, for each composite image evaluation item, the average of the composite image user evaluation values from a plurality of users is stored in the composite image user evaluation value storage unit, and the composite image creation unit 26 sets each composite image evaluation item for each composite image evaluation item. The individual image evaluation condition, the image extraction condition, and the composite image creation condition so that the composite image analysis evaluation value approaches the average of the composite image user evaluation values from a plurality of users stored in the composite image user evaluation value storage unit. The next composite image may be created under the condition that at least one value of is determined.

If the average of the composite image created under a certain condition and the composite image user evaluation value from a plurality of users who evaluated this composite image for each composite image evaluation item is known, It is possible to learn whether a composite image that can provide average satisfaction of a plurality of users can be created. Therefore, by storing the average of the composite image user evaluation value from a plurality of users in the composite image user evaluation value storage unit, the next composite image, the one closer to the average rating of the plurality of users, accuracy Can be created well and quickly.

  When the composite image is re-created, for each composite image evaluation item, the condition that the difference between the composite image user evaluation total value and the composite image analysis evaluation value is equal to or less than the threshold value, that is, the evaluation from multiple users Is stored in the composite image user evaluation value storage unit, and the composite image user evaluation total value and the composite image analysis evaluation value stored in the composite image user evaluation value storage unit are stored. The next composite image may be created under the condition that the difference is equal to or less than the threshold.

  The image processing apparatus 10 may create a composite image such as a photo album (photo book) on a paper medium by printing and binding, or the image processing apparatus 10 may include an image including a still image and a moving image on a template. May be arranged to create a composite image such as an electronic album to be viewed on a display. Furthermore, without using a template, a composite image such as a slide show that sequentially displays various contents including still images and moving images acquired from the user may be created.

  It is not essential that the image processing apparatus 10 includes the server 12 and the terminal devices 14 of a plurality of users. For example, an apparatus including all the components of the server 12 and the terminal device 14 may be configured. In this case, the exchange between the network 16 and the server 12 and the user's terminal device 14 is unnecessary. For example, the exchange from the user to the image processing apparatus 10 or directly from the image processing apparatus 10 to the user is not necessary. It can be carried out.

  Image acquisition unit 18, individual image analysis unit 20, individual image evaluation value calculation unit 22, image extraction unit 24, composite image creation unit 26, composite image analysis unit 28, composite image evaluation value calculation unit 30, acquisition of composite image user evaluation value Unit 32, composite image user evaluation value calculation unit 34, composition condition changing unit 36, personal information acquisition unit 38, weight calculation unit 40, composition condition storage unit 42, composition condition selection unit 44, composition image selection number acquisition unit 46, composition The image information acquisition unit 48, the composite image information storage unit 50, the object detection unit 52, the number of objects acquisition unit 54, the composite image evaluation item storage unit 56, the composite image evaluation item creation unit 58, and the composite image user evaluation value storage unit 59 Is not essential to the server 12, and at least one of them may be provided in the terminal device 14 of the user.

  In the device of the present invention, each component included in the device may be configured by dedicated hardware, or each component may be configured by a programmed processor, a computer including the processor, or the like. The method of the present invention can be implemented, for example, by a program for causing a computer to execute each step. Further, a computer-readable recording medium on which the program is recorded can be provided.

  As described above, the present invention has been described in detail. However, the present invention is not limited to the above embodiment, and various improvements and modifications may be made without departing from the gist of the present invention.

10 image processing device 12 server 14 terminal device (client)
Reference Signs List 16 Network 18 Image acquisition unit 20 Individual image analysis unit 22 Individual image evaluation value calculation unit 24 Image extraction unit 26 Synthetic image creation unit 28 Synthetic image analysis unit 30 Synthetic image evaluation value calculation unit 32 Synthetic image user evaluation value acquisition unit 34 Synthetic image User evaluation value calculation unit 36 Synthesis condition change unit 38 Personal information acquisition unit 40 Weight calculation unit 42 Synthesis condition storage unit 44 Synthesis condition selection unit 46 Synthetic image selection number acquisition unit 48 Synthetic image information acquisition unit 50 Synthetic image information storage unit 52 Object Detecting unit 54 Object number acquiring unit 56 Synthetic image evaluation item storage unit 58 Synthetic image evaluation item creation unit 59 Synthetic image user evaluation value storage unit 60 Image display unit 62 Instruction input unit 64 Slider bar 66 Slider

Claims (37)

An image acquisition unit that acquires a plurality of images from a plurality of users;
An individual image analysis unit that analyzes each of the plurality of images,
An individual image evaluation value calculation unit that calculates an individual image evaluation value obtained by evaluating each of the images with respect to one or more individual image evaluation conditions, based on an analysis result of each of the images;
An image extraction unit that extracts one or more images corresponding to one or more image extraction conditions from the plurality of images based on an individual image evaluation value of each of the images;
A composite image creation unit that creates a composite image combining the one or more images based on one or more composite image creation conditions;
A composite image analysis unit for analyzing the composite image,
A composite image evaluation value calculation unit that calculates each of one or more composite image analysis evaluation values obtained by evaluating the composite image for each of one or more composite image evaluation items based on the analysis result of the composite image;
A composite image user evaluation value obtaining unit configured to obtain each of one or more composite image user evaluation values obtained by evaluating the composite image for each of the one or more composite image evaluation items from the plurality of users;
For each of the composite image evaluation items, a composite image user evaluation value calculation unit that calculates a composite image user evaluation total value based on composite image user evaluation values from the plurality of users,
For each of the composite image evaluation items, when the difference between the composite image user evaluation total value and the composite image analysis evaluation value is greater than a threshold, the composite image analysis evaluation value approaches the composite image user evaluation total value. A combination condition changing unit that creates a change condition in which at least one of the individual image evaluation condition, the image extraction condition, and the combined image creation condition is changed according to the difference,
The image processing device, wherein the combined image creating unit re-creates the combined image based on the change condition created by the combining condition changing unit.   The combining condition changing unit, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, decreases the combined image analysis evaluation value according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value increases according to the combined image user evaluation total value. The image processing apparatus according to claim 1, wherein a change condition is created by changing at least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition. The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for the number of images used in the composite image,
The combining condition changing unit, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, decreases the combined image analysis evaluation value according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value increases according to the combined image user evaluation total value. In such a manner, the number of arranged images in the template used to create the composite image is changed,
The image processing apparatus according to claim 1, wherein the composite image creating unit re-creates the composite image using a template whose number of arranged images has been changed by the synthesis condition changing unit. The composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for the number of human images used in the composite image,
The combining condition changing unit, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, decreases the combined image analysis evaluation value according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value increases according to the combined image user evaluation total value. Changing the weight of the person image when extracting the one or more images from the plurality of images,
The composite image creating unit re-creates the composite image using one or more images extracted from the plurality of images according to the weight of the person image changed by the synthesis condition changing unit. Item 3. The image processing device according to item 1 or 2 . The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for the atmosphere of the composite image,
The combining condition changing unit, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, decreases the combined image analysis evaluation value according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value increases according to the combined image user evaluation total value. To change the background image of the template used to create the composite image,
The composite image creation unit may re-create the composite image using the background image is changed template by the synthesis condition changing unit, an image processing apparatus according to claim 1 or 2. The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for the number of images and the number of person images used in the composite image,
The combining condition changing unit, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, decreases the combined image analysis evaluation value according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value increases according to the combined image user evaluation total value. Changing the weight of the person image when extracting the one or more images from the plurality of images and the number of arranged images in the template used to create the composite image,
The composite image creation unit is extracted from the plurality of images according to the template whose number of arranged images has been changed by the synthesis condition change unit and the weight of the person image changed by the synthesis condition change unit. The image processing apparatus according to claim 1, wherein the composite image is re-created using one or more images. The composite image user evaluation value acquisition unit acquires the number of images and the number of human images used in the composite image, and a composite image user evaluation value that evaluates the composite image for the atmosphere of the composite image.
The combining condition changing unit, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, decreases the combined image analysis evaluation value according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value increases according to the combined image user evaluation total value. As described above, the number of arranged images in the template used for creating the composite image, the weight of the person image when extracting the one or more images from the plurality of images, and the background of the template used for creating the composite image Change the image,
The composite image creating unit may include a template in which the number of arranged images and the background image are changed by the synthesis condition changing unit, and the plurality of images according to a weight of the person image changed by the synthesis condition changing unit. The image processing apparatus according to claim 1, wherein the composite image is re-created using one or more images extracted from among the images. The composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for the number of human images used in the composite image and the atmosphere of the composite image,
The combining condition changing unit, when the combined image user evaluation total value is larger than the threshold value with respect to the combined image analysis evaluation value, decreases the combined image analysis evaluation value according to the combined image user evaluation total value. Or when the combined image user evaluation total value is smaller than the threshold value with respect to the combined image analysis evaluation value, the combined image analysis evaluation value increases according to the combined image user evaluation total value. Changing the background image of the template used for creating the composite image and the weight of the human image when extracting the one or more images from the plurality of images,
The composite image creating unit changes one or more images extracted from the plurality of images according to the weight of the person image changed by the synthesis condition changing unit and the background image is changed by the synthesis condition changing unit. The image processing apparatus according to claim 1, wherein the composite image is re-created using the template. The composite image user evaluation value calculation unit, as the composite image Rating Overall value, the sum of the composite image user evaluation value from the plurality of users, and calculates the average or product, any one of claims 1 to 8 An image processing apparatus according to claim 1. Comprising a weight calculation unit for calculating the weight of each of the plurality of users,
The composite image user evaluation value calculation unit calculates, as the composite image user evaluation total value, a sum, an average, or a product of the composite image user evaluation values from the plurality of users weighted according to the weight of each user. to image processing apparatus according to any one of claims 1 to 8. Comprising a personal information acquisition unit for acquiring personal information of each of the users,
The image processing apparatus according to claim 10 , wherein the weight calculation unit calculates a weight of each of the plurality of users based on personal information of each of the users. The image processing device according to claim 10 , wherein the weight calculation unit calculates the weight of each of the plurality of users such that the weight of a user whose more images have been obtained by the image obtaining unit is heavier. . The weight calculating unit calculates the weight of each of the plurality of users such that the weight of the user whose synthesized image user evaluation value is acquired earlier by the synthesized image user evaluation value obtaining unit is heavier. The image processing apparatus according to claim 10 . A combination condition storage unit that stores a plurality of change conditions obtained by changing at least one of the individual image evaluation condition, the image extraction condition, and the combination image creation condition according to the difference;
A combination condition selection unit that selects one change condition corresponding to a combination image evaluation item whose difference is greater than the threshold from among a plurality of change conditions stored in the combination condition storage unit;
The composite image creation unit, the re-create the composite image based on the selected change condition by the synthesis condition selection unit, an image processing apparatus according to any one of claims 1 to 13. A synthesis condition storage unit that stores a plurality of change conditions obtained by changing at least one of the individual image evaluation condition, the image extraction condition, and the synthesized image creation condition according to the difference,
The composite image creation unit re-creates the composite image based on one change condition selected by each of the plurality of users from a plurality of change conditions stored in the combination condition storage unit. Item 14. The image processing device according to any one of Items 1 to 13 . The combining condition changing unit creates two or more changing conditions in which at least one of the individual image evaluation condition, the image extraction condition, and the combined image creating condition is changed according to the difference,
The composite image creation unit re-creates two or more composite images based on the two or more change conditions created by the composite condition change unit,
For the two or more composite images, a composite image selection number acquisition unit that acquires the number of each of the two or more composite images selected by the plurality of users,
The composite image information acquisition unit according to any one of claims 1 to 15 , further comprising: a composite image information acquisition unit configured to acquire information on a selected composite image having the largest number selected by the plurality of users from the two or more composite images. Image processing device. The composite image user evaluation value calculation unit further calculates a standard deviation of the composite image user evaluation values from the plurality of users,
The combining condition changing unit creates two or more changing conditions in which at least one of the individual image evaluation condition, the image extraction condition, and the combined image creating condition is changed according to the difference and the standard deviation,
The composite image creation unit re-creates two or more composite images based on the two or more change conditions created by the composite condition change unit,
For the two or more composite images, a composite image selection number acquisition unit that acquires the number of each of the two or more composite images selected by the plurality of users,
And a composite image information acquisition unit that acquires information of the selected largest number selected composite image by the plurality of users from among the two or more composite images, according to any one of claims 1 to 16 Image processing device. An image acquisition unit that acquires a plurality of images from a plurality of users;
An individual image analysis unit that analyzes each of the plurality of images,
An individual image evaluation value calculation unit that calculates an individual image evaluation value obtained by evaluating each of the images with respect to one or more individual image evaluation conditions, based on an analysis result of each of the images;
An image extraction unit that extracts one or more images corresponding to one or more image extraction conditions from the plurality of images based on an individual image evaluation value of each of the images;
A composite image creation unit that creates a composite image combining the one or more images based on one or more composite image creation conditions;
A composite image user evaluation value acquisition unit configured to acquire each of one or more composite image user evaluation values obtained by evaluating the composite image for each of the one or more composite image evaluation items from the plurality of users;
For each of the composite image evaluation items, a composite image user evaluation value calculation unit that calculates a standard deviation of composite image user evaluation values from the plurality of users,
For each of the composite image evaluation items, when the standard deviation is greater than a threshold, change at least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition according to the standard deviation. A combining condition changing unit for creating two or more changing conditions,
For each of the two or more composite images recreated based on the two or more change conditions by the composite image creation unit, the number of each of the two or more composite images selected by the plurality of users is obtained. An image selection number acquisition unit,
An image processing apparatus, comprising: a composite image information acquisition unit configured to acquire information of a selected composite image having the largest number selected by the plurality of users from the two or more composite images. The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for the number of images used in the composite image,
The composition condition changing unit, when the standard deviation is larger than the threshold value, changes the number of arranged images in the template used to create the composite image according to the standard deviation,
19. The image processing apparatus according to claim 18 , wherein the composite image creating unit re-creates the composite image using a template whose number of arranged images has been changed by the synthesis condition changing unit. The composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for the number of human images used in the composite image,
The synthesis condition changing unit, when the standard deviation is greater than the threshold, changes the weight of the person image when extracting the one or more images from the plurality of images according to the standard deviation,
The composite image creating unit re-creates the composite image using one or more images extracted from the plurality of images according to the weight of the person image changed by the synthesis condition changing unit. Item 19. The image processing device according to item 18 . The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for the atmosphere of the composite image,
The synthesis condition changing unit, when the standard deviation is greater than the threshold, changes the background image of the template used to create the synthesized image according to the standard deviation,
19. The image processing apparatus according to claim 18 , wherein the composite image creating unit re-creates the composite image using a template whose background image has been changed by the synthesis condition changing unit. The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for the number of images and the number of person images used in the composite image,
When the standard deviation is larger than the threshold value, the combining condition changing unit is configured to extract the one or more images from the number of arranged images in the template used for creating the combined image and the plurality of images. Change the weight of the person image according to the standard deviation,
The composite image creation unit is extracted from the plurality of images according to the template whose number of arranged images has been changed by the synthesis condition change unit and the weight of the person image changed by the synthesis condition change unit. The image processing apparatus according to claim 18, wherein the composite image is re-created using one or more images. The composite image user evaluation value acquisition unit acquires the number of images and the number of human images used in the composite image, and a composite image user evaluation value that evaluates the composite image for the atmosphere of the composite image.
The composition condition changing unit is configured to, when the standard deviation is larger than the threshold value, extract the one or more images from the plurality of images, the number of arranged images in a template used to create the composite image. Change the weight of the person image and the background image of the template used to create the composite image according to the standard deviation,
The composite image creating unit may include a template in which the number of arranged images and the background image are changed by the synthesis condition changing unit, and the plurality of images according to a weight of the person image changed by the synthesis condition changing unit. The image processing apparatus according to claim 18, wherein the composite image is re-created using one or more images extracted from among the images. The composite image user evaluation value obtaining unit obtains a composite image user evaluation value obtained by evaluating the composite image for the number of human images used in the composite image and the atmosphere of the composite image,
The combining condition changing unit is configured to, when the standard deviation is larger than the threshold value, weigh a person image when extracting the one or more images from the plurality of images and a template used for creating the combined image. Change the background image according to the standard deviation,
The composite image creating unit changes one or more images extracted from the plurality of images according to the weight of the person image changed by the synthesis condition changing unit and the background image is changed by the synthesis condition changing unit. 19. The image processing apparatus according to claim 18, wherein the composite image is re-created using the template obtained. A synthesis condition storage unit that stores a plurality of change conditions obtained by changing at least one of the individual image evaluation condition, the image extraction condition, and the synthesized image creation condition according to the standard deviation;
A synthesis condition selection unit that selects two or more change conditions corresponding to a synthesized image evaluation item in which the standard deviation is larger than the threshold, from a plurality of change conditions stored in the synthesis condition storage unit;
The composite image creation unit, the synthesis conditions recreate the composite image on the basis of the selected change condition by the selection unit, an image processing apparatus according to any one of claims 18 to 24. A synthesis condition storage unit that stores a plurality of change conditions obtained by changing at least one of the individual image evaluation condition, the image extraction condition, and the synthesized image creation condition according to the standard deviation,
The composite image creating unit re-creates the composite image based on two or more change conditions selected by each of the plurality of users from a plurality of change conditions stored in the composite condition storage unit. Item 25. The image processing device according to any one of Items 18 to 24 . Based on the analysis result of each of the images, an object detection unit that detects an object other than a person appearing in each of the images, and creates a list of objects that appear in the plurality of images,
An object number acquisition unit that acquires the number of each object selected by the plurality of users from the list of objects,
The synthesizing condition changing unit may further include extracting the one or more images from the plurality of images according to the number of each object selected by the plurality of users from the list of objects. Changing the weight of the image in which each of the objects is captured,
The said composite image preparation part re-creates the composite image using one or more images extracted from the plurality of images according to the weight of the object changed by the synthesis condition change part. The image processing device according to any one of 1 to 26 . A composite image evaluation item storage unit that stores the one or more composite image evaluation items;
The composite image user evaluation value acquisition unit acquires a composite image user evaluation value that evaluates the composite image for each of the one or more composite image evaluation items stored in the composite image evaluation item storage unit. 28. The image processing device according to any one of claims 27 to 27 . A composite image evaluation item storage unit that stores the one or more composite image evaluation items;
The composite image user evaluation value acquisition unit is configured to select the composite image evaluation item selected by each of the plurality of users from the one or more composite image evaluation items stored in the composite image evaluation item storage unit. The image processing apparatus according to any one of claims 1 to 27 , wherein a composite image user evaluation value obtained by evaluating is obtained. The composite image evaluation value calculation unit, when the composite image analysis evaluation value exceeds a threshold, evaluates the composite image for a composite image evaluation item exceeding the threshold, among the plurality of users. of recommending to at least one user, the image processing apparatus according to any one of claims 1 to 17. A composite image evaluation item creation unit that creates the composite image evaluation item for an object whose appearance frequency in the composite image is greater than a threshold from among one or more objects based on the individual image evaluation value of each image; Prepared,
The composite image user evaluation value acquiring unit, the synthesized image evaluation to obtain a composite image user evaluation value of the evaluation of the composite image for the composite image evaluation items created by item creation unit, any one of claims 1 to 27 An image processing apparatus according to the item. A composite image information storage unit that stores information on the selected composite image,
The combining condition changing unit creates a next combined image based on the information of the selected combined image stored in the combined image information storage unit so as to match the tendency of the plurality of users to select the combined image. The image processing apparatus according to any one of claims 16 to 18 , wherein at least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition used for (i) is changed. For each of the composite image evaluation items, a composite image user evaluation value storage unit that stores an average of composite image user evaluation values from the plurality of users,
The composite image creation unit is configured such that, for each of the composite image evaluation items, the composite image analysis evaluation value approaches an average of composite image user evaluation values from the plurality of users stored in the composite image user evaluation value storage unit. The method according to any one of claims 1 to 17, and wherein the next composite image is generated under a condition in which at least one of the individual image evaluation condition, the image extraction condition, and the composite image generation condition is determined. The image processing device according to claim 1. An image acquiring unit acquiring a plurality of images from a plurality of users;
An individual image analysis unit for analyzing each of the plurality of images;
An individual image evaluation value calculating unit that calculates an individual image evaluation value obtained by evaluating each of the images with respect to one or more individual image evaluation conditions, based on an analysis result of each of the images;
An image extracting unit for extracting one or more images corresponding to one or more image extraction conditions from the plurality of images based on an individual image evaluation value of each of the images;
A step in which the combined image creation unit creates a combined image by combining the one or more images based on one or more combined image creation conditions;
A composite image analysis unit that analyzes the composite image;
A step in which the composite image evaluation value calculation unit calculates each of one or more composite image analysis evaluation values obtained by evaluating the composite image for each of one or more composite image evaluation items based on the analysis result of the composite image;
A step of acquiring, from the plurality of users, one or more composite image user evaluation values obtained by evaluating the composite image for each of the one or more composite image evaluation items;
A composite image user evaluation value calculation unit for each of the composite image evaluation items, calculating a composite image user evaluation total value based on composite image user evaluation values from the plurality of users;
A combining condition changing unit that, for each of the combined image evaluation items, when the difference between the combined image user evaluation total value and the combined image analysis evaluation value is greater than a threshold, the combined image analysis evaluation value is the combined image Creating a change condition in which at least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition is changed according to the difference so as to approach the user evaluation total value;
A step of re-creating the composite image based on the change condition created by the step of creating the change condition. An image acquiring unit acquiring a plurality of images from a plurality of users;
An individual image analysis unit for analyzing each of the plurality of images;
An individual image evaluation value calculating unit that calculates an individual image evaluation value obtained by evaluating each of the images with respect to one or more individual image evaluation conditions, based on an analysis result of each of the images;
An image extracting unit for extracting one or more images corresponding to one or more image extraction conditions from the plurality of images based on an individual image evaluation value of each of the images;
A step in which the combined image creation unit creates a combined image by combining the one or more images based on one or more combined image creation conditions;
A step of acquiring, from the plurality of users, one or more composite image user evaluation values obtained by evaluating the composite image for each of the one or more composite image evaluation items;
A step of calculating a standard deviation of composite image user evaluation values from the plurality of users, for each of the composite image evaluation items,
For each of the composite image evaluation items, when the standard deviation is greater than a threshold, the composition condition changing unit sets at least one of the individual image evaluation condition, the image extraction condition, and the composite image creation condition to the Creating two or more change conditions changed according to the standard deviation;
The two or more synthesized images selected by the plurality of users are selected by the plurality of users for the two or more synthesized images re-created based on the two or more change conditions by the step of creating the synthesized image. Obtaining a number of each of the composite images;
A composite image information acquisition unit acquiring information on a selected composite image selected by the plurality of users from the two or more composite images, the number being the largest. Program for executing the respective steps of the image processing method according to the computer to claim 34 or 35. A computer-readable recording medium on which a program for causing a computer to execute each step of the image processing method according to claim 34 or 35 is recorded.