JP6595958B2 - Image processing apparatus, image processing method, program, and recording medium - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, a program, and a recording medium that create a composite image using a plurality of images acquired from a plurality of users.

  Currently, a service is provided for acquiring a plurality of images (image data) owned by a user via the Internet or the like and creating a photo album having a layout desired by the user using the plurality of images acquired from the user. Yes.

  In recent years, not only a photo album is created using only a plurality of images owned by a single user, but also a photo album is created using a plurality of images owned by a plurality of users (Patent Document 1 and 2) is known. In addition, there is known one that determines whether an image is disclosed or not disclosed according to the person in the image, the analysis result of the image, and the shooting position of the image (see Patent Documents 3 to 5).

JP 2008-257308 A JP, 2015-066941, A JP 2012-083915 A JP 2013-191035 A Japanese Patent No. 4823758

  When a plurality of users jointly create one composite image, there is a problem that images used in the composite image are not easily collected. The cause is that each of a plurality of users searches a huge number of image groups from a storage device included in each user's terminal device, confirms the contents of each image included in the image group, and the image group Therefore, it takes time and effort to select and upload an image to be used in the composite image from among the images.

  Further, even after a plurality of users jointly create one composite image, the plurality of images acquired from the plurality of users are stored in a storage device included in the server. Therefore, if each of a plurality of users can create a composite image for themselves using images acquired from a plurality of users, the convenience of the user when creating a composite image is improved, In addition, it is considered that creation of a composite image can be promoted.

  Accordingly, an object of the present invention is to use images acquired from a plurality of users when a plurality of users jointly create a composite image, and each of the plurality of users creates its own composite image. An image processing apparatus, an image processing method, a program, and a recording medium are provided.

In order to achieve the above object, the present invention provides an image acquisition unit that acquires a first image group owned by each of a plurality of users;
An image analysis unit for analyzing each image included in the first image group of each user;
Based on the analysis result of each image, the first extraction condition for extracting an image to be used in the first composite image jointly created by a plurality of users is matched from the first image group of each user. A second image group is extracted and created for the first user from a third image group other than the second image group in the first image group of the first user of the plurality of users. An image extraction unit that extracts a fourth image group that matches a second extraction condition for extracting an image to be used in the two composite images;
A first composite image creating unit that creates a first composite image using images included in the second image group of a plurality of users;
Provided is an image processing apparatus comprising: a second composite image creating unit that creates a second composite image using images included in a second image group of a plurality of users and a fourth image group of a first user.

  Here, the image acquisition unit may acquire, as the first image group of each user, an image group included in each user's storage device designated by each user or a folder created in the storage device. preferable.

  Moreover, it is preferable that an image acquisition part acquires the 1st image group of each user in the night time zone set beforehand.

  In addition, the first extraction condition includes an image of a specific person, an image shot on a specific day or a specific period, an image shot at a specific location, and an image of a specific scene. At least one is preferred.

  The second extraction condition is preferably an image in which the first user is shown.

  Moreover, it is preferable that an image extraction part extracts the image selected by the 1st user further from the 1st user's 1st image group as a 2nd image group of a 1st user.

  The image extraction unit preferably further extracts an image selected by the first user from the third image group of the first user as the fourth image group of the first user.

  Moreover, it is preferable to provide a public control unit that exposes only the second image group of a plurality of users to a plurality of users.

  It is preferable that the publication control unit further publishes an image selected by the first user from the third image group of the first user to a plurality of users.

  In addition, when the second image group of a plurality of users is disclosed, the disclosure control unit sets a password for requesting each user to input the second image group of the plurality of users, It is preferable that the two-image group is disclosed only to a user who inputs a password that matches a password set in the second image group of a plurality of users.

In addition, a disclosure request unit that receives a request to publish an image other than the second image group from each user,
The image extraction unit extracts, as a public request image, an image selected by each user from the third image group of each user when the request is received by the public request unit.
The publication control unit further publishes the publication request image,
It is preferable that the first composite image creating unit creates the first composite image using images and public request images included in the second image group of a plurality of users.

  In addition, the second composite image creation unit uses the images included in the second image group of the plurality of users, the public request image, and the images included in the fourth image group of the first user to perform the second for the first user. It is preferable to create a composite image.

In addition, an image request unit that requests each of one or more designated users designated by the first user for an image of the first user in response to an instruction from the first user,
The image extraction unit further extracts a fifth image group including an image of the first user selected in response to the request by each designated user from the fourth image group of each designated user,
The second composite image creation unit uses the images included in the second image group of the plurality of users, the fourth image group of the first user, and the fifth image group of the one or more designated users, for the first user. It is preferable to create two composite images.

The image request unit further sends the face image of the first user to each designated user,
The image extracting unit extracts, from the fourth image group of each designated user, a fifth image group in which the first user selected by referring to the face image of the first user by each designated user is shown. It is preferable.

The image request unit further sends the face image of the first user to each designated user,
The image extraction unit extracts an image showing the first user from the fourth image group of each designated user based on the face image of the first user, and further, an image showing the first user. A fifth image including an image of the first user selected by referring to the face image of the first user by each designated user from among the fourth image group of each designated user displayed with emphasis on It is preferable to extract an image group.

  Moreover, it is preferable that a 1st synthesized image production part produces a 1st synthesized image using the image selected by the at least 1 user of several users from the 2nd image group of several users. .

  In addition, the second composite image creation unit uses the image selected by the first user from the second image group of the plurality of users and the fourth image group of the first user to perform the second for the first user. It is preferable to create a composite image.

According to the present invention, the image acquisition unit acquires a first image group owned by each of the plurality of users;
An image analysis unit analyzing each image included in the first image group of each user;
A first image extracting unit extracts an image to be used in a first composite image jointly created by a plurality of users from the first image group of each user based on the analysis result of each image. The second image group that matches the extraction condition is extracted, and the first user's first image group out of the third image group other than the second image group is selected from the first user's first image group. Extracting a fourth image group that matches a second extraction condition for extracting an image to be used in the second composite image to be created;
A first synthesized image creating unit creating a first synthesized image using images included in a second image group of a plurality of users;
A second composite image creating unit that creates a second composite image using images included in the second image group of the plurality of users and the fourth image group of the first user. .

  The present invention also provides a program for causing a computer to execute each step of the image processing method described above.

  The present invention also provides a computer-readable recording medium on which a program for causing a computer to execute each step of the image processing method described above is recorded.

  In the present invention, after a plurality of users jointly create one composite image using a plurality of images acquired from a plurality of users, the plurality of users are used using the images acquired from the plurality of users. Each can create a composite image for themselves. Therefore, according to the present invention, it is possible to improve the convenience for the user when creating a composite image and to promote the creation of the composite image.

It is a block diagram of one embodiment showing composition of an image processing device concerning the present invention. It is a block diagram of one Embodiment showing the structure of the server shown in FIG. It is a block diagram of one Embodiment showing the structure of the user's terminal device shown in FIG. 2 is a flowchart of an embodiment illustrating an operation of the image processing apparatus illustrated in FIG. 1. It is a conceptual diagram of one Embodiment showing the relationship of the image group acquired from the several user.

  Hereinafter, the @ of the present invention will be described in detail based on preferred embodiments shown in the accompanying drawings.

  FIG. 1 is a block diagram of an embodiment showing a configuration of an image processing apparatus according to the present invention. An image processing apparatus 10 illustrated in FIG. 1 includes a server 12 and a plurality of user terminal devices (clients) 14 connected to the server 12 via a network 16. The image processing apparatus 10 acquires an image group owned by each user from the terminal devices 14 of the plurality of users via the network 16 and combines them using images included in the acquired image groups of the plurality of users. Create an image.

  In the case of the present embodiment, in the image processing apparatus 10, after the first composite image is created jointly by a plurality of users, the first user who is one of the plurality of users is the first user's user. A second composite image is created.

  The server 12 performs various data processing for creating a composite image based on an instruction from the terminal device 14, and is configured by, for example, a desktop PC (Personal Computer) or a workstation. .

  The terminal device 14 gives various instructions to the server 12 to perform various data processing, and is configured by, for example, a smartphone, a tablet PC, or a notebook PC.

  The network 16 is, for example, a telephone line or an internet line, and the server 12 and the terminal device 14 are connected to each other by wire or wireless, and bidirectional communication is possible.

  FIG. 2 is a block diagram of an embodiment showing the configuration of the server shown in FIG. The server 12 shown in the figure includes an image acquisition unit 18, an image analysis unit 20, an image extraction unit 22, a disclosure control unit 24, a disclosure request unit 26, a first composite image creation unit 28, and an image request unit. 30 and a second composite image creation unit 32.

  The image acquisition unit 18 acquires a first image group owned by each of the plurality of users from the terminal devices 14 of the plurality of users via the network 16.

  The first image group of each user may be, for example, an image group including an image only for creating a first composite image jointly created by a plurality of users, or a first composite image is created. It may be an image group including an image to be used and other images.

  Note that the image acquisition unit 46 is configured so that, for example, each user inputs a first image group of each user stored in a storage device such as an SD (Secure Digital) card in the server 12. The first image group owned by each user can be acquired from each user without going through the network 16.

  Subsequently, the image analysis unit 20 analyzes each image included in the first image group of each user acquired by the image acquisition unit 18.

  The image analysis unit 20, for example, analyzes image quality such as image brightness, hue, blur and blur, and image size analysis, as well as Exif (Exchangeable Image File Format). ) And other information included in the supplementary information of the image, analysis of the shooting location, etc., analysis of people and non-human subjects in the image, face recognition of the person in the image, analysis of the scene of the image, etc. Do.

Subsequently, when creating the first composite image, the image extraction unit 22 selects an image to be used in the first composite image from the first image group of each user based on the analysis result of each image. A second image group that matches the first extraction condition for extraction is extracted.
In addition, when creating the second composite image, the image extraction unit 22 creates a third image group other than the second image group in the first image group of the first user based on the analysis result of each image. A fourth image group that matches the second extraction condition for extracting an image to be used in the second composite image created for the first user is extracted from the second image group.

  The first extraction condition is, for example, an image in which a specific person who is a hero in the first composite image is captured, an image captured within a specific date or a specific period, an image captured at a specific location, and It is at least one of the images of a specific scene. Further, the second extraction condition is, for example, an image showing the first user. The first extraction condition is set by, for example, a second user who is the organizer of the group when creating a first composite image among a plurality of users. Further, the second extraction condition is set by the first user, for example.

  Subsequently, the disclosure control unit 24 transmits only the second image group of the plurality of users extracted by the image extraction unit 22 out of the first image group of the plurality of users to the plurality of users via the network 16. And make it public.

  For example, the public control unit 24 transmits the second image group of a plurality of users to the terminal devices 14 of the plurality of users via the network 16 and displays them on the image display units of the terminal devices 14 of the plurality of users. Thus, the second image group of a plurality of users can be disclosed to a plurality of users. Alternatively, the disclosure control unit 24, for example, allows the plurality of users to browse the second image group of the plurality of users displayed (published) on the image display device of the server 12 without going through the network 16. The second image group of a plurality of users can be disclosed to a plurality of users.

  Subsequently, the publication request unit 26 receives a request to publish an additional image other than the second image group from each user.

  The publication request unit 26 can receive, for example, a request for publishing an image from the terminal device 14 of each user via the network 16. Alternatively, the publication request unit 26 can receive a request for publishing an image from each user without going through the network 16, for example, when each user inputs a request in the server 12.

  Subsequently, the first composite image creation unit 28 creates a first composite image using images included in the second image group of a plurality of users.

  For example, based on the analysis result of each image, the first composite image creation unit 28 extracts a certain number of images as images to be combined from the images included in the second image group of the plurality of users. The size of the synthesis target image, the arrangement position in the first synthesis image, and the like are determined, and a certain number of synthesis target images are arranged (automatic layout) in the arrangement area of the synthesis target image in the first synthesis image. Create

  Subsequently, the image request unit 30 receives one or more images designated by the first user among the plurality of users via the network 16 in accordance with an instruction from the first user. Request to the specified user.

  The image request unit 30 can request an image from the designated user by sending a message requesting the image to the designated user's mail address by e-mail, for example. Alternatively, the image request unit 30 may display an image request message on the terminal device 14 of the designated user on the image display unit of the terminal device 14 of the designated user, for example, without passing through the network 16. Can also be requested from a designated user.

  Subsequently, the second composite image creation unit 32 creates a second composite image using images included in the second image group of the plurality of users and the fourth image group of the first user.

  For example, based on the analysis result of each image, the second composite image creation unit 32 generates a certain number of images from among the images included in the second image group of the plurality of users and the fourth image group of the first user. It is extracted as a synthesis target image, the size of each synthesis target image, the arrangement position in the second synthesis image, etc. are determined, and a certain number of synthesis target images are arranged in the arrangement area of the synthesis target image in the second synthesis image ( A second composite image is created by automatic layout).

  The image acquisition unit 18, the image analysis unit 20, the image extraction unit 22, the disclosure control unit 24, the first composite image creation unit 28, the image request unit 30, and the second composite image creation unit 32 are, for example, a CPU (Central Processing Unit: A control device such as a central processing unit is realized by executing a program loaded in a memory. Data stored by each part is stored in a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), an SD card, or the like.

  Next, FIG. 3 is a block diagram of an embodiment showing the configuration of the user terminal device shown in FIG. The user terminal device 14 shown in FIG. 1 includes an image display unit 34 and an instruction input unit 36.

  In the terminal device 14, the image display unit 34 displays various images, a setting screen, a selection screen, a confirmation screen, an input screen, a creation screen, and the like, and is configured by a display device such as a liquid crystal display.

  Subsequently, the instruction input unit 36 acquires various setting instructions, selection instructions, confirmation instructions, input instructions, creation instructions, and the like input by the user, and includes, for example, an input device such as a keyboard and a mouse. The

  In the case of this embodiment, the image display unit 34 and the instruction input unit 36 are configured by a device in which a display device and an input device are integrated, such as a touch panel.

  Although not shown, the server 12 and the terminal device 14 include, for example, a transmission / reception unit that is a communication device that transmits and receives various data between the server 12 and the terminal device 14, a CPU that controls the operation of each part, The control part etc. which are are provided.

  Next, the operation of the image processing apparatus 10 will be described with reference to the flowchart shown in FIG.

  In the case of this embodiment, as shown in FIG. 5, the plurality of users are users A, B, C, and D, user A is the second user who is the secretary, and user B is the first user. . Also, a first composite image for Mr. W who is the main character and a second composite image for user B are created.

  User A requests users B, C, and D via the network 16 to provide (upload) an image used in the first composite image created for Mr. W. The user A can request the users B, C, and D to provide images by, for example, an SNS (Social Networking Service) message or an e-mail.

  For example, when the user B is requested to provide an image from the user A, the storage device of the terminal device 14 of the user B or the folder created in the storage device including the image group owned by the user B is included. specify.

  When the user B specifies a storage device or folder, the image acquisition unit 18 uses the network 16 as an image group included in the storage device or folder of the user B specified by the user B as the first image group of the user B. Is acquired (step S1). When the image acquisition unit 18 acquires the first image group of the user B, the image acquisition unit 18 creates a user B personal folder in the storage device of the server 12 and stores the user B first image group in the user B personal folder. To do. The same applies to users A, C, and D.

  Each user A, B, C, D only needs to specify the storage device or folder containing the image group owned by himself / herself, and each image included in the enormous number of image groups owned by himself / herself. There is no need to confirm the content of the image, and it is not necessary to select and upload an image to be used in the first composite image for Mr. W from the image group. Therefore, it is possible to save labor and time for that, and it is possible to easily collect a plurality of images used in the first composite image for Mr. W from a plurality of users A, B, C, and D.

  The image acquisition unit 18 may acquire the first image group of each user A, B, C, D immediately after the storage device or folder is designated by each user A, B, C, D. Alternatively, the first image group of each of the users A, B, C, and D may be acquired during a preset night time zone. By acquiring the first image group in the night time zone, it is possible to prevent the users A, B, C, and D from feeling the waiting time for uploading the images.

  The image acquisition unit 18 may acquire all images included in the storage device or folder as the first image group.

  Alternatively, the image analysis unit 20 analyzes each image included in the storage device or folder included in the terminal device 14 of each user A, B, C, D, and the image acquisition unit 18 stores the image in the storage device or folder. Based on the analysis result of each included image, the image that matches the third extraction condition for extracting the image acquired from each user by the image acquiring unit 18 from the images included in the storage device or folder You may get only.

  The third extraction condition is, for example, the image quality and size of the image. As described above, the terminal device 14 of each of the users A, B, C, and D can perform the primary analysis of the images and select the images to be uploaded, thereby reducing the load for transferring the images.

  After the first image group of each user A, B, C, D is acquired, the image analysis unit 20 analyzes each image included in the first image group of each user A, B, C, D. Is performed (step S2).

  Subsequently, in the first composite image created for Mr. W from the first image group of each user A, B, C, D based on the analysis result of each image by the image extraction unit 22. A second image group that matches the first extraction condition for extracting an image to be used is automatically extracted (step S3). When the second image group of each of the users A, B, C, and D is extracted, the image extracting unit 22 creates a personal folder for Mr. W in the storage device of the server 12 as shown in FIG. Store in 's personal folder.

  In the case of the present embodiment, the image extraction unit 22 selects, from the first image group of each user A, B, C, D, according to the degree of matching of the face obtained by the face recognition by the image analysis unit 20. As the second image group, an image showing Mr. W is extracted.

  Here, when creating a photo album, the person who has the most appearances is generally the main character, and the photo album is created using an image that shows the main character, but the person who has the most appearances is always the main character. Not necessarily.

  For example, when a child's graduation school album is created, a plurality of children are protagonists, and based on face recognition by the image analysis unit 20, a graduation album is created using an image taken with friends. There is a need.

  In addition, when creating a wedding anniversary album for a friend who is married, an image at the time of a wedding may be used, or an image at the time of travel before marriage may be used. In this case, for example, by specifying the shooting date or shooting period, shooting location, scene, etc. based on the analysis result of the incidental information of the image by the image analysis unit 20, the image shot on the wedding day, Images taken during a trip can be selected.

  Further, the user B can select one or more images from the first image group of the user B and include them in the second image group of the user B. When the user B selects an image from the first image group of the user B, the image extracting unit 22 further selects the user B as the second image group of the user B from the first image group of the user B. Extract the image selected by. The same applies to users A, C, and D.

  Further, the user B can select one or more images from the second image group of the user B extracted by the image extraction unit 22 and exclude it from the second image group of the user B. When the user B selects an image from the second image group of the user B, the image extraction unit 22 excludes the image selected by the user B from the second image group of the user B. The same applies to users A, C, and D.

  For example, even if an image is determined to be a good image for humans, an image that is determined to be good by a human may not be automatically extracted by automatic image extraction by the image extraction unit 22. On the other hand, even if an image is determined to be a bad image for humans, the image extraction unit 22 may not be able to exclude an image that is determined to be bad by the automatic image extraction unit 22.

  Therefore, in the image processing apparatus 10, each of the users A, B, C, and D subjectively determines an image included in the second image group that is automatically extracted by the image extraction unit 22, and sets the second image group. Images to be included and images to be excluded from the second image group can be selected.

  When the second image group is extracted from the first image group of each of the users A, B, C, and D, only the second image group of the plurality of users A, B, C, and D is obtained by the public control unit 24. Is disclosed to each user A, B, C, D via the network 16 (step S4). That is, the third image group of the users A, B, C, and D is not disclosed (not disclosed).

  When the second image group of the plurality of users A, B, C, and D is disclosed, the disclosure control unit 24 uses the plurality of users A, B, and the passwords that request the users A, B, C, and D to input. , C, D second image group. The password is set by the second user, for example. When the public control unit 24 sets a password for the second image group of the users A, B, C, and D, the second image group of the plurality of users A, B, C, and D It is only open to users who have entered a password that matches the password set in the second image group of C and D.

  Here, the user B can select an image that is not desired to be used in the first composite image from the publicly disclosed second image groups of the users A, B, C, and D as an image that is not to be combined. When the non-combination image is selected by the user B, the image extraction unit 22 excludes the non-combination image selected by the user B from the second image group of the users A, B, C, and D. The same applies to users A, C, and D.

  Further, the user B can select an image that the user B wants to make public from the third image group of the user B that has not been made public. When the user B selects an image to be disclosed from the third image group of the user B, the disclosure control unit 24 further selects a plurality of images selected by the user B from the third image group of the user B. To users A, B, C, and D. The same applies to users A, C, and D.

  Subsequently, the user A instructs the creation of a first composite image for Mr. W via the instruction input unit 36 in the terminal device 14 of the user A.

  When creation of the first composite image is instructed by the user A, the first composite image creation unit 28 includes the second image group of the users A, B, C, and D based on the analysis result of each image. A certain number of images used in the first composite image are extracted as synthesis target images from the images from which images that are not synthesis targets are excluded, and the extracted synthesis target images are synthesized in the first composite image. A first composite image is created by being arranged in the arrangement area of the target image (step S5).

  The first composite image creation unit 28 selects at least one of the plurality of users A, B, C, D from the second image group of the plurality of users A, B, C, D as the composition target image. A first composite image may be created using an image selected by the user.

  As described above, in the image processing apparatus 10, the second image group among the first image groups acquired from the plurality of users A, B, C, and D in order to create the first composite image for Mr. W. The first composite image is automatically created using the image included in the.

  The user A may browse the first composite image automatically created on the terminal device 14 of the user A and adopt the first composite image automatically created as it is, or in the first composite image The image to be used, the size of the image, the arrangement position of the image, etc. may be edited. In addition, it is possible to add a comment, add a stamp image, change the background type and color of the first composite image, and the like.

  Note that it is not essential that only the user A creates the first composite image, and the plurality of users A, B, C, and D may jointly create the first composite image, or the plurality of users A, B , C, D may create a composite image.

  After the first composite image is created, the user B instructs the creation of the second composite image for the user B via the instruction input unit 36 in the terminal device 14 of the user B.

  When the creation of the second composite image is instructed by the user B, the image extraction unit 22 uses the third image group other than the second image group in the first image group of the user B for the user B. A fourth image group that matches the second extraction condition for extracting an image to be used in the second composite image to be created is extracted (step S6).

  Similarly, user B can select one or more images from user B's third image group and include them in user B's fourth image group. When the user B selects an image from the third image group of the user B, the image extraction unit 22 further selects the user B as the fourth image group of the user B from the third image group of the user B. Extract the image selected by. User B may upload a new image. The same applies to users A, C and D.

  Subsequently, based on the analysis result of each image, the second composite image creation unit 32 excluded images that are not to be combined among images included in the second image group of the users A, B, C, and D. A fixed number of images used in the second composite image are extracted from the images and the images included in the fourth image group of the user B as composite target images, and the extracted composite target image is the second composite image. The second synthesized image is created by being arranged in the arrangement area of the synthesis target image at (step S7).

  Note that the second composite image creation unit 32 selects an image selected by the user B from the second image group of the plurality of users A, B, C, and D and the fourth image group of the user B as the composition target image. May be used to create a second composite image for user B.

  As described above, in the image processing apparatus 10, the second image group among the first image groups acquired from the plurality of users A, B, C, and D in order to create the first composite image for Mr. W. The second composite image is automatically created using the images included in the fourth image group of user B.

  User B may browse the automatically created second composite image at the terminal device 14 of user B and adopt the automatically created second composite image as it is, or in the second composite image The image to be used, the size of the image, the arrangement position of the image, etc. may be edited. Further, it is possible to add a comment, add a stamp image, change the background type and color of the second composite image, and the like.

  As described above, in the image processing apparatus 10, a plurality of users A, B, C, and D jointly use a plurality of images acquired from a plurality of users A, B, C, and D to form one composite image. Then, using images acquired from a plurality of users A, B, C, and D, each user A, B, C, and D can create a composite image for themselves. Therefore, it is possible to improve the convenience of each user A, B, C, and D when creating a composite image, and promote the creation of the composite image.

  In addition, each user A, B, C, D, when creating the first composite image, other than the second image group of the users A, B, C, D disclosed via the instruction input unit 36 You can request to publish additional images.

  When each user A, B, C, D requests to publish an additional image, the publishing request unit 26 publishes images other than the second image group from each user A, B, C, D. Request to be accepted.

When the request is accepted by the public request unit 26, the image extraction unit 22 responds to the request by each user A, B, C, D from the third image group of each user A, B, C, D. The selected image is extracted as a public request image.
The public request image is an image included in the third image group, and is not disclosed as the second image group, but is an image disclosed when requested by another user.

  When the disclosure request image is extracted by the image extraction unit 22, the disclosure request image is released by the disclosure control unit 24.

  When the public request image is released, the first composite image creation unit 28 creates a first composite image using the images and public request images included in the second image group of the users A, B, C, and D. In addition, the second composite image creation unit 32 uses the images included in the second image group of the users A, B, C, and D, the public request image, and the images included in the fourth image group of the user B. A second composite image is created.

  Further, when creating a second composite image for the user B, the user B selects an image showing the user B via the instruction input unit 36 as the user B among the users A, C, and D. A request can be made to one or more designated users designated by.

  As shown in FIG. 5, it is assumed that user B requests user D for an image in which user B is shown. In this case, the image request unit 30 requests the terminal device 14 of the user D for an image showing the user B via the network 16 in response to an instruction from the user B.

  The user D receiving the image request selects an image in which the user B is captured from the fourth image group of the user D. When the user D knows the face of the user B, the user D can select an image in which the user B is captured from the fourth image group of the user D.

  When an image is selected by the user D, the image extraction unit 22 includes a fifth image group including an image in which the user B selected by the user D in response to the request from the fourth image group of the user D is shown. To extract. When the image extraction unit 22 extracts the fifth image group from the fourth image group of the user D, the image extraction unit 22 stores the fifth image group in the private folder of the user B created in the storage device of the server 12.

  When the fifth image group is extracted, the second composite image creation unit 32 includes the second image group of the plurality of users A, B, C, and D, the fourth image group of the user B, and the fifth image group of the user D. Is used to create a second composite image for user B.

  The image request unit 30 may send the face image of the user B to the terminal device 14 of the user D via the network 16 when requesting an image showing the user B.

  By sending the face image of user B, even if user D does not know the face of user B, user D refers to the face image of user B from the fourth image group of user D, and You can select an image that contains B.

  Alternatively, when the user D selects an image, the image extraction unit 22 extracts an image showing the user B from the fourth image group of the user D based on the face image of the user B, and the user In the fourth image group of D, an image in which the user B is captured may be highlighted and displayed.

  The method for emphasizing the image in which the user B is captured is not particularly limited. For example, when displaying a list of images included in the fourth image group of the user D, the size of the image in which the user B is captured is a different image. Enlarge the image so that it is larger than the size of the image, place a frame image that decorates the periphery of the image only around the image where user B is shown, or add a star mark to the image where user B is shown Can be displayed.

  In this way, in the fourth image group of user D, by highlighting and displaying the image in which user B is captured, user D can select the face image of user B from the fourth image group of user D. By referring to the image, it becomes easier to select an image in which the user B is captured.

  When an image is selected by the user D, the image extraction unit 22 selects an image in which the user B selected by referring to the face image of the user B by the user D from the fourth image group of the user D is shown. A fifth image group including the extracted images is extracted. The subsequent operation is the same.

  Not only when user B requests an image from user D, but one user among users A, B, C, and D requests an image from one or more other users Is the same.

  In addition, the first image group of the users A, B, C, and D is stored in the storage device of the server 12, and is used, for example, to create another first composite image and another second composite image. Also good. On the other hand, among the first image group, an image group other than the second image group, the fourth image group, and the fifth image group, that is, an image group that is not used in any of the first composite image and the second composite image is appropriate. It may be automatically deleted at the timing.

  In addition, a photo album (photo book) of a paper medium may be created by printing and binding a composite image. Not limited to this, an image including a still image and a moving image on a template may be used as a photo album. An electronic album may be created that is arranged and viewed on the display. Further, as a photo album, a slide show (photo movie) that sequentially displays various contents including still images and moving images acquired from the user without using a template may be created.

  Of the image acquisition unit 18, the image analysis unit 20, the image extraction unit 22, the disclosure control unit 24, the disclosure request unit 26, the first composite image creation unit 28, the image request unit 30, and the second composite image creation unit 32. At least one may be provided in the user terminal device 14.

  In the apparatus of the present invention, each component included in the apparatus may be configured by dedicated hardware, or each component may be configured by a programmed processor and a computer including a processor. The method of the present invention can be implemented, for example, by a program for causing a computer to execute each step. It is also possible to provide a computer-readable recording medium in which this program is recorded.

  Although the present invention has been described in detail above, the present invention is not limited to the above-described embodiment, and it is needless to say that various improvements and modifications may be made without departing from the gist of the present invention.

10 image processing device 12 server 14 terminal device (client)
DESCRIPTION OF SYMBOLS 16 Network 18 Image acquisition part 20 Image analysis part 22 Image extraction part 24 Public control part 26 Public request part 28 1st composite image creation part 30 Image request part 32 2nd composite image creation part 34 Image display part 36 Instruction input part

Claims (20)

An image acquisition unit that acquires a first image group owned by each of a plurality of users;
An image analysis unit for analyzing each image included in the first image group of each of the users;
A first extraction condition for extracting an image to be used in a first composite image jointly created by the plurality of users from the first image group of each user based on the analysis result of each image. A second image group that matches the first image group, and the first user out of a third image group other than the second image group in the first image group of the first user of the plurality of users. An image extraction unit that extracts a fourth image group that matches a second extraction condition for extracting an image to be used in the second composite image created for
A first composite image creating unit that creates the first composite image using images included in the second image group of the plurality of users;
An image processing apparatus comprising: a second composite image creating unit that creates the second composite image using images included in the second image group of the plurality of users and the fourth image group of the first user.   The image acquisition unit acquires, as the first image group of each user, an image group included in the storage device of each user specified by each user or a folder created in the storage device. The image processing apparatus according to claim 1.   The image processing apparatus according to claim 1, wherein the image acquisition unit acquires the first image group of each user in a preset night time zone.   The first extraction condition includes at least one of an image showing a specific person, an image taken within a specific day or within a specific period, an image taken at a specific place, and an image of a specific scene. The image processing apparatus according to claim 1, wherein the number is one.   The image processing apparatus according to claim 1, wherein the second extraction condition is an image showing the first user.   6. The image extracting unit further extracts an image selected by the first user from the first image group of the first user as the second image group of the first user. The image processing apparatus according to any one of the above.   The image extracting unit further extracts an image selected by the first user from the third image group of the first user as the fourth image group of the first user. The image processing apparatus according to any one of the above.   The image processing apparatus according to claim 1, further comprising a public control unit that discloses only the second image group of the plurality of users to the plurality of users.   The image processing according to claim 8, wherein the publication control unit further publishes an image selected by the first user from the third image group of the first user to the plurality of users. apparatus.   The publication control unit sets a password for requesting input to each user when the second image group of the plurality of users is published in the second image group of the plurality of users, The image processing apparatus according to claim 8 or 9, wherein the second image group of the user is disclosed only to a user who has input a password that matches a password set in the second image group of the plurality of users. A publication request unit that accepts a request to publish an image other than the second image group from each of the users;
The image extraction unit extracts, as a public request image, an image selected by each user from the third image group of each user when the request is received by the public request unit.
The publication control unit further publishes the publication request image,
The first composite image creation unit creates the first composite image using an image included in the second image group of the plurality of users and the public request image, according to any one of claims 8 to 10. The image processing apparatus described.   For the first user, the second composite image creating unit uses an image included in the second image group of the plurality of users, the public request image, and an image included in the fourth image group of the first user. The image processing apparatus according to claim 11, wherein the second composite image is created. In response to an instruction from the first user, an image request unit that requests an image of the first user from each of one or more designated users designated by the first user,
The image extraction unit further includes a fifth image including an image of the first user selected in response to the request by each designated user from the fourth image group of each designated user. Extract groups,
The second composite image creation unit uses the images included in the second image group of the plurality of users, the fourth image group of the first user, and the fifth image group of the one or more designated users. The image processing apparatus according to any one of claims 1 to 10, wherein a second composite image for a user is created. The image request unit further sends the face image of the first user to each designated user,
The image extraction unit includes a fifth image in which the first user selected from the fourth image group of each designated user by referring to the face image of the first user by each designated user is shown. The image processing apparatus according to claim 13, wherein an image group is extracted. The image request unit further sends the face image of the first user to each designated user,
The image extraction unit extracts an image of the first user from the fourth image group of each designated user based on the face image of the first user, and further, the first user The first user selected by referring to the face image of the first user by the designated user from the fourth image group of the designated user displayed with the image including The image processing device according to claim 13, wherein a fifth image group including an image in which is shown is extracted.   The first composite image creation unit creates the first composite image using an image selected by at least one user of the plurality of users from the second image group of the plurality of users. The image processing apparatus according to claim 1.   The second composite image creation unit is configured to use the image selected by the first user from the second image group of the plurality of users and the fourth image group of the first user. The image processing device according to claim 1, wherein the second composite image is created. An image acquisition unit acquiring a first image group owned by each of a plurality of users;
An image analysis unit analyzing each image included in the first image group of each user;
An image extraction unit extracts an image to be used in a first composite image jointly created by the plurality of users from the first image group of each user based on the analysis result of each image. A second image group that matches the first extraction condition of the first user, and a third image group other than the second image group of the first image group of the first user of the plurality of users. Extracting a fourth image group that matches a second extraction condition for extracting an image to be used in a second composite image created for the first user;
A first synthesized image creating unit creating the first synthesized image using images included in the second image group of the plurality of users;
A second synthesized image creating unit creating the second synthesized image using images included in the second image group of the plurality of users and the fourth image group of the first user. .   The program for making a computer perform each step of the image processing method of Claim 18.   A computer-readable recording medium on which a program for causing a computer to execute each step of the image processing method according to claim 18 is recorded.