JP2006277227A - Composite image preparation device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To automatically generate a good-looking composite image by optimally arranging a plurality of user images when compositing those user images with each of the image compositing positions of one template image without imposing any labor on any user or operator. <P>SOLUTION: The priority order of a plurality of inputted user images is determined by a priority order determining means 23. On the other hand, a predetermined image having a plurality of image compositing positions is selected from a template DB28, and the priority order of the template image is preliminarily set for the plurality of image compositing positions. A composite image preparing means 24 attaches each user image to the image compositing position of the corresponding priority order of the template image based on the determined priority order of the user image. Thus, it is possible to prepare a good-looking composite image by automatically arranging a plurality of user images on one template image as intended by a designer or the like. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a composite image creation apparatus, and more particularly to a technique for creating a composite image by combining a plurality of user images taken by a user with a single template image.

  A digital camera that electrically records an image with respect to a silver salt camera using a film has an advantage that it can easily process the photographed image. Various services have also been proposed in which an image captured by a digital camera is synthesized with a predetermined template by using such an advantage of ease of processing to create a synthesized image.

For example, Patent Document 1 proposes a system in which a plurality of favorite images are selected from images taken by a digital camera and pasted on a predetermined template to create one original image.
JP 2000-168187 A

  By the way, when combining a plurality of user images at each image combining position of one template image, in the system described in Patent Document 1, which image is combined (pasted) by the user at which image combining position. However, there is a problem that the operation for creating the composite image is complicated.

  On the other hand, when a plurality of user images are automatically combined at each image combining position of one template image, for example, it may be arranged in order according to the shooting date and time of the user images. There is a possibility that the same kind of user images are continuously arranged, or the image is shifted and the resulting composite image looks bad.

  The present invention has been made in view of such circumstances, and automatically synthesizes a plurality of user images at each image composition position of one template image without taking the effort of the user or operator. It is an object of the present invention to provide a composite image creating apparatus that can synthesize (paste) so as to obtain an optimal arrangement and generate a good-looking composite image.

  In order to achieve the above object, the composite image creating apparatus according to claim 1 includes: an image input unit that inputs a plurality of user images; and a priority that determines a priority order of the plurality of user images input from the image input unit. A rank determining unit, a template image storage unit having a plurality of image combining positions and storing a predetermined template image in which priorities are set in advance for the plurality of image combining positions; and the plurality of user images. A composite image creating means for creating a composite image by pasting to a plurality of image composition positions of the predetermined template image, wherein each user image is placed at an image composition position having a priority order corresponding to the priority order of the determined user image. And a composite image creating means to be pasted.

  That is, priorities are assigned to a plurality of input user images. On the other hand, each image composition position of a template image having a plurality of image composition positions is given a priority in advance by a template image designer or the like, for example, and an image composition with a priority order that matches the priority order of each user image. Each user image is pasted to the position. As a result, a plurality of user images can be automatically arranged on a single template image as intended by a designer or the like, and a good-looking composite image can be created.

  The composite image creating apparatus according to claim 1, wherein the priority order determination unit includes an image analysis unit that performs image analysis on each of the plurality of user images, and the analysis by the image analysis unit. The priority order of the plurality of user images is determined based on the result. For example, when the user image is a person image, the person's facial expression (such as emotions) is automatically recognized, and a plurality of user images are classified according to the facial expression recognition result to determine the priority order. Also, a plurality of user images may be classified according to subjects such as people, landscapes, buildings, etc., and priorities may be assigned, or priorities may be assigned according to the image quality of the user images (degrees of out-of-focus and camera shake).

  The composite image creation device according to claim 1 or 2, wherein the priority order determination unit determines the priority order of the plurality of user images based on attached information attached to the user images. It is characterized by doing. For example, the attached information attached to the user image includes information indicating shooting date / time, shooting location (GPS information), image size, and the like. Based on this type of information, a plurality of user images are classified and prioritized. Decide.

  The composite image creating apparatus according to any one of claims 1 to 3, wherein the image input means inputs an image attached to an e-mail transmitted from a user terminal as the user image. The priority order determining means determines the priority order of the plurality of user images based on the comments of the e-mail. For example, a plurality of user images are classified and prioritized according to the presence / absence of a comment and whether the comment includes emotions.

  The composite image creation device according to any one of claims 1 to 4, wherein the template image storage means stores a plurality of template images having different numbers of image composition, and the composite image creation means The image input means selects the number of template images corresponding to the number of user images input and synthesizes the images.

  The composite image creation device according to any one of claims 1 to 5, wherein the template image storage unit stores a plurality of types of template images of different types, and the composite image creation unit includes: A user image is synthesized with a template image of a type selected by the user via the user terminal.

  The composite image creation apparatus according to any one of claims 1 to 6, further comprising a printing unit that prints the composite image created by the composite image creation unit on photographic paper. Yes. The printing means includes those connected to the composite image creating apparatus via a network.

  According to the present invention, a priority order is assigned to a plurality of user images, and user images having the same priority order are pasted to each image composition position of a template image in which a priority order is assigned in advance to the arrangement positions of the user images. Therefore, a plurality of user images can be automatically arranged optimally without taking time and effort of the user or operator, and a good-looking composite image can be generated.

  A preferred embodiment of a composite image creating apparatus according to the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a system configuration diagram showing an embodiment of a system to which a composite image creating apparatus according to the present invention is applied.

  As shown in the figure, this system is a plurality of users photographed with a camera-equipped mobile phone (hereinafter referred to as “user terminal”) 10 owned by the user in a certain facility such as an amusement park or a theme park. It is operated as a service system that creates a composite image by compositing an image with a predetermined template image.

  The system mainly includes a user terminal 10, a system server 20 that functions as a composite image creation apparatus, a print server 30, and a printer 40. The user terminal 10 and the system server 20 include a mobile communication network 50 and the Internet. The system server 20 and the print server 30 can communicate with each other via the Internet 60.

  The user attaches an image (user image) taken in the facility with the user terminal 10 to an e-mail and transmits it to a predetermined e-mail address of the operator of the service.

  The system server 20 receives an e-mail transmitted to the e-mail address, and predetermines user images (or a plurality of user images attached to one e-mail) attached to each of the received e-mails. A composite image is created by pasting the template image. The created composite image is sent to the printer 40 via the print server 30 installed in the facility in accordance with a print order from the user, and printed on photographic paper.

  The user performs a series of processes from photographing of a user image and transmission by e-mail to print order in accordance with e-mail instructions sequentially transmitted from the system server 20. That is, when the service of this system is started, an e-mail in which the contents of the process to be performed by the user is sequentially transmitted from the system server 20 to the user terminal 10, and the user transmits the electronic mail transmitted from the system server 20. By acting in accordance with the instructions described in the mail text, the system server 20 can execute a desired composite image creation process.

  The user terminal 10 includes a general mobile phone having a camera function, an e-mail function, and a WWW browsing function, and is connected to the Internet 60 via a mobile communication network 50.

  The system server 20 includes a server body 25 having a member registration unit 21, an authentication unit 22, a priority order determination unit 23, a composite image creation unit 24, and the like, a member database (DB) 26, an image DB 27, and a template image DB 28. is doing.

  The member DB 26 registers and manages user information (user ID, password, address, name, telephone number, e-mail address, etc.) of the user who receives this system service.

  The image DB 27 stores and manages a user image attached to an e-mail transmitted from each user and a mail text for each user.

  The template image DB 28 stores and manages a plurality of template images. The template image DB 28 stores and manages a plurality of template images corresponding to the number of combined images for combining the user images for each of a plurality of types of template images. In addition, each template image is given a priority of image composition in advance for each image composition position, and the template image DB 28 also manages information indicating the priority order of the image composition position for each template image. .

  FIGS. 2A to 2C are diagrams showing examples of different types of template images.

  FIG. 2A shows an instant film-like template image, which is designed such that 21 instant films are pasted on a bulletin board. An area of each instant film image in the template image is a synthesis area where the user image is synthesized, and a blank area of the instant film is an area where a comment is inserted.

  FIG. 2B shows a template image of a random collage, and the size and arrangement of 14 image composition areas are random.

  FIG. 2C shows an order arrangement template image, in which 36 image composition areas are arranged on the grid.

  For each template image, a priority order for a plurality of image combining positions is determined. This priority order is determined based on which priority user image is pasted at which position when a plurality of user images with priorities are pasted to each composite position by a template image designer. It is decided in consideration. For example, the priority order of each image composition position is determined so that a plurality of user images are moderately scattered on the template image according to the priority order, or user images with high priority order are collected at the center of the template image, and priority is given. A method of determining the priority order of the respective image synthesis positions so as to be arranged in the peripheral part of the template image as the order becomes lower can be considered. In the case of the template image of the random collage shown in FIG. 2B, it can be considered that a high priority is assigned to a composition position where the image composition area is large.

  The server main body 25 has the functions of a WWW (World Wide Web) server and a mail server, acquires necessary information from the member DB 26, the image DB 27, and the template image DB 28, and is transmitted from the user terminal 10 to a plurality of sheets. The priority order of the user images is determined, and a composite image is created by automatically pasting to a plurality of image composition positions to which the required priority order of the template image is attached according to the priority order.

  The composite image created by the system server 20 is sent to the print server 30 via the Internet 60 together with user information. The print server 30 outputs the received composite image to the printer 40 and prints the composite image on photographic paper. The printed composite image is managed with user information and is mailed or handed to the user.

  Next, the processing from the service start to the print creation of the system configured as described above will be described in order.

  First, prior to starting the service, the user performs user registration according to a predetermined procedure. The user accesses a home page provided by the WWW server in the system server 20 by using the browsing function of the user terminal 10 owned by the user. When using the service, the user operates the user terminal 10 to perform user registration. When the user registration is completed, a composite image creation service can be received.

  When receiving the composite image creation service, the user terminal 10 accesses the Web page for the composite image creation service, inputs user information, and logs in.

  After logging in, the user accesses a Web page for selecting a template image of a composite image, and selects a desired template image from a plurality of types of template images presented.

  In this way, when the user registration process is completed and the selection of the template image is completed, the composite image creation service is started.

  Next, processing from the start of service to creation / printing of a composite image will be described with reference to the flowchart shown in FIG.

  In FIG. 3, when the service is started, the user takes a picture at an arbitrary time and place with the user terminal 10 (step S10), attaches the user image obtained by this photography to an e-mail, and sends it to the system server. It transmits to 20 predetermined e-mail addresses (step S12).

  When the system server 20 receives an e-mail attached with a user image from the user terminal 10 (step S20), the system server 20 stores the user image in the image DB 27 in association with the user information. If there is a body of the electronic mail, the text information of the body is also saved. The received e-mail may be stored in the image DB 27 as it is.

  Subsequently, the system server 20 informs the user image 10 of the number of transmitted user images (the total number of transmitted images) and returns an e-mail for accepting the print order to the user terminal 10 (step S22).

  When the user terminal 10 receives the e-mail (step S14), the user confirms the number of transmitted user images and determines whether or not to place a print order (step S16). When the print order is not made, the process returns to step S10, and steps S10 to S16 are repeated. In this way, the user can transmit a desired number of user images to the system server 20.

  On the other hand, if a print order is to be made in step S16, the process proceeds to step S18, and a print order e-mail is transmitted from the user terminal 10 to the system server 20.

  Upon receiving the print order e-mail (step S24), the system server 20 first obtains the total number of user images received from the user who ordered the print, and selects a template image having the same number of image composition positions as the total number. (Step S26). The template image to be selected is selected from the template images selected in advance by the user.

  Subsequently, a plurality of user images of the user who has ordered printing are read from the image DB 27, and the priority order of each user image is determined by the priority order determining means 23 (step S28).

  Hereinafter, a method for determining the priority order of a plurality of user images will be described.

  (1) The priority order is determined by analyzing a plurality of user images.

  When the user image includes a human face image, face parts (eyes, mouth, nose, etc.) are detected after face extraction, and facial expressions (such as emotions) are automatically recognized from the face parts. Then, based on the facial expression recognition result, a plurality of user images are classified and a priority order is determined. For example, a “happy face”, “sad face”, “angry face”, and “normal face” are classified, and priorities are assigned according to these classifications.

  In addition, it automatically recognizes by analyzing whether a user image belongs to a subject such as a person, landscape, building, etc., classifies a plurality of user images by subject, prioritizes the user image, Priorities may be set according to the degree of camera shake.

  (2) The priority order is determined based on the information attached to the user image.

  As in the case of an Exif format image file, the user image has attached information such as shooting date and time, GPS information, image size, and exposure conditions (shutter speed, aperture value, sensitivity) at the time of shooting in a tag format. Therefore, the priority order of the plurality of user images is determined based on the attached information added to the user images. For example, when assigning priorities by shooting date and time, priorities are given in the order of shooting date and time (or late order), or when priorities are given based on GPS information, the order of increasing latitude or longitude ( (Or in ascending order). Also, when priorities are assigned by image size, priorities are assigned in descending order of image size.

  (3) Determine the priority order based on the comments in the email.

  A plurality of user images are classified and prioritized according to whether or not a comment is attached to the e-mail to which the user images are attached, and which of the comments are included in the comments.

  Further, the priority order of a plurality of user images may be given by combining the above priority order determination methods. The method of assigning priorities to a plurality of user images is not limited to this embodiment, and various determination methods can be considered.

  When the priority order of the plurality of user images is determined, the composite image creation unit 24 pastes each user image in accordance with the priority order in each image composition position of the template image selected in step S26 (step S30). That is, each user image is pasted at an image composition position having a priority order that matches the priority order of each user image.

  When the creation of the composite image is completed, the system server 20 displays the composite image on a monitor (not shown) and allows the operator to test the composite image. Here, the operator can appropriately replace the user images so that the composite image becomes a better-looking composite image. When the completion of the composite image verification is received, the system server 20 transmits the user information of the user together with the composite image to the print server 30 via the Internet 60. The transmitted composite image is sent to a printer 40 installed in the facility and printed on photographic paper. The user information sent to the print server 30 is used as information when the printed composite image print is delivered to the user.

  FIG. 4 is a diagram showing a print image of a composite image print in which the composite image automatically created as described above is printed on photographic paper.

  The composite image shown in FIG. 4 is a template image in which 21 user images are combined, and an instant film type is selected as the template image type, and 21 user images are combined with this template image. Has been created.

  In this example of the composite image, 21 user images are automatically recognized as emotional expressions by image analysis, and are “happy face”, “sad face”, “angry face”, and “normal face” In the user images classified in the same “joyful and happy face”, the higher the facial expression recognition point that matches the “happy and happy face”, or the shooting. The priority is determined such that the earlier the date and time, the higher the priority.

  In FIG. 4, A shows a user image of “happy face”, B shows a user image of “sad face”, C shows a user image of “angry face”, and D shows “normal face” Is shown. Further, the priorities assigned to the image composition positions of the template image in FIG. 4 are set so that the 21 user images to which the priorities are assigned are appropriately scattered on one template image.

  In this embodiment, the user image is directly pasted on the template image, but a special effect may be applied to the user image. For example, a characteristic part of a face image is detected by comparison with a reference face image, and image processing for emphasizing (for example, enlarging) the characteristic part is performed, or other modifications, morphing, whitening, color black, sepia Special effects such as tone, black and white, oil painting tone, mosaic, stippling, solarization may be applied. In addition, this special effect may be applied only to a user image synthesized at a specific image synthesis position, or a different special effect may be applied to each image synthesis position.

  In this embodiment, a user-captured camera phone is used as a user terminal to capture a user image, browse a web page, and send / receive an e-mail. The electronic mail transmission / reception means is not limited to this. For example, an image may be taken with a digital camera, the image data may be taken into a notebook computer, a PDA, or the like, and a web page may be browsed and emails may be sent and received using these devices.

  Further, the user images are attached to the e-mail one by one and transmitted to the system server 20. However, the present invention is not limited to this, and a plurality of user images that have been taken and stored are transmitted to the system server 20 at a time. Also good.

  In this embodiment, the image is attached to the e-mail and transmitted, but the means for transmitting the image is not limited to this. For example, the image may be transmitted to a predetermined destination using FTP (File Transfer Protocol), HTTP (HyperText Transfer Protocol), or the like.

  Furthermore, in this embodiment, the created composite image is printed on photographic paper and provided to the user. However, it may be provided to the user as electronic data. For example, the created composite image may be provided by being stored in a CD-ROM or the like, provided by being attached to an e-mail, or downloaded from a predetermined Web page.

FIG. 1 is a system configuration diagram showing an embodiment of a system to which a composite image creating apparatus according to the present invention is applied. FIGS. 2A to 2C are diagrams showing examples of different types of template images. FIG. 3 is a flowchart showing the processing from the start of the composite image creation service according to the present invention to the composite image creation / printing. FIG. 4 is a diagram showing a print image of a composite image print in which a composite image created by the composite image creation apparatus according to the present invention is printed on photographic paper.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... User terminal (mobile phone with a camera), 20 ... System server, 23 ... Priority determination means, 24 ... Composite image preparation means, 26 ... Member DB, 27 ... Image DB, 28 ... Template image DB, 30 ... Print server 40 ... printer, 50 ... mobile communication network, 60 ... internet

Claims (7)

Image input means for inputting a plurality of user images;
Priority order determining means for determining the priority order of a plurality of user images input from the image input means;
Template image storage means for storing a predetermined template image having a plurality of image composition positions and priorities set in advance for the plurality of image composition positions;
Composite image creation means for creating a composite image by pasting the plurality of user images to a plurality of image composition positions of the predetermined template image, the image having a priority order corresponding to the priority order of the determined user image A composite image creating means for pasting each user image at the composite position;
A composite image creating apparatus comprising:   The priority order determination means includes image analysis means for analyzing each of the plurality of user images, and determines the priority order of the plurality of user images based on an analysis result by the image analysis means. The composite image creation device according to claim 1.   The composite image creating apparatus according to claim 1, wherein the priority order determining unit determines the priority order of the plurality of user images based on attached information attached to the user images.   The image input means inputs an image attached to an e-mail transmitted from a user terminal as the user image, and the priority order determination means prioritizes the plurality of user images based on a comment of the e-mail. 4. The composite image creating apparatus according to claim 1, wherein the order is determined.   The template image storage means stores a plurality of template images having different image composition numbers, and the composite image creation means selects a template image having an image composition number corresponding to the number of user images input by the image input means. The composite image creation apparatus according to claim 1, wherein the composite images are combined.   The template image storage means stores a plurality of types of template images of different types, and the composite image creation means synthesizes a user image with a template image of a type selected by a user via a user terminal. The composite image creation apparatus according to any one of claims 1 to 5.   7. The composite image creating apparatus according to claim 1, further comprising a printing unit that prints the composite image created by the composite image creating unit on a photographic printing paper.

Images