JP2003085587A - Composite photograph generating system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a composite photograph generating system capable of composing a 3D decorative image such as a character or an object with a photograph while reflecting the hobby feeling of a user, and having a relation as the image between the content of the photograph and the decorative image. SOLUTION: A geometric data expressing a 3D geometry is stored in a database 21 and distributed to a digital print service machine 10. The image data submitted from a user is fetched into by a media reader 13. A CPU 16 reflects a 3D expression factor and composes the fetched image data of the user with the geometric data of the database 21. The composed image is displayed on a display 12 and printed out by a color printer 15.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a composite photograph generation system for compositing an image acquired by a digital camera or the like with an image of a character or the like for printing.

[0002]

2. Description of the Related Art In recent years, high-resolution digital cameras have become widespread, and it has become possible to print with image quality comparable to conventional silver halide photography. With the spread of this digital camera, an automatic print service machine (digipuri machine) that prints an image of the digital camera and a print service that receives and prints image data on the Web have appeared. The print service is based on the captured image (hereinafter, the photo is basically printed as it is, but in order to add value other than that, services such as frame composition processing that fits the photo in the frame of the illustration etc. are performed. There is.

[0003]

By the way, according to the frame compositing process described above, when composing a picture into a frame, it becomes possible to select the type of frame according to the user's taste. There is. However, since the types of frames are limited, the frames cannot be edited according to the user's preference. Therefore, for users who want their own original frame, such a service feels unsatisfactory, and a service with further added value is desired. Further, since the illustration used for the frame is expressed in a plane, it has little relation to the content of the photograph as an image and has only a decorative function.

The present invention has been made in view of the above circumstances, and a three-dimensional decorative image such as a character or an object is combined with a photograph to reflect the user's taste, and the contents of the photograph and the decorative image are combined. It is an object of the present invention to provide a composite photograph generation system capable of having a relation as an image between them.

[0005]

In order to solve the above problems, the present invention has the following constitution. That is, the composite photograph generation system according to the present invention is provided with data storage means (for example, a component corresponding to the database 21) for storing first image data (3D shape data) expressing a three-dimensional shape, and a user. Data capturing means (for example, a component corresponding to the media reader 13) for capturing the submitted second image data and the second capturing means for reflecting the three-dimensional expression element. Image data and the first stored in the data storage means
Image synthesizing means (for example, an element corresponding to the processing function of the CPU 16) for synthesizing the image data of
An image display unit (for example, a component corresponding to the display 12) that displays the image combined by the image combining unit, and a printing unit (for example, the color printer 15) that prints the image combined by the image combining unit. And the constituent elements that do).

The image synthesizing means has a function of rendering the first image data (3D shape data). The image synthesizing unit reflects, as the three-dimensional expression element, the orientation of the three-dimensional shape, the shape of the shadow, and the direction of the light source represented by the first image data (3D shape data). To do. The data storage means is connected to the image synthesizing means via a network.

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows a configuration example of a composite photograph generation system according to this embodiment. As shown in the figure, this system comprises a digital print service machine 10 and a server 20 having a database 21. The digital print service machine 10 and the server 20 are connected via a network 30.

The digital print service machine 10 includes a touch panel 11 for a user to input information, a display 12 for displaying an image, and a media reader (data capture) for reading the second image data submitted by the user. Means) 13, a settlement processing unit 14 for settlement of service charges, a color printer 1 for printing an image
5, a CPU 16 for controlling the overall operation, a storage device for temporarily storing data, and a communication processing unit 18 for communicating with the server 20 side.

On the other hand, the server 20 is installed on the operator side of this print service, and the database 21 stores image data representing a three-dimensional shape such as characters and objects (hereinafter referred to as 3D shape data). Is stored. The contents of the database 21 can be arbitrarily added, revised or deleted by the administrator of the print service machine.

The operation of this embodiment will be described below with reference to the flow shown in FIG. First, the user of this service operates the touch panel 11 to select the content of the service (step S1). Here, it is assumed that the print service of the 3D character composite photograph is selected.
Then, the user inserts the media of the digital camera into the media reader 13 (step S2). Then, an image to be printed is selected from a list of image data stored in the medium (step S3).

Subsequently, the CPU 16 displays on the display 12 the 3D shape data (3D character) of the synthesizable character. The image data (3D shape data) of this 3D character is distributed from the server 10 to the digital print service machine 10 side via the network.
The user selects a desired character from the 3D characters displayed on the display 12 (step S
4).

Here, the CPU 16 displays the image data of the user selected in step 3 and the image data (3D shape data) of the 3D character selected in step S4 on the display 12 in wire frame. An example of this display is shown in FIG. In the figure, reference symbol A represents a person based on the image data of the user, and reference symbol B represents a 3D character. Usually, the image of the 3D character B is displayed on the image of the user (person A). 3 in the initial state
The D character B is displayed facing forward.

In the following, the CPU will be operated according to the user's instruction.
Under the control of 16, the three-dimensional expression elements are reflected and the image data of the user and the image data of the 3D character (3D
A series of processing for synthesizing the shape data) is executed. That is, the user roughly determines the position of the 3D character B on the selected own image (person A) while looking at the display image on the display 12 (step S5).
Then, the direction and pose of the 3D character B are determined, the position is finely adjusted, and the color, the direction of the light source, and the like are designated (step S6). An example of this is shown in FIG. In the example shown in the figure, the direction of the face of the 3D character B changes from the front to the person A.

Next, the user selects an optional function,
The position of the 3D character B is specified behind the person A. Upon receiving this instruction, the CPU 16 executes a process for extracting the contour figure of the person A, and creates this contour figure as a mask. Then, by overlaying the contour figure on the 3D character B, a part of the 3D character B included in the area of the contour figure is masked to make it look as if the 3D character B is behind the person A (step S7). .

Next, under the control of the CPU 16, the rendering / synthesizing process of the 3D character B is executed (step S8). By this processing, the 3D character b displayed in the wire frame has a surface. A known technique can be used for this rendering synthesis process. As described above, the process of synthesizing the image of the user including the person A and the image of the 3D character is performed. Finally, the user
If there is no problem with the composite image displayed on the display 12, printing is instructed to cause the color printer 15 to print the composite image. When the CPU and the display unit are fast, real-time rendering display is possible instead of wire frame display when the 3D character is arranged. This is the end of the series of processes associated with the print service.

Although the basic operation (function) of this synthetic photograph generation system has been described, in order to add further added value to the printed photograph, this synthetic photograph generation system
It has the following functions. That is, in step S4 described above, the 3D character that the user can select is
Not all of them are always selectable, and they are targeted for selection by the user with a certain appearance rate. By imposing such a condition, the value of the 3D character is enhanced, and the effect of having the collection property is generated.

As conditions for giving this appearance rate, for example, date, time zone, user's constellation, background image feature, and random number are used. Here, according to the method of setting the appearance rate based on the date, for example, a specific 3D character related to the day can be caused to appear on a specific day. According to this method, the user is forced to come and use another character if he / she wants to use another character.

Further, according to the method of using the time zone, it is possible to switch the 3D characters according to the customer base of each time zone, for example. In this case, it becomes difficult for a user in a certain time zone to obtain a 3D character that appears in another time zone, and the value of such a 3D character increases. Further, according to the method of using the constellation of the user, it is possible to replace the 3D character that characterizes each user. In this case, it becomes difficult for each user to obtain the 3D character that appears outside the constellation.

Further, according to the method of using the feature of the background image, it is possible to replace the 3D character with the relation with the content of the photograph. Therefore, even if a certain 3D character is desired, in order to make the character appear, the image data taken at a place having a characteristic related to the character must be presented, which increases the value of the character.

According to the method using random numbers, 3D is randomly generated.
You can switch characters. According to each of the above-mentioned methods, it is possible to intentionally make a desired 3D character appear although it is difficult. However, if the method using a random number is used, the 3D character cannot be intentionally selected, and the rarity value of the character increases. According to the method using random numbers, 3D characters are randomly selected. However, by setting the rank for each character in advance, the higher the rank, the lower the appearance rate may be set. It is possible.

According to the above embodiment, the following effects can be obtained. (1) Capture a photographic image taken with a digital camera,
It is possible to provide a service for generating an image in which 3D characters and objects are combined. (2) Since the 3D character is rendered on the image of the user, the character and the background are blended well.
It also renders pseudo shadows at the same time to make them look more natural. If mixed reality technology is put to practical use in the future, it will be possible to express even the direction of the light source and the shape of the shadow in combination with it. (3) By setting the appearance rate of the 3D characters that can be combined (controlled by setting the conditions for availability), 3D
It is possible to improve the collectability of characters.

Although the embodiment of the present invention has been described above, the present invention is not limited to this embodiment, and is included in the present invention even if there are design changes and the like within the scope not departing from the gist of the present invention. Be done. For example, in the above-described embodiment, the digital print service machine 10 and the server 20 are connected via the network, and the image of the 3D character is distributed from the server 10 to each digital print service machine 10. Without limitation, the database 21 included in the server 20 may be provided on the digital print service machine 10 side. In addition, the digital print service machine 10 and the server 20 (database 2
Although each function of the present invention is realized on the dedicated terminal of 1), each function can be realized by allocating each function to any server or personal computer on the Web. In this case, a form linked to the web for print services is preferable.

[0023]

As described above, according to the present invention, the data storing means for storing the first image data representing the three-dimensional shape and the second image data submitted by the user are fetched. The second image data captured by the data capturing unit and the second image data stored in the data storing unit are combined by reflecting the data capturing unit and the three-dimensional expression element. The image synthesizing means, the image displaying means for displaying the image synthesized by the image synthesizing means, and the printing means for printing the image synthesized by the image synthesizing means are provided, so that the user's hobby can be improved. It is possible to reflect and synthesize a three-dimensional decorative image such as a character or an object with a photograph so that the content of the photograph and the decorative image have a relation as an image.

[Brief description of drawings]

FIG. 1 is a diagram showing an application example of a composite photograph generation system according to an embodiment of the present invention.

FIG. 2 is a flowchart showing an operation of the composite photograph generation system according to the embodiment of the present invention.

FIG. 3 is a diagram showing a display example of a composite image of the composite photo generation system according to the embodiment of the present invention.

[Explanation of symbols]

10; Digital print service machine, 11; Touch panel, 12; Display, 13; Media reader, 1
4; settlement processing unit, 15; color printer, 16; CP
U, 17; storage device, 18; communication processing unit, 20; server, 21; database (3D shape data), 30; network.

Continued front page    F-term (reference) 5B050 AA09 BA06 BA07 BA09 BA12                       CA07 CA08 DA04 EA19 EA30                       FA02 FA03 FA09 FA12                 5B057 AA20 BA02 CA01 CA08 CA12                       CA13 CA16 CA17 CB01 CB08                       CB12 CB16 CC04 CE08                 5C052 AA11 FA02 FA03 FA04 FA06                       FA07 FB01 FB05 FD09 FE08

Claims (4)

[Claims] 1. A data storage means for storing first image data (3D shape data) expressing a three-dimensional shape, and a data acquisition means for acquiring the second image data submitted by a user, 3. An image in which the second image data captured by the data capturing unit and the first image data (3D shape data) stored in the data storing unit are combined by reflecting a dimensional expression element. A composite photograph generation system comprising: a compositing unit, an image display unit for displaying the image composited by the image compositing unit, and a printing unit for printing the image composited by the image compositing unit. 2. The composite photograph generation system according to claim 1, wherein the image composition means has a function of rendering the first image data (3D shape data). 3. The image synthesizing unit reflects, as the three-dimensional expression element, the orientation of a three-dimensional shape represented by the first image data (3D shape data), the shape of a shadow, and the direction of a light source. The composite photograph generation system according to claim 2, wherein 4. The composite photograph generation system according to claim 1, wherein the data storage unit is connected to the image composition unit via a network.