JP2004297350A - Picture distribution device, picture delivery method, and picture distribution program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To composite and distribute a picture corresponding to a photographed picture instead of merely compositing and distributing a picture by means of a portable terminal with a camera, or the like. <P>SOLUTION: Terminal equipment 20 sets a target area for copying the photographed picture and transmits the photographed picture to a picture distribution server 10. The picture distribution server 10 extracts an object picture corresponding to the set area of the received photographed picture and acquires an optionally specified type of a character picture of a pose corresponding to the extracted object picture from a character 1 'Rabbit' pose picture memory 12d, character 2 'Bear' pose picture memory 12e, and character 3 'Cat' pose picture memory 12f. Replacing or adding the photographed picture with or to the object picture entails composition to distribute the object picture to the terminal 20. Thus, replacing or adding the photographed picture with or to an animated picture formed by copying the pose of the range-set object allows composition for distribution instead of merely applying additional composition for distribution to the animated picture in a photographing frame. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image distribution device, an image distribution method, and an image distribution program for distributing an image according to a captured image captured by a camera-equipped mobile terminal or the like.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, among various still cameras and video cameras, there is a type in which a captured image is combined with another image to be displayed or printed and output.
[0003]
For example, one that synthesizes and outputs animated images such as flowers and popular characters prepared in advance at a fixed position of a shooting frame, or that synthesizes and outputs the previously prepared animated image at a desired position in a shooting frame Things are in practical use.
[0004]
In addition, an image captured by a digital camera can be displayed on a display screen of a personal computer and combined with another image for editing. In this case, the other image can be selectively selected from other image files, for example. It is acquired by clipping, downloading from an arbitrary homepage screen on the Internet, or the like, and is synthesized at a desired position on a captured image.
[0005]
Also, an arbitrary region (for example, a face portion) of an image photographed by a digital camera is cut out, and this cut out image is combined with a previously prepared animation image (for example, a face portion of an animation character) to form another new image. There is also a proposal for creating an image or combining an animated image associated with a specified region of an arbitrary image. (For example, refer to Patent Document 1.)
[0006]
[Patent Document 1]
JP 2001-230972 A
[0007]
[Problems to be solved by the invention]
However, in such a conventional image processing system, a previously prepared image is fixed as it is or is synthesized at a desired position and output with respect to a photographed image, or an arbitrary prepared image is prepared in advance. Because it is only for synthesizing and outputting images, synthesized images other than captured images are always fixed and unchanged, and even if various images are downloaded from the Internet and used, Is a mere decoration that has nothing to do with it.
[0008]
The present invention has been made in view of the above-described problem, and does not simply synthesize and deliver a fixed image to an image captured by a terminal, but instead applies an image of an object (for example, a person) in the captured image. It is an object of the present invention to provide an image distribution device, an image distribution method, and an image distribution program that can combine and distribute corresponding images.
[0009]
[Means for Solving the Problems]
That is, in the image distribution device according to claim 1 of the present invention, when a captured image and a target range for the captured image are received from the terminal by the captured image receiving unit, the received image is determined according to the image of the target range of the received captured image. The corresponding image obtained is obtained by the corresponding image obtaining means, and the obtained corresponding image is synthesized with the photographed image by the image synthesizing means, and the synthesized image is transmitted by the synthetic image transmitting means.
[0010]
According to this, it is possible to acquire a corresponding image such as an imitation image corresponding to the image corresponding to the target range set on the image captured by the terminal, and obtain an image synthesized with the captured image.
[0011]
Further, in the image distribution device according to claim 2 of the present invention, in the image distribution device according to claim 1, the target range of the captured image received by the captured image receiving unit is determined by the terminal with respect to the captured image. The image range is set arbitrarily.
[0012]
According to this, it is possible to set the target range on the captured image, which is the reference of the corresponding image to be combined, according to an arbitrary subject or the like.
[0013]
Also, in the image distribution device according to a third aspect of the present invention, in the image distribution device according to the second aspect, the target range of the captured image is an ellipse, and the size and shape are arbitrarily changed and set. Is done.
[0014]
According to this, the target range on the captured image, which is the reference of the corresponding image to be synthesized, can be set as an ellipse of any size and shape so that it can be easily adjusted to any human image.
[0015]
According to a fourth aspect of the present invention, there is provided the image distribution apparatus according to any one of the first to third aspects, wherein the contour block extraction unit receives the image data received by the captured image reception unit. A block corresponding to the contour is extracted from the captured image thus obtained, and among the extracted blocks, an image of a block corresponding to the target range is extracted by target image extracting means. Then, the corresponding image acquiring unit acquires a corresponding image corresponding to the image extracted by the target image extracting unit as a corresponding image to be combined.
[0016]
According to this, a corresponding image corresponding to an image of a contour block such as a subject existing in a target range on a captured image can be acquired and synthesized.
[0017]
According to a fifth aspect of the present invention, there is provided the image distribution apparatus according to any one of the first to fourth aspects, wherein the corresponding image acquisition unit stores a plurality of corresponding images. Image storage means, and similarity evaluation means for evaluating the similarity between an image corresponding to the target range of the captured image received by the captured image reception means and each corresponding image stored by the corresponding image storage means. In accordance with the similarity between the image corresponding to the target range evaluated by the similarity evaluation means and each corresponding image, a corresponding image to be synthesized according to the image in the target range is obtained.
[0018]
According to this, an image having a high degree of similarity (very similar) to a subject image such as a person corresponding to the target range of the captured image can be acquired as a corresponding image to be synthesized.
[0019]
Also, in the image distribution device according to claim 6 of the present invention, in the image distribution device according to any one of claims 1 to 4, the corresponding image acquisition unit may include a plurality of model images and a plurality of model images. A corresponding image storage unit that stores the corresponding image in association with the corresponding image, and a similarity between the image corresponding to the target range of the captured image received by the captured image receiving unit and each model image stored by the corresponding image storage unit. A similarity evaluation unit for evaluating, and, in accordance with the similarity between the image corresponding to the target range evaluated by the similarity evaluation unit and each model image, associating the image with the model image corresponding to the image in the target range. The corresponding image stored by the corresponding image storage means is obtained as a corresponding image to be combined.
[0020]
According to this, an image having a high degree of similarity (very similar) to a subject image such as a person corresponding to the target range of a captured image can be easily and reliably determined as a corresponding image to be synthesized by similarity evaluation using a model image. Can be obtained.
[0021]
Also, in the image distribution device according to claim 7 of the present invention, in the image distribution device according to any one of claims 1 to 6, a plurality of correspondences for different types are provided as the corresponding images. There is an image, and the corresponding image acquired by the corresponding image acquiring unit is a corresponding image of the type received from the terminal by the type receiving unit.
[0022]
According to this, a corresponding image corresponding to a person image corresponding to the target range of the captured image can be obtained as an image to be synthesized from a plurality of corresponding images of a type such as an animal selected by the terminal.
[0023]
An image distribution apparatus according to an eighth aspect of the present invention is the image distribution apparatus according to any one of the first to seventh aspects, further comprising: A charging unit for charging the terminal is provided.
[0024]
According to this, it is possible to provide, as a business, a composite delivery service of an acquired image corresponding to an image corresponding to a target range of a captured image.
[0025]
In the image distribution device according to a ninth aspect of the present invention, in the image distribution device according to the eighth aspect, the amount charged by the charging unit is determined according to the type of the corresponding image acquired by the corresponding image acquiring unit. The amount is assumed.
[0026]
According to this, different amounts can be charged depending on the type of image to be combined (for example, the degree of demand) acquired according to the image corresponding to the target range of the captured image.
[0027]
In the image distribution device according to claim 10 of the present invention, in the image distribution device according to claim 8, the amount charged by the charging means depends on the type of the corresponding image obtained by the corresponding image obtaining means. The copyright fee is included for every certain number of uses or every certain use period.
[0028]
According to this, an image such as a popular character requiring a copyright can be prepared as a type of an image to be synthesized obtained according to the image corresponding to the target range of the captured image, and the service can be provided as a plurality of billing modes. Can be provided.
[0029]
Also, in the image distribution device according to claim 11 of the present invention, in the image distribution device according to any one of claims 1 to 10, the image synthesizing unit receives from the terminal by the synthesizing method receiving unit. The corresponding image obtained by the corresponding image obtaining means is synthesized with the captured image according to the method of synthesizing the obtained images.
[0030]
According to this, the corresponding image acquired according to the image corresponding to the target range of the captured image can be combined with the captured image according to the combining method selected by the terminal.
[0031]
In the image distribution apparatus according to a twelfth aspect of the present invention, in the image distribution apparatus according to the eleventh aspect, the image synthesizing unit includes: The image corresponding to the target range of the photographed image received by the image receiving means is replaced with the corresponding image acquired by the corresponding image acquiring means, and is synthesized with the photographed image.
[0032]
According to this, by selecting the synthesizing method by the terminal, the image corresponding to the target range of the captured image can be replaced with the corresponding image corresponding thereto and synthesized with the captured image.
[0033]
Further, in the image distribution device according to claim 13 of the present invention, in the image distribution device according to claim 11, wherein the image synthesizing means receives the background additional synthesizing method of the image by the synthesizing method receiving means, The corresponding image obtained by the corresponding image obtaining means is added to the background of the captured image and synthesized.
[0034]
According to this, by selecting the combining method by the terminal, a corresponding image corresponding to the image corresponding to the target range of the captured image can be added to the background of the captured image and combined.
[0035]
Further, in the image distribution device according to claim 14 of the present invention, in the image distribution device according to claim 11, wherein the image synthesizing unit receives a left-right inversion synthesizing method of the image by the synthesizing method receiving unit, The corresponding image acquired by the corresponding image acquiring unit is added to the image corresponding to the target range on the captured image at the position where the image is inverted, and is synthesized.
[0036]
According to this, by selecting the combining method by the terminal, the corresponding image corresponding to the image corresponding to the target range of the captured image is added to the image corresponding to the target range on the captured image at the position of left / right inversion and combined You can do it.
[0037]
In the image distribution device according to a fifteenth aspect of the present invention, in the image distribution device according to the eleventh aspect, the corresponding image acquisition unit includes a target area of the first captured image received by the captured image reception unit. Acquisition of a corresponding image corresponding to the image of the above, the image synthesis means, when another shooting synthesis method of the image is received by the synthesis method receiving means, the second captured image received by the captured image receiving means, The corresponding image obtained by the corresponding image obtaining means is synthesized.
[0038]
According to this, by selecting the combination method by the terminal, the corresponding image acquired according to the image in the target range of the first captured image can be combined with the second captured image.
[0039]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0040]
(1st Embodiment)
FIG. 1 is a block diagram showing a configuration of an electronic circuit of the image distribution server 10 in the image distribution system according to the embodiment of the present invention.
[0041]
FIG. 2 is a block diagram showing a configuration of an electronic circuit of the terminal device 20 in the image distribution system.
[0042]
This image distribution system includes various types of mobile telephones 20A, personal digital assistants (PDAs) 20B, personal computers (PCs) 20C, digital cameras 20D, and the like connected from the image distribution server 10 to a communication network such as the Internet and Bluetooth (R). This system provides a service for distributing images to the terminal devices 20. The image distribution server 10 is configured to execute another image corresponding to an arbitrary target image in the captured image acquired by each of the terminal devices 20 (20A to 20D). The image of the character) is synthesized with the photographed image and distributed.
[0043]
In FIG. 1, an image distribution server 10 is configured by a computer which reads a program recorded on various recording media or a transmitted program and whose operation is controlled by the read program. , A CPU (central processing unit) 11.
[0044]
The CPU 11 executes a server control program stored in the memory 12 in advance, a server control program read from an external recording medium 13 such as a CD-ROM into the memory 12 via the recording medium reading unit 14, or a server control program on the Internet N In accordance with a server control program read into the memory 12 from another Web server (in this case, a program server) via the transmission control unit 15, the operation of each circuit is controlled. The server control program is a communication signal from each of the terminal devices 20 (20A to 20C) on the Internet N connected via the transmission control unit 15, or a digital camera 20D connected via the short-range wireless communication unit 16. From the input unit 17 composed of keys and touch panel. It is activated in response to an input signal corresponding to the data operation.
[0045]
The memory 11, the recording medium reading unit 14, the transmission control unit 15, the short-range wireless communication unit 16, the input unit 17, and a display unit 18 including an LCD and a CRT are connected to the CPU 11. .
[0046]
In the memory 12, a communication program for performing data communication with each of the terminal devices 20 (20A to 20C)... A short-range communication program for performing data communication with the digital camera 20D existing within the communication range via the short-range wireless communication unit 16 is stored. For generating, synthesizing, and distributing a corresponding image corresponding to an arbitrary specified target image in the captured image with respect to the captured image obtained from each of the terminal devices 20 (20A to 20D) to be connected with each other. The image distribution processing program 12a and the like are stored.
[0047]
The memory 12 includes a model pose image memory 12b, a modified model pose image memory 12c, a character 1 "rabbit" pose image memory 12d, a character 2 "bear" pose image memory 12e, and a character 3 "cat" pose image memory 12f. , A client terminal information memory 12g is prepared, and a photographed image memory 12h and an image processing work area 12i are prepared in the work area.
[0048]
FIG. 3 shows the character 1 "rabbit" pose image memory 12d: the character 2 "bear" pose image memory 12e: the character 3 "cat" pose image memory 12f of the image distribution server 10 corresponding to each pose. It is a figure showing a character image.
[0049]
The various pose images of the characters stored in the pose image memories 12d, 12e, and 12f of the characters 1 "rabbit", 2 "bear", and 3 "cat" are stored in the external terminal devices 20 connected by communication. (20A to 20D) is used as a simulated image corresponding to the pose of the subject image (target image) on the captured image input in response to a request from the user. Are stored in association with each other.
[0050]
FIG. 4 is a view showing a model image corresponding to the model pose stored in the model pose image memory 12b of the image distribution server 10.
[0051]
The model images of various poses stored in the model pose image memory 12b are stored in a subject image (object image) on a photographed image input in response to a request from each of the externally connected terminal devices 20 (20A to 20D). ) Is used to acquire a similar model image corresponding to the pose of the pose number. Are stored in association with each other, and further, each pose No. Model images of three types of variations A, B, and C are stored every time.
[0052]
The character images stored in the character 1 "rabbit" pose image memory 12d, the character 2 "bear" pose image memory 12e, and the character 3 "cat" pose image memory 12f are stored in the model pose image memory 12b. All stored pose Nos. Character images of the same pose corresponding to (No. 1A, 1B, 1C, 2A, 2B, 2C,..., NA, nB, nC) are prepared and stored.
[0053]
The corrected model image stored in the corrected model pose image memory 12c first has the pose No. shown in FIG. The standard model image of the whole body pose indicated by 2A is corrected vertically and horizontally according to the non-standard subject image (target image). 2A is obtained as a corrected model image corresponding to this pose No. 2A. All the standard model images corresponding to the other poses are corrected according to the correction ratio (correction balance) of the corrected model image corresponding to 2A, and stored in the corrected model pose image memory 12c.
[0054]
In the client terminal information memory 12g, there are terminal devices 20 (20A to 20D) which have requested the image distribution member 10 to register an image distribution member. Each terminal ID and bank account number as personal communication transaction information. , A password, etc. are stored and registered as a member.
[0055]
The photographed image memory 12h temporarily stores photographed image data input from each of the external terminal devices 20 (20A to 20D).
[0056]
Image data processed according to the image distribution processing program 12a is temporarily stored in the image processing work area 12i in accordance with the image processing.
[0057]
In FIG. 2, the terminal device 20 is configured by a computer that reads a program recorded on various recording media or a transmitted program, and whose operation is controlled by the read program. A CPU (central processing unit) 21 is provided.
[0058]
The CPU 21 stores a terminal control program stored in the memory 22 in advance, a terminal control program read from the external recording medium 23 such as a CD-ROM or a ROM card into the memory 22 via the recording medium reading unit 24, or an Internet control program. In accordance with a terminal control program read into the memory 22 from a Web server (in this case, a program server) on the N via the electric transmission control unit 25, the operation of each circuit is controlled. The terminal control program includes an input signal corresponding to a user operation from an input unit 26 including keys and a touch panel, an image signal input from a digital camera (unit) 32 via an image input unit 27a, or a transmission control unit 25. Each Web such as the image distribution server 10 on the Internet N connected via Current position detection in response to a communication signal with the server, a communication signal with the image distribution server 10 connected via the short-range wireless communication unit 28, or the movement of the terminal device 20 from a GPS (global positioning system) 29 Fired in response to a signal.
[0059]
The CPU 21 is connected to the memory 22, a recording medium reading unit 24, an electric transmission control unit 25, an input unit 26, an image input unit 27a, a short-range wireless communication unit 28, a GPS 29, and a display unit 30 including an LCD. And an image printing machine 31 via an image output unit 27b.
[0060]
The image input unit 27 is for inputting captured image data from an externally connected digital camera 32 or a built-in digital camera (unit) 32. For example, the terminal device 20 is used for a mobile phone 20A or a portable terminal device (PDA). In the case of a personal computer (PC) 20C, captured image data from an externally connected digital camera 32 is input. Is entered.
[0061]
The image output unit 27b outputs the photographed image data input from the image input unit 27a and the image data distributed by requesting the image distribution server 10 based on the photographed image. The image data is output to the image printer 31 for printing.
[0062]
The memory 22 includes a system program that controls the overall operation of the terminal device 20 (20A to 20D) and data communication with each Web server such as the image distribution server 10 on the Internet N via the transmission control unit 25. In addition to storing a communication program and a short-range communication program for performing data communication with the image distribution server 10 existing within the communication range via the short-range wireless communication unit 28, a captured image input from the image input unit 27a Communication / image processing program 22a for requesting the image distribution server 10 to perform image processing, displaying image data distributed from the image distribution server 10, and performing print processing via the image output unit 27b based on the Are stored.
[0063]
In the work area of the memory 22, an image processing work area 22b or the like in which image data processed according to the communication / image processing program 22a is temporarily stored according to the image processing is prepared.
[0064]
An outline of the operation of the image distribution system configured as described above will be described.
[0065]
FIG. 5 is a diagram showing a left-right reversal position additional combination state by the character image “rabbit” when the left-right reversal combination mode (4) is designated by the image distribution server 10 based on an image distribution request from the terminal device 20 of the image distribution system. is there.
[0066]
As shown in FIG. 5A, the terminal device 20 captures, for example, a subject image (target image) H that is conscious of dance with a partner in advance, and sets a subject image range T to be imitated for the captured image 12h1. Then, the image distribution server 10 selects the left-right reversal combination mode (4) and requests image distribution.
[0067]
Then, as shown in FIG. 5B, the subject image (target image) H is extracted based on the captured image 12h1 requested to be distributed by the terminal device 20 and the imitation target image range T, and the left-right reversal position addition is performed. When "rabbit" is designated as the character image to be imitated, a pose No. similar to the pose of the subject image (target image) H as shown in FIG. The character image of the "rabbit" of 19 "dance" is read from the character 1 "rabbit" pose image memory 12d. Then, a pose No. similar to the subject image (target image) H read from the character 1 "rabbit" pose image memory 12d. The character image of the “rabbit” of 19 “dance” is horizontally inverted, and is synthesized with the subject (target image) H whose center is symmetric on the captured image 12h1 as shown in FIG. 5D. Then, the composite image with the added left-right reversal position is distributed to the terminal device 20 that has requested the image distribution, and is displayed or printed out.
[0068]
Thereby, in the image distribution server 10, the character image of the “rabbit” imitating the subject (target image) H of the dance pose in which the imitation target image range T is set in the captured image 12h1 of the terminal device 20 is horizontally inverted, A dance partner is additionally synthesized at a position that is symmetrical with the subject (target image) H performing a dance pose on the photographed image 12h1 and distributed to the terminal device 20.
[0069]
FIG. 6 shows the replacement / combination state by the character image “bear” when the image distribution server 10 specifies a plurality of shooting / replacement (different photograph composition) modes (2) based on an image distribution request from the terminal device 20 of the image distribution system. FIG.
[0070]
In the terminal device 20, for example, when it is desired to create an image in which the “bear” character as the replacement image and the subject as the “good-bye” are made, first, as shown in FIG. The subject image (target image) H1 is photographed in the pose of “good-bye”, a subject image range T to be imitated is set for the photographed image 12h2, and the image is distributed to the image distribution server 10 a plurality of times. Request image distribution by specifying (2).
[0071]
Then, as shown in FIG. 6B, the subject image (target image) H1 is extracted based on the first captured image 12h2 requested to be distributed by the terminal device 20 and the imitation target image range T. Then, when “bear” is designated as the replacement character image, a pose number similar to the pose of the subject image (target image) H1 as shown in FIG. The character image of "bear" of 11 "goodbye" is read from the character 2 "bear" pose image memory 12e. In this case, the current time “PM8” is detected, and it is determined that it is night, and the “bear” character image in the “good-bye” pose is read as, for example, a night character image 12e11N on the moon.
[0072]
Next, as shown in FIG. 6D, when the terminal device 20 shoots the subject image H2 of the pose to be the opponent corresponding to the first subject image (target image) H1, the second photographing is performed. As shown in FIG. 6E, a pose No. similar to the first subject image (target image) H1 read from the character 2 "bear" pose image memory 12e is applied to the image 12h2 '. 11 A "bear" character image for the night time of "goodbye" is synthesized. Then, the composite image obtained by the multiple photographing replacement (separate photograph composition) is distributed to the terminal device 20 that has requested the image distribution, and is displayed or printed out.
[0073]
Thereby, in the image distribution server 10, the character image of "good-bye" imitating the subject (target image) H1 in which the imitation target image range T is set in the first captured image 12h2 of the terminal device 20 is displayed. Is synthesized in accordance with the subject (target image) H2 photographed in the second photographed image 12h2 ′, and is distributed to the terminal device 20.
[0074]
FIG. 7 is a diagram showing a replacement synthesis state by the character image “rabbit” when the subject selection replacement mode (1) is designated by the image distribution server 10 based on an image distribution request from the terminal device 20 of the image distribution system.
[0075]
As shown in FIG. 7A, the terminal device 20 captures, for example, subject images (target images) H1 to H3 including three persons, and sets a subject image range T to be imitated for the captured image 12h3. Then, the image distribution server 10 requests the image distribution by designating the subject selection replacement mode (1).
[0076]
Then, in the image distribution server 10, as shown in FIG. 7B, based on the photographed image 12h3 requested to be distributed by the terminal device 20 and the imitation target image range T, the subject image to be replaced (the target image When H1 is extracted and "rabbit" is designated as the replacement character image, a pose No. similar to the pose of the subject image (target image) H1 as shown in FIG. The character image of "rabbit" of 1 "yes cheese (up)" is read from the character 1 "rabbit" pose image memory 12d.
[0077]
On the other hand, as shown in FIGS. 7D, 7E, and 7F, three subject images H2 and H3 including a subject image (target image) H1 corresponding to the imitation target image range T are cut out from the captured image 12h3. The captured background image 12h3 'is generated.
[0078]
Then, as shown in FIG. 7 (G), a character image of a “rabbit” similar to the designated subject image (target image) H1 read from the character 1 “rabbit” pose image memory 12d and the photographed image The remaining two subject images H2 and H3 cut out from 12h3 are combined with the photographic background image 12h3 'in order of the photographic distance from the photographic background image 12h3' corresponding to each subject position. Then, the composite image obtained by the subject selection replacement is delivered to the terminal device 20 that has requested the image delivery, and is displayed or printed out.
[0079]
Thereby, in the image distribution server 10, the character image of “rabbit” imitating the pose of the subject (target image) H <b> 1 in which the imitation target image range T is set in the image 12 h 3 captured by the terminal device 20 is the subject in the range T. The image is replaced with the target image (H1), synthesized, and distributed to the terminal device 20.
[0080]
Although illustration of the outline of the operation is omitted, the image processing mode in the present image distribution system includes the left-right reversal combining mode (4), the multiple image capturing / replacement (different photograph combining) mode (2), In addition to the subject selection and replacement mode (1), there is a background addition mode (3).
[0081]
That is, in the terminal device 20, an arbitrary subject (target image) H is photographed, the subject image range T to be imitated is set for the photographed image 12h3, and the background addition mode (3) is designated to the image distribution server 10. When the image distribution server 10 requests the image distribution, the image distribution server 10 displays an arbitrary character image imitating the pose of the subject (target image) Hn for which the subject image range T is set in the captured image 12hn in the background area of the captured image 12hn. Are additionally synthesized at random positions and distributed to the terminal device 20.
[0082]
Next, a detailed image distribution processing operation by the image distribution server 10 and the terminal device 20 of the image distribution system having the above configuration will be described.
[0083]
Here, a case where the terminal device 20 is implemented as a mobile phone 20A with a digital camera will be described.
[0084]
FIG. 8 is a front view showing an external configuration of a camera-equipped mobile phone 20A which is a terminal device 20 of the image distribution system.
[0085]
FIG. 9 is a diagram showing an operation display state (part 1) associated with a new creation process in the image processing “mimic character workshop” by the camera-equipped mobile phone 20A of the image distribution system.
[0086]
FIG. 10 is a diagram showing an operation display state (No. 2) associated with a new creation process in the image processing “mimic character workshop” by the camera-equipped mobile phone 20A of the image distribution system.
[0087]
FIG. 11 is a diagram showing an operation display state (part 3) associated with a new creation process in the image processing “mimic character workshop” by the camera-equipped mobile phone 20A of the image distribution system.
[0088]
FIG. 12 is a flowchart showing a new creation process (No. 1) in the image processing "mimic character workshop" by the camera-equipped mobile phone 20A of the image distribution system.
[0089]
FIG. 13 is a flowchart showing a new creation process (No. 2) in the image processing "mimic character workshop" by the camera-equipped mobile phone 20A of the image distribution system.
[0090]
FIG. 14 is a flowchart showing a server process (No. 1) corresponding to the new creation of the image process “mimic character workshop” by the image distribution server 10 of the image distribution system.
[0091]
FIG. 15 is a flowchart showing a server process (part 2) corresponding to the new creation of the image process “mimic character workshop” by the image distribution server 10 of the image distribution system.
[0092]
First, in the camera-equipped mobile phone 20A, the image processing site of the image distribution server 10 on the Internet N or in the short-range wireless communication range via the transmission control unit 25 or the short-range wireless communication unit 28 in accordance with the operation of the input unit 26 " When it is connected to the mimic character studio, an initial menu screen G of the mimic character studio is received and displayed as shown in FIG. 9A.
[0093]
In the initial menu screen G of the “imitation character studio”, when the selection sample key 26A of the input unit 26 is operated to select and determine (OK), as shown in FIGS. 9 (A1) and 9 (A2), Sample screens Gs1 corresponding to various image synthesis modes “replacement synthesis mode” (1), “different photo synthesis mode” (2), “background addition synthesis mode” (3), and “left-right inversion synthesis mode” (4) Gs2,... Are selectively received and displayed according to the left / right key operation of the selection determination key 26A.
[0094]
Further, as shown in FIG. 9B, when the selection determination key 26A of the input unit 26 is operated on the initial menu screen G of the “mock character studio” to select and determine (OK) the figure, As shown in FIG. 9 (B1), a screen Gm for explaining how to make the “mimic character workshop” is received and displayed.
[0095]
In this method explanation screen Gm, the method of creating a composite image by the “mimic character studio” is, for example, “(1) Select a photo.” (2) Specify and register the image range of the target (person) to be mimicked "[3] Select a character." [4] Select the method of replacing (compositing) mimic characters. "[5] You can download the completed mimic character image or send it to your friends. "Is displayed.
[0096]
Further, as shown in FIG. 9 (C), on the initial menu screen G of “mimic character studio”, the user operates the selection and determination key 26A of the input unit 26 to select and determine “member registration / usage agreement” (OK). Then, the member registration screen Gr is received and displayed as shown in FIG. 9 (C1).
[0097]
In this member registration screen Gr, a monthly service fee, a character image usage fee, and the like are introduced and displayed, and further, according to a combination operation of the numeric keys “1” and “2”, a usage agreement screen Gr1 as shown in FIG. A registration approval screen Gr2 as shown in FIG. 9 (C3) is received and displayed.
[0098]
When the member registration operation according to the member registration screen Gr is performed, the member personal information such as the terminal ID, password, and bank account number corresponding to the terminal user is stored in the requester terminal information memory 12g of the image distribution server 10. be registered.
[0099]
As shown in FIG. 10 (D), on the camera-equipped mobile phone 20A after the member registration, on the initial menu screen G of the “mimic character workshop”, the “new creation” is operated by operating the selection determination key 26A of the input unit 26. When the selection and determination (OK) are made, the ID and password of the terminal user are transmitted to the image processing site “mimic character workshop” of the image distribution server 10 (step A1).
[0100]
Then, as shown in FIG. 10 (E), from the captured images captured by the mobile phone 20 </ b> A and recorded in the image processing work area 22 b, the user wants to create a photograph to be created in the “imitation character studio”. A photo selection guide screen G1 for selection is displayed (step A2).
[0101]
In the photo selection guide screen G1, according to the left / right key operation of the selection determination key 26A of the input unit 26, for example, as shown in FIGS. 10 (E1) and (E2), the captured images p1 and p1 recorded in the image processing work area 22b. are sequentially read out and displayed (steps A3 → A4).
[0102]
Here, for example, when the photographed image p2 displayed as shown in FIG. 10 (E2) is selected and determined (OK) (step A5), as shown in FIG. 10 (F), the selected photographed image p2 is displayed. A range selection guide screen G2 for setting the image range T of the subject (in this case, a person) to be imitated above by user selection is displayed (step A6).
[0103]
In this range selection guide screen G2, as the selection determination key 26A of the input unit 26 is operated up, down, left and right, as shown in FIGS. 10 (F1) and 10 (F2), in the range setting screen Gp2 in which the photographed image p2 is displayed, The elliptical imitation target image range T is freely moved up and down and left and right (steps A7 → A8), and the numeric keys “2” 26U, “8” 26D, “4” 26L, and “6” 26R are displayed. Along with the operation, the elliptical size of the imitation target image range T is expanded and contracted in the vertical and horizontal directions (steps A7 to A9).
[0104]
Here, for example, in the selection setting state of the imitation target image range T on the range setting screen Gp2 displayed as shown in FIG. 10 (F2), when the determination (OK) operation is performed by the selection determination key 26A of the input unit 26. , An imitation target image range T for the photographed image p2 selected as the creation target of the “imitation character studio” is set (step A7 → A10), and the data of the selected photographed image p2 and the imitation target image range T are stored in the image. The data is transmitted to the distribution server 10 (step A11).
[0105]
The image distribution server 10 receives an ID and a password from the mobile phone 20A with a camera connected via the transmission control unit 15 or the mobile phone with camera 20A connected via the short-range wireless communication unit 16 from the Internet N. Then (step B1), it is determined whether the terminal is "OK" or "NG" according to the match / mismatch with the password of the terminal ID registered as a member in the client terminal information memory 12g in the memory 12 (step B2). .
[0106]
Here, the password of the connected camera-equipped mobile phone 20A does not match the password of the terminal ID registered in advance as a member, and if it is determined that the terminal is “NG”, the password of the camera-equipped mobile phone 20A is determined. The connection is cut off and error processing is performed (step B2 → No).
[0107]
After the image distribution server 10 determines that the terminal is “OK”, the captured image p2 and the data of the imitation target image range T are received from the connected camera-equipped mobile phone 20A determined as the terminal “OK”. Then, the data of the received photographed image p2 and the imitation target image range T are registered in the photographed image memory 12h (step B2 → B3).
[0108]
Then, the basic images 12 d (1) to 12 f (1) of the respective characters that are candidates for corresponding animation images to be added or replaced according to the received captured image p 2 and the imitation target image range T are replaced with the character 1. The character is read from the "rabbit" pose image memory 12d to the character 3 "cat" pose image memory 12f and transmitted to the mobile phone 20A as character list information / image data along with usage information for each character (step B4).
[0109]
In the mobile phone 20A, when the character list information / image data transmitted from the image distribution server 10 is received (step A12), as shown in FIG. A character selection screen G3 for allowing the user to select an arbitrary character to be synthesized as an animation image is displayed (step A13).
[0110]
In this character selection screen G3, each character information received from the image distribution server 10 and its image are displayed according to the left / right key operation of the selection determination key 26A of the input unit 26, for example, as shown in FIGS. 11 (G1) and (G2). Are sequentially switched and displayed as character introduction screens Gc1, Gc2,... For each character (step A14 → A15). In addition, as each character information, a usage fee such as a copyright fee corresponding to the character is displayed as an amount for a predetermined number of uses, a lump sum payment for a predetermined period such as a monthly fee, or the like.
[0111]
Here, for example, in the character introduction screen Gc1 of “rabbit” shown in FIG. 11 (G1), when the “decision” button is designated by operating the right key of the selection decision key 26A of the input unit 26, the additional synthesis to the photographed image p2 is performed. Alternatively, the character type "rabbit" to be replaced and synthesized is selected and determined (steps A14 to A16), and the determined character type "rabbit" is transmitted to the image distribution server 10 (step A17).
[0112]
When the image distribution server 10 receives the character type "rabbit" specified and transmitted from the mobile phone 20A (step B5), the character mimic image synthesis modes (1) to (4) in the "mimic character studio" are set. A mode selection screen G4 for user selection is generated and transmitted to mobile phone 20A (step B6).
[0113]
In the mobile phone 20A, when the mode selection screen G4 generated and transmitted from the image distribution server 10 is received, for example, as shown in FIG. A mode selection screen G4 listing the imitation character image synthesis modes (1) to (4) is displayed together with the range T and the basic image 12d (n) of the character to be synthesized according to the range T (step A18).
[0114]
For example, in the mode selection screen G4 shown in FIG. 11H, when the imitation character replacement synthesis mode (1) is selected and set by operating the numeric key “1” (steps A19 → A20), this selection is made. The number (1) of the mimic character replacement synthesis mode is transmitted to the image distribution server 10 (step A21).
[0115]
When the image distribution server 10 receives the imitation character replacement / combination mode number (1) transmitted from the mobile phone 20A (step B7), the process proceeds to the target image extraction process in FIG. 16 (step BC).
[0116]
FIG. 16 is a flowchart showing a target image extraction process accompanying the server processing in the image distribution server 10 of the image distribution system.
[0117]
In this target image extraction process, first, the captured image pn and its imitation target image range T (see FIG. 10 (F2)) selectively received from the mobile phone 20A and stored in the captured image memory 12h in the work area are read. (Step C1).
[0118]
Then, from the captured image pn read from the captured image memory 12h, based on the adjacent luminance value, color difference value, and the like in the image data, each object (subject) included in the captured image corresponds to the contour of each object (subject). A subject block is extracted (step C2), and each subject image Hn thus extracted is stored in the image processing work area 12i for each block (step C3).
[0119]
In this way, when each subject image Hn included in the taken image pn is extracted from the taken image pn for each block and stored in the image processing work area 12i (step BC), the subject images Hn thus divided into blocks are extracted. Then, the subject image Hn of the block area that best matches the imitation target image range T is extracted and set as the imitation target image (step B8).
[0120]
When the subject image Hn to be imitated is extracted and set, the process proceeds to a corresponding animation image (similar image) acquisition process in FIG. 17 (step BD).
[0121]
FIG. 17 is a flowchart showing a corresponding animation image acquisition process accompanying the server processing of the image distribution server 10 in the image distribution system.
[0122]
In the corresponding animation image acquisition processing, first, the subject image Hn extracted from the photographed image pn according to the imitation target image range T and set as the imitation target image and each pose stored in the model pose image memory 12b. Of the model image having the highest similarity is evaluated (step DE). Is set as the first composite image (step D1).
[0123]
Then, when there is a model image having a pose having the next highest similarity, each pose No. is set for each model image having the next highest similarity. Are sequentially set as the second, third,... Composite images (step D2 → D4).
[0124]
Thereafter, when a selected type of character image A is set as a composite image corresponding to all of the model images of poses having similarities to the subject image Hn set as the imitation target image in sequence, the subject image Hn Each pose No. set in the descending order of similarity with the pose No. Each character image is registered in the order of similarity as an animation image corresponding to the imitation target image (step D2 → D3).
[0125]
As described above, in the corresponding animation image acquisition process in the image distribution server 10, the subject image Hn as the imitation target image extracted and set according to the range T from the image pn captured by the mobile phone 20A is a basic model of a person. The degree of similarity with the model image for each pose is evaluated, and based on this, the selected type of character image to which the subject image Hn is added or replaced as a character with a simulated pose is determined in order of similarity.
[0126]
In this case, an additional or replacement character image is determined by directly evaluating the similarity of the selected type of character to the character image of each pose with respect to the subject image Hn as the imitation target image set in the range T. In comparison with the case, the similarity with the model image for each pose is evaluated, and the selected model pose No. In the present corresponding animation image acquisition process in which the character image to be added or replaced is determined from the above, since a person model is used as the evaluation target of the similarity, a high similarity with the subject image Hn is easily obtained, and the similarity is more improved. There is an advantage that a character image with high character (similarity) can be acquired.
[0127]
FIG. 18 is a flowchart showing the similarity evaluation process with the imitation target image in the corresponding animation image acquisition process accompanying the server process of the image distribution server 10 in the image distribution system.
[0128]
FIG. 19 is a diagram illustrating an example of similarity evaluation with a model image accompanying similarity evaluation processing in the corresponding animation image acquisition processing of the image distribution server 10.
[0129]
For example, as shown in FIG. Is read out (step E1), and the vertical and horizontal sizes of the model image H1 shown in FIG. 8 (X) are matched (step E2).
[0130]
Then, the superimposition evaluation of the imitation target image H1 and the model image whose vertical and horizontal sizes are matched is performed, and the evaluation value (%) is calculated and stored as the degree of similarity with the model image of the pose (step E3). ).
[0131]
Here, the pose number of the similarity evaluation target this time. It is determined whether or not the model image is an asymmetric image (step E4). For example, as shown in FIG. 19A, when it is determined that the model image 12b1A of the pose is not an asymmetric image, (Step E4 “No”), the next pose No. Is read out (steps E8 → E9), and the similarity evaluation processing between the imitation target image H1 and the model image of the next pose is repeated (steps E2 to E4).
[0132]
On the other hand, for example, as shown in FIG. 19 is determined to be a left-right asymmetric model image, the pose No. 19 is determined. The 19 model images are horizontally inverted (steps E4 → E5), and the vertical and horizontal sizes of the inverted model image 12b19R and the imitation target image H1 are matched as shown in FIG. 19C (step E6). ).
[0133]
Then, the superimposition evaluation of the imitation target image H1 and the inverted model image 12b19R whose vertical and horizontal sizes are matched is performed, and the evaluation value (%) is calculated and stored as the similarity with the inverted model image 12b19R of the pose. (Step E7).
[0134]
After this, the next pose No. If there is a model image of the next pose No. (step E8). Are sequentially read out (step E9), and the similarity evaluation process between the imitation target image and the model image for each pose is repeated in the same manner as described above (steps E2 to E7).
[0135]
Thus, for example, as shown in FIG. 19, when the similarity evaluation of the subject image (target image) H1 with the model image is performed, the pose No. The model image 12b19 corresponding to 19 is evaluated as the model image having the pose with the highest similarity.
[0136]
In this way, the subject image Hn as the imitation target image extracted and set from the captured image pn and its range T is imitated by the corresponding animation image acquisition process (step BD) described with reference to FIGS. When the character image of the pose selection type is determined, a standby state is entered for a request to create a composite image from the mobile phone 20A (step B9).
[0137]
In the mobile phone 20A, after the number (1) of the selected imitation character replacement combination mode is transmitted to the image distribution server 10 (step A21), the composite image creation request is transmitted to the image distribution server 10 (step A21). Step A22), the image distribution server 10 receives the composite image creation request transmitted from the mobile phone 20A (step B9), and imitates the first similarity acquired according to the corresponding animation image acquisition process (step BD). A character image is read (step B10).
[0138]
Then, the combination mode numbers of the images selected and received from the mobile phone 20A are number 1 “replacement combination mode”, number 2 “different photo combination mode”, number 3 “additional combination mode”, and number 4 “left / right inverted combination mode”. Is determined (step B11).
[0139]
Here, when it is determined that the combining mode of the image specified by the mobile phone 20A is the “replacement combining mode” (1) (step B11 “number (1)”), for example, as shown in FIG. In addition, the “rabbit” that imitates the pose of the subject H1, which is the imitation target image set in the range T in the captured image 12h3 and obtained by the corresponding animation image obtaining process (see FIG. 17) and read in step B10. Is replaced with the subject (target image) H1 and synthesized (step B12a), and the synthesized image is transmitted to the mobile phone 20A (step B13).
[0140]
In this case, a photographed background image 12h3 'is generated by cutting out three photographed images H2 and H3 including the photographed image (target image) H1 set in the range T from the photographed image 12h3. The character image 12d1 of the first similarity of “rabbit” similar to the subject image (target image) H1 and the remaining two subject images H2 and H3 cut out from the photographed image 12h3 are, for example, the photographing background. The image 12h3 'is synthesized corresponding to each subject position in ascending order of the shooting distance detected at the time of shooting.
[0141]
Note that, without generating a background image 12h3 ′ obtained by cutting out the subject images H1, H2, and H3, a “rabbit” character image 12d1 similar to the subject image (target image) H1 is generated for the captured image 12h3. Alternatively, the remaining two subject images H2 and H3 may be superimposed and synthesized on each subject position in the descending order of the shooting distance detected at the time of shooting.
[0142]
In the mobile phone 20A, for example, in the mode selection screen G4 shown in FIG. 11H, the imitation target image range T is set for the photographed image p2, the "rabbit" character is selected as the type of the imitation character, and the replacement synthesis is performed. When the mode (1) is selected, the first replacement composite image screen Gq1 in which the character image 12d1 of the “rabbit” having the first similarity is replaced and composited as shown in FIG. 11 (H1), the received message is displayed (step A23).
[0143]
In the display state of the first replacement composite image screen Gq1 on the mobile phone 20A, the character image 12d1 of the first similarity “rabbit” displayed by the replacement composite display is changed to the character image 12dn of the next similarity “rabbit”. When the number key "1" for selecting the "replacement combination mode" is further operated in order to replace and display the combined image, the same composite image creation request is repeatedly transmitted to the image distribution server 10 (step A24 → A22).
[0144]
Then, the image distribution server 10 receives a new composite image creation request repeatedly transmitted from the mobile phone 20A (step B14 → B9), and follows the next acquired and registered according to the corresponding animation image acquisition process (step BD). An imitation character image with similarity is read (step B10).
[0145]
Then, the replacement synthesis process in step B12a is repeatedly performed in accordance with the determination of the replacement synthesis mode (1) again in step B11, so that, for example, the imitation target image set in the captured image 12h3 in FIG. The character image 12dn of the second similarity of "rabbit" imitating the pose of the subject H1 is replaced with the subject (target image) H1 and combined (step B12a), and the combined image is newly transmitted to the mobile phone 20A. (Step B13).
[0146]
That is, in the mobile phone 20A, for example, as shown in FIG. 11 (H1), the first replacement composite image screen Gq1 in which the character image 12d1 of the “rabbit” having the first similarity is replaced and composited is displayed. In this state, when the repeat replacement mode (1) is selected by further operating the numeric key “1”, the second similarity-substituted character image 12dn of “rabbit” is replaced and the second replacement process is performed. The replacement composite image screen Gq2 is received and displayed as shown in FIG. 11 (H2) (step A23).
[0147]
On the other hand, when the image distribution server 10 determines that the composite mode of the image designated by the mobile phone 20A is the “simulated character different photo composite mode” (2) (step B11 “number (2)”). For example, as shown in FIG. 6, the position of the subject (target image) H1 set as the imitation target image range T in the first captured image 12h2 is stored as the imitation image replacement position (step B11 → B12b1). ).
[0148]
Then, when the second captured image 12h2 'is obtained (step B12b2), the correspondence between the stored position of the subject (target image) H1 at the time of the first captured image in the second captured image 12h2' is obtained. The character image 12e11N (in this case, a night special character) of the first similarity “bear” imitating the subject H1 acquired by the animation image acquisition process (see FIG. 17) is the second captured image 12h2. ′, The image is combined with the subject H2 photographed in step ′ (step B12b3), and the synthesized image is transmitted to the mobile phone 20A (step B13).
[0149]
Then, on the mobile phone 20A, the different photo composite image transmitted from the image distribution server 10 is received and displayed (step A23).
[0150]
As a result, the image distribution server 10 creates the subject image H1 corresponding to the setting range T of the first shooting as shown in FIG. Image data obtained by combining a character image of a “bear” (a special character for night use) imitating a goodbye pose with a subject image H2 of a second captured image 12h2 ′ is transmitted to the mobile phone 20A and distributed. Is done.
[0151]
In this case as well, each time the imitation character-based photo composition mode (2) is repeatedly selected on the mobile phone 20A (step A22), the image distribution server 10 executes the corresponding animation image acquisition process (see FIG. 17). The acquired character image 12en of “bear” having the next similarity is read out (steps B9 and B10), combined again with the subject H2 photographed in the second photographed image 12h2 ′, and combined (step B11). To B12b3), and the recombined image is transmitted to the mobile phone 20A (step B13).
[0152]
When the image distribution server 10 determines that the combination mode of the image designated by the mobile phone 20A is the “similar character background addition combination mode” (3) (step B11 “number (3)”). ), The imitation target object image acquired by the corresponding animation image acquisition process (see FIG. 17) at a random position in an empty area other than the object block M extracted according to the imitation target image range T in the captured image pn. A character image of the selected type having the first similarity imitating the pose of H1 is additionally synthesized (step B12c), and the synthesized image is transmitted to the mobile phone 20A (step B13).
[0153]
Then, the background-added composite image transmitted from the image distribution server 10 is received and displayed on the mobile phone 20A (step A23).
[0154]
As a result, in the image distribution server 10, a selected type of character image created in accordance with the imitation character background addition / synthesis mode and imitating the pose of the subject image H1 set in the range T is randomly generated in the free area on the captured image pn. The combined image data is transmitted to the mobile phone 20A and distributed.
[0155]
In this case as well, each time the mimicry character background addition / combination mode (3) is repeatedly selected on the mobile phone 20A (step A22), the image distribution server 10 causes the corresponding animation image acquisition process (see FIG. 17). Is read out (steps B9 and B10) and recombined at a random position in a free area on the captured image pn (steps B11n → B12c), and the recomposition is performed. The image is transmitted to mobile phone 20A (step B13).
[0156]
When the image distribution server 10 determines that the combination mode of the image specified by the mobile phone 20A is the “imitation character left / right inversion combination mode” (4) (step B11 “number (4)”) For example, as shown in FIG. 5, the subject (target image) H in a dance pose in which the range T is set in the captured image 12h1 acquired by the corresponding animation image acquisition process (see FIG. 17) is imitated. The character image 12d19 of "Rabbit" is horizontally inverted, and additionally synthesized at a position symmetrical with the subject (target image) H performing a dance pose on the photographed image 12h1 (step B12d), and the synthesized image is transmitted to the mobile phone 20A. It is transmitted (step B13).
[0157]
Then, on the mobile phone 20A, the horizontally inverted composite image transmitted from the image distribution server 10 is received and displayed (step A23).
[0158]
As a result, the image distribution server 10 creates a character image of a “rabbit” that is created in accordance with the left-right reversal combination mode and imitates the dance pose of the subject image H set in the range T, as shown in FIG. Is inverted and synthesized at the opposite position of the subject image H on the captured image 12h1, and the synthesized image data is transmitted to the terminal device 20 and distributed.
[0159]
In this case as well, each time the imitation character left / right reversal synthesis mode (4) is repeatedly selected on the mobile phone 20A (step A22), the image distribution server 10 causes the corresponding animation image acquisition process (see FIG. 17). Is read out (steps B9 and B10), and again invertedly synthesized at the left and right opposite positions of the subject image H on the photographed image 12h1 (step B11). → B12d), this recombined image is transmitted to the mobile phone 20A (step B13).
[0160]
As described above, based on the image captured by the camera-equipped mobile phone 20A, the additional synthesizing process or the replacing synthesizing process using the selected type of character image in which the subject image Hn set in the range T is the imitation target image is performed by the image distribution server 10. When the composite image is delivered to the mobile phone 20A and displayed, and the copy character composite image is determined (OK) by the selection determination key 26A of the input unit 26, the selected copy is determined. The character composite image is registered in the image processing work area 22b (steps A24 to A25), and the selection determination information for the current imitation character composite image is transmitted to the image distribution server 10 (step A26).
[0161]
When the image distribution server 10 receives the selection decision information about the current imitation character composite image transmitted from the mobile phone 20A, the imitation character composite image is registered in the image processing work area 12i in association with the user ID. (Step B14 → B15), and the registration completion information is transmitted to the mobile phone 20A (Step B16).
[0162]
Then, in the mobile phone 20A, as shown in FIG. 11 (I), for example, the imitation character composite image (in this case, the first replacement composite image screen Gq1) and its registration completion message are displayed together with the selected and determined imitation character composite image. A composite image registration screen G5 displaying a message prompting distribution to friends is displayed (step A27).
[0163]
When the user wants to send the composite image distributed to the mobile phone 20A to the designated partner terminal, he designates the “Give” button on the composite image registration screen G5, as shown in FIG. 11 (I1). A transmission information setting screen G6 is displayed. In the transmission information setting screen G6, the user's name, the destination address of the designated partner terminal, a message, and the like are input according to the operation of the input unit 26, and the image distribution server 10 It is transmitted (step A27 → A28).
[0164]
When the image distribution server 10 receives the destination address of the specified destination terminal and the sender's name and message transmitted from the mobile phone 20A (step B17), the specified destination terminal according to the destination address is received. The composite image / name / message is transmitted to the device 20 '(step B18), and the billing contents composed of the user of the requester of the current image distribution and the transmission of the designated terminal are calculated, and the mobile phone 20A of the distribution requester is calculated. (Step B19).
[0165]
Then, in the mobile phone 20A of the distribution request source, the billing contents of the server use including the transmission of the composite image to the designated partner terminal transmitted from the image distribution server 10 are received and displayed on the display unit 30. (Step A29).
[0166]
On the other hand, if the destination address is not input / transmitted to the designated partner terminal in the mobile phone 20A (step A27 → No), the image distribution server 10 includes only the user who has requested the current image distribution. The billing content is calculated and transmitted to the mobile phone 20A of the distribution request source (step B17 → B20).
[0167]
Then, the mobile phone 20A of the distribution request source receives the server use billing content for only the distribution request source user transmitted from the image distribution server 10 and displays it on the display unit 30 (step A30).
[0168]
Then, in the image distribution server 10, a server usage fee corresponding to the calculated accounting content is charged to the bank account corresponding to the distribution request source terminal registered in the client terminal information memory 12g (step). B21).
[0169]
Note that the charging process for the user may be charging for each number of times of use, such as once, or charging for a fixed period such as every month.
[0170]
Therefore, according to the image distribution processing function of the image distribution system having the above-described configuration, an image captured by the terminal device 20 such as the mobile phone with a digital camera 20A is set to the image capture target image range T and the image distribution server 10 Upon transmission, the image distribution server 10 extracts a subject image corresponding to the imitation target image range T of the received captured image, and also displays a character image of an arbitrary type in a pose corresponding to the extracted subject image. The character 1 “rabbit” pose image memory 12d, the character 2 “bear” pose image memory 12e, and the character 3 “cat” pose image memory 12f are obtained and synthesized by replacing or adding a subject image in the captured image. Since it is distributed to the device 20, simply add and synthesize a fixed animation image in the shooting frame. Instead of trust, it is possible to create deliver the very photographic image of fun with animation by replacing or adding synthetic animated image that mimics the pose of the subject that was set in the range T.
[0171]
By using the image distribution server 10 in such an image distribution system, a mail-with-image distribution service in which a character image in a pose imitating a subject image corresponding to an arbitrary setting range T of a captured image is synthesized by adding or replacing the character image. , An image synthesis fee-based distribution that performs a synthetic distribution of a character image imitating a subject pose corresponding to a set range T to each photographed image for mobile terminal devices 20B, 20C, and 20D capable of photographing, such as a mobile phone 20A with a digital camera. A service that adds or replaces a specific character for promoting a specific character on a specific homepage as a character image that imitates the subject pose corresponding to the setting range T of the photographed image, and combines and combines it for paid or free delivery, as well as an amusement spot. Only specific places in Etc. can be realized Oite short distance synthesis paid distribution services popular character image imitating the object poses to target setting range T of the captured image in the digital camera terminal device 20D is connected through a radio communication unit 16.
[0172]
In the above embodiment, a character image of a pose corresponding to a subject extracted corresponding to the imitation target image range T is selectively obtained from a captured image, and an image is synthesized by addition or replacement. However, face images and person images of various facial expressions by actual shooting are stored in advance, and the face images and person images by actual shooting are acquired as imitative images corresponding to subjects extracted from the captured image, and added or replaced. It may be configured to combine images.
[0173]
Further, in the above-described embodiment, the case where the captured image is a still image has been described. However, when the captured image is a moving image, the setting range from the captured and input moving image to the background image in the moving image is set. T sequentially extracts subject images that change in a time series corresponding to T, selectively obtains and distributes a character image of a pose for a moving image corresponding to each of the sequentially extracted subject images, or distributes the image in the captured moving image. The video may be added to or replaced with the subject and synthesized.
[0174]
Further, the image processing function of the image distribution server 10 or the terminal device 20 in the above-described embodiment is applied, and an image of a character that is arbitrarily specified and extracted based on a moving image such as a game is set as a similar target image. Alternatively, a desired character image prepared in advance or a human image based on a real image may be acquired and distributed, or may be replaced with the appearing character and compositely distributed.
[0175]
In addition, a character image in the memory 12 of the image distribution server 10 can be used to capture a subject image of various poses photographed by the user himself or a character image of various poses appearing in a game downloaded by the user himself from a game server (game HP) on the Internet N. 1 "Rabbit" pose image memory 12d, character 2 "Bear" pose image memory 12e, character 3 "cat" pose image memory 12f, etc., are registered in the same manner as in the above embodiment. When the image distribution server 10 acquires a character image in a pose corresponding to the subject image extracted correspondingly, the character image originally registered such as “rabbit”, “bear”, “cat” and the user himself Configuration that can select and acquire and combine the person images and game character images registered in It may be.
[0176]
The method of each processing by the image distribution system described in the above embodiment, that is, a new creation processing in the image processing by the terminal device 20 shown in the flowcharts of FIGS. 12 and 13, and the image shown in the flowcharts of FIGS. A server process corresponding to the new creation by the distribution server 10, a target image extraction process accompanying the server process by the image distribution server 10 shown in the flowchart of FIG. 16, and a corresponding animation image accompanying the server process by the image distribution server 10 shown in the flowchart of FIG. Each of the acquisition processing and the similarity evaluation processing with the imitation target image accompanying the corresponding animation image acquisition processing by the image distribution server 10 shown in the flowchart of FIG. 18 is a memory card as a program that can be executed by a computer. (ROM card, RAM card, etc.), magnetic disk Click (floppy disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.) can be distributed and stored in an external recording medium such as a semiconductor memory 13 (23). Various computer terminals having a communication function with the communication network (Internet) N store the program stored in the external recording medium 13 (23) into the memory 12 (22) by the recording medium reading unit 14 (24). By reading and controlling the operation by the read program, the image distribution processing function described in the above-described embodiment can be realized, and the same processing can be performed by the above-described method.
[0177]
Further, data of a program for realizing each of the above methods can be transmitted on a communication network (Internet) N in the form of a program code, and a computer terminal connected to the communication network (Internet) N transmits the program data. By taking in program data, it is also possible to realize the image distribution processing function described above.
[0178]
It should be noted that the present invention is not limited to the above-described embodiments, and can be variously modified in an implementation stage without departing from the scope of the invention. Furthermore, the embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some components are deleted from all the components shown in each embodiment or some components are combined, the problem described in the section of the problem to be solved by the invention can be solved. In the case where the effects described in the section of the effects of the invention can be obtained, a configuration in which this component is deleted or combined can be extracted as the invention.
[0179]
【The invention's effect】
As described above, according to the image distribution apparatus according to the first aspect of the present invention, when a captured image and a target range for the captured image are received from the terminal by the captured image receiving unit, the target of the received captured image is A corresponding image corresponding to the image in the range is acquired by the corresponding image acquiring unit, and the acquired corresponding image is combined with the photographed image by the image combining unit, and the combined image is transmitted by the combined image transmitting unit. , A corresponding image such as an imitation image corresponding to the image corresponding to the target range set on the captured image can be obtained, and an image synthesized with the captured image can be obtained.
[0180]
Further, according to the image distribution device of the present invention, in the image distribution device of the first aspect, the target range of the photographed image received by the photographed image receiving means is the same as that of the photographed image in the terminal. , The range of the image is set arbitrarily, so that the target range on the captured image, which is the reference of the corresponding image to be synthesized, can be set according to an arbitrary subject or the like.
[0181]
Further, according to the image distribution device of the third aspect of the present invention, in the image distribution device of the second aspect, the target range of the captured image is an ellipse, and the size and shape thereof are arbitrarily changed. Therefore, the target range on the captured image, which is the reference of the corresponding image to be synthesized, can be set as an ellipse of any size and shape so that it can be easily set to any human image.
[0182]
According to a fourth aspect of the present invention, there is provided the image distribution apparatus according to any one of the first to third aspects, wherein the photographed image receiving unit is provided by the contour block extracting unit. The block corresponding to the contour is extracted from the photographed image received by (1), and among the extracted blocks, the image of the block corresponding to the target range is extracted by the target image extracting means. Then, in the corresponding image obtaining means, a corresponding image corresponding to the image extracted by the target image extracting means is obtained as a corresponding image to be synthesized. A corresponding image corresponding to the image can be acquired and synthesized.
[0183]
According to a fifth aspect of the present invention, in the image distribution apparatus according to any one of the first to fourth aspects, the corresponding image acquisition unit stores a plurality of corresponding images. Corresponding image storage means, and similarity evaluation means for evaluating the similarity between an image corresponding to the target range of the captured image received by the captured image reception means and each corresponding image stored by the corresponding image storage means. Since the corresponding image to be synthesized according to the image of the target range is obtained according to the similarity between the image corresponding to the target range evaluated by the similarity evaluation unit and each corresponding image, the captured image An image having a high degree of similarity (very similar) to a subject image such as a person corresponding to the target range can be obtained as a corresponding image to be synthesized.
[0184]
Further, according to the image distribution device according to claim 6 of the present invention, in the image distribution device according to any one of claims 1 to 4, the corresponding image acquisition unit includes a plurality of model images and A corresponding image storage unit that stores a plurality of corresponding images in association with each other, and a similarity between an image corresponding to a target range of the captured image received by the captured image receiving unit and each model image stored by the corresponding image storage unit. A similarity evaluation unit that evaluates the degree, and according to the similarity between the image corresponding to the target range evaluated by the similarity evaluation unit and each model image, a model image corresponding to the image of the target range is obtained. Since the corresponding image stored by the corresponding image storage means is obtained as a corresponding image to be combined, the similarity is high (similar to the subject image such as a person corresponding to the target range of the captured image). An image, the similarity evaluation using model image, it becomes possible to obtain easily and securely as the corresponding image to be synthesized.
[0185]
Further, according to the image distribution device according to claim 7 of the present invention, in the image distribution device according to any one of claims 1 to 6, wherein the corresponding image is provided for each of different types. Since the corresponding image acquired by the corresponding image acquiring unit is the corresponding image of the type received from the terminal by the type receiving unit, the corresponding image of the plurality of types such as the animal selected by the terminal is displayed. From inside, a corresponding image corresponding to a person image or the like corresponding to the target range of the captured image can be acquired as an image to be synthesized.
[0186]
Further, according to the image distribution apparatus according to claim 8 of the present invention, the image distribution apparatus according to any one of claims 1 to 7, further comprising: Since the charging means for charging the terminal in response thereto is provided, it is possible to provide, as a business, a composite delivery service of the acquired image corresponding to the image corresponding to the target range of the captured image.
[0187]
Further, according to the image distribution device of the ninth aspect of the present invention, in the image distribution device of the eighth aspect, the amount charged by the charging means is determined by the type of the corresponding image acquired by the corresponding image acquiring means. Since the price is set according to the type of the image to be combined (for example, the degree of demand) acquired according to the image corresponding to the target range of the captured image, different amounts can be charged.
[0188]
According to a tenth aspect of the present invention, there is provided the image distributing apparatus according to the eighth aspect, wherein the amount charged by the charging means includes the type of the corresponding image acquired by the corresponding image acquiring means. Since the copyright fee is included for each of a certain number of uses or for a certain period of use according to the type of image to be synthesized obtained according to the image corresponding to the target range of the photographed image, a popular character requiring a copyright fee is included. Images can be prepared, and a service can be provided as a plurality of billing modes.
[0189]
Further, according to the image distribution device of the present invention, in the image distribution device of any one of the above-mentioned claims, the image synthesizing means may include a synthesizing method receiving means. The corresponding image obtained by the corresponding image obtaining means is synthesized with the captured image according to the method of synthesizing the image received from the device, and the corresponding image obtained according to the image corresponding to the target range of the captured image is selected by the terminal. According to the combining method performed, the image can be combined with the photographed image.
[0190]
Further, according to the image distribution device of the present invention, in the image distribution device according to the eleventh aspect, the image synthesizing unit is configured to receive the image replacement synthesizing method by the synthesizing method receiving unit. The image corresponding to the target range of the captured image received by the captured image receiving unit is replaced with the corresponding image acquired by the corresponding image acquiring unit and combined with the captured image. An image corresponding to the target range of the image can be replaced with a corresponding image corresponding to the image and combined with the captured image.
[0191]
Further, according to the image distribution device of the present invention, in the image distribution device according to the eleventh aspect, the image synthesizing unit receives the background additional synthesizing method of the image by the synthesizing method receiving unit. In this case, the corresponding image obtained by the corresponding image obtaining unit is added to the background of the captured image and synthesized, so that the corresponding image corresponding to the image corresponding to the target range of the captured image is selected by the terminal by selecting the synthesis method. It can be added to the background of the captured image and synthesized.
[0192]
According to the image distribution device of the present invention, in the image distribution device of the eleventh aspect, the image synthesizing unit receives the left-right reversal synthesizing method of the image by the synthesizing method receiving unit. In this case, the corresponding image acquired by the corresponding image acquiring unit is added to the image corresponding to the target range on the captured image at the position where the image is flipped horizontally, and then combined. A corresponding image corresponding to the image corresponding to the target range can be added and combined with the image corresponding to the target range on the captured image at the left-right inverted position.
[0193]
Further, according to the image distribution device according to claim 15 of the present invention, in the image distribution device according to claim 11, wherein the corresponding image acquisition unit is configured to output the first captured image received by the captured image reception unit. A corresponding image corresponding to the image in the target range is acquired, and the image synthesizing unit receives the second photographed image received by the photographed image receiving unit when another photographing and synthesizing method of the image is received by the combining method receiving unit. The corresponding image obtained by the corresponding image obtaining means is synthesized, and the corresponding image obtained in accordance with the image in the target range of the first captured image is converted into the second image by selecting the synthesis method by the terminal. It becomes possible to combine images.
[0194]
Therefore, it is possible to combine and deliver an image corresponding to an object (for example, a person) image in the captured image, instead of simply synthesizing and delivering a fixed image to an image captured by the terminal. A distribution device (an image distribution method and an image distribution program) can be provided.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration of an electronic circuit of an image distribution server in an image distribution system according to an embodiment of the present invention.
FIG. 2 is a block diagram showing a configuration of an electronic circuit of a terminal device 20 in the image distribution system.
FIG. 3 shows a character 1 “rabbit” pose image memory 12d of the image distribution server 10; a character 2 “bear” pose image memory 12e; and a character 3 corresponding to various poses stored in a “cat” pose image memory 12f. The figure which shows each character image.
FIG. 4 is a view showing a model image corresponding to a model pose stored in a model pose image memory 12b of the image distribution server 10;
FIG. 5 is a diagram illustrating a left-right reversal position additional combination state by a character image “rabbit” when the left-right reversal combination mode (4) is designated by the image distribution server 10 based on an image distribution request from the terminal device 20 of the image distribution system. .
FIG. 6 shows a state of replacement and synthesis by a character image “bear” when the image delivery server 10 specifies a plurality of shooting and replacement (separate photograph synthesis) mode (2) based on an image delivery request from the terminal device 20 of the image delivery system. FIG.
FIG. 7 is a diagram showing a replacement / combination state using a character image “rabbit” when an object selection / replacement mode (1) is designated by the image distribution server 10 based on an image distribution request from a terminal device 20 of the image distribution system.
FIG. 8 is a front view showing an external configuration of a camera-equipped mobile phone 20A which is a terminal device 20 of the image distribution system.
FIG. 9 is a diagram showing an operation display state (No. 1) associated with a new creation process in the image processing “mimic character studio” by the camera-equipped mobile phone 20A of the image distribution system.
FIG. 10 is a diagram showing an operation display state (No. 2) associated with a new creation process in the image processing “mimic character workshop” by the camera-equipped mobile phone 20A of the image distribution system.
FIG. 11 is a diagram showing an operation display state (part 3) associated with a new creation process in the image processing “mimic character workshop” by the camera-equipped mobile phone 20A of the image distribution system.
FIG. 12 is a flowchart showing a new creation process (No. 1) in the image processing “mimic character workshop” by the mobile phone with camera 20A of the image distribution system.
FIG. 13 is a flowchart showing a new creation process (No. 2) in the image processing “mimic character workshop” by the mobile phone with camera 20A of the image distribution system.
FIG. 14 is a flowchart showing a server process (1) corresponding to a new creation of an image process “mimic character workshop” by the image distribution server 10 of the image distribution system.
FIG. 15 is a flowchart showing a server process (part 2) corresponding to a new creation of an image process “imitation character studio” by the image distribution server 10 of the image distribution system.
FIG. 16 is a flowchart showing a target image extraction process associated with server processing in the image distribution server 10 of the image distribution system.
FIG. 17 is a flowchart showing a corresponding animation image acquisition process associated with server processing of the image distribution server 10 in the image distribution system.
FIG. 18 is a flowchart showing a similarity evaluation process with the imitation target image in the corresponding animation image acquisition process accompanying the server process of the image distribution server 10 in the image distribution system.
FIG. 19 is a diagram showing an example of similarity evaluation with a model image accompanying similarity evaluation processing in the corresponding animation image acquisition processing of the image distribution server 10.
[Explanation of symbols]
10 ... image distribution server
11 ... Server CPU
12… server memory
12a: Image distribution processing program
12b: Model pose image memory
12c: Modified model pose image memory
12d ... Character 1 "Rabbit" pose image memory
12e ... Character 2 "bear" pose image memory
12f ... Character 3 "cat" pose image memory
12g: Client terminal information memory
12h: Photographed image memory
12i: Image processing work area
13… server external recording medium
14: Server recording medium reading unit
15: Server transmission control unit
16… server short-range wireless communication unit
17… server input section
18… server display
20… Terminal device
20A: Mobile phone terminal
20B… Mobile terminal (PDA)
20C Terminal (PC)
20D ... Digital camera terminal
21… Terminal CPU
22 ... terminal memory
22a: Communication / image processing program
22b: Image processing work area
23 ... terminal external recording medium
24 ... terminal recording medium reading unit
25 ... terminal transmission control unit
26 ... terminal input section
26A… Selection key
27a ... Image input unit
27b ... Image output unit
28… Terminal short-range wireless communication unit
29 ... GPS
30 Terminal display unit
31 ... Image printing machine
32… Digital camera (part)
N: Communication network (Internet)
G… “Mimi Character Studio” initial menu screen
G1: Photo selection guide screen
G2: Range selection guide screen
G3: Character selection screen
G4: Mode selection screen
G5: Composite image registration screen
G6: Transmission information setting screen

Claims (17)

A captured image receiving means for receiving a captured image and a target range for the captured image from the terminal,
A corresponding image acquiring unit that acquires a corresponding image corresponding to an image in a target range of the captured image received by the captured image receiving unit;
Image synthesizing means for synthesizing the corresponding image obtained by the corresponding image obtaining means with the captured image,
Combined image transmitting means for transmitting the image combined by the image combining means;
An image distribution device comprising: 2. The image distribution apparatus according to claim 1, wherein the target range received by the captured image receiving unit is an image range arbitrarily set for the captured image in the terminal. 3. The image distribution apparatus according to claim 2, wherein the target range is an ellipse, and the size and shape are arbitrarily changed and set. further,
Contour block extracting means for extracting a block corresponding to a contour from the photographed image received by the photographed image receiving means,
A target image extracting unit that extracts an image of a block corresponding to the target range among the blocks extracted by the contour block extracting unit;
4. The image distribution device according to claim 1, wherein the corresponding image acquiring unit acquires a corresponding image corresponding to the image extracted by the target image extracting unit. 5. The corresponding image obtaining means,
Corresponding image storage means for storing a plurality of corresponding images,
A similarity evaluation unit that evaluates a similarity between an image corresponding to the target range of the captured image received by the captured image reception unit and each corresponding image stored by the corresponding image storage unit,
4. The image processing apparatus according to claim 1, wherein a corresponding image corresponding to the image of the target range is acquired according to the similarity between the image corresponding to the target range evaluated by the similarity evaluation unit and each corresponding image. 5. The image distribution device according to claim 4. The corresponding image obtaining means,
Corresponding image storage means for storing a plurality of model images and a plurality of corresponding images in association with each other,
A similarity evaluation unit that evaluates a similarity between an image corresponding to the target range of the captured image received by the captured image reception unit and each model image stored by the corresponding image storage unit,
According to the similarity between the image corresponding to the target range evaluated by the similarity evaluation unit and each model image, the image is stored by the corresponding image storage unit in association with the model image corresponding to the image in the target range. The image distribution device according to claim 1, wherein a corresponding image is acquired. In the corresponding image, there are a plurality of corresponding images for different types,
Comprising a type receiving means for receiving the type of the corresponding image from the terminal,
The image distribution apparatus according to claim 1, wherein the corresponding image acquired by the corresponding image acquisition unit is a type of corresponding image received by the type receiving unit. . further,
The image distribution apparatus according to claim 1, further comprising a charging unit configured to charge the terminal according to transmission of an image by the composite image transmission unit. 9. The image distribution apparatus according to claim 8, wherein the amount charged by the charging unit is a price corresponding to a type of the corresponding image acquired by the corresponding image acquiring unit. 9. The method according to claim 8, wherein the amount charged by the charging unit includes a copyright fee for each of a certain number of uses or for a certain period of use according to the type of the corresponding image obtained by the corresponding image obtaining unit. Image distribution device. further,
A synthesizing method receiving means for receiving an image synthesizing method from the terminal,
11. The image combining unit according to claim 1, wherein the corresponding image acquired by the corresponding image acquiring unit is combined with the photographed image according to a method of combining the images received by the combining method receiving unit. The image distribution device according to any one of claims 1 to 4. The image synthesis method includes at least a replacement synthesis method,
The image synthesizing unit is configured such that, when an image replacement synthesizing method is received by the synthesizing method receiving unit, an image corresponding to a target range of the captured image received by the captured image receiving unit is obtained by the corresponding image obtaining unit. The image distribution device according to claim 11, wherein the image distribution device replaces the captured image with the captured image and synthesizes the captured image. The image synthesis method includes at least a background addition synthesis method,
The image synthesizing unit adds the corresponding image acquired by the corresponding image acquiring unit to the background of the photographed image and synthesizes the image when the background adding and synthesizing method of the image is received by the synthesizing method receiving unit. The image distribution device according to claim 11, wherein: The image synthesizing method includes at least a left-right inversion synthesizing method,
The image synthesizing unit is configured to, when the image synthesizing method receiving unit receives a left-right inversion synthesizing method, convert the corresponding image acquired by the corresponding image acquiring unit into an image corresponding to a target range on the captured image and horizontally invert the image. The image distribution apparatus according to claim 11, wherein the image distribution apparatus adds the image to the position and synthesizes the image. The image synthesizing method includes at least another photographing synthesizing method,
The corresponding image obtaining unit obtains a corresponding image corresponding to an image in a target range of the first captured image received by the captured image receiving unit,
The image synthesizing unit, when another synthesizing method of an image is received by the synthesizing method receiving unit, acquiring the second captured image received by the captured image receiving unit by the corresponding image acquiring unit. The image distribution device according to claim 11, wherein the corresponding image is synthesized. A captured image receiving step of receiving a captured image and a target range for the captured image from the terminal,
A corresponding image obtaining step of obtaining a corresponding image corresponding to an image in the target range of the captured image received in the captured image receiving step,
An image combining step of combining the corresponding image obtained in the corresponding image obtaining step with the captured image;
A synthesized image transmitting step of transmitting the image synthesized in the image synthesizing step;
An image distribution method comprising: An image distribution program for controlling a computer connected to a network to distribute an image,
Said computer,
Captured image receiving means for receiving a captured image and a target range for the captured image from the terminal,
A corresponding image acquiring unit that acquires a corresponding image corresponding to an image in a target range of the captured image received by the captured image receiving unit;
Image synthesizing means for synthesizing the corresponding image acquired by the corresponding image acquiring means with the photographed image,
Synthesized image transmitting means for transmitting an image synthesized by the image synthesizing means,
A computer-readable image distribution program that functions as a computer.

Images