CN101179668A

CN101179668A - Image delivery server, image delivery program and image delivery method

Info

Publication number: CN101179668A
Application number: CNA2007101995267A
Authority: CN
Inventors: 湖城孝
Original assignee: Casio Computer Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2002-05-28
Filing date: 2003-05-28
Publication date: 2008-05-14
Anticipated expiration: 2023-05-28
Also published as: CN100382576C; JP2003346170A; CN101119444B; CN1742482A; JP3918632B2; CN101179668B; CN101119444A

Abstract

Provided is a composite image output/delivery apparatus for (10) adding to a picked-up scene image a corresponding animation image and outputting/delivering a resulting composite image without adding a fixed animation image simply to the picked-up scene image. When an object image is extracted from the picked-up scene image received via an image input unit (17), any specified type of character image corresponding to the scene image is selected from an appropriate one of a character 1 ''rabbit'' pose image memory (12d), a character 2 ''bear'' pose image memory (12e), a character 3 ''cat'' pose image memory (12f). The selected type of character image replaces the object image in the picked-up scene image or adds to the scene image to thereby provide and display a resulting composite image. That is, by replacing the object image with an animation image similar in pose to the object image or by adding the animation image to the scene image, a very delightful picked-up image with an animation is easily created without adding a fixed animation image simply to an image pickup frame.

Description

Composograph output equipment and method

The application be submitted on May 28th, 2003, application number is 03812128.X, denomination of invention is divided an application for the application of " composograph output equipment and composograph transfer equipment ".

Technical field

The present invention relates to a kind of composograph output equipment and method, be used for combination and pick up scene image and other image, and export the composograph that obtains.

Background technology

The conventional still image camera of some types or video camera have image and other images that combination is picked up, and the function that shows the composograph that obtains.

For example, this at present actual camera that uses can be exported by combination and pick up the composograph that scene image and flower or popular role's (character) animated image forms, wherein said animated image be set at pick up in the frame fix or desired locations on.

The image that is picked up by digital camera can be presented on the display screen of personal computer, and it can be made up and edit with different image.In this case, described different image for example can be cut from another graphic file selectively, and sticks on the desired locations place in the captured image.

Yet, adopt the problem of this normal image treatment facility to be: only to be the image that to prepare and pick up scene image in the position of fixing or expectation combination output then, therefore, except that captured image, described composograph certainly will be dullness and sesquipedalian all the time.

Summary of the invention

The present invention proposes in view of the above problems.One object of the present invention is to provide a kind of image output device, a kind of image output processing program and a kind of image output method, be used for not only to make up fixing animated image and pick up scene image so that the composograph that obtains of output thus, and can will make up corresponding to animated image that picks up scene image and the described scene image that picks up.

To achieve these goals,, provide a kind of composograph output equipment, having comprised according to one aspect of the present invention:

Pick up scene image acquiring unit (device), be used for obtaining expression comprise at least one object a scene pick up scene image;

Target image extraction unit (device) is used for extracting the target image of representing any special object at least one object from the scene image that picks up that acquiring unit obtains;

Correspondence image obtains unit (device), is used to obtain the image corresponding to the target image of described extraction unit extraction; And

Image output unit (device) is used for the image that described acquisition unit obtains added to by described and picks up the scene image that picks up that the scene image acquiring unit obtains, and the composograph that obtains of output.

In this composograph output equipment, when the target image extraction element from obtain by deriving means pick up the scene image target image that extracts any special object at least one object of expression the time, obtain device by described correspondence image and obtain image corresponding to the target image that extracts.So, add to by picking up the scene image that picks up that the scene image deriving means obtains obtaining image that device obtains, thus the composograph that obtains of output.In brief, the user can enjoy the enjoyment of creating lovely composograph.

According to another aspect of the present invention, a kind of composograph output equipment also is provided, comprising:

Pick up scene image acquiring unit (device), be used to obtain a plurality of scene images that pick up, each image all represents to comprise the scene of at least one object;

Target image extraction unit (device) is used for a plurality of target images that pick up any special object scene image, at least one object of extraction expression that pick up any selection of scene image that pick up the acquisition of scene image acquiring unit from described;

Image output unit (device), being used for utilizing correspondence image to obtain image that the unit obtains substitutes described and picks up the target image that scene image extracts, be used for adding correspondence image to other a plurality of selected images that pick up scene image that the target image extraction unit does not therefrom extract target image, and be used to export the composograph that obtains.

In this composograph output equipment, when the target image extraction element from a plurality of picking up when extracting the target image of any special object at least one object of expression each of scene image by picking up that the scene image deriving means obtains, obtain device by described correspondence image and obtain image corresponding to the target image that extracts.So by described image output device, the target image that the target image extraction element is extracted replaces with the image that correspondence image obtains the device acquisition.In addition,, then correspondence image is added to other a plurality of selected images that pick up scene image that the target image extraction element does not therefrom extract target image, so that the composograph that output obtains by described image output device.In brief, the user can enjoy the enjoyment of creating lovely image.

According to another aspect of the present invention, a kind of composograph transfer equipment also is provided, comprising:

Pick up scene image receiver (receiving system), be used for from terminal receive expression comprise object scene pick up scene image;

Target image extractor (extraction element) is used for from by picking up the target image that scene image extracts the described object of expression that picks up that the scene image receiving element receives;

Correspondence image obtains device (acquisition device), is used to obtain the image of the target image that extracts corresponding to described target image extraction unit;

Image adder (adding set) is used for that correspondence image is obtained correspondence image that device obtains and adds to and pick up scene image, so that the composograph that obtains is provided thus; And

Picture transmitter (conveyer) is used for the composograph that the image adder provides is sent to terminal.

In described composograph transfer equipment, when receive from terminal expression comprise at least one object scene pick up scene image the time, the pick up target image that scene image extract expression described object of target image extraction element from receiving.Image corresponding to the target image that extracts obtains the device acquisition by described correspondence image.So, by described image adding set the image that obtains is added to and to pick up scene image, so that a kind of composograph that obtains is provided thus, then it is sent to terminal by image transfer apparatus.In brief, the user can enjoy the enjoyment of creating lovely image.

According to another aspect of the present invention, a kind of composograph transfer equipment also is provided, described composograph transfer equipment and terminal communicate, described terminal is extracted and is picked up the target image that comprises in the scene image, send the terminal attitude information of the relevant target image that is extracted, reception is corresponding to the image of described attitude information, wherein said attitude information is that terminal response composograph transfer equipment sends attitude information and sends, described correspondence image added to pick up scene image, export the composograph that obtains thus, described equipment comprises:

Attitude information receiver (receiving system) is used for receiving the attitude information that picks up the target image that scene image comprises from described terminal;

Correspondence image memory (storage device) has a plurality of images of being stored, and each image is all corresponding to corresponding of the different item of attitude information; And

Picture transmitter (conveyer) is used for reading image corresponding to the attitude information that is received by the attitude information receiver from the correspondence image memory, and the image that reads is sent to terminal.

In this composograph transfer equipment, extract when picking up the target image that comprises in the scene image and the attitude information of target image being sent to described composograph transfer equipment when described terminal, described composograph transfer equipment receives described attitude information in its attitude information receiving system.So described image transfer apparatus reads the image corresponding to the attitude information that is received from the correspondence image storage device, and send it to described terminal.In brief, described terminal can receive image corresponding to the target image that extracts from described image transmission devices from pick up scene image, and described image is added to pick up scene image, so that the interested composograph that is synthesized of output thus.Thus, the user can enjoy the enjoyment of creating lovely image.

Description of drawings

Fig. 1 shows the block diagram according to the electric circuit construction of the image output device 10 of first embodiment of the invention.

Fig. 2 shows " rabbit ", " bear " and " cat " role's the image (part 1) of the various attitudes of employing of role 1 " rabbit " the attitude video memory 12d, role 2 " bear " the attitude video memory 12e that are stored in respectively in the image output device 10 and role 3 " cat " attitude video memory 12f.

Fig. 3 shows other images (part 2) of " rabbit ", " bear " and " cat " role of the various attitudes of employing of role 1 " rabbit " the attitude video memory 12d, role 2 " bear " the attitude video memory 12e that are stored in respectively in the image output device 10 and role 3 " cat " attitude video memory 12f.

Fig. 4 shows " rabbit ", " bear " and " cat " role's the further image (part 3) of the various attitudes of employing of role 1 " rabbit " the attitude video memory 12d, role 2 " bear " the attitude video memory 12e that are stored in respectively in the image output device 10 and role 3 " cat " attitude video memory 12f.

Fig. 5 shows the image (part 1) of the various attitudes of the model among the model attitude memory 12b that is stored in image output device 10.

Fig. 6 shows the image (part 2) of other various attitudes of the model among the model attitude memory 12b that is stored in image output device 10.

Fig. 7 shows the further more various attitudes (part 3) of the model among the model attitude memory 12b that is stored in image output device 10.

Fig. 8 (A) shows the model image (attitude 1A is to 5A) of the model attitude video memory 12c of and size adjustment that be stored in image output device 10 generation based on the object images (target image) of standard body shape as an example.

Fig. 8 (B) shows among Fig. 8 (B) size adjustment as another example and is non-type body shape object images (target image) and is stored in model image (attitude 1A is to 5A) among the memory 2C.

Fig. 9 shows when image output device 10 has stipulated that the follower adds pattern, and " bear " character image is appended to the schematic diagram that picks up scene image as the follower.

Figure 10 shows when image output device 10 has stipulated that the white space character image adds pattern, adds the schematic diagram of " cat " character image in picking up the clear area of scene image.

Figure 11 shows when image output device 10 has stipulated that the mirror image reversal character image adds pattern, adds the schematic diagram of " rabbit " character image of mirror image reversal in picking up scene image.

Figure 12 shows when image output device 10 has been stipulated a plurality of image pickups/alternating pattern, utilizes " rabbit " character image to substitute the schematic diagram of object images.

Figure 13 shows when image output device 10 has been stipulated Object Selection/alternating pattern, utilizes " rabbit " character image to substitute the schematic diagram of object images.

Figure 14 shows the flow chart of the image processing (part 1) of image output device 10 execution.

Figure 15 shows the flow chart of image processing (part 2) of the image processing (part 1) of the Figure 14 that continues that will carry out from image output device 10.

Figure 16 (A) and (B) show the flow chart of the target image leaching process (method 1 and 2) that comprises in the image processing of will be in image output device 10 carrying out respectively.

Figure 17 (A) and 17 (B) are the flow charts that shows the corresponding animated image acquisition process (method 1 and 2) that comprises in the image processing with execution in the image output device 10 respectively.

Figure 18 shows and is used for assessing the attitude of role/model image and the process of the similitude of the target image of corresponding animated image acquisition process (method 1)/imitation that (method 2) comprises of Figure 17 (A)/17 (B).

Figure 19 shows in the attitude similitude evaluation process that comprises in the corresponding animated image acquisition process (method 1) in Figure 17 (A), the schematic diagram of a specific examples of assessment assigned role image and the similitude of target image on attitude.

Figure 20 shows in the attitude similitude evaluation process that comprises in the corresponding animated image acquisition process (method 2) in Figure 17 (B), the schematic diagram of a specific examples of assessment models image and the similitude of target image on attitude.

Figure 21 shows in the attitude similitude evaluation process that comprises in the corresponding animated image acquisition process (method 2) of Figure 17 (B), the schematic diagram of assessment models image and target image another specific examples of the similitude of (part 2) on attitude.

Figure 22 shows the flow chart of big or small adjustment process of the attitude model of image output device 110.

Figure 23 shows the block diagram according to the electric circuit construction of image delivery server 110 in the image delivery system of second embodiment of the invention.

Figure 24 shows the block diagram according to the electric circuit construction of the terminal in the image delivery system of second embodiment 120.

Figure 25 shows a plurality of when picking up alternating pattern when having stipulated according to second embodiment, utilizes other image to substitute the schematic diagram of target image and interpolation " bear " character image by image delivery server 110 according to the request that comes from the terminal equipment 120 of image delivery system.

Figure 26 shows the flow chart according to the image processing of the terminal 120 of the image delivery system of second embodiment (part 1).

Figure 27 shows the flow chart of the image processing (part 2) that is continued from the image processing (part 1) of Figure 26 by the terminal 120 of image delivery system.

Figure 28 shows the flow chart according to the server process of the image delivery server 10 of the image delivery system of second embodiment (part 1).

Figure 29 shows the flow chart according to the server process (part 2) of the server process (part 1) of Figure 28 that continues that is carried out by image delivery server 10 of second embodiment.

Figure 30 shows the flow chart according to the target image leaching process that comprises in the server process of second embodiment in image delivery server 10.

Figure 31 shows the flow chart according to the corresponding animated image acquisition process that comprises in the server process of second embodiment in image delivery server 10.

Figure 32 shows the schematic diagram of the similitude on attitude according to the second embodiment assessment models image and target image, carries out in the attitude similitude evaluation process that this assessment will comprise in the corresponding animated image acquisition process of image delivery system 10.

Figure 33 shows the flow chart according to the image processing of the terminal 120 of the image delivery system of the 3rd embodiment (part 1).

Figure 34 shows the continue flow chart of image processing (part 2) of image processing (part 1) of Figure 33 of terminal equipment 120 by image delivery system.

Figure 35 shows the flow chart according to the server process of the image delivery server 110 of the image delivery system of the 3rd embodiment.

Figure 36 shows the flow chart according to the target image leaching process that comprises in the described image processing in the terminal 120 of the image delivery system of described the 3rd embodiment.

Figure 37 shows the flow chart of determining deterministic process according to the attitude numbering that comprises in the described image processing in the terminal 120 of the image delivery system of described the 3rd embodiment.

Figure 38 shows in the attitude numbering deterministic process that comprises in the image processing of the terminal 120 of image delivery system according to the 3rd embodiment, the flow chart of target image similitude on attitude of assessment models image and imitation.

Figure 39 shows the attitude angle color image that conduct according to the 3rd embodiment is used for the moving image of image delivery server 110, triggers animation " rabbit " role's of the various attitudes among moving image " rabbit " the role attitude video memory 12dM that is stored in the image delivery server 110 image.

Figure 40 shows the block diagram according to the universal architecture of the image delivery system of the 4th embodiment.

Figure 41 deposits the flow chart of process according to the rudimentary horn color image that the 4th embodiment shows user in image delivery system, wherein Figure 41 (A) shows the flow chart of the process of carrying out on portable telephone 200A side, and Figure 41 (B) shows the flow chart of the process of carrying out on image delivery server 210 sides.

Embodiment

The preferred embodiments of the present invention are described with reference to the accompanying drawings.

(first embodiment)

This image output device 10 comprises computer, is used for the program of reading and recording on various recording mediums or the program that receives from the outside, and controls himself operation according to described program.The electronic circuit of computer comprises CPU (CPU) 11.

The operation that described CPU 11 comes the control circuit parts according to the facility control program that is stored in advance in the memory 12, described facility control program reads in the memory 12 via recording medium reader 14 from the external recording medium 13 such as CD-ROM, perhaps described facility control program reads in memory 12 from the webserver 21 (in this case, being the procedure service device) on the Internet N via electric transmission controller 15.Being stored in the input signal that the facility control program in the memory 12 sends by the user operation of response input unit 16 starts, described input unit 16 has button or touch panel, perhaps start by picture signal via 17 inputs of image input unit, perhaps start by the signal of communication that is used for communicating by letter with each webserver 21 on the Internet N, this Internet N is connected to described image output device 10 via described electric transmission controller 15.

Except memory 12, recording medium reader 14, electric transmission controller 15, input unit 16 and image input unit 17, described CPU 11 also with range sensor 18, comprise that the display unit 19 of LED and image output unit 20 link to each other.

Image input unit 17 obtains to pick up scene image data selectively from digital camera 17A, digital video film camera 17B or VTR (player) 17C.

Described range sensor 18 detects range sensor 18 and distance between objects in the scene that object images is input to image input unit 17.

Described image output unit 20 is based on the view data that this device processes is passed through in scene image output of picking up that receives via image input unit 17.The view data of output is outputed to storage card 20A, VTR (video tape recorder) 20B or image printer 20C selectively, so that store, write down or print described image.

Described memory 12 has been stored the system program of the whole operation that is used for responsible control image output device 10, and is used for the signal procedure via each webserver 21 swap data on described electric transmission controller 15 and the Internet N.Described memory 12 has also been stored image processing program 12a, is used for via image input unit 17 and image output unit 20, carries out corresponding to the image combination/output procedure of picking up the scene image target image by described image output device 10.

In addition, described memory 12 has been prepared model attitude video memory 12c, role 1 " rabbit " attitude video memory 12d, " bear " attitude video memory 12e and role 3 " cat " the attitude video memory 12f of model attitude video memory 12b, size adjustment.In addition, it has prepared to pick up scene image memory 12g and image processing service area 12h in its service area.

Fig. 2 shows triggering and is stored in role 1 " rabbit " attitude video memory 12d, role 2 " bear " the attitude video memory 12e of image output device 10 and " rabbit ", the character image of " bear " and " cat " of the various attitudes (part 1) among role 3 " cat " the attitude video memory 12f respectively.

Fig. 3 shows triggering and is stored in role 1 " rabbit " attitude video memory 12d, role 2 " bear " the attitude video memory 12e of image output device 10 and " rabbit ", the character image of " bear " and " cat " of the various attitudes (part 2) among role 3 " cat " the attitude video memory 12f respectively.

Fig. 4 shows triggering and is stored in role 1 " rabbit " attitude video memory 12d, role 2 " bear " the attitude video memory 12e of image output device 10 and " rabbit ", the character image of " bear " and " cat " of the various attitudes (part 3) among role 3 " cat " the attitude video memory 12f respectively.

Triggering is stored in each dissimilar character image of the various attitudes among role " rabbit ", " bear " and " cat "

attitude video memory

12d, 12e and the 12f, can be as the character image of the attitude of imitating one of corresponding object (target) image, wherein said object images is arranged in the scene image that picks up from described image input unit 17 inputs.Different attitude numberings are stored according to corresponding relation with different attitudes.

Fig. 5 shows the image corresponding to the model of the various model attitudes (part 1) among the model attitude memory 12b that is stored in image output device 10.

Fig. 6 shows the model image corresponding to the various model attitudes (part 2) among the model attitude memory 12b that is stored in image output device 10.

Fig. 7 shows the further model image corresponding to the various model attitudes (part 3) among the model attitude memory 12b that is stored in image output device 10.

Each model image that triggering is stored in the various attitudes among the model attitude video memory 12b is used for obtaining on attitude and model image like object (target) images category, and wherein said object images is arranged in the scene image that picks up from 17 inputs of image input unit.Different attitudes numbered with different attitudes according to corresponding relation store, and be each attitude numbering storage A, B and three kinds of model images of C.

Be stored in each " rabbit ", the character image of " bear " and " cat " among role 1 " rabbit " attitude video memory 12d, role 2 " bear " attitude video memory 12e and role 3 " cat " the attitude video memory 12f, corresponding to triggering be stored in all attitudes numbering among the described model attitude video memory 12b (numbering 1A, 1B, 1C, 2A, 2B, 2C ... nA, nB, nC) model image of the attitude that shows.

Fig. 8 shows the attitude image of the size adjustment among the model attitude video memory 12c of the size adjustment that is stored in image output device, and wherein Fig. 8 (A) shows according to standard body shape object (target) the image production that is presented at Fig. 8 (A) left side as an example and is stored in model attitude image (having attitude 1A to 5A) among the memory 12c.Fig. 8 (B) shows by the big or small vertical and horizontal with each standard body shape model attitude image of Fig. 8 (A) as an example and is adjusted to non-type body shape object (target) image and is stored in the model attitude image (having attitude 1A to 5A) of the size adjustment that described memory 12c obtains.

Following acquisition will be stored in the model image of the size adjustment among the model attitude video memory 12c of size adjustment.Standard body shape attitude model image by the total length shown in the attitude 2A in Fig. 8 (A) is conditioned (vertical and horizontal) in size for the non-type body shape object images shown in Fig. 8 (B), to become the image corresponding to the size adjustment of attitude 2A.Size adjustment ratio (balance) according to the model image of the size adjustment of attitude 2A, the every other standard body shape model image of other attitudes all is that size adjustment is the model image of non-standard body shape, is stored in then among the model attitude video memory 12c of size adjustment.

The described scene image memory 12g that picks up receives from image input unit 17 and picks up scene image data, and stores according to the unit that picks up scene image and to pick up scene image data.

When handling described view data, the view data according to image processing program 12a processing is treated in the temporary transient storage of described image processing service area 12h.

To outline the operation of the image output device 10 of structure as mentioned above this moment.

Fig. 9 for example understands when image output device 10 has stipulated that the follower adds pattern, additional " bear " character image as the follower.

When shown in Fig. 9 (B) during from the picking up scene image 12g1 and extract object (target) image H and will " bear " character image stipulate as the follower of Fig. 9 (A), 12e reads in " walking " character image " bear " that attitude is similar to the attitude 4 (end view) of object images H shown in Fig. 9 (C) from role 2 " bear " attitude video memory.So from picking up location recognition that scene image 12g1 presents object images H and go out to pick up a position the scene image 12g1 a series of, described object images H was presented on this position in the past in the time cycle of determining." walking bear " character image (end view) of the attitude 4 that will read from role 2 " bear " attitude video memory 12e adds a position of picking up in the scene image to, in this position, object images H just existed before the time cycle of determining, shown in Fig. 9 (D).

In brief, add " walking bear " character image that is similar to the object images H that picks up among the scene image 12g1 on the attitude to " bear " character image is followed object images H in the captured image position.

Figure 10 for example understands when having stipulated that the white space character image adds pattern, image output device 10 adds " cat " character image in the clear area.

If specified object (target) the image H1 of imitation and extracted from picking up the scene image 12g2 of Figure 10 (A), shown in Figure 10 (B), and specify and add " cat " character image to clear area, from role 3 " cat " the attitude video memory 12f shown in Figure 10 (C), read in " cat " character image that attitude is similar to the attitude 10 (" long live ") of object (target) image H1 so.Then, add " cat " character image of this attitude that reads 10 (" long live ") to pick up scene image 12g2 hollow white area any random position, wherein do not have object (target) image H1 and H2, shown in Figure 10 (D).

In brief, add imitation " cat " character image of the attitude of the object images of appointment in picking up scene image 12g2 in the clear area of picking up scene image 12g2 any random position.

Figure 11 for example understands " rabbit " character image of additional mirror image reversal when image output device 10 has stipulated that the mirror image reversal image adds pattern.

If shown in Figure 11 (B), extract object (target) image H from picking up scene image 12g3, wherein pick up object (target) the image H that scene image 12g3 includes consciousness and the dancing of partner's (not shown), for example shown in Figure 11 (A), if and when specifying " rabbit " character image to be added as dancing partner character image, from role 1 " rabbit " attitude video memory 12d, read in " rabbit " character image that attitude is similar to the attitude 19 (" dancing ") of object (target) image H so, shown in Figure 11 (C).So, with " rabbit " character image mirror image reversal of reading, and add a position of picking up among the scene image 12g3 to as the dancing partner, wherein " rabbit " image of mirror image reversal links with object (target) the image H of dancing purpose, shown in Figure 11 (D).

In brief, imitation is picked up " rabbit " character image mirror image reversal of the dancing attitude of object images H among the scene image 12g3, and add the position of picking up scene image to as the dancing partner, wherein said mirror image reversal " rabbit " links with object images H.

Figure 12 for example understands when image output device 10 has been stipulated a plurality of image pickups/alternating pattern by the alternative object images of " rabbit " character image.

For example, when the user wishes to produce " rabbit " role of image as an alternative and awards the scene image that the user kisses, pick up the scene image 12g4 to extract to wish to trigger from first of Figure 12 (A) and kiss object (target) the image H1 of attitude, shown in Figure 12 (B), wherein said Figure 12 (A) comprises triggering and kisses the object images H1 of attitude.When " rabbit " character image being appointed as when substituting character image, from role 1 " rabbit " attitude video memory 12d, read in " rabbit " character image that attitude is similar to object (target) image H1, shown in Figure 12 (C) with attitude 20 (" kissing ").

Then, shown in Figure 12 (D), " rabbit " character image that reads from role 1 " rabbit " attitude video memory 12d, be similar to the attitude 20 (" kissing ") of the described first object images H1 in attitude is added to second and picks up scene image 12g4 ', described second picks up scene image 12g4 ' is included in the object images H2 that is different from object in first captured image (target) image H on the attitude, shown in Figure 12 (E).

In brief, the object images H2 that imitation first " rabbit " character image and second that picks up the object images H1 among the scene image 12g4 is picked up among the scene image 12g4 ' makes up.

Figure 13 for example understands when image output device 10 has been selected Object Selection/alternating pattern, by the alternative object images of role " rabbit " image.

If specified an object image H1 and shown in Figure 13 (B), from pick up scene image 12g5, extracted conduct image to be substituted, and " rabbit " image is appointed as alternative object images, the wherein said scene image 12g5 that picks up for example comprises three object images H1 to H3, shown in Figure 13 (A), from role 1 " rabbit " attitude video memory 12d, read in " rabbit " character image that attitude is similar to object images H1 so, shown in Figure 13 (C) with attitude 1 ((close-up shot) smiles).

On the other hand, object images H1 and other object images H2, the H3 of appointment sheared from pick up scene image 12g5, and shown in Figure 13 (B), 13 (F), 13 (E) and 13 (D), produce background image 12g5 ' like that respectively.

So, shown in Figure 13 (G), to be similar to " rabbit " character image of object images H1 and the object images H2 that from pick up scene image 12g5, shears, H3 and the background image 12g5 ' combination of appointment in attitude from what role 1 " rabbit " attitude video memory 12d read, and make them be in corresponding appropriate position according to descending order to the image pickup distance of each picked object of image.

In brief, " rabbit " character image that imitates the attitude of the object images H1 that picks up the appointment among the scene image 12g5 substitutes the object images H1 of appointment, and the composograph that obtains is provided thus.

Then, will image output device 10 be described in more detail with the image processing of carrying out.

Figure 15 shows the flow chart that passes through the image processing (part 2) that described image output device 10 carries out of the image processing (part 1) of the Figure 14 that continues.

To specify (step S1) by handling input unit 16 as the interpolation role or the alternative character types (" rabbit ", " bear " or " cat ") of picking up among the scene image 12g.

From following group, select and specify interpolation/compositional model or alternative/compositional model: " 1-1: the white space character image adds pattern at random ", " 1-2: the follower adds pattern ", " 1-3: the mirror image reversal character image adds pattern " and " 2-1: object images selection/alternating pattern " and " 2-2: a plurality of image pickup/alternating patterns ".(step S2).

The scene image 12gn that picks up as digital camera 17A, digital video film camera 17B or VTR (player) 17C begins to be imported into image output device 12gn (step S3) and carries out start-up operation with the character image that adds appointment during to scene image 12gn (step S4), and described process proceeds to the extraction object images (step SA) among Figure 16.

Figure 16 (A) and 16 (B) are the flow charts of the target image leaching process (method 1 and 2) that comprises respectively in the image processing in the image output device 10.

In the target image leaching process (method 1) of Figure 16 (A), a series ofly pick up pick up (steps A 11) among the scene image memory 12g that scene image 12gn is stored in the service area with what scheduled time order was input to image output device 10 via image input unit 17.

So, extract to trigger corresponding to the object images Hn of the different attitudes that move of each object and pick up each the relevant block (steps A 12) of scene image 12gn as being stored in the series of picking up among the scene image memory 12g, and ordering (steps A 13) in the 12h of image processing service area.

In the target image leaching process (method 2) of Figure 16 (B), each distance between objects in the picked scene of range sensor 18 and image is by described range sensor 18 measured (steps A 21).Extraction is defined as coming across the image Hn of each object in the short distance according to background and distance between objects, and with it as a piece (steps A 22) independently.

The object images Hn that each is extracted is stored in (steps A 23) among the 12h of image processing service area as piece independently then.

When extracting and to pick up each object images Hn of comprising the scene image 12gn as one and when being stored among the 12h of image processing service area (step SA) from picking up scene image 12gn, on display 19, show have that broken broken line surrounds that among the M each extract object images Hn pick up scene image 12gn, for example shown in Fig. 9 (A), 11 (A), 12 (A) or 13 (A) (step S5).

Then, determine on display 19 a plurality of (the step S6) that whether have object images Hn among the scene image 12gn that pick up that show.

If a plurality of of determining not have object images Hn in picking up scene image 12gn, unique object images Hn that will extract from pick up scene image 12gn so are set at object images (the step S6 → S7a) of imitation.

If a plurality of of determining to exist object images Hn in picking up scene image 12gn, the user is by handling input unit 16 from the imitative target image of a plurality of middle finger cover half of object images (step S6 → S7b) so.

When object images Hn was appointed as the target image of imitation, described process proceeded to the corresponding animated image acquisition process (step SB) among Figure 17.

Figure 17 (A) is the different flow charts that show the corresponding animated image acquisition process (method 1 and 2) that in the image output device 10 image processing of carrying out is comprised respectively with 17 (B).

In the described corresponding animated image acquisition process (method 1) of Figure 17 (A), each attitude image of assessment assigned role and the attitude similitude (step B1C) of the object images Hn of the target image that from pick up scene image 12gn, extracts and be set at imitation, and on display 19, show the attitude angle color image (step B12) that produces lofty stance similitude.

Here, when handling input unit 16 by the user and select to produce target image with the imitation that on display 19, shows and have the attitude angle color image of lofty stance similitude, the character image (having its attitude numbering) of appointment deposited be animated image corresponding to the target image of described imitation.As long as the attitude angle color image with different attitude similitudes is arranged, so when clicking " next demonstration (next display) ", show attitude role with next lofty stance similitude (step B13 → B14).

On the other hand, if (perhaps whenever) user will have character image that target image with imitation has lofty stance similitude when being presented at state lower-pilot input unit 16 on the display 19 and clicking " next demonstration ", will present character image with second lofty stance similitude (step B13 → B15) so.

When handling by the user that input unit 16 shows and when selecting to have the character image of lofty stance similitude, selected (by its numbering appointment) character image is deposited to corresponding to the animated image of the target image of described imitation (step B13 → B14).

In brief, in described corresponding animated image acquisition process (method 1), directly assess the similitude of object images Hn on attitude of corresponding attitude image with the target image of conduct imitation of assigned role, wherein said object images Hn has extracted and has been set at described target image from pick up scene image 12gn.According to this assessment, determine the character image of appointment, and used as adding character image or imitating the alternative character image of the attitude of object images Hn as triggering.

In the corresponding animated image acquisition process (method 2) in Figure 17 (B), each attitude image that is stored in the designated model among the model attitude video memory 12b and the similitude of object images Hn on attitude of extracting and be set at the target image of imitation from pick up scene image 12gn are assessed (step B2C).On display 19, show assigned role image (step B22) corresponding to the attitude numbering of model image with lofty stance similitude.

Select corresponding to having target image with the imitation that on display 19, shows when having the character image of attitude model image of lofty stance similitude when handle input unit 16 by the user, described (by its attitude numbering appointment) character image is deposited to corresponding to the animated image of the target image of described imitation (step B23 → B24).

On the other hand, when (if perhaps whenever) user clicks " next demonstration " at the state lower-pilot input unit 16 that character image is presented at display 19, wherein said character image is corresponding to the attitude numbering that has with the model image of the lofty stance similitude of the target image of imitation, shows the character image of appointment so corresponding to the attitude numbering of the model image with second lofty stance.As long as still there is attitude angle color image with different attitude similitudes, so when clicking " next shows ", show attitude role with next lofty stance similitude (step B23 → B25).

Then, when handling by the user that input unit 16 is selected and when showing character image corresponding to model attitude image, (by its attitude numbering appointment) character image of appointment is deposited to corresponding to the animated image of the target image of described imitation (step B23 → B24) with expectation attitude similitude.

As mentioned above, in corresponding animated image acquisition process (method 2), assess each different attitude image and the similitude of object images Hn on attitude of from pick up scene image 12gn, extracting and be set at the target image of this imitation of the basic model of human figure.Then,, determine the character image of appointment according to this assessment, the attitude of its model image Hn, and as adding role or role as an alternative.

In this case, compare with corresponding animated image acquisition process (method 1), wherein method 1 is directly assessed the similitude of object images Hn on attitude of each various attitude image with the target image of conduct imitation of assigned role, so that determine as adding role or role's character image as an alternative, described corresponding animated image acquisition process (method 2) is very useful, in described method 2, the different attitude images of designated model are evaluated with the similitude of object images Hn on attitude of the target image that extracts and be set at imitation from pick up scene image 12gn, and determine as adding role or role's character image as an alternative according to assess selected model attitude numbering based on this, the benefit of method 2 is: use human graphical model to make it easy to obtain to have with object images to have the more model image of lofty stance similitude, and be convenient to obtain to have the more character image of lofty stance similitude (imitation).

Figure 18 shows in the corresponding animated image acquisition process (method 1 and 2) of the Figure 17 that comprises in the pending image processing of image output device 10, the flow chart of the similitude of target image on attitude of assessment role/model image and imitation.

When in corresponding animated image acquisition process (method 1), carrying out the assessment of attitude similitude, each the various attitude image of assessment assigned role and the similitude of target image on attitude of imitation.When in the corresponding animation acquisition process (method 2) of imitation image, carrying out the assessment of attitude similitude, each the various attitude image of assessment designated model and the similitude of target image on attitude of imitation.

Figure 19 shows being used to of comprising in the attitude similitude evaluation process of corresponding animated image acquisition process (method 1) pending in image output device 10 and assesses the example schematic diagram of the similitude of target image on attitude of assigned role image and imitation.

Figure 20 shows the schematic diagram of the assessment example that comprises in the attitude similitude evaluation process of corresponding animated image acquisition process (method 2) pending in image output device 10, is used for the similitude (part 1) of target image on attitude of assessment models image and imitation.

Figure 21 shows the example schematic diagram of the similitude (part 2) of the target image that is used for assessment models image and imitation on attitude that comprises in the attitude similitude evaluation process of corresponding animated image acquisition process (method 2).

At first, in similitude evaluation process (method 1), read the character image (step C1) of appointment with first attitude numbering, for example shown in Figure 19 (A), and regulate the target image H1 of the character image of appointment and imitation so as to go up in size (vertical and horizontal) consistent, shown in Figure 19 (X) (step C2).

So, the character image regulated and the target image H1 of imitation are overlapped each other, assess the similitude on attitude (%) between them then, and stored (step C3) as the similitude of target image on attitude of character image and imitation.

Here, determine character image (having first attitude numbering) whether asymmetric (step C4) then as the similitude assessment objective.If determine that described character image is not asymmetric (step C4, "No"), order is carried out the target image of size adjustment and overlapping, imitation and is had overlapping-similitude assessment between each attitude image of assigned role of respective sequence attitude numbering so, and store their similitude, and for example shown in Figure 19 (B) and 19 (C) (step C8 → C9 → C2-C4).

On the other hand, if determine that the character image with attitude numbering as the similitude assessment objective is asymmetric, so with character image mirror image reversal (step C4 → C5), and regulate the target image of the character image of counter-rotating and imitation so that go up consistent (step C6) in size (vertical and horizontal).

So, the target image of imitation and the character image of counter-rotating are overlapped each other, assess the similitude on attitude (%) between them then, and stored (step C7) as the similitude of target image on attitude of inverted image and imitation.

Then, if existing further, other has the attitude image of the assigned role of order attitude numbering, so as mentioned above order read they (step C9), between the target image of the corresponding attitude image of assigned role and imitation, repeat similitude evaluation process (step C2-C7) with order attitude numbering.

For example shown in Figure 19, when similitude on attitude of assessment " rabbit " character image and object images (target image) H1, will have " rabbit " character image 12d that attitude numbers 1A 1. A be evaluated as and have lofty stance similitude.

Then, when shown in Figure 20 (A) or 21 (A), carrying out similitude evaluation process (method 2) like that, read and number the 1. model image (step C1) of first attitude of A, and regulate (vertical and horizontal) to the target image H1 of imitation or the size of H, shown in Figure 20 (X) or Figure 21 (X) (step C2).

Then, the target image H1 or the model image of H and adjusting of imitation is overlapping, and assess the similitude on attitude (%) between them, and store (step C3) as the similitude of target image on attitude of model image and imitation.

This moment, determine whether the model image as the similitude assessment objective is asymmetric (step 4).If determine that model attitude image 12b (1A) is not asymmetric, (step C4 shown in Figure 20 (A) or 21 (A) for example, "No"), read model image with next attitude numbering (step C8 → C9) so, and with the same as mentioned above method, between the target image H1 of imitation or the model image of H and next attitude, repeat attitude similitude evaluation process (step C2-C4).

On the other hand, for example shown in Figure 20 (B) or 21 (B), if determine that model image 12b (1B) or 12b (4B) with attitude numbering 1B or 4B as the similitude assessment objective are asymmetric in this case, to have attitude so and number 1. B or 4. the model image mirror image reversal of B (step C4 and C5), and shown in Figure 20 (C) or 21 (C), regulate model image 12b (1B) R of this counter-rotating or 12b (4B) R size (vertical and horizontal) (step C6) to the target image H1 or the H of described imitation.

Then, target image H1 or model image 12b (1B) R H and counter-rotating and size adjustment or 12b (4B) R of imitation are overlapped each other, and assess the similitude on attitude (%) between them, and stored (step C7) as model image 12b (1B) R of attitude counter-rotating or the similitude of target image on attitude of 12b (4B) R and imitation.

Then, if there is other model image (step C8) with order attitude numbering, so order is read these model images (step C9), with the same as mentioned above method, between target image that imitates and corresponding model image, repeat attitude similitude evaluation process (step C2-C7).

Therefore, as shown in the figure, for example in Figure 20, if carry out the assessment of attitude similitude between object images (target image) H1 and corresponding attitude model image, the model image 12b (1B) that will have attitude numbering 1B so is evaluated as one with lofty stance similitude.For example shown in Figure 21, if between object images (target image) H and corresponding model image, carry out the assessment of attitude similitude, will have attitude so and number 4. model image 12b (4B) R of BR and be evaluated as one with lofty stance similitude.

As mentioned above, when having determined to be used in the described corresponding animated image acquisition process of reference Figure 17-21 (step SB) to imitate when picking up scene image 12gn and extract and be set at the assigned role image of object images Hn of target image of this imitation, the compositional model of determining specify image is interpolation/compositional model or alternative/compositional model (step S8).

If determining the compositional model of specify image is that " interpolation/compositional model " and " 1-1: the white space character image adds pattern at random " (step S8 is to S9, " 1-1 "), so 10. " cat " character image 12f is added to the random site and the demonstration of picking up a clear area that is different from the zone of extracting object piece M among the scene image 12g2 ', for example shown in Figure 10 (D) (step S11a), 10. wherein said " cat " character image 12f is used for the attitude " long live " of imitation as the object images H1 of the imitation target that obtains at corresponding animated image acquisition process (referring to Figure 17).

At this moment, if carry out manual operations so as from " cat " character image 12f 10. from it being added to the current location of picking up the scene image 12g2 ', move to the diverse location (step S16 is to S17) of any appointment, so also " cat " character image is added to the composograph (step S18) that diverse location and demonstration obtain.

So, from the data (step S19) of image output unit 20 output, and described data are recorded on storage card 20A or VTR (register) 20B about composograph, print by image printer 20C when perhaps needing.

If determine that it is " interpolation/compositional model " and " 1-2: the follower adds pattern " (step S8 → S9 that the image sets of appointment becomes the mode, " 1-2 "), for example shown in Figure 9, the counter-rotating that will in corresponding animated image acquisition process (referring to Figure 17), obtain, the imitation pick up " walking " attitude among the scene image 12g1 object images (target image) H " bear " character image 12e 4. R add a certain position and the demonstration of picking up scene image 12g1 ' to, follow object (target image) H at this position " bear " character image, in other words, determining a series of positions of picking up object images (target image) H in that is correlated with of scene image 12g1 before the time, shown in Fig. 9 (D) (step S11b).

At this moment, if by manual operations with " bear " character image 12e of adding and showing 4. r move to the diverse location of any appointment from its present position (step S16 → S17), " bear " character image be moved to diverse location so that show the composograph (step S18) that obtains thus so.

So, from the view data (step S19) of image output unit 20 outputs, and be recorded on storage card 20A or VTR (register) 20B about this composograph, print by image printer 20C when perhaps needing.

If determining the compositional model of specify image is " interpolation/compositional model " and " 1-3: the mirror image reversal character image adds pattern " (step S8 is to S9 " 1-3 "), for example shown in Figure 11, to in corresponding animated image acquisition process (referring to Figure 17), obtain so, be used for imitation and pick up " rabbit " character image 12d (19) A (Figure 11 (C)) mirror image reversal of the dancing attitude of scene image 12g3 object (target) image H, and " rabbit " character image that adds counter-rotating to and the position of triggering object (target) image links of picking up dancing attitude among the scene image 12g3, and show the composograph that obtains, shown in Figure 11 (D) (step S11c).

When " rabbit " character image 12d (19) R that carries out the mirror image reversal that will show in the position in picking up scene image 12g3 when artificially in this case moves to the process of diverse location of any appointment from its present position (step S16 → S17), wherein in described this position of picking up among the scene image 12g3, " rabbit " character image of mirror image reversal links with object (target) image H, " rabbit " image 12d (19) R of mirror image reversal is moved on to diverse location so that the composograph that obtains is provided thus, show then (step S18).

So, from the data (step S19) of image output unit 20 outputs, and be recorded on storage card 20A or VTR (register) 20B about this composograph, print by image printer 20C when perhaps needing.

Comprise " substituting/compositional model " and " 2-1: Object Selection/alternating pattern " (step SB8 → S10 if determine described specify image compositional model, " 2-1 "), appointed object (target) the image H1 of the target image of the conduct imitation of picking up appointment among the scene image 12g5 that will obtain in corresponding animated image acquisition process (Figure 17) so replaces with " rabbit " character image 12d 1. (step SB 18) of the attitude of model image H1, show the composograph that obtains then, shown in Figure 13 (G).

In this case, with three object images, be that object (target) image H1 and other two object images H2 and H3 shear from pick up scene image 12g5, provide thus and pick up background image 12g5 '." rabbit " character image 12d that on attitude, is similar to object images H1 1. and all the other two the object images H2 and the H3 that from scene image 12g5, shear be added to the corresponding appropriate position of picking up among the background image 12g5, and above-mentioned interpolation is to carry out according to the descending order to the image pickup distance of each object of being correlated with that is detected by range sensor 18 in the image pickup process, and the composograph that obtains is provided thus.

Under the situation that does not produce all the other background image 12g5 ', 1. " rabbit " character image 12d is similar to object (target) image H1 on attitude, and other two image H2 and H3 can be added to the appropriate position of picking up among the scene image 12g5 them, and the descending order interpolation to the image pickup distance of corresponding object according to being detected by range sensor 18 in the image pickup process provides the composograph that obtains thus.

When execution is used for picking up scene image 12g5 with adding to " target image H1 locational " rabbit " character image 12d 1. when its current location moves to the process of diverse location of any appointment (step S16 → S17); 1. " rabbit " character image 12d moved on to pick up scene image 12g5 " in appointment diverse location place, so that supply the composograph that obtains whereby, show (step S18) then.

So, from the data (step S19) of described image output unit 20 outputs, and it is recorded on storage card 20A or VTR (register) 20B about composograph, print by image printer 20C when perhaps needing.

If becoming the mode, definite described image sets comprises " substituting/combination " pattern and " 2-2: a plurality of image pickup/alternating patterns " (step S8 → S10, " 2-2 "), so with first location storage of picking up object among the scene image 12g4 (target) image H1 as replacing with object images H1 the position of imitation image, (step S10 → S13) as shown in figure 12.

When picking up the second scene image 12g4 (step S14), to be used for imitation adds among the scene image 12g4 ' that picks up the second time corresponding to object (target) image H1 in first position of picking up the memory location among the scene image 12g4 at " rabbit " character image 12d (20) of the attitude of the object images H1 that corresponding animated image acquisition process (Figure 17) obtains, so that " rabbit " character image 12d (20) and object images H1 link, show the composograph 12g4 that obtains then " (step S15).

Carry out and be used for (step S16 → S17) when its current location moves to the process of diverse location of any appointment when picking up artificially among the scene image 12dg4 ' " rabbit " character image 12d (20) second, " rabbit " role 12d (20) is moved on to the diverse location place of appointment, and show the composograph (step S18) that obtains.

So, from the view data (step S19) of image data-outputting unit 20 output, and it is recorded on storage card 20A or the video tape recorder 20B about this composograph, print by image printer 20C when perhaps needing.

According to above it is evident that, image processing function according to image output device 10, when from the scene image that receives via image input unit 17, extracting object images, from role 1 " rabbit " attitude video memory 12d, be chosen in the character image of any particular type that is similar to the object images that extracts on the attitude among role 2 " bear " attitude video memory 12e and role 3 " cat " the attitude video memory 12f, the character image of selected particular type is replaced this object images of picking up in the scene image, perhaps it is added to and pick up scene image so that the composograph that obtains is provided thus.In brief, under the situation of not creating scene image, in described scene image, only be that fixing animated image is added in the image pickup frame, be easy to create divine scene image, described lovely scene image uses the animated image of the attitude of imitating destination object as object that adds or the opposite object of destination object as an alternative.

Next the function of the image output device 10 of regulating the model image size will be described.In the function of regulating the model image size, big or small aspect is consistent with standard body shape object (target) image and be stored in attitude model image among the model attitude video memory 12b, aspect big or small, be adjusted to non-standard body shape object (target) image, and in the model attitude video memory 12c of size adjustment, save as the model image of size adjustment.In described corresponding animated image acquisition process (part 2), model image that the model image that is stored in the size adjustment of regulating model attitude video memory 12c is used to assess adjusting and the similitude of object images on attitude as the target image of imitation obtain to have the assigned role image of the correspondence of this attitude similitude whereby.Do the character image that allows easily to obtain on attitude, to be similar to object images like this with any body shape.

Figure 22 is the flow chart for the treatment of by the attitude model size adjustment process of image output device 10 execution.

When the captured image of the scene that comprises an object via image input unit 17 input expression, wherein said object for example comprises the total length figure (step D1) of the non-standard body shape of the user shown in Fig. 8 (B), in the target image leaching process (method 1 or 2) of Figure 16, extract user images (step DA) so as an object, and with itself and 2. a comparison (step D2) of the model image 12b that is stored in the standard body shape total length among the model attitude video memory 12b.

Then, with model image 12b 2. A aspect big or small, regulate (step D3) with respect to vertical ratio of face, health and leg, regulate (step D4) to from picking up the object images of scene image extraction with respect to the width ratio of face, health and leg then.

So the model image 12b that the every other attitude model image that is stored in model attitude video memory 12b is adjusted to size adjustment aspect big or small is A 2., deposit then among the model attitude video memory 12c of size adjustment (step D5).

As mentioned above, assess the similitude of object images on attitude of model image with the target image of conduct imitation of any one size adjustment among the model attitude video memory 12c that is stored in size adjustment, and obtain on attitude, to have the character image that equates similitude with object images, so that can easily obtain on attitude, to be similar to the character image of object images with various body shapes.Can add to and pick up scene image or replace the object images of picking up in the scene image on attitude, being similar to the character image of object images as the imitation destination object more, so that the composograph that obtains is provided whereby.

In described embodiment, when obtaining to pick up the content of adding the scene image or substitute being similar on the attitude to be used as selectively so that during the composograph that output obtains from the character image that picks up the object images that scene image extracts and with its animated image, can store actual face image that picks up and human image in advance with various expressions, and independent use conduct is imitated in picking up scene image from the interpolation content of the object images attitude of picking up the scene image extraction or alternative, so that export the composograph that obtains whereby.

The present invention can realize in digital camera well.If implement the present invention, particularly in having the digital camera of LCD, realize, can pick up object images so, so that can confirm the composograph that obtains immediately.

In described embodiment, when for example understand as still image pick up scene image the time, can from dynamic image, sequentially extract object images, for example digital video film 17B with respect to the background image order variation in time of the dynamic image of importing via image input unit 17.Can obtain on attitude, to be similar to respectively the character image of the object images of extracting in proper order selectively, and add it to pick up in dynamic image or the replacement corresponding dynamic image object images, provide the series that is synthesized synthetic dynamic image whereby.

The image processing function of described embodiment can be used to replace as appointment and from for example, the character image of the target image of the imitation of extracting in animated image that uses in the recreation of the expectation character image with preparation or the actual human image that picks up shows the composograph that obtains whereby.

Each process that the image output device of describing in described embodiment 10 is carried out, the arbitrary image processing process shown in Figure 14 and 15 the flow chart just, the object picture extraction process that comprises in the image processing shown in the flow chart of Figure 16, the corresponding animated image acquisition process that comprises in the image processing shown in the flow chart of Figure 17, the process that is used to assess role's (perhaps model) image and the similitude of object images on attitude shown in the flow chart of the Figure 18 that comprises in the corresponding animated image acquisition process, and the size adjustment of attitude model shown in the flow chart of Figure 22 process, can store and be distributed in storage card (ROM and RAM card etc.) as the executable program of computer, disk (floppy disk, hard disk etc.), CD (CD-ROM, DVD etc.) or in the external recording medium 13 such as semiconductor memory.Have the various terminals that employing communication network (the Internet) N communicates function and can read in memory 12 via the program that recording medium reader 14 will be stored in the external recording medium 13, and control its operation according to read routine, carry out the image processing function of in described embodiment, describing thus, and carry out the process that is similar to said method.

Be included in the described program and can transmit via communication network (the Internet) N with the form of program code so that carry out the data of each said process.Described routine data can obtain from the terminal that is connected to communication network (the Internet) N, carries out above-mentioned image processing function whereby.

(second embodiment)

Figure 23 is the block diagram that the electronic circuit of image delivery server 110 in the expression image delivery system of the present invention is formed.

Figure 24 is the block diagram that expression is formed according to the electronic circuit of terminal 120 in the image delivery system of second embodiment.

Described image delivery system to various terminals 120, provides image creation/transmission service such as portable telephone 120A, the PDA(Personal Digital Assistant) 120B, personal computer (PC) 120C, the digital camera 120D etc. that are connected to such as the communication network of the Internet or bluetooth (R) from image delivery server 110.The image (for example, corresponding to the character image that picks up the human image in the scene image) that described image delivery server 110 transmits corresponding to the target image in the image that is picked up by terminal 120 (120A-120D) to each terminal 120.

In Figure 23, described image delivery server 110 comprises computer, is used for the program of playback record on various recording mediums, perhaps reads the outside program that receives, and computer operation is by the program control of reading.Computer comprises CPU (central processing unit) 111 in its electronic circuit.

Described CPU 111 comes each element of control circuit according to being stored in server controls program in the memory 112 in advance, reading in the server controls program of memory 112 from reading in the server controls program of memory 112 or another webserver (being the procedure service device in the case) from the Internet N such as the external recording medium 113 of CD-ROM via recording medium reader 114 via electric transmission controller 115.The server controls program that is stored in the described memory 112 starts from the input signal that the input unit 117 that comprises key or touch panel produces by the signal of communication that comes from each terminal 120 (120A-120C) on the Internet N that connects via transmission control unit (TCU) 115, the signal of communication that comes from the digital camera 120D that connects via short-distance wireless communication unit 116 or by the operator.

Described CPU 111 and memory 112, recording medium reader 114, transmission control unit (TCU) 115, short-distance wireless communication unit 116 and input unit 117 and comprise LCD or the display unit of CRT 118 is connected.

Remove the system program of the overall operation of being responsible for image delivery server 110, on the Internet N, carry out the signal procedure of transfer of data with each terminal 120 (120A-120C) via transmission control unit (TCU) 115, and in the communication range of short-distance wireless communication unit 16, carry out beyond the short haul connection program of data communication with digital camera 120D via communication unit 16, described memory 112 has been stored image convey program 112a, be used for producing image corresponding to the object images of captured image, wherein said captured image is to obtain from a corresponding terminal 120 (120A-120D) that communicates to connect via transmission control unit (TCU) 115 and short-distance wireless communication unit 116, adds to correspondence image in the captured image and the image that will generate thus is sent to terminal.

Described memory 112 has been prepared model attitude video memory 112b, the model attitude video memory 112c of size adjustment, role 1 " rabbit " attitude video memory 112d, role 2 " bear " attitude video memory 112e, role 3 " cat " attitude video memory 112f, and requester terminal information-storing device 112g, and in its service area, have the scene image of picking up memory 112h and image processing service area 112i.

Those of the role " rabbit ", " bear " and " cat " image who triggers each attitude among role " rabbit ", " bear " and " cat "

attitude video memory

112d, 112e and the 112f be stored in image delivery server 110 respectively and Fig. 2-4 illustrated of first embodiment are the same, so Fig. 2-4 also is used to describe second embodiment.

The every kind of attitude image that is stored in the role among

memory

112d, 112e and the 112f is used as is similar to the imitation image that picks up object in the scene image (target) image on attitude, the wherein said scene image that picks up is to import according to the demand of a corresponding exterior terminal 120 (120A-120D) that communicates to connect with described image delivery server 110.Each attitude angle color image has its corresponding attitude numbering and is stored.

Fig. 5-7 relates to first embodiment and also is used for graphic extension second embodiment here.Fig. 5-7 shows the model image that triggers each attitude among the model attitude video memory 112b that is stored in image delivery server 110.

Be stored in every kind of attitude model image among the memory 112b and be used for obtaining on attitude, to be similar to the model image of object (target) image that picks up in the scene image, the wherein said scene image that picks up is to import according to the demand of a corresponding exterior terminal 120 (120A-120D) that communicates to connect with image delivery server 110, and different attitudes are stored and have corresponding attitude numbering.In addition, be each attitude numbering storage three different types of model image A, B and C.

Be stored in the character image among each role 1 " rabbit " attitude video memory 112d, role 2 " bear " attitude video memory 112e and role 3 " cat " the attitude video memory 112f, be used for triggering all attitudes numbering of being stored in described model attitude video memory 112b (numbering 1A, 1B, 1C, 2A, 2B, 2C ..., na, nb, nc) the image of attitude.

Is non-type body shape object (target) image by vertical and horizontal with the size adjustment of the standard body shape model image of total length figure, can obtain to be stored in the model image of the size adjustment of the attitude numbering 2A among the model attitude video memory 112e of size adjustment, wherein said total length figure triggers the attitude shown in the attitude numbering 2A among Fig. 4.According to have attitude numbering 2A and be stored in the size adjustment among the model attitude video memory 112c of size adjustment model image vertically-grid scale, the size of regulating the every other standard body shape model image that triggers each attitude.

The model image of the following acquisition size adjustment in the model attitude video memory 112c of size adjustment to be stored.In Fig. 8 (A), aspect big or small, be adjusted to the nonstandard body shape object images shown in (vertical and horizontal) Fig. 8 (B), so that become corresponding to image after the size adjustment of attitude numbering 2A with the total length standard body shape attitude model image shown in the attitude numbering 2A.Size adjustment ratio (balance) according to the model image of the size adjustment of attitude numbering 2A, the every other standard body shape model image of other attitudes is adjusted to non-standard body shape model image in size, is stored in then among the model attitude video memory 12c of size adjustment.

Requester terminal information-storing device 112g has the password of ID, Bank Account Number and the terminal 120 (120A-120D) of depositing, transmit member's individuality mail-order business information with this as relevant image, wherein said image transmits the member and has required image delivery server 110 to deposit them like this.

The described scene image memory 112h that picks up is according to picking up the pick up scene image data of the interim storage of scene image unit from each exterior terminal 120 (120A-120D) input, and wherein said exterior terminal 120 communicates to connect with image delivery server 110.

Described image processing service area 112i is according to image processing, and interim storage is according to the view data of image convey program 112a processing.

In Figure 24, each terminal 120 comprises computer, is used for the program of playback record on every kind of recording medium, perhaps reads the outside program that receives, and computer operation is by this program control.Its electronic circuit comprises CPU (central processing unit) 121.

Described CPU 121 is according to reading in TCP in the memory 122 in advance, reading in the TCP of memory 122, the operation that comes the control circuit element from reading in the TCP of memory 122 or the webserver (being the procedure service device in the case) from the Internet N such as the external recording medium 123 of CD-ROM or ROM card via recording medium reader 124 via electric transmission controller 125.Be stored in the input signal that the TCP in the memory 122 produces the operation of input unit 126 by the user, via the picture signal of image input unit 127a by digital camera 132 inputs, with the signal of communication on the Internet N that is connected to terminal 120 via transmission control unit (TCU) 125 such as each webserver of image delivery server 110, start with the signal of communication of the image delivery server 110 that is connected to terminal 120 via short range antenna communication unit 128 or from the current location detection signal of the current location of GPS (global positioning system) 129 portable terminals 120, described input unit 126 comprises key or touch panel.

Described CPU 121 is connected with display unit 130 and the image printer 131 of memory 122, recording medium reader 124, transmission control unit (TCU) 125, input unit 126, image input unit 127a, short-distance wireless communication unit 128 and GPS 129 and LCD via image output unit 127b.

Image input unit 127a receives the scene image data of picking up that comes from outside connection or embedded digital camera 132.For example, if described terminal 120 comprises portable telephone 120A, PDA(Personal Digital Assistant) 120B or digital camera 120D, image input unit 127 receives the scene image data of picking up that comes from embedded digital camera 132 so.If described terminal 120 comprises personal computer (PC) 120C, image input unit 127 receives the scene image data of picking up that comes from the outside digital camera 132 that connects so.

Described image output unit 127b exports by image delivery server 110 based on the view data of being imported by image input unit 127a according to terminal request of picking up the scene image processing and transmitting.View data with output is sent to image printer 131 and printing then.

Remove the system program of being responsible for control terminal 120 (120A-120D) integrated operation, via the signal procedure that carries out data communication such as each webserver of image delivery server 110 on the Internet N on the transmission control unit (TCU) 125, and carry out outside the short haul connection program of data communication via wireless communication unit 128 and the image delivery server 110 that in the communication range of short-distance wireless communication unit 128, exists, described memory 122 is gone back storing communication/image processing program 122a, be used for requirement image delivery server 110 based on picking up the scene image carries out image processing from image input unit 127a input, be used to show the view data that transmits by described image delivery server 110, and be used for carrying out print processing via described image output unit 127b.

The model attitude video memory 122b that described terminal 120 (120A-120D) is will be on specification similar to those memories 112b of comprising and 112c in the memory 112 of the image delivery server 110 of second embodiment and the model attitude video memory 122c of size adjustment are included in the memory 122.

Described memory 122 comprises image processing service area 122d, is used for the view data that interim storage is handled according to its process according to communication/image processing program 122a.

Next will outline the operation of the image delivery system of second embodiment.

Figure 11 relates to first embodiment and also it is applied to describe second embodiment.Figure 11 for example understands when terminal 120 has been specified the mirror image reversal character image to add pattern and required from image delivery server 110 transmitted images, add mirror image reversal character image " rabbit " in picking up scene image.

Shown in Figure 11 (A), described terminal 120 is picked up the scene image 12g3 that comprises object images (target image) H, and wherein said object images H triggers and for example recognizes the attitude of dancing with the partner in advance; And require image delivery server 110 to create composograph, in described composograph, the character image of mirror image reversal adds pattern and target image dancing by the character image of designated mirror counter-rotating; And composograph is sent to terminal 120.

Then, shown in Figure 11 (B), in image delivery server 110, object (target) image H is extracted from terminal 120 picking up the scene image 12g3 of transmission.When " rabbit " character image is appointed as the content of interpolation, from described role 1 " rabbit " attitude video memory 112d, read out in " rabbit " character image that attitude is similar to object (target) image H, shown in Figure 11 (C) with 19 (" dancings ") of attitude numbering.So, with this " rabbit " character image mirror image reversal and add the position of picking up among the scene image 12g3 ' to respect to vertical center line and object (target) image symmetrical, and wherein " rabbit " image of mirror image reversal links with object (target) H of dancing purpose, shown in Figure 11 (D).Produced composograph like this, then composograph has been sent to requester terminal 120, and shown there or print.

In brief, " rabbit " character image of object (target) the image H dancing attitude among the scene image 12h1 that is picked up by terminal 120 is imitated in described image delivery server 110 mirror image reversals, and add " rabbit " character image of mirror image reversal to pick up among the scene image 12h1 a position as the dancing partner, in this position, " rabbit " character image of mirror image reversal and object (target) image links that triggers the dancing attitude for the dancing purpose.Then the composograph that obtains is sent to terminal 120.

Figure 25 understands that for example utilization " bear " character image substitutes object images, when the terminal 120 of image delivery system has been asked to create image and from the server transmitted image and when having specified a plurality of image pickups/alternating pattern, carried out these operations by image delivery server 110.

When the user of terminal 120 wishes to create the scene image that object images and " bear " character image wave farewell each other, the user picks up the scene image that comprises object (target) image H1, wherein said object (target) image H1 triggers with character image and wishes identical " farewell " attitude of triggering, shown in Figure 25 (A), pick up scene image to image delivery server 110 transmissions, and require image delivery server 10 by specifying a plurality of image pickup/compositional models, based on the scene image 12h2 that picks up, create synthetic scene image, and transmit synthetic scene image to terminal.

Shown in Figure 25 (B), described image delivery server 110 is extracted image (target image) H1 from first captured image 12h2 that the user sends.When the user is appointed as the replacement content with " bear " character image, read out in " bear " character image (triggering the attitude " farewell " of numbering 11) that attitude is similar to object (target) image H1 from described role 2 " bear " attitude video memory 112e.In this case, when for example detecting the current time, read " bear " character image that triggers attitude " farewells ", and conduct is sitting in character image 12e at night (11) N on the moon for " 08:00 in afternoon " or when determining to be evening now.

Then, shown in Figure 25 (D), when terminal 120 has been picked up the second scene image 12h2 ' that comprises target image H2, wherein scene image 12h2 ' comprises as picking up the target image H2 of the partner of object images (target image) H1 among the scene image 12h2 corresponding to first, and trigger another attitude, " bear " character image of numbering 11 attitudes (" farewell ") of the triggering use in evening that at this moment will read adds second to and picks up scene image 12h2 ', the composograph that obtains is provided whereby, in Figure 25 (E) with 12h2 " illustrate.Then consequent composograph is sent to requester terminal 120, and shows there or print.

In brief, in image delivery server 110, the character image of the farewell attitude of object (target) image H1 is added among the second scene image 12h2 ' appropriate position with respect to the position of object (target) image H2 among the first scene image 12h2 that picks up of imitation terminal 120, consequent composograph is provided thus, send it to terminal 120 then, the wherein said second scene image 12h2 ' is picked up by terminal 120.

Though Figure 13 is used to illustrate the object alternative Process of the image output device 110 of first embodiment, it also goes for explaining the similar object alternative Process of the image delivery server of second embodiment.

Figure 13 for example understands when terminal 120 and requires to create images and when image delivery server transmits and specified object images selection/alternating pattern, utilize the alternative object images of " rabbit " character images by described image delivery server 100.

Shown in Figure 13 (A), described terminal 120 is picked up scene image 12g5, it comprises for example three people (object) image H1-H3, described scene image is sent to image delivery server 110 together with the notice of the alternative character image (for example " rabbit ") of an appointment, and, send it to terminal 120 then by specifying an object image selection/alternating pattern requirement image delivery server 110 to create composograph based on picking up scene image.

So shown in Figure 13 (B), described image delivery server 110 is extracted object (perhaps target) image H1 from picking up of sending of terminal 120 the scene image 12g5, and be assigned therein as by terminal 120 and substitute.When having specified when substituting " rabbit " character image, from described role 1 " rabbit " attitude video memory 112d, read out on the attitude " rabbit " character image that (attitude of numbering 1 " smiles " (close-up shot)) is similar to object (target) image H1, shown in Figure 13 (C).

As Figure 13 (B), (D), (E) with (F), object (target) the image H1 of appointment and other object images H2 and H3 are excised from scene image 12g5 and all the other background image 12g5 ' keep.

So, shown in Figure 13 (G), from described role 1 " rabbit " attitude video memory 112d, read out in other two object images H2 and H3 that attitude is similar to " rabbit " character image of appointed object image (target image) H1 and shears from scene image 12g5, be added to the appropriate position among the background image 12g5 ', and add according to descending order, the composograph that obtains 12g5 is provided thus " to the image pickup distance of relevant each object.Then with described composograph 12g5 " be sent to requester terminal 120, and show there or print.

In brief, in described image delivery server 110, " rabbit " character image of the attitude of appointed object (target) image H1 among the scene image 12g5 that imitation is picked up by terminal 120 is replaced object (target) the image H1 among the scene image 12g5 that is picked up by terminal 120, and the composograph that obtains is sent to terminal 120.

In described image delivery system, except that the reflex angle color image adds pattern, a plurality of image pickup/alternating pattern and object images selection/alternating pattern, described image processing pattern comprises that also the follower adds pattern and the clear area character image adds pattern, in the operation summary of image delivery server, omitted and used the explanation of accompanying drawing them.

In described follower's interpolation pattern, pick up the scene image 12hn that comprises object (target) image H walking or trigger the walking attitude when described terminal 120, and require image delivery server 100 by specifying the follower and add pattern and as the follower's of model image H attitude character image, create synthetic scene image based on scene image 12hn, and will synthesize scene image and be sent to terminal 120 time, described image delivery server 110 is added the character image of the appointment among the scene image 12hn to follow object (target) image H as the character image of follower's appointment position, transmits the composograph that obtains to terminal 120 whereby.

Pick up the scene image 12hn that comprises any object (target) image H when described terminal 120, send the character image of appointment of the attitude of this scene image 12hn and imitation appointed object (target) image H to image delivery server 110, and require to transmit server 110 and add pattern by specifying the white space character image, create synthetic scene image based on scene image with the role H that picks up appointment among the scene image 12hn, and when terminal transmits composograph, described image delivery server 110 is added the character image of appointment the random position of the clear area of scene image 12hn to, transmits the composograph that obtains to terminal 120 whereby.

Next the image processing of image delivery server 110 and terminal 20 and the details of transfer operation will be described.

Figure 26 is the flow chart for the treatment of by the image processing (part 1) of terminal 120 execution.

Figure 27 is the flow chart of image processing (part 2) of image processing (part 1) of Figure 26 of continuing.

Figure 28 is the flow chart for the treatment of by the server process (part 1) of image delivery server 110 execution.

Figure 29 is the flow chart of server process (part 2) of server process (part 1) of Figure 28 of continuing.

At first, the operation that described terminal 120 (120A, 120B or 120C) responds its input unit 126 to be being connected to the Internet N and going up or image delivery server 110 in the short-distance wireless communication scope via transmission control unit (TCU) 125 or short-distance wireless communication unit 128, and sends user ID and passwords (step TA1) thereof to image delivery server 110.

When described image delivery server 110 by the Internet N via transfer unit 115 from terminal 120 (120A, 120B or 120C) or via short-distance wireless communication unit 116 (step SB1) when described terminal (digital camera) 120D receives ID and password, according to Termination ID and password whether can with ID and the password match of member among the requester terminal information-storing device 112g that is deposited with memory 112, determine whether described terminal is full member (step SB2).

When the ID that determines terminal 120 and password can not find coupling in registered members's ID and password, and when definite terminal is not the full member, interrupt being connected of terminal 120 and image delivery server 110 so, and error process (step SB2, "No").

When terminal 120 with do not interrupt in its ID and one period scheduled time after password sends to image delivery server 110 terminal 120 and image delivery server 110 be connected (step TA1) time, the data of expression terminal 120 current locations that GPS 129 is detected (under the situation of portable telephone 120A, be the data of the position of its relevant base station of expression) send to image delivery server 110 (step TA2) from terminal 120.

As described image delivery server 110 (step SB3) when terminal 120 receives the data of expression terminal current location, determine whether terminal 120 is present in predetermined specific position (for example, the souvenir photo in amusement park or tourist spot obtains the place) or determines whether that the current time is in fixed time zone (for example at night) (step SB4).

If described image delivery server 110 is determined that described terminal 120 is current and is present in predetermined special place, determine that perhaps the current time is present in fixed time zone (step SB4), so (for example corresponding to the specific role in specific place, be popular role there under the situation of amusement park) or corresponding to the specific role in fixed time zone (for example, be " bear " role who is sitting on the moon under the situation at night) be confirmed as assigned role corresponding to destination object, and then this role's title is sent to terminal 120 (step SB5).

Terminal 120 under described image delivery server 110 is determined to connect is not positioned at predetermined place, perhaps definite current time is not positioned at fixed time zone (step SB4), and image delivery server 110 is waited for the type (step SB6) that receives assigned roles from terminal 120 so.

If because of terminal 120 is in this specific place or the current time is in the fixed time zone, described terminal 120 has received that image delivery server 110 is determined and the title (step TA3) of the specific role that sends, so this specific role title is sent to display unit 130 and shows (step TA4).

When because terminal 120 is not positioned at specific place or the current time is not positioned at the fixed time zone, described terminal 120 does not receive the title (step TA3) of specific role from image delivery server 110, the user of terminal 120 operates type that input unit 126 comes assigned role (" rabbit ", " bear " or " cat ") image with as the interpolation content of picking up in the scene image so, perhaps replacement, and send the character image (step TA5) of specified type to image delivery server 110.

Then, described terminal 120 is selected to add or substitute/integrated mode from " 1-1: white space character image at random adds pattern ", " 1-2: the follower adds pattern ", " 1-3: the character image of mirror image reversal adds pattern ", " 2-1: object images selection/alternating pattern " and " 2-2: a plurality of image pickup/alternating patterns ", and sends the pattern numbering (step TA6) of expression preference pattern to image delivery server 110.

Described then digital camera 132 beginnings, are picked up this series scene image then and are sent to image delivery server 110 (step TA7) to a series of scene images that pick up of terminal 120 inputs via image input unit 127a.

When described image delivery server 110 receives the pattern numbering (step SB7) of expression preference patterns and when described terminal 120 receives these series and picks up scene image (step SB8), carries out the process (step SBC) of the extraction target image of the Figure 30 that comprises in the server process process from terminal 120.

In this target image leaching process, pick up scene memory 112h (step SC1) with what this series that receives from terminal 120 at the fixed time picked up that scene image 12hn is stored in the service area.

So, pick up among the scene image 12hn from being stored in this series of picking up (step SC2) the scene image memory 112h and being stored among the image processing service area 12i (step SC3), extract a series of continuous attitude object images Hn of a series of continuous transition activities that show each object.

In brief, be included in each object images Hn of picking up among the scene image 12hn as piece independently and when being stored in image processing service area 12i (step SBC) when from pick up scene image 12hn, extracting, the scene image 12hn that picks up that is included in the character image Hn of each extraction that comprises among the broken line encirclement M is presented on the display unit 118, for example shown in Figure 11 (A), 12 (A) or 13 (A) (step SB9).

So, determine whether picking up on being presented at display unit 118 exists a plurality of object images Hn pieces (step SB10) among the scene image 12hn.

If described image delivery server 110 determines there are not a plurality of object images Hn pieces in picking up scene image 12hn, the single object images Hn that will extract from pick up scene image 12hn is set at the target image (step SB10 → SB 11) of imitation so.

Determine to pick up when having a plurality of object images Hn piece among the scene image 12hn when described image delivery server 110, image delivery server 110 sends the request (step SB10 → SB 12) that users specify object images piece to be imitated to terminal 120.

As terminal 120 (step TA8) when server 110 receives these requests and show it, the user handles input equipment 126 specifies an imitation from a plurality of object images Hn pieces target image, and provides the notice (step TA9) of specify image to image delivery server 110.

Then, described image delivery server 110 receives this notice (step SB 13) from terminal.

Then, described image delivery server 110 is from picking up the object images Hn that scene image 12hn extracts appointment, and the wherein said scene image 12hn that picks up receives from terminal 120, and the object images Hn of this appointment is set at the target image of imitation.Then, described image delivery server 110 is with the corresponding animated image acquisition process (step SBD) of its treatment conversion for comprising in the server process of Figure 31.

In this corresponding animated image acquisition process, described image delivery server 110 is at first assessed to trigger and is stored in each model image of the different attitudes among the model attitude video memory 112b and the similitude (step SDC) of object images Hn on attitude of extracting and be set at the target image of imitation from pick up scene image 12hn.Then, described image delivery server 110 sends corresponding to the character image A (step SD1) that has with the appointment of the attitude numbering of the model image of the highest attitude similitude of object images to terminal 120.

As described terminal 120 (step TA10) when image delivery system 110 receives the character image A of appointments and show it, the user determines that click shown appointment attitude angle color image is " OK " or " next demonstration " (next candidate's demonstration), sends the notice (step TA11) that this determines to image delivery server 110 then.

When described image delivery server 110 receives when selecting notice and definite terminal 120 to select " is OK based on the similitude of current assessment, the appointment attitude angle color image of demonstration " from terminal 120, the character image (by its attitude number-mark) that described image delivery server 110 is deposited appointment is as corresponding to the animated image of the target image of imitation (step SD2 → SD3).

When described image delivery server 110 receives when selecting notice and determining to have selected " next demonstration " of attitude image of the assigned role that receives based on current similitude assessment from terminal 120, described image delivery server 110 sends character image A corresponding to another appointment of the attitude numbering of the model image with second lofty stance similitude to terminal 120.When the user who receives " next show " from terminal 120 selects,, just repeat this operation (step SD2 → SD4) as long as there is attitude angle color image corresponding to the attitude model image.

When described terminal 120 receives corresponding to the attitude angle color image (receiving from image delivery server 110) of the model image with expectation attitude similitude and shows described attitude angle color image, and the user handles input unit 126 when image delivery server 110 sends shown character image " OK " (step TA10-TA12), and the character image (by its attitude number-mark) that image delivery server 110 is deposited OK is as corresponding to the animated image of the target image of described imitation (step SD2 → SD3).

As mentioned above, in the corresponding animated image acquisition process that image delivery server 110 is carried out, the evaluation form model image and the similitude of object images Hn on attitude of each attitude of class basic model of leting others have a look at as the target image of the imitation of from pick up scene image 12hn, extracting by terminal 120, and determine to be used as the character image of the appointment of the interpolation content of attitude of model image Hn or replacement.

In this case, compare with following this situation: every kind of attitude image directly assessing assigned role and the similitude of object images Hn on attitude as the target image of imitation, add role or role's character image as an alternative so that determine with being used as, described corresponding animated image acquisition process is very useful, in this process, assess the similitude of object images Hn on attitude of the target image of each model image and conduct imitation, and number to determine to be used as according to selected model attitude and add role or role's character image as an alternative, so use human graphical model to make it easy to obtain the attitude similitude higher, and be convenient to obtain to have the more character image of lofty stance similitude (imitation) thus with object images.

Though the similitude evaluation process of Figure 18 is carried out by the image output device of first embodiment, similarly the similitude evaluation process also can be carried out by the image delivery server among second embodiment.Thereby, in a second embodiment, the similitude evaluation process is described with reference to Figure 18.

Figure 18 is the process of the similitude of target image on attitude of assessment animated image in the corresponding animated image acquisition process that comprises in the pending server process of the image delivery server 110 by image delivery system and imitation.

Figure 32 for example understands the example of the similitude of target image on attitude of assessment models character image in the pending corresponding animated image acquisition process of image delivery server 110 and imitation.

Shown in Figure 32 (A), the model image that for example has first attitude numbering is read out (step C1) and is adjusted to the target image H1 (step C2) of the imitation of Figure 32 (X) aspect big or small.

Then, the model image of target image H1 and size adjustment is overlapped each other, and assess the similitude on attitude (%) between them, and the similitude on attitude is stored (step C3) as model image and target image H1.

Determine then whether described model image is asymmetric (step C4).When definite model image when not being asymmetric, for example among Figure 32 (A) (step C4; " shown in 12b (1) A "), do not read next attitude numbering model image (step C8 → C9), and assess the similitude of target image on attitude of this model image and imitation.As long as next model image is not asymmetric, just repeat this similitude evaluation process (step C2-C4).

If determine that based on similitude assessment model image is asymmetric, for example shown in the model image 12b19 of the attitude of Figure 32 (B) numbering 19, so with described model image mirror image reversal (step C4 → C5).Then, shown in Figure 32 (C), model image 12b (19) R of mirror image reversal aspect big or small (vertically and laterally) is adjusted to the target image (step C6) of imitation.

Then, model image 12b (19) R with target image H1 and mirror image reversal overlaps each other.Assess the similitude on attitude (%) between these images, and save as the model image and the similitude (step C7) of target image H1 on attitude of mirror image reversal.

Then, as long as there is interdiction model image (step C8) with corresponding attitude numbering, can sequentially read they (step C9), and repeatedly assess the similitude (step C2-C7) of target image on attitude of a corresponding model image and imitation.

In this example, for example shown in Figure 32, when similitude on attitude of assessment models image and object (target) image H1, the model image 12b (19) that will have attitude numbering 19 is evaluated as the image that has with the lofty stance similitude of target image H1.

As mentioned above, when the assigned role image of in corresponding animated image acquisition process, determining model image Hn during as the target image of the imitation of from pick up scene image 12hn, extracting (step SBD), for example with reference to Figure 31, shown in 18 and 32, determine so to specify and the image sets that receives become the mode " interpolations/integrated mode " or " alternative/integrated mode " (step SB 14) by terminal 120.

If being become the mode by the image sets of terminal 120 appointments is " interpolation/integrated mode " and " 1-1: white space character image at random adds pattern " (step SB 14 → SB 15, " 1-1 "), the assigned role image of the imitation target image H1 attitude of the target image of the conduct imitation that obtains in corresponding animated image acquisition process so is added to and picks up the random site in the clear area except that the position of extracting the object images piece among the scene image 12hn, (step SB17a) for example shown in Figure 10.Then the composograph that obtains is sent to terminal 120 (step SB22).

Then terminal 120 from image delivery server 110 receive described composographs and show it (step TA13).When the user of terminal 120 carries out character image when its current location moves to process at the synthetic diverse location that picks up any appointment the scene image 12hn, the relevant information that it moves is sent to image delivery server 110 (step TA14).

As image delivery server 110 (step SB23 → SB24) when terminal 120 receives these information, image delivery server 110 moves to described character image position different in the clear area of picking up scene image 12hn (step SB25) based on described information, sends the composograph (step SB26) that obtains to terminal 120 then.

So terminal 120 receives and shows this composograph (step TA15 → TA16) from image delivery server 110.

In brief, the data that described image delivery server 110 sends about composograph to terminal 120, wherein the character image with described appointment adds the random site that picks up in the scene image 12hn clear area to, the character image of wherein said appointment be used for imitating appointment object images H1 attitude and be created at random white space character image interpolation pattern.

When image delivery server 110 definite image sets by terminal 120 appointments become the mode is " interpolation/integrated mode " and " 1-2: the follower adds pattern " (step SB14 → SB15, " 1-2 ") time, the assigned role image that it will be used for model image (target image) walking attitude adds to picking up among the scene image 12hn that corresponding animated image acquisition process (Figure 31) obtains, and add to in the upper/lower positions, described position is: the character image of appointment is to follow the position of object images (target image) H of walking apart from this object images one given distance, or the position of object (target) image of in picking up scene image 12hn, before the time of determining, supposing, (step SB17b) as shown in Figure 9.This image delivery server 110 sends the composograph (step SB22) that obtains to terminal 120 then.

As terminal 120 (step TA13) when image delivery server 110 receives described composographs and show it there, and the user artificially of terminal 120 is carried out and will as the assigned role image of follower in the composograph when its current location moves to the process of diverse location of any appointment the relevant information that it moves be issued image delivery server 110 (step TA14).

As image delivery server 110 (step SB23 → SB24) when terminal 120 receives these information, image delivery server 110 is added appointment once more in the diverse location that picks up scene image 12hn character image sends the composograph (step SB26) that obtains to terminal 120 then as follower (step SB25).

Then, terminal 120 receives these composographs and shows its (step TA15 → TA16) from image delivery server 110.

In brief, the data that described image delivery server 110 sends about composograph to terminal 120, in described composograph, add the character image of described appointment to after the object images H follower position, the character image of wherein said appointment be used for imitating appointment object images H attitude and create in follower's interpolation pattern.

When becoming the mode, image delivery server 110 definite image sets by terminal 120 appointments comprise " interpolation/integrated mode " and " 1-3: the character image of mirror image reversal adds pattern " (step SB14 → SB15, " 1-3 ") time, " rabbit " character image 12d (19) of image delivery server 110 mirror image reversals model image (target image) H dancing attitude in scene image 12g3, be added into " rabbit " character image and the position (step SB17c) that target image H links of mirror image reversal among the scene image 12g3, send the synthetic scene image 12g3 ' (step SB22) that is synthesized to terminal 120 then.

As terminal 120 (step TA13) when scene image transmits server 110 and receives described composograph 12g3 ' and show it, and " rabbit " character image 12d (19) R (R means counter-rotating) will pick up the counter-rotating among the scene image 12g3 ' is carried out when its current location moves to the process of diverse location of any appointment in the user artificially, and the relevant information that it moves is sent to image delivery server 110 (step TA14).

As image delivery server 110 (step SB23 → SB24) when terminal 120 receives mobile messages, image delivery server 110 is added " rabbit " character image of mirror image reversal to different position (step SB25) among the scene image 12g3 ' once more based on mobile message, and the synthetic scene image that will be synthesized then sends to terminal 120 (step SB26).

Then, terminal 120 receives these synthetic scene images and shows its (step TA15 → TA16) from image delivery server 110.

In brief, the data that image delivery server 110 sends about scene image 12g3 to terminal 120, the position that " rabbit " character image that wherein " rabbit " character image of mirror image reversal is added to mirror image reversal and object images H link, wherein " rabbit " character image of mirror image reversal is used for imitating the attitude of dancing object images H and is created in the character image interpolation pattern of mirror image reversal, for example shown in Figure 11 (D).

If becoming the mode, image delivery server 110 definite image sets by terminal 120 appointments comprise " substituting/integrated mode " and " 2-1: object images selection/alternating pattern " (step SB14 → SB16, " 2-1 ") time, image delivery server 110 utilizes " rabbit " character image 12d 1. to substitute object images (target image) H1 (step SB 18) of appointment, 1. described " rabbit " character image 12d is used for imitation as the attitude of picking up the object images H1 of the target image of the imitation of appointment among the scene image 12g5 that obtains at corresponding animated image acquisition process (Figure 31), send the synthetic scene image 12g3 ' that is synthesized, (step SB22) for example shown in Figure 13 to terminal 120 then.

In this case,, that is to say three object images, will be in picking up scene image 12g5 specified target object image H1 and other two object images H2 and H3 from pick up scene image 12g5, shear, and produce and pick up background image 12g5 '.Then, " rabbit " character image 12d that will on attitude, be similar to intended target object images H1 1. and all the other two object images H2 that from scene image 12g5, shear and H3 add to and pick up each relevant position among the background image 12g5 ', and aforesaid operations is to add according to the descending order of the image pickup distance of detected and each related object, and the composograph that obtains is provided thus.

Under the situation that does not produce all the other background image 12g5 ', can with " rabbit " character image 12d of on attitude, being similar to target image H1 1. and other two image H2 and H3 add the relevant position place of picking up among the scene image 12g5 them to, and can add according to the descending order that detects to the image pickup distance of each related object.

When terminal 120 from image delivery server 110 receive described composographs and show it (step TA13), and the artificially is carried out and to be picked up scene image 12g5 with adding to " in " rabbit " character image 12d of target image H1 position 1. when its current location moves to the diverse location of any appointment, the relevant information that it moves is issued image delivery server 110 (step TA14).

When image delivery server 110 receives this information (step SB23 → SB24), image delivery server 110 based on described mobile message " rabbit " character image is added to once more pick up scene image 12g5 " in different position to replace target roles image H1 (step SB25), send the composograph (step SB26) that obtains to terminal 120 then.

So terminal 120 receives these composographs and shows its (step TA15 → TA16) from image delivery server 110.

In brief, the data that image delivery server 110 sends about the composograph of creating in object images selection/alternating pattern to terminal 120, in this image selection/alternating pattern, object images H1 is replaced with " rabbit " character image that the attitude of model image H1 " smiles ", shown in Figure 13 (G).

If becoming the mode, described image delivery server 110 definite image sets by terminal 120 appointments comprise " substituting/combination " pattern and " 2-2: a plurality of image pickup/alternating patterns " (step SB14 → SB16, " 2-2 "), so first position of picking up the destination object image H1 among the scene image 12h2 is saved as the position that the imitation image is replaced destination object image H1, for example shown in Figure 25 (step SB16 → SB19).

When scene image 12h2 ' is picked up in image delivery server 110 acquisitions second (step SB20), it will imitate the object images H1 attitude that obtains in corresponding animated image acquisition process (Figure 31) " bear " character image 12e (11) N (being special " bear at night " character image in this case) adds second position of picking up scene image 12h2 ' to, wherein second pick up scene image 12h2 ' corresponding to object images (target image) H1 in first memory location of picking up among the scene image 12h2, so make that " bear " character image 12e (11) N waves farewell (step SB21) to object images H2, and with the composograph 12h2 that obtains " send to terminal 120 (step SB22).

When terminal 120 receives described composograph 12h2 from image delivery server 110 " and when showing it (step TA13); and carry out composograph 12h2 the artificially " in " bear at night " character image 12e (11) n move to composograph 12h2 from its current location " arbitrarily during the process of the diverse location of appointment, the relevant information that it moves is issued image delivery server 110 (step TA14).

When image delivery server 110 receives this information (step SB23 → SB24), it adds " bear " character image 12e (11) N ' to second diverse location (step SB25) that picks up among the scene image 12h2 ' once more based on the mobile message that receives, and sends the composograph (step SB26) that obtains to terminal 120 then.

In brief, image delivery server 110 is sent in the composograph 12h2 that creates in a plurality of image pickup/alternating patterns to terminal 120 "; wherein described " bear " character image (special " night " character image) is combined with the second object images H2 that picks up among the scene image 12h2 ', wherein said " bear " character image is used for imitating first " farewell is waved " attitude of picking up the object images H1 of scene image 12h2.Then the composograph that obtains is sent to terminal 120.

Terminal 120 receives and shows this composograph.When the user of terminal 120 wishes to be presented at composograph on the terminal 120 and sends to the different terminals of appointment, the user is via the address of input unit 126 input different terminals, sends composographs (step TA17 → TA18) to image delivery server 110 then.

As image delivery server 110 (step SB27) when terminal 120 receives the address of different terminals, image delivery server 110 sends composograph (step SB28) to the different terminals of this address, calculating provides the establishment of composograph and sends the expense of serving for the different terminals of request user and appointment specifically, and to requester terminal 120 mail sending charge per messages content (step SB29).

Described request person's terminal 120 is from image delivery server 110 reception fee contents then, and on display 130, show it (step TA19).

When unaddressed appointment different terminals (step TA17 → deny) is imported and sent to described terminal 120, image delivery server 110 is only calculated specifically establishment that requester terminal is provided and the expense that transmits the service of composograph, and to requester terminal 120 mail sending charge per messages with content (step S27 → SB30).

So described request person's terminal 120 is from image delivery server 110 reception fee contents, and on display 30, show it (step TA20).

The bank account of the requester terminal that described image delivery server 110 is deposited in requester terminal information-storing device 112g sends corresponding bill (step SB 31).

Therefore, image transmitting function according to the image delivery system of second embodiment, when the scene image that terminal 120 is picked up is issued image delivery server 110, described image delivery server 110 is extracted object images from the scene image that receives, acquisition is similar on attitude from role 1 " rabbit " attitude video memory 12d, the character image of the specified type of the object images of extracting among role 2 " bear " attitude video memory 12e and role 3 " cat " the attitude video memory 12f, utilize the specified type character image in picking up scene image that obtains to substitute the object images of picking up in the scene image, perhaps add the character image that requires and arrive the scene image, so that the composograph that obtains is provided whereby, and to terminal 120 these composographs of transmission.Thereby, not having to create and transmit only is will fixing animated image to add under the situation of scene image of image pickup frame, can create and transmit divine synthetic scene image to terminal, in described divine synthetic scene image, the animated image that imitates destination object attitude in the original scene image is used as the role who adds the role or be used as alternative destination object on the contrary.

By the image delivery server in the image delivery system that utilizes second embodiment 110, various services can be provided, comprise: transmit the mail comprise synthetic scene image, described synthetic scene image comprises that imitation picks up the interpolation or the alternative character image of object images attitude in the scene image; Synthetic and the transmission of the synthetic scene image of payment, wherein, the character image that imitation is picked up target image attitude in the original scene image is used as interpolation or alternate image in the original scene image, be sent among portable terminal 120B, 120C, the 120D of a corresponding image pickup type, such as cellular phone terminal 120A with digital camera; Pay or freely create and transmit synthetic scene image, wherein, a specific role image of object images attitude is picked up in the scene image in imitation add to or replace described object images on the contrary so that propagate this specific role on the specific homepage; And establishment and transmission that scene image is picked up in payment, wherein imitation is picked up that the popular character image of object images attitude adds digital camera terminal 120D in the scene image, described digital camera terminal 120D connects such as the short-distance wireless communication unit in the public place of entertainment 116 via assigned address.

As mentioned above, in the image delivery system of second embodiment, will issue image delivery server 110 by the image that terminal 120 is picked up.In image delivery server 110, from pick up scene image, extract object images, obtain the character image of the similar object images of extracting on attitude, add character image to scene image or replace object images in the scene image.

Then the composograph that obtains is sent to terminal 120, and the bill of this service is issued terminal 120.Contrast, as among the 3rd embodiment next will as described in, terminal 120 is extracted object images from pick up scene image, determine on attitude, to be similar to the attitude numbering of the model image that extracts object images, and ask described image delivery server 110 to transmit assigned role image with definite attitude numbering.Image delivery server 110 only transmits the character image with definite attitude numbering of being asked by terminal 120 to terminal 120, and the bill that transmits this service to this terminal.Terminal 120 also will be added the character image that transmits to scene image or the opposite object images of utilizing in the character image replacement scene image that transmits, and the composograph that obtains is provided whereby.

(the 3rd embodiment)

Be substantially similar to electronic circuit according to the electronic circuit of the image delivery server 110 of the image delivery system of third embodiment of the invention and terminal 120 (120A-120D) with reference to Figure 23 and 24 second embodiment that describe, except following points:

In the image delivery system of the 3rd embodiment, the model attitude video memory 112c of described model image memory 112b and size adjustment is not arranged in the image delivery server 110, but is provided in the terminal 120.

Figure 33 is the flow chart for the treatment of in the image delivery system of the 3rd embodiment by the image processing (part 1) of terminal 120 execution.

Figure 34 is the flow chart of image processing (part 2) of image processing (part 1) of Figure 33 of continuing.

Figure 35 is the flow chart of the pending server process of the image delivery server 110 of the 3rd embodiment.

At first, the operation of terminal 120 (120A, 120B or 120C) response input unit 126 sends user ID and passwords (step TF1) to image delivery server 110 then to be connected on the Internet N via transmission control unit (TCU) 125 or short-distance wireless communication unit 128 or the image delivery server 110 in the short-distance wireless communication scope.

When image delivery server 110 by the Internet N via transmission unit 115 from terminal 120 (120A, 120B or 120C) receive ID and password or via short-distance wireless communication unit 116 (step SJ1) when terminal (digital camera) 120D receives ID and password, can in the ID that deposits of the member terminal among the requester terminal information-storing device 112g of memory 112 and password, find out the Termination ID and the password of coupling according to whether and determine whether terminal 120 is full member (step SJ2).

When can not find in the ID that determines terminal 120 and member terminal ID that password is being deposited and the password when matching, when promptly this terminal is not the full member, interruption terminal 120 is connected with image delivery server 110, and error process (step SJ2, "No").

When do not interrupt on the scheduled time after image delivery server 110 sends its ID and password in terminal 120 terminal 120 and image delivery server 110 be connected (step TF1) time, the data (with regard to cell phone 120A, being the data of its dependency basis station location of expression) of representing the current location of the terminal 120 that GPS 129 detects are sent to image delivery server 110 (step TF2) from terminal 120.

As image delivery server 110 (step SJ3) when terminal 120 receives the data of its current locations of expression, it determines whether described terminal 120 is present in a predetermined ad-hoc location (for example, souvenir photo obtains the place in amusement park or the tourist quarters) or the current time and whether is in a fixed time zone (for example at night) (step SJ4).

If the terminal 120 under image delivery server 110 is determined to connect is present in predetermined specific place or definite current time is positioned at fixed time zone (step SJ4), determine so corresponding to specific place specific role (for example being popular role there) with regard to the amusement park or corresponding to the specific role (being " bear " role who is sitting on the winding moon at night just for example) in fixed time zone as the specific role corresponding to destination object, the title with this role sends to terminal 120 (step SJ5) then.

Terminal 120 under image delivery server 110 is determined to connect is not positioned at predetermined place, when determining that perhaps the current time is not positioned at fixed time zone (step SJ4), image delivery server 110 is waited for the role (step SJ6) who receives specified type from terminal 120.

If, so the specific role title is sent to display unit 130 and shows (step TF4) by display unit 130 because terminal 120 is positioned at special place or the current time is positioned at the fixed time zone, terminal 120 receives the specific role title (step TF3) that image delivery server 110 is determined and sent.

When terminal 120 not when image delivery server 110 receives the title of specific role (step TF3) because terminal 120 is not positioned at that specific place or current time are not positioned at the fixed time zone, the user of terminal 120 handles input unit 126 and specifies whereby to be used as and add the role pick up in the scene image or alternative role's character types (" rabbit ", " bear " or " cat "), and sends the role (step TF5) of specified type to image delivery server 110.

So the described scene image that picks up begins to be input to terminal 120 (step TF6) via image input unit 127a from digital camera 132, and process proceeds to the target image leaching process (TFG) of the Figure 36 that comprises in the image processing that terminal 120 carries out.

In this target image leaching process, will be input to this series in the terminal 120 at the fixed time by image input unit 127a and pick up among the service area 122d that scene image is stored in memory 122 (step TG1).

So, this series from be stored in image processing service area 122d is picked up in the scene image a series of continuous object images Hn that extracts each action that shows each object as piece (step TG2) independently, and saves as corresponding piece (step TG3) in the 122d of service area.

In brief, be included in the corresponding object image Hn that picks up in the scene image as piece independently and when being stored among the 122d of image processing service area (step TFG) when from pick up scene image, extracting, their broken line surrounded one of the character image Hn that includes corresponding extraction among the M and pick up scene image and be presented on the display unit 130, for example shown in Figure 11 (A), 12 (A) or 13 (A) (step TF7).

So, determine whether picking up on being presented at display unit 130 exists a plurality of object images Hn pieces (step TF8) in the scene image.

If determine not have a plurality of object images Hn pieces, the single object images Hn that will extract from pick up scene image so is set at imitation target image (step TF8 → TF9).

If determine to exist a plurality of object images Hn pieces, handle input unit 126 by the user so and from those object images Hn piece, one object image Hn is appointed as imitation target image (step TF8 → TF10).

When extracting object images Hn and be appointed as the target image Hn of imitation from pick up scene image, process proceeds to the attitude numbering deterministic process (step TFI) of Figure 37.

In this attitude numbering deterministic process, assessment is stored in each different attitude model image among the model attitude video memory 122b and extracts and be set at the similitude (step TIK) of object images Hn on attitude of the target image of imitation from picks up scene image, and the attitude model image that will have lofty stance similitude is presented at (step TI1) on the display unit 130.

When the user when input unit 126 is selected the model image of these demonstrations, the attitude numbering of selected model image is deposited to corresponding to the model image of the target image of imitation (step TI2 → TI3).

The model image of numbering when the attitude that is showing that target image corresponding to expression and imitation has in the model image state of attitude numbering of lofty stance similitude, handles on input unit 126 by the user and give me a little when hitting " next demonstration ", showing the second lofty stance similitude with expression and target image.As long as there are static a plurality of model images, when clicking " next shows ", can show next model image (step TI2 → TI4) than the low profile similitude with different similitudes.

When the user handles that input unit 126 shows and when selecting to have the model image of attitude numbering of expression expectation attitude similitude, the attitude numbering of this model image is deposited to corresponding to the attitude numbering of the target image of imitation (step TI2 → TI3).

As mentioned above, in attitude numbering deterministic process, evaluation form let others have a look at each model image (triggering corresponding attitude) of class basic model and attitude similitude as the object images Hn of the target image of the imitation of from pick up scene image, extracting, and be identified for the attitude numbering of model image of the attitude of model image Hn according to the assessment of similitude.

Figure 38 show according in the image delivery system of the 3rd embodiment by in the attitude numbering deterministic process that comprises in the pending image processing of terminal 120, the flow chart of the target image of assessment models image and imitation similitude on attitude.

For example, shown in Figure 32 (A), the model image with first attitude numbering is read out (step TK1), and is adjusted to the target image H1 (step TK2) of the imitation of Figure 32 (X) aspect big or small.

Then, the model image of target image H1 and size adjustment is overlapped each other, and assess the similitude on attitude (%) between them, and the similitude on attitude is stored (step TK3) as model image and target image H1.

Whether the model image of determining to have interested attitude numbering then is asymmetric (step TK4).When definite model image when not being asymmetric, (step TK4 shown in the 12bA (1) among Figure 32 (A) for example, "No"), read next attitude numbering model image (step TK8 → TK9), and similarly assess the similitude of target image H1 on attitude of this model image and imitation.As long as next model image is not asymmetric, just repeat this similitude evaluation process (step TK2-TK4).

If determine that the model image of similitude assessment is asymmetric, for example shown in the model image 12b19 of the attitude of Figure 32 (B) numbering 19, so with described model image mirror image reversal (step TK4 → TK5).Then, shown in Figure 32 (C), model image 12b (19) R of mirror image reversal aspect big or small (vertically and laterally) is adjusted to the target image (step TK6) of imitation.

Then, model image 12b (19) R of target image H1 and mirror image reversal is overlapped each other on.Assess the attitude similitude (%) between these images, and save as the attitude similitude (step TK7) of the model image and the target image H1 of mirror image reversal.

Then, as long as there are other model images (step TK8) of different attitudes numbering, can sequentially read they (step TK9), and repeatedly assess the attitude similitude (step TK2-TK7) of the target image of a corresponding model image and imitation.

In this example, when for example shown in Figure 32, during the attitude similitude of assessment models image and object (target) image H1, the model image 12b (19) that will have attitude numbering 19 is evaluated as the model image that has with the lofty stance similitude of target image H1.

As mentioned above, when determining that imitation is numbered as the model image attitude of the object images Hn attitude of the target image of the imitation of extracting in the attitudes numbering deterministic process in reference Figure 37,38 and 32 descriptions from pick up scene image (step TFI), the request that transmits the assigned role image that triggers the attitude of determining the attitude numbering is sent to image delivery server 110 (step TF11).

As described image delivery server 110 (step SJ7) when terminal 120 receives the request that transmits character images, read character image in suitable one of role 1 " rabbit " attitude video memory 112d, role 2 " bear " attitude video memory 112e that image delivery server 110 comprises and role 3 " cat " attitude video memory 112f selectively from memory 112, and transmit the character image (step SJ8) that reads to requester terminal 120 with definite attitude numbering.

So, image delivery server 110 is provided by the expense of the transmission service that provides to the request user, and with the notice (step SJ9) of content, and corresponding bill is issued the bank account (step SJ10) of the requester terminal of in requester terminal information-storing device 112g, depositing to requester terminal 120 mail sending charge per messages.

As requester terminal 120 (step TF12) when image delivery server 110 receives the character image with definite attitude numbering, from " 1-1: white space character image at random adds pattern ", " 1-2: the follower adds pattern ", " 1-3: the character image of mirror image reversal adds pattern ", select interpolation/integrated mode (character image that adds reception is to picking up scene image) or alternative/integrated mode (utilizing the character image that receives to substitute the target image H that picks up in the scene image) in " 2-1: object images selection/alternating pattern " or " 2-2: a plurality of image pickup/alternating patterns ".

In the flow chart of the image processing of in Figure 33 and 34, carrying out, omitted routine corresponding to alternative/integrated mode " 2-1: object images selection/alternating pattern " and " 2-2: a plurality of image pickup/alternating patterns " by terminal 120.The abridged routine comprises and the step SB16 of Figure 28 and 29, the identical process that SB18-SB21 represents, and together with after a while step TF14 in interpolation/integrated mode of describing and the process of TF15a-TF15c being carried out selectively.

Therefore, process pending when selecting interpolations/integrated mode is only described here, and omitted selection alternative/pending process during integrated mode.

If determine that at step TF13 it is " interpolation/integrated mode " and " 1-1: white space character image at random adds pattern " (step F 14 that the image sets of appointment becomes the mode, " 1-1 "), the assigned role image of the target image Hn attitude of the target image of the imitation that imitation is transmitted as image delivery server 110 adds the random position of the clear area of picking up scene image 12hn to so, and this random site is the position of removing the position of extraction object images piece.Show the composograph (step TF15a, TF16) that obtains then.

Then, when in composograph, carrying out with the character image in the composograph (step TF17 → step TF18) when its current location moves to the process of diverse location of any appointment, character image is moved on to diverse location in the composograph, and show another composograph that obtains (TF19-TF20).

When becoming the mode, the image sets of determining appointment comprises " interpolation/integrated mode " and " 1-2: the follower adds pattern " (step TF14, " 1-2 ") time, the position that the assigned role image of object images in the scene image (target image) walking attitude adds last scene image to is picked up in image delivery server 110 is transmitted and imitation, the position on relevant of scene image 12hn is picked up in this position corresponding to this series, supposition walking object images (target image) H is in this position before the time of determining, the composograph that obtains is provided whereby, shown in Fig. 9 (D) (step TH15b, TF16).

When the artificially carry out will be as composograph in follower's assigned role image (step TF17 is to TF18) when its current location moves to the composograph arbitrarily the diverse location of appointment, the character image of appointment is moved on to diverse location in the composograph, and show another composograph that obtains (step TF19, TF20).

When becoming the mode, the image sets of determining appointment comprises " interpolation/integrated mode " and " 1-3: the character image of counter-rotating adds pattern " (step F 14, " 1-3 ") time, to imitate " rabbit " character image 12d (19) mirror image reversal of the dancing attitude of object images among the scene image 12g3 (target image) H, add " rabbit " character image of mirror image reversal among the scene image 12g3 a position, in this position, " rabbit " character image of mirror image reversal links with the target image H of dancing purpose, show the composograph 12g3 ' that obtains then, and shown in Figure 11 (D) (step TF15c → TF16).

When carry out with " rabbit " character image 12d (19) R of the counter-rotating among the composograph 12g3 ' when its current location moves to the process of diverse location of any appointment (step TF17 is to step TF18) artificially, " rabbit " character image of mirror image reversal is moved on to diverse location place among the composograph 12g3 ', and show another composograph that obtains (step TF19, TF20).

Then, terminal 120 is received the notice that the user uses the expense content of server service from image delivery server 110, and on display unit 130, show it (step TF21).

Therefore, according to the image transmitting function of the image delivery system of the 3rd embodiment, when terminal 120 is picked up the scene image that comprises a plurality of objects, from the scene image that picks up, extract an object image.Determine the attitude numbering according to the model image of the object images that on attitude, is similar to extraction.Terminal 120 requests have the attitude angle color image of definite attitude numbering and the character image of specified type from image delivery server 110 transmission.So, image delivery server 110 is from role 1 " rabbit " attitude video memory 112d, read in suitable one of role 2 " bear " attitude video memory 112e and role 3 " cat " attitude video memory 112f and have the character image of specifying attitude numbering and type, and transmit the character image that reads to terminal 120, show the composograph that obtains, wherein, can utilize the character image that on attitude, is similar to described object of reception to substitute the object images pick up in the scene image, perhaps add the character image that receives in the scene image and show the composograph that obtains.In brief, the user who is in terminal 120 is not to add fixing animated image simply to picking up frame for enjoyment, but obtain to be similar to the animated image of the object images the scene image in attitude from image delivery server 110, and utilize this animated image to substitute and pick up the object images in the scene image or add this animated image to picking up scene image, so that produce the divine composograph that comprises this animated image whereby.

Image delivery server 110 in the image delivery system of the 3rd embodiment can provide following function to image pickup type

portable terminal

120B, 120C, 120D (such as the cellular phone terminal 120A that comprises digital camera): payment transmits imitation, and each picks up the expense of the character image of object images attitude in the scene image; Payment or free transmit a specific role image that imitation picks up object images attitude in the scene image so as on a specific homepage this specific role of propaganda, and payment transmits imitation via the short-distance wireless communication unit 116 of (such as the public place of entertainment etc.) in the given place and picks up the expense of the popular character image of object images attitude in the scene image to digital camera terminal 120D.

Though in respective embodiments, obtain on attitude, to be similar to the character image of the object images of from pick up scene image, extracting selectively, and be used as the interpolation role or the alternative role that pick up in the scene image, so that the composograph that obtains is provided whereby, but, can store actual face-image that picks up and human image in advance with various expressions, and, export the composograph that obtains whereby as the interpolation role or the alternative role that imitate the object images attitude of from pick up scene image, extracting.

In corresponding the foregoing description, for example understood the scene image that picks up as still image.On the other hand, when described when picking up scene image and comprising the animated image of a series of inputs, can sequentially from this series animated image, extract the object images that the order in time with respect to the background image of this series dynamic image changes.Obtain, be transmitted in the character image (Figure 39) of the object images that is similar to the order extraction on the attitude then selectively, and add it to pick up dynamic image or substitute object images in the corresponding animated image, a series of synthetic animated images that are synthesized are provided whereby, transmit then.

Figure 39 for example understands the cartoon role image that triggers various attitudes among role " rabbit " the animation attitude video memory 112dM that is stored in image delivery server 110.

The image delivery server 110 by utilizing corresponding embodiment or the image processing function of terminal 120, the expectation character image that can obtain to prepare (is similar to the target image of imitation on attitude, the target image of described imitation comprise from the animated image of recreation, specify and extract present the role) or the actual human image that picks up, and be sent to requester terminal, perhaps substitute the role who occurs in the animated image, transmit the composograph that obtains to requester terminal whereby.

As the 4th embodiment next will as described in, the character image that triggers the object images of the various attitudes of being picked up by the user or trigger the various attitudes of appearance the recreation (recreation HP) that the game server from the Internet N downloads can be recorded in the memory of role 1 " rabbit " the attitude video memory 112d, role 2 " bear " the attitude video memory 112e that are similar to memory 112 in the image delivery server 110 and role 3 " cat " attitude video memory 112f.When in the second or the 3rd embodiment, obtain when attitude is similar to the character image of the object images of extracting from pick up scene image, be selected human image that it can be deposited from " rabbit ", " bear " and " cat " character image deposited at first and user and the game role image from image delivery server 110.

(the 4th embodiment)

Figure 40 is the block diagram that the integral body of image delivery system among expression the 4th embodiment is formed.

The object images of the various attitudes of triggering that the cell phone 220A that this embodiment process user utilization has digital camera picks up, and in the memory 212 of image delivery server 210, deposit object images as user's rudimentary horn color image, or opposite, the game role of depositing the various attitudes that triggering downloads from the memory 212A of game server 210A in the memory 212 that transmits server 210 is as the original role of user.

Figure 41 (A) and 41 (B) are that cell phone 220A and image delivery server 210 pending user's rudimentary horn color images of the image delivery system in the 4th embodiment are respectively deposited the flow chart of process.

At first, when the cell phone 220A of the game server 210A on the Internet N by having digital camera from the Internet N game server 210A download user rudimentary horn color image and when depositing, specify the homepage (HP) of the game server 210A that obtains character image, and be connected with cell phone 220A (step TS1 → TS2).

When on the user specifies the homepage (HP) of game server 210A, waiting to be set at the game role of his or his rudimentary horn color image, the various attitude images (step TS4) of the designate game of downloaded stored in the memory 212A of game server 210A.

So, the user ID (=123) of cell phone 220A and the corresponding attitude angle color image of downloading from game server 210A are sent to image delivery server 210 (step TS5).

When the user under the situation of not downloading similar character image, when utilizing cell phone 220A to pick up and deposit user's rudimentary horn color image from the Internet N, described digital camera 232 picks up the scene image that comprises the object images that triggers their corresponding attitudes (step TS1 → TS7).

So cell phone 220A extracts the character image conduct and picks up the object images except that background image (step TS8) in the scene image, and they are stored as the respective corners color image (step TS9) of taking corresponding attitude.

Then, cell phone 220A sends the correspondence image (step TS5) of the corresponding attitude of triggering of its terminal use ID (=123) and storage to image delivery server 210.

When described image delivery server 210 from cell phone 220A receiving terminal user ID and when triggering the character image of their corresponding attitudes (step SR1), except that Figure 23 in the memory 212 for example those corresponding " rabbits ", " bear " and " cat " character image (112d-112f), it deposits the character image (step SR2) of character image as the corresponding attitude that triggers user ID.

When in the second or the 3rd embodiment, described image delivery server 210 is selected and when being transmitted in the character image that is similar to the object images of extracting on the attitude from pick up scene image, selects character image character image that image delivery server 210 can be picked up and deposit from " rabbit ", " bear " and " cat " character image deposited and user and the game role.

The various processes that the image delivery system of describing with reference to respective embodiments is carried out, that is to say, image processing shown in Figure 26 that carries out in the terminal 120 of the image delivery system of second embodiment and 27 the flow chart, the server process that image delivery server 110 in the image delivery system of second embodiment shown in Figure 28 and 29 the flow chart is carried out, the object picture extraction process that comprises in the server process among second embodiment shown in Figure 30 flow chart, the corresponding animated image acquisition process that comprises in the server process of second embodiment shown in Figure 31 flow chart, the process of the target image attitude similitude of assessment role/model image that comprises in the corresponding animated image acquisition process among second embodiment shown in Figure 18 flow chart and imitation, the image processing that terminal 120 is carried out in the image delivery system of the 3rd embodiment shown in Figure 33 and 34 flow charts, the server process of image delivery server 110 in the image delivery system of the 3rd embodiment shown in the flow chart of Figure 35, the target image leaching process that comprises in the image processing of the 3rd embodiment shown in the flow chart of Figure 36, the attitude numbering deterministic process that comprises in the image processing of the 3rd embodiment shown in the flow chart of Figure 37, the process of the assessment models attitude image that comprises in the attitude numbering deterministic process among the 3rd embodiment shown in the flow chart of Figure 38 and the target image attitude similitude of imitation, the user role image of carrying out among the cell phone 220A in the image delivery system of the 4th embodiment shown in Figure 41 flow chart is deposited process, and the user role image process of depositing carried out of image delivery server 210 can be stored and is distributed in storage card (ROM card as computer executable program, RAM card etc.), disk (floppy disk, hard disk etc.), CD (CD-ROM, DVD etc.) and such as semiconductor memory 113 (123,213,223) on the external recording medium.Having various terminals with communication network (the Internet) N communication function can utilize recording medium reader 114 (124,214,224) that external recording medium 113 (123,213,223) is gone up program stored to read in the memory 112 (122,212,222).Therefore, can so that carry out the image transmitting function of describing with reference to corresponding embodiment, carry out the process that is similar to above-mentioned those operations whereby by the operation of these program-con-trolled computers.

Can pass through communication network (the Internet) N transmits the realization respective process with the form of program code routine data.Described routine data can obtain from the terminal that is connected with communication network (the Internet) N, so that realize the image transmitting function.

The present invention is not limited to the embodiment that corresponding embodiment realizes.Under the situation that does not break away from the spirit and scope of the present invention, those skilled in the art can easily make variations and modifications.

Claims

1. a correspondence is picked up the composograph output equipment of scene, it is characterized in that comprising:

Pick up scene image acquiring unit (17), be used to obtain a plurality of scene images that pick up, each in these images all represents to comprise a scene of at least one object;

Target image extraction unit (11) is used for picking up scene image from described a plurality of optional one of the scene images that pick up that pick up the acquisition of scene image acquiring unit, extracts the target image of any special object in this at least one object of expression;

Correspondence image obtains unit (11), is used to obtain the image of the target image that extracts corresponding to described extraction unit;

Image output unit (11,20) is used for that described correspondence image is obtained image that the unit obtains and adds the scene image that picks up that described captured image acquiring unit obtains to, and the composograph that obtains of output;

Specified device (11,16) is used to specify correspondence image motion from its current location to diverse location in the composograph of described output unit output; And

Mobile device (11) is used to respond described specified device, moves to the diverse location of the appointment the scene image of acquisition with adding the correspondence image of picking up scene image to from its current location, thus the composograph that output obtains.

2. a correspondence is picked up the composograph output intent of scene, it is characterized in that, comprising:

Pick up the scene image obtaining step, be used to obtain expression comprise at least one object scene pick up scene image;

The target image extraction step is used for extracting the target image of representing any special object this at least one object from the scene image that picks up that described captured image obtaining step obtains;

The correspondence image obtaining step is used to obtain the correspondence image corresponding to the target image of described target image extraction step extraction;

Image output step is used for adding the correspondence image that described correspondence image obtaining step obtains to the scene image that picks up that described captured image obtaining step obtains, and will synthesizes the composograph output that obtains;

Mobile given step is used to specify the correspondence image on the composograph of described image output step output is moved to other positions of any appointment from its current location; And

Mobile composograph output step is used for correspondence image synthetic on the described captured image being moved, with the composograph output that obtains in picking up scene image to described other positions from current location according to the moving of described mobile given step appointment.