JP4168803B2 - Image output device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present invention provides an image output for synthesizing and outputting an image according to a photographed image in a digital camera or a camera-equipped mobile terminal.EquipmentRelated.
[0002]
[Prior art]
2. Description of the Related Art Conventionally, there are various types of still cameras and video cameras that synthesize and display or print and output another image with a captured image.
[0003]
For example, an animation image such as a flower or a popular character prepared in advance at a fixed position of the shooting frame is output and synthesized, or an animation image prepared in advance is combined and output at a desired position in the shooting frame. Things are in practical use.
[0004]
In addition, an image captured by a digital camera can be displayed on a display screen of a personal computer and combined with another image for editing. In this case, for example, another image can be selectively selected from other image files. It is obtained by cutting out or downloading from any homepage screen on the Internet, and is synthesized at a desired position on the photographed image.
[0005]
In addition, an arbitrary region (for example, a face portion) of an image photographed by a digital camera is cut out, and this cut-out image is combined with a prepared animation image (for example, the face portion of an anime character) to create a new another image. It is also conceivable to create or to synthesize an animation image associated with a specified area of an arbitrary image. (For example, refer to Patent Document 1.)
[0006]
[Patent Document 1]
JP 2001-230972 A
[0007]
[Problems to be solved by the invention]
However, in such a conventional image processing system, a pre-prepared image is fixed as it is with respect to a photographed image, or is synthesized and output at a desired position, or is prepared in advance for an arbitrary cut-out image. Since the image is only synthesized and output, the synthesized image other than the captured image is always fixed and unchanged, and even if various images are downloaded from the Internet and used, Because it is just a irrelevant decoration, there is a problem that it is not interesting and can easily get bored.
[0008]
  The present invention has been made in view of the above-described problems, and does not simply synthesize a fixed image with a captured image, but an image corresponding to an object (for example, a person) image in the captured image. Image output that can be combined and outputEquipmentThe purpose is to provide.
[0009]
[Means for Solving the Problems]
  That is, in the image output apparatus according to claim 1 of the present invention,
  A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
  A captured image acquisition means for acquiring a captured image;
  A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
  Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
  The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
  Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means;
  A target image extracting means for extracting a target image from the photographed image acquired by the photographed image acquiring means according to the extraction target portion indicated by the composite form image selected by the composite form image selecting means;
  The corresponding image acquisition unit acquires a corresponding image corresponding to the target image extracted by the target image extraction unit;
  The target image extraction means includes
  Image block extraction means for extracting an image block of a change portion from a series of captured images acquired by the captured image acquisition means;
  An image block corresponding to the extraction target portion indicated by the combined form image selected by the combined form image selecting unit is extracted as a target image from the image blocks extracted by the image block extracting unit.
[0010]
  An image output apparatus according to claim 1According to this, a corresponding image such as a mimic image corresponding to the image of the target portion selected with respect to the captured image is acquired, and the corresponding image can be combined with the captured image and output according to the combination form of the selected image. .
[0016]
  According to the image output device according to claim 1, not only that,Extracts the image block of the changed part such as the subject image from a series of captured images, extracts the image block corresponding to the extraction target part from this image block as the target image, and acquires and combines the corresponding image It will be possible.
[0023]
  Further, the claims of the present invention2In the image output apparatus according to
  A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
  A captured image acquisition means for acquiring a captured image;
  About the captured image acquired by the captured image acquisition unit, a combined form image selecting unit that selects a combined form image stored by the combined form image storage unit;
  Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
  The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
  Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means,
  The composite form of the image includes at least a region replacement composite form,
  The image synthesizing unit, when the synthetic form of the image indicated by the synthetic form image selected by the synthetic form image selecting unit is a region replacement synthetic form, the image in the photographed image obtained by the photographed image obtaining unit The plurality of target images of the extraction target portion indicated by the composite form image are respectively replaced with a plurality of corresponding images acquired by the corresponding image acquisition unit, and the captured images are combined.
[0024]
  An image output apparatus according to claim 2According to the above, by selecting a composite form of the image indicated by the composite form image, the target image such as a plurality of subjects included in the extraction target portion of the captured image is replaced with a plurality of corresponding images corresponding thereto, respectively, It can be combined with the image.
[0025]
  Further, the claims of the present invention3In the image output apparatus according to
  A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
  A captured image acquisition means for acquiring a captured image;
  A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
  Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
  The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
  Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means,
  The composite form of the image includes at least an additional composite form,
  The image synthesizing unit acquires the corresponding image acquired by the corresponding image acquiring unit when the synthetic mode of the image indicated by the synthetic mode image selected by the synthetic mode image selecting unit is an additional synthetic mode. It is characterized in that it is combined with the captured image acquired by the means.
[0026]
  An image output apparatus according to claim 3According to this, by selecting the composite form of the image indicated by the composite form image, a corresponding image corresponding to the target image of the extraction target portion of the captured image can be added to the captured image and combined.
[0027]
  Further, the claims of the present invention4In the image output apparatus according to
  A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
  A captured image acquisition means for acquiring a captured image;
  A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
  Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
  The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
  Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means,
  The composite form of the image includes at least an inverted additional composite form,
  The image synthesizing unit is configured to display the corresponding image acquired by the corresponding image acquiring unit when the composite form of the image indicated by the composite form image selected by the composite form image selecting unit is an inverted additional composite form. It is characterized in that it is combined with the target image of the extraction target part indicated by the composite form image on the photographed image acquired by the acquisition means in addition to the left-right reversal position.
[0028]
  An image output device according to claim 4According to the above, by selecting the composite form of the image indicated by the composite form image, the corresponding image corresponding to the target image of the extraction target portion of the photographed image is placed at a position that is horizontally reversed from the target image of the target portion on the photographed image. It can be added and combined.
[0029]
  Further, the claims of the present invention5In the image output apparatus according to
  A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
  A captured image acquisition means for acquiring a captured image;
  A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
  Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
  The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
  Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means,
  The composite form of the image includes at least a subsequent image replacement composite form,
  The corresponding image acquisition means acquires a corresponding image corresponding to the extraction target portion indicated by the composite form image selected by the composite form image selection means for the first captured image acquired by the captured image acquisition means,
  The image synthesizing unit is configured to obtain a second photographed image acquired by the photographed image acquiring unit when a composite form of the image indicated by the composite form image selected by the composite form image selecting unit is a next image replacement composite form. On the other hand, the corresponding image acquired by the corresponding image acquisition means is synthesized.
[0030]
  An image output device according to claim 5According to the above, the corresponding image acquired in accordance with the target image of the extraction target portion of the first captured image can be combined with the second captured image by selecting the composite form of the image indicated by the composite form image. become.
[0031]
  Further, the claims of the present invention6Image output device according toSo, synthesisThe extraction target portion of the photographed image indicated by the composite morphological image stored by the morphological image storage means is indicated by a human-shaped frame.
[0032]
  An image output apparatus according to claim 6According to this, it is possible to easily select a target image such as a person for acquiring a corresponding image to be synthesized with respect to a captured image as an extraction target portion by using a frame of a person shape.
[0033]
  Further, the claims of the present invention7Image output device according toSo, synthesisWhen the composite form of the image indicated by the composite form image stored by the form image storage means is an additional composite form, the extraction target portion for the captured image indicated by the composite form image is indicated by a transparent frame.
[0034]
  An image output device according to claim 7According to this, it is possible to select a target image for acquiring a corresponding image to be additionally synthesized on the photographed image using the transparent frame and know that the corresponding image is additionally synthesized without changing the target image.
[0035]
  Further, the claims of the present invention8Image output device according toSo, synthesisWhen the composite form of the image indicated by the composite form image stored by the form image storage means is a replacement composite form, the extraction target portion of the captured image indicated by the composite form image is indicated by a translucent frame.
[0036]
  An image output device according to claim 8According to the above, it is possible to know that the target image for acquiring the corresponding image to be replaced and synthesized on the photographed image is selected by the translucent frame, and the corresponding image is synthesized by being replaced with the target image. .
[0037]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings.
[0038]
FIG. 1 is a block diagram showing a configuration of an electronic circuit of an image output apparatus 10 according to an embodiment of the present invention.
[0039]
The image output apparatus 10 is configured by a computer that reads a program recorded on various recording media or a transmitted program and whose operation is controlled by the read program. The electronic circuit includes a CPU ( a central processing unit) 11 is provided.
[0040]
The CPU 11 is a device control program stored in the memory 12 in advance, or a device control program read from the external recording medium 13 such as a CD-ROM into the memory 12 via the recording medium reading unit 14 or on the Internet N. The device stored in the memory 12 controls the operation of each part of the circuit in accordance with the device control program read into the memory 12 from the Web server 21 (in this case, the program server) via the power transmission control unit 15. The control program is an input signal corresponding to a user operation from the input unit 16 including a key or a touch panel, an image signal input via the image input unit 17, or on the Internet N connected via the transmission control unit 15. Is started in response to a communication signal with each of the Web servers 21.
[0041]
The CPU 11 is connected to the memory 12, the recording medium reading unit 14, the power transmission control unit 15, the input unit 16, and the image input unit 17, a distance sensor 18, a display unit 19 including an LCD, and an image output unit 20. Etc. are connected.
[0042]
The image input unit 17 inputs captured image data, and the captured image data is selectively acquired from a digital camera 17A, a digital video movie 17B, and a VTR (image reproduction device) 17C.
[0043]
The distance sensor 18 detects the distance to the subject of the captured image input by the image input unit 17.
[0044]
The image output unit 20 outputs image data processed by the present apparatus based on the captured image input from the image input unit 17, and the output image data includes a memory card 20A, a VTR (recording apparatus) 20B, The image is selectively output to the image printing machine 20C, and the image is stored, recorded, and printed.
[0045]
The memory 12 stores a system program that controls the overall operation of the image output apparatus 10 and a communication program for data communication with each Web server 21 on the Internet N via the transmission control unit 15. An image processing program 12a or the like is stored in the image output device 10 via the image input unit 17 or the image output unit 20 for performing a composite image output process corresponding to the target image in the captured image.
[0046]
The memory 12 includes a model pose image memory 12b, a mimic character frame list memory 12c, a character 1 "rabbit" pose image memory 12d, a character 2 "bear" pose image memory 12e, and a character 3 "cat" pose image memory 12f. The character 4 “Kobito” pose image memory 12i is prepared, and the photographed image memory 12g and the image processing work area 12h are prepared in the work area.
[0047]
FIG. 2 is a diagram showing a list (No. 1) of imitation target portion setting frames for various imitation characters stored in the imitation character frame list memory 12c of the image output apparatus 10.
[0048]
FIG. 3 is a diagram showing a list (part 2) of imitation target portion setting frames for each of various imitation characters stored in the imitation character frame list memory 12c of the image output apparatus 10.
[0049]
In the imitation character frame list memory 12c, the type of character (A: cat / B: rabbit / C: bear / D: kobito) to be synthesized as a human imitation character in the imaged image area Fi by the image output device 10 is stored. A plurality of types of imitation character frames (A (1) -1, -2 to A (5) -1, -2 / B (1)) for indicating the target portion (Tx / Ta) of the image to be imitated by the character. -1, -2 to B (5) -1, -2 / C (1) -1, -2 to C (5) -1, -2 / D (1) -1, -2 to D (5) -1, -2 / E (1) -1, -2 to E (5) -1, -2) are stored.
[0050]
In each imitation character frame (▲ 1 ▼ -1, -2 to ▲ 5 ▼ -1, -2), the type of imitation character (A to D) is indicated by the basic image of the imitation character, and also imitated. The target portion (Tx / Ta) of the power image is shown at a preset position in the captured image area Fi for each frame ((1) -1, -2 to (5) -1, -2).
[0051]
In each of the mimic character frames ((1) -1, -2 to (5) -1, -2), the imitation target portion Tx displayed semi-transparently is a subject image existing in the imitation target portion Tx. Is replaced and synthesized by the imitation image of the character indicated by the basic image, and the imitation target portion Ta displayed in a transparent manner is the subject image existing in the imitation target portion Ta as it is. It shows that the imitation image of the character indicated by the basic image is additionally synthesized at another position.
[0052]
That is, as shown in FIGS. 2 (1) and (2), when the mimic character frame (1) -1 (replacement (left)) or (1) -2 (replacement (right)) is selected, shooting is performed. The subject image existing in the imitation target portion Tx of the left or right doll in the image area Fi is replaced and synthesized by a character image of a selected type that imitates the pose.
[0053]
In addition, as shown in FIGS. 2 (3) and (4), when mimic character frame (2) -1 (region replacement (left)) or (2) -2 (region replacement (right)) is selected. Then, all the subject images existing in the surrounding area of the circular imitation target portion Tx on the left side or the right side of the photographed image area Fi are replaced and synthesized by the character image of the selected type that imitates the pose.
[0054]
In addition, as shown in FIGS. 2 (5) and 3 (6), when a mimic character frame (3) -1 (addition (left)) or (3) -2 (addition (right)) is selected. In the subject image that exists in the imitation target portion Ta of the doll in the photographed image area Fi, a character image of a selected type that imitates the pose is additionally synthesized to the left or right.
[0055]
In addition, as shown in FIGS. 3 (7) and (8), when the mimic character frame (4) -1 (reverse (left → right)) or (4) -2 (reverse (right → left)) is selected. Includes a character image of a selected type obtained by simulating and reversing a subject image existing in the imitation target portion Ta of the left or right doll of the photographed image area Fi on the right side or the left side opposite to the subject image. Synthesized.
[0056]
Also, as shown in FIGS. 3 (9) and (10), when the mimic character frame (5) -1 (next addition (left)) or (5) -2 (next addition (right)) is selected. A character image of a selection type that imitates the pose of the subject image present in the imitation target portion Tx of the doll in the first captured image area Fi is added to the left or right side of the second captured image area Fi that is the next captured image. Synthesized.
[0057]
FIG. 4 shows the character 1 “rabbit” pose image memory 12d: character 2 “bear” pose image memory 12e: character 3 “cat” pose image memory 12f of the image output device 10 corresponding to various poses respectively stored therein. It is a figure which shows a character image. In FIG. 4, the character 4 “Kobito” pose image memory 12 i is the same as the other pose image memories 12 d to 12 f and is not shown.
[0058]
Various pose images of each character stored in the pose image memories 12d, 12e, 12f, and 12i of the character 1 “rabbit”, 2 “bear”, 3 “cat”, and 4 “kobito” are image input units. 17 is used as a character image imitating the pose of the subject image (target image) existing in the imitation target portion (Tx / Ta) on the photographed image input from FIG. Are stored in association with each other.
[0059]
FIG. 5 is a diagram showing a model image corresponding to the model pose stored in the model pose image memory 12b of the image output apparatus 10. As shown in FIG.
[0060]
The model images of various poses stored in the model pose image memory 12b correspond to the pose of the subject image (target image) existing in the imitation target portion (Tx / Ta) on the photographed image input from the image input unit 17. Are used for acquiring similar model images, and each pose has its pose No. Are stored in association with each other, and each pose No. is stored. Three types of model images of variations A, B, and C are stored every time.
[0061]
The character images stored in the character 1 “rabbit” pose image memory 12d, the character 2 “bear” pose image memory 12e, the character 3 “cat” pose image memory 12f, and the character 4 “cobit” pose image memory 12i, respectively. Includes all pose Nos. Stored in the model pose image memory 12b. Character images of the same pose corresponding to (No. 1A, 1B, 1C, 2A, 2B, 2C,..., NA, nB, nC) are prepared and stored.
[0062]
The photographed image memory 12g stores photographed image data input via the image input unit 17 in units of photographed images.
[0063]
In the image processing work area 12h, image data processed according to the image processing program 12a is temporarily stored according to the image processing.
[0064]
An outline of the operation of the image output apparatus 10 configured as described above will be described.
[0065]
FIG. 6 is a diagram showing a left-right inverted position additional composition state by the character image “rabbit” when the imitation character frame B (4) -2 (reverse (right → left)) is selected by the image output device 10.
[0066]
As shown in FIG. 6A, for example, a captured image 12g1 of a subject image (target image) H that is conscious of dancing with a partner in advance is a “rabbit” imitation character frame B (4) -2 (inverted (right → (Left)) In a state where [see FIG. 3 (B-8)] is selected and superimposed, the subject image (target image) H fits the simulated target portion Ta in the frame B (4) -2. Set the shooting direction and size. At this time, the transparent imitation target portion Ta has a character image imitating the pose of the subject image (target image) H as another region while the subject image (target image) H existing in the imitation target portion Ta is not changed. Means to be synthesized. Then, the subject image (target image) H is extracted based on the captured image 12g1 and the simulated target portion Ta as shown in FIG.
[0067]
Since the selected character of the mimic character frame B (4) -2 is “rabbit”, the pose No. similar to the pose of the extracted subject image (target image) H is shown in FIG. The character image 12d (19) of 19 "dance" "Rabbit" is read from the character 1 "Rabbit" pose image memory 12d. Then, a pose No. similar to the subject image (target image) H read from the character 1 “rabbit” pose image memory 12d. 19 The character image 12d (19) of “Rabbit” of “Dance” is reversed left and right, and as shown in FIG. 6D, the position reversed from the subject (target image) H with the center on the photographed image 12g1 being symmetrical. It is added and synthesized.
[0068]
In this way, by selecting the “rabbit” imitation character frame B (4) -2 (inverted (right → left)) [see FIG. 3 (B-8)], the subject of the dance pose in the photographed image 12g1 ( Target image) Rabbit character image 12d (19) imitating H is flipped left and right, and added as a dance partner at a position that is symmetrical to the subject (target image) H that makes a dance pose on the captured image 12g1. Composite display.
[0069]
FIG. 7 is a diagram showing a next image replacement composition state by the character image “bear” when the imitation character frame C (5) -2 (next addition (right)) is selected by the image output device 10.
[0070]
For example, when creating a composite image in which the character “bear” serving as the replacement image and the subject himself “doing goodbye” are created, first, as shown in FIG. 7A, the character “bear” is imitated. For the first captured image 12g2 of the subject image (target image) H1 in the pose of “Goodbye”, a “bear” imitation character frame C (5) -2 (next addition (right)) [FIG. 3 (C-10 ) Reference] is selected and overlaid and displayed, the shooting direction and size are set so that the subject image (target image) H1 matches the simulated target portion Tx in the frame C (5) -2. At this time, the translucent imitation target portion Tx means that a character image imitating the pose is synthesized by replacing the object image (target image) H1 existing in the imitation target portion Tx. Then, as shown in FIG. 7B, the subject image (target image) H1 is extracted based on the first photographed image 12g2 and the mimic target portion Tx.
[0071]
Since the selected character of the mimic character frame C (5) -2 is “bear”, as shown in FIG. 7C, a pose No. similar to the pose of the extracted subject image (target image) H1. The character image 12e (11) of the 11 “goodbye” “bear” is read from the character 2 “bear” pose image memory 12e. In this case, the current time “PM8” is detected and it is determined that it is night, and the character image of the “bear” in the “goodbye” pose is, for example, the character image 12e (11) N for night on the moon. Is read as
[0072]
Next, as shown in FIG. 7D, when the second subject image H2 in the pose corresponding to the first subject image (target image) H1 in the first photographed image 12g2 is photographed, the second subject image H2 is captured. To the right of the photographed image 12g2 ′, as shown in FIG. 7E, a pose No. similar to the first subject image (target image) H1 read from the character 2 “bear” pose image memory 12e. The character image 12e (11) N of the “bear” for night time of 11 “goodbye” is additionally synthesized.
[0073]
In this manner, by selecting “bear” imitation character frame C (5) -2 (next addition (right)) [see FIG. 3 (C-10)], the subject (object) in the first captured image 12g2 is selected. An image) “bear” character image 12e (11) imitating H1 is additionally combined and displayed in accordance with the subject (target image) H2 captured in the second captured image 12g2 ′.
[0074]
FIG. 8 is a diagram showing a replacement composition state by the character image “rabbit” when the imitation character frame B (1) -1 (replacement (left)) is selected by the image output device 10.
[0075]
As shown in FIG. 8A, for example, a photographed image 12g3 obtained by photographing three subjects H1 to H3, a “rabbit” imitation character frame B (1) -1 (replacement (left)) [FIG. -1) Reference] is selected and displayed in a superimposed manner, the shooting direction and size so that the subject image (target image) H1 to be replaced fits the simulated target portion Tx in the frame B (1) -1. Set. At this time, the translucent imitation target portion Tx means that a character image imitating the pose is synthesized by replacing the object image (target image) H1 existing in the imitation target portion Tx. Then, as shown in FIG. 8B, a subject image (target image) H1 to be replaced is extracted.
[0076]
Since the selected character of the mimic character frame B (1) -1 is “rabbit”, a pose No. similar to the pose of the subject image (target image) H1 as shown in FIG. The character image 12d (1) of “Rabbit” of 1 “Yes cheese (up)” is read from the character 1 “Rabbit” pose image memory 12d.
[0077]
On the other hand, as shown in FIGS. 8D, 8E and 8F, a photographic background image 12g3 obtained by cutting out three subject images H2 and H3 including the subject image (target image) H1 to be replaced from the photographic image 12g3. 'Is generated.
[0078]
Then, as shown in FIG. 8G, a pose No. similar to the subject image (target image) H1 read from the character 1 “rabbit” pose image memory 12d. The character image 12d (1) of “Rabbit” of 1 “yes cheese” and the remaining two subject images H2 and H3 cut out from the photographed image 12g3 are in order of increasing photographing distance with respect to the photographed background image 12g3 ′. It is synthesized corresponding to each subject position.
[0079]
In this way, by selecting the “rabbit” imitation character frame B (1) -1 (replacement (left)) [see FIG. 2 (B-1)], the subject (target image) H1 in the photographed image 12g3 is selected. The character image 12d (1) of the “rabbit” imitating the pose is replaced with the subject (target image) H1 and is displayed in a composite manner.
[0080]
Although illustration explanation in the outline of this operation is omitted, as the types of imitation character frame modes that can be selected during shooting by the image output apparatus 10, the replacement composite frame mode (1), the inverted additional composite frame, are used. In addition to the mode (4) and the next image replacement composite frame mode (5), there are an area replacement composite frame mode (2) and an additional composite frame mode (3).
[0081]
That is, for the photographed image 12gn, for example, the “Kobito” region replacement composite frame {circle around (2)}-n is selected and superimposed and the region of the translucent imitation target portion Tx is replaced in the photographed image 12gn. For example, it is set according to the position where a plurality of unrelated subject images h1, h2,. Then, a plurality of subject images h1, h2,... Extracted from the area of the mimic target portion Tx are acquired from the character 4 “Kobito” pose image memory 12i, which is a “Kobito” character image 12i (n) imitating each pose. The plurality of subject images h1, h2,... Are combined and displayed.
[0082]
As a result, for example, a plurality of subject images h1, h2,... That are unnecessary as a subject to be photographed included in the photographed image 12gn are replaced with imitated character images selected and set as a region replacement composite frame (2) -n. .
[0083]
Further, for the photographed image 12gn, for example, an additional composite frame {circle over (3)}-n of “cat” is selected and superimposed, and the transparent imitation target portion Ta is a subject image to be imitated in the photographed image 12gn. Set according to the position of h. Then, a “cat” character image 12f (n) imitating the pose of the subject image h extracted from the mimic target portion Ta is acquired from the character 3 “cat” pose image memory 12f, and the background area of the photographed image 12gn is randomly selected. Additional composition is displayed at various positions.
[0084]
As a result, a character image imitating the pose of an arbitrary subject image h included in the captured image 12gn is added to the empty area of the captured image 12gn and combined and displayed.
[0085]
Next, a detailed image processing operation by the image output apparatus 10 having the above configuration will be described.
[0086]
Here, a case where the image output apparatus 10 is implemented as a digital camera will be described.
[0087]
FIG. 9 is a diagram showing an external configuration of the digital camera 10 which is the image output device. FIG. 9A is a front view thereof, and FIG. 9B is a rear view thereof.
[0088]
FIG. 10 is a view showing a shooting display state (part 1) accompanying setting of various frame modes in the composite image output process by the image output apparatus (digital camera) 10. The figure which shows the imaging | photography display state at the time of setting the additional synthetic | combination frame A (3) -2 of a "cat", The same figure (B1)-(B4) set the replacement synthetic frame B (1) -1 of a "rabbit" (C1) to (C4) are diagrams showing the shooting display state when the inverted addition composite frame B <4> -2 of "Rabbit" is set.
[0089]
FIG. 11 is a view showing a photographic display state (part 2) associated with setting of various frame modes in the composite image output process by the image output apparatus (digital camera) 10, and FIGS. 11 (D 1) to (D 4) are “ FIGS. 11E to 11E are diagrams showing the shooting display state when the next image replacement composite frame C <5> -2 of "Bear" is set, and FIGS. It is a figure which shows the imaging | photography display state at the time of setting.
[0090]
FIG. 12 is a flowchart showing composite image output processing (part 1) by the image output apparatus (digital camera) 10.
[0091]
FIG. 13 is a flowchart showing a composite image output process (part 2) by the image output apparatus (digital camera) 10.
[0092]
First, the “PLAY / REC” key 16b is set to the “REC” side, and a desired subject image Hn is captured in the captured image 12g by the image input unit 17 and displayed on the display unit 19 (step A1).
[0093]
When the “MENU” key 16a of the input unit 16 is operated, the “imitation frame function” for combining and displaying the character image imitating the subject image Hn on the captured image 12gn is selected (step A2). ), The first character frame mode (replacement of “cat” (left) composite frame (1) -1) stored in the character character frame list memory 12c (see FIG. 2 and FIG. 3) is initialized ( Steps A3 and A4).
[0094]
Then, the “cat” replacement (left) composite frame {circle around (1)}-1 designated by the initial setting is read from the imitation character frame list memory 12c, for example, as shown in FIGS. 10 (B1) to (B3). It is superimposed and displayed on the image 12gn being photographed (step A6).
[0095]
Here, when the cursor key 16d of the input unit 16 is operated in the left-right direction, the imitated character frame mode being set is arbitrarily set between the replacement composition mode (1) -n to the next screen additional composition mode (5) -n. The image 12gn that has been changed and set is displayed in combination with the image being photographed each time (steps A7 → A8, A5, A6). Is arbitrarily changed and set between the “cat” A to “Kobito” D, and is displayed in combination with the image 12gn being photographed (steps A9 → A10, A5, A6).
[0096]
Then, the subject image Hn to be imitated for the imitation target portion (Tx / Ta) of the imitation character frame synthesized and displayed together with the desired character image selected and set with respect to the image 12gn being photographed. When the cursor key 16d is pushed with the shooting direction and size matched so as to be positioned, the imitation character frame being synthesized and displayed is selected and determined according to the current shot image 12gn, and the frame mode and character are selected. Is set (step A11 → A12).
[0097]
When the “shutter” key 16c of the input unit 16 is operated, the process proceeds to the target image extraction process in FIG. 14 (step A12 ′ → AC).
[0098]
FIG. 14 is a flowchart showing target image extraction processing accompanying the composite image output processing of the image output apparatus (digital camera) 10.
[0099]
A series of captured images 12gn... Sequentially input at a predetermined timing via the image input unit 17 immediately before the shutter operation are stored in the captured image memory 12g in the work area (step C1).
[0100]
Then, a change portion of the image accompanying the movement of the subject is extracted for each block of the subject from each of the series of the captured images 12gn stored in the photographed image memory 12g (Step C2), and each of the extracted images is thereby extracted. The subject image Hn is stored in the image processing work area 12h for each block (step C3).
[0101]
Thus, when each subject image Hn included in the photographed image 12gn is extracted for each block from the photographed image 12gn and stored in the image processing work area 12h (step AC), each of the subject images Hn that have been blocked. The subject image Hn in the block area that most closely matches the imitation target portion (Tx / Ta) of the imitation character frame is extracted and set as the imitation target image (step A13).
[0102]
When the subject image Hn to be imitated is extracted and set, the process proceeds to the corresponding animation image (mimic image) acquisition process in FIG. 15 (step AD).
[0103]
FIG. 15 is a flowchart showing the corresponding animation image acquisition process associated with the composite image output process of the image output apparatus (digital camera) 10.
[0104]
In the corresponding animation image acquisition process, first, the subject image Hn extracted from the photographed image 12gn in accordance with the imitation target portion (Tx / Ta) and set as the imitation target image and each stored in the model pose image memory 12b. The degree of similarity of the pose with the model image is evaluated (step DE), and the pose No. of the model image with the highest degree of similarity is evaluated. Is set as a mimic character image in the currently displayed captured image 12gn and its imitation character frame (step D2 → D3).
[0105]
On the other hand, when “next display” is instructed in response to a user operation on the input unit 16 (left / right operation of the “cursor” key 16d), the model image with the next highest similarity is displayed for each “next display” operation. Pause No. Are set in order (steps D2 → D4).
[0106]
When the character image corresponding to the model pose having the desired similarity is set, the selected pose No. Is set as a mimic character image corresponding to the imitation target image (step D2 → D3).
[0107]
As described above, in the corresponding animation image acquisition process, the subject image Hn as the imitation target image extracted and set from the captured image 12gn according to the imitation target portion (Tx / Ta) is obtained for each pose that is a basic model of a person. The similarity with the model image is evaluated, and based on this, a set character image to be additionally synthesized or replaced with a pose character imitating the subject image Hn is determined.
[0108]
In this case, compared to the subject image Hn as the imitation target image, the degree of similarity between the set character and the character image for each pose is directly evaluated, and the character image to be added or replaced is determined. The model pose No. selected by evaluating the similarity with the model image for each pose. The corresponding animation image acquisition process that determines the character image to be added or replaced from the above uses a person model as the evaluation target of the similarity, so that it is easy to obtain a high similarity with the subject image Hn and is more similar. There is an advantage that it is possible to acquire a character image having high characteristics (similarity).
[0109]
FIG. 16 is a flowchart showing the similarity evaluation process with the imitation target image in the corresponding animation image acquisition process associated with the composite image output process of the image output apparatus 10.
[0110]
FIG. 17 is a view showing an example of similarity evaluation with a model image accompanying the similarity evaluation processing in the corresponding animation image acquisition processing of the image output apparatus 10.
[0111]
For example, as shown in FIG. Model image is read out (step E1), and the vertical and horizontal sizes of the imitation target image H1 shown in FIG.
[0112]
Then, the overlay evaluation of the imitation target image H1 and the model image with the vertical and horizontal sizes is performed, and the evaluation value (%) is calculated and stored as the similarity with the model image of the pose (step E3). ).
[0113]
Here, the pose No. of the similarity evaluation target this time. It is determined whether or not the model image is a left-right asymmetric image (step E4). For example, as shown in FIG. 17A, the model image 12b (1) A of the pose is not a left-right asymmetric image (left-right). If it is determined (Symmetry) (step E4 “No”), the next pose No. Model image is read out (steps E8 → E9), and similarly, the similarity evaluation process between the imitation target image H1 and the model image of the next pose is repeated (steps E2 to E4).
[0114]
On the other hand, for example, as shown in FIG. When it is determined that the 19 model images 12b (19) are left-right asymmetric model images, the pose no. The 19 model images are reversed left and right (steps E4 → E5), and the vertical and horizontal sizes of the inverted model image 12b (19) R and the imitation target image H1 are combined as shown in FIG. 17C. (Step E6).
[0115]
Then, the overlay evaluation of the imitation target image H1 and the inverted model image 12b (19) R in which the vertical and horizontal sizes are combined is performed, and the evaluation value (%) is calculated and the inverted model image 12b (19) of the pose is calculated. The degree of similarity with R is stored (step E7).
[0116]
After this, the next pose No. Is present (step E8), the next pose No. Model images are sequentially read (step E9), and similarly, the similarity evaluation process between the imitation target image and the model image for each pose is repeated (steps E2 to E7).
[0117]
Thus, for example, as shown in FIG. 17, when the similarity evaluation with the model image is performed on the subject image (target image) H1, the pose No. The model image 12b (19) corresponding to 19 is evaluated as the model image of the pose with the highest similarity.
[0118]
As described above, the corresponding animation image acquisition process (step AD) described with reference to FIGS. 15 to 17 is used as the imitation target image extracted and set from the captured image 12gn according to the imitation target portion (Tx / Ta). When the set character image of the pose that imitates the subject image Hn is determined, the currently set imitation character frame mode is “replacement composition mode 1) -n”, “region replacement composition mode 2” -n ”,“ additional composition ” It is determined which of the frame modes (mode {circle over (3)}-n}, “inverted addition composition mode {circle around (4)}-n}} and“ next image replacement composition mode {circle around (5)}-n} ”(step A14).
[0119]
Here, for example, as shown in FIGS. 10 (B1) to (B3), a imitation character frame B (1) -1 of “Rabbit” is selected and set for the photographed image 12g3, and is displayed in a synthesized manner. The “shutter” key 16c is operated in a state where the subject image H1 is aligned with the target portion Tx (steps A1 to A12 ′), and the corresponding animation image acquisition processing (step AD) is performed from the target image extraction processing (step AC). If it is determined that the currently set imitation character frame mode is “replacement synthesis mode {circle around (1)}-n '] (step A14), as shown in FIG. 15), the “rabbit” key imitating the pose of the subject H1, which is the imitation target image extracted according to the imitation target portion Tx in the photographed image 12g3. The character image 12d (1) is replaced with the subject (target image) H1 of the imitation target portion Tx and displayed in combination (steps A14 → A15, A23).
[0120]
In this case, as shown in FIG. 8, a photographic background image 12g3 ′ obtained by cutting out three subject images H2 and H3 including a subject image (target image) H1 extracted from the photographed image 12g3 according to the imitation target portion Tx is obtained. Generated. The “rabbit” character image 12d (1) similar to the subject image (target image) H1 to be imitated and the remaining two subject images H2 and H3 cut out from the photographed image 12g3 are the photographing background. The image 12g3 'is synthesized corresponding to each subject position in order of increasing shooting distance detected by the distance sensor 18 at the time of shooting.
[0121]
Note that a “rabbit” character similar to the subject image (target image) H1 to be imitated on the captured image 12g3 without generating the background image 12g3 ′ obtained by cutting out the subject images H1, H2, and H3. The image 12d (1) and the remaining two subject images H2 and H3 may be superimposed on each subject position in order of increasing shooting distance detected by the distance sensor 18 at the time of shooting.
[0122]
Then, a character image of “rabbit” which is created according to the replacement composition mode {circle around (1)}-1 and imitates the pose of yes cheese in the subject image H1 is the subject image H1. The photographed image 12g3 that is replaced and synthesized is registered in the memory 12 in response to a push (OK) operation on the “cursor” key 16d of the input unit 16 (steps A24 → A25).
[0123]
If the next display of the character image currently being combined and displayed is instructed by the left / right operation of the “cursor” key 16d before the registration processing of the photographed image 12g3 after the image combination accompanying the OK operation is performed, By the corresponding animation image acquisition process (see FIG. 15), the pose No. of the model image having the next highest similarity to the subject image H1 to be imitated. The character image of “rabbit” corresponding to is set, re-synthesized by the same replacement synthesis process, and displayed (steps A24 → AC to A14 → A15, A23).
[0124]
For example, as shown in FIGS. 11 (E1) to (E3), the imitation character frame D (2) -1 of “Kobito” is selected and set for the photographed image 12g5, and is displayed in a composite manner. The “shutter” key 16c is operated (steps A1 to A12 ′) in a state where a plurality of subject images H3 and H4 that do not need to be photographed are combined in the region of the target portion Tx, and this is handled from the target image extraction process (step AC). If it is determined through the animation image acquisition process (step AD) that the currently set mimic character frame mode is “region replacement composition mode {circle around (2)}-n}”, as shown in FIG. The poses of the subjects H3 and H4, which are a plurality of imitation target images extracted according to the imitation target portion Tx in the captured image 12g5, acquired by the corresponding animation image acquisition process (see FIG. 15). The character images 12i (3) and 12i (3) ′ of “Kobito”, which are imitated, are sequentially replaced with a plurality of subjects (target images) H3 and H4 in the area of the imitation target portion Tx and are combined and displayed ( Step A14 → A16, A17, A23).
[0125]
Then, as shown in FIG. 11 (E4), a “Kobito” that imitates the poses of a plurality of subject images H3 and H4 that are unnecessary for the photographed image is created according to the area replacement composition mode (2) -1. A photographed image 12g5 obtained by replacing the character image with each of the subject images H3 and H4 is registered in the memory 12 in response to a push (OK) operation on the “cursor” key 16d of the input unit 16 (step). A24 → A25).
[0126]
If the next display of the character image currently being combined and displayed is instructed by the left / right operation of the “cursor” key 16d before the registration processing of the captured image 12g5 after the image combination accompanying the OK operation is performed, By the corresponding animation image acquisition process (see FIG. 15), the pose No. of the model image having the next highest similarity to the subject images H3 and H4 to be imitated. A character image of “Kobito” corresponding to is set, recombined and displayed by the same area replacement composition processing (steps A24 → AC to A14 → A16, A17, A23).
[0127]
Also, for example, as shown in FIGS. 10A1 to 10A3, a “cat” imitation character frame A (3) -2 is selected and set for the photographed image 12g4, and is displayed in a combined manner. In a state where the subject image H1 is aligned with the portion Ta, the “shutter” key 16c is operated (steps A1 to A12 ′), and through the corresponding image extraction process (step AC) through the corresponding animation image acquisition process (step AD), If it is determined that the currently set mimic character frame mode is “additional composition mode (3) -n”, as shown in FIG. 10 (A4) [see FIG. 8], the subject extracted in the photographed image 12g4 Imitation of the pose “Banzai” of the subject image H1 to be imitated acquired by the corresponding animation image acquisition process (see FIG. 15) at a random position in an empty area other than the block M. The character image 12fn of “cat” is additionally synthesized and displayed (steps A14 → A18, A23).
[0128]
Then, a “cat” character image that is created according to this additional composition mode {circle around (3)}-2 and imitates the pose of the subject image H1 is added to the empty area as shown in FIG. 10 (A4). The synthesized captured image 12g4 is registered in the memory 12 in response to a push (OK) operation on the “cursor” key 16d of the input unit 16 (steps A24 → A25).
[0129]
If the next display of the character image currently being combined and displayed is instructed by the left / right operation of the “cursor” key 16d before performing the registration process of the captured image 12g4 after the image combination accompanying the OK operation, By the corresponding animation image acquisition process (see FIG. 15), the pose No. of the model image having the next highest similarity to the subject image H1 to be imitated. The character image of “cat” corresponding to is set and re-synthesized and displayed by the above-described additional synthesis process (steps A24 → AC to A14 → A18, A23).
[0130]
For example, as shown in FIGS. 10 (C1) to (C3), the imitation character frame B (4) -2 of “Rabbit” is selected and set for the photographed image 12g1, and is displayed in a synthesized manner. In a state where the subject image H is aligned with the portion Ta, the “shutter” key 16c is operated (steps A1 to A12 ′), and through the target image extraction process (step AC) through the corresponding animation image acquisition process (step AD), If it is determined that the currently set mimic character frame mode is “inverted additional composition mode (4) -n”, as shown in FIG. 10 (C4) [see FIG. The character image 12d (19) of the “rabbit” imitating the pose “dance” of the subject image H to be imitated acquired in FIG. 15) is the left of the subject image H in the captured image 12g1. To be symmetrical position is displayed by being added synthesized as a character image 12d (19) R of the inverted "Rabbit" (step A14 → A19, A23).
[0131]
Then, as shown in FIG. 10C4, a “rabbit” character image that is created in accordance with the inverted additional composition mode (4) -2 and imitates the dance pose of the subject image H is the subject image H. The photographed image 12g1 added and synthesized at the reverse position is registered in the memory 12 in response to a push (OK) operation on the “cursor” key 16d of the input unit 16 (steps A24 → A25).
[0132]
If the next display of the character image currently being combined and displayed is instructed by the left / right operation of the “cursor” key 16d before performing the registration processing of the captured image 12g1 after the image combination accompanying the OK operation, By the corresponding animation image acquisition process (see FIG. 15), the pose No. of the model image having the next highest similarity to the subject image H to be imitated. The character image of “rabbit” corresponding to is set, re-synthesized and displayed by the same reverse addition synthesis process (steps A24 → AC to A14 → A19, A23).
[0133]
Further, for example, as shown in FIGS. 11D1 to 11D3, a “bear” imitation character frame C (5) -2 is selected and combined with the photographed image 12g2, and is displayed as a semi-transparent imitation. In a state where the subject image H1 is aligned with the target portion Tx, the “shutter” key 16c is operated (steps A1 to A12 ′), and the corresponding animation image acquisition processing (step AD) is performed from the target image extraction processing (step AC). If it is determined that the currently set imitation character frame mode is “next image replacement composition mode (5) -n”, the subject (target image) H1 set as the imitation target in the first captured image 12g2 is determined. The position is stored as the replacement position of the imitation image (step A14 → A20).
[0134]
Then, as shown in FIG. 11 (D3 ′), when the second captured image 12g2 ′ is acquired (step A21), the stored subject (at the time of the first capturing in the second captured image 12g2 ′). As shown in FIG. 11 (D4) with respect to the position of the target image H1, a “bear” having the first similarity that imitates the subject H1 acquired by the corresponding animation image acquisition process (see FIG. 15). The character image 12e (11) N (in this case, a special character for night use) is combined and displayed in combination with the subject H2 photographed in the second photographed image 12g2 '(step A22).
[0135]
Then, a “bear” character image that is created in accordance with the next image replacement composition mode {circle around (5)}-2 and imitates the pose of the first subject image H1 as shown in FIG. The photographed image 12g2 ′ that is additionally combined with the subject image H2 is registered in the memory 12 in response to a push (OK) operation on the “cursor” key 16d of the input unit 16 (steps A24 → A25). .
[0136]
If the next display of the character image currently being combined and displayed is instructed by the left / right operation of the “cursor” key 16d before the registration processing of the captured image 12g2 ′ after the image combination accompanying the OK operation is performed, By the corresponding animation image acquisition process (see FIG. 15), the pose No. of the model image having the next highest similarity to the first subject image H1 to be imitated. The character image of “bear” corresponding to is set and re-synthesized and displayed on the second captured image 12g2 ′ by the same next image replacement synthesis process (step A24 → AC to A14 → A20 to A23).
[0137]
In the various imitation character frame modes {circle around (1)}-n to {circle around (5)}-n, the captured image 12gn subjected to the replacement composite display process or the additional composite display process is registered in the memory 12 in response to an OK operation. On the other hand, it is output from the image output unit 20, and recording by the memory card 20A, recording by the VTR (recording device) 20B, or printing by the image printer 20C is appropriately performed.
[0138]
Therefore, according to the composite image output function of the image output apparatus 10 having the above-described configuration, for the photographed image 12gn input via the image input unit 17, the types of mimic characters A to E and their composite forms (1) to (5) An imitation character frame A (1) -n to D (5) -n indicating ▼ is selected and set so as to be superimposed on the photographed image 12gn, and an arbitrary subject is displayed on the imitation target portion (Tx / Ta) in the setting frame. When the shutter operation is performed together with the image Hn, the character image of the type selected and set in the pose corresponding to the subject image Hn extracted corresponding to the imitation target portion (Tx / Ta) is the character 1 “rabbit” pose. Image memory 12d, character 2 “bear” pose image memory 12e, character 3 “cat” pose image memory 12f, character 4 “Kobito” pose image memory 12i Since it is acquired and synthesized and displayed by replacement or addition of the subject image Hn in the photographed image 12gn, it does not simply add and synthesize a fixed animation image in the photographed frame, but a simulated target part in the photographed frame. By replacing or additionally synthesizing an animation image that imitates the pose of the subject in accordance with (Tx / Ta), it is possible to easily create a very enjoyable animation image with animation.
[0139]
Further, according to the composite image output function of the image output apparatus 10 having the above-described configuration, each of the imitation character frames A (1) -n to D (5) -n to be selectively superimposed on the captured image 12gn. Since the pre-positioned imitation target portion (Tx / Ta) is shown as a doll (person), the subject image Hn to be imitated on the captured image 12gn with respect to the imitation target portion (Tx / Ta) of the doll. Can be easily and clearly aligned to extract an image.
[0140]
In addition, the imitation target portion Tx that is preset in the imitation character frames A (2) -n to D (2) -n for the area replacement composition mode is shown as a circle, so that the imitation target portion Tx of the circle is displayed. On the other hand, for example, a plurality of unnecessary subject images Hn,... To be imitated on the photographed image 12 gn can be simply and clearly aligned and extracted to obtain a plurality of character images in corresponding poses.
[0141]
Further, for the simulated character portion Tx in each of the simulated character frames {circle over (1)}-n, {circle around (2)}-n, {circle around (5)}-n to be synthesized by replacing the simulated character image of the subject image Hn with the subject image Hn, The subject image Hn to be imitated when it is superimposed and displayed on the captured image 12gn as a translucent frame can be easily recognized as a replacement object by making it translucent.
[0142]
Further, the imitation character frame {circle over (3)}-n, {circle around (4)}-n for adding and synthesizing the imitation character image of the subject image Hn in combination with the subject image Hn is a transparent frame. The subject image Hn to be imitated when superimposed on the photographed image 12gn can be easily recognized as an object remaining in the composite image.
[0143]
In the embodiment, the character image of the pose corresponding to the subject extracted from the photographed image 12gn according to the imitation target portion (Tx / Ta) is selectively acquired, and the acquired anime image of the character is acquired. Are added or replaced and combined and output. However, face images and person images of various expressions by live-action are stored in advance, and the face image and person image by live-action are imitated from the captured image 12gn as a target portion Tx. It is also possible to add or replace as a simulated image corresponding to the subject extracted in accordance with / Ta and output it.
[0144]
Further, as described in the above embodiment, the image output apparatus 10 can be suitably implemented by being incorporated in a digital camera. When implemented with a digital camera with a liquid crystal display, it is possible to shoot an image and confirm and record the composite image on the spot.
[0145]
In the embodiment, the case where the captured image is a still image has been described. However, from the moving image captured and input by, for example, the digital video movie 17B via the image input unit 17, and the imitation target portion (Tx / Ta). , Sequentially extracting subject images that change in time series with respect to the background image in the moving image, and selectively acquiring character images of poses corresponding to the sequentially extracted subject images, A configuration may be adopted in which a moving image is output by being added to or replaced with a subject in the image.
[0146]
Furthermore, by applying the composite image output function in the embodiment, an image of an appearance character that is arbitrarily specified and extracted from a moving image such as a game by a mimic target portion (Tx / Ta) is used as an imitation target image. It is also possible to use a configuration in which the character image is replaced with a person image obtained by actual shooting.
[0147]
Note that the image output device 10 of the above embodiment is preferably configured to be built in a digital camera, and for the photographed image 12gn input via the image input unit 17 included in the output device 10 itself, the character type A ~ E and imitation character frames A showing the composite forms (1) to (5) A (1) -n to D (5) -n are selected and set, and the imitation target extracted in the output device 10 based on this The character image of the pose corresponding to the subject image Hn is acquired and replaced with the subject image Hn or additionally combined and displayed. However, an external communication function is transmitted from the transmission control unit 15 via the communication network (Internet) N. By communicably connecting to a digital camera terminal having the same structure as the above embodiment, the composite image output process is performed. The photographed image input from the user may function as an image distribution server (10) that returns (distributes) the photographed image after the imitation character image composition processing.
[0148]
That is, when functioning as an image distribution server (10), in response to an access from an external digital camera terminal, for the image 12gn being photographed by the camera terminal, the types of mimic characters A to E and their composite forms ▲ The selection setting process of the mimic character frame A (1) -n to D (5) -n indicating 1 ▼ to (5) and its overlay display are performed (steps A1 to A12 '), and the server (10) By receiving a superimposed image of the photographed image 12gn and the imitated character frame selected and set from the camera terminal, a subject image Hn extraction process according to the imitation target portion (Tx / Ta) in the imitation character frame (step) AC), the corresponding mimic character image acquisition process (step A13, AD), the replacement with the subject image Hn or the additional synthesis process (step Performed 14～A22), it may be configured to transmit (deliver) the access source of the digital camera device.
[0149]
It should be noted that each processing method by the image output apparatus 10 described in the above embodiment, that is, the target image extraction associated with the composite image output process shown in the flowcharts of FIGS. 12 and 13 and the composite image output process shown in the flowchart of FIG. Each method of processing, the corresponding animation image acquisition process accompanying the synthetic image output process shown in the flowchart of FIG. 15, the similarity evaluation process with the imitation target image accompanying the corresponding animation image acquisition process shown in the flowchart of FIG. Any of these programs can be executed by a computer, such as a memory card (ROM card, RAM card, etc.), a magnetic disk (floppy disk, hard disk, etc.), an optical disk (CD-ROM, DVD, etc.), and an external recording medium such as a semiconductor memory. 13 can be stored and distributed. Various computer terminals having a communication function with the communication network (Internet) N read the program stored in the external recording medium 13 into the memory 12 by the recording medium reading unit 14, and the operation is performed by the read program. By being controlled, the composite image output function described in the above embodiment can be realized, and the same processing can be executed by the method described above.
[0150]
The program data for realizing each of the above methods can be transmitted on a communication network (Internet) N in the form of a program code, and the above-mentioned data can be transmitted from a computer terminal connected to the communication network (Internet) N. It is also possible to capture the program data and realize the composite image output function described above.
[0151]
Note that the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention at the stage of implementation. Further, each of the embodiments includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in each embodiment or some constituent features are combined, the problems described in the column of the problem to be solved by the invention can be solved. When the effects described in the column of the effect of the invention can be obtained, a configuration in which these constituent elements are deleted or combined can be extracted as an invention.
[0152]
【The invention's effect】
  As described above, in the image output apparatus according to claim 1 of the present invention,According to the shootingA corresponding image such as a mimic image corresponding to the image of the target portion selected for the image is acquired, and the corresponding image can be combined with the captured image and output according to the combination form of the selected image.
[0155]
  Further, the claims of the present invention1In the image output device according toAccording to the seriesThe image block of the changed part such as the subject image is extracted from the plurality of photographed images, the image block corresponding to the extraction target part is extracted from the image block as the target image, and the corresponding image can be acquired and synthesized. It becomes like this.
[0159]
  Further, the claims of the present invention2In the image output device according toAccording to the synthesisBy selecting the composite form of the image indicated by the morphological image, the target image such as a plurality of subjects included in the extraction target portion of the captured image can be replaced with a plurality of corresponding images, respectively, and combined with the captured image. become.
[0160]
  Further, the claims of the present invention3In the image output device according toAccording to the synthesisBy selecting an image combination form indicated by the form image, a corresponding image corresponding to the target image of the extraction target portion of the captured image can be added to the captured image and combined.
[0161]
  Further, the claims of the present invention4In the image output device according toAccording to the synthesisBy selecting the combination form of the images indicated by the morphological images, a corresponding image corresponding to the target image of the extraction target portion of the captured image can be added and combined with the target image of the target portion on the captured image at a position that is horizontally reversed. It becomes like this.
[0162]
  Further, the claims of the present invention5In the image output device according toAccording to the composite formBy selecting an image combination form indicated by the state image, the corresponding image acquired in accordance with the target image of the extraction target portion of the first captured image can be combined with the second captured image.
[0163]
  Further, the claims of the present invention6In the image output device according toAccording to the shootingA target image such as a person for acquiring a corresponding image to be synthesized with respect to the image can be easily selected as an extraction target portion by a frame of a person shape.
[0164]
  Further, the claims of the present invention7In the image output device according toAccording to the taken imageIt is possible to select a target image for acquiring a corresponding image to be additionally combined with a transparent frame and know that the corresponding image is additionally combined without changing the target image.
[0165]
  Further, the claims of the present invention8In the image output device according toAccording to the taken imageIt is possible to know that the target image for acquiring the corresponding image to be replaced and combined is selected by the semi-transparent frame and is replaced with the target image and the corresponding image is combined.
[0166]
  Therefore, according to the present invention, it is possible to synthesize and output an image corresponding to an object (for example, a person) image in the captured image, rather than simply combining a fixed image with the captured image. Image outputEquipmentCan be provided.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of an electronic circuit of an image output apparatus 10 according to an embodiment of the present invention.
FIG. 2 is a view showing a list (No. 1) of imitation target part setting frames for each of various imitation characters stored in an imitation character frame list memory 12c of the image output apparatus 10;
FIG. 3 is a diagram showing a list (part 2) of imitation target portion setting frames for each of various imitation characters stored in an imitation character frame list memory 12c of the image output apparatus 10;
4 corresponds to various poses respectively stored in the character 1 “rabbit” pose image memory 12d: character 2 “bear” pose image memory 12e: character 3 “cat” pose image memory 12f of the image output device 10; The figure which shows each character image.
FIG. 5 is a view showing a model image corresponding to a model pose stored in a model pose image memory 12b of the image output apparatus 10;
FIG. 6 is a diagram showing a left-right inverted position additional composition state by a character image “rabbit” when a mimic character frame B (4) -2 (reverse (right → left)) is selected by the image output device 10;
FIG. 7 is a diagram showing a next image replacement combined state using a character image “bear” when a mimic character frame C (5) -2 (next addition (right)) is selected by the image output device 10;
FIG. 8 is a diagram showing a replacement composition state by the character image “rabbit” when the imitation character frame B (1) -1 (replacement (left)) is selected by the image output apparatus 10;
9A and 9B are diagrams showing an external configuration of a digital camera 10 that is the image output apparatus, in which FIG. 9A is a front view thereof, and FIG. 9B is a rear view thereof.
FIG. 10 is a diagram showing a shooting display state (No. 1) accompanying setting of various frame modes in the composite image output process by the image output apparatus (digital camera) 10; FIGS. The figure which shows the imaging | photography display state at the time of setting the additional synthetic | combination frame A (3) -2 of "cat", The figure (B1)-(B4) set the replacement synthetic frame B (1) -1 of "rabbit" The figure which shows the imaging | photography display state at the time of doing, The figure (C1)-(C4) is a figure which shows the imaging | photography display state when the reverse addition synthetic | combination frame B (4) -2 of "rabbit" is set.
FIG. 11 is a diagram showing a shooting display state (part 2) accompanying setting of various frame modes in the composite image output process by the image output device (digital camera) 10; FIGS. FIGS. 11E to 11E are diagrams showing the shooting display state when the “Bear” next image replacement composite frame C <5> -2 is set. FIGS. The figure which shows the imaging | photography display state when 1 is set.
FIG. 12 is a flowchart showing composite image output processing (part 1) by the image output apparatus (digital camera) 10;
FIG. 13 is a flowchart showing composite image output processing (part 2) by the image output apparatus (digital camera) 10;
FIG. 14 is a flowchart showing a target image extraction process associated with a composite image output process of the image output apparatus (digital camera) 10;
FIG. 15 is a flowchart showing a corresponding animation image acquisition process associated with a composite image output process of the image output apparatus (digital camera) 10;
FIG. 16 is a flowchart showing a similarity evaluation process with an imitation target image in a corresponding animation image acquisition process associated with a composite image output process of the image output apparatus 10;
FIG. 17 is a view showing an example of similarity evaluation with a model image in the similarity evaluation process in the corresponding animation image acquisition process of the image output apparatus 10;
[Explanation of symbols]
10 Image output device
11 ... CPU
12 ... Memory
12a ... Image processing program
12b ... Model pose image memory
12c ... Mimic character list frame memory
12d ... Character 1 "Rabbit" pose image memory
12e… Character 2 “bear” pose image memory
12f… Character 3 “cat” pose image memory
12g ... Captured image memory
12h ... image processing work area
12i… Character 4 “Kobito” pose image memory
13: External recording medium
14 ... Recording medium reader
15 ... Transmission control unit
16: Input section
16a ... “MENU” key
16b ... "PLAY / REC" key
16c ... "Shutter" key
16d ... "Cursor" key
17 Image input unit
17A ... Digital camera
17B ... Digital video movie
17C ... VTR (image playback device)
18 Distance sensor
19: Display section
20 Image output unit
20A ... Memory card
20B ... VTR (recording device)
20C ... Image printer
21 ... Web server
N ... Communication network (Internet)
▲ 1 ▼ -n ... Replacement composite frame
▲ 2 ▼ -n ... area replacement composite frame
▲ 3 ▼ -n ... Additional composite frame
▲ 4 ▼ -n ... Inverted additional composite frame
▲ 5 ▼ -n ... Next image replacement composite frame
Tx ... Replacement (semi-transparent) imitation target part
Ta: Additional (transparent) imitation target part

Claims (8)

A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
A captured image acquisition means for acquiring a captured image;
A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means;
A target image extracting means for extracting a target image from the photographed image acquired by the photographed image acquiring means according to the extraction target portion indicated by the composite form image selected by the composite form image selecting means;
The corresponding image acquisition unit acquires a corresponding image corresponding to the target image extracted by the target image extraction unit;
The target image extraction means includes
Image block extraction means for extracting an image block of a change portion from a series of captured images acquired by the captured image acquisition means;
An image characterized in that an image block corresponding to an extraction target portion indicated by a composite form image selected by the composite form image selection means is extracted as a target image from the image blocks extracted by the image block extraction means. Output device. A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
A captured image acquisition means for acquiring a captured image;
A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means,
The composite form of the image includes at least a region replacement composite form,
The image synthesizing unit, when the synthetic form of the image indicated by the synthetic form image selected by the synthetic form image selecting unit is a region replacement synthetic form, the image in the photographed image obtained by the photographed image obtaining unit An image output apparatus, wherein a plurality of target images of an extraction target portion indicated by a composite form image are respectively replaced with a plurality of corresponding images acquired by the corresponding image acquisition means and combined with the captured image . A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
A captured image acquisition means for acquiring a captured image;
A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means,
The composite form of the image includes at least an additional composite form,
The image synthesizing unit acquires the corresponding image acquired by the corresponding image acquiring unit when the synthetic mode of the image indicated by the synthetic mode image selected by the synthetic mode image selecting unit is an additional synthetic mode. An image output apparatus characterized in that it is combined with a photographed image acquired by the means . A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
A captured image acquisition means for acquiring a captured image;
A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means,
The composite form of the image includes at least an inverted additional composite form,
The image synthesizing unit is configured to display the corresponding image acquired by the corresponding image acquiring unit when the composite form of the image indicated by the composite form image selected by the composite form image selecting unit is an inverted additional composite form. An image output apparatus characterized by being added to a target image of an extraction target portion indicated by the composite form image and added to a left-right inverted position on a captured image acquired by an acquisition unit. A composite form image storage unit that stores a plurality of composite form images in which an extraction target portion for a captured image is associated with a composite form of the image;
A captured image acquisition means for acquiring a captured image;
A combined form image selecting unit that selects a combined form image stored in the combined form image storage unit in association with the captured image acquired by the captured image acquisition unit;
Corresponding image acquisition means for acquiring a corresponding image corresponding to the extraction target portion for the captured image indicated by the composite form image selected by the composite form image selection means;
The corresponding image acquired by the corresponding image acquisition unit is combined with the captured image acquired by the captured image acquisition unit according to the composite form of the image indicated by the composite form image selected by the composite form image selection unit. Image synthesis means;
Image output means for outputting a captured image in which the corresponding image is synthesized by the image synthesis means,
The composite form of the image includes at least a subsequent image replacement composite form,
The corresponding image acquisition means acquires a corresponding image corresponding to the extraction target portion indicated by the composite form image selected by the composite form image selection means for the first captured image acquired by the captured image acquisition means,
The image synthesizing unit is configured to obtain a second captured image acquired by the captured image acquiring unit when a composite form of an image indicated by the composite form image selected by the composite form image selecting unit is a next image replacement composite form On the other hand, an image output apparatus characterized in that the corresponding image acquired by the corresponding image acquisition means is synthesized . 4. The image output apparatus according to claim 3, wherein an extraction target portion of the photographed image indicated by the composite form image stored by the composite form image storage unit is indicated by a human-shaped frame. When the composite form of the image indicated by the composite form image stored by the composite form image storage means is an additional composite form, the extraction target portion for the captured image indicated by the composite form image is indicated by a transparent frame. The image output apparatus according to claim 3 . When the composite form of the image indicated by the composite form image stored by the composite form image storage means is a replacement composite form, the extraction target portion for the captured image indicated by the composite form image is indicated by a translucent frame. The image output apparatus according to claim 2 .

Images