JP2010287983A - Image capturing apparatus, image processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a generation of an image with less uncomfortable feeing as a result of synthesis. <P>SOLUTION: An image capturing apparatus 100 has an image synthesis unit 63 for synthesizing a subject image O extracted from a subject existing image P by a subject extraction unit 61 and a background image recorded in a recording medium 7 from a plurality of image frames sequentially generated by an image data generation unit 4. A CPU 11 changes a size of the subject image O according to an operation of an operating input unit 10 and causes the image synthesis unit 63 to synthesize the subject image O whose size is changed and a background image B. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an image processing method, and a program for imaging a subject.

  Conventionally, there is a technique in which an imaging device is used to capture an image with a subject in the background and a background image without the subject, generate difference information from the background image and the image with the subject, and extract only the subject. It is known (see, for example, Patent Document 1).

Japanese Patent Laid-Open No. 10-21408

  However, if the size of the subject image extracted by the above technique is unnatural with respect to the background image to which the image is to be synthesized, there is a problem in that a synthesized image with poor realism is generated when the synthesis is performed. It was.

  Accordingly, an object of the present invention is to be able to generate an image with a little uncomfortable feeling as a result of synthesis.

  In order to solve the above-described problem, an imaging apparatus according to a first aspect of the present invention includes an imaging unit, an extraction unit that obtains a subject image obtained by extracting a subject region from an image captured by the imaging unit, and a background image. An acquisition unit for acquiring, a first specifying unit for specifying a size of the subject image when the subject image acquired by the extraction unit and the background image acquired by the acquisition unit are combined; Synthesizing means for synthesizing a subject image having a size designated by the first designating means with the background image.

The invention according to claim 2 is the imaging apparatus according to claim 1,
The image forming apparatus further includes second specifying means for specifying a position where the object image is combined with the background image by the combining means.

  According to a third aspect of the present invention, in the imaging apparatus according to the first or second aspect, the imaging control unit that causes the imaging unit to perform continuous imaging, and the extraction unit are configured by continuous imaging performed by the imaging control unit. Subject images are obtained from each of the plurality of obtained images, and the synthesizing unit generates a plurality of synthesized images by synthesizing each of the plurality of subject images acquired by the extracting unit with the background image. It is said.

  According to a fourth aspect of the present invention, in the imaging device according to the third aspect, the first designation means designates at least one subject image among the plurality of subject images extracted by the extraction means, The synthesizing unit generates a plurality of synthesized images obtained by synthesizing each of the other subject images obtained by the extracting unit based on a designation result by the designation unit.

  According to a fifth aspect of the present invention, in the imaging apparatus according to the third or fourth aspect, the image pickup apparatus further includes a reproduction display unit that reproduces and displays the synthesized result before the synthesis by the synthesizing unit.

  A sixth aspect of the present invention is the imaging apparatus according to any one of the first to fifth aspects, wherein the acquisition unit acquires the background image from an external device connected to the apparatus. It is said.

  The invention according to claim 7 is the imaging apparatus according to any one of claims 1 to 6, further comprising foreground image recording means for recording a foreground image, wherein the synthesizing means is further acquired by the acquisition means. The foreground image recorded in the image recording means is combined with the background image thus formed.

  An image processing method according to an eighth aspect of the present invention is an extraction step of acquiring a subject image obtained by extracting a subject region from a captured image, and combines the subject image acquired in the extraction step with a background image. An image processing method comprising: a specifying step for specifying the size of the subject image, and a combining step for combining the subject image having the size specified in the specifying step with the background image. Yes.

  According to a ninth aspect of the present invention, there is provided a program for extracting a subject image obtained by extracting a subject region from an image captured by a computer included in an imaging apparatus, and a subject image and a background image acquired by the extraction unit. A function for detecting a designation of the size of the subject image at the time of synthesis, and a function for synthesizing the subject image having a size detected by the designation detection unit with the background image. It is said.

  According to the present invention, it is possible to generate an image with less sense of incongruity as a result of synthesis.

It is a block diagram which shows schematic structure of the imaging device of Embodiment 1 to which this invention is applied. 3 is a flowchart illustrating an example of an operation related to subject clipping processing by the imaging apparatus of FIG. 1. It is a figure which shows typically an example of the image for demonstrating the subject presence image. It is a figure which shows typically an example of the image for demonstrating the clip moving image data. 3 is a flowchart illustrating an example of an operation related to a composite image generation process by the imaging apparatus of FIG. 1. It is a figure which shows typically an example of the image for demonstrating the expansion / contraction display of the image B for background, and the to-be-photographed image O1. 3 is a flowchart illustrating an example of an operation related to an image composition process performed by the imaging apparatus of FIG. 1. It is a conceptual diagram of the imaging device and personal computer of the modification to which this invention is applied.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the description and drawings of the present embodiment.

[Embodiment 1]
FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to the first embodiment to which the present invention is applied.
The imaging apparatus 100 according to the first embodiment defines a subject area S including a subject from each image frame based on difference information of each pixel corresponding to a plurality of image frames f0 to fn captured by the electronic imaging unit 2. Extract.
Specifically, as illustrated in FIG. 1, the imaging apparatus 100 includes a lens unit 1, an electronic imaging unit 2, an imaging control unit 3, an image data generation unit 4, an image memory 5, and an image processing unit 6. A recording medium 7, a display control unit 8, a display unit 9, a recording control unit 7, an operation input unit 10, a CPU 11, a lens motor 12, and an external interface 13.

The lens unit 1 includes a plurality of lenses and includes a zoom lens, a focus lens, and the like.
In the lens unit 1, the zoom lens and the focus lens move based on the driving of the lens motor 13.

  The electronic imaging unit 2 is composed of an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-oxide Semiconductor), for example, and converts an optical image that has passed through various lenses of the lens unit 1 into a two-dimensional image signal. To do.

Although not shown, the imaging control unit 3 includes a timing generator, a driver, and the like. Then, the imaging control unit 3 scans and drives the electronic imaging unit 2 with a timing generator and a driver, converts the optical image into a two-dimensional image signal with the electronic imaging unit 2 every predetermined period, and the electronic imaging unit 2 Image frames are read out from the imaging area for each screen and output to the image data generation unit 4.
In addition, the imaging control unit 3 performs adjustment control of imaging conditions such as AE (automatic exposure processing), AF (automatic focusing processing), and AWB (automatic white balance).

  The lens unit 1, the electronic imaging unit 2, and the imaging control unit 3 configured as described above capture the subject presence image P.

The image data generation unit 4 appropriately adjusts the gain for each RGB color component with respect to the analog value signal of the image frame transferred from the electronic imaging unit 2, and then performs sample holding by a sample hold circuit (not shown). The digital signal is converted into digital data by a / D converter (not shown), color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown), and then a digital luminance signal Y and color difference signal Cb , Cr (YUV data).
The luminance signal Y and the color difference signals Cb and Cr output from the color process circuit are DMA-transferred to an image memory 5 used as a buffer memory via a DMA controller (not shown).

The image memory 5 is composed of, for example, a DRAM or the like, and temporarily stores data processed by the image processing unit 6 or the CPU 11.
Further, the image memory 5 includes, for example, a ring buffer that can temporarily store 20 frames of image frames, and cyclically stores a plurality of image frames generated by the image data generation unit 4.

The image processing unit 6 generates difference information of corresponding pixels between the plurality of image frames f1 to fn of the subject existing image P, and uses the difference information as a reference to obtain subject images O1 to On from the image frames f1 to fn. A subject extraction unit 61 for extraction is provided.
Further, the image processing unit 6 specifies the positions of the subject images O1 to On extracted from the image frames f1 to fn, and obtains positional information indicating the positions of the subject images O1 to On in the image frames f1 to fn. A position information generation unit 62 for generation is provided.
Here, the position information includes, for example, an alpha map. The alpha map is a weight for alpha blending the image of the subject image O with respect to a predetermined background for each pixel of the subject existing image P. It is expressed as a value (0 ≦ α ≦ 1).

Further, the image processing unit 6 does not transmit a pixel having an alpha value of 1 among the pixels of the subject existing image P to a predetermined single color image (not shown) based on the generated alpha map. And an image composition unit 63 for generating cutout moving image data M composed of a plurality of image data generated by combining the subject image O with a predetermined single color image so as to transmit pixels having an alpha value of 0. ing.
Further, the image composition unit 63 composes the subject image O and the background image B to generate a composite image. Specifically, the image composition unit 63 obtains the user-desired background image B from the recording medium 7, and transmits pixels having an alpha value of 0 among the pixels of the background image B, thereby transmitting the alpha value. Is overwritten with the pixel value of the corresponding pixel of the subject cut-out image C, and among the pixels of the background image B, the pixel whose alpha value is 0 <α <1 is the one's complement (1-α ) Is used to generate the cropped image C (background image × (1-α)), and then the cropped image C is generated using the 1's complement (1-α) in the alpha map. A value blended with a single background color is calculated, and the value is subtracted from the subject cutout image C, and is combined with an image obtained by cutting out the subject image O (background image × (1-α)).
The image processing unit 6 includes a character memory 64, and foreground image data M ′ made of CG (computer graphic) that can be used as the clipped moving image data M is recorded in the character memory 64 in advance.

The recording medium 7 is composed of, for example, a nonvolatile memory (flash memory) or the like, and stores image data encoded by a JPEG compression unit (not shown) of the image processing unit 6.
The recording medium 7 compresses each of a plurality of image frames generated by imaging by the imaging lens unit 1, the electronic imaging unit 2, and the imaging control unit 3 by a coding unit (not shown) of the image processing unit 6. Cutout moving image data M encoded in a format, for example, Motion-JPEG format, is recorded.
The clipped moving image data M is a file in which the image frames C0 to Cn constituting the subject clipped moving image data M and the alpha maps generated by the position information generating unit 62 of the image processing unit 6 are associated with each other. Saved.

The display control unit 8 performs control to read out image data temporarily stored in the image memory 5 and display it on the display unit 9.
Specifically, the display control unit 8 includes a VRAM, a VRAM controller, a digital video encoder, and the like. The digital video encoder periodically reads the luminance signal Y and the color difference signals Cb and Cr read from the image memory 5 and stored in the VRAM (not shown) under the control of the CPU 11 from the VRAM via the VRAM controller. Are read out, a video signal is generated based on these data, and is output to the display unit 9.

  The display unit 9 is, for example, a liquid crystal display device, and displays a captured image on the display screen based on a video signal from the display control unit 8. Specifically, the display unit 9 displays a live view image based on a plurality of image frames generated by imaging by the lens unit 1, the electronic imaging unit 2, and the imaging control unit 3 in the imaging mode, A REC view image captured as a captured image is displayed.

  The operation input unit 10 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 10 includes a shutter button 101 related to an instruction to shoot a subject, a selection determination button 102 related to an instruction to select an imaging mode or function, an instruction to adjust a zoom amount, and the like. In response to this, a predetermined operation signal is output to the CPU 11.

  The CPU 11 controls each part of the imaging device 100. Specifically, the CPU 11 performs various control operations according to various processing programs (not shown) for the imaging apparatus 100.

  The lens motor 12 drives the zoom lens and the focus lens of the lens unit 1 based on the control signal from the imaging control unit 3.

The external interface 13 is, for example, a data input / output unit compatible with a general-purpose protocol such as USB or IEEE 1394. A control signal transmitted from an external device (not shown) such as a personal computer or the like via this external interface 13 By detecting an operation from the input unit 10, the captured image data is transferred (image data recorded in the recording medium 7 is transferred to an external device or the like) or read (image data from the external device or the like to the recording medium). Can be read).
In the present embodiment, the external interface 13 is connected to an external device by cable connection, and performs image data transmission / reception, but is not limited to this, and includes a module for non-contact communication and wireless communication, and wirelessly. You may make it transmit and receive image data with an external apparatus.

Next, the subject clipping process according to the image processing method of the imaging apparatus 100 will be described with reference to FIGS.
FIG. 2 is a flowchart illustrating an example of an operation related to the subject clipping process.

The subject clipping process is a process executed when a subject clipping mode is selected from a plurality of imaging modes displayed on the menu screen based on a predetermined operation of the selection determination button 102 by the user.
As shown in FIG. 2, first, the CPU 11 displays a live view image on the display control unit 8 based on a plurality of image frames generated by imaging the subject by the lens unit 1, the electronic imaging unit 2, and the imaging control unit 3. The image is displayed on the display screen of the display unit 9 and is superimposed on the live view image, and an imaging instruction message of the subject existing image P is displayed on the display screen of the display unit 9 (step S1).

Then, the CPU 11 drives the lens motor 12 by the imaging control unit 3 to adjust the focus position of the focus lens, and updates the live view image until the user operates the shutter button 101 of the operation input unit 11 to perform an imaging instruction operation. When the imaging instruction operation is performed while waiting (YES in step S2), an optical image of the subject existing image P is continuously performed a predetermined number of times (n times) by the electronic imaging unit 2 under a predetermined imaging condition at the instructed timing. A plurality of image frames f1 to fn are acquired by starting imaging (step S3). The YUV data of each image frame of the subject existing image P generated by the image data generation unit 4 is temporarily stored in the image memory 5.
FIG. 3 is a diagram showing a subject existing image P including a plurality of image frames f1 to fn including the subject images O1 to On obtained in step S3.

Then, the subject extraction unit 61 extracts subject images O1 to On including the subject from the image frames f1 to fn of the subject presence image P acquired in step S3 (step S4).
Specifically, the subject extraction unit 61 applies a low-pass filter to each of the YUV data in each of the image frames f1 to fn of the subject presence image P to remove the high frequency component of each image. Thereafter, the subject extraction unit 61 calculates a difference for each pixel corresponding to each of the image frames f1 to fn of the subject existing image P to which a low-pass filter has been applied, and generates a difference map. Subsequently, the subject extraction unit 61 binarizes the dissimilarity map relating to each pixel with a predetermined threshold, and then performs a contraction process in order to remove an area in which the dissimilarity has occurred due to fine noise or camera shake. . Thereafter, the subject extraction unit 61 performs a labeling process to remove a region below a predetermined value or a region other than the maximum region, and then specifies the largest island pattern as the subject image O.

  Next, the CPU 11 causes the position information generation unit 62 to generate an alpha map indicating the positions in the corresponding image frames f1 to fn of the subject images O1 to On extracted for each of the image frames f1 to fn ( Step S5).

Thereafter, the CPU 11 causes the image composition unit 63 to generate cutout moving image data M including a plurality of subject cutout images C1 to Cn obtained by combining the subject image O in each of the image frames f1 to fn with a predetermined single color image (Step S11). S6).
Specifically, the CPU 11 causes the image composition unit 63 to read out the subject images O1 to On in the image frames f1 to fn, and a single color image and an alpha map corresponding to the image frames f1 to fn. After development in the memory 5, with respect to all the pixels of the subject images O1 to On in the image frames f1 to fn, pixels with an alpha value of 0 (α = 0) are transmitted, and the alpha value is 0 <α <1. For pixels of (0 <α <1), blending with a predetermined single color is performed, and for pixels with an alpha value of 1 (α = 1), nothing is transmitted to the predetermined single color without doing anything. To do.
Thereafter, the CPU 11 reproduces and displays on the display screen of the display unit 9 the clipped moving image data M including the image frames C1 to Cn (see FIG. 4) of the subject clipped image generated by the image composition unit 63 on the display control unit 8. Let

Next, the CPU 11 associates the alpha map generated by the position information generation unit 62 with the image data of the image frame for each image frame C1 to Cn of the subject clipped image in a predetermined storage area of the recording medium 7. Then, the cutout moving image data M is stored as one file (step S7).
Thereby, the subject clipping process is completed.

Next, the composite image generation process by the imaging device 100 will be described with reference to FIGS. 5 and 6.
FIG. 5 is a flowchart illustrating an example of an operation related to the composite image generation process.
The composite image generation process is a process of generating a subject composite image by combining the background image B and the image frames C1 to Cn of the cutout moving image data M using the image composition unit 63 of the image processing unit 6. .

  As shown in FIG. 5, first, based on a predetermined operation of the operation input unit 10 by the user, a desired background image B (FIG. 6A) among a plurality of images recorded on the recording medium 7 is obtained. When selected, the image composition unit 63 reads out the image data of the designated background image B and develops it in the image memory 5 (step S11). Note that the background image B may not be an image captured by the imaging device 100. For example, it may be an image transferred from the personal computer to the recording medium 7 via the external interface 13.

  Next, when desired clipped moving image data M is selected from a plurality of images recorded on the recording medium 7 based on an instruction operation from the operation input unit 10 by the user (step S31), image processing is performed. The unit 6 reads out the image frames C1 to Cn of the selected cutout moving image data M and develops them in the image memory 5 (step S12). At this time, the display control unit 8 also superimposes the subject image O1 in the image frame C1 of the cutout moving image data M developed in the image memory 5 at a predetermined position on the background image B developed in the image memory 5. The display unit 9 is controlled to display (Step S13).

  Subsequently, the CPU 11 determines whether or not an instruction to enlarge / reduce the subject image O has been given based on a predetermined operation of the operation input unit 10 by the user (step S14). If the enlargement / reduction instruction has not been issued (NO in step S14), the process proceeds to step S16.

  On the other hand, if it is determined that an enlargement / reduction instruction has been issued (YES in step S14), the CPU 11 displays the display control unit 8 in accordance with an operation by the operation input unit 10 as shown in FIGS. Thus, control is performed to enlarge / reduce the subject image O1 displayed on the display unit 9 so as to be superimposed on the background image B (step S15). In this enlargement / reduction display, a frame indicating the range of the image frames C1 to Cn of the cutout moving image data M may be superimposed on the background image B.

  Next, based on a predetermined operation of the operation input unit 10 by the user, it is determined whether or not a user-desired synthesis position of the subject image O1 has been designated (step S16).

  Here, when the enlargement / reduction instruction and the composite position instruction are not given (NO in step S16), it is determined whether or not the user has not operated the operation input unit 10 for a predetermined time or longer (eg, 2 seconds or longer) (step S17). If it is determined that there is no operation (YES in step S17), the clipped moving image data M is cut into the background image B based on the size and position of the subject image O1 currently displayed on the background image B. The subject synthesized video is reproduced and displayed by sequentially reproducing and displaying the subject synthesized image obtained by synthesizing the image frames C1 to Cn.

  On the other hand, if it is determined in step S16 that the composition position has been designated (YES in step S16), the CPU 11 shifts the processing to step S19, and the background image B developed in the image memory 5 and the cut-out moving image data M. An image composition process for composing each of the image frames C1 to Cn is performed (step S19).

Here, the image composition processing will be described in detail with reference to FIG.
FIG. 7 is a flowchart illustrating an example of an operation related to the image composition process.
As shown in FIG. 7, the image composition unit 63 reads the alpha map stored as “.jpe”, and associates the read alpha map with the size of the subject image O1 that is enlarged and reduced in step S15. The data is developed in the image memory 5 (step S31).

  Next, the image composition unit 63 designates the first frame among the image frames developed in the image memory 5 (step S32), and then continues with any one pixel (for example, the upper left corner) of the background image B. Part pixel) is designated (step S33). For the pixel, the process is branched based on the alpha value of the alpha map (step S34). Specifically, the composition unit 8f, for any one of the pixels in the background image B, for a pixel with an alpha value of 1 (step S34; α = 1), a pixel corresponding to the subject cut-out image C Overwrite with a value (step S35), and for a pixel with an alpha value of 0 <α <1 (step S34; 0 <α <1), an image obtained by cutting out the subject image O using 1's complement (1-α) After generating (background image × (1-α)), when the subject cutout image C is generated using the one's complement (1-α) in the alpha map, a value blended with a single background color is calculated. Then, the value is subtracted from the subject cutout image C, and is combined with an image obtained by cutting out the subject image O (background image × (1−α)) (step S36, for a pixel with an alpha value of 0 (step S34). ; Α = 0), background without doing anything So as to transmit the image B.

Subsequently, the image composition unit 63 determines whether or not all the pixels of the background image B have been processed (step S37).
If it is determined that all the pixels have not been processed (step S37; NO), the image composition unit 63 moves the processing target to the next pixel (step S38), and the process proceeds to step S34. Let
Further, it is determined whether or not the above processing has been performed for all of the image frames C1 to Cn constituting the cutout moving image data M (step S39). (Step S40), and the process proceeds to step S33. Thus, the subject image O1 is synthesized at a desired reference composition position and size, and in each image frame other than the reference image frame, between adjacent image frames generated by the position information generation unit 62 (for example, image frames). Based on the position information of the subject image O in the image frame f2) with respect to f3, the composition position and size of the subject cutout image C in each image frame other than the reference image frame are set, and the subject cutout synthesized with the reference image frame The subject clipped images C2 to On are combined with the image C1 so as to be displaced in accordance with the movement of the clipped moving image data M to generate a plurality of combined image frames.
On the other hand, if it is determined that all image frames have been processed (step S39; YES), the image composition process is terminated.

As described above, according to the imaging apparatus 100 of the present embodiment, when the subject image O is combined with the background image B, the size of the subject image O to be combined can be arbitrarily designated. As a result, the user can arbitrarily change the size of the subject image O to be combined with the background image, and as a result of the combination, it is possible to generate an image with less discomfort.
When the subject images O1 to On in the cutout moving image data M are combined with the background image B, the composition position and the size of the subject image O1 with respect to the background image B in the first subject cutout image frame C1 are designated, and By synthesizing the subject images O2 to On in the subsequent frames C2 to Cn based on the designation result, the subject image O changed to a desired size in accordance with the motion of the subject in the cutout moving image data M is operated in a predetermined manner. It is possible to generate a synthetic video with high interest.
Furthermore, according to the present embodiment, the cutout moving image data M ′ is stored in advance as a foreground image, so that even if the cutout moving image data M cannot be generated in a satisfactory manner, a composite image can be easily generated. it can.

  Moreover, what was illustrated in the said embodiment is an example, and is not restricted to this. For example, the subject image O is extracted by the subject extraction unit 61 from the image frames f0 to fn of the subject presence image P acquired by imaging, but the foreground image data M recorded in the character memory 64 in advance. The character image in each frame of ′ may be used as the subject image O.

Furthermore, in the above embodiment, the background image B is selected from the images recorded on the recording medium 7. However, as shown in FIG. 8, the background image B is connected to the personal computer 200 via the external interface 13. The image capturing apparatus 100 may be connected so that an image stored in an HDD (Hard Disk Drive) 201 of the personal computer 200 can be taken into the recording medium 7.
In this way, since a desired still image can be acquired as a background image via an external device, a composite image can be generated with an image that is not actually taken as a background image.

  Furthermore, in the above-described embodiment, the case where the present invention is applied to a digital camera has been illustrated. However, the present invention is not limited to a digital camera, and may be applied to various hardware, systems, and software such as computer software and network server systems. Applicable.

2 Electronic imaging unit 3 Imaging control unit 4 Image data generation unit 5 Image memory 6 Image processing unit 7 Recording medium 10 Operation input unit 11 CPU
13 External Interface 61 Subject Extraction Unit 62 Position Information Generation Unit 63 Image Composition Unit 64 Character Memory 100 Imaging Device 101 Shutter Button 102 Selection Decision Button 200 Personal Computer 201 HDD (Hard Disk Drive)

Claims (9)

Imaging means;
Extraction means for acquiring a subject image obtained by extracting a subject region from an image captured by the imaging means;
Acquisition means for acquiring a background image;
First specifying means for specifying the size of the subject image when the subject image acquired by the extracting unit and the background image acquired by the acquiring unit are combined;
An image pickup apparatus comprising: a combining unit configured to combine a subject image having a size specified by the first specifying unit with the background image.   The imaging apparatus according to claim 1, further comprising second specifying means for specifying a position at which the subject image is combined with the background image by the combining means. Imaging control means for causing the imaging means to perform continuous imaging;
The extraction unit acquires a subject image from each of a plurality of images obtained by continuous imaging by the imaging control unit,
The imaging apparatus according to claim 1, wherein the synthesizing unit generates a plurality of synthesized images by synthesizing each of the plurality of subject images acquired by the extracting unit with the background image. Specifying at least one subject image among the plurality of subject images extracted by the extracting means by the first specifying means;
The imaging apparatus according to claim 3, wherein the synthesizing unit generates a plurality of synthesized images obtained by synthesizing each of the other subject images obtained by the extracting unit based on a designation result by the designation unit.   5. The image pickup apparatus according to claim 3, further comprising reproduction display means for reproducing and displaying the synthesized result before the synthesis by the synthesizing means.   The imaging apparatus according to claim 1, wherein the acquisition unit acquires the background image from an external device connected to the apparatus. Foreground image recording means for recording the foreground image;
The imaging apparatus according to claim 1, wherein the synthesizing unit further synthesizes the foreground image recorded in the image recording unit with the background image acquired by the acquiring unit. . An extraction step of acquiring a subject image obtained by extracting a subject region from the captured image;
A designation step for designating the size of the subject image when the subject image acquired in the extraction step and the background image are combined;
An image processing method comprising: a combining step of combining the subject image having the size specified in the specifying step with the background image. An extracting means for acquiring a subject image obtained by extracting a subject region from an image captured by a computer included in the imaging device;
Designation detecting means for detecting designation of the size of the subject image when the subject image acquired by the extracting means and the background image are combined;
A program for causing a subject image having a size detected by the designation detection means to function as a synthesis means for synthesizing the subject image with the background image.

Images