JP2011077850A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an effective composite image when combining a background image and a foreground image. <P>SOLUTION: An imaging device 100 is provided with: a combination region specification unit 8c for specifying a combination region of the background image with which a subject image should be combined; a process handling unit 8e that applies predetermined image processing to the subject image and/or the background image based on the subject image combination region specified by the combination region specification unit; and an image combination unit 8f that combines the subject image applied with predetermined image processing by the process handling unit with the background image to generate a subject combined image P. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program for combining a plurality of images.

  Conventionally, a technique for generating a composite image by combining a subject image with a background image or a frame image is known (see, for example, Patent Document 1).

JP 2004-159158 A

  However, since the above conventional technique only synthesizes the subject image at the designated position of the background image, depending on the background image to be synthesized, the content of the subject image, the synthesis position, and the synthesis size, it does not become an effective synthesized image. There was a problem.

  Therefore, an object of the present invention is to provide an image processing apparatus, an image processing method, and a program capable of obtaining an effective composite image when combining a background image and a foreground image.

In order to solve the above problem, an image processing apparatus according to claim 1 is provided.
In an image processing apparatus including a synthesis unit that synthesizes a foreground image with a background image, a specifying unit that specifies a region in the background image to be combined with the foreground image, and the foreground image specified by the specification unit are combined. Image processing means for performing a predetermined process on at least one of the foreground image and the background image based on a power region, and the synthesizing means is subjected to the predetermined process on at least one of the image processing means. The foreground image and the background image are synthesized.

The invention according to claim 2 is the image processing apparatus according to claim 1,
The image processing device further comprises storage means for storing the foreground image and a predetermined process in association with each other, and the image processing means stores the foreground image in the storage means based on an area to be combined with the foreground image specified by the specifying means. The predetermined processing stored in association with the foreground image is performed on at least one of the foreground image and the background image.

The invention according to claim 3 is the image processing apparatus according to claim 1 or 2,
And a determination unit configured to determine whether or not a predetermined region in the background image is specified as a region to be combined with the foreground image by the specifying unit, and the image processing unit is configured to determine the predetermined region in the background image by the determination unit. When it is determined that the image is identified, a predetermined process is performed on at least one of the foreground image and the background image.

The invention according to claim 4 is the image processing apparatus according to claim 3,
The image processing unit preferentially displays an image portion of the predetermined region in the background image with respect to the foreground image when the determination unit determines that the predetermined region in the background image is specified. A predetermined process is performed on at least one of the foreground image and the background image.

The invention according to claim 5 is the image processing apparatus according to claim 3 or 4,
The background image is a continuous shot image or a moving image composed of a plurality of frame images, and the determining means determines the predetermined area in the frame image for each frame image constituting the continuous shot image or the moving image. The image processing means determines whether or not a predetermined image of at least one of the frame image and the foreground image determined by the determining means to be specified from the plurality of frame images. It is characterized by processing.

The invention according to claim 6 is the image processing apparatus according to any one of claims 3 to 5,
The predetermined area is a face image area detected from the background image.

An image processing apparatus according to a seventh aspect of the present invention provides:
In an image processing apparatus including a synthesis unit that synthesizes a foreground image with a background image, a storage unit that stores the foreground image and a predetermined process in association with each other, and a storage unit that stores the foreground image in association with the foreground image. Image processing means for performing the predetermined processing on at least one of the foreground image and the background image, and the synthesizing means has the foreground image on which at least one of the predetermined processing has been performed by the image processing means. And the background image.

The invention according to claim 8 is the image processing apparatus according to claim 7,
The image processing means further includes a specifying unit that specifies a region in the background image to be combined with the foreground image, and the image processing unit is configured to select a predetermined region in the background image specified as the region to be combined with the foreground image. A predetermined process is performed on the background image within a predetermined range.

The image processing method of the invention according to claim 9
Based on the step of specifying the region in the background image where the foreground image is to be combined and the region where the foreground image specified in the above step is to be combined, predetermined processing is performed on at least one of the foreground image and the background image. And a step of synthesizing the foreground image and the background image that have been subjected to predetermined processing in at least one of the steps.

An image processing method according to the invention of claim 10 is provided.
A foreground image and a predetermined process are stored in association with each other in advance, and the predetermined process stored in association with the foreground image is applied to at least one of the foreground image and the background image with which the foreground image is synthesized. And a step of synthesizing the foreground image and the background image that have been subjected to predetermined processing in at least one of the steps.

The program of the invention described in claim 11 is
The computer of the image processing apparatus is configured to specify a region for combining the foreground image in the background image, based on the region to be combined with the foreground image specified by the specifying unit. The image processing means for performing a predetermined process on at least one, and a combining means for combining the foreground image and the background image on which the predetermined process has been applied to at least one by the image processing means.

The program of the invention described in claim 12 is:
A computer of an image processing apparatus having a storage unit that stores a foreground image and a predetermined process in association with each other. The predetermined process stored in the storage unit in association with a foreground image is stored in the foreground image and the background. The image processing means is applied to at least one of the images, and the image processing means functions as a synthesis means for synthesizing the foreground image and the background image on which at least one of the images has been subjected to predetermined processing.

  According to the present invention, an effective composite image can be obtained when a background image and a foreground image are combined.

It is a block diagram which shows schematic structure of the imaging device of one Embodiment to which this invention is applied. It is a figure which shows an example of the processing content table memorize | stored in the imaging device of FIG. 3 is a flowchart illustrating an example of an operation related to background image generation processing by the imaging apparatus of FIG. 1. 3 is a flowchart illustrating an example of an operation related to subject clipping processing by the imaging apparatus of FIG. 1. 3 is a flowchart illustrating an example of an operation related to a composite image generation process by the imaging apparatus of FIG. 1. It is a flowchart which shows an example of the operation | movement which concerns on the image composition process in the composite image generation process of FIG. It is a figure which shows typically an example of the image which concerns on the synthesized image generation process of FIG. FIG. 10 is a diagram schematically illustrating an example of an image related to a composite image generation process performed by an imaging apparatus according to Modification 1. 14 is a flowchart illustrating an example of an operation related to a composite image generation process performed by an imaging apparatus according to a second modification.

Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.
FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to an embodiment to which the present invention is applied.

The imaging apparatus 100 according to the present embodiment identifies a synthesis region in which a subject image (foreground image) G (see FIG. 7A, etc.) in the background image B (see FIG. 7A, etc.) is to be synthesized, and Based on the synthesis area where the subject image G is to be synthesized, at least one of the subject image G and the background image B is subjected to predetermined image processing to generate a subject synthesized image P.
Specifically, as illustrated in FIG. 1, the imaging apparatus 100 includes a lens unit 1, an electronic imaging unit 2, an imaging control unit 3, an image data generation unit 4, an image memory 5, and a feature amount calculation unit. 6, a block matching unit 7, an image processing unit 8, a recording medium 9, a display control unit 10, a display unit 11, an operation input unit 12, and a CPU 13.
In addition, the imaging control unit 3, the feature amount calculation unit 6, the block matching unit 7, the image processing unit 8, and the CPU 13 are designed as, for example, a custom LSI 1A.

The lens unit 1 includes a plurality of lenses and includes a zoom lens, a focus lens, and the like.
Although not shown, the lens unit 1 includes a zoom drive unit that moves the zoom lens in the optical axis direction and a focus drive unit that moves the focus lens in the optical axis direction when imaging a subject. May be.

  The electronic imaging unit 2 is composed of an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-oxide Semiconductor), for example, and converts an optical image that has passed through various lenses of the lens unit 1 into a two-dimensional image signal. To do.

Although not shown, the imaging control unit 3 includes a timing generator, a driver, and the like. Then, the imaging control unit 3 scans and drives the electronic imaging unit 2 with a timing generator and a driver, converts the optical image into a two-dimensional image signal with the electronic imaging unit 2 every predetermined period, and the electronic imaging unit 2 Image frames are read out from the imaging area for each screen and output to the image data generation unit 4.
In addition, the imaging control unit 3 performs adjustment control of conditions when imaging a subject such as AF (automatic focusing process), AE (automatic exposure process), and AWB (automatic white balance).

  The lens unit 1, the electronic imaging unit 2, and the imaging control unit 3 configured as described above capture the background image B (see FIG. 7A) and the subject presence image (not shown) related to the image composition processing.

The image data generation unit 4 appropriately adjusts the gain for each RGB color component with respect to the analog value signal of the image frame transferred from the electronic imaging unit 2, and then performs sample holding by a sample hold circuit (not shown). The digital signal is converted into digital data by a / D converter (not shown), color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown), and then a digital luminance signal Y and color difference signal Cb , Cr (YUV data).
The luminance signal Y and the color difference signals Cb and Cr output from the color process circuit are DMA-transferred to an image memory 5 used as a buffer memory via a DMA controller (not shown).

  The image memory 5 is composed of, for example, a DRAM or the like, and temporarily stores data processed by the feature amount calculation unit 6, the block matching unit 7, the image processing unit 8, the CPU 13, and the like.

When generating a subject cut-out image from the captured subject existing image, the feature amount calculation unit 6 performs feature extraction processing for extracting feature points from the subject non-existing image with reference to the subject non-existing image to be compared. Specifically, the feature amount calculation unit 6 selects a predetermined number (or a predetermined number or more) of highly featured block regions (feature points) based on the YUV data of the subject nonexistent image, and The contents are extracted as a template (for example, a square of 16 × 16 pixels).
Here, the feature extraction process is a process of selecting a feature having a high characteristic convenient for tracking from a large number of candidate blocks.

  The block matching unit 7 performs block matching processing for aligning the subject non-existing image and the subject existing image. Specifically, the block matching unit 7 corresponds to where in the subject existing image the template extracted by the feature extraction processing corresponds, that is, the position where the pixel value of the template optimally matches in the subject existing image ( Search the corresponding area. Then, an optimal offset between the subject non-existing image and the subject existing image having the best evaluation value (for example, the sum of squared differences (SSD), the sum of absolute differences (SAD), etc.) Calculate as a motion vector.

  The image processing unit 8 includes a cut-out image generation unit 8a, a face detection unit 8b, a synthesis region specifying unit 8c, a region determination unit 8d, a processing unit 8e, and an image synthesis unit 8f.

The cutout image generation unit 8a generates image data of the subject cutout image. Specifically, the cut-out image generation unit 8a includes a position alignment unit, a subject image extraction unit, a position information generation unit, and the like (all not shown).
The alignment unit calculates a coordinate conversion formula (projection conversion matrix) of each pixel of the subject existing image with respect to the subject nonexistent image based on the feature points extracted from the subject nonexistent image, and the subject existing image according to the coordinate conversion formula Is coordinate-converted with the subject non-existing image.
The subject image extraction unit generates difference information of each corresponding pixel between the subject presence image and the subject non-existence image aligned by the alignment unit, and includes the subject from the subject presence image based on the difference information. Subject image (foreground image) G is extracted.
The position information generating unit specifies the position of the subject image G extracted from the subject existing image, and generates position information (for example, an alpha map) indicating the position of the subject image G in the subject existing image. Here, the alpha map represents a weight when alpha blending the subject image G with respect to a predetermined background for each pixel of the subject existing image as an alpha value (0 ≦ α ≦ 1).
Based on the alpha map generated by the position information generation unit, the cut-out image generation unit 8a transmits a pixel having an alpha value of 1 to a predetermined single color image (not shown) among the pixels of the subject existing image. In addition, the subject image G is synthesized with a predetermined single color image so as to transmit a pixel having an alpha value of 0 without generating the image data of the subject cut-out image.

  The face detection unit 8b detects a face from the background image B using a predetermined face detection method. Specifically, the face detection unit 8b performs a face image region A from the background image B designated based on a predetermined operation of the selection determination button 12b of the operation input unit 12 by the user in a composite image generation process (described later). , And feature portions (face parts) corresponding to eyes, nose, mouth, and the like are detected from within the detected regions. Since this face detection process is a known technique, a detailed description thereof is omitted here.

The synthesis area specifying unit 8c specifies a synthesis area in which the subject image G of the subject cutout image in the background image B is to be synthesized. Specifically, in the composite image generation process, when the composite position of the subject image G on the background image B is specified based on a predetermined operation of the selection determination button 12b of the operation input unit 12 by the user, the composite region specifying unit 8c specifies an area in which the subject image G on the background image B is superimposed at the synthesis position as a synthesis area where the subject image G of the subject cut-out image in the background image B is to be synthesized.
Here, the synthesis area specifying unit 8c constitutes specifying means for specifying an area in which the subject image (foreground image) G in the background image B is to be synthesized.

The region determination unit 8d determines whether or not the composite region of the subject image G in the background image B and the predetermined region in the background image B overlap. Specifically, the area determination unit 8d overlaps the synthesis area of the subject image G specified by the synthesis area specification unit 8c and the face image area (predetermined area) A detected from the background image B by the face detection unit 8b. It is determined whether or not.
Here, the region determination unit 8d constitutes a determination unit that determines whether or not a predetermined region in the background image B is specified as a combination region in which the subject image (foreground image) G is to be combined by the combination region specification unit 8c. Yes.

The processing unit 8e performs predetermined image processing on the background image B based on the composite region of the subject image G in the background image B. Specifically, the processing unit 8e performs predetermined image processing registered in the processing content table T (see FIG. 2) in association with the subject image G on the background image B in the synthesis region of the subject image G. Apply.
The processing content table T stores the subject image G and predetermined image processing in association with each other as storage means. Specifically, as illustrated in FIG. 2, the processing content table T includes a subject image name (for example, “exclamation mark”, “light”, “ Water droplets ”,“ balls ”, etc.), image data of the subject image G, and processing contents of image processing for the background image B are stored in association with each other. For example, “exclamation mark” as the subject image G is associated with “the face image area is made a surprised expression” as the processing content of the image processing, and the processing unit 8e performs the face image area of the background image B. Image processing is performed such that the white part of the eye of A is enlarged toward the outside of the face, and the black part is reduced toward the inside of the face. Further, “light” as the subject image G is associated with “brighten around the composite region” as the processing content of the image processing, and the processing unit 8e has a portion other than the composite region of the background image B. Image processing is performed such that the brightness, contrast, color tone, and the like are adjusted to make the area closer to the synthesis area brighter. Further, “water droplets” as the subject image G are associated with “processing that causes ripples to spread around the synthesis position” as the processing content of the image processing, and the processing unit 8e performs the synthesis region of the background image B. Assuming an annular portion having a predetermined diameter in the other region, image processing is performed so that a portion overlapping the annular portion undulates. In addition, “ball” as the subject image G is associated with “processing to dent about the composite position” as the processing content of the image processing, and the processing unit 8e displays the composite area of the background image B. Image processing that distorts the vicinity is performed.
Note that the processing content table T described above is an example, and the type and processing content of the subject image G are not limited to these. These content may be registered in the processing content table T in advance. Registration may be performed by subject clipping processing described later.
Further, the processing content table T described above may be stored in the image memory 5 in advance, or may be stored in a predetermined storage area of the recording medium 9 or a predetermined storage area for each image file.

  Further, when the predetermined region in the background image B is specified as the composite region of the subject image G by the region determination unit 8d, that is, the processing unit 8e, that is, from the background image B by the composite region of the subject image G and the face detection unit 8b. When it is determined that the detected face image area A overlaps, the background image B is subjected to predetermined image processing. Specifically, when it is determined that the face image area A of the background image B and the composite area of the subject image G overlap, the processing unit 8e stores the processing content table T in the composite area of the subject image G. The predetermined image processing registered in association with the subject image G is performed on the background image B.

The processing unit 8e may perform predetermined image processing on the subject image G in addition to the image processing on the background image B as described above or instead of the image processing on the background image B.
Here, the processing unit 8e, based on the synthesis area in which the subject image (foreground image) G in the background image B specified by the synthesis area specification unit 8c is to be synthesized, of the subject image G and the background image B, Image processing means for performing predetermined processing on at least one of them is configured.

The image processing unit 8 includes an image composition unit (composition unit) 8f that combines the subject cut-out image and the background image B.
The image synthesizing unit 8f synthesizes the background image B on which the predetermined image processing has been performed by the processing unit 8e and the subject cutout image to generate the subject synthesized image P. Specifically, the image composition unit 8f transmits pixels having an alpha value of 0 among the pixels of the background image B after image processing, and pixels having an alpha value of 1 are pixels corresponding to the subject cutout image. In addition, among the pixels of the background image B, the pixel whose alpha value is 0 <α <1 is an image obtained by clipping the subject area using the one's complement (1-α) (background image × (1 -Α)), a value blended with a single background color is calculated when the subject cutout image is generated using the one's complement (1-α) in the alpha map, and the value is calculated from the subject cutout image. Subtraction is performed, and the resultant is combined with an image obtained by cutting out the subject area (background image × (1−α)).

The recording medium 9 is constituted by, for example, a nonvolatile memory (flash memory) or the like, and stores the image data of the background image B and the subject cutout image encoded by the compression unit (not shown) of the image processing unit 8.
In addition, the image data of the subject clipped image is associated with the alpha map generated by the position information generation unit of the image processing unit 8 and a plurality of extensions of the image data of the subject clipped image is “.jpe”. A group of image files is saved.

The display control unit 10 performs control for reading display image data temporarily stored in the image memory 5 and displaying the read image data on the display unit 11.
Specifically, the display control unit 10 includes a VRAM, a VRAM controller, a digital video encoder, and the like. The digital video encoder periodically reads the luminance signal Y and the color difference signals Cb and Cr read from the image memory 5 and stored in the VRAM (not shown) under the control of the CPU 13 from the VRAM via the VRAM controller. Are read out, a video signal is generated based on these data, and is output to the display unit 11.

  The display unit 11 is, for example, a liquid crystal display device, and displays images, characters, and the like on a display screen based on a video signal from the display control unit 10. Specifically, the display unit 11 displays a live view image based on a plurality of image frames generated by imaging the subject by the lens unit 1, the electronic imaging unit 2, and the imaging control unit 3 in the imaging mode. The REC view image captured as the actual captured image is displayed.

  The operation input unit 12 is for performing a predetermined operation of the imaging apparatus 100. Specifically, the operation input unit 12 includes a shutter button 12a related to a subject shooting instruction, a selection determination button 12b related to a selection instruction of a shooting mode and a function, and a setting instruction of a composition position of a subject image G of a subject cutout image, A zoom button (not shown) or the like related to a zoom amount adjustment instruction is provided, and a predetermined operation signal is output to the CPU 13 in accordance with the operation of these buttons.

  The CPU 13 controls each part of the imaging device 100. Specifically, the CPU 13 performs various control operations in accordance with various processing programs (not shown) for the imaging apparatus 100.

Next, background image generation processing by the imaging apparatus 100 will be described with reference to FIG.
FIG. 3 is a flowchart illustrating an example of an operation related to the background image generation process.

The background image generation process is a normal still image capturing process, and based on a predetermined operation of the selection determination button 12b of the operation input unit 12 by the user, a still image is captured from among a plurality of imaging modes displayed on the menu screen. This process is executed when a mode is instructed to be selected.
As shown in FIG. 3, first, the display control unit 10 displays a live view image based on a plurality of image frames generated by imaging the background image B by the lens unit 1, the electronic imaging unit 2, and the imaging control unit 3. It displays on the display screen of the part 11 (step S1).

  Next, the CPU 13 determines whether or not an imaging instruction has been input based on a predetermined operation of the shutter button 12a of the operation input unit 12 by the user (step S2). If it is determined that an imaging instruction has been input (step S2; YES), the imaging control unit 3 determines the focus lens focus position, exposure conditions (shutter speed, aperture, amplification factor, etc.), white balance, and the like. The condition is adjusted, and the optical image of the background image B (see FIG. 7A, etc.) is imaged by the electronic imaging unit 2 under a predetermined condition (step S3).

Subsequently, the image data generation unit 4 generates YUV data of the image frame of the background image B transferred from the electronic imaging unit 2 and then stores the YUV data of the background image B in a predetermined storage area of the recording medium 9. (Step S4).
Thereby, the background image generation process is terminated.

Next, the subject clipping process performed by the imaging apparatus 100 will be described with reference to FIG.
FIG. 4 is a flowchart illustrating an example of an operation related to the subject clipping process.

The subject clipping process is executed when a subject clipping mode is selected from a plurality of imaging modes displayed on the menu screen based on a predetermined operation of the selection determination button 12b of the operation input unit 12 by the user. It is.
As shown in FIG. 4, first, the display control unit 10 displays a live view image based on a plurality of image frames generated by imaging a subject by the lens unit 1, the electronic imaging unit 2, and the imaging control unit 3. Is displayed on the display screen, and is superimposed on the live view image, and an imaging instruction message for the subject existing image is displayed on the display screen of the display unit 11 (step S11).

  Next, the CPU 13 determines whether or not an imaging instruction has been input based on a predetermined operation of the shutter button 12a of the operation input unit 12 by the user (step S12). If it is determined that an imaging instruction has been input (step S12; YES), the imaging control unit 3 determines the focus lens focus position, exposure conditions (shutter speed, aperture, amplification factor, etc.), white balance, and the like. The conditions are adjusted, and an optical image of a subject existing image (not shown) is imaged by the electronic imaging unit 2 under a predetermined condition (step S13).

Subsequently, the image data generation unit 4 generates YUV data of the image frame of the subject existing image transferred from the electronic imaging unit 2 and then temporarily stores the YUV data of the subject existing image in the image memory 5.
Further, the imaging control unit 3 maintains a state in which conditions such as a focus position, an exposure condition, and a white balance at the time of imaging the subject existing image are fixed.

The display control unit 10 displays a live view image on the display screen of the display unit 11 based on a plurality of image frames generated by imaging the subject by the lens unit 1, the electronic imaging unit 2, and the imaging control unit 3. Then, the image of the semi-transparent display mode of the subject existing image and the imaging instruction message of the subject non-existing image are displayed on the display screen of the display unit 11 so as to be superimposed on the live view image (step S14).
Thereafter, the CPU 13 determines whether or not an imaging instruction is input based on a predetermined operation of the shutter button 12a of the operation input unit 12 by the user (step S15). Then, after the user moves the subject outside the angle of view or waits for the subject to move, the camera position is adjusted by the user so that the subject nonexistent image overlaps the semi-transparent image of the subject present image. When it is determined that an imaging instruction has been input based on a predetermined operation of the shutter button 12a of the operation input unit 12 (step S15; YES), the imaging control unit 3 converts the optical image of the subject non-existing image into the subject existing image. The electronic image pickup unit 2 picks up an image under conditions fixed after the image pickup (step S16).
Thereafter, the image data generation unit 4 generates YUV data of the subject nonexistent image based on the image frame of the subject nonexistent image transferred from the electronic imaging unit 2, and then temporarily stores the YUV data in the image memory 5. Let

Next, the CPU 13 uses the YUV data of the non-existing subject image temporarily stored in the image memory 5 in the cutout image generating unit 8a of the feature amount calculating unit 6, the block matching unit 7, and the image processing unit 8 as a reference. A projection transformation matrix for projectively transforming the YUV data of the existing image is calculated using a predetermined image transformation model (for example, a similarity transformation model or a joint transformation model) (step S17).
Specifically, the feature amount calculation unit 6 selects a predetermined number (or a predetermined number or more) of highly featured block regions (feature points) based on the YUV data of the subject nonexistent image, and Extract the contents as a template. Then, the block matching unit 7 searches the subject existing image for a position where the pixel value of the template extracted in the feature extraction process is optimally matched, and the subject with the highest evaluation value of the pixel value difference is obtained. An optimum offset between the non-existing image and the subject existing image is calculated as a motion vector of the template. Then, the alignment unit of the cut-out image generation unit 8a statistically calculates the entire motion vector based on the motion vectors of the plurality of templates calculated by the block matching unit 7, and performs feature point correspondence related to the motion vector. Using this, a projective transformation matrix of the subject existing image is calculated.

  Next, the alignment unit of the cutout image generation unit 8a performs the projective transformation on the subject existing image based on the calculated projective conversion example, thereby obtaining the YUV data of the subject existing image and the YUV data of the subject nonexistent image. A process of aligning is performed (step S18).

Then, the subject area extraction unit of the cutout image generation unit 8a performs a process of extracting a subject area (subject image) including the subject from the subject existing image (step S19).
Specifically, the subject region extraction unit applies a low-pass filter to each of the YUV data of the subject existing image and the YUV data of the subject nonexistent image to remove the high frequency component of each image. Thereafter, the subject area extraction unit calculates a difference for each pixel corresponding to the subject existing image and the subject non-existing image subjected to the low-pass filter to generate a difference map. Subsequently, the subject region extraction unit binarizes the dissimilarity map relating to each pixel with a predetermined threshold, and then performs a contraction process to remove a region in which the dissimilarity is caused by fine noise or camera shake from the dissimilarity map. . After that, the subject region extraction unit performs a labeling process, removes a region below a predetermined value or a region other than the maximum region, identifies the largest island pattern as the subject region, and corrects the contraction Perform expansion treatment.

  Next, the position information generation unit of the cutout image generation unit 8a generates an alpha map indicating the position of the extracted subject area in the subject existing image (step S20).

Thereafter, the cut-out image generation unit 8a performs a process of generating image data of a cut-out subject (not shown) obtained by combining the subject image with a predetermined single color image (step S21).
Specifically, the cut-out image generation unit 8a reads out the subject existing image, the single color image, and the alpha map and develops them in the image memory 5. Then, for all the pixels of the subject existing image, the pixels with an alpha value of 0 are obtained. (Α = 0), transmission is performed for a pixel with an alpha value of 0 <α <1, (0 <α <1), and blending with a predetermined single color is performed, and for a pixel with an alpha value of 1 (α = 1) ) Do nothing and do not allow transmission through a given single color.

After that, the CPU 13 converts the YUV data of the subject clipped image into an Exif format image file in which the alpha map generated by the position information generation unit of the clipped image generation unit 8a is attached as Exif information. One file with an extension of image data “.jpe” is stored in a predetermined storage area of the recording medium 9 (step S22).
When the image file is stored in a predetermined storage area of the recording medium 9, predetermined processing contents are stored in association with each other. For example, processing contents such as “increase brightness”, “decrease brightness”, and “add blur processing” are stored in the image memory 5, and an arbitrary image processing content can be selected from among these. The processed contents are stored in a predetermined storage area of the recording medium 9 in association with the image file.
Thereby, the subject clipping process is completed.

Next, the composite image generation process will be described in detail with reference to FIGS.
FIG. 5 is a flowchart illustrating an example of an operation related to the composite image generation process. FIG. 6 is a flowchart illustrating an example of an operation related to the image composition processing in the composite image generation processing.

The composite image generation processing is executed when an image combination mode is selected from a plurality of imaging modes displayed on the menu screen based on a predetermined operation of the selection determination button 12b of the operation input unit 12 by the user. It is processing.
As shown in FIG. 5, based on a predetermined operation of the operation input unit 12 by the user, a desired background image B (FIG. 7 (a) as a background of the composite image among a plurality of images recorded on the recording medium 9 is displayed. )) Is selected and designated (step S31), the image processing unit 8 reads the image data of the designated background image B, develops it in the image memory 5, and detects the face of the image processing unit 8. The unit 8b performs face detection processing on the image data and detects the face image area A from the background image B (step S32).

  Next, when a desired subject cut-out image is selected and designated from among a plurality of images recorded on the recording medium 9 based on a predetermined operation of the operation input unit 12 by the user (step S33), image processing is performed. The unit 8 reads out the image data of the designated subject cutout image and develops it in the image memory 5.

  Subsequently, when the synthesis position of the subject image G of the subject cut-out image in the background image B is designated based on a predetermined operation of the selection determination button 12b of the operation input unit 12 by the user (step S34; FIG. 7A) and the like. The composite region specifying unit 8c of the image processing unit 8 specifies the region where the subject image G on the background image B is superimposed as the composite region to be combined with the subject image G of the subject cutout image in the background image B (see FIG. Step S35).

Subsequently, the area determination unit 8d of the image processing unit 8 determines whether or not the face image area A detected by the face detection unit 8b overlaps with the synthesis area of the subject image G specified by the synthesis area specification unit 8c. (Step S36).
If it is determined that the face image area A of the background image B and the composite area of the subject image G overlap (see FIG. 7B) (step S36; YES), the processing unit 8e of the image processing unit 8 is determined. Acquires predetermined image processing content registered in association with the subject image G in the processing content table T (step S37), and performs image processing on the background image B according to the acquired image processing content (step S38). ).
For example, when the subject image “exclamation mark” is selected and designated, if the face image area A of the background image B overlaps with the composite area of the subject image G, the processing unit 8e performs image processing from the processing content table T. Image processing that obtains the content “make the face image area a surprised expression” and enlarges the white part of the eye of the face image area A in the outward direction of the face and reduces the black eye part in the inward direction of the face Apply. Further, for example, when “light” in the processing table T is selected as the subject image G, if the face image region A of the background image B and the composite region of the subject image G overlap, the processing unit 8e The image processing content “brighten around the combined area” is acquired from the table T, and image processing is performed so that the background image B is brightened around the combined area.

Next, the image processing unit 8 determines whether or not the composite position of the subject image G of the subject cutout image in the background image B has been redesignated based on a predetermined operation of the selection determination button 12b of the operation input unit 12 by the user. (Step S39).
Here, if it is determined that the synthesis position of the subject image G has been redesignated (step S39; YES), the image processing unit 8 shifts the process to step S35 and executes the subsequent processes.
The processing after step S35 is repeatedly performed until it is determined in step S39 that the composition position of the subject image G has not been designated again (step S39; NO).
When it is determined in step S39 that the composition position of the subject image G has not been designated again (step S39; NO), the image composition unit 8f of the image processing unit 8 determines that the background image B, the subject cut-out image, and the like. An image synthesis process is performed to synthesize (step S40).
Further, when it is determined in step S36 that the composite area of the subject image G and the face image area A do not overlap (see FIG. 7A, FIG. 7C, etc.) (step S36; NO) ), The image composition unit 8f performs image composition processing.

Here, the image composition processing will be described in detail with reference to FIG.
When the face image area A of the background image B and the composition area of the subject image G overlap, the image composition processing is performed using the background image B subjected to the predetermined image processing in step S38 as the target image. On the other hand, when the face image area A of the background image B and the composite area of the subject image G do not overlap, the background image B that has not been subjected to the predetermined image processing is performed as the target image.
In the following description, the background image B to be processed is simply referred to as the background image B regardless of whether or not predetermined image processing has been performed.

As shown in FIG. 6, the image composition unit 8f reads the alpha map stored in association with the subject clipped image and develops it in the image memory 5 (step S51).
In addition, when the synthesis position of the subject image G of the subject cutout image in the background image B is designated in step S34 or step S39 in FIG. 5, the background image B and the alpha map are shifted, and are outside the range of the alpha map. For such a region, α = 0 is set so as not to generate a region having no alpha value.

  Next, the image composition unit 8f designates any one pixel (for example, the pixel at the upper left corner) of the background image B (step S52), and processes the pixel based on the alpha value of the alpha map. Branch (step S53). Specifically, the image composition unit 8f, for any one of the pixels of the background image B, for the pixel having an alpha value of 1 (step S53; α = 1), the pixel value of the corresponding pixel of the subject cutout image (Step S54), for pixels with an alpha value of 0 <α <1 (step S53; 0 <α <1), an image obtained by clipping the subject area using 1's complement (1-α) (background Image × (1-α)), and when the subject cutout image is generated using the one's complement (1-α) in the alpha map, the value blended with the single background color is calculated, and the value is Subtract from the cut-out image of the subject and combine it with the image (background image × (1-α)) cut out of the subject area (step S55, for pixels with an alpha value of 0 (step S53; α = 0), Without passing through the background image B So as to.

Subsequently, the image composition unit 8f determines whether or not all the pixels of the background image B have been processed (step S56).
If it is determined that all the pixels have not been processed (step S56; NO), the image composition unit 8f designates the next pixel as a processing target and moves the processing target to the pixel (step S56). S57), the process proceeds to step S53.
By repeating the above process until it is determined in step S56 that all pixels have been processed (step S56; YES), the image composition unit 8f composites the subject clipped image and the background image B. Image data of the image P is generated.
Thereby, the image composition process is terminated.

After that, as shown in FIG. 5, the display control unit 10 displays the subject composite image P in which the subject image G is superimposed on the background image B based on the image data of the subject composite image P generated by the image composition unit 8 f. It displays on the display screen of the display part 11 (step S41).
Specifically, for example, when the face image area A of the background image B and the composite area of the subject image G overlap, the display control unit 10 applies the subject to the background image B that has undergone predetermined image processing. The subject composite image Pb (see FIG. 7B) on which the image G is superimposed is displayed on the display unit 11. On the other hand, for example, when the face image area A of the background image B and the composite area of the subject image G do not overlap, the display control unit 10 applies the subject image G to the background image B that has not been subjected to predetermined image processing. Subject display images Pa and Pc (see FIG. 7A, FIG. 7C, etc.) superimposed on the display unit 11.
Thus, the composite image generation process is finished.

As described above, according to the imaging apparatus 100 of the present embodiment, at least one of the subject image G and the background image B is based on the synthesis region in which the subject image G of the subject clipped image in the background image B is to be synthesized. Since predetermined image processing is performed on one of them, a novel mode in which predetermined image processing is performed on the subject image G and the background image B, instead of simply combining the subject image G and the background image B as in the past. The subject composite image Pb can be generated, and the subject composite image Pb can be made uncomfortable to improve the interest of the subject composite image Pb.
In particular, when the face image area A in the background image B is specified as a synthesis area in which the subject image G in the background image B is to be synthesized, a predetermined content stored in the processing content table T in association with the subject image G is stored. Since the image processing is performed on at least one of the subject image G and the background image B, for example, the subject image G and the face image area A of the background image B overlap, and the visual recognition of the entire face image area A is restricted. In such a case, by applying predetermined image processing to the face image area A, it is possible to create a sense of incongruity in the subject composite image Pb and improve the interest of the subject composite image Pb.
In this way, an effective subject composite image P can be obtained by combining the background image B and the subject image G.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
Below, the modification of the imaging device 100 is demonstrated.
Here, the modified example of the imaging device 100 has substantially the same configuration as the imaging device 100 of the above-described embodiment except for the details described below, and the description thereof is omitted.

<Modification 1>
When it is determined that the composite region of the subject image G and the predetermined region in the background image B overlap with each other, the processing unit 8e uses the image portion of the predetermined region in the background image B as the subject. Predetermined image processing is performed on the subject image G and the background image B so that the image G is displayed with priority.
That is, the processing unit 8e displays the subject image G in a semi-transparent display mode when the region determination unit 8d determines that the composite region of the subject image G and the face image region (predetermined region) A overlap. As described above, the subject image G is subjected to image processing.
The semi-transparent display mode of the subject image G is a state in which the subject image G is displayed in the middle of transparent and opaque, and the outline of the background image B displayed on the rear side superimposed on the subject image G. In other words, the display mode is such that the color, color, brightness, and the like are transmitted.

Thereby, the image portion of the face image area A in the background image B is preferentially displayed with respect to the subject image G (see FIG. 8).
Note that when the image portion of the face image area A in the background image B is displayed preferentially with respect to the subject image G, the subject image G is subjected to predetermined image processing. However, the present invention is not limited to this. Alternatively, predetermined image processing may be performed on the background image B. Further, as the preferential display mode of the background image B, the semi-transparent display mode of the subject image G has been exemplified, but the present invention is not limited to this. For example, the face image region A of the background image B of the subject image G Display mode in which overlapping portions are cut out, display mode in which the brightness, contrast, color tone, etc. of these images are adjusted so that the face image area A of the background image B is more conspicuous than the subject image G Is mentioned.

  Therefore, according to the imaging device 100 of the first modification, when the face image area A in the background image B is specified as the synthesis area in which the subject image G in the background image B is to be synthesized, the image of the face image area A The portion can be preferentially displayed with respect to the subject image G.

<Modification 2>
When the imaging apparatus 100 according to the second modification synthesizes a continuous shot background image including a plurality of (for example, 20) background images B and the subject image G, the processing unit 8e configures the continuous shot background image. Among the plurality of background images B,..., Predetermined image processing is performed on each of the background images B in which the face image area A is specified as the synthesis area of the subject image G.

Although the continuous shooting background image is not shown in the drawing, from a plurality of background images (frame images) B,... Successively captured at a predetermined imaging frame rate by the lens unit 1, the electronic imaging unit 2, and the imaging control unit 3. Become.
The face detection unit 8b of the image processing unit 8 detects the face image area A by performing face detection processing on each of the plurality of background images B,. Further, the synthesis region specifying unit 8c of the image processing unit 8 specifies a synthesis region in which the subject image G of the subject cutout image in each of the plurality of background images B,.
Then, the region determination unit 8d of the image processing unit 8 includes the synthesis region of the subject image G in each background image B specified by the synthesis region specification unit 8c and the face image region detected from each background image B by the face detection unit 8b. It is determined whether or not (predetermined area) A overlaps. That is, for each background image (component image) B constituting the continuous shot background image, the region determination unit 8d determines whether the face image region (predetermined region) A in the background image B is specified by the composite region specifying unit 8c. Determine whether.

The processing unit 8e determines that the combined region of the subject image G and the face image region (predetermined region) A are overlapped by the region determination unit 8d among the plurality of background images B constituting the continuous shot background image. Predetermined image processing is performed on each of the background images B.
The processing unit 8e performs image processing on the subject image G in addition to image processing on the plurality of background images B,... Constituting the continuous shooting background image as described above, or instead of image processing on each background image B. Predetermined image processing may be performed.

Next, a composite image generation process performed by the imaging apparatus 100 according to Modification 2 will be described with reference to FIG.
FIG. 9 is a flowchart illustrating an example of an operation related to the composite image generation process.

  As shown in FIG. 9, first, in substantially the same manner as in the above-described embodiment, a desired subject cut-out image is selected from a plurality of images recorded on the recording medium 9 based on a predetermined operation of the operation input unit 12 by the user. When selected and designated (step S61), the image processing unit 8 reads out the image data of the designated subject cutout image and develops it in the image memory 5.

Next, based on a predetermined operation of the operation input unit 12 by the user, a desired continuous shooting background image (not shown) as a background of the composite image is selected from a plurality of images recorded on the recording medium 9. When designated (step S62), the image processing unit 8 reads out the image data of the designated continuous shooting background image and develops it in the image memory 5 to obtain the first background image B constituting the continuous shooting background image. Designate (step S63). Further, the image processing unit 8 duplicates the subject cutout image according to the number of continuous shots of the continuous shot background image, and stores the subject cutout image corresponding to each background image B in the image memory 5.
Subsequently, the face detection unit 8b of the image processing unit 8 performs a face detection process on the image data of the first background image B to detect the face image region A from the background image B (step S64).

  Subsequently, when the combination position of the subject image G of the subject cutout image in the first background image B is designated based on a predetermined operation of the selection determination button 12b of the operation input unit 12 by the user (step S65), the image processing unit The composite region specifying unit 8c in FIG. 8 specifies the region in which the subject image G on the first background image B is superimposed as the composite region to be combined with the subject image G of the subject cutout image in the background image B (step S66).

Subsequently, the area determination unit 8d of the image processing unit 8 determines whether or not the face image area A detected by the face detection unit 8b overlaps with the synthesis area of the subject image G specified by the synthesis area specification unit 8c. (Step S67).
If it is determined that the face image area A in the background image B and the composite area of the subject image G overlap (see FIG. 7B) (step S67; YES), the processing unit 8e of the image processing unit 8 is determined. Acquires predetermined image processing content registered in the processing content table T in association with the subject image G (step S68), and performs image processing on the background image B to be processed in accordance with the acquired image processing content. (Step S69).
The specific contents of the image processing are the same as those described in the above embodiment, and a detailed description thereof is omitted.

  Next, the image processing unit 8 determines whether or not the background image B to be processed among the plurality of background images B constituting the continuous shot background image is the first background image B ( Step S70). Even when it is determined in step S67 that the face image area A of the background image B and the composite area of the subject image G do not overlap (step S67; NO), the image processing unit 8 performs the process. The process proceeds to S70 to determine whether or not the background image B to be processed is the first background image B.

When it is determined in step S70 that the background image B to be processed is the first background image B (step S70; YES), the image processing unit 8 determines the selection determination button 12b of the operation input unit 12 by the user. Based on the operation, it is determined whether or not the synthesis position of the subject image G of the subject cutout image in the first background image B has been designated again (step S71).
Here, if it is determined that the composition position of the subject image G has been redesignated (step S71; YES), the image processing unit 8 shifts the processing to step S66 and executes the subsequent processing.
The processing after step S66 is repeatedly performed until it is determined in step S71 that the composition position of the subject image G has not been designated again (step S71; NO).
When it is determined in step S71 that the composition position of the subject image G has not been designated again (step S71; NO), the image composition unit 8f of the image processing unit 8 performs processing on the background image B and the subject. An image synthesis process for synthesizing the clipped image is performed (step S40).

The image composition process is substantially the same as the above embodiment except that the background image B (for example, the first background image B, etc.) designated from the continuous shot background image is executed as a processing target. Omitted.
As a result, a subject composite image P in which the subject image G of the subject cutout image is superimposed on the background image B to be processed (for example, the first background image B) is generated. Note that the generated image data of the subject composite image P is temporarily stored in the image memory 5.

Next, the image processing unit 8 determines whether or not all of the plurality of background images B,... Constituting the continuous shot background image have been processed (step S72).
Here, when it is determined that all the background images B have not been processed (step S72; NO), the image processing unit 8 sets the next background image B (for example, the second background image B) as the processing target. And the processing target is moved to the background image B (step S73). Subsequently, the face detection unit 8b of the image processing unit 8 performs a face detection process on the image data of the background image B to be processed to detect the face image region A from the background image B (step S74), and then performs processing. Is shifted to step S66.

The image processing unit 8 repeats the above processing until it is determined in step S72 that all of the plurality of background images B,... Have been processed (step S72; YES).
Here, when the processing target is designated as the second and subsequent background images B, it is determined in step S70 that the processing target background image B is not the first background image B (step S70; NO). The image processing unit 8 skips the process of step S71, and the image composition unit 8f performs image composition processing for compositing the background image B to be processed and the subject cutout image (step S40).

If it is determined in step S72 that all of the plurality of background images B,... Have been processed (step S72; YES), the display control unit 10 displays the plurality of subject composite images generated by the image composition unit 8f. Based on the image data of P,..., The subject synthesized moving image is displayed on the display screen of the display unit 11 (step S75).
Specifically, the display control unit 10 acquires image data of a plurality of subject composite images P,... From the image memory 5 and switches the plurality of subject composite images P,... At a predetermined display frame rate. When the face image area A of the background image B and the composite area of the subject image G overlap each other by being reproduced and displayed on the display screen 11, the subject image G is added to the background image B subjected to predetermined image processing. Is displayed on the display unit 11, and when the face image area A of the background image B and the composite area of the subject image G do not overlap, the background that has not been subjected to the predetermined image processing The subject composite image P in which the subject image G is superimposed on the image B is displayed on the display unit 11.
Thus, the composite image generation process is finished.

  Therefore, according to the imaging apparatus 100 of the second modification, each of the background images B in which the face image area A is specified as the synthesis area of the subject image G among the plurality of background images B,. Since the predetermined image processing is performed on the background image B, the subject image G is subjected to the predetermined image processing depending on whether the face image area A of the background image B and the composite area of the subject image G are overlapped. The subject composite image P superimposed on the subject image and the subject composite image P superimposed on the background image B that has not been subjected to the predetermined image processing can be switched and displayed, and a novel subject composite moving image is generated. This makes it possible to create a sense of incongruity in the subject synthesized moving image and improve the interest of the subject synthesized moving image.

  In the second modification, a continuous background image including a plurality of background images B,... Is exemplified as the background image B. However, the processing target image is not limited to this, and a plurality of image frames. It may be a moving image including (composition image).

In the above embodiment, when the face image region (predetermined region) A in the background image B is specified as the composite region of the subject image G in the background image B in the composite image generation process, the background image Although predetermined image processing is performed on B and subject image G, the execution timing of image processing is not limited to this.
For example, when the composite region of the subject image G in the background image B is specified, predetermined image processing may be performed on the background image B or the subject image G based on the composite region of the subject image G. good. That is, for example, a still image may be taken with a composition in which a relatively important subject is arranged in the vicinity of the approximate center, but when the composite area of the subject image G is in the vicinity of the approximate center of the background image B, for example. There is a possibility that a relatively important subject in the subject image G and the background image B overlaps each other. Therefore, in consideration of such a case, predetermined image processing may be performed on the background image B or the subject image G based on the synthesis region in which the subject image G in the background image B is to be synthesized.
Further, for example, after the synthesis region of the subject image G in the background image B is specified, when the background image B and the subject image G are actually synthesized in the image synthesis process, the background image B and the subject image G are combined. Then, predetermined image processing may be performed.

Moreover, in the said embodiment, although the face image area | region A was illustrated as a predetermined area | region in the background image B, the kind of predetermined area | region is not restricted to this. For example, an image recognition process is performed on the background image B, and for example, the outline of the pixel set of the main subject is extracted using various information of the image such as color, brightness, contrast, and high frequency component information. The image portion of the main subject may be a predetermined area.
Further, this predetermined area may be set for each subject image G. Taking the processing content table T shown in FIG. 2 as an example, the “exclamation mark” as the subject image G is associated with “make the face image area a surprising expression” as the processing content of the image processing. In addition to this, it is assumed that a “face image area” is associated as a predetermined area. That is, when the composite area of “exclamation mark” overlaps with the face image area in the background image B, the face image area is subjected to the process of “displaying it astonishingly”. In addition, “light” as the subject image G is associated with “dark area” as a predetermined area in addition to “brighten around the synthesis area” as the processing content of the image processing. May overlap with a dark area in the background image B (for example, an area having a luminance equal to or lower than a predetermined value), a process of “brightening around the combined area” may be performed.
Further, the processing content table T may store a processing range of predetermined image processing for the background image B and the subject image G by the processing unit 8e in association with each subject image G.
Further, regardless of the type of the subject image G, the predetermined area in the background image and the processing content may be recorded in association with each other. For example, when “face image area” is stored as the predetermined area and associated with “display the face image area astonishingly” as the processing content, any subject image G can be combined. When the face image area overlaps with the face image area, image processing may be performed so that the face image area is displayed in an astonishing manner.

  Furthermore, in the above embodiment, the subject image G of the subject cutout image is combined with the background image B as a foreground image. However, the type of the foreground image is not limited to this, and is superimposed on the background image B. Any image may be used as long as it is an image to be synthesized.

In the above embodiment, the processing unit 8e performs predetermined image processing on the background image B and the subject image G on the basis of the composite region of the subject image G in the background image B. The standard for image processing is not limited to this.
That is, the processing unit 8e applies predetermined image processing registered in association with the subject image G in the processing content table T (see FIG. 2) to at least one of the background image B and the subject image G. Image processing may be performed.
Even in such a configuration, the subject image G and the background image B are not simply synthesized as in the prior art, but the subject composite image in a novel form in which the subject image G and the background image B are subjected to predetermined image processing. P can be generated, and the interest of the subject composite image P can be improved.

  Furthermore, the configuration of the imaging apparatus 100 is merely an example illustrated in the above embodiment, and is not limited thereto. That is, although the imaging apparatus 100 is illustrated as an image processing apparatus, it is not limited to this. For example, the background image B and the subject image G are generated by an imaging device (not shown) different from the imaging device 100, and the image data transferred from the imaging device is recorded to execute a composite image generation process. An image processing apparatus may be used.

In addition, in the above embodiment, the present invention is realized by driving the synthesis region specifying unit 8c and the processing unit 8e of the image processing unit 8 under the control of the CPU 13. However, the present invention is not limited to this, and a configuration realized by executing a predetermined program or the like by the CPU 13 may be adopted.
That is, a program including a specific processing routine, an image processing routine, and a composition processing routine, or a program including an image processing routine and a composition processing routine is stored in a program memory (not shown) that stores the program. Then, the CPU 13 may be caused to function as a specifying unit that specifies a region where the subject image (foreground image) G in the background image B is to be synthesized by a specifying process routine. Further, the image processing routine causes the CPU 13 to function as an image processing unit that performs a predetermined process on at least one of the foreground image and the background image B based on the region where the foreground image specified by the specifying unit is to be synthesized. May be. Further, the CPU 13 may be caused to function as a synthesis unit that synthesizes the foreground image and the background image on which at least one of the predetermined processing has been performed by the image processing unit by the synthesis processing routine.
Further, the CPU 13 may function as an image processing unit that performs predetermined processing stored in the storage unit in association with the foreground image on at least one of the foreground image and the background image B by the image processing routine. . Further, the CPU 13 may be caused to function as a synthesis unit that synthesizes the foreground image and the background image on which at least one of the predetermined processing has been performed by the image processing unit by the synthesis processing routine.

DESCRIPTION OF SYMBOLS 100 Imaging device 1 Lens part 2 Electronic imaging part 3 Imaging control part 8 Image processing part 8b Face detection part 8c Composite area specific | specification part 8d Area | region determination part 8e Processing process part 8f Image composition part 13 CPU
T processing contents table

Claims (12)

In an image processing apparatus provided with a combining unit that combines a foreground image with a background image,
Specifying means for specifying an area in the background image to be combined with the foreground image;
Image processing means for performing a predetermined process on at least one of the foreground image and the background image based on the region to be combined with the foreground image specified by the specifying means;
With
The image processing apparatus, wherein the synthesizing unit synthesizes the foreground image and the background image that have been subjected to predetermined processing on at least one of the image processing units. Storage means for storing the foreground image and a predetermined process in association with each other;
The image processing means performs the predetermined processing stored in the storage means in association with the foreground image based on the region to be synthesized with the foreground image specified by the specifying means. The image processing apparatus according to claim 1, wherein the image processing apparatus is applied to at least one of the background images. Determination means for determining whether or not a predetermined area in the background image is specified as an area to be combined with the foreground image by the specifying means;
The image processing means performs a predetermined process on at least one of the foreground image and the background image when the determination means determines that a predetermined area in the background image is specified. Or the image processing apparatus of 2.   The image processing unit preferentially displays an image portion of the predetermined region in the background image with respect to the foreground image when the determination unit determines that the predetermined region in the background image is specified. The image processing apparatus according to claim 3, wherein predetermined processing is performed on at least one of the foreground image and the background image. The background image is a continuous image or a moving image composed of a plurality of frame images,
The determination means determines, for each frame image constituting the continuous shot image or moving image, whether or not a predetermined area in the frame image is specified by the specifying means,
The image processing means performs a predetermined process on at least one of the frame image and the foreground image determined to have specified a predetermined area by the determination means among the plurality of frame images. Or the image processing apparatus of 4.   The image processing apparatus according to claim 3, wherein the predetermined area is a face image area detected from the background image. In an image processing apparatus provided with a combining unit that combines a foreground image with a background image,
Storage means for storing the foreground image and predetermined processing in association with each other;
Image processing means for applying the predetermined processing stored in the storage means in association with the foreground image to at least one of the foreground image and the background image;
With
The image processing apparatus, wherein the synthesizing unit synthesizes the foreground image and the background image that have been subjected to predetermined processing on at least one of the image processing units. A specifying unit for specifying a region in the background image to be combined with the foreground image;
The image processing means performs a predetermined process on the background image within a predetermined range from a predetermined area in the background image specified as an area to be synthesized with the foreground image by the specifying means. 8. The image processing apparatus according to 7. Identifying a region in the background image where the foreground image is to be synthesized;
Performing a predetermined process on at least one of the foreground image and the background image based on the region to be combined with the foreground image specified in the step;
And a step of synthesizing the foreground image and the background image that have been subjected to a predetermined process in at least one of the steps. A foreground image and a predetermined process are stored in association with each other in advance, and the predetermined process stored in association with the foreground image is applied to at least one of the foreground image and the background image with which the foreground image is synthesized. Steps,
And a step of synthesizing the foreground image and the background image that have been subjected to a predetermined process in at least one of the steps. The computer of the image processing device
A specifying means for specifying a region in the background image to be synthesized with the foreground image;
Image processing means for performing a predetermined process on at least one of the foreground image and the background image based on the region to be combined with the foreground image specified by the specifying means;
A program that functions as a combining unit that combines the foreground image and the background image that have been subjected to predetermined processing on at least one of them by the image processing unit. A computer of an image processing apparatus having a storage unit that stores a foreground image and a predetermined process in association with each other,
Image processing means for applying the predetermined processing stored in the storage unit in association with the foreground image to at least one of the foreground image and the background image;
A program that functions as a combining unit that combines the foreground image and the background image that have been subjected to predetermined processing on at least one of them by the image processing unit.

Images