JP2011250351A - Imaging apparatus, imaging support method, and imaging support program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate operation for adjusting a range of imaging.SOLUTION: An imaging apparatus comprises: an imaging control unit (S24) which executes imaging operation of imaging a subject and outputting the image; a reference background area extraction unit (S09) which extracts a reference background area expressing a background from a reference image based on the image selected from among the images stored in EEPROM; a target background area extraction unit (S13) which extracts a target background area expressing a background from an image outputted by the imaging control unit; a comparison unit (S15) which compares the reference background area and the target background area; and a reporting unit which reports a comparison result obtained by the comparison unit.

Description

  The present invention relates to an imaging apparatus, an imaging support method, and an imaging support program, and more particularly to an imaging apparatus capable of assisting imaging, an imaging support method executed by the imaging apparatus, and an imaging support program.

  Conventionally, when a person who is a main subject and a photographer take turns to capture a plurality of images with the same background, a technology has been developed to assist the photographer so that the imaging range of the camera is the same. For example, in Japanese Patent Application Laid-Open No. 2005-102263, a predetermined photographing is performed in a camera device including an imaging unit that images a subject and a display unit that displays an image captured by the imaging unit in a shooting standby state as a through image. In the mode, a temporary storage means for temporarily storing a reference image showing a composition of an image captured by the imaging means at the time of temporary shooting prior to the main shooting for recording an image, and a reference image temporarily stored in the temporary storage means. A combination unit configured to combine the images sequentially captured by the imaging unit; and a control unit configured to display the combined image combined by the combination unit on the display unit in a standby state of the main photographing. Is described.

However, in the conventional camera device, when the subject is different between the reference image captured during temporary shooting and the through image, it is difficult to change the imaging range so that the through image overlaps the reference image. There is. For example, if a subject that does not exist at the time of actual imaging is present at the time of provisional imaging, a subject that does not actually exist is displayed as a reference image together with the through image, so which part of the through image should be matched with the reference image It may not be possible to judge. On the other hand, if the subject that exists at the time of actual imaging does not exist at the time of provisional imaging, the background is displayed as the reference image on the subject portion of the through image, so which part of the through image should be matched with the reference image. It may not be possible to judge.
JP 2005-102263 A

  The present invention has been made to solve the above-described problems, and one of the objects of the present invention is to provide an imaging apparatus that facilitates an operation for adjusting the imaging range by the user.

  Another object of the present invention is to provide an imaging support method that makes it easy for a user to adjust the imaging range.

  Still another object of the present invention is to provide an imaging support program that makes it easy for a user to adjust the imaging range.

  In order to achieve the above-described problem, according to an aspect of the present invention, an imaging apparatus selects an imaging unit that performs an imaging operation for imaging a subject and outputs the image, and an image stored in the storage unit. A reference background area extracting means for extracting a reference background area representing a background from a reference image based on the displayed image, and a target background area extracting means for extracting a target background area representing a background from the image output by the imaging means And comparison means for comparing the reference background area and the target background area, and notification means for notifying the comparison result by the comparison means.

  According to this aspect, the reference background region representing the background is extracted from the reference image based on the image selected from the images stored in the storage unit, and the background is represented from the image output by the imaging unit. The target background area is extracted, and a comparison result between the reference background area and the target background area is notified. For this reason, the user can change the imaging range of an image to be captured from now on based on the notified comparison result. As a result, it is possible to provide an imaging apparatus that facilitates an operation for adjusting the imaging range.

  Preferably, the reference background area extracting means includes a reference object area extracting means for extracting a reference object area representing an object from the reference image, and an area including the extracted reference object area and having a predetermined relationship with the reference object area. A reference subject region extracting means for extracting the reference subject region as a reference subject region, extracting a reference subject region from the reference image as a reference background region, and the target background region extracting means from the image output by the imaging means Target object region extracting means for extracting a target object region in which an object is represented; target subject region extracting means for extracting, as a target subject region, a region including the extracted target object region and having a predetermined relationship with the target object region; , And a region obtained by removing the target subject region from the image output by the imaging unit is extracted as a target background region.

  According to this aspect, it is possible to easily extract an area representing the main subject and an area representing the background excluding the main subject from the image.

  Preferably, the comparison unit includes a shift amount detection unit that detects a shift amount between the reference background region and the target background region, and a determination unit that determines whether or not the shift amount satisfies a predetermined condition. If it is determined that the deviation amount does not satisfy the predetermined condition as a result of the discrimination by the discrimination means, the deviation amount is notified.

  According to this aspect, the shift amount between the reference background region and the target background region is detected, and when it is determined that the shift amount does not satisfy the predetermined condition, the shift amount is notified. For this reason, the user can change the imaging range so that the background of the image to be captured matches the background of the stored image according to the notified deviation amount.

  Preferably, the notification unit includes a combined image display unit that combines and displays an image corresponding to the reference background area and an image output by the imaging unit based on the transmittance.

  According to this aspect, the image corresponding to the reference background area and the image output by the imaging unit are combined and displayed based on the transmittance, so that the user can select the image to be captured and the stored image. You can see the background image at the same time.

  According to another aspect of the present invention, an imaging apparatus captures a subject and outputs a reference image based on an image selected from an imaging unit that executes an imaging operation for outputting the image and an image stored in the storage unit A reference subject area extracting means for extracting a reference subject area representing the subject from the image, a target subject area extracting means for extracting a target subject area representing the subject from the image output by the imaging means, and a reference subject from the reference image A reference background region extracting unit that extracts a region excluding the region as a reference background region, a target background region extracting unit that extracts a region excluding the target subject region from the image output by the imaging unit, and a reference background Comparing means for comparing the area with the target background area, and notification means for notifying the comparison result by the comparing means.

  According to this aspect, the reference subject area representing the subject is extracted from the reference image based on the image selected from the images stored in the storage unit, and the subject is represented from the image output by the imaging unit. A target subject region is extracted, a region obtained by removing the reference subject region from the reference image is extracted as a reference background region, a region obtained by removing the target subject region from the image output by the imaging unit is extracted as a target background region, and a reference background is extracted. A comparison result between the area and the target background area is notified. For this reason, the user can change the imaging range of an image to be captured from now on based on the notified comparison result. As a result, it is possible to provide an imaging apparatus that facilitates an operation for adjusting the imaging range.

  Preferably, the comparison means includes a background difference calculation means for calculating a difference between a reference background difference area obtained by removing the target subject area from the reference background area and a target background difference area obtained by removing the reference subject area from the target background area as a background difference. Determining means for determining whether or not the background difference satisfies a predetermined condition.

  Preferably, the comparison means includes a background difference calculation means for calculating a difference between a reference background difference area obtained by removing the target subject area from the reference background area and a target background difference area obtained by removing the reference subject area from the target background area as a background difference. Subject difference calculation means for calculating a difference between areas common to the reference subject area and the target subject area as subject differences, weight difference calculation means for calculating a weighting difference weighted to the background difference and the subject difference, Discriminating means for discriminating whether or not the attached difference satisfies a predetermined condition.

  Preferably, when it is determined that the weighting difference does not satisfy the predetermined condition, the notifying unit combines the image corresponding to the reference background difference region and the image output by the imaging unit based on the transmittance, and displays And a composite image display means.

  Preferably, the reference image is an image stored immediately before in the storage unit.

  Preferably, the reference image is an image selected by the user from among the images stored in the storage unit.

  According to another aspect of the present invention, an imaging support method is an imaging support method executed by an imaging apparatus including an imaging unit that executes an imaging operation of imaging a subject and outputting an image. A step of extracting a reference background region representing a background from a reference image based on an image selected from among the stored images, and a step of extracting a target background region representing a background from the image output by the imaging means And a step of comparing the reference background region and the target background region, and a step of notifying a comparison result in the comparing step.

  According to this aspect, it is possible to provide an imaging support method that facilitates an operation for adjusting the imaging range.

  According to another aspect of the present invention, there is provided an imaging support method executed by an imaging apparatus including an imaging unit that performs an imaging operation of imaging a subject and outputting the image, and the image stored in the storage unit A step of extracting a reference subject area in which a subject is represented from a reference image based on an image selected from among the steps, a step of extracting a target subject region in which the subject is represented from an image output by an imaging unit, and a reference image Extracting a reference background region that is neither the reference subject region nor the target subject region, extracting a target background region that is neither the reference subject region nor the target subject region from the image output by the imaging unit, and a reference background A step of comparing the region with the target background region, and a step of notifying a comparison result in the comparing step.

  According to this aspect, it is possible to provide an imaging support method that facilitates an operation for adjusting the imaging range.

  According to still another aspect of the present invention, the imaging support program is an imaging support program that is executed by a computer that controls an imaging apparatus that includes an imaging unit that performs imaging operation of imaging a subject and outputting the image. Extracting a reference background area representing a background from a reference image based on an image selected from images stored in the storage means, and a target background representing a background from the image output by the imaging means The computer is caused to execute a step of extracting a region, a step of comparing the reference background region and the target background region, and a step of notifying a comparison result in the comparing step.

  According to this aspect, it is possible to provide an imaging support program that facilitates an operation for adjusting the imaging range.

  According to still another aspect of the present invention, the imaging support program is an imaging support program that is executed by a computer that controls an imaging apparatus that includes an imaging unit that performs imaging operation of imaging a subject and outputting the image. Extracting a reference subject area representing the subject from a reference image based on an image selected from the images stored in the storage unit, and a target subject representing the subject from the image output by the imaging unit A step of extracting a region, a step of extracting a reference background region that is neither a reference subject region nor a target subject region from a reference image, and a target that is neither a reference subject region nor a target subject region from an image output by an imaging unit A step of extracting the background region, a step of comparing the reference background region and the target background region, and a step of comparing To execute the step of notifying a comparison result at the flop, to the computer.

  According to this aspect, it is possible to provide an imaging support program that facilitates an operation for adjusting the imaging range.

It is a block diagram which shows the outline of a structure of the digital still camera in one of the embodiments of this invention. It is a functional block diagram which shows an example of the outline | summary of the function of the control part with which the digital still camera in 1st Embodiment is provided with the data memorize | stored in EEPROM. It is a figure which shows an example of a reference background area | region. It is a figure which shows an example of an imaging area. It is a figure which shows an example of a detection area. It is a figure which shows an example of a detailed structure of a motion vector determination part. It is a flowchart which shows an example of the flow of the imaging process in 1st Embodiment. It is a figure which shows an example of a structure of the comparison part in a modification. It is the flowchart which showed an example of the flow of the motion vector calculation process in the modification of 1st Embodiment. It is a functional block diagram which shows an example of the outline | summary of the function of the control part with which the digital still camera in 2nd Embodiment is provided with the data memorize | stored in EEPROM. It is a flowchart which shows an example of the flow of the imaging process in 2nd Embodiment. It is a functional block diagram which shows an example of the outline | summary of the function of the control part with which the digital still camera in the modification of 2nd Embodiment is provided with the data memorize | stored in EEPROM. It is a flowchart which shows an example of the flow of the imaging process in the modification of 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<First Embodiment>
FIG. 1 is a block diagram showing a schematic configuration of a digital still camera according to one embodiment of the present invention. Referring to FIG. 1, a digital still camera 1 includes a control unit 11 that controls the entire digital still camera 1, a lens group 13 that includes a plurality of lenses including a focus lens and a zoom lens, and a lens group 13. A lens driving unit 15 to be driven, an image sensor 19, a codec (CODEC) 21, a signal processing circuit 22 for processing an image, a liquid crystal display (LCD) 23, a program to be executed by the control unit 11, and the like. An EEPROM (Electrically Erasable and Programmable Read Only Memory) 25 to be stored, an SDRAM (Synchronous Dynamic Random Access Memory) 27 used as a work area of the control unit 11, and a memory card 29 are installed. That includes a card interface (I / F) 29, a speaker 31, an operation unit 35 that accepts an operation by a user, the.

  The lens group 13 is provided on the front surface of the digital still camera 1 main body, and the LCD 23 is provided on the back surface of the digital still camera 1 opposite to the surface on which the lens group 13 is provided. The lens group 13 is controlled by the lens driving unit 15 and is focused by moving the focus lens. The lens group 13 has a zoom mechanism that adjusts the zoom lens, and the lens driving unit 15 changes the zoom amount of the lens group 13.

  The image sensor 19 is a photoelectric conversion element such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and its imaging plane is perpendicular to the optical axis of the lens group 13. The image sensor 19 photoelectrically converts an optical image of a subject formed on the imaging surface via the lens group 13 and outputs image data to the control unit 11. The control unit 11 receives image data output from the image sensor 19 and stores the image data in the SDRAM 27. The image data here is, for example, bitmap format data in which one pixel is composed of R (red), G (green), and B (blue). The image sensor 19 is not limited to a CMOS image sensor, and a CCD (Charge Coupled Device) image sensor may be used. In this case, since the CCD image sensor outputs an analog signal, the analog signal output from the CCD image sensor may be converted into digital image data by an analog / digital converter. Here, digital image data output from a CMOS image sensor as a photoelectric conversion element and analog signals output from a CCD image sensor are collectively referred to as an image signal.

  The image sensor 19 is controlled by the control unit 11 to control the time for photoelectric conversion. Specifically, when the control unit 11 causes the image sensor 19 to start photoelectric conversion, the control unit 11 opens a shutter provided between the lens group 13 and the image sensor 19. Thereby, the image sensor 19 starts photoelectric conversion. When the time for photoelectric conversion has elapsed, the control unit 11 closes the shutter and causes the image sensor 19 to output image data.

  The signal processing circuit 22 reads the image data stored in the SDRAM 27, performs various signal processing on the image data, and converts the image data into a color system YUV format represented by a luminance signal and a color difference signal. The signal processing circuit 22 stores YUV format image data in the SDRAM 27.

  The control unit 11 generates an RGB signal from the YUV format image data stored in the SDRAM 27 and outputs the RGB signal to the LCD 23. Thereby, an image output by the image sensor 19 is displayed on the LCD 23. Instead of the LCD 23, an organic EL (ElectroLuminescence) display may be used.

  The codec 21 is controlled by the control unit 11, reads the YUV format image data stored in the SDRAM 27, performs compression encoding, and stores the encoded data obtained by compressing and encoding the image data in the SDRAM 27 or the EEPROM 25. Here, the image data is compression-encoded by the JPEG (Joint Photographic Experts Group) method. Therefore, when the digital still camera 1 captures and records a still image, if the user presses the shutter button 35A, the still image data is stored in the SDRAM 27, and the still image data is compressed by the codec 21 using the JPEG method. After being encoded, JPEG encoded data is stored in the SDRAM 27 or the EEPROM 25.

  The operation unit 35 includes a plurality of buttons including a shutter button 35A for accepting an instruction to start imaging and a mode setting button 35B for accepting an instruction to set an imaging mode, and accepts a user operation. The operation unit 35 may include a touch panel superimposed on the LCD 23.

  The card I / F 29 is loaded with a memory card 29A having a nonvolatile memory. The control unit 11 can access the memory card 29A via the card I / F 29, and stores the encoded data stored in the SDRAM 27 in the memory card 29A or the encoded data stored in the memory card 29A. Data is read out and stored in the SDRAM 27.

  An example in which the imaging support program is stored in the EEPROM 25 will be described. However, the imaging support program is not limited to the EEPROM 25, and the imaging support program stored in the memory card 29A may be executed. Further, the recording medium for storing the imaging support program is not limited to the memory card 29A, but a magnetic tape, a flexible disk, an optical disk (CD-ROM (Compact Disc-Read Only Memory) / MO (Magnetic Optical Disc / MD (Mini Disc)). ) / DVD (Digital Versatile Disc)), IC card (including memory card), optical card, mask ROM, EPROM (Erasable Programmable ROM), and the like.

  The digital still camera 1 according to the present embodiment has a function of assisting an operation for adjusting the imaging range when the second and subsequent images are captured by matching the imaging range with the same background as the image captured in the past. As a situation where the background is the same as the image taken in the past, for example, when taking a group photo, the first situation where the person who operates the digital still camera 1 and the person who is the main subject are interchanged And a second situation where the image is captured in the same background as the background of the image captured at a place that has been visited in the past. The first situation and the second situation differ in the image that matches the background of the image to be captured. Here, the imaging mode for imaging in the first situation is set as the immediately preceding image reference mode, and the imaging mode for imaging in the second situation is set as the past image reference mode. The imaging mode is set to either the previous image reference mode or the past image reference mode when the user operates a mode setting button 35B provided in the operation unit 35.

  FIG. 2 is a block diagram illustrating an example of an outline of functions of the control unit included in the digital still camera 1 according to the first embodiment, together with data stored in the EEPROM. The functions shown in FIG. 2 are realized when the control unit 11 included in the digital still camera 1 executes an imaging support program stored in the EEPROM 25. Referring to FIG. 2, the control unit 11 includes an imaging control unit 61 that controls the image sensor 19, a display control unit 63 that controls the LCD 23, a storage control unit 67, an operation reception unit 65 that receives operations, and an imaging. And an auxiliary portion 69 for assisting.

  When the user half-presses the shutter button 35A included in the operation unit 35, the operation receiving unit 65 outputs a focus instruction to the imaging control unit 61. When the user fully presses the shutter button 35A, the operation receiving unit 65 outputs the imaging instruction to the imaging control unit 61. Output.

  The imaging control unit 61 causes the image sensor 19 to output image data at predetermined time intervals before the imaging instruction is input from the operation accepting unit 65, and displays the image data output by the image sensor 19 as a display control unit 63. And output to the auxiliary unit 69. The display control unit 63 displays the image of the image data input at predetermined time intervals from the imaging control unit 61 on the LCD 23 before the imaging instruction is input from the operation receiving unit 65. An image displayed on the LCD 23 before the imaging instruction is input is referred to as a through image.

  The imaging control unit 61 controls the lens driving unit 15 in response to the input of the focus instruction so that the contrast of the image data output by the image sensor 19 at a predetermined time interval becomes high. The focus is adjusted by adjusting the focus lens, the so-called autofocus function. Note that the method of the autofocus function is not limited to this, and other methods may be used.

  When an imaging instruction is input from the operation receiving unit 65, the imaging control unit 61 controls the lens driving unit 15 and the image sensor 19 to perform photoelectric conversion for an imaging time corresponding to a shutter speed predetermined for the image sensor 19. (Exposure), and image data output by the image sensor 19 is acquired. Specifically, when an imaging instruction is input from the operation receiving unit 65, the imaging control unit 61 fixes the focus lens and is included in the lens group 13 for an imaging time corresponding to a preset shutter speed. The photoelectric conversion by the image sensor 19 is started by opening the shutter. Then, the imaging control unit 61 closes the shutter when the imaging time has elapsed, acquires the image data output by the image sensor 19, and outputs the acquired image data to the display control unit 63 and the storage control unit 67.

  The display control unit 63 displays an image of the image data input from the imaging control unit 61 on the LCD 23 after the operation receiving unit 65 outputs the imaging instruction.

  When the user inputs an instruction to store the image displayed on the LCD 23 to the operation unit 35, the storage control unit 67 converts the image data input from the imaging control unit 61 after the operation reception unit 65 outputs the imaging instruction into the codec. The image data subjected to compression encoding is stored in the EEPROM 25. As a result, the image data 101 is stored in the EEPROM 25.

  When the user operates the mode setting button 35B, the operation receiving unit 65 receives an instruction to set the imaging mode to either the immediately preceding image reference mode or the past image reference mode. When receiving an instruction to set the previous image reference mode, the operation reception unit 65 sets the imaging mode to the previous image reference mode, and when receiving an instruction to set to the past image reference mode, the operation reception unit 65 sets the imaging mode to the past image reference mode. To do.

  The auxiliary unit 69 includes a reference subject region extraction unit 71, a reference background region extraction unit 77, a target subject region extraction unit 79, a target background region extraction unit 85, a comparison unit 87, and a notification unit 93.

  The reference subject area extraction unit 71 extracts a subject area in which the main subject is represented from the image data 101 stored in the EEPROM 25. When the imaging mode is set to the previous image reference mode, the reference subject region extraction unit 71 sets the image data stored last from the image data 101 stored in the EEPROM 25 as the reference image. The image data stored last in the EEPROM 25 is image data captured and stored immediately before. When the imaging mode is set to the past image reference mode, the reference subject region extraction unit 71 sets image data selected by the user from the image data 101 stored in the EEPROM 25 as a reference image.

  The reference subject region extraction unit 71 includes a reference face region detection unit 73 and a reference subject region prediction unit 75. The reference face area detection unit 73 detects a face area from the reference image. The method for detecting the face region may be either a method for detecting based on the color or a method for detecting based on the shape, or a combination thereof. The detection method based on the color is, for example, a method in which a human skin color range is determined in advance, and an area formed by a set of color pixels included in the range is detected as a face area. The method of detecting based on the shape is a method in which a plurality of types of contour patterns of a human face are prepared, and a pattern area that matches the pattern is detected as a face area. When detecting the face area from the reference image, the reference face area detection unit 73 outputs the detected face area to the reference subject area prediction unit 75. When a plurality of face regions are detected from the reference image, the reference face region detection unit 73 outputs the plurality of face regions to the reference subject region prediction unit 75.

  The reference subject region prediction unit 75 extracts a reference subject region from the reference image based on the face region input from the reference face region detection unit 73. Specifically, the reference subject area prediction unit 75 specifies a rectangular area including the face area input from the reference face area detection unit 73 as a rectangular face area. When a plurality of face areas are detected from the reference image, a plurality of rectangular face areas including each of the plurality of face areas are specified. Then, the reference subject region prediction unit 75 extracts a rectangular region obtained by expanding the rectangular face region at a predetermined magnification in each of the horizontal direction and the vertical direction as a reference subject region. Statistically, it is known that the shoulder width of a person is about three times the width of the face and the height of the person is about seven times the vertical direction of the face. Here, the reference subject region prediction unit 75 expands the rectangular face region in the left-right direction by the same horizontal width as the rectangular face region, and expands the region expanded by the horizontal width downward by seven times the vertical direction of the rectangular face region. The determined area is predicted as a reference subject area. When a plurality of face regions are input from the reference face region detection unit 73, the reference subject region prediction unit 75 predicts a plurality of reference subject regions corresponding to each of the plurality of face regions, and the plurality of predicted reference subject regions Is extracted as a reference subject area. The reference subject region prediction unit 75 outputs the reference subject region predicted from the face region in the reference image to the reference background region extraction unit 77.

  FIG. 3 is a diagram illustrating an example of the reference subject area. Referring to FIG. 3, reference subject area 209 includes a first reference subject area 205 and a second reference subject area 207. The first reference subject area 205 includes a first rectangular face area 201, and the second reference subject area 207 includes a second rectangular face area 203. Since the first reference subject region 205 and the second reference subject region 207 are only different in position and size in the image, only the first reference subject region 205 will be described here. The first rectangular face area 201 is specified as a rectangular area including the face area. The first reference subject area 205 is specified based on the first rectangular face area 201. Specifically, a rectangular area is obtained by expanding the first rectangular face area 201 in the left-right direction by the same horizontal width as the face area, and extending the expanded area by a horizontal width by seven times the vertical direction of the face area. It is specified as the first reference subject area 205. The reference subject area 209 is specified as a rectangular area including the first reference subject area 205 and the second reference subject area 207.

  The reference background region extraction unit 77 extracts a region obtained by removing the reference subject region from the reference image as a reference background region, and outputs the extracted reference background region to the comparison unit 87 and the notification unit 93.

  The target subject region extraction unit 79 uses the image data input from the imaging control unit 61 as a target image, and extracts the target subject region from the target image. Since the imaging control unit 61 outputs the image data output by the image sensor 19 at predetermined time intervals to the target subject region extraction unit 79 and the display control unit 63, the same image data as the image data displayed on the LCD 23 by the display control unit 63. Is input to the target subject region extraction unit 79. The target subject region extraction unit 79 may use each of the image data input from the imaging control unit 61 at a predetermined time interval as a target image. However, the target subject region extraction unit 79 thins out the image data input from the imaging control unit 61 at a predetermined time interval. Image data may be used as a reference image.

  The target subject area extraction unit 79 includes a target face area detection unit 81 and a target subject area prediction unit 83. The target face area detection unit 81 detects a face area from the target image. When the target image includes a plurality of face areas, the plurality of face areas are detected. The target face area detection unit 81 outputs the specified face area to the target subject area prediction unit 83.

  The target subject region prediction unit 83 extracts a target subject region from the target image based on the face region detected by the target face region detection unit 81, and outputs the extracted target subject region to the target background region extraction unit 85. . Note that the target subject region prediction unit 83 is different from the processing in which the reference subject region prediction unit 75 extracts the reference subject region from the reference image and the image to be processed, and therefore, description thereof will not be repeated here.

  The target background region extraction unit 85 extracts a region obtained by removing the target subject region from the target image as a target background region, and outputs the extracted target background region to the comparison unit 87.

  The comparison unit 87 compares the reference background region input from the reference background region extraction unit 77 with the target background region input from the target background region extraction unit 85. The comparison unit 87 includes a motion vector determination unit 89 and a determination unit 91.

  The motion vector determination unit 89 calculates a motion vector from the reference background region and the target background region, and outputs the calculated motion vector to the determination unit 91. Although details of the motion vector determination unit 89 will be described later, the motion vector indicates a shift amount between the reference background region and the target background region and a direction of the shift.

  The determination unit 91 determines whether the reference background region and the target background region match based on the motion vector input from the motion vector determination unit 89. Specifically, the determination unit 91 compares the scalar quantity of the motion vector with a predetermined threshold value. If the scalar quantity is equal to or smaller than the predetermined threshold value, the determination unit 91 determines that the backgrounds match and the scalar quantity is If it is larger than the predetermined threshold, it is determined that the backgrounds do not match. The determination unit 91 outputs a coincidence signal to the notification unit 93 when determining that the backgrounds match, and outputs a mismatch signal and a motion vector to the notification unit 93 when determining that the backgrounds do not match. .

  The notification unit 93 receives a match signal or a mismatch signal from the determination unit 91, and receives a motion vector when a mismatch signal is input. The notification unit 93 includes a transmission image generation unit 95, a sound generation unit 97, and a message generation unit 99. The transparent image generation unit 95 receives the reference background region from the reference background region extraction unit 77. When a mismatch signal is input from the determination unit 91, the transmission image generation unit 95 determines a transmittance according to the scalar quantity of the motion vector input together with the mismatch signal, and the reference background of the reference image is determined with the determined transmittance. A transparent image in which the region is transparentized is generated. The transmission image generation unit 95 outputs the generated transmission image to the display control unit 63. When the transmission image is input from the transmission image generation unit 95, the display control unit 63 displays an image obtained by combining the transmission image with the image data input from the imaging control unit 61 on the LCD 23.

  Here, the transmittance indicates the degree of increasing the luminance value of the pixel, and is inversely proportional to the scalar quantity of the motion vector. The greater the scalar quantity of the motion vector, the lower the transmittance, and the smaller the motion vector scalar quantity, the higher the transmittance.

  The reference image is an image captured immediately before when the imaging mode is set to the previous image reference mode, and is an image specified by the user when the imaging mode is set to the past image reference mode. On the other hand, the target image is the same as the through image displayed on the LCD 23. For this reason, when the imaging mode is set to the immediately preceding image reference mode, the transparent image of the background area of the image captured immediately before is combined with the through image and displayed. Furthermore, as the amount of deviation between the background area of the image captured immediately before and the background area of the through image increases, the background area of the image captured immediately before is darker and clearly displayed. The smaller the deviation amount, the lighter the background area of the image captured immediately before. For this reason, the user who operates the digital still camera 1 can view the through image and the transparent image at the same time, and can confirm the shift amount between the two images. Therefore, the user can easily change the imaging range until the through image matches the transmission image. Further, since the transmittance of the reference image changes according to the shift amount, the shift amount can be notified by the luminance of the reference image.

  The sound generation unit 97 generates different sounds depending on whether the coincidence signal is input from the determination unit 91 or the disagreement signal is input. The sound generator 97 generates a first sound to the speaker 31 when a coincidence signal is input from the determination unit 91, and causes the speaker 31 to generate a second sound when a disagreement signal is input. The first sound and the second sound may have different frequencies, may be generated at different times, or may be generated at different times. As a result, the user who hears the first sound can know that the background of the image to be captured is coincident with the background of the reference image, and the user who hears the second sound is about to capture the image. It can be known that the background of the image to be executed does not match the background of the reference image.

  When the coincidence signal is input from the determination unit 91, the message generation unit 99 generates a first message indicating that the backgrounds match, and outputs the generated first message to the display control unit 63. . When the mismatch signal is input from the determination unit 91, the message generation unit 99 generates a second message indicating that the backgrounds do not match, and outputs the generated second message to the display control unit 63. When the first message or the second message is input, the display control unit 63 displays the first message or the second message on the LCD 23.

  Next, the motion vector determination unit 89 will be described. The motion vector determination unit 89 determines a motion vector using a representative point matching method. The representative point matching method compares the pixel values of a plurality of fixed representative points in the reference background region with the pixel values of the sampling points in the detection area including the representative points in the target background region, and the difference is the largest. A sampling point with few correlations is obtained, and a position difference (deviation) between the sampling point and the representative point is specified as a motion vector.

  The representative point matching method will be specifically described. FIG. 4 is a diagram illustrating an example of an imaging area. Referring to FIG. 4, a predetermined range of video area is formed in the imaging area, and four detection blocks A, B, C, and D are provided in this video area. Further, each of the detection blocks A to D is divided into 16 detection areas.

  FIG. 5 is a diagram illustrating an example of the detection area. Referring to FIG. 5, there are a plurality of sampling points in the detection area, and one of the plurality of sampling points is defined as a representative point.

  FIG. 6 is a diagram illustrating an example of a detailed configuration of the motion vector determination unit. Referring to FIG. 6, motion vector determination unit 89 includes a correlation value calculation unit 121, a cumulative addition unit 122, a minimum value detection unit 123, an average value calculation unit 124, and a motion vector generation unit 125.

  The target background area and the reference background area are input to the correlation value calculation unit 121. The correlation value calculation unit 121 calculates the absolute value of the difference between the pixel value of the target background area and the pixel value of the reference background area, that is, the correlation between the representative point and the sampling point shifted from the representative point in the detection area Calculate the value. Correlation value calculation section 121 cumulatively adds correlation values for each sampling point having the same deviation with respect to the representative points in the detection block in cumulative addition section 122. The correlation value calculation unit 121 performs this cumulative addition every four detection blocks.

  The cumulative addition unit 122 outputs the correlation value obtained by cumulative addition for each sampling point for each detection block to the minimum value detection unit 123 and the average value calculation unit 124 as a correlation cumulative value. The minimum value detection unit 123 detects the position of the sampling point having the minimum correlation accumulated value and the minimum value thereof. Further, the average value calculation unit 124 calculates the average of the accumulated correlation values. Then, the obtained minimum position, minimum value, and average value are input to the motion vector generation unit 125.

  The motion vector generation unit 125 detects motion detected from a detection block in which the minimum correlation accumulated value in each detection block is larger than a predetermined threshold and a detection block in which the minimum value / average value is smaller than the predetermined threshold. Remove the vector as unreliable and identify one motion vector from the rest.

  FIG. 7 is a flowchart illustrating an example of a flow of imaging processing according to the first embodiment. The imaging process is a process executed by the control unit 11 when the control unit 11 executes an imaging support program stored in the EEPROM 25. Referring to FIG. 7, control unit 11 branches the process depending on the set imaging mode (step S01). If the imaging mode is set to the previous image reference mode, the process proceeds to step S02. If the imaging mode is set to the past image reference mode, the process proceeds to step S03.

  In step S02, the image captured immediately before is acquired, and the process proceeds to step S06. The image data stored last in the image data 101 stored in the EEPROM 25 is acquired.

  In step S03, a list of file names of the image data 101 stored in the EEPROM 25 is displayed on the LCD 23. In the next step S04, the process waits until an instruction to select a file name is accepted (NO in step S04). When an instruction to select a file name is accepted (YES in step S04), the process proceeds to step S05. In step S05, image data specified by the file name selected in step S04 is acquired, and the process proceeds to step S06.

  In step S06, when the process proceeds from step S02, the image data acquired in step S02 is set as a reference image. On the other hand, when the process proceeds from step S05, the image data selected by the user in step S04 is set as a reference image. Then, a face area is detected from the reference image set in step S06 (step S07), and a reference subject area in which the main subject is represented in the reference image is predicted based on the detected face area (step S08). . Then, an area excluding the reference subject area predicted in step S08 is extracted as a reference background area from the reference image (step S09).

  In step S10, the target image is acquired, and the process proceeds to step S11. Image data output by the image sensor 19 at predetermined time intervals is set as a target image. Then, a face area is detected from the acquired target image (step S11), and a control subject area in which the main subject is represented in the target image is predicted based on the detected face area (step S12). Then, a region excluding the target subject region predicted in step S12 from the target image is extracted as a target background region (step S13).

  In step S14, a motion vector calculation process is executed, and the process proceeds to step S15. The motion vector calculation process is a process of calculating a motion vector from the reference background region extracted in step S08 by the representative point matching method described above and the target background region extracted in step S12.

  In step S15, it is determined whether or not the scalar quantity of the motion vector calculated in step S14 is equal to or less than a threshold value T1. If the scalar quantity of the motion vector is equal to or smaller than threshold value T1, the process proceeds to step S16; otherwise, the process proceeds to step S18.

  In step S16, a first message indicating that the backgrounds match is generated, and the generated first message is displayed on the LCD 23. In the next step S17, the first sound is generated in the speaker 31, and the process proceeds to step S23.

  In step S 18, a second message indicating that the backgrounds do not match is generated, and the generated second message is displayed on the LCD 23. In the next step S19, the speaker 31 is caused to generate the second sound. The second sound is different in frequency from the first sound.

  In step S20, the transmittance U1 is calculated based on the scalar quantity of the motion vector calculated in step S14. Then, using the calculated transmittance U1, a transmission image is generated from the reference background region extracted in step S09 (step S21), and the generated transmission image is superimposed on the through image and displayed on the LCD 23 (step S21). S22), the process proceeds to step S23.

  In step S23, it is determined whether or not the shutter button 35A is fully pressed. If shutter button 35A is fully pressed, the process proceeds to step S24; otherwise, the process returns to step S10.

  In step S24, a still image is captured. In the next step S25, it is determined whether or not the enter button has been pressed. If the determination button is pressed, the process proceeds to step S26. If not, the process returns to step S10. In step S26, the still image captured in step S23 is compressed and stored in the EEPROM 25. In the next step S27, it is determined whether an imaging end instruction has been accepted. If an imaging end instruction is accepted, the imaging process ends. If not, the process returns to step S01.

<Modification>
The digital still camera 1 according to the first embodiment calculates a motion vector using a representative point matching method in order to detect a shift amount between the background region of the target image and the background region of the reference image. . In the digital still camera 1 according to the modified example, the comparison unit 87 is changed to the comparison unit 87A, and the motion vector is calculated by a method different from the representative point matching method. In the following, the differences from the digital still camera 1 in the first embodiment will be mainly described.

  FIG. 8 is a diagram illustrating an example of the configuration of the comparison unit in the modification. Referring to FIG. 8, comparison unit 87A includes target feature point extraction unit 111, reference feature point extraction unit 113, motion vector determination unit 89A, and determination unit 91. The same functions as those shown in FIG. 2 are denoted by the same reference numerals, and description thereof will not be repeated here.

  The target feature point extraction unit 111 extracts feature points in the target background region as target feature points, and outputs the extracted target feature points to the motion vector determination unit 89A. A feature point is a point having a characteristic shape or color in an image, for example, a pixel having a pixel value equal to or greater than a predetermined value, a pixel having a color whose proportion in the image is equal to or less than a predetermined value, It is a pixel that forms a shape, for example, a contour line. Note that the feature point is not limited to one pixel, and may be a feature region including a set of a plurality of pixels having the same feature. Furthermore, it is preferable to extract not only one feature point but also a plurality of feature points. The target feature point extraction unit 111 extracts a feature point existing in the target background region input from the target background region extraction unit 85 as a target feature point, and uses the extracted target feature point as a reference feature point extraction unit 113 and a motion vector. It outputs to the determination part 89A.

  The reference feature point extraction unit 113 receives the reference background region from the reference background region extraction unit 77 and the target feature point from the target feature point extraction unit 111. The reference feature point extraction unit 113 extracts a feature point having the same feature as the target feature point as a reference feature point from the reference background region, and outputs the extracted reference feature point to the motion vector determination unit 89A.

  The motion vector determination unit 89 </ b> A receives the target feature point from the target feature point extraction unit 111 and the reference feature point from the reference feature point extraction unit 113. The motion vector determination unit 89A calculates a motion vector from the target feature point toward the reference feature point, and outputs the calculated motion vector to the determination unit 91.

  FIG. 9 is a flowchart showing an example of the flow of motion vector calculation processing in the modification of the first embodiment. The motion vector calculation process is a process executed in step S14 shown in FIG. Referring to FIG. 9, in step S31, target feature points are extracted from the target background area extracted in step S13 of FIG.

  In the next step S32, a feature point having the same feature as the target feature point extracted in step S31 is extracted as a reference feature point from the reference background region extracted in step S09 in FIG. In step S33, a motion vector from the target feature point extracted in step S31 toward the reference feature point extracted in step S32 is calculated, and the process ends.

<Second Embodiment>
The digital still camera 1 in the first embodiment calculates a motion vector and determines whether or not the background of the target image matches the background of the reference image. The digital still camera 1 according to the second embodiment is configured to determine whether the backgrounds of the two images match based on the difference between the two images. In the following, the differences from the digital still camera 1 in the first embodiment will be mainly described.

  FIG. 10 is a functional block diagram illustrating an example of an outline of functions of a control unit included in the digital still camera according to the second embodiment, together with data stored in the EEPROM. Referring to FIG. 10, the difference from the functional block diagram shown in FIG. 2 is that comparison unit 87 is changed to comparison unit 87B, and transmission image generation unit 95 is changed to transmission image generation unit 95A. . The other functions are the same as those shown in FIG. 2, and therefore description thereof will not be repeated here.

  Comparison unit 87B includes a background difference calculation unit 115 and a determination unit 91A. The background difference calculation unit 115 receives the target subject region from the target subject region prediction unit 83, receives the target background region from the target background region extraction unit 85, receives the reference subject region from the reference subject region prediction unit 75, and references A reference background area is input from the background area extraction unit 77. The background difference calculation unit 115 extracts a reference background difference area obtained by removing the target subject area from the reference background area, and extracts a target background difference area obtained by removing the reference subject area from the target background area. The reference background difference area is an area that is neither the reference subject area nor the target subject area in the reference image. The target background difference area is an area that is neither the reference subject area nor the target subject area in the target image. The background difference calculation unit 115 calculates a difference D1 between the reference background difference region and the target background difference region, and outputs the calculated difference D1 to the determination unit 91A.

  The determination unit 91A compares the difference D1 input from the background difference calculation unit 115 with a predetermined threshold T2, and determines that the backgrounds match if the difference D1 is equal to or less than the predetermined threshold T2. If the difference D1 is greater than a predetermined threshold value T2, it is determined that the backgrounds do not match. When determining that the backgrounds match, the determination unit 91 </ b> A outputs a match signal to the notification unit 93, and when determining that the backgrounds do not match, the determination unit 91 </ b> A outputs a mismatch signal and a difference to the notification unit 93.

  The transparent image generation unit 95A receives the reference background region from the reference background region extraction unit 77. When a mismatch signal is input from the determination unit 91A, the transmission image generation unit 95A determines a transmittance according to the difference input together with the mismatch signal, and transparentizes the reference background region of the reference image with the determined transmittance. A processed transmission image is generated. The transmission image generation unit 95A outputs the generated transmission image to the display control unit 63. When a transmission image is input from the transmission image generation unit 95A, the display control unit 63 displays on the LCD 23 an image obtained by combining the transmission image with the image of the image data input from the imaging control unit 61.

  FIG. 11 is a flowchart illustrating an example of a flow of imaging processing according to the second embodiment. The imaging process is a process executed by the control unit 11A when the control unit 11A executes an imaging support program stored in the EEPROM 25. Referring to FIG. 11, the difference from the imaging processing shown in FIG. 7 is that step S14 is replaced by steps S41 to S43, step S15 is changed to step S15A, and step S20 is changed to step S20A. It is a changed point. Other processing is the same as the processing shown in FIG. 7, and therefore description thereof will not be repeated here.

  In step S41, an area obtained by removing the target subject area predicted in step S12 from the reference background area extracted in step S09 is extracted as a reference background difference area. In the next step S42, an area obtained by removing the reference subject area predicted in step S08 from the target background area extracted in step S13 is extracted as the target background difference area. Then, a difference D2 between the reference background difference area extracted in step S41 and the target background difference area extracted in step S42 is calculated (step S43).

  In the next step S15A, it is determined whether or not the difference D1 calculated in step S43 is equal to or less than a threshold value T2. If difference D1 is equal to or smaller than threshold value T2, the process proceeds to step S16; otherwise, the process proceeds to step S18.

  In step S20A, the transmittance U2 is calculated based on the difference D1 calculated in step S43. Then, using the calculated transmittance U2, a transmission image is generated from the reference background difference area extracted in step S41 (step S21), and the generated transmission image is superimposed on the through image and displayed on the LCD 23 ( Step S22), the process proceeds to step S23.

<Modification>
The digital still camera 1 according to the second embodiment determines whether the background of the target image matches the background of the reference image from the difference D1 between the reference background difference area and the target background difference area. In addition to the difference D1, the digital still camera 1 in the modified example takes into account the difference D2 between the subject area of the reference image and the subject area of the target image, and sets the amount of deviation between the background area of the target image and the background area of the reference image. It was made to detect. In the following, the differences from the digital still camera 1 in the second embodiment will be mainly described.

  FIG. 12 is a functional block diagram illustrating an example of an outline of functions of a control unit included in the digital still camera according to the modification of the second embodiment, together with data stored in the EEPROM. Referring to FIG. 12, the difference from the functional block diagram shown in FIG. 10 is that comparison unit 87B is changed to comparison unit 87C. The other functions are the same as those shown in FIG. 10, and thus description thereof will not be repeated here.

  The comparison unit 87C includes a background difference calculation unit 115, a subject difference calculation unit 117, a weighted difference calculation unit 119, and a determination unit 91A. Since the background difference calculation unit 115 has been described above, description thereof will not be repeated here.

  The subject difference calculation unit 117 receives the target subject region from the target subject region prediction unit 83 and receives the reference subject region from the reference subject region prediction unit 75. The subject difference calculation unit 117 specifies a subject region where the target subject region and the reference subject region overlap, and calculates a difference D2 of the specified subject region. The subject difference calculation unit 117 outputs the calculated subject area difference D2 to the weighted difference calculation unit 119.

  The weight difference calculation unit 119 calculates the weight difference DW based on the subject area difference D2 input from the subject difference calculation section 117 and the background area difference D1 input from the background difference calculation section 115. The weighting difference DW is the sum of a value obtained by multiplying the background region difference D1 by W1 and a value obtained by multiplying the subject region difference D2 by W2. The weighting coefficient W1 is preferably “10” and the weighting coefficient W2 is preferably “3”. The weight difference calculation unit 119 outputs the calculated weight difference DW to the determination unit 91A.

  The determination unit 91A compares the weighting difference DW input from the background difference calculation unit 115 with a predetermined threshold value T3. If the weighting difference DW is equal to or smaller than the predetermined threshold value T3, the backgrounds match. If the weighting difference DW is larger than the predetermined threshold value T3, it is determined that the backgrounds do not match. When determining that the backgrounds match, the determination unit 91 </ b> A outputs a match signal to the notification unit 93, and when determining that the backgrounds do not match, the determination unit 91 </ b> A outputs a mismatch signal and a difference to the notification unit 93.

  FIG. 13 is a flowchart illustrating an example of the flow of an imaging process in a modification of the second embodiment. Referring to FIG. 13, the difference from the imaging process shown in FIG. 11 is that step S15A is changed to step S15B, step S51 and step S52 are added between step S43 and step S15A, And step S20A is the point changed to step S20B. Other processing is the same as the processing shown in FIG. 11, and therefore description thereof will not be repeated here.

  In step S51, a difference D2 between the regions where the reference subject region predicted in step S08 and the target subject region predicted in step S12 overlap is calculated. Then, a weighting difference DW is calculated from the difference D1 calculated in step S43 and the difference D2 calculated in step S51 (step S52). The weighting difference DW is the sum of a value obtained by multiplying the difference D1 by the weighting coefficient W1 and a value obtained by multiplying the difference D2 by the weighting coefficient W2.

  In the next step S15B, it is determined whether or not the weighting difference DW calculated in step S52 is equal to or less than a threshold value T3. If weighting difference DW is equal to or smaller than threshold value T3, the process proceeds to step S16; otherwise, the process proceeds to step S18.

  In step S20B, transmittance U3 is calculated based on the weighting difference DW calculated in step S52, and the process proceeds to step S21. In step S21, a transmission image is generated from the reference background difference area extracted in step S41 using the transmittance U3, and the process proceeds to step S22.

  Note that the digital still camera 1 according to the present embodiment has shown an example in which arbitrary image data is used as a reference image from among a plurality of image data captured and stored in the EEPROM 25. Specifically, when the imaging mode is set to the previous image reference mode, the image data stored last in the EEPROM 25 is used as a reference image, and when the imaging mode is set to the past image reference mode, the EEPROM 25 is stored. Of the stored image data 101, image data selected by the user is used as a reference image. The reference image is not limited to image data captured and stored in the EEPROM 25, but may be image data input from the outside, for example, image data downloaded from a personal computer. In addition, the reference image may not be image data itself but may be an image obtained by enlarging the image and cutting out the enlarged image.

  Furthermore, in the present embodiment, an example is shown in which a person is imaged as a main subject, but a main subject is not limited to a person, and a toy such as a pet or a stuffed toy may be used. In this case, in the present embodiment, when extracting a subject area representing a subject from a reference image or a background image, the face area representing a face is extracted, and a range having a predetermined relationship from the face area is extracted. Was the subject area. When the main subject is a toy such as a pet or a stuffed toy, the characteristics of the toy such as a pet or a stuffed toy, for example, the characteristic color or shape of the main subject may be extracted from the image. .

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

<Appendix>
(1) The imaging device according to any one of claims 3, 6, and 7, wherein the notification unit notifies when it is determined that the reference background region and the target background region match.

DESCRIPTION OF SYMBOLS 1 Digital still camera, 11 Control part, 11A Control part, 13 Lens group, 15 Lens drive part, 19 Image sensor, 21 Codec, 22 Signal processing circuit, 23 LCD, 25 EEPROM, 27 SDRAM, 29 Card I / F, 29A Memory card, 31 speaker, 35 operation unit, 35A shutter button, 35B mode setting button, 41 battery, 61 imaging control unit, 63 display control unit, 65 operation reception unit, 67 storage control unit, 69 auxiliary unit, 71 reference subject area Extraction unit, 73 Reference face region detection unit, 75 Reference subject region prediction unit, 77 Reference background region extraction unit, 79 Target subject region extraction unit, 81 Target face region detection unit, 83 Target subject region prediction unit, 85 Target background region extraction Part, 87, 87A, 87B, 87C comparison part, 89, 89A motion vector determination part 91, 91A determination unit, 93 notification unit, 95, 95A transmission image generation unit, 97 sound generation unit, 99 message generation unit, 101 image data, 111 target feature point extraction unit, 113 reference feature point extraction unit, 115 background difference calculation , 117 subject difference calculation unit, 119 weighted difference calculation unit, 121 correlation value calculation unit, 122 cumulative addition unit, 123 minimum value detection unit, 124 average value calculation unit, 125 motion vector generation unit.

Claims (14)

An imaging means for imaging an object and executing an imaging operation for outputting the image;
Reference background area extraction means for extracting a reference background area representing a background from a reference image based on an image selected from images stored in the storage means;
Target background area extraction means for extracting a target background area representing a background from the image output by the imaging means;
Comparison means for comparing the reference background region and the target background region;
An imaging device comprising: notification means for notifying a comparison result by the comparison means. The reference background area extracting means extracts a reference object area extracting means for extracting a reference object area representing an object from the reference image;
A reference subject region extraction unit that includes the extracted reference object region and extracts a region having a predetermined relationship with the reference object region as a reference subject region,
An area excluding the reference subject area from the reference image is extracted as a reference background area,
The target background area extracting means is a target object area extracting means for extracting a target object area representing an object from the image output by the imaging means;
Target subject region extraction means that includes the extracted target object region, and extracts a region that has a predetermined relationship with the target object region as a target subject region,
The imaging apparatus according to claim 1, wherein an area obtained by removing the target subject area from the image output by the imaging unit is extracted as a target background area. The comparison unit includes a shift amount detection unit that detects a shift amount between the reference background region and the target background region;
Determining means for determining whether or not the deviation amount satisfies a predetermined condition;
The imaging apparatus according to claim 1, wherein the notification unit notifies the shift amount when it is determined that the shift amount does not satisfy a predetermined condition as a result of determination by the determination unit.   The imaging apparatus according to claim 3, wherein the notification unit includes a combined image display unit that combines and displays an image corresponding to the reference background area and an image output by the imaging unit based on transmittance. An imaging means for imaging an object and executing an imaging operation for outputting the image;
Reference subject area extracting means for extracting a reference subject area representing a subject from a reference image based on an image selected from images stored in the storage means;
Target subject area extraction means for extracting a target subject area in which a subject is represented from the image output by the imaging means;
A reference background area extracting means for extracting an area excluding the reference subject area from the reference image as a reference background area;
Target background area extraction means for extracting, as a target background area, an area obtained by removing the target subject area from the image output by the imaging means;
Comparison means for comparing the reference background region and the target background region;
An imaging device comprising: notification means for notifying a comparison result by the comparison means. The comparison means calculates a difference between a reference background difference area obtained by removing the target subject area from the reference background area and a target background difference area obtained by removing the reference subject area from the target background area as a background difference calculation. Means,
The imaging apparatus according to claim 5, further comprising: a determination unit that determines whether the background difference satisfies a predetermined condition. The comparison means calculates a difference between a reference background difference area obtained by removing the target subject area from the reference background area and a target background difference area obtained by removing the reference subject area from the target background area as a background difference calculation. Means,
Subject difference calculation means for calculating a difference between regions common to the reference subject region and the target subject region as a subject difference;
A weighted difference calculating means for calculating a weighted difference weighted to the background difference and the subject difference;
The imaging device according to claim 5, further comprising: a determination unit that determines whether the weighting difference satisfies a predetermined condition.   The notification means, when it is determined that the weighting difference does not satisfy a predetermined condition, combines the image corresponding to the reference background difference area and the image output by the imaging means based on the transmittance, The imaging apparatus according to claim 6, further comprising a composite image display unit for displaying.   The imaging device according to claim 1, wherein the reference image is an image stored immediately before in the storage unit.   The imaging device according to claim 1, wherein the reference image is an image selected by a user from images stored in the storage unit. An imaging support method executed by an imaging apparatus including an imaging unit that performs an imaging operation of imaging a subject and outputting an image,
Extracting a reference background region representing a background from a reference image based on an image selected from images stored in the storage means;
Extracting a target background area representing a background from the image output by the imaging means;
Comparing the reference background region and the target background region;
And a step of notifying a comparison result in the comparing step. An imaging support method executed by an imaging apparatus including an imaging unit that performs an imaging operation of imaging a subject and outputting an image,
Extracting a reference subject area in which a subject is represented from a reference image based on an image selected from images stored in a storage unit;
Extracting a target subject area in which a subject is represented from an image output by the imaging means;
Extracting a reference background area that is neither the reference subject area nor the target subject area from the reference image;
Extracting a target background area that is neither the reference subject area nor the target subject area from the image output by the imaging means;
Comparing the reference background region and the target background region;
And a step of notifying a comparison result in the comparing step. An imaging support program that is executed by a computer that controls an imaging apparatus including an imaging unit that performs an imaging operation of imaging a subject and outputting an image,
Extracting a reference background region representing a background from a reference image based on an image selected from images stored in the storage means;
Extracting a target background area representing a background from the image output by the imaging means;
Comparing the reference background region and the target background region;
An imaging support program for causing the computer to execute a step of notifying a comparison result in the comparing step. An imaging support program that is executed by a computer that controls an imaging apparatus including an imaging unit that performs an imaging operation of imaging a subject and outputting an image,
Extracting a reference subject area in which a subject is represented from a reference image based on an image selected from images stored in a storage unit;
Extracting a target subject area in which a subject is represented from an image output by the imaging means;
Extracting a reference background area that is neither the reference subject area nor the target subject area from the reference image;
Extracting a target background area that is neither the reference subject area nor the target subject area from the image output by the imaging means;
Comparing the reference background region and the target background region;
An imaging support program for causing the computer to execute a step of notifying a comparison result in the comparing step.

Images