JP2008278425A - Image recording apparatus, method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve image recording, with simple configuration, in which a user can easily and intuitively identify a reduced image of a multi-viewpoint image from among reduced images of a photographed image. <P>SOLUTION: A three-dimensional thumbnail image is created by applying three-dimensional (3D) CG processing to a multi-viewpoint image thumbnail image, and a thumbnail image is created from a normal image and recorded correspondingly to a main image. Since 3D CG graphic processing is applied and a 3D effect is applied to a 3D thumbnail image X, a difference from a 2D ordinary thumbnail Y is made clear at a glance and even without using any special device for achieving realistic techniques, an observer is enabled to easily recognize the reduced image of the multi-viewpoint image. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to recording reduced images of multi-view images and single-view images.

  In a general stereoscopic image display system, an image drawn with the right eye as a viewpoint is individually displayed for the right eye, and an image drawn with the left eye as a viewpoint is individually presented for the left eye. Usually, in such two images with the right eye and the left eye as viewpoints (hereinafter referred to as multi-viewpoint images), an object located far from the viewpoint looks almost parallel to both eyes. Since they are almost the same, they are drawn at almost the same position. On the other hand, objects close to the viewpoint are drawn at positions shifted from each other because the lines of sight from both eyes are non-parallel and look different. When an image with such parallax (hereinafter referred to as a parallax image) is viewed with the right eye and the left eye, the observer perceives a sense of perspective with respect to the object.

  With regard to the generation of parallax images, a photorealistic method of photographing a subject using two left and right cameras and viewing the obtained parallax images three-dimensionally using an optical illusion and computer graphics technology are used. In addition, there is a three-dimensional computer graphics (three-dimensional CG) display that generates a parallax image by visual field conversion of model data with the left and right eyes as viewpoints. The three-dimensional computer graphics display is commonly called a virtual three-dimensional display or a pseudo three-dimensional display.

  In the photorealistic method, a parallax image is stereoscopically displayed using a parallax barrier type or lenticular lens type 3D monitor. In the parallax barrier type, a parallax barrier having a pattern in which light transmitting portions and light shielding portions are alternately arranged at a predetermined pitch is generated on the parallax barrier display layer, and left and right images are displayed on the lower image display surface. The strip-shaped image fragments indicating “” are alternately arranged and displayed to enable stereoscopic viewing of the parallax image.

  Alternatively, the realistic method employs a lenticular method using a lenticular lens sheet, an integral photography method using a microlens array sheet, a holography method using an interference phenomenon, and the like.

  In general computer graphics, an object defined in a three-dimensional space is represented by a set of a plurality of polygons. Usually, the simplest triangle is often used as the polygon. Each polygon that composes an object is coordinated from its own object coordinates to three-dimensional coordinates based on the position of the observer's viewpoint, that is, visual field coordinates, using mathematical methods such as vectors and matrices. Conversion is performed. Further, for display on the display device, coordinate transformation (perspective transformation) for perspectively projecting a polygon represented by visual field coordinates onto a two-dimensional plane is performed. The final polygon position data after these series of coordinate transformations is performed, the Z value indicating the distance from the viewpoint in the direction perpendicular to the display (Z axis), and the position coordinates in the display surface X value and Y value representing

  Regarding the method for determining the color values of the pixels constituting each polygon, a virtual light source is arranged at the visual field coordinates, and the intensity of light emitted from this light source to each vertex constituting the polygon is physically calculated. There is a method of obtaining the light intensity at each pixel position by linear interpolation from the values in the rasterizing process in the polygon.

  Alternatively, as disclosed in Patent Document 1, there is a method of pasting an image representing a texture or special pattern of an object surface called a texture on a polygon surface. In this case, texture coordinates in addition to position coordinates are given to each vertex of the polygon constituting the object at the stage of object coordinates before coordinate conversion. As in the case of the light intensity described above, the texture coordinates are linearly interpolated for each pixel position in the polygon rasterization process, and the pixel color value is determined according to the obtained texture coordinates.

  A graphics image viewed from a specific viewpoint can be generated by the above procedure, but in order to generate a parallax image for stereoscopic viewing as described above, the viewpoint position is set to the right eye and the left eye. A multi-viewpoint image is generated by drawing the same object twice, replacing each position of the eye. An expensive system includes a display device capable of realizing the above-described realistic technique, and generates a multi-viewpoint image.

  On the other hand, conventionally, when a multi-viewpoint image and a normal image without parallax are mixed and stored in a storage device, there is a technique for displaying these reduced images in a distinguishable manner. The electronic device disclosed in Patent Document 2 includes a display device that can realize a photorealistic technique. When displaying a list of thumbnail images in a planar manner, a symbol “3D” is added to a thumbnail image corresponding to a three-dimensional image. In addition, the thumbnail image corresponding to the two-dimensional image is represented by a circle or an ellipse, and the symbol “2D” is added, and the thumbnail image is represented by a triangle, the thumbnail created from the two-dimensional image and the thumbnail created from the three-dimensional image Can be distinguished.

Conventionally, an imaging method has been proposed that increases the stereoscopic effect even when a subject is present at a long distance. For example, according to Patent Document 3, a camera unit is provided at both ends of an open housing, and the effect of a stereoscopic image is enhanced even at a long distance.
JP 2002-24850 A JP 2004-120165 A JP 2003-51872 A

  In Patent Document 2, 2D images and 3D image thumbnails are represented by symbols such as “3D” and “2D”, and shapes such as a circle, an ellipse, and a triangle. Hard to do.

  Further, in Patent Document 2, it is essential to arrange a display device that can display a three-dimensional image by a realistic method, and display switching between a two-dimensional image and a three-dimensional image is essential. There is a disadvantage that the cost becomes high.

  In particular, in a portable device such as a digital camera, forcing the arrangement of such a special display device is very problematic in terms of securing portability and reducing production costs.

  Further, Patent Document 3 has a problem that a stereoscopic effect cannot be imparted to a subject at infinity.

  Therefore, the present invention realizes image recording with a simple configuration that allows a user to easily and intuitively identify a reduced image of a multi-viewpoint image from reduced images of a captured image. The present invention also prevents the recording of meaningless multi-viewpoint images that do not produce a stereoscopic effect.

  An image recording apparatus according to the present invention includes a photographing unit capable of photographing a multi-view image photographed from two or more viewpoints and an image including a single viewpoint image photographed from a single viewpoint, and the multi-viewpoint photographed by the photographing unit. A main image storage unit that stores a main image that is an image or a single-viewpoint image, an image identification unit that identifies whether the main image stored in the main-image storage unit is a multi-viewpoint image or a single-viewpoint image, By creating a first reduced image obtained by reducing the image and performing a three-dimensional computer graphic process on the first reduced image created from the main image identified by the image identification unit as a multi-viewpoint image, An image processing unit that creates a second reduced image, and a reduction that stores the first reduced image or the second reduced image created by the image processing unit in accordance with the identification of the multi-viewpoint image or single-viewpoint image by the image identification unit Image storage and reduced image storage And a recording unit for recording in association with the main image stored in the first reduced image or the second reduced image and the image storage unit stored in the part.

  According to this invention, a reduced image subjected to three-dimensional computer graphic processing is recorded as a reduced image of a multi-viewpoint image, and a simple reduced image is recorded as a reduced image of a single-viewpoint image in association with the main image. Since the reduced image of the multi-viewpoint image has been subjected to three-dimensional computer graphic processing, the difference from the simple reduced image can be seen at a glance. Further, it is not necessary to use a special realistic method for displaying a reduced image of a multi-viewpoint image, and the apparatus configuration can be inexpensive.

  The image recognition unit further includes a face detection unit that detects the presence or absence of the subject face area from the main image identified as a multi-viewpoint image, and the image processing unit detects the first reduced image from the face detection unit. A second reduced image may be created by setting an area corresponding to the subject face area and performing three-dimensional computer graphic processing on the set area.

  Here, three-dimensional computer graphic processing is performed only on the important part of the face, and a substantial pseudo three-dimensional reduced image can be recorded with a small amount of processing.

  An image recording apparatus according to the present invention includes a photographing unit capable of photographing a multi-view image photographed from two or more viewpoints and an image including a single viewpoint image photographed from a single viewpoint, and the multi-viewpoint photographed by the photographing unit. A main image storage unit that stores a main image that is an image or a single-viewpoint image, an image identification unit that identifies whether the main image stored in the main image storage unit is a multi-viewpoint image or a single-viewpoint image, and an image For an image identified by the identification unit as a multi-viewpoint image, a flash emission identification unit that identifies the presence or absence of flash emission at the time of shooting, and an image identification unit identified as a single-viewpoint image or a flash emission identification unit An image processing unit for creating a first reduced image obtained by reducing the main image identified as having no flash emission at the time, an image identification unit identifying a multi-viewpoint image, and a flash emission identification unit having flash emission A sample reduced image acquisition unit that acquires a predetermined sample reduced image subjected to three-dimensional computer graphics as a second reduced image corresponding to the separate main image, and identification of a multi-viewpoint image or a single-viewpoint image by the image identification unit; A reduced image storage unit that stores the first reduced image created by the image processing unit or the second reduced image acquired by the sample reduced image acquisition unit according to the identification of the presence or absence of flash emission during shooting by the flash emission identification unit And a recording unit that records the first reduced image or the second reduced image stored in the reduced image storage unit and the main image stored in the main image storage unit in association with each other.

  According to the present invention, a predetermined sample reduced image that has been subjected to three-dimensional computer graphic processing as a reduced image of a multi-viewpoint image that was flashed at the time of shooting is a single-viewpoint image or a multi-viewpoint image that was not flashed at the time of shooting. As the reduced image, a simple normal reduced image is recorded in association with the main image.

  Since the sample reduced image of the multi-viewpoint image that has flash emission at the time of shooting is subjected to three-dimensional computer graphic processing, the difference between the simple reduced image or the reduced image of the multi-viewpoint image without flash emission at the time of shooting can be seen at a glance. In addition, it is not necessary to use a special photorealistic method for displaying a reduced image of a multi-viewpoint image, and it is not necessary to perform a three-dimensional computer graphic process for each photographing.

  An image recording apparatus according to the present invention includes a photographing unit capable of photographing a multi-view image photographed from two or more viewpoints and an image including a single viewpoint image photographed from a single viewpoint, and the multi-viewpoint photographed by the photographing unit. A main image storage unit that stores a main image that is an image or a single-viewpoint image, an image identification unit that identifies whether the main image stored in the main image storage unit is a multi-viewpoint image or a single-viewpoint image, and an image For an image identified by the identification unit as a multi-viewpoint image, a face detection unit that detects the presence or absence of the subject face region, and whether the image identification unit identified as a single-viewpoint image or the face detection unit detected the subject face region An image processing unit that creates a first reduced image obtained by reducing the main image that has not been performed, and a second image corresponding to the main image that the image identification unit identifies as a multi-viewpoint image and the face detection unit detects the subject face area. 3D computer graphics as reduced image A sample reduced image acquisition unit that acquires a predetermined sample reduced image subjected to a mark, an image according to whether a multi-viewpoint image or a single-viewpoint image is identified by an image identification unit, and whether a subject face area is detected by a face detection unit A reduced image storage unit that stores the first reduced image created by the processing unit or the second reduced image acquired by the sample reduced image acquisition unit, and the first reduced image or the second reduced image stored in the reduced image storage unit And a recording unit that records the reduced image and the main image stored in the main image storage unit in association with each other.

  According to the present invention, a predetermined sample reduced image subjected to three-dimensional computer graphic processing as a reduced image of a multi-view image having a subject face area is a single-view image or a reduced image of a multi-view image having no subject face area. For example, a simple reduced image is recorded in association with the main image.

  Since the sample reduced image of the multi-viewpoint image having the subject face area has been subjected to three-dimensional computer graphic processing, the difference between the simple reduced image or the reduced image of the multi-viewpoint image that did not emit flash at the time of shooting can be seen at a glance. In addition, it is not necessary to use a special photorealistic method for displaying a reduced image of a multi-viewpoint image, and it is not necessary to perform a three-dimensional computer graphic process for each photographing.

  An image recording apparatus according to the present invention includes a photographing unit capable of photographing a multi-view image photographed from two or more viewpoints and an image including a single viewpoint image photographed from a single viewpoint, and the multi-viewpoint photographed by the photographing unit. A main image storage unit that stores a main image that is an image or a single-viewpoint image, an image identification unit that identifies whether the main image stored in the main image storage unit is a multi-viewpoint image or a single-viewpoint image, and an image A distance identifying unit that identifies whether the subject in the image identified by the identifying unit as a multi-viewpoint image is at a long distance or a short distance, and a first reduced image obtained by reducing the main image, and a plurality of image identifying units A second reduced image is obtained by performing three-dimensional computer graphic processing on the first reduced image created from the main image that has been identified as the viewpoint image and the distance identifying unit has identified that the subject is at a short distance. Image processing unit that creates A reduced image storage unit that stores the first reduced image or the second reduced image created by the image processing unit according to the identification of the multi-viewpoint image or single-viewpoint image by the unit and the identification of the distance of the subject by the distance identification unit; A recording unit that records the first reduced image or the second reduced image stored in the reduced image storage unit and the main image stored in the main image storage unit in association with each other.

  According to the present invention, since the three-dimensional computer graphic processing is performed only on the multi-viewpoint image having the subject at a short distance, the processing is not performed on the meaningless image even when the subject is at a long distance. I'll do it.

  The recording unit may record only the main image that the distance identifying unit has identified as being close to the main image that the image identifying unit has identified as a multi-viewpoint image.

  In this way, it is not necessary to record a multi-viewpoint image in which the subject is at a long distance of a predetermined distance or more and a stereoscopic effect is hardly generated, or a multi-viewpoint image in which a stereoscopic effect is not generated at all, and meaningless image recording can be prevented.

  You may further provide the notification part which notifies the warning that the image identification part identifies that it is a multi-viewpoint image, and the distance identification part identifies that a to-be-photographed object is a long distance not to record.

  In this way, the user can recognize that the subject is at a long distance and a multi-viewpoint image that does not easily generate a stereoscopic effect is not recorded.

  An image recording method according to the present invention includes a step of capturing an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint, and the captured multi-viewpoint image or single-viewpoint image. And a step of identifying whether the stored main image is a multi-viewpoint image or a single-viewpoint image, creating a first reduced image obtained by reducing the main image, Performing a three-dimensional computer graphic process on the first reduced image created from the main image identified as the viewpoint image to create a second reduced image; Depending on the identification, the step of storing the created first reduced image or second reduced image and the stored first reduced image or second reduced image and the stored main image are recorded in association with each other. The Tsu including and up, the.

  In this image recording method, a step of detecting the presence / absence of a subject face region from a main image identified as a multi-viewpoint image, and a region corresponding to the detected subject face region are set for the first reduced image. And a step of creating a second reduced image by performing a three-dimensional computer graphic process on the set area.

  The image recording method according to the present invention includes a step of not capturing an image including a multi-view image captured from two or more viewpoints and a single-view image captured from a single viewpoint, and the captured multi-view image or single viewpoint. A step of storing a main image that is an image, a step of identifying whether the stored main image is a multi-viewpoint image or a single-viewpoint image, and a flash at the time of shooting for an image identified as a multi-viewpoint image A step of identifying the presence or absence of light emission, a step of creating a first reduced image obtained by reducing the main image that has been identified as a single-viewpoint image or identified as having no flash emission at the time of photographing, and a multi-viewpoint image In addition, a step of acquiring a predetermined sample reduced image subjected to three-dimensional computer graphics as a second reduced image corresponding to the main image identified as having flash emission. And storing the first reduced image or the second reduced image according to the identification of the multi-viewpoint image or single-viewpoint image and the presence / absence of flash emission at the time of shooting, and the stored first reduction Recording the image or the second reduced image and the stored main image in association with each other.

  An image recording method according to the present invention includes a step of capturing an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint, and the captured multi-viewpoint image or single-viewpoint image. A main image that is stored, a step of identifying whether the stored main image is a multi-view image or a single-view image, and whether or not there is a subject face area for the image identified as a multi-view image A first reduced image obtained by reducing a main image that has been identified as a single-viewpoint image or has not detected a subject face area, and identified as a multi-viewpoint image and subject face area Obtaining a predetermined sample reduced image subjected to three-dimensional computer graphics as a second reduced image corresponding to the main image in which the image is detected; and a multi-viewpoint image or a single-viewpoint image Storing the first reduced image or the second reduced image according to whether the subject face area is detected or not, and the stored first reduced image or the second reduced image and the main image stored And associating and recording.

  An image recording method according to the present invention includes a step of capturing an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint, and the captured multi-viewpoint image or single-viewpoint image. Storing the main image, identifying whether the stored main image is a multi-view image or a single-view image, and the subject in the image identified as the multi-view image is a long distance or a short distance A first reduced image obtained by reducing the main image, a first reduced image that is identified as a multi-viewpoint image, and that the subject is identified as being at a short distance is created. The first reduction is performed in accordance with the step of creating a second reduced image by performing three-dimensional computer graphic processing on the reduced image, identification of the multi-viewpoint image or single-viewpoint image, and identification of the distance of the subject. Picture Or comprising a step of storing the second reduced image, a step of association records the first reduced image or the second reduced image with the stored present image stored, the.

  In this image recording method, it is preferable to record only the main image that is identified as being close to the main image that is identified as a multi-viewpoint image.

  Further, it is preferable that the method further includes a step of displaying a warning that the main image identified as a multi-viewpoint image and the subject identified as being at a long distance is not recorded.

  A program for causing a computer to execute the above image recording method is also included in the present invention.

  According to the present invention, as a reduced image of a multi-viewpoint image, a reduced image that has been subjected to three-dimensional computer graphic processing, and more preferably, a reduced image that has been subjected to three-dimensional computer graphic processing on the subject face area corresponds to the main image. Is recorded. On the other hand, a simple reduced image is recorded in association with the main image as a reduced image of a single viewpoint image, a multi-view image in which no face is detected, or a multi-view image in which the subject is at a long distance. Since the reduced image of the multi-viewpoint image is subjected to three-dimensional computer graphic processing, the difference between the reduced image of the multi-viewpoint image and the reduced image of the single-viewpoint image can be seen at a glance. Further, it is not necessary to use a special realistic method for displaying a reduced image of a multi-viewpoint image, and the apparatus configuration can be inexpensive.

<First Embodiment>
FIG. 1 shows an electrical configuration of the compound eye camera 1. The lens optical axes L1 and L2 of the first and second imaging units 2a and 2b are arranged in parallel so as to be parallel or at a predetermined angle.

  The first imaging unit 2a includes a first zoom lens 11a, a first diaphragm 12a, a first focus lens 13a, and a first image sensor 14a arranged along the lens optical axis L1. A diaphragm control unit 16a is connected to the first diaphragm 12a, and a timing generator (TG) 18a is connected to the first image sensor 14a. The operations of the first aperture 12a and the first focus lens 13a are controlled by the photometric distance measuring CPU 19a. The operation of the TG 18a is controlled by the main CPU 62.

  The camera 1 is provided with an operation unit 70 for performing various operations when the user uses the camera 1. The operation unit 70 includes a power switch for turning on the power for operating the camera 1, a mode dial for selecting stereoscopic (3D) shooting, plane (2D) shooting, auto shooting, manual shooting, and various menus. A cross key for setting, selecting or zooming, a flash emission switch, and an information position specifying key for executing or canceling a menu selected by the cross key. By appropriately operating the operation unit 70, turning on / off the power, switching between various modes (shooting mode, reproduction mode, etc.), zooming, and the like are performed.

  Further, the camera 1 includes a main CPU 62, an EEPROM 146, a YC / RGB conversion unit 147, and a display driver 148. The main CPU 62 controls the entire camera 1. The EEPROM 146 stores solid data and programs unique to the camera 1.

  The YC / RGB conversion unit 147 converts the color video signal YC generated by the YC processing units 35a and 35b into RGB signals of three colors and outputs them to the image display LCD 10 via the display driver 148.

  In response to a zoom operation from the input operation unit 9, the first zoom lens 11a moves along the lens optical axis L1 to the NEAR side (feeding side) or the INF side (retraction side) to change the zoom magnification. This movement is driven by a motor (not shown). The aperture 12a performs exposure adjustment by changing the aperture value (aperture value) during AE (Auto Exposure) operation to limit the light flux. The focus lens 13a is moved to the NEAR side or the INF side along the lens optical axis L1 during AF (Auto Focus) operation to change the focus position and perform focus adjustment. This movement is driven by a motor (not shown).

  When the half-pressed state of the still image release switch 5a is detected, the main CPU 62 obtains distance measurement data from the distance image sensors 51a and 51b. The main CPU 62 adjusts focus, aperture, etc. based on the obtained distance measurement data.

  The first image sensor 14a receives subject light imaged by the first zoom lens 11a, the first diaphragm 12a, and the first focus lens 13a, and accumulates photocharges corresponding to the amount of received light in the light receiving element. The photoelectric charge accumulation / transfer operation of the first image sensor 14a is controlled by the TG 18a, and the electronic shutter speed (photo charge accumulation time) is determined by the timing signal (clock pulse) input from the TG 18a. The first image sensor 14a acquires an image signal for one screen every predetermined period in the photographing mode.

  The second image pickup unit 2b has the same configuration as the first image pickup unit 2a, and is a second image in which the second zoom lens 11b, the second diaphragm 12b, the second focus lens 13b, and the timing generator (TG) 14b are connected. It is configured by the sensor 14b. These operations are controlled by the main CPU 62. The first imaging unit 2a and the second imaging unit 2b basically operate in conjunction with each other, but can also be operated individually. A CCD type or CMOS type image sensor is used as the first and second image sensors 14a and 14b.

  The imaging signals output from the first and second image sensors 14a and 14b are input to the A / D converters 30a and 30b, respectively. The A / D converters 30a and 30b convert the input image data from analog to digital. Through the A / D converters 30a and 30b, the imaging signal of the first image sensor 14a is first image data (right-eye image data), and the imaging signal of the second image sensor 14b is second image data (left-eye image). Data).

  The image signal processing circuits 31a and 31b respectively perform various image processing such as gradation conversion, white balance correction, and γ correction processing on the first and second image data input from the A / D converters 30a and 31b. The buffer memories 32a and 32b temporarily store the first and second image data subjected to various image processing by the image signal processing circuits 31a and 31b.

  The photometry / ranging CPUs 19a and 19b calculate AF evaluation values and AE evaluation values from the first and second image data stored in the buffer memories 32a and 32b, respectively. The AF evaluation value is calculated by integrating high-frequency components of the luminance value for the entire area or predetermined area (for example, the central portion) of each image data, and represents the sharpness of the image. The high-frequency component of the luminance value is a sum of luminance differences (contrast) between adjacent pixels in a predetermined area. In addition, the AE evaluation value is calculated by integrating the luminance values over the entire area or a predetermined area (for example, the central portion) of each image data, and represents the brightness of the image. The AF evaluation value and the AE evaluation value are respectively used in an AF operation and an AE operation that are executed during an imaging preparation process described later.

  The image data stored in the buffer memories 32a and 32b is converted into luminance signals (Y signals) and color difference signals (Cr and Cb signals) by YC processing units 35a and 35b, respectively, and predetermined processing such as gamma correction is performed. Applied. The processed YC signals are stored in the work memories 128a and 128b, respectively.

  The YC signals of the first and second image data stored in the work memories 128a and 128b are read by the controller 34 to the YC / RGB conversion unit 147, respectively. The YC / RGB converter 147 converts the YC signal of the first and second image data into a predetermined format video signal (for example, an NTSC color composite video signal), and then performs stereoscopic display on the image display LCD 10. To the stereoscopic image data. When the LCD 10 is used as an electronic viewfinder in the shooting mode, the stereoscopic image data synthesized by the YC / RGB conversion unit 147 is displayed on the LCD 10 as a through image via the LCD driver 148.

  The compression / decompression processing circuits 36a and 36b respectively apply JPEG for still images, MPEG2, MPEG4, H.264 for moving images to the first and second image data stored in the work memories 128a and 128b, respectively. Compression processing is performed according to a predetermined compression format such as H.264. The media controller 37 records each image data compressed by the compression / decompression processing circuits 36 a and 36 on a memory card 38 or other recording media connected via the I / F 39.

  When the first and second image data recorded in the memory card 38 in this way are reproduced and displayed on the LCD 10, each image data in the memory card 38 is read by the media controller 37, and the compression / decompression processing circuits 36a and 36 are used. The YC / RGB conversion unit 147 converts the image data into stereoscopic image data, and then displays the reproduced image on the LCD 10 via the LCD driver 148.

  The LCD 10 is a normal flat monitor that does not employ a photorealistic technique. The LCD 10 is used as an electronic viewfinder at the time of image shooting, and displays image data obtained by shooting at the time of image reproduction.

  The main CPU 62 comprehensively controls the overall operation of the compound eye camera 1. In addition to the release switches 5a and 5b and the operation unit 70, the main CPU 62 is connected to an EEPROM 146 which is a nonvolatile memory. The EEPROM 146 stores various control programs and setting information. The main CPU 62 executes various processes based on this program and setting information.

  In addition, an optical system control instruction unit 127 is connected to the main CPU 62, and the imaging magnifications of the first imaging unit 2a and the second imaging unit 2b are changed according to a zoom operation to the optical system control instruction unit 127. .

  The release switches 5a and 5b have a two-push switch structure. When the release switches 5a and 5b are lightly pressed (half-pressed) during the shooting mode, an AF operation and an AE operation are performed, and shooting preparation processing is performed. In this state, when the release switches 5a and 5b are further pressed (fully pressed), shooting processing is performed, and the first and second image data for one screen are transferred from the frame memory 32 to the memory card 38 and recorded. Is done.

  In the AF operation, the main CPU 62 controls the first and second focus lenses 13a and 13b and moves them in predetermined directions, respectively, and the AF evaluation value calculated from each of the first and second image data obtained sequentially. This is done by finding the maximum value. In the AE operation, after the AF operation is completed, the aperture values of the first and second apertures 12a and 12b and the electronic shutter speeds of the first and second image sensors 14a and 14b are calculated based on the calculated AE evaluation values. This is done by setting.

  In addition, the camera 1 is provided with an operation LCD display 103 for assisting the operation.

  Further, the camera 1 has a configuration in which the power supply battery 68 is detachable. The power battery 68 is composed of a rechargeable secondary battery such as a nickel-cadmium battery, a nickel metal hydride battery, or a lithium ion battery. The power supply battery 68 may be a single-use primary battery such as a lithium battery or an alkaline battery. The power supply battery 68 is electrically connected to each circuit of the camera 1 by being loaded into a battery storage chamber (not shown).

  The first imaging unit 2a and the second imaging unit 2b are respectively provided with an interval / convergence angle detection circuit 4a, 4b for detecting an interval / convergence angle between the first imaging unit 2a and the second imaging unit 2b, and an interval / congestion. Lens interval / convergence angle storage circuit 6 for storing the angle of convergence detected by the angle detection circuits 4a and 4b, and interval / convergence angle drive circuits 3a and 3b for changing the convergence by rotating the optical axis with a drive motor or the like by changing the baseline length. And are provided.

  Further, the camera 1 includes an interval / convergence angle control circuit 5 that controls changes in the convergence angle of the interval / convergence angle driving circuits 3a and 3b based on the intervals / convergence angles detected by the interval / convergence angle detection circuits 4a and 4b. Is provided.

  The charge / light emission control units 138a and 138b are supplied with electric power from the power supply battery 68 in order to cause the strobes 44a and 44b to emit light, respectively, and charge a flash light emitting capacitor (not shown) or emit light from the strobes 44a and 44b. Control.

  The charge / light emission control units 138a and 138b receive various signals such as half-press and full-press operation signals of the release switches 5a and 5b, and signals indicating the light emission amount and the light emission timing from the main CPU 62 and the photometry / ranging CPUs 19a and 19b. In response to the capture, current supply control to the strobes 44a and 44b is performed so that a desired light emission amount can be obtained at a desired timing.

  The vertical / horizontal shooting switching button 40 is a button for instructing whether to perform vertical shooting or horizontal shooting. The vertical / horizontal shooting detection circuit 166 detects whether shooting is performed in vertical shooting or horizontal shooting depending on the state of this button.

  The 2D / 3D mode switching flag 168 is set with a flag indicating the 2D mode or the 3D mode according to the setting operation of the 3D shooting mode / 2D shooting mode.

  The distance light-emitting elements 52a and 52b are each composed of a light-emitting diode (LED) for irradiating a projection spot to the same subject captured by the first imaging unit 2a and the second imaging unit 2b.

  The distance image pickup devices 51a and 51b are image pickup devices dedicated to distance measurement that acquire subject images irradiated with the light projection spots by the distance light emitting devices 52a and 52b, respectively.

  The distance driving / control circuit 54 performs control to synchronize the light emission timings of the distance light emitting elements 52a and 52b with the distance imaging elements 53a and 53b.

  Analog image signals obtained by the imaging operations of the distance imaging elements 53a and 53b are converted into digital image data by the distance measurement A / D conversion units 55a and 55b, respectively, and are output to the distance information processing circuit 57.

  The distance information processing circuit 57 calculates the distance from the input digital image data to the subject captured by the first imaging unit 2a and the second imaging unit 2b. This is based on the principle of so-called triangulation. The distance information calculated by the distance information processing circuit 57 is stored in the distance information storage circuit 58.

  The face detection unit 150 detects a face area that is an area including the face portion of the person who is the subject from the image data stored in the buffer memory 32 a or the buffer memory 32 b or the image data stored in the buffer memory 42.

  The method for detecting the face area is not particularly limited, and various methods can be adopted. For example, the technique disclosed in Japanese Patent Application Laid-Open No. 9-101579 by the present applicant can be applied. This technology determines whether or not the hue of each pixel of the captured image is included in the skin color range and divides it into a skin color region and a non-skin color region, and detects edges in the image to detect each pixel in the image. The location is classified as an edge portion or a non-edge portion. Then, an area surrounded by pixels that are located in the skin color area and classified as a non-edge part and surrounded by pixels that are determined to be edge parts is extracted as a face candidate area, and the extracted face candidate area becomes a human face. It is determined whether the region is a corresponding region, and is detected as a face region based on the determination result. In addition to this, a face region can also be detected by a method described in Japanese Patent Application Laid-Open Nos. 2003-209683 and 2002-199221.

  The multi-viewpoint image is not necessarily acquired by the compound eye camera 1 as described above, and may be acquired by continuous shooting using a motion stereo method using a monocular camera.

  Hereinafter, the flow of image recording processing executed by the camera 1 will be described with reference to the flowchart of FIG. A program that defines this processing is stored in the EEPROM 146, and the main CPU 62 executes this program. In response to an instruction of “display thumbnail image list” from the operation unit 70, all the multi-viewpoint images stored in the memory card 38 are collectively performed.

  In S1, it is determined whether or not the still image release switch 5a has been fully pressed. If the still image release switch 5a is fully pressed, the process proceeds to S2.

  In S2, capturing of still image data for recording is started. The captured image data (main image) is temporarily stored in a main image buffer secured in the buffer memory 42.

  In S3, the flag of the 2D / 3D mode switching flag 168 is determined. If the 3D mode flag is set, the process proceeds to S4. If the 2D mode flag is set, the process proceeds to S7.

  In S4, a thumbnail image is created from the multi-viewpoint image stored in the main image buffer. The specific method may be created by thinning out only the left-eye image, only the right-eye image, or both, as in paragraph 0040 of Patent Document 2.

  In S5, a 3D thumbnail image is created by performing 3D CG processing on the created thumbnail image. For example, as shown in FIG. 3, a thumbnail image is displayed on a polygon PG of a three-dimensional shape model corresponding to a main subject and other various objects (FIG. 3 shows a mug but may be a person) existing in the image. Texture mapping for pasting the corresponding region of th is performed to obtain a three-dimensional CG thumbnail image X. This specific method is the same as that of Patent Document 1. Alternatively, a 3D CG process may be performed on the original multi-viewpoint image, and a 3D CG thumbnail image may be created by thinning out the 3D CG process. However, in terms of processing load, it is better to create a thumbnail first. Yes.

  Note that other 3D computer graphic techniques may be applied to the thumbnail image to create a 3D CG thumbnail image.

  In S 6, the created 3D CG thumbnail image is stored in a thumbnail buffer secured in the buffer memory 41.

  In S7, a thumbnail image is created from a single viewpoint normal image stored in the image file. The specific method may be created by thinning out a single viewpoint image in the same manner as a normal thumbnail image. This thumbnail is called a normal thumbnail image.

  In S8, the created normal thumbnail image is stored in a thumbnail buffer secured in the buffer memory 42.

  In S9, the thumbnail image stored in the thumbnail buffer of the buffer memory 42 and the main image stored in the main image buffer are associated with each other and recorded in the memory card 38. The association between both images can be performed, for example, by storing the images in the same Exif (Exchangeable image file format) file and recording them in the memory card 38.

  Note that the processing from S3 to S9 may be performed every time a still image for recording is newly acquired, or may be performed after a certain number of still images are collected. In short, as long as the main image and the reduced image can be recorded in association with each other, the timing of creating the three-dimensional CG thumbnail image may be any time.

  FIG. 4 shows an example of the three-dimensional CG thumbnail image X and the normal thumbnail image Y which are taken from the image file recorded on the memory card 38 by the above processing and displayed as a list on the LCD 10 or other display device. The three-dimensional CG thumbnail image X is created in the above steps S4 to S6, and the three-dimensional CG graphic process is applied to give a stereoscopic effect. Therefore, the normal thumbnail Y created in the above steps S7 to S8 is used. At first glance, the difference can be easily recognized and the viewer can easily recognize that the image is a reduced image of a multi-viewpoint image without using a special display device that realizes a realistic method.

Second Embodiment
FIG. 5 shows another example of the image recording process. Here, the thumbnail image of the multi-viewpoint image showing the face is replaced with a thumbnail image that has been subjected to the three-dimensional CG process only for the face area of the multi-viewpoint image.

  S11 to S13 are the same as S1 to S3.

  In S14, the face detection unit 150 is instructed to extract a face from one or both of the multi-viewpoint images. In response to a command from the main CPU 62, the face detection unit 150 attempts to detect a face area from the left-eye image or the right-eye image stored in the image file.

  In S15, it is determined whether or not the face detection unit 150 has detected a face area. If the face area can be detected, the process proceeds to S16. If the face area cannot be detected, the process proceeds to S18.

  In S16, a face area is extracted from the multi-viewpoint image showing the face, and the three-dimensional CG process is performed on the face area. For example, a face area is extracted from a multi-viewpoint image showing a face, and the multi-viewpoint image is thinned out at a predetermined thinning rate. An area corresponding to the face area extracted from the original multi-viewpoint image is set in the reduced image after thinning. When face detection is attempted from both viewpoint images, it is better to set a face area in the viewpoint image with higher detection accuracy. Then, a polygon peculiar to the face in the set area is created, and texture mapping is performed by pasting the face area after thinning on the polygon to obtain a thumbnail image on which only the face area has been subjected to 3D CG processing. In this method, three-dimensional CG processing is performed after creation of a thinned image.

  Alternatively, a polygon unique to the person's face is created from the detected face itself, texture mapping is performed to attach the face area to the polygon, and a three-dimensional CG process is performed on only the face area on the multi-viewpoint image. Make a CG image. Then, the provisional CG image is thinned out at a predetermined thinning rate to obtain a thumbnail image in which only the face area is subjected to the three-dimensional CG process. This method creates a thinned image after the three-dimensional CG processing.

  The above texture mapping method needs to start with creation of a polygon. If a precise polygon is created, the processing load is large. The following is a simple polygon creation method. First, face components such as a face outline, eyes, nose, and mouth are detected from the detected face region, and polygon dividing lines are determined according to the positions of the detected face components. For example, a line that starts from the central part (between eyebrows) and reaches the tip of the nose along the nasal muscles, a line that circulates both eyes, a line that circulates the mouth, and a contour of the face are polygon dividing lines. When texture mapping is performed on this polygon, a simple three-dimensional CG thumbnail image in which the mouth and nose are raised and the periphery of the eye is depressed is obtained.

  In S17, the created three-dimensional CG thumbnail image is stored in the thumbnail buffer.

  In S18, a thumbnail image is created from the multi-viewpoint image stored in the main image buffer. The specific method may be created by thinning out only the left-eye image, only the right-eye image, or both, as in paragraph 0040 of Patent Document 2.

  S20 to S22 are the same as S7 to S9 described above.

  FIG. 6 shows an example of a three-dimensional thumbnail image S corresponding to a multi-view image with a face detected, a normal thumbnail image Y, and a thumbnail image Z corresponding to a multi-view image with no face detected displayed on the LCD 10 as a list. Indicates.

  The sample thumbnail image U is created in steps S4 to S6, and the three-dimensional CG graphic process is performed only on the face area. Therefore, the normal thumbnail Y created in steps S20 to S21 and the steps S18 to S18 are performed. The difference between the simple viewpoint image created in S19 and the reduced image Z is obvious at a glance, and it is easy to identify a stereoscopic image having a face as a subject without using a special device that implements a realistic method. . In addition, since the three-dimensional CG graphic processing is performed on the face area using the original image, the outline of the face of the original image can be understood three-dimensionally.

<Third Embodiment>
FIG. 7 shows another example of the image recording process executed by the main CPU 62. Here, the thumbnail image of the multi-viewpoint image captured by flash is replaced with a special sample.

  S31 to S33 are the same as S1 to S3.

  In S34, the flash emission information is acquired from the photometry and ranging CPUs 19a and 19b, and the on / off status of the strobes 44a and 44b at the time of image recording is identified. Note that the flash emission information is stored, for example, in the “Flash” tag of the Exif file.

  In S35, on / off of the strobes 44a and 44b at the time of shooting is determined based on the flash emission information. If the strobes 44a and 44b are on at the time of shooting, the process proceeds to S36, and if it is off, the process proceeds to S38.

  In S 36, a sample three-dimensional thumbnail image representing the multi-viewpoint image is taken out from the EEPROM 146. Similar to the second embodiment, this sample is given a three-dimensional effect by three-dimensional CG processing, and is stored in the EEPROM 146 in advance. Note that this sample does not have to be an actual subject.

  In S37, the extracted three-dimensional thumbnail image of the sample is stored in the thumbnail buffer. The sample three-dimensional thumbnail image does not have to be the same as the actual subject, but is merely a thumbnail image for indicating that the image is a multi-viewpoint image by 3D graphics.

  S38 to S42 are the same as S18 to S22 described above.

  FIG. 8 shows an example of a sample 3D thumbnail image W, normal thumbnail image Y, and stereoscopic image reduced image Z displayed as a list on the LCD 10.

  Since the sample thumbnail image W extracted from the EEPROM 146 in step S37 has been subjected to the three-dimensional CG processing, the difference from the normal thumbnail Y or the simple reduced image Z of the three-dimensional image is obvious at first glance. Even without using a special device that realizes the above, it is easy to identify a stereoscopic image having a face as a subject.

  In addition, it is not necessary to record the samples uniformly in correspondence with the dark multi-viewpoint images that are difficult to effectively use as a multi-viewpoint image, and the flash does not emit light, and the processing becomes efficient.

<Fourth embodiment>
FIG. 9 shows another example of the image recording process. Here, the thumbnail image of the multi-viewpoint image showing the face is replaced with a special sample.

  S51 to S53 are the same as S1 to S3.

  S54 to S55 are the same as S14 to S15. However, in S55, if it is determined that there is a face, the process proceeds to S56, and if it is determined that there is no face, the process proceeds to S58.

  In S <b> 56, a sample three-dimensional thumbnail image representing that the face is a multi-viewpoint image is extracted from the EEPROM 146.

  In S57, the extracted sample is stored in the thumbnail buffer. The sample 3D thumbnail image does not have to be the same as the face of the actual subject, and may be a sample person's face, and the face or body is preliminarily provided with a 3D graphic stereoscopic effect. Yes.

  S58 to S62 are the same as S18 to S22 described above.

  FIG. 10 shows an example of a sample three-dimensional thumbnail image U, a normal thumbnail image Y, and a reduced image Z of a stereoscopic image displayed as a list on the LCD 10.

  Since the sample thumbnail image U has been subjected to 3D CG graphic processing, the difference from the normal thumbnail Y and the stereoscopic image reduced image Z is apparent at first glance, without using a special device that realizes a realistic method. In both cases, it is easy to identify a stereoscopic image whose face is a subject.

<Fifth Embodiment>
FIG. 11 shows another example of the image recording process. Here, only a thumbnail image of a multi-viewpoint image obtained by photographing a subject at a short distance is subjected to three-dimensional CG processing.

  S71 to S73 are the same as S1 to S3.

  In S74, distance information is acquired from the distance information storage circuit 58, and the distance from the camera 1 to the subject at the time of shooting is identified. The distance information is stored in a “SubjectDistance” tag of the Exif file, for example. There are two types of distance information stored in the distance information storage circuit 58, one obtained from the distance image sensor 51a and one obtained from the distance image sensor 51b, either of which may be used, for example, a short distance. The distance information of the direction is used.

  In S75, based on the distance information D, it is determined whether or not the subject is at a position farther than a predetermined distance (for example, D> 10 m). If the subject is not a long distance, that is, if it is a short distance, the process proceeds to S76, and if the subject is a long distance, the process proceeds to S78.

  In S76, as in S5, a three-dimensional CG thumbnail image is created.

  In S 77, the created three-dimensional CG thumbnail image is stored in a thumbnail buffer secured in the buffer memory 42.

  S78 to S82 are the same as S18 to S22 described above.

  FIG. 12 shows an example of a thumbnail image V displayed as a list on the LCD 10, a normal thumbnail image Y, a subject that has not been subjected to the 3D CG process, and is far away.

  Since the sample thumbnail image T in which the subject is at a short distance is subjected to three-dimensional CG processing, the thumbnail image V and the thumbnail image V of the image in which the subject is far away can be obtained without using a special device that implements a realistic method. The difference is obvious at first glance.

  In addition, since the 3D CG process is performed only on the multi-viewpoint image in which the subject is at a short distance at the time of shooting, it is not necessary to perform the 3D CG process uniformly even to the far object image even if the process is performed. , Process becomes more efficient.

<Sixth Embodiment>
FIG. 13 shows another example of the image recording process. Here, when a long-distance subject is photographed as a multi-viewpoint image, a warning is issued and the multi-viewpoint image itself is not recorded. On the other hand, only thumbnail images of multi-viewpoint images taken at a short distance are subjected to three-dimensional CG processing and recorded in association with the main image.

  S91 to S95 are the same as S71 to S75. However, in S95, if it is determined that the subject is a long distance, the process proceeds to S96, and if it is determined that the subject is a short distance, the process proceeds to S97.

  In S96, a warning is displayed on the LCD 10 that the subject is at a long distance and a multi-viewpoint image is not recorded. Then, the process ends without proceeding to the image recording in S101.

  S97 to S98 are the same as S76 to S77. S99 to S101 are the same as S80 to S82.

  In this process, the 3D CG process is performed only on the multi-viewpoint image in which the subject is at a short distance at the time of shooting and is recorded in association with the main image. It is not necessary to perform the 3D CG processing uniformly, and the processing becomes efficient.

  Further, in this process, a warning is displayed for the multi-viewpoint image in which the subject is at a long distance at the time of shooting, and the actual image is not recorded. That is, it is not necessary to record a multi-viewpoint image that is far from the subject and does not cause a stereoscopic effect, and the processing becomes efficient.

<Other embodiments>
A combination of part or all of the first to sixth embodiments is also possible. For example, a reduced image subjected to three-dimensional CG processing can be recorded in association with the main image only when a face is detected and flash emission at the time of shooting is on. Alternatively, only when a face is detected and flash emission at the time of shooting is on, a reduced sample image subjected to three-dimensional CG processing can be recorded in association with the main image.

  Alternatively, the reduced image subjected to the three-dimensional CG process can be recorded in association with the main image only when the subject distance is short and the flash emission at the time of shooting is on. Alternatively, the sample reduced image subjected to the three-dimensional CG processing can be recorded in association with the main image only when the subject distance is short and the flash emission at the time of photographing is on.

  When face detection is performed, the subject distance is assumed to be a short distance. Therefore, when face detection is performed, determination that the subject distance is short or far may be omitted.

Camera block diagram Flowchart of image recording processing according to the first embodiment Diagram showing an example of texture mapping The figure which shows an example of the thumbnail recorded by the image recording process which concerns on 1st Embodiment. Flowchart of image recording process according to second embodiment The figure which shows an example of the thumbnail recorded by the image recording process which concerns on 2nd Embodiment. Flowchart of image recording process according to third embodiment The figure which shows an example of the thumbnail recorded by the image recording process which concerns on 3rd Embodiment. Flowchart of image recording processing according to the fourth embodiment The figure which shows an example of the thumbnail recorded by the image recording process which concerns on 4th Embodiment Flowchart of image recording process according to fifth embodiment The figure which shows an example of the thumbnail recorded by the image recording process which concerns on 5th Embodiment Flowchart of image recording process according to sixth embodiment

Explanation of symbols

1: camera, 2a: first imaging unit, 2b: second imaging unit, 10: LCD, 62: main CPU, 38: memory card

Claims (15)

An imaging unit capable of imaging an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint;
A main image storage unit that stores a main image that is a multi-viewpoint image or a single-viewpoint image captured by the shooting unit;
An image identification unit for identifying whether the main image stored in the main image storage unit is a multi-view image or a single-view image;
A first reduced image obtained by reducing the main image is created, and a three-dimensional computer graphic process is performed on the first reduced image created from the main image identified by the image identification unit as a multi-viewpoint image. An image processing unit that creates a second reduced image,
A reduced image storage unit that stores the first reduced image or the second reduced image created by the image processing unit according to the identification of the multi-viewpoint image or the single-viewpoint image by the image identification unit;
A recording unit that records the first reduced image or the second reduced image stored in the reduced image storage unit and the main image stored in the main image storage unit in association with each other;
An image recording apparatus comprising: A face detection unit for detecting the presence or absence of a subject face region from the main image identified by the image identification unit as a multi-viewpoint image;
The image processing unit sets a region corresponding to the subject face region detected by the face detection unit for the first reduced image, and performs three-dimensional computer graphic processing on the set region, The image recording apparatus according to claim 1, wherein the second reduced image is created. An imaging unit capable of imaging an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint;
A main image storage unit that stores a main image that is a multi-viewpoint image or a single-viewpoint image captured by the shooting unit;
An image identification unit for identifying whether the main image stored in the main image storage unit is a multi-view image or a single-view image;
For the image identified by the image identification unit as a multi-viewpoint image, a flash emission identification unit for identifying presence or absence of flash emission at the time of shooting;
An image processing unit that creates a first reduced image obtained by reducing the main image that the image identification unit has identified as a single-viewpoint image or the flash emission identification unit has identified that there was no flash emission at the time of shooting;
As a second reduced image corresponding to the main image identified by the image identification unit as a multi-viewpoint image and identified by the flash emission identification unit as having flash emission, a predetermined sample reduced image subjected to three-dimensional computer graphics is used. A sample reduced image acquisition unit to acquire;
The first reduced image created by the image processing unit according to the identification of the multi-viewpoint image or the single-viewpoint image by the image identification unit and the identification of the presence or absence of flash emission at the time of shooting by the flash emission identification unit A reduced image storage unit that stores the second reduced image acquired by the sample reduced image acquisition unit;
A recording unit that records the first reduced image or the second reduced image stored in the reduced image storage unit and the main image stored in the main image storage unit in association with each other;
An image recording apparatus comprising: An imaging unit capable of imaging an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint;
A main image storage unit that stores a main image that is a multi-viewpoint image or a single-viewpoint image captured by the shooting unit;
An image identification unit for identifying whether the main image stored in the main image storage unit is a multi-view image or a single-view image;
A face detection unit that detects the presence or absence of a subject face region for the image identified by the image identification unit as a multi-viewpoint image;
An image processing unit that creates a first reduced image obtained by reducing the main image in which the image identifying unit has identified that it is a single-viewpoint image or the face detection unit has not detected a subject face area;
A predetermined sample reduced image subjected to three-dimensional computer graphics is acquired as a second reduced image corresponding to the main image that the image identification unit has identified as a multi-viewpoint image and the face detection unit has detected the subject face area. A sample reduced image acquisition unit;
The first reduced image or the sample reduced created by the image processing unit according to the identification of the multi-viewpoint image or the single-viewpoint image by the image identification unit and the presence / absence of the detection of the subject face area by the face detection unit. A reduced image storage unit for storing the second reduced image acquired by the image acquisition unit;
A recording unit that records the first reduced image or the second reduced image stored in the reduced image storage unit and the main image stored in the main image storage unit in association with each other;
An image recording apparatus comprising: An imaging unit capable of imaging an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint;
A main image storage unit that stores a main image that is a multi-viewpoint image or a single-viewpoint image captured by the shooting unit;
An image identification unit for identifying whether the main image stored in the main image storage unit is a multi-view image or a single-view image;
A distance identifying unit for identifying whether a subject in the image identified by the image identifying unit as a multi-viewpoint image is at a long distance or a short distance;
A first reduced image obtained by reducing the main image is created, and the image identification unit identifies the image as a multi-viewpoint image, and the distance identification unit creates the main image from which the subject is identified at a short distance. An image processing unit that creates a second reduced image by performing three-dimensional computer graphic processing on the first reduced image;
The first reduced image or the second reduced image created by the image processing unit according to the identification of the multi-viewpoint image or the single-viewpoint image by the image identification unit and the identification of the distance of the subject by the distance identification unit. A reduced image storage unit for storing
A recording unit that records the first reduced image or the second reduced image stored in the reduced image storage unit and the main image stored in the main image storage unit in association with each other;
An image recording apparatus comprising:   6. The image according to claim 5, wherein the recording unit records only the main image that the distance identifying unit has identified as being close to the main image that the image identifying unit has identified as a multi-viewpoint image. Recording device.   7. The notification unit according to claim 6, further comprising a notification unit that notifies the warning that the image identification unit identifies that the image is a multi-viewpoint image and the distance identification unit identifies that the subject is located at a long distance, and the main image is not recorded. Image recording device. Capturing an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint;
Storing a captured multi-view image or a main image that is a single-view image;
Identifying whether the stored main image is a multi-view image or a single-view image;
A first reduced image obtained by reducing the main image is created, and a first reduced image created from the main image identified as the multi-viewpoint image is subjected to three-dimensional computer graphic processing, thereby Creating a reduced image of 2;
Storing the created first reduced image or second reduced image according to the identification of the multi-viewpoint image or the single-viewpoint image;
Recording the stored first reduced image or second reduced image and the stored main image in association with each other;
An image recording method comprising: Detecting the presence or absence of a subject face region from the main image identified as the multi-viewpoint image;
A step of creating a second reduced image by setting a region corresponding to the detected subject face region for the first reduced image and performing a three-dimensional computer graphic process on the set region. When,
The image recording method according to claim 8, further comprising: Taking an image including a multi-viewpoint image taken from two or more viewpoints and a single-viewpoint image taken from a single viewpoint;
Storing a captured multi-view image or a main image that is a single-view image;
Identifying whether the stored main image is a multi-view image or a single-view image;
Identifying the presence or absence of flash emission at the time of shooting for an image identified as a multi-viewpoint image;
Creating a first reduced image that is a reduced version of the main image that has been identified as the single-viewpoint image or identified as having no flash emission at the time of shooting;
Obtaining a predetermined sample reduced image subjected to three-dimensional computer graphics as a second reduced image corresponding to the main image identified as the multi-viewpoint image and identified as having the flash emission;
Storing the first reduced image or the second reduced image according to the identification of the multi-viewpoint image or the single-viewpoint image and the identification of the presence or absence of flash emission at the time of shooting;
Recording the stored first reduced image or second reduced image and the stored main image in association with each other;
An image recording method comprising: Capturing an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint;
Storing a captured multi-view image or a main image that is a single-view image;
Identifying whether the stored main image is a multi-view image or a single-view image;
Detecting the presence or absence of a subject face area for the image identified as the multi-viewpoint image;
Creating a first reduced image obtained by reducing the main image that has been identified as the single-viewpoint image or has not detected the subject face area;
Obtaining a predetermined sample reduced image subjected to three-dimensional computer graphics as a second reduced image corresponding to the main image that has been identified from the multi-viewpoint image and has detected the subject face area;
Storing the first reduced image or the second reduced image according to the identification of the multi-viewpoint image or the single-viewpoint image and the presence or absence of detection of the subject face area;
Recording the stored first reduced image or second reduced image and the stored main image in association with each other;
An image recording method comprising: Capturing an image including a multi-viewpoint image captured from two or more viewpoints and a single-viewpoint image captured from a single viewpoint;
Storing a captured multi-view image or a main image that is a single-view image;
Identifying whether the stored main image is a multi-view image or a single-view image;
Identifying whether the subject in the image identified as the multi-viewpoint image is at a long distance or a short distance;
A first reduced image created by reducing the main image and then identifying the multi-viewpoint image and identifying the subject at a short distance with respect to the first reduced image created from the main image, Applying a three-dimensional computer graphic process to create a second reduced image;
Storing the first reduced image or the second reduced image according to the identification of the multi-view image or the single-view image and the identification of the distance of the subject;
Recording the stored first reduced image or second reduced image and the stored main image in association with each other;
An image recording method comprising:   The image recording method according to claim 12, wherein the main image identified as the multi-viewpoint image is recorded only for the main image identified as the subject at a short distance.   The image recording method according to claim 13, further comprising a step of notifying a warning that the main image identified as the multi-viewpoint image and the subject identified as being at a long distance is not recorded.   A program for causing a computer to execute the image recording method according to claim 8.

Images