JP2011182418A - Imaging apparatus, image reproducing apparatus, imaging method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent information needed to reproduce a 3D/multi-viewpoint image from being lost even when the 3D/multi-viewpoint image is edited and so on by an apparatus or application software which is not adaptive to the 3D/multi-viewpoint image. <P>SOLUTION: An imaging apparatus includes: a module for detecting whether it is a 3D mode for photographing a subject image viewed from a plurality of viewpoints or a 2D mode for photographing a subject image viewed from one viewpoint; and a module for setting such a protect as not to modify or delete a multi-viewpoint image to the multi-viewpoint image when the 3D mode is detected. Erasure prohibition and editing prohibition can be individually set to the multi-viewpoint image to be recorded, by an erasure prohibition flag for prohibiting erasure of the multi-viewpoint image to be recorded and an editing prohibition flag for prohibiting the editing of the multi-viewpoint image to be recorded. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an image reproducing apparatus, an imaging method, and a program, and more particularly, to an imaging apparatus, an image reproducing apparatus, an imaging method, and a program that prevent a recorded image from being erased by mistake.

  The following techniques have been proposed as techniques for preventing accidental erasure and editing of images recorded by an imaging device such as a digital camera.

  Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for automatically erasing and protecting a photographed image by performing erasure protection on a previously photographed image after recording.

  Patent Document 2 describes a technique for preventing a captured moving image from being erased by an erroneous operation by erasing the original data after the edited data is written. Yes.

  Patent Document 3 describes a technique for preventing the loss of important images by prohibiting overwriting of the same file in the same folder and prohibiting image data erasing operation in the standard mode.

  Patent Document 4 describes a technique for preventing a reduction in image quality and erasure of a required image by performing protection for prohibiting the compression rate change for compressed image data that does not want to change the compression rate. .

JP 2006-41699 A Japanese Patent Application Laid-Open No. 2000-115685 JP 2000-209535 A JP-A-11-308563

  When a standard for 3D (three-dimensional) / multi-viewpoint images is established, the 3D / 3D / multi-viewpoint device or application software that is not compatible with the 3D / multi-viewpoint standard described in Patent Documents 1 to 4 is used. When editing and saving a multi-viewpoint image, the following problem may remain.

  In order to provide compatibility between the 3D standard and the conventional standard, the representative viewpoint image in the 3D / multi-viewpoint image is recorded first, followed by the newly introduced tag (3D / multi-viewpoint tag). And a 3D / multi-viewpoint image is recorded in a memory or the like in a format in which the remaining viewpoint images are recorded. At this time, if a 3D / multi-viewpoint image file is read by a 3D / multi-viewpoint incompatible device or application software, the data after the 3D / multiview tag is not recognized and is not read. If editing including resizing and rotation is performed in this state and the edited image is re-recorded, data necessary for playback of the 3D / multi-viewpoint image is discarded.

  The present invention has been made in view of such circumstances. Even when a 3D / multi-viewpoint image is edited by a device or application software that does not support 3D / multi-viewpoint images, the 3D / multi-viewpoint image is displayed. The purpose is to prevent information necessary for reproduction from being lost.

  The present invention provides a shooting mode switching means for switching between a multi-viewpoint image shooting mode for shooting a subject image viewed from a plurality of viewpoints and a one-viewpoint image shooting mode for shooting a subject image viewed from one viewpoint, and the shooting mode A shooting mode detecting unit for detecting a shooting mode switched by the switching unit, an imaging unit for acquiring a multi-viewpoint image or a single viewpoint image shot in the shooting mode switched by the shooting mode switching unit, and the imaging unit. A recording unit that records the acquired multi-viewpoint image or one-viewpoint image on a recording medium, and a multi-viewpoint image that is recorded by the recording unit when the shooting mode detection unit detects the multi-viewpoint image shooting mode. Protection setting means for setting protection so that the multi-viewpoint image is not changed or deleted. The setting means adds an erasure prohibition flag for prohibiting erasure of the recorded multi-viewpoint image and an edit prohibition flag for prohibiting editing of the recorded multi-viewpoint image to the recorded multi-viewpoint image. On the other hand, an image pickup apparatus is provided in which deletion prohibition and editing prohibition can be individually set.

  According to this configuration, when shooting a multi-viewpoint image for shooting a subject image viewed from a plurality of viewpoints, the multi-viewpoint image recorded in the recording unit is protected so that the multi-viewpoint image is not changed or deleted. To do. Note that protection is set by writing information in tag information attached to an image. As a result, since the acquired multi-viewpoint image is recorded in a protected state, even when editing or the like is performed using a device or application software that does not support 3D / multi-viewpoint images. It is possible to prevent information necessary for reproduction of the viewpoint image from being lost.

  In one embodiment, when an image including the multi-viewpoint image is recorded on the recording medium, an erasing mode setting unit that sets an erasing mode for erasing a desired image selected from the images; An erasing mode detecting means for detecting whether or not an erasing mode is set; and when the erasing mode is detected by the erasing mode detecting means and the desired image is the multi-view image, the multi-view image Warning means for warning that the image is erased, and if the selection of the multi-viewpoint image is determined after warning is issued by the warning means, the protection set for the selected multi-viewpoint image And erasing means for canceling and erasing.

  According to this configuration, a warning is issued when a multi-viewpoint image is selected in an erasing mode in which a desired image selected from images including the multi-viewpoint image recorded on the recording medium is erased. If the selection of the multi-viewpoint image is determined after the warning, the protection of the multi-viewpoint image is canceled and the image is deleted. This warns the user before deleting the multi-viewpoint image, thereby preventing the user from deleting the multi-viewpoint image by mistake. For example, if the multi-viewpoint image is prohibited from being read by the protect flag, the user can carefully edit the 3D / multi-viewpoint image after copying it with a different file name.

  In one embodiment, when an image including the multi-viewpoint image is recorded on the recording medium, an editing mode setting unit that sets an editing mode for editing a desired image selected from the images; An editing mode detecting means for detecting whether or not an editing mode has been set; and when the editing mode is detected by the editing mode detecting means and the desired image is the multi-view image, the multi-view image Warning means for warning that the editing is performed, and when the selection of the multi-viewpoint image is determined after warning is given by the warning means, the protection set in the selected multi-viewpoint image And an editing unit that edits the multi-viewpoint image that has been unprotected by the unprotecting unit, and the storage unit includes the editing unit. The multi-viewpoint image edited in the stage is recorded on a recording medium, and the protection setting unit does not change or delete the multi-viewpoint image with respect to the edited multi-viewpoint image recorded by the recording unit. It is characterized by setting protection.

  According to this configuration, a warning is issued when a multi-viewpoint image is selected in an edit mode for editing a desired image selected from images including the multi-viewpoint image recorded on the recording medium. If the selection of the multi-viewpoint image is determined after the warning, the multi-viewpoint image is unprotected and the image is edited. The edited multi-viewpoint image is recorded in the recording means, and protection is set so that the multi-viewpoint image is not changed or deleted. This warns the user before editing the multi-viewpoint image, thereby preventing the user from editing the multi-viewpoint image by mistake. Since the edited image is protected, the edited image can be protected appropriately.

  In one embodiment, when the imaging unit is switched to a multi-viewpoint imaging mode by a plurality of imaging systems having a plurality of optical systems and imaging elements that form a subject image, and the imaging mode switching unit, When the plurality of imaging systems are driven and switched to the single viewpoint image shooting mode by the shooting mode switching means, driving of the imaging system is completed by the driving means for driving one imaging system and the driving means. Driving detection means for detecting whether or not the imaging mode detection means detects the multi-viewpoint image shooting mode, and the drive detection means detects that the plurality of imaging systems are not driven. In this case, the shooting mode switching means switches from the multi-viewpoint image shooting mode to the one-viewpoint image shooting mode.

  According to this configuration, when the multi-viewpoint image capturing mode is set and the plurality of capturing systems are not driven, that is, when the multi-viewpoint image cannot be captured, the multi-viewpoint image capturing mode is changed to the one-viewpoint image capturing mode. Switch to. Thereby, when a multi-viewpoint image cannot be captured, it is possible to automatically capture a two-dimensional image and set the captured image not to be protected.

  In one embodiment, the camera includes vertical shooting detection means for detecting whether or not a subject image is in a vertical shooting state, is switched to the multi-viewpoint image shooting mode by the shooting mode switching means, and is detected by the vertical shooting detection means. When it is detected that the image is in the state of being taken vertically, the shooting mode switching means switches from the multi-viewpoint image shooting mode to the one-viewpoint image shooting mode.

  According to this configuration, when the multi-viewpoint image capturing mode is set and the subject image is in the state of being taken vertically, that is, when the multi-viewpoint image cannot be captured, the one-viewpoint image is changed from the multi-viewpoint image capturing mode. Switch to shooting mode. Thereby, when a multi-viewpoint image cannot be captured, it is possible to automatically capture a two-dimensional image and set the captured image not to be protected.

  In one embodiment, the recording means records the multi-viewpoint image edited by the editing means in the recording means after giving a warning again.

  According to this configuration, the warning is performed again before the edited multi-viewpoint image is recorded in the recording unit. Thereby, when a multi-viewpoint image is edited, it can prevent saving the edited image accidentally.

  The present invention provides a connection means to which a recording medium capable of recording a subject image is connected, a detection means for detecting that the recording medium is connected to the connection means, and a connection of the recording medium is detected by the detection means. If it is determined, the first determination means for determining whether or not a multi-viewpoint image, which is a subject image viewed from a plurality of viewpoints, is recorded on the recording medium; and the multi-viewpoint image is determined by the first determination section. A first protection setting unit that sets protection for the recorded multi-viewpoint image so that the multi-viewpoint image is not changed or deleted. The first protection setting means includes the erasure prohibition flag for prohibiting erasure of the recorded multi-viewpoint image and the edit prohibition flag for prohibiting editing of the recorded multi-viewpoint image. To provide an image reproducing apparatus which is a settable individually and erase inhibit editing disabled for multi-view image.

  According to this configuration, when a recording medium capable of recording a subject image is connected and the multi-viewpoint image is recorded on the recording medium, the multi-viewpoint image is compared with the recorded multi-viewpoint image. Set protection so that is not changed or deleted. Accordingly, it is possible to automatically protect a multi-viewpoint image captured by a device that cannot automatically protect a 3D / multi-viewpoint image.

  In one embodiment, when the detection unit detects the connection of the recording medium, a second determination unit that determines whether a new subject image can be recorded on the recording medium; and the second determination If it is determined by the means that a new subject image cannot be recorded on the recording medium, the multi-viewpoint image or single-viewpoint image recorded on the recording medium is not changed or deleted with respect to the recording medium. And second protection setting means for setting.

  According to this configuration, when a new subject image cannot be recorded on the connected recording medium, data such as a multi-viewpoint image or a single-viewpoint image recorded on the recording medium is not changed or deleted with respect to the recording medium. Set such protection. Thereby, since the multi-viewpoint image included in the recording medium is protected twice, the protection of the image data can be further strengthened.

  The imaging apparatus includes the image reproduction apparatus.

  The present invention includes a step of switching between a multi-viewpoint image capturing mode for capturing subject images viewed from a plurality of viewpoints and a one-viewpoint image capturing mode for capturing subject images viewed from one viewpoint, and the switched capturing modes. Detecting a multi-viewpoint image or one-viewpoint image captured in the switched shooting mode, recording the acquired multi-viewpoint image or one-viewpoint image on a recording medium, A protection setting step for setting protection for the recorded multi-view image so that the multi-view image is not changed or deleted when the multi-view image shooting mode is detected in the step of detecting the shooting mode; The first protection setting means includes an erasure prohibition flag for prohibiting erasure of the recorded multi-viewpoint image and a previous An imaging method characterized in that erasure prohibition and edit prohibition can be individually set for the recorded multi-viewpoint image by an edit prohibition flag for prohibiting editing of the recorded multi-viewpoint image. provide.

  The present invention also includes a step of connecting a recording medium capable of recording a subject image, a step of detecting that the recording medium is connected, and a connection of the recording medium. In the step of determining whether or not a multi-viewpoint image that is a subject image viewed from a viewpoint is recorded on the recording medium, and in the step of determining whether or not the multi-viewpoint image is recorded on the recording medium, the multi-viewpoint image A protection setting step for setting protection for the recorded multi-viewpoint image so that the multi-viewpoint image is not changed or deleted. The protection setting unit 1 includes an erasure prohibition flag for prohibiting erasure of the recorded multi-viewpoint image and an edit for prohibiting editing of the recorded multi-viewpoint image. By the inhibition flag, to provide an imaging method, wherein the an erase prohibition against recorded as multi-view image editing inhibited and the individually configurable.

  The present invention provides a program that causes an arithmetic device to execute the imaging method.

  According to the present invention, even when a 3D / multi-viewpoint image is edited by a device or application software that does not support 3D / multi-viewpoint images, information necessary for playback of the 3D / multi-viewpoint image disappears. Can be prevented.

1 is a block diagram of a compound-eye digital camera 1a to which the present invention is applied. 6 is a flowchart illustrating a processing flow of the first embodiment in which a protection flag is set and image data of a three-dimensional image is captured and recorded. It is a flowchart which shows the flow of a process of 2nd Embodiment which sets a protection flag and image | photographs and records the image data of a three-dimensional image. It is a flowchart which shows the flow of a process when the memory card with which the three-dimensional image was recorded is inserted. It is a flowchart which shows the flow of a process when the memory card with which the three-dimensional image was recorded is inserted. It is a flowchart which shows the flow of the deletion process of a three-dimensional image. It is a flowchart which shows the flow of the edit process of a three-dimensional image.

  The best mode for carrying out an image pickup device-integrated lens interchangeable digital camera according to the present invention will be described below in detail with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing an electrical configuration of the compound-eye digital camera 1. The compound-eye digital camera 1 can shoot single-viewpoint images (two-dimensional images) and multi-viewpoint images (three-dimensional images), and can record and reproduce moving images, still images, and sounds. In addition, for both moving images and still images, not only single-view images but also multi-view images can be taken.

  The compound-eye digital camera 1 mainly includes two imaging systems, a first imaging system 2a and a second imaging system 2b, and an operation unit 3 for performing various operations when the user uses the compound-eye digital camera 1. An operation display LCD 4 for assisting the operation, release switches 5a and 5b, and an image display LCD 6 are provided.

  The first imaging system 2a and the second imaging system 2b are arranged side by side so that the lens optical axes L1 and L2 are parallel or at a predetermined angle.

  The first imaging system 2a includes a first zoom lens 11a, a first diaphragm 12a, a first focus lens 13a, and a first image sensor 14a arranged along the lens optical axis L1. A diaphragm control unit 16a is connected to the first diaphragm 12a, and a timing generator (TG) 18a is connected to the first image sensor 14a. The operations of the first aperture 12a and the first focus lens 13a are controlled by the photometric distance measuring CPU 19a. The operation of the TG 18a is controlled by the main CPU 10.

  The first zoom lens 11a moves to the NEAR side (feed-out side) or the INF side (retract-side) along the lens optical axis L1 in accordance with the zoom operation from the operation unit 3 to change the zoom magnification. This movement is driven by a motor (not shown).

  The first diaphragm 12a performs exposure adjustment by changing the aperture value (aperture value) during AE (Auto Exposure) operation to limit the light flux.

  The first focus lens 13a is moved to the NEAR side or the INF side along the lens optical axis L1 during AF (Auto Focus) operation to change the focus position and perform focus adjustment. This movement is driven by a motor (not shown). When the half-pressed state of the still image release switch 5a is detected, the main CPU 10 obtains distance measurement data from the first image sensor 14a. The main CPU 10 adjusts the focus, aperture, etc. based on the obtained distance measurement data.

  The first image sensor 14a is a CCD-type or CMOS-type image sensor, receives the subject light imaged by the first zoom lens 11a, the first diaphragm 12a, and the first focus lens 13a and receives the light on the light receiving element. Accumulate photocharge according to quantity. The photocharge accumulation / transfer operation of the first image sensor 14a is controlled by the TG 18a, and the electronic shutter speed (photocharge accumulation time) is determined by the timing signal (clock pulse) input from the TG 18a. The first image sensor 14a acquires an image signal for one screen every predetermined period in the photographing mode.

  The second imaging system 2b has the same configuration as the first imaging system 2a, and is a second image in which the second zoom lens 11b, the second diaphragm 12b, the second focus lens 13b, and the timing generator (TG) 18b are connected. It is configured by the sensor 14b.

  The operations of the first imaging system 2a and the second imaging system 2b are controlled by the main CPU 10. The first imaging system 2a and the second imaging system 2b basically operate in conjunction with each other, but can also be operated individually.

  Imaging signals output from the first image sensor 14a and the second image sensor 14b of the first imaging system 2a and the second imaging system 2b are input to the A / D converters 30a and 30b, respectively.

  The A / D converters 30a and 30b convert input image data from analog to digital. Through the A / D converters 30a and 30b, the imaging signal of the first image sensor 14a is first image data (right eye image data), and the imaging signal of the second image sensor 14b is second image data (left eye image). Data).

  The image signal processing circuits 31a and 31b perform first and second image data input from the A / D converters 30a and 30b, respectively, for various image processing such as gradation conversion, white balance correction, and γ correction processing. To apply.

  The buffer memories 32a and 32b temporarily store the first image data and the second image data that have been subjected to various image processes by the image signal processing circuits 31a and 31b. The first image data and the second image data stored in the buffer memories 32a and 32b are output via the system bus.

  The system bus includes a main CPU 10, EEPROM 21, work memories 24a and 24b, buffer memories 32a and 32b, a controller 34, YC processing units 35a and 35b, compression / decompression processing circuits 36a and 36b, a media controller 37, and a vertical shooting detection circuit 50. A vertical shooting flag setting circuit 51, a protect flag setting circuit 52, a 2D / 3D mode switching flag setting circuit 53, and the like are connected.

  The main CPU 10 comprehensively controls the overall operation of the compound-eye digital camera 1. The main CPU 10 is connected with an operation unit 3, release switches 5a and 5b, a protection release switch 7, a 2D / 3D setting switch 8, and a vertical shooting setting button 9.

  The operation unit 3 includes a power switch for turning on the power for operating the compound-eye digital camera 1, a mode dial for selecting auto shooting, manual shooting, and the like, and a cross key for setting and selecting various menus or zooming. , A flash emission switch, and an information position designation key for executing or canceling the menu selected by the cross key. By appropriately operating the operation unit 3, the power is turned on / off, various modes (shooting mode, playback mode, erase mode, edit mode, etc.), zooming, and the like are performed.

  The release switches 5a and 5b have a two-stage push switch structure. When the release switch 5 is lightly pressed (half-pressed) during the shooting mode, AF operation and AE operation are performed and shooting preparation processing is performed. In this state, when the release switches 5a and 5b are further pressed (fully pressed), photographing processing is performed, and the first image data and the second image data for one screen are transferred from the frame memory 32 to the memory card 38. Recorded.

  The image display LCD 6 is a parallax barrier type or lenticular lens type 3D monitor, is used as an electronic viewfinder at the time of image shooting, and performs stereoscopic display of image data obtained by shooting at the time of image reproduction. Although the detailed structure of the image display LCD 6 is not shown, the image display LCD 6 includes a parallax barrier display layer on the surface thereof. When performing stereoscopic display, the image display LCD 6 generates a parallax barrier having a pattern in which light transmitting portions and light shielding portions are alternately arranged at a predetermined pitch on the parallax barrier display layer. Stereoscopic viewing is enabled by alternately arranging strip-shaped image fragments showing left and right images on the display surface. Note that the configuration of the display device that enables stereoscopic viewing is not necessarily limited to the parallax method using the slit array sheet, the lenticular method using the lenticular lens sheet, the integral photography method using the micro lens array sheet, and the interference. A holographic method using a phenomenon may be employed.

  The protect cancellation switch 7 is a switch for instructing cancellation of protection of an image that is prohibited from being deleted or edited.

  The 2D / 3D setting switch 8 is a switch for instructing switching between a 2D mode for capturing a single-viewpoint image and a 3D mode for capturing a multi-viewpoint image.

  The vertical shooting setting button 9 is a button for instructing whether to perform vertical shooting or horizontal shooting. It should be noted that vertical / horizontal shooting may be selected by selecting a menu.

  The EEPROM 21 is a non-volatile memory and stores various control programs and setting information. The main CPU 10 executes various processes based on this program and setting information.

  The work memories 24a and 24b store the YC signals processed by the YC processing units 35a and 35b, respectively.

  The controller 34 reads out the YC signals of the first image data and the second image data stored in the work memories 24 a and 24 b to the YC / RGB processing unit 22.

  The YC / RGB processing unit 22 converts the YC signal of the first image data and the second image data into a video signal of a predetermined format (for example, a color composite video signal of the NTSC format), and then the stereoscopic display on the image display LCD 6. It is combined with stereoscopic image data for display and output to the LCD driver 23 for display. When used as an electronic viewfinder in the shooting mode, the stereoscopic image data synthesized by the YC / RGB processing unit 22 is displayed as a through image on the image display LCD 6 via the LCD driver 23. In addition, when performing stereoscopic display of image data obtained by shooting, the YC / RGB processing unit 22 reads out each image data recorded on the memory card 38 by the media controller 37 and compresses and decompresses the data. The data subjected to the decompression processing by 36a and 36b is converted into stereoscopic image data, and the stereoscopic image data is displayed on the image display LCD 6 as a reproduced image via the LCD driver 23.

  The LCD driver 23 outputs the RGB signal output from the YC / RGB processing unit 22 to the image display LCD 6.

  The YC processing units 35a and 35b convert the image data stored in the buffer memories 32a and 32b into luminance signals (Y signals) and color difference signals (Cr and Cb signals), and perform predetermined processing such as gamma correction.

  The compression / decompression processing circuits 36a and 36b respectively apply JPEG for still images, MPEG2, MPEG4, H.264 for moving images to the first image data and the second image data stored in the work memories 24a and 24b, respectively. Compression processing is performed according to a predetermined compression format such as H.264.

  The media controller 37 records each image data compressed by the compression / decompression processing circuits 36 a and 36 b on the memory card 38 or other recording media connected via the I / F 39.

  The memory card 38 is an xD picture card (registered trademark) detachable from the compound-eye digital camera 1, a semiconductor memory card represented by smart media (registered trademark), a portable small hard disk, a magnetic disk, an optical disk, a magneto-optical disk, etc. Various recording media.

  The vertical shooting detection circuit 50 detects whether to perform vertical shooting or horizontal shooting using a sensor using gravity, a Hall element, a sensor using MEMS, or the like.

  In the vertical shooting flag setting circuit 51, a flag indicating the vertical shooting mode is set.

  In the protect flag setting circuit 52, an erase prohibition flag, an edit prohibition flag, an overwrite prohibition flag, and the like are set. Normally, if there is an erasure prohibition flag, erasure, overwriting, and editing can be prohibited. If an edit prohibition flag and an overwrite prohibition flag can be individually set and set in addition to the erase prohibition flag, editing can be prohibited, and when editing, a file copied with an alias can be edited. At this time, by setting such that editing is prohibited but erasing is possible, the erasing operation can be facilitated if the contents of the file can be grasped.

  The 2D / 3D mode switching flag setting circuit 53 is set with a flag indicating the 2D mode or the 3D mode. In addition, not only when an edit prohibition flag and an overwrite prohibition flag are individually provided as a protection flag, it is also possible to prohibit all deletion, editing, overwriting and the like with one flag.

  The vertical shooting flag setting circuit 51, the protect flag setting circuit 52, and the 2D / 3D mode switching flag setting circuit 53 are written in the tag information attached to the acquired image file, folder, memory card 38, and the like.

  In addition, the compound-eye digital camera 1 is provided with a power supply battery 68 in a detachable manner.

  The power supply battery 68 is composed of a rechargeable secondary battery such as a nickel-cadmium battery, a nickel metal hydride battery, or a lithium ion battery. The power supply battery 68 may be a single-use primary battery such as a lithium battery or an alkaline battery. The power battery 68 is electrically connected to each circuit of the compound-eye digital camera 1 by being loaded into a battery storage chamber (not shown).

  The charge / light emission control units 43a and 43b are supplied with electric power from the power supply battery 68, and charge the flash light emitting capacitors (not shown) in order to cause the strobe lights 44a and 44b to emit light, respectively, and the light emission of the strobe lights 44a and 44b. To control.

  The charge / light emission control units 43a and 43b send various signals such as half-press / full-press operation signals of the release switches 5a and 5b, and signals indicating the light emission amount and the light emission timing to the main CPU 10 and the photometry / ranging CPUs 19a and 19b. Is supplied to the strobes 44a and 44b in response to being taken in from the camera, so that a desired light emission amount can be obtained at a desired timing.

1 shows an example having two imaging systems (first imaging system 2a and second imaging system 2b), the number of imaging systems may be three or more. Moreover, the arrangement of the imaging system may not be one horizontal row but may be two-dimensionally arranged.

  Further, instead of providing a release button for each imaging system as in the compound eye digital camera 1 described above, only one release button may be provided.

  In addition, the compound-eye digital camera 1 of FIG. 1 can perform not only stereoscopic shooting but also shooting from multiple viewpoints and all directions.

  The photographing, recording operation, and reproduction operation of the compound eye digital camera 1 configured as described above will be described.

  In this compound-eye digital camera 1, when a power button (not shown) is turned on, the main CPU 10 detects this, turns on the power in the camera, and enters a shooting standby state in the shooting mode. The 2D / 3D setting switch 8 is used to set either the 2D mode or the 3D mode. If necessary, the vertical shooting setting button 9 is pressed to set the vertical shooting.

  In this photographing standby state, the main CPU 10 normally displays a moving image (through image) on the image display LCD 6 as follows.

  First, the main CPU 10 refers to the 2D / 3D mode switching flag setting circuit 53 and detects whether the 2D mode for acquiring a single-viewpoint image (two-dimensional image) or the 3D mode for acquiring a multi-viewpoint image (three-dimensional image). To do. In the 2D mode, only the first imaging system 2a is driven, and in the 3D mode, the first imaging system 2a and the second imaging system 2b are driven. Hereinafter, the 3D mode will be described as an example.

  The first zoom lens 11a, the second zoom lens 11b, the first focus lens 13a, and the second focus lens 13b are extended to predetermined positions, and then the first image sensor 14a and the second image sensor 14b perform shooting for a through image. The through image is displayed on the image display LCD 6. That is, images are continuously captured by the first image sensor 14a and the second image sensor 14b, and the image signals are continuously processed to generate image data for through images. The generated image data is sequentially added to the controller 34, converted into a display signal format, and output to the image display LCD 6. As a result, the images captured by the first image sensor 14a and the second image sensor 14b are displayed through on the image display LCD 6.

  A user (photographer) performs framing while viewing a through image displayed on the image display LCD 6, confirms a subject to be photographed, confirms an image after photographing, and sets photographing conditions.

  When the release switches 5a and 5b are half-pressed in the shooting standby state, an S1 ON signal is input to the main CPU 10. The main CPU 10 detects this and performs AE metering and AF control. At the time of AE photometry, the brightness of the subject is measured based on the integrated value of the image signal taken in via the first image sensor 14a and the second image sensor 14b. This photometric value (photometric value) is used to determine the aperture values of the first aperture 12a and the second aperture 12b and the shutter speed at the time of actual photographing. At the same time, it is determined from the detected subject brightness whether or not the strobe light emission is necessary. At the same time, it is determined from the detected subject brightness whether or not the strobe light emission is necessary. When it is determined that the strobes 44a and 44b need to emit light, the strobes 44a and 44b are pre-lighted, and the light emission amounts of the strobes 44a and 44b during actual photographing are determined based on the reflected light. Further, the vertical shooting detection circuit 50 detects whether the vertical shooting or horizontal shooting.

  When the release switches 5a and 5b are fully pressed, the S2ON signal is input to the main CPU 10. The main CPU 10 executes photographing and recording processing in response to the S2ON signal.

  First, the main CPU 10 drives the first aperture 12a and the second aperture 12b via the aperture controllers 16a and 16b based on the aperture value determined based on the photometric value, and also determines based on the photometric value. The charge accumulation time (so-called electronic shutter) in the first image sensor 14a and the second image sensor 14b is controlled so as to achieve the shutter speed.

  The main CPU 10 calculates an AF evaluation value and an AE evaluation value from each of the first image data and the second image data stored in the buffer memories 32a and 32b. The AF evaluation value is calculated by integrating high-frequency components of the luminance value for the entire area or predetermined area (for example, the central portion) of each image data, and represents the sharpness of the image. The high-frequency component of the luminance value is a sum of luminance differences (contrast) between adjacent pixels in a predetermined area. The AE evaluation value is calculated by integrating the luminance values over the entire area or a predetermined area (for example, the central portion) of each image data, and represents the brightness of the image. The AF evaluation value and the AE evaluation value are respectively used in an AF operation and an AE operation that are executed during an imaging preparation process described later.

  The main CPU 10 controls the first focus lens 13a and the second focus lens 13b and moves them in predetermined directions while the main CPU 10 calculates the AF calculated from each of the first image data and the second image data obtained sequentially. An AF operation (contrast AF) is performed by obtaining the maximum evaluation value.

  At this time, when the strobes 44a and 44b are caused to emit light, the strobes 44a and 44b are caused to emit light based on the light emission amounts of the strobes 44a and 44b obtained from the result of the pre-emission.

  The subject light enters the light receiving surface of the first image sensor 14a via the first zoom lens 11a, the first diaphragm 12a, and the first focus lens 13a. Further, the light enters the light receiving surface of the second image sensor 14b via the second zoom lens 11b, the second diaphragm 12b, and the second focus lens 13b.

  The first image sensor 14a and the second image sensor 14b are composed of color CCDs provided with R, G, and B color filters in a predetermined color filter array (for example, honeycomb array, Bayer array). Light incident on the light receiving surfaces of the image sensor 14a and the second image sensor 14b is converted into signal charges in an amount corresponding to the amount of incident light by the photodiodes arranged on the light receiving surfaces. The signal charge accumulated in each photodiode is read according to the timing signal applied from the timing generator (TG) 18a, and is sequentially output from the first image sensor 14a and the second image sensor 14b as a voltage signal (image signal), The signals are input to the A / D converters 30a and 30b.

  The A / D converters 30a and 30b include a CDS circuit and an analog amplifier. The CDS circuit performs correlated double sampling processing on the CCD output signal based on the CDS pulse, and the analog amplifier sets the photographing sensitivity applied from the main CPU 10. The image signal output from the CDS circuit is amplified by the gain for use. In the A / D converters 30a and 30b, analog image signals are converted into digital image signals, respectively.

  The first image data and the second image data output from the A / D converters 30a and 30b are subjected to various image processing such as gradation conversion, white balance correction, and γ correction processing by the image signal processing circuits 31a and 31b, respectively. And temporarily stored in the buffer memories 32a and 32b.

  The R, G, B image signals read from the buffer memories 32a, 32b are converted into luminance signals Y and color difference signals Cr, Cb (YC signals) by the YC processing units 35a, 35b, and the Y signals are contour corrected. Outline enhancement processing is performed by the circuit. The YC signals processed by the YC processing units 35a and 35b are stored in the work memories 24a and 24b, respectively.

  The YC signals stored in the buffer memories 32a and 32b as described above are compressed by the compression / decompression processing circuits 36a and 36b, and are recorded on the memory card 38 through the I / F 39 as image files of a predetermined format. . In the case of the compound-eye digital camera 1 of this example, the data of the still image two-dimensional image is stored in the memory card 38 as an image file according to the Exif standard. The Exif file has an area for storing main image data and an area for storing reduced image (thumbnail image) data. A thumbnail image having a specified size (for example, 160 × 120 or 80 × 60 pixels) is generated from the main image data obtained by shooting through pixel thinning processing and other necessary data processing. The thumbnail image generated in this way is written in the Exif file together with the main image. Also, tag information such as shooting date / time, shooting conditions, and face detection information is attached to the Exif file. The video data is MPEG2, MPEG4, H.264. The data is compressed according to a predetermined compression format such as H.264 and stored in the memory card 38.

  When image data of a three-dimensional image is recorded on the memory card 38, a protect flag is written in tag information attached to the image data. The image data in which the protect flag or the like is written is stored in the memory card 38 as an image file for which protection is set (details will be described later). Further, when vertical shooting is detected by the vertical shooting detection circuit 50, a vertical shooting flag is written in tag information attached to the image data. Note that the protect flag is not set when shooting in 2D mode.

  The image data recorded on the memory card 38 in this way is reproduced and displayed on the image display LCD 6 by setting the mode of the compound-eye digital camera 1 to the reproduction mode. The transition to the playback mode is performed by pressing a playback button (not shown).

  When the playback mode is selected, the image file of the last frame recorded on the memory card 38 is read out via the I / F 39. The compressed data of the read image file is expanded into an uncompressed YC signal via the compression / decompression processing circuits 36a and 36b.

  The decompressed YC signal is held in the buffer memories 32a and 32b (or a VRAM (not shown)), converted into a display signal format by the controller 34, and output to the image display LCD 6. As a result, the last frame image recorded on the memory card 38 is displayed on the image display LCD 6.

  Thereafter, when the forward frame advance switch (right key of the cross key) is pressed, the frame is advanced in the forward direction, and when the reverse frame advance switch (left key of the cross key) is pressed, the frame is advanced in the reverse direction. Then, the frame-positioned image file at the frame position is read from the memory card 38, and the image is reproduced on the image display LCD 6 in the same manner as described above.

  While confirming the image reproduced and displayed on the image display LCD 6, the image recorded on the memory card 38 can be erased as necessary. The image is erased when the photo mode button is pressed while the image is reproduced and displayed on the image display LCD 6. The image erasing will be described later in detail.

  As described above, the compound-eye digital camera 1 captures, records, and reproduces an image. In the above description, the case of taking a still image has been described, but the same applies to the case of a moving image. The shooting of moving images and still images is controlled by individual release buttons. In addition, switching between a moving image and a still image may be performed by a mode selection SW and a menu for moving images and still images.

<3D image shooting and recording>
A method for setting the protect flag setting circuit 52 to capture and record image data of a three-dimensional image will be described.

(First embodiment)
FIG. 2 is a flowchart showing a series of flows for capturing and recording an image in the 3D mode. The main CPU 10 performs control according to this flowchart.

  It is determined whether or not a shooting instruction has been input (step S10). If the shooting instruction is not input (NO in step S10), the process returns to step S10 again. If the shooting instruction is input (YES in step S10), the 2D / 3D setting switch 8 is set to the 3D mode. Whether it is set to the 2D mode or not is detected (step S11).

  It is determined whether or not the 2D / 3D setting switch 8 is set to the 3D mode (step S12). When the 2D / 3D setting switch 8 is set to the 3D mode (YES in step S12), the operation mode is switched to the 3D mode (step S13), and the 2D / 3D setting switch 8 is set to the 2D mode. In the case (NO in step S12), the photographing mode is switched to the 2D mode (step S19).

  First, the case of 2D mode (steps S19 to S21) will be described.

  The protect flag setting circuit 52 is turned off (step S20), one predetermined imaging system is driven, and a two-dimensional image is acquired (step S21). In the present embodiment, only the first imaging system 2a is driven.

  Next, the case of the 3D mode (steps S14 to S18) will be described.

  The protect flag setting circuit 52 is set to ON (step S14), and an operation test of a plurality of imaging systems (first imaging system 2a and second imaging system 2b) is performed (step S15).

  In the operation test, the operation statuses of the plurality of imaging systems are acquired (step S16), and it is determined whether or not the plurality of imaging systems have been operated (step S17). When the plurality of imaging systems do not operate normally (NO in step S17), the mode is switched to the 2D mode (step S19). When the plurality of imaging systems operate normally (YES in step S17), the plurality of imaging systems are driven and a three-dimensional image is acquired (step S18).

  Next, file initialization is performed (step S22), and the acquired two-dimensional image or image data of the three-dimensional image is captured and recorded in the memory card 38 (step S23).

  It is determined whether shooting has been completed (step S24). If it is determined that shooting has not ended (NO in step S24), it is determined whether or not a predetermined time has elapsed after shooting and recording are performed in step S23 (step S25). If the predetermined time has not elapsed (NO in step S25), step S25 is performed again. If the predetermined time has elapsed (YES in step S25), a step of taking and recording is performed (step S23). Return to).

  If it is determined that shooting has ended (YES in step S24), the header information of the image data recorded in step S23 is updated (step S26). That is, when the image is taken in the 3D mode, the acquired three-dimensional image data is recorded in the memory card 38 with the protect flag set to ON in step S14 being written in the header.

  Although the above description has been made on the case where a still image is taken, the same applies to the case where a moving image is taken. Since moving images are continuously shot, when writing information such as the shooting time of the moving images, a protect flag is written at the same time.

  In this way, the 3D image is automatically captured and recorded by setting the protect flag, so that the 3D image captured by the device corresponding to the 3D image is edited by the device corresponding to the 2D image only. When performing the above, it is possible to protect the three-dimensional image from being erased and to prevent information necessary for reproducing the three-dimensional image from being erased.

  In addition, since the three-dimensional image is protected, it is possible to prevent the three-dimensional image from being erased even if the user is careless or malfunctions.

  In the present embodiment, the protect flag is set to ON in the case of a three-dimensional image, but the image file access flag may be recorded as “write prohibited”.

(Second Embodiment)
In order to construct a three-dimensional image, at least two two-dimensional images taken from different angles in the left-right direction are required. When taking a vertically shot image with the compound-eye digital camera 1, a two-dimensional image from different angles in the left-right direction cannot be acquired, and a three-dimensional image cannot be formed.

  In the second embodiment in which the protect flag setting circuit 52 is set to shoot and record the image data of a three-dimensional image, it is determined whether it is vertical shooting or horizontal shooting in the 3D mode. The mode is switched from the 2D mode. FIG. 3 is a flowchart showing a series of flows of the second embodiment for capturing and recording an image in the 3D mode. The main CPU 10 performs control according to this flowchart. Note that portions similar to those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  It is determined whether or not a shooting instruction has been input (step S10). If the shooting instruction is not input (NO in step S10), the process returns to step S10 again. If the shooting instruction is input (YES in step S10), the 2D / 3D setting switch 8 is set to the 3D mode. Whether it is set to 2D mode or not is determined (step S11).

  It is determined whether or not the 2D / 3D setting switch 8 is set to the 3D mode (step S12). When the 2D / 3D setting switch 8 is set to the 3D mode (YES in step S12), the operation mode is switched to the 3D mode (step S13), and the 2D / 3D setting switch 8 is set to the 2D mode. In the case (NO in step S12), the photographing mode is switched to the 2D mode (step S19).

  In the 2D mode (step S19), the protect flag setting circuit 52 is turned off (step S20), one predetermined imaging system is driven, and a two-dimensional image is acquired (step S21).

  When the mode is switched to the 3D mode (step S13), the protect flag setting circuit 52 is set to ON (step S14), and an operation test of a plurality of imaging systems (the first imaging system 2a and the second imaging system 2b) is performed. (Step S15).

  In the operation test, the operation statuses of the plurality of imaging systems are acquired (step S16), and it is determined whether or not the plurality of imaging systems have been operated (step S17). When the plurality of imaging systems do not operate normally (NO in step S17), the mode is switched to the 2D mode (step S19).

  When a plurality of imaging systems operate normally (YES in step S17), information indicating whether or not the vertical shooting is performed is acquired from the vertical shooting detection circuit 50 (step S27), and the vertical image for acquiring the vertical shooting image is acquired. It is determined whether or not the shooting mode is set (step S28).

  If the vertical shooting mode is selected (YES in step S28), the 3D image cannot be acquired, and the mode is switched to the 2D mode (step S19).

  When the mode is not the vertical shooting mode (NO in step S28), a three-dimensional image can be acquired, so that a plurality of imaging systems are driven and a three-dimensional image is acquired (step S18).

  Next, file initialization is performed (step S22), image data of the acquired two-dimensional image or three-dimensional image is captured, and the captured image data is recorded in the memory card 38 (step S23).

  It is determined whether shooting has been completed (step S24). If it is determined that shooting has not ended (NO in step S24), it is determined whether a predetermined time has elapsed after shooting and recording are performed in step S23 (step S25). If the predetermined time has not elapsed (NO in step S25), step S25 is performed again, and if the predetermined time has elapsed (YES in step S25), a step of shooting and recording (step Return to S23).

  If it is determined that shooting has ended (YES in step S24), the header information of the image data recorded in step S23 is updated (step S26). That is, when the image is taken in the 3D mode, the protect flag set to ON in step S14 is written in the header.

  In the above description, in the case of vertical shooting, shooting is performed with one imaging system. However, the imaging system may be configured to perform shooting with a number smaller than the maximum number.

  In this way, the 3D image is automatically captured and recorded by setting the protect flag, so that the 3D image captured by the device corresponding to the 3D image is edited by the device corresponding to the 2D image only. Even when performing the above, it is possible to protect the three-dimensional image from being erased.

  In addition, since the three-dimensional image is protected, it is possible to prevent the three-dimensional image from being erased even if the user is careless or malfunctions.

Even in the 3D mode, if a 3D image cannot be acquired, such as vertical shooting, the protection flag can be turned off by automatically switching to the 2D mode. Thereby, it is possible to prevent the image data from being protected unnecessarily.

<When a memory card on which a three-dimensional image is recorded is connected>
A case where a memory card 38 on which a two-dimensional image or a three-dimensional image is recorded is connected to the compound-eye digital camera 1 will be described.

  A three-dimensional image photographed by the compound-eye digital camera 1 as described above is automatically protected simultaneously with the recording of the image, but is three-dimensionally photographed by a compound-eye digital camera that cannot be automatically protected. It is desirable that the image is protected.

  A method for automatically protecting an unprotected 3D image will be described below.

(First embodiment)
FIG. 4 is a flowchart showing a processing flow when the memory card 38 is connected to the compound-eye digital camera 1 by a method such as inserting the memory card 38 into the card throttle of the compound-eye digital camera 1. The main CPU 10 performs control according to this flowchart.

  First, it is determined whether or not an instruction to protect a three-dimensional image has been given by menu selection or the like (step S30). If the 3D image is not protected (NO in step S30), the process ends. If the 3D image is to be protected (YES in step S30), it is determined whether or not the memory card 38 has been inserted into the card throttle (step S31). Note that the processing of step S30 can be omitted, and protection can be applied to all the cards inserted. However, by making it possible to select whether or not to protect a three-dimensional image, the degree of freedom of user selection can be increased.

  If the memory card 38 is not inserted into the card throttle (NO in step S31), step S31 is performed again.

  When the memory card 38 is inserted into the card throttle (YES in step S31), it is determined whether or not there is an image on the memory card 38 (step S32).

  If there is no image on the memory card 38 (NO in step S32), the process ends.

  If there is an image on the memory card 38 (YES in step S32), it is determined whether or not the image includes a three-dimensional image (step S33).

  If a 3D image is not included (NO in step S33), the process ends.

  If a 3D image is included (YES in step S33), the protect flag is set to ON for the 3D image (step S34), and the protect flag is written in the header (step S35).

  Then, it is determined whether or not the processing (steps S34 and S35) in which the protect flag is turned on and written to the header has been performed for all the three-dimensional images included in the memory card 38 (step S36).

  If the processes in steps S34 and S35 have not been completed for all three-dimensional images (NO in step S36), the processes in steps S34 and S35 are performed again.

  If the processes in steps S34 and S35 have been completed for all three-dimensional images (YES in step S36), the process is terminated.

  When the above processing (steps S30 to S36) is completed, all the processing may be completed, or the above-described protection flag setting circuit 52 is set to perform processing for photographing and recording image data of a three-dimensional image. It may be.

  Thus, when a card including a 3D image is inserted, the 3D image is protected by automatically protecting the 3D / multi-viewpoint image by protecting the 3D image. You can also protect images automatically.

  In this embodiment, the insertion of the memory card is detected, and if it is inserted, it is detected whether there is image data or a file. First, all the data and files of the three-dimensional image are searched, and the search information The flag may be rewritten based on the above.

  In this embodiment, all three-dimensional images are protected (step S34). However, the tag information attached to the three-dimensional image is examined, and an already protected three-dimensional image is obtained. May not be protected, and may be protected only for an unprotected three-dimensional image.

  In this embodiment, the insertion of the memory card is detected and the three-dimensional image recorded on the memory card is protected. However, the present invention is not limited to the memory card. The present invention can also be applied to a three-dimensional image recorded in a server or the like connected via the network. In this case, it is only necessary to detect that the compound-eye digital camera is connected to a PC or a server on the network, and then perform steps S32 to S36.

(Second Embodiment)
In the first embodiment for automatically protecting a non-protected three-dimensional image, a protect flag is set for the three-dimensional image searched by the memory card 38. A method for protecting a three-dimensional image is not limited to a method for setting a protect flag for each image data.

  The second embodiment for automatically protecting a three-dimensional image is to protect the memory card itself on which the three-dimensional image is recorded. FIG. 5 is a flowchart showing a series of flows of the second embodiment for automatically protecting a three-dimensional image. The main CPU 10 performs control according to this flowchart. Note that portions similar to those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  It is determined whether or not the memory card 38 has been inserted into the card throttle (step S31). If the memory card 38 is not inserted into the card throttle (NO in step S31), step S31 is performed again.

  When the memory card 38 is inserted into the card throttle (YES in step S31), the remaining capacity of the memory card 38 is detected (step S37), and the remaining capacity in which a newly shot image can be recorded is stored in the memory card 38. It is determined whether or not there is (step S38).

  If the memory card 38 has a remaining capacity for recording a newly taken image (NO in step S38), the process is terminated.

  If the memory card 38 does not have a remaining capacity for recording a newly shot image (YES in step S32), it is determined whether or not to set protection for the entire memory card 38 (step S39).

  If the entire memory card 38 is not protected (NO in step S39), a warning display indicating that the memory card 38 has run out of capacity is displayed (step S43), and the processing is thereafter terminated.

  When the entire memory card 38 is protected (YES in step S39), it is determined whether or not there is a three-dimensional image in the memory card 38 (step S40).

  If there is no 3D image in the memory card 38 (NO in step S40), a warning display indicating that the memory card 38 has run out of capacity is displayed (step S43), and the processing is thereafter terminated.

  If there is a three-dimensional image in the memory card 38 (YES in step S40), the protection flag of the entire memory card is set to ON (step S41), and the protection flag is added to the tag information attached to the memory card 38 or the like. It is written (step S42).

  Thereafter, a warning display indicating that the memory card 38 has run out of capacity is displayed (step S43), and the process ends.

  When the above processes (steps S31 and S37 to S43) are completed, all the processes may be terminated, or the above-described protection flag setting circuit 52 is set and the process of photographing and recording the image data of the three-dimensional image is performed. You may make it perform.

  In this way, by protecting the entire recording medium on which the three-dimensional image is recorded, the multi-viewpoint image captured by a device that cannot automatically protect the 3D / multi-viewpoint image is automatically detected. Can be protected.

  Further, when the protection flag is set for the three-dimensional image included in the recording medium, the image data and the recording medium are protected twice, so that the image data can be protected. Can be strong.

  In addition to the text display for displaying the message on the screen, the warning method may use voice, an alarm, or the like.

  In this embodiment, the insertion of the memory card is detected and the entire memory card is protected. However, the present invention is not limited to the memory card, and is connected via a PC connected to a compound-eye digital camera, a LAN, or the like. It can also be applied to image folders on the server. In this case, it is detected that the compound-eye digital camera is connected to the PC or the server on the network, and it is detected whether or not there is an image folder on the PC or the server, and then the processing of steps S40 to S42 is performed. do it.

<Erasing and editing 3D images>
Deletion and editing of the three-dimensional image recorded in the memory card 38 and set with the protect flag will be described.

  Since the protect flag is set for the three-dimensional image for protecting the three-dimensional image, the image cannot be erased or edited as it is. However, when the user is aware of this, if it is necessary to erase or edit the image, it is necessary to make the process possible.

  Hereinafter, a method for erasing and editing a three-dimensional image with the protect flag set will be described.

(When deleting 3D images)
FIG. 6 is a flowchart showing the flow of the 3D image erasing process. In order to perform this process, it is necessary to set in advance an erasure permission mode that enables the erasure of the three-dimensional image with the protect flag set using the protect release switch 7. The main CPU 10 performs control according to this flowchart.

  It is determined whether or not the operation mode of the compound-eye digital camera 1 is set to an erasure mode that is an operation mode for erasing a two-dimensional image or a three-dimensional image (step S50).

  If the erase mode is not set (NO in step S50), the process ends.

  If the erasing mode is set (YES in step S50), an image to be erased is selected (step S51), and a message warning that the image is to be erased is displayed (step S52). The image is selected by pressing the information position designation key while the image to be deleted is displayed on the image display LCD 6. Further, the image erasure warning is performed by the main CPU 10 displaying an image erasure message such as “Are you sure you want to erase this picture” on the image display LCD 6 over the image via the controller 34. . In addition to the text display as described above, a voice or the like may be used for the warning.

  Next, it is determined whether or not the selected image is a three-dimensional image (step S53). If the selected image is not a three-dimensional image (NO in step S53), the process proceeds to steps (steps S63 to S65) for deleting the two-dimensional image.

  If the selected image is a three-dimensional image (YES in step S53), it is detected whether or not an erasure permission flag is set for the three-dimensional image (step S54). The erasure permission flag is a flag that is set only when an erasure permission mode that enables erasure of a three-dimensional image for which the protect flag is set is set. For each three-dimensional image for which the protect flag is set, Is set.

  It is determined whether or not an erasure permission flag is set for the selected three-dimensional image, that is, whether or not an erasure permission flag is detected in step S54 (step S55).

  If the erasure permission flag is not set (NO in step S55), the erasure permission mode is not set, that is, the three-dimensional image cannot be erased, so that a warning is given that the image cannot be erased. A message is displayed (step S56), and the process is terminated.

  If the erasure permission flag is set (YES in step S55), a message to warn the erasure of the three-dimensional image is displayed (step S57), and it is detected whether or not an erasure command is input by the user. (Step S58). The deletion command is input when the information position designation key is pressed.

  It is determined whether or not the image can be erased by inputting the erase command (step S59). If erasing is not possible (NO in step S59), it is detected again whether or not an erasing command is input by the user (step S58).

  If the image can be erased (YES in step S59), the protection flag of the three-dimensional image is canceled (step S60), and the erasure process is performed (step S61). The protection flag is released by a system call. The erasing process is performed by erasing the image file recorded on the memory card 38 via the I / F 39.

  In the step of erasing the two-dimensional image (steps S63 to S65), a message to warn the erasure of the two-dimensional image is displayed (step S63), and it is detected whether or not an erasure command is input by the user (step S64). ). The deletion command is input when the information position designation key is pressed.

  It is determined whether or not the image can be erased by inputting the erase command (step S65). If erasure is not possible (NO in step S65), it is detected again whether or not an erasure command is input by the user (step S64).

  If the image can be erased (YES in step S65), an erasure process is performed (step S61). The erasing process is performed by erasing the image file recorded on the memory card 38 via the I / F 39.

  When the above processes (steps S50 to S65) are completed, all the processes may be completed, the erasing process may be performed again, or the mode may be automatically shifted to the photographing mode.

  Accordingly, since a warning is issued before the 3D image is deleted, it is possible to prevent the user from deleting the 3D image by mistake.

  In addition, if a device that supports 3D images is set to allow image deletion, 3D images can be deleted. Therefore, 3D images that are known to be deleted can be deleted. So there is no need to keep unnecessary files.

  Note that this embodiment can be applied not only to a three-dimensional image such as an internal memory or a storage medium but also to a three-dimensional image on a PC or a server on a network. In addition, by using a program for performing the above-described processing, it can be applied not only to a compound-eye digital camera but also to various devices such as a PC and a terminal for image printing.

(When editing 3D images)
FIG. 7 is a flowchart showing the flow of editing processing of a three-dimensional image. This is processing in the edit permission mode, which is an operation mode that enables editing of a three-dimensional image in which the protect flag is set. The main CPU 10 performs control according to this flowchart. This process can be started in a state where the edit permission mode is set in advance on the setting screen of the compound-eye digital camera 1 or the like. In the following description, the same reference numerals are assigned to the same processes as the three-dimensional image erasing process, and the description thereof is omitted.

  It is determined whether or not the operation mode of the compound-eye digital camera 1 is set to an edit mode that is an operation mode for editing a two-dimensional image or a three-dimensional image (step S70).

  If the edit mode is not set (NO in step S70), the process ends.

  If the editing mode is set (YES in step S70), an image to be edited is selected (step S51), and a message to warn editing of the image is displayed (step S71). The image is selected by pressing the information position designation key while the image to be edited is displayed on the image display LCD 6. Further, the image editing warning is performed by the main CPU 10 displaying a message on the image display LCD 6 via the controller 34, such as “Are you sure you want to edit this picture?”, Overlaid on the image. . In addition to the text display, a voice or the like may be used for the warning.

  Next, it is determined whether or not the selected image is a three-dimensional image (step S53). If the selected image is not a three-dimensional image (NO in step S53), the process proceeds to steps for editing the two-dimensional image (steps S81 to S85).

  If the selected image is a three-dimensional image (YES in step S53), it is detected whether an edit permission flag is set for the three-dimensional image (step S72). The edit permission flag is a flag that is set only when an edit permission mode that enables editing of a three-dimensional image for which the protect flag is set is set. For each three-dimensional image for which the protect flag is set, Is set.

  It is determined whether or not an edit permission flag is set for the selected three-dimensional image, that is, whether or not an edit permission flag has been detected in step S72 (step S73).

  If the edit permission flag is not set (NO in step S73), a warning is given that the edit permission mode is not set, that is, the three-dimensional image cannot be edited, so that the image cannot be edited. A message is displayed (step S74), and the process is terminated.

  If the edit permission flag is set (YES in step S73), a message to warn editing of the three-dimensional image is displayed (step S75), and it is detected whether an edit command has been input by the user. (Step S76). An edit command is input by pressing an information position designation key.

  It is determined whether the editing of the image is enabled by the input of the editing command (step S77). If editing is not possible (NO in step S77), it is detected again whether an editing command has been input by the user (step S76).

  If the image can be edited (YES in step S77), the protection flag of the three-dimensional image is canceled (step S60), and the three-dimensional image editing process is performed (step S78). In the editing process, a plurality of types of editing contents are registered in advance, and the editing contents are executed by selecting desired editing contents from among them with the information position designation key and pressing the menu / OK.

  When the editing process is completed, the three-dimensional image file is updated from the file before editing to the file after editing (step S79), and a protect flag is written to the updated file (step S80). As a result, the edited three-dimensional image file is protected.

  In the step of editing the two-dimensional image (steps S81 to S85), a message to warn the editing of the two-dimensional image is displayed (step S81), and it is detected whether or not an editing command has been input by the user (step S82). ). An edit command is input by pressing an information position designation key.

  It is determined whether or not the image can be edited by the input of the editing command (step S83). If editing is not possible (NO in step S83), it is detected again whether an editing command has been input by the user (step S82).

  If the image can be edited (YES in step S83), the two-dimensional image is edited (step S84), and the two-dimensional image file is updated from the file before editing to the file after editing. (Step S85). The editing process (step S84) is the same as the three-dimensional image editing process (step S78).

  When the above processing (steps S51, S53, S70 to S85) is completed, all processing may be completed, editing processing may be performed again, or the mode may be automatically shifted to the shooting mode. Also good.

  As described above, since the protection flag is automatically set for the three-dimensional image, even when editing the three-dimensional image taken by the device corresponding to the three-dimensional image with the device corresponding only to the two-dimensional image, The 3D image never disappears carelessly.

  In addition, since a warning is issued before the editing of the 3D image, the user can be prevented from editing the 3D image by mistake. For example, if the 3D image is prohibited from being edited by the protect flag, the user can carefully copy the 3D image with another file name and edit the copied 3D image. Thereby, the photographed three-dimensional image can be effectively protected.

  In addition, by setting a protect flag for the edited 3D image, not only the captured 3D image but also the edited 3D file can be protected.

  If the device corresponding to the three-dimensional image is set to allow image editing, the three-dimensional image can be edited, so that the image can be edited on the device.

  When editing of an image is selected, the copied image can be edited by copying the image to another file close to the file name of the selected image.

  Also, a warning may be issued before recording. Thereby, it is possible to prevent recording of a three-dimensional image edited by mistake.

  Note that this embodiment can be applied not only to a three-dimensional image such as an internal memory or a storage medium but also to a three-dimensional image on a PC or a server on a network. In addition, by using a program for performing the above-described processing, it can be applied not only to a compound-eye digital camera but also to various devices such as a PC and a terminal for image printing.

  According to the present invention, the compatibility with the conventional standard can be ensured only by making the present invention compatible with a device that conforms to the 3D / multi-viewpoint standard, and thus the occurrence of problems caused by the presence of the 3D / multi-viewpoint. Can be prevented.

  The three-dimensional image is not necessarily acquired by the compound-eye digital camera 1 as described above, and may be acquired by continuous shooting using a motion stereo method using a monocular camera.

  1: compound eye digital camera, 2a: first imaging system, 2b: second imaging system, 6: image display LCD, 10: main CPU, 38: memory card, 50: vertical shooting detection circuit, 51: vertical shooting flag setting circuit 52: Protect flag setting circuit, 53: 2D / 3D mode switching flag setting circuit

Claims (14)

Shooting mode switching means for switching between a multi-viewpoint image shooting mode for shooting a subject image viewed from a plurality of viewpoints and a one-viewpoint image shooting mode for shooting a subject image viewed from one viewpoint;
Shooting mode detection means for detecting the shooting mode switched by the shooting mode switching means;
Imaging means for acquiring a multi-viewpoint image or a single-viewpoint image shot in the shooting mode switched by the shooting mode switching means;
Recording means for recording a multi-viewpoint image or one-viewpoint image acquired by the imaging means on a recording medium;
Protect that sets protection for the multi-view image recorded by the recording unit so that the multi-view image is not changed or deleted when the multi-view image shooting mode is detected by the shooting mode detection unit. Setting means;
With
The protection setting means includes the multi-viewpoint to be recorded based on an erasure prohibition flag for prohibiting erasure of the recorded multi-viewpoint image and an edit prohibition flag for prohibiting editing the recorded multi-viewpoint image. An image pickup apparatus, wherein erasure prohibition and edit prohibition can be individually set for an image.   2. The protection setting means can set both erasure prohibition and edit prohibition of the multi-view image for the recorded multi-view image by one flag. The imaging device described. An erasing mode setting means for setting an erasing mode for erasing a desired image selected from the images when an image including the multi-viewpoint image is recorded in the recording means;
Erasing mode detecting means for detecting whether the erasing mode is set;
A warning means for giving a warning that the multi-viewpoint image is erased when the desired image is the multi-viewpoint image when the erasure mode is detected by the erasure mode detection section;
If the selection of the multi-viewpoint image is determined after giving a warning by the warning unit, an erasing unit that cancels and erases the protection set in the selected multi-viewpoint image;
The imaging apparatus according to claim 1, further comprising: An edit mode setting means for setting an edit mode for editing a desired image selected from the images when an image including the multi-viewpoint image is recorded in the recording means;
Editing mode detecting means for detecting whether the editing mode is set;
A warning means for giving a warning to the effect that the multi-viewpoint image is edited when the edit mode is detected by the edit mode detection section and the desired image is the multi-viewpoint image;
If the selection of the multi-viewpoint image is determined after giving a warning by the warning means, the protection release means for canceling the protection set in the selected multi-viewpoint image,
Editing means for editing the multi-viewpoint image that has been unprotected by the unprotecting means;
With
The storage unit records the multi-viewpoint image edited by the editing unit on a recording medium, and the protection setting unit applies the multi-viewpoint image to the edited multi-viewpoint image recorded by the recording unit. The imaging apparatus according to claim 1, wherein protection is set so that the data is not changed or deleted.   The imaging apparatus according to claim 4, wherein the recording unit records the multi-viewpoint image edited by the editing unit in the recording unit after giving a warning again. The imaging means includes
A plurality of imaging systems having a plurality of optical systems and imaging elements for forming a subject image;
When the multi-viewpoint image capturing mode is switched by the capturing mode switching unit, the plurality of imaging systems are driven, and when the single-viewpoint image capturing mode is switched by the capturing mode switching unit, one image capturing is performed. Driving means for driving the system;
Drive detection means for detecting whether the drive of the imaging system is completed by the drive means;
With
In the case where the multi-viewpoint image capturing mode is detected by the capturing mode detecting means and the drive detecting means detects that the plurality of imaging systems are not driven, the capturing mode switching means The imaging apparatus according to any one of claims 1 to 5, wherein the viewpoint image capturing mode is switched to the one viewpoint image capturing mode. A vertical shooting detection means for detecting whether or not the subject image is in a vertical shooting state,
When the shooting mode switching means switches to the multi-viewpoint image shooting mode and the vertical shooting detection means detects that the subject image is being shot vertically, the shooting mode switching means The imaging apparatus according to any one of claims 1 to 6, wherein the viewpoint image capturing mode is switched to the one viewpoint image capturing mode. Connection means to which a recording medium capable of recording a subject image is connected;
Detecting means for detecting that the recording medium is connected to the connecting means;
A first determination unit that determines whether a multi-viewpoint image that is a subject image viewed from a plurality of viewpoints is recorded on the recording medium when the detection unit detects a connection of the recording medium;
When the first determination unit determines that the multi-viewpoint image is recorded, a protection is set so that the multi-viewpoint image is not changed or deleted with respect to the recorded multi-viewpoint image. First protection setting means,
With
The first protection setting means includes the erase prohibition flag for prohibiting the erase of the recorded multi-viewpoint image and the edit prohibition flag for prohibiting the editing of the recorded multi-viewpoint image. An image reproduction apparatus characterized in that editing prohibition and deletion prohibition can be individually set for a multi-viewpoint image.   The first protection setting means can set both prohibition of editing and erasure of the multi-viewpoint image with respect to the recorded multi-viewpoint image by one flag. Item 9. The image playback device according to Item 8. Second determination means for determining whether a new subject image can be recorded on the recording medium when the detection means detects the connection of the recording medium;
When the second determination unit determines that a new subject image cannot be recorded on the recording medium, a multi-viewpoint image or a one-viewpoint image recorded on the recording medium is changed or changed with respect to the recording medium. A second protect setting means for setting a protect so as not to be deleted;
The image reproducing apparatus according to claim 8, further comprising:   The imaging apparatus according to any one of claims 1 to 7, further comprising the image reproducing apparatus according to any one of claims 8 to 10. Switching between a multi-viewpoint image capturing mode for capturing a subject image viewed from a plurality of viewpoints and a one-viewpoint image capturing mode for capturing a subject image viewed from one viewpoint;
Detecting the switched shooting mode;
Acquiring a multi-viewpoint image or a single-viewpoint image shot in the switched shooting mode;
Recording the acquired multi-viewpoint image or single-viewpoint image on a recording medium;
Protect setting step for setting protection so that the multi-viewpoint image is not changed or deleted with respect to the recorded multi-viewpoint image when the multi-viewpoint image shooting mode is detected in the step of detecting the shooting mode. When,
With
The protection setting step sets an erasure prohibition flag when prohibiting erasure of the recorded multi-viewpoint image, and sets an edit prohibition flag when prohibiting editing of the recorded multi-viewpoint image. An imaging method characterized by the above. Connecting a recording medium capable of recording a subject image;
Detecting that the recording medium is connected;
When connection of the recording medium is detected, determining whether a multi-viewpoint image, which is a subject image viewed from a plurality of viewpoints, is recorded on the recording medium;
If it is determined that the multi-viewpoint image is recorded in the step of determining whether the multi-viewpoint image is recorded on the recording medium, the multi-viewpoint image is recorded with respect to the recorded multi-viewpoint image. A protection setting step for setting protection so that the viewpoint image is not changed or deleted;
With
The protection setting step sets an erasure prohibition flag when prohibiting erasure of the recorded multi-viewpoint image, and sets an edit prohibition flag when prohibiting editing of the recorded multi-viewpoint image. An imaging method characterized by the above.   A program for causing an arithmetic device to execute the imaging method according to claim 12 or 13.

Images