JP5415820B2 - Imaging device - Google Patents

Description

  The present invention relates to an imaging apparatus capable of capturing a stereoscopically displayable image by capturing a subject from a plurality of different viewpoints.

  A technique for capturing a still image (3D still image) or a moving image (3D moving image) capable of 3D display (stereoscopic display) by capturing the same subject from a plurality of different viewpoints is known.

  As a method of photographing an image that can be displayed in 3D, for example, as disclosed in Japanese Patent No. 3722498, a method of photographing from a plurality of viewpoints while moving one imaging device by a predetermined distance is known. Yes. In addition, as a method of shooting an image that can be displayed in 3D, a method of shooting using an imaging device including two imaging lenses that are spaced apart by a predetermined distance, or two imaging devices are predetermined. There is also known a method of shooting while being fixed in a state separated by a distance of.

  Also, as disclosed in, for example, Japanese Patent No. 4148811, a display device that displays 3D images is becoming common, and users can easily shoot and view 3D still images and 3D moving images. It is possible.

Japanese Patent No. 3722498 Japanese Patent No. 4148811

  A display device that displays a 3D image is characterized by being able to provide the viewer with a realistic image. However, the viewer obtains a sense from the 3D image and a sense of the viewer's actual surrounding environment. If there is an inconsistency, the viewer may feel uncomfortable or tired eyes.

  For example, when a 3D moving image is captured by a portable imaging device, the subject vibrates in the 3D moving image due to the movement of the photographer or camera shake. When viewing a 3D moving image in which the subject vibrates in this way, the viewer's head is actually still, but the viewer feels that the 3D moving image is visually perceived as if the head is The viewer feels uncomfortable because it is as if it is vibrating.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide an imaging apparatus capable of providing a 3D moving image that does not cause discomfort to the viewer.

An imaging apparatus according to an aspect of the present invention includes a photographing unit capable of photographing a 3D moving image by photographing a subject from a plurality of viewpoints having parallax, and a predetermined cycle of the subject in the 3D moving image. Image vibration detecting unit for detecting similar vibrations of the image, the 3D moving image, and the similar vibrations of the subject detected by the image vibration detecting unit during shooting of the 3D moving image at a predetermined number of times or a vibration period occurring continuously, and a recording unit for recording in association with, provided with an image display unit capable of displaying and reproducing the 3D moving image, in the image display unit, the 3D video When displaying an image, the 3D moving image is controlled to be displayed as a 2D moving image during the vibration period recorded in the recording unit in association with the 3D moving image .
An imaging device according to another aspect of the present invention includes an imaging unit capable of imaging a 3D moving image by imaging a subject from a plurality of viewpoints having parallax, and the subject in the 3D moving image. An image vibration detection unit that detects similar vibrations with a predetermined period, the 3D moving image, and similar vibrations of the subject detected by the image vibration detection unit during shooting of the 3D moving image with a predetermined period And a recording unit that records the vibration period continuously generated a predetermined number of times or more in association with each other.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device which can provide the 3D moving image which does not give a viewer discomfort can be provided.

It is a perspective view which shows the front side of a digital camera. It is a perspective view which shows the back side of a digital camera. It is a block diagram explaining the schematic structure of a digital camera. It is a flowchart of 3D effect determination processing. It is a flowchart of a problem vibration determination process. It is a figure explaining the area | region which calculates the motion vector of a to-be-photographed object. It is a figure explaining a mode that a subject is vibrating in a 3D animation. It is a flowchart of a main routine. It is a flowchart of a moving image shooting process. It is a flowchart of a similar vibration determination process. It is a flowchart of a reproduction process. It is a figure explaining the structure of the digital camera of 2nd Embodiment.

  A preferred embodiment of the imaging apparatus of the present invention will be described with reference to the drawings. Below, the example which applied this invention to the digital camera 1 as an imaging device is demonstrated as an example. In each drawing used for the following description, the scale is different for each component in order to make each component large enough to be recognized on the drawing. It is not limited only to the quantity of the component described in the figure, the shape of the component, the ratio of the size of the component, and the relative positional relationship of each component.

(First embodiment)
The digital camera 1 according to the present embodiment is an apparatus capable of electronically recording still images and moving images, and obtains an image capable of stereoscopically displaying a subject by photographing the same subject from a plurality of different viewpoints. Is for.

  Hereinafter, a combination of still images having parallax and a combination of moving images having parallax obtained by photographing a subject from a plurality of different viewpoints are referred to as a 3D still image and a 3D moving image, respectively. In addition, a still image and a moving image having no parallax obtained by photographing a subject from one viewpoint are referred to as a 2D still image and a 2D moving image, respectively.

  As an example, the digital camera 1 of the present embodiment includes a photographing unit 2 that photographs a subject from two viewpoints separated by a base length BL having a predetermined length as shown in FIG. The imaging unit 2 includes a left imaging unit 2a and a right imaging unit 2b that respectively correspond to two viewpoints.

  The digital camera 1 can record a 3D still image and a 3D moving image of the subject by photographing the subject from different viewpoints by the left photographing unit 2a and the right photographing unit 2b. Further, the digital camera 1 can record a 2D still image and a 2D moving image of the subject by photographing the subject with one of the left photographing unit 2a and the right photographing unit 2b.

  The configuration of the photographing unit 2 is not particularly limited as long as it can shoot a subject with parallax from two different viewpoints, but in this embodiment, the left photographing unit 2a and the right photographing unit 2b It is assumed that each is configured with an imaging lens and an image sensor such as a CCD sensor or a CMOS sensor.

  The photographing unit 2 includes a single image sensor and a pair of photographing lenses that are disposed in the left photographing unit 2a and the right photographing unit 2b, respectively, and form a subject image on the image sensor. The light beam from the pair of photographing lenses to the image sensor may be switched at high speed by a movable mirror, a liquid crystal shutter, or the like. For example, if a left viewpoint image obtained via the left photographing unit 2a and a right viewpoint image obtained via the right photographing unit 2b can be switched and photographed every 1/120 seconds by the imaging device, two different images can be obtained. It is possible to record a 3D still image and a 3D moving image obtained by photographing a subject substantially synchronously from the viewpoint.

  First, an external configuration of the digital camera 1 will be described with reference to FIGS. 1 and 2. In addition to the left photographing unit 2a and the right photographing unit 2b described above, a microphone 3 for recording sound is disposed on the front surface of the digital camera 1 facing the subject.

  On the back surface of the digital camera 1, a speaker 7 for outputting sound and an image display unit 10 for displaying and outputting an image are disposed. The speaker 7 can output sound recorded simultaneously with the shooting of 2D moving images and 3D moving images, for example.

  The image display unit 10 is capable of displaying 2D still images and 2D moving images, and displaying 3D still images and 3D moving images by displaying images having parallax taken from two different viewpoints. It is configured to be able to. Since such an image display unit 10 is well known, detailed description thereof will be omitted. The image display unit 10 may be configured as a so-called touch panel that includes a touch sensor as an operation member on the display surface.

  In addition, operation members for a user to input an operation instruction of the digital camera 1 are disposed on the upper surface and the rear surface of the digital camera 1. The operation members include a still image shooting switch 4, a moving image shooting switch 5, a power switch 6, a zoom operation switch 8, a cross switch 9, and the like.

  The still image shooting switch 4 is a switch for inputting an instruction for a 2D still image or 3D still image shooting operation by the digital camera 1. The moving image shooting switch 5 is a switch for inputting instructions for starting and stopping the shooting operation of the 2D moving image or 3D moving image by the digital camera 1.

  The power switch 6 is a switch for inputting a switching instruction between the power-on state and the power-off state of the digital camera 1. The zoom operation switch 8 is a switch for inputting an instruction for changing the focal length (zoom operation) of the left photographing unit 2a and the right photographing unit 2b. The cross switch 9 is a switch for inputting an instruction to change the operation mode of the digital camera 1.

  In the present embodiment, the operation member is configured by a plurality of push switches, but the operation member is configured to include a lever switch, a dial switch, a touch sensor, an illuminance sensor, an acceleration sensor, and the like. There may be.

  Next, a configuration for controlling the operation of the digital camera 1 will be described with reference to FIG. The digital camera 1 includes a control unit 20, an operation determination unit 11, a recording unit 12, and a clock unit 13. Although not shown, the digital camera 1 is provided with a power supply unit for supplying power necessary for the operation of each component of the digital camera 1. Note that the digital camera 1 may be provided with a communication unit capable of transmitting and receiving images and the like by wired or wireless communication with an external device.

  The control unit 20 includes an arithmetic device, a storage device, an input / output device, a power control device, and the like, and is a control device that controls the operation of each unit configuration of the digital camera 1 based on a predetermined program. The control unit 20 includes an image processing unit 21, a 3D effect determination unit 22, and an image vibration detection unit 23 as components necessary for realizing the operation of the digital camera 1 described later. The mounting of the image processing unit 21, the 3D effect determination unit 22, and the image vibration detection unit 23 on the control unit 20 may be hardware or software.

  The image processing unit 30 performs predetermined image processing on the image photographed by the photographing unit 2. In the present embodiment, the image processing unit 30 includes a face recognition unit 24 that recognizes the number, position, size, and facial expression of a person's face in an image by predetermined image processing such as pattern matching. Yes. In addition, the image processing unit 30 includes a contrast calculation unit that calculates a contrast value of an image to be used for a focusing operation in the photographing unit 2.

  Although the details will be described later, the 3D effect determination unit 22 is based on information such as the focal length and focusing distance of the photographing unit 2 and the position and size of a person's face in the image recognized by the face recognition unit 24. It is determined whether or not the distance between the digital camera 1 and the main subject has an appropriate relationship with respect to the base line length BL of the photographing unit 2 in a stereoscopic display.

  As will be described in detail later, the image vibration detection unit 23 calculates a motion vector in the moving image based on a comparison between frames of the moving image during shooting of the moving image by the shooting unit 2, and a digital camera for the subject. 1 to detect fluctuations in the period of a predetermined range. In other words, the image vibration detection unit 23 detects vibrations of a predetermined range of the subject in the moving image.

  The operation determination unit 11 determines an operation instruction input by the user via the operation member described above. The determination result by the operation determination unit 11 is output to the control unit 20.

  The recording unit 12 is a device capable of recording information. In the present embodiment, the recording unit 12 records an image photographed by the photographing unit 2. The recording unit 12 includes a recording medium such as a semiconductor nonvolatile memory or a small hard disk drive. The recording unit 12 may be separate from the digital camera 1 and may be capable of exchanging information with the digital camera 1 using a wired or wireless communication format.

  The clock unit 13 is for recording the date and time of the image photographed by the photographing unit 2. The date and time read from the clock unit 13 is added to the image shot by the digital camera 1 as shooting date and time information.

  The operation of the digital camera 1 having the above-described configuration will be described below with reference to the flowcharts of FIGS.

  First, the detailed operation of the 3D effect determination unit 22 will be described. The 3D effect determination unit 22 performs the 3D effect determination process illustrated in FIG. The 3D effect determination process generally determines whether or not the distance between the digital camera 1 and the main subject has an appropriate relationship with respect to the base line length BL of the photographing unit 2 in a stereoscopic display. It is processing.

  For example, when the distance between the digital camera 1 and the main subject is long, the difference between the left viewpoint image obtained by the left photographing unit 2a and the right viewpoint image obtained by the right photographing unit 2b, that is, the parallax becomes slight. Therefore, it is difficult to obtain a 3D still image or a 3D moving image that can effectively perform a stereoscopic display.

  In the present embodiment, an appropriate value LA of the distance between the digital camera 1 and the main subject is taken as an example in consideration of the size of the baseline length BL that can be set when the digital camera 1 is easily portable. 3m. The value LA is preferably determined in consideration of the specifications of a display device that displays a 3D still image or a 3D moving image.

  Hereinafter, a case where the distance between the digital camera 1 and the main subject has an appropriate relationship with respect to the base line length BL of the photographing unit 2 is referred to as the 3D effect being effective, and is inappropriate. The 3D effect is referred to as invalid if the relationship is in a negative relationship.

  First, in step S20, the face recognition unit 24 performs face recognition processing for recognizing the presence of a human face in the image obtained by the photographing unit 2. In step S21, it is determined whether or not a human face exists in the center of the image. That is, in step S21, it is determined whether or not a person is a main subject.

  If it is determined in step S21 that a human face exists in the center of the image, the process proceeds to step S22. In steps S22 to S24, the distance between the digital camera 1 and the main subject is three-dimensional based on the face size Df in the image of the person who is the main subject and the focal length Z of the photographing lens of the photographing unit 2. It is determined whether or not there is an appropriate relationship to display a correct display.

  Specifically, in step S24, the representative value Df of the face size of the person closest to the center in the image, such as the area of the person's face and the number of pixels in the vertical direction, is determined by the focal length Z of the photographing lens. If the divided value is larger than the predetermined value A0, it is determined in step S25 that the 3D effect is effective. If the value obtained by dividing the representative value Df of the size of the person's face by the focal length Z is equal to or less than the predetermined value A0, it is determined in step S28 that the 3D effect is invalid.

  Here, in step S24, the representative value Df of the size of the person's face is divided by the focal length Z when the focal length Z is large even if the face of the person who is the main subject in the image is large. This is because the distance between the digital camera 1 and the person is so long that it is difficult to obtain the 3D effect. If the representative value Df of the size of a person's face is divided by the focal length Z as in this embodiment, the influence of such a change in the focal length Z of the photographing lens can be eliminated.

  The predetermined value A0 used for the determination is determined in consideration of an appropriate value LA of the distance between the digital camera 1 and the main subject, the size of the image sensor of the imaging unit 2, and the like.

  On the other hand, if it is determined in step S21 that a person's face does not exist in the center of the image, that is, if the main subject is not a person, the process proceeds to step S26. In step S26 and step S27, it is considered that the focused subject is the main subject, and the distance between the digital camera 1 and the main subject is displayed in a three-dimensional manner based on the focusing distance L of the photographing lens. Determine whether the relationship is appropriate.

  Specifically, in step S27, if the in-focus distance L of the photographing lens is smaller than an appropriate value LA of the distance between the digital camera 1 and the main subject, it is determined in step S25 that the 3D effect is effective. . On the other hand, if the in-focus distance L of the photographing lens is not less than the appropriate value LA of the distance between the digital camera 1 and the main subject, it is determined in step S28 that the 3D effect is invalid.

  In this embodiment, when a person's face is recognized at the center of the image, the validity / invalidity of the 3D effect is determined based on the size of the person's face in the image. However, there is a person in the image. Whether the 3D effect is valid or invalid may be determined based on the focusing distance L of the photographing lens regardless of whether or not it is performed.

  Next, the detailed operation of the image vibration detection unit 23 will be described with reference to FIGS. The image vibration detection unit 23 performs a problem vibration determination process shown in FIG. In general, the problem vibration determination process detects the vibration of the subject in the 3D moving image captured by the image capturing unit 2, and if the amplitude of the vibration is a predetermined value or more, the vibration is determined to be a problem vibration. It is the process which determines as.

  In the present embodiment, as an example, as illustrated in FIG. 6, the image vibration detection unit 23 includes an area A <b> 1 above the center part and an area below the center part of the 3D moving image being shot by the shooting unit 2. It is possible to calculate the motion vector of the subject in a predetermined unit time in the two areas A2.

  First, in step S60, a motion vector X1 in the area A1 above the center of the 3D moving image is calculated. Next, in step S61, a motion vector X2 in the area A2 below the center of the 3D moving image is calculated.

  Next, as shown in step S62 and step S63, the magnitudes of the magnitudes of the motion vectors X1 and X2 in the two regions A1 and A2 are compared. For example, as shown in FIG. 7, in the 3D moving image, when the subject is swinging about the center lower side as the center, the size of the motion vector X1 in the region A1 is larger than the motion vector in the region A2. It becomes larger than X2.

  Then, as shown in steps S64 and S65, the magnitude of the motion vector determined to be larger among the motion vectors X1 and X2 is temporarily stored as X3. Further, as shown in step S64, when the magnitude of the motion vector X1 in the area A1 is larger than the motion vector X2 in the area A2, this vibration is stored as the pattern 1. On the other hand, when the magnitude of the motion vector X2 in the area A2 is larger than the motion vector X1 in the area A1, as shown in step S65, this vibration is stored as the pattern 2.

  Next, in step S66, it is determined whether or not the value of X3 is larger than a predetermined threshold value X0. That is, it is determined whether or not the amplitude of vibration is greater than or equal to a predetermined value. If the value of X3 is larger than the predetermined threshold value X0, this vibration is determined as a problem vibration in step S67.

  In this embodiment, as shown in FIG. 6, the vibration of the subject is determined from the motion vectors in the two regions of the image, but the present invention is not limited to this embodiment. For example, the area for calculating the motion vector in the image may be further increased. When the subject is a person, the vibration of the subject in the 3D moving image may be determined from changes in the position and angle of the face of the person recognized by the face recognition unit 24 between frames.

  Next, a main routine for operation control of the digital camera 1 will be described with reference to FIG. This main routine is started when the power switch 6 is operated and the digital camera 1 is turned on.

  First, in step S01, it is determined whether or not an instruction input for operating the power switch 6 to turn off the digital camera 1 has been made. When it is determined that an instruction to turn off the power has been input, the digital camera 1 is turned off after completion processing such as moving the position of the photographing lens to a predetermined position.

  On the other hand, if it is determined that an instruction to turn off the power has not been input, the process proceeds to step S02 to determine whether the operation mode of the digital camera 1 is set to the shooting mode.

  If it is determined in step S02 that the shooting mode is not set, it is determined in step S03 whether the operation mode of the digital camera 1 is set to the playback mode. If it is determined in step S03 that the playback mode is not set, the fact that there is an abnormality in the operation mode setting is displayed on the image display unit 10, and the process returns to step S01. If it is determined in step S03 that the playback mode is set, a playback process described later in detail is executed in step S04.

  On the other hand, if it is determined in step S02 that the shooting mode is set, the process proceeds to step S10. In step S10 and step S11, the latest through image of the subject, so-called live view, is displayed on the image display unit 10. Specifically, in step S10, photographing is performed by at least one of the left photographing unit 2a and the right photographing unit 2b of the photographing unit 2, and the image is displayed on the image display unit 10 in step S11.

  In step S12, the 3D effect determination process described with reference to FIG. 4 is executed. That is, it is determined whether or not the 3D effect is effective for the image captured in step S10.

  If it is determined in step S12 that the 3D effect is effective, in step S14, a message indicating that a 3D still image that can be effectively displayed stereoscopically can be taken is displayed on the image display unit 10. . Note that the sound may indicate that the 3D effect is effective. In step S10, when both the left photographing unit 2a and the right photographing unit 2b are photographed, in step S14, the left viewpoint image and the right viewpoint image are simultaneously displayed on the image display unit 10 to perform 3D display. Also good.

  In step S15 and step S17, it is determined whether or not an instruction for capturing a still image or a moving image is input by the user. If it is determined that an instruction for capturing a still image or a moving image has not been input, the process returns to step S01.

  If it is determined in step S15 that the user has operated the still image shooting switch 4 and an instruction for a 2D still image or 3D still image shooting operation has been input, the process proceeds to step S16 and the shooting unit 2 performs 2D A still image or a 3D still image is captured and recorded in the recording unit 12. In step S16, whether to capture and record a 2D still image or a 3D still image is determined according to the operating conditions set in advance by the user.

  When the 3D effect is valid, a 3D still image is shot. When the 3D effect is invalid, a 2D still image is shot by only one of the left shooting unit 2a and the right shooting unit 2b. A mode in which the operation of the photographing unit 2 is automatically switched may be employed. In such a form, when the 3D effect is invalid, it is possible to stop the left photographing unit 2a and the right photographing unit 2b that are not used for photographing, thereby reducing power consumption. Further, the recording capacity of the recording unit 12 can be saved.

  On the other hand, if it is determined in step S17 that the user has operated the moving image shooting switch 5 to input a moving image shooting operation start instruction, the process proceeds to step S18, and a moving image shooting process described later in detail is performed. Run.

Next, the moving image shooting process in step S18 will be described with reference to FIG.
In the present embodiment, in the moving image shooting process, the left shooting unit 2 a and the right shooting unit 2 b of the shooting unit 2 shoot a subject from a plurality of different viewpoints, and record a 3D moving image of the subject in the recording unit 12. . As will be described in detail later, in this moving image shooting process, when a vibration determined to be a problem vibration by the image vibration detection unit 23 continues for a predetermined period at a predetermined period during the shooting of a 3D moving image, Is recorded as the vibration period.

  First, as shown in step S30, shooting of a 3D moving image is started. In the present embodiment, sound is also recorded in synchronization with the 3D moving image. In step S31, the vibration period counter M, which is an integer variable, is set to zero.

  Next, in step S32, it is determined whether or not an instruction to end the moving image shooting operation is input by operating the moving image shooting switch 5 again. If it is determined in step S32 that an instruction to end the shooting operation of the moving image has been input, the process proceeds to step S50, where the 3D moving image and sound are filed and recorded in the recording unit 12, and the vibration period is included in the file. And record the information.

  If it is determined in step S32 that an instruction to end the moving image shooting operation is not input, the process proceeds to step S33, and the above-described problem vibration determination process is performed by the image vibration detection unit 23.

  If it is not determined that the problem vibration has occurred in the problem vibration determination process in step S33, the process returns to step S31 (NO in step S34). On the other hand, if it is determined that the problem vibration has occurred in the problem vibration determination process in step S33, the process proceeds to step S35 (YES in step S34).

  In step S35, 1 is added to the value of the vibration period counter M, and the value of the vibration frequency counter N, which is an integer variable, is set to 0. Then, the similar vibration determination process shown in FIG. 10 is executed. In the similar vibration determination process, as shown in step S70, the above-described problem vibration determination process is performed by the image vibration detection unit 23. As shown in step S72, the vibration determined to be the latest problem vibration is the problem vibration in the past. It is determined whether the vibration determined to be the same of the pattern 1 and the pattern 2 or not.

  Here, if the vibration determined as the latest problem vibration is the same pattern as the vibration determined as the problem vibration in the past, this vibration is determined as a similar vibration. For example, as shown in FIG. 7, when the subject repeatedly swings around the lower center portion in the 3D moving image, the vibration of the pattern 1 is repeatedly generated, so it is determined that the similar vibration has occurred. .

  If it is determined that no similar vibration has occurred (NO in step S37), 1 is subtracted from the value of the vibration period counter M in step S49, and the process returns to step S32. On the other hand, when it is determined that the similar vibration has occurred (YES in step S37), the generation time of the similar vibration and the previous vibration generation time determined to be the same pattern as the similar vibration in step S38. It is determined whether or not the interval between is within a predetermined range.

  That is, in step S38, it is determined whether or not the generation cycle of the problem vibration having the same pattern is within a predetermined range. Here, the predetermined range is, for example, about 0.1 to 1 second.

  If it is determined in step S38 that the problem vibration occurrence pattern of the same pattern is outside the predetermined range (NO in step S38), 1 is subtracted from the value of the vibration period counter M in step S49, and step S32 is executed. Return to.

  On the other hand, if it is determined in step S38 that the problem vibration occurrence interval of the same pattern is within the predetermined range (YES in step S38), 1 is added to the value of the vibration counter N in step S39.

  In step S40, it is determined whether or not the value of the vibration frequency counter N is greater than 3. That is, in step S40, it is determined whether the same pattern of problem vibrations has been repeated a predetermined number of times or more. If the value of the vibration counter N is 3 or less, the process returns to step S36. If the value of the vibration counter N is greater than 3, the process proceeds to step S41.

  In step S41, the current time is recorded as the start time ts (M) of the Mth vibration period. In step S42, the value of the timer Tw is set to zero. Here, the timer Tw is a count-up timer, that is, starts counting from the time of step S42.

  In step 43, the above-described similar vibration determination process is executed. If it is determined in the similar vibration determination process in step S43 that similar vibration has occurred (YES in step S44), the process returns to step S42. That is, while the similar vibration is repeatedly generated, the value of the timer Tw is continuously reset to 0.

  If it is determined in the similar vibration determination process in step S43 that no similar vibration has occurred (NO in step S44), the process proceeds to step S45, and it is determined whether or not the value of the timer Tw is greater than 5 seconds. judge. In step S45, when the value of the timer Tw is 5 seconds or less, the process returns to step S43.

  On the other hand, if the value of the timer Tw is greater than 5 seconds in step S45, that is, if the similar vibration has not occurred for a period longer than 5 seconds, the process proceeds to step S46. In step S46, the current time is recorded as the end time te (M) of the Mth vibration period.

  As described above, in the moving image shooting process according to the present embodiment, problem vibrations of a subject having a predetermined vibration amplitude (pattern) with a similar amplitude or more are generated four times in a period between 0.1 second and 1 second. When it repeats, the vibration period start time ts (M) is recorded.

  Then, after the problem vibration no longer occurs, when the value of the timer Tw exceeds 5 seconds, the end time te (M) of the vibration period is recorded. Until the value of the timer Tw reaches 5 seconds, that is, when a problem vibration having a similar pattern is newly generated while the current vibration period continues, the value of the timer Tw is set to 0 again, and the vibration period of 5 seconds. To extend.

  In the present embodiment, it is assumed that the vibration of the subject having a period between 0.1 second and 1 second is a problem vibration. However, the value of this period is not limited to this embodiment. The period and amplitude of the problem vibration may be changed by the user in addition to a preset value.

Next, the reproduction process in step S04 will be described with reference to FIG.
As shown in step 80, the reproduction process is performed during the period in which the operation mode of the digital camera 1 is set to the reproduction mode. In the reproduction process, first, in step S81, a so-called thumbnail display is performed in which a list of still images and moving images recorded in the recording unit 12 is displayed on the image display unit 10.

  If it is determined in step S82 that the user inputs an instruction to select either a still image or a moving image from the operation member, the process proceeds to step S83, and the selected one is stationary. Whether it is an image or a moving image is determined.

  If a still image is selected, the selected still image is enlarged and displayed on the image display unit 10 in step S84. Here, when it is determined that the user has input a feed instruction by operating the cross switch 9 or the like (YES in step S85), the process returns to step S83 assuming that the next still image or moving image is selected. If it is determined that a list display instruction has been input by operating the zoom operation switch 8 or the like (YES in step S86), the process returns to step S80.

  On the other hand, if it is determined in step S83 that the image selected by the user is a 3D moving image, in step S90, information on the vibration period associated with the selected 3D moving image is read.

  Next, in step S91, the selected 3D moving image is reproduced and displayed on the image display unit 10. During the playback operation of this 3D moving image, as shown in step S92 and step S93, when the playback time of the moving image is in the vibration period, the 3D moving image is displayed on the image display unit 10 as a 2D moving image. To do. Here, during the vibration period, as described above, it is a period between the start time ts (M) and the end time ts (M) of the vibration period recorded in the recording unit 12.

  In order to display a 3D moving image as a 2D moving image, one of images captured by the left photographing unit 2a and the right photographing unit 2b may be displayed simultaneously as a left viewpoint image and a right viewpoint image. In step S93, the sound recorded simultaneously with the 3D moving image is reproduced as it is and displayed from the speaker 7 while being displayed as the 2D moving image.

  Then, as shown in step S94, the determination in step S92 is repeated for each frame until the reproduction of the 3D moving image being reproduced ends or an instruction to end the reproduction process is input by the operation member.

  As described above, in the present embodiment, even when a 3D moving image is played back, the 3D moving image is played back as a 2D moving image during a vibration period in which vibration of a predetermined region of the subject is generated. indicate.

  As described above, the digital camera 1 according to the present embodiment detects vibrations of a predetermined period of a subject in a 3D moving image and captures a vibration period during which the vibration is generated when capturing a 3D moving image. Recorded in the recording unit 12 together with the 3D moving image. When the 3D moving image is reproduced and displayed on the image display unit 10, the 3D moving image is set as a 2D moving image during the vibration period in which the vibration of the subject in the 3D moving image is detected. indicate.

  For this reason, the digital camera 1 according to the present embodiment does not display a 3D moving image in a state where the subject vibrates at a period in which it is easy for the viewer to feel uncomfortable. 3D moving images can be displayed.

  In the above-described embodiment, the image vibration detection unit 23 detects the vibration of the subject in the 3D image. However, the image vibration detection unit 23 detects the sudden movement of the subject based on the motion vector in the 3D image. You may detect expansion and reduction. In this case, it is possible to prevent the viewer from feeling uncomfortable due to enlargement or reduction of the subject due to a sudden zoom operation or the like.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described with reference to FIG. The second embodiment differs from the first embodiment described above only in the configuration of the image vibration detection unit 23. Hereinafter, only this difference will be described, and the same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof will be omitted as appropriate.

  In the present embodiment, as shown in FIG. 12, the image vibration detection unit 23 includes a vibration detection sensor 25. The vibration detection sensor 25 is for detecting the vibration of the digital camera 1 and is composed of, for example, an angular acceleration sensor, an acceleration sensor, or the like.

  The image vibration detection unit 23 calculates the vibration of the subject in the 3D moving image based on the vibration state of the digital camera 1 detected by the vibration detection sensor 25 and the focal length Z of the photographing lens of the photographing unit 2. Then, vibration of a predetermined cycle of the subject is detected.

  Such a configuration eliminates the need for processing that requires a relatively high processing capability of calculating a motion vector of a subject from comparison between frames of a 3D moving image. Power can be reduced. The vibration detection sensor 25 can be used in combination with a camera shake detection sensor used in a so-called camera shake prevention mechanism.

  Note that the present invention is not limited to the above-described embodiments, and can be appropriately changed without departing from the spirit or idea of the invention that can be read from the claims and the entire specification. The apparatus is also included in the technical scope of the present invention.

  For example, in the above-described embodiment, the state in which the subject vibrates with a period that is likely to cause discomfort to the viewer during shooting of the 3D moving image is detected. If image blurring occurs in at least one of the image and the left viewpoint image, the viewer may be uncomfortable. Therefore, the imaging device is capable of capturing a 3D still image, and when blurring of an image is detected in at least one of the right viewpoint image and the left viewpoint image when capturing the 3D still image, the image is recorded as a 2D still image. Alternatively, an imaging apparatus that displays a 3D still image in which blur is detected as a 2D still image is also included in the present invention.

  In the above-described embodiment, the digital camera 1 includes a pair of the left photographing unit 2a and the right photographing unit 2b corresponding to two viewpoints. For example, two digital cameras having a single photographing unit are provided. The present invention can also be applied to a configuration in which the two digital cameras are used in combination and operated in a substantially synchronized manner by wired or wireless communication.

  The present invention is not limited to the digital camera described in the above-described embodiment, and is applied to electronic devices such as a recording device, a mobile phone, a PDA, a personal computer, a game machine, a digital media player, a television, a GPS, and a clock having a photographing function. Is also applicable.

1 Digital digital camera,
2 Shooting department,
2a Left shooting part,
2b Right shooting part,
3 Microphone,
4 Still image shooting switch,
5 Movie shooting switch 5,
6 Power switch,
8 Zoom operation switch,
9 Cross switch 9,
10 Image display section,
11 Operation determination unit,
12 Recording section,
13 Clock part,
20 control unit,
21 Image processing unit,
22 Subject status determination unit,
23 Image vibration detection unit,
24 Face recognition unit.

Claims (2)

A photographing unit capable of photographing a 3D moving image by photographing a subject from a plurality of viewpoints having parallax;
An image vibration detection unit for detecting similar vibrations of the subject in a predetermined cycle in the 3D moving image;
The 3D moving image, and a vibration period in which similar vibrations of the subject detected by the image vibration detecting unit during the shooting of the 3D moving image are continuously generated at a predetermined frequency for a predetermined number of times. A recording unit for recording in association;
An image display unit capable of reproducing and displaying the 3D moving image ;
Comprising
In the image display unit, the when displaying 3D moving image, the in vibration period recorded in the recording unit associated with the 3D moving image, the 3D moving image, to display a 2D video image An image pickup apparatus that is controlled to the above. A photographing unit capable of photographing a 3D moving image by photographing a subject from a plurality of viewpoints having parallax;
An image vibration detection unit for detecting similar vibrations of the subject in a predetermined cycle in the 3D moving image;
The 3D moving image, and a vibration period in which similar vibrations of the subject detected by the image vibration detecting unit during the shooting of the 3D moving image are continuously generated at a predetermined frequency for a predetermined number of times. A recording unit for recording in association;
An imaging apparatus comprising:

Images