JP5750779B2 - Imaging apparatus, image communication system, and image communication method - Google Patents

Description

  The present invention relates to an imaging device that captures and displays an image, and an image communication system that includes the imaging device and performs image communication according to a predetermined communication standard.

  In recent years, by acquiring a plurality of image data for the same subject and using the parallax of the subject included in the acquired plurality of image data, a three-dimensional image (hereinafter, referred to as a three-dimensional image) that can be viewed three-dimensionally by a user. An imaging apparatus such as a digital stereo camera that captures a “3D image”) is becoming widespread. Conventionally, a technique for connecting such an imaging device to a display device capable of displaying a 3D image has been disclosed (see, for example, Patent Document 1). In this technique, a user can view a 3D image displayed on the display device by wearing dedicated liquid crystal shutter glasses.

JP-A-10-145820

  By the way, in the above-described conventional technology, a situation may occur in which the user watches the display unit of the imaging device and the display screen of the display device alternately while wearing the liquid crystal shutter glasses. Under such circumstances, when the display format on the display unit of the imaging device is different from the display format on the display device, the user has to feel uncomfortable with the 3D image displayed on the display unit of the imaging device. It was.

  The present invention has been made in view of the above, and even when a user views a 3D image on an external device in a state in which the user can communicate with the external device capable of displaying a 3D image, It is an object of the present invention to provide an imaging device capable of displaying an image that does not give a sense of incongruity, and an image communication system that includes the imaging device and performs image communication.

  In order to solve the above-described problems and achieve the object, an imaging apparatus according to the present invention includes an imaging unit that captures an image of a subject and generates image data, and an external device capable of displaying a three-dimensional image and a predetermined unit. An imaging apparatus capable of communicating according to a communication standard, a display unit capable of displaying a three-dimensional image based on two images, and a display image displayed on the display unit by using at least one of the two images A display image generation unit to generate, a transmission image generation unit that generates a transmission image to be transmitted for display on the external device by using the two images, and a transmission generated by the transmission image generation unit. And a communication unit that transmits a trusted image to the external device.

  Moreover, the imaging device according to the present invention is characterized in that, in the above invention, the display image generation unit generates different display images depending on whether or not the communication unit transmits the transmission image. To do.

  Moreover, in the imaging device according to the present invention, in the above invention, the display image generation unit, when the communication unit transmits the transmission image, displays a composite image obtained by superimposing the two images as a display image. It is characterized by generating.

  The imaging device according to the present invention is the above-described invention, wherein the imaging device according to the present invention is provided on the display screen of the display unit and receives a signal input according to the position of an object in contact with the outside, and the display unit displays the touch panel. A parallax adjustment unit that adjusts the parallax of a subject included in the synthetic image according to a trajectory of an object that has touched the touch panel with respect to the synthetic image, and the synthetic image that the parallax adjustment unit has adjusted the parallax is displayed on the display unit. A display control unit that performs display control, and the transmission image generation unit uses the two images having the parallax adjusted by the parallax adjustment unit.

  In the imaging device according to the present invention, in the above invention, the composite image is an image obtained by cutting out and overlapping a predetermined region from the two images, and the parallax adjustment unit includes a cut-out region of the two images. It is characterized by changing.

  In the imaging device according to the present invention, in the above invention, the display image generation unit may display a three-dimensional image based on the two images as a display image when the communication unit does not transmit the transmission image. It is characterized by generating.

  In the imaging device according to the present invention, in the above invention, the imaging unit captures, as the two images, two images in which one end in the horizontal direction of each field of view overlaps and corresponds to each image. Two image data to be generated is generated.

  Moreover, the imaging device according to the present invention is characterized in that, in the above invention, the imaging unit includes two optical systems that respectively capture the two images.

  The imaging device according to the present invention is the imaging device according to the above invention, wherein the imaging unit has a function of continuously capturing images at a predetermined interval while the imaging device moves, and the transmission image generation unit and The display image generation unit extracts the two images from images continuously captured by the imaging unit.

  In the imaging device according to the present invention, in the above invention, the display control unit alternately arranges the two image data respectively corresponding to the two images for each pixel in the horizontal direction on the display screen. Control to output to the unit is performed.

  Further, an image communication system according to the present invention is a display that displays a three-dimensional image based on the image for transmission received from the image pickup apparatus and connected to the image pickup apparatus according to the invention described above. And a device.

  According to the present invention, since a display image displayed on the imaging device side and a transmission image transmitted to the external device for display on the external device side are individually generated, communication with an external device capable of displaying a 3D image is performed. An image that does not make the user feel uncomfortable can be displayed even when the user views a 3D image with an external device while being connected.

FIG. 1 is a diagram showing a configuration of an image communication system according to Embodiment 1 of the present invention. FIG. 2 is a block diagram showing a configuration of the imaging apparatus according to Embodiment 1 of the present invention. FIG. 3 is a schematic diagram illustrating a schematic configuration of a display unit included in the imaging apparatus according to Embodiment 1 of the present invention. FIG. 4 is a schematic diagram illustrating a situation when the imaging unit included in the imaging device according to Embodiment 1 of the present invention generates two image data in which one end in the left-right direction of each field of view overlaps. . FIG. 5 is a diagram illustrating an example of an image corresponding to two image data in which the imaging unit has one end in the horizontal direction of each other's visual field overlapping each other under the situation illustrated in FIG. 4. FIG. 6 is a diagram illustrating an example of an image in which the right eye image and the left eye image generated by the imaging unit under the situation illustrated in FIG. 4 are virtually overlapped. FIG. 7 is a diagram illustrating the relationship between the imaging distance between the imaging unit and the subject under the situation illustrated in FIG. FIG. 8 is a schematic diagram illustrating an outline of processing performed by the parallax adjustment unit included in the imaging apparatus according to Embodiment 1 of the present invention. FIG. 9 is a diagram illustrating an example of a synthesized image obtained by synthesizing the right eye image and the left eye image generated by the display image generating unit included in the imaging apparatus according to Embodiment 1 of the present invention. FIG. 10 is a diagram illustrating an example of a virtual 3D image displayed by the display device included in the image communication system according to Embodiment 1 of the present invention. FIG. 11 is a flowchart showing an outline of processing performed by the imaging apparatus according to Embodiment 1 of the present invention. FIG. 12 is a flowchart showing an overview of the parallax adjustment processing of FIG. FIG. 13 is a diagram for explaining an operation of increasing the parallax of the subject included in the composite image by the user. FIG. 14 is a diagram illustrating an example of an image displayed on the display unit included in the imaging apparatus according to Embodiment 1 of the present invention. FIG. 15 is a diagram illustrating another example of an image displayed on the display unit included in the imaging apparatus according to Embodiment 1 of the present invention. FIG. 16 is a diagram for explaining an operation of reducing the parallax of the subject included in the composite image by the user. FIG. 17 is a flowchart showing an outline of the reproduction display process of FIG. FIG. 18 is a diagram illustrating an adjustment method (first example) in which the parallax adjustment unit adjusts the parallax of a subject according to two external trajectories on the touch panel in the imaging apparatus according to Embodiment 1 of the present invention. is there. FIG. 19 is a diagram for explaining an adjustment method (second example) in which the parallax adjustment unit adjusts the parallax of the subject according to two external trajectories on the touch panel in the imaging apparatus according to Embodiment 1 of the present invention. is there. FIG. 20 is a block diagram showing the configuration of the imaging apparatus according to Embodiment 2 of the present invention. FIG. 21 is a diagram showing an outline of imaging using the imaging apparatus according to Embodiment 2 of the present invention. 22 is a diagram illustrating an example of two images respectively corresponding to two image data generated by the imaging unit under the situation illustrated in FIG. 21, and a 3D image as a display image generated by the display image generation unit. It is a figure which shows the example of a pair of image which comprises. FIG. 23 is a diagram illustrating a second example of two images respectively corresponding to two image data generated by the imaging unit under the situation illustrated in FIG. 21, and an example of a transmission image generated by the transmission image generation unit FIG. FIG. 24 is a flowchart illustrating an outline of processing performed by the imaging apparatus according to Embodiment 2 of the present invention. FIG. 25 is a diagram schematically illustrating a situation when the user views the display screen of the display device included in the image communication system according to Embodiment 2 of the present invention. FIG. 26 is a diagram illustrating a situation when the user looks at the display unit of the imaging apparatus according to the second embodiment of the present invention. FIG. 27 is a diagram illustrating another configuration example of the touch panel.

  DESCRIPTION OF EMBODIMENTS Hereinafter, modes for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the drawings.

(Embodiment 1)
FIG. 1 is a diagram showing a configuration of an image communication system according to Embodiment 1 of the present invention. An image communication system 100 shown in FIG. 1 is electrically connected to the imaging device 1 that is a digital stereo camera, and can receive image data from the imaging device 1 and display a 3D image. And a display device 200 as an external device.

  In the first embodiment, as the display device 200, a polarizing film is incorporated into the display screen 201 formed of a frame sequential method or a liquid crystal panel that switches between a right-eye image and a left-eye image displayed on the display screen 201 at high speed. A 3D television or the like that displays a 3D image by a polarizing film method is applied. When a user views a 3D image displayed on such a 3D television, it is necessary to wear dedicated glasses 300 corresponding to the method. Glasses 300 applied in the case of the frame sequential method are liquid crystal shutter glasses having a configuration capable of closing an eye opposite to an eye for viewing a displayed image in synchronization with switching of images. Further, in the glasses 300 applied in the polarization method, only the image for the left eye (hereinafter referred to as “left eye image”) reaches the left eye, and the image for the right eye (hereinafter referred to as “right eye image”) reaches the right eye. It has a configuration in which a polarizing filter is attached so that only can reach.

  FIG. 2 is a block diagram illustrating a configuration of the imaging apparatus 1. As illustrated in FIG. 2, the imaging device 1 captures images from different positions and generates two image data in which one end in the horizontal direction of each field of view overlaps, and the posture of the imaging device 1. A posture detection unit 3 to detect, an operation input unit 4 that receives input of various information of the imaging device 1, a clock 5 having a shooting date determination function and a timer function, and a two-dimensional image (hereinafter referred to as “2D image”). Or the display part 6 which displays a 3D image, the touchscreen 7 which receives the input of the signal according to the contact position and locus | trajectory from the outside, and the memory | storage part 8 which memorize | stores the various information containing the image data produced | generated by the imaging part 2 The control unit 9 that controls the operation of the imaging device 1 and the communication unit 10 that transmits and receives data to and from the display device 200 are provided.

  The imaging unit 2 includes a first imaging unit 21 and a second imaging unit 22 that have different optical systems. The first imaging unit 21 and the second imaging unit 22 are arranged side by side on the same plane so that their optical axes L1 and L2 are parallel or have a predetermined angle.

  The first imaging unit 21 includes a lens unit 21a, a lens driving unit 21b, a diaphragm 21c, a diaphragm driving unit 21d, a shutter 21e, a shutter driving unit 21f, an imaging element 21g, and a signal processing unit 21h. .

  The lens unit 21a is configured by a focus lens, a zoom lens, or the like, and collects light from a predetermined visual field region. The lens driving unit 21b is configured by a DC motor or the like, and changes the focus position and focal length of the lens unit 21a by moving the focus lens, the zoom lens, and the like of the lens unit 21a on the optical axis L1.

  The diaphragm 21c adjusts the exposure by limiting the amount of incident light collected by the lens unit 21a. The aperture drive unit 21d is configured by a stepping motor or the like, and drives the aperture 21c.

  The shutter 21e sets the state of the image sensor 21g to an exposure state or a light shielding state. The shutter drive unit 21f is configured by a stepping motor or the like, and drives the shutter 21e according to the release signal.

  The imaging element 21g is realized by a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like that receives the light collected by the lens unit 21a and converts it into an electrical signal (analog signal), and converts the converted electrical signal. It outputs to the signal processor 21h.

  The signal processing unit 21h performs signal processing such as amplification on the electrical signal output from the image sensor 21g, and then converts the digital signal to digital image data by performing A / D conversion, and outputs the digital image data to the control unit 9.

  The second imaging unit 22 is realized by the same configuration as the first imaging unit 21, and includes a lens unit 22a, a lens driving unit 22b, a diaphragm 22c, a diaphragm driving unit 22d, a shutter 22e, and a shutter driving unit 22f. The image sensor 22g and the signal processor 22h are included.

  The posture detection unit 3 is configured by an acceleration sensor, and detects the posture of the imaging device 1 by detecting the acceleration of the imaging device 1. Specifically, the posture detection unit 3 detects the posture of the imaging device 1 with respect to the horizontal plane.

  The operation input unit 4 includes a power switch 41 that switches the power state of the imaging device 1 to an on state or an off state, a release switch 42 that inputs a release signal that gives a still image shooting instruction, and various shooting modes of the imaging device 1. A change-over switch 43 for switching various settings and a zoom switch 44 for performing a zoom operation of the imaging unit 2 are provided.

  The timepiece 5 generates a time signal that serves as a reference for the operation of the imaging apparatus 1. Thereby, the control part 9 can set the acquisition time of image data, the exposure time of the image pick-up elements 21g and 22g, etc. The clock 5 also has a function as a timer for measuring time.

FIG. 3 is a schematic diagram illustrating a schematic configuration of the display unit 6. As shown in FIG. 2, the display unit 6 includes a backlight 61, a display panel 62, and a parallax barrier 63. The backlight 61 is configured by an LED (Light Emitting Diode) or the like, and irradiates light for displaying an image from the back side. The display panel 62 is configured by a display panel such as liquid crystal or organic EL (Electro Luminescence). The parallax barrier 63 is made of liquid crystal or the like and is laminated on the upper surface of the display panel 62. The parallax barrier 63 is provided with slits at an interval narrower than the interval between the pixels of the display panel 62, and separates images corresponding to the user's right eye E _R and left eye E _L , respectively. As such a parallax barrier 63, for example, a parallax barrier method is applied. Instead of the parallax barrier 63, a lens sheet in which lenticular lenses are stacked may be provided on the upper surface of the display panel 62.

In the display unit 6 having the above configuration, when 3D image data is input from the control unit 9, the display panel 62 performs horizontal alignment of the right eye image and the left eye image from the left end pixel in the horizontal direction under the control of the control unit 9. The images are alternately displayed in order, and the parallax barrier 63 separates the light emitted from each pixel of the display panel 62. For this reason, the right eye image reaches only the right eye E _R and the left eye image reaches only the left eye E _L. Thereby, the user can stereoscopically view the 3D image displayed on the display unit 6. Further, when the display unit 6 switches the display mode from the 3D image to the 2D image, the voltage applied to the parallax barrier 63 changes from the on state to the off state, so that the parallax barrier 63 transitions from the light shielding state to the transmission state. Then, either the right eye image or the left eye image is output to the display panel 62.

  The touch panel 7 is provided so as to overlap the display screen of the display unit 6. The touch panel 7 detects a position or locus touched (touched) based on information or an image displayed on the display unit 6 and accepts an input of an operation signal corresponding to the contact position or locus. In general, the touch panel includes a resistance film method, a capacitance method, an optical method, and the like. In the first embodiment, any type of touch panel is applicable.

  The storage unit 8 includes an image data storage unit 81 that stores image data captured by the imaging unit 2, a program storage unit 82 that stores various programs executed by the imaging device 1, and a comfortable 3D image displayed by the display unit 6. A parallax storage unit 83 that stores the parallax range. The storage unit 8 is realized using a semiconductor memory such as a flash memory or a RAM (Random Access Memory) that is fixedly provided inside the imaging apparatus 1. The storage unit 8 may be provided with a function as a recording medium interface that reads information stored in the storage medium while storing information in a storage medium such as a memory card mounted from the outside.

  The control unit 9 is realized by a CPU (Central Processing Unit) or the like. The control unit 9 reads various programs from the program storage unit 82 of the storage unit 8 in response to an operation signal from the operation input unit 4, transmits a control signal to each unit constituting the imaging device 1, and transfers data. To control the operation of the imaging apparatus 1. The control unit 9 includes an image processing unit 91, a transmission image generation unit 92, a display image generation unit 93, a parallax adjustment unit 94, a display control unit 95, and a communication state detection unit 96.

  The image processing unit 91 performs various types of image processing on the left-eye image data and right-eye image data output from the signal processing units 21 h and 22 h, and outputs them to the image data storage unit 81 of the storage unit 8. Specifically, the image processing unit 91 performs processing such as edge enhancement, color correction, and γ correction on the left eye image data and right eye image data output from the signal processing units 21h and 22h, respectively.

  The transmission image generation unit 92 generates image data of a transmission image to be transmitted to the display device 200 for display on the display screen 201 of the display device 200 externally connected via the communication unit 10. Specifically, the transmission image generation unit 92 cuts out the left-eye image data and the right-eye image data subjected to image processing by the image processing unit 91 at a predetermined aspect ratio (for example, an aspect ratio of 3: 4), thereby generating a 3D image. Generate. Note that the aspect ratio that the transmission image generation unit 92 cuts out from the left-eye image data and the right-eye image data may be changed by the changeover switch 43.

  The display image generation unit 93 generates image data of a display image displayed on the display unit 6. Specifically, the display image generation unit 93 generates 3D images or image data corresponding to 2D images as display images. Among these, when generating image data of a 3D image, the left-eye image data and the right-eye image data are cut out at a predetermined aspect ratio in the same manner as the transmission image generation unit 92.

  When the display image generation unit 93 generates 2D image data, the display image generation unit 93 generates a composite image in which the left eye image and the right eye image generated by the transmission image generation unit 92 are overlapped, or the left eye image data and the right eye image One of the image data is generated as a display image. Among these, when the transmission image generating unit 92 generates a composite image, the display image generating unit 93 has the sharpness in the region where the sharpness is maximum in the image region of the left eye image and in the image region of the right eye image. A composite image is generated by overlapping the maximum region with matching. As a result, the display image generation unit 93 can generate a composite image based on the subject in focus in the image areas of the left eye image and the right eye image. For this reason, the user can start adjusting the amount of change in the 3D image from a state in which the parallax of the near subject included in the composite image is small.

  The parallax adjustment unit 94 changes the left-eye image data and right-eye image data cut-out regions by the transmission image generation unit 92 according to the trajectory of the object touching the touch panel 7 from the outside, and the parallax of the subject included in the composite image Adjust. Specifically, the parallax adjustment unit 94 performs, for example, the right eye on the region of one end in the left-right direction in which the left eye image and the right eye image overlap each other in the composite image according to the trajectory of the object that has touched the touch panel 7. The parallax of the subject included in the composite image is adjusted by shifting the image area to the right.

  The display control unit 95 controls the display unit 6 to display a 3D image or 2D image corresponding to the image data generated as the display image by the display image generation unit 93. Specifically, when displaying the 3D image on the display unit 6, the display control unit 95 displays the left eye image and the right eye image of the 3D image generated by the transmission image generation unit 92 in the horizontal direction on the display screen of the display unit 6. Control is performed to output 3D images alternately arranged for each pixel to the display unit 6.

  On the other hand, when displaying a 2D image on the display unit 6, the display control unit 95 changes the power applied to the parallax barrier 63 from the on state to the off state, thereby changing the parallax barrier 63 from the light shielding state to the transmissive state. Then, control is performed to cause the display unit 6 to output the left eye image or the right eye image as the display image generated by the display image generation unit 93.

  The display control unit 95 may control the display unit 6 to display the combined image adjusted by the parallax adjusting unit 94 and the parallax information related to the parallax of the subject included in the combined image. The display control unit 95 controls the display unit 6 to display a warning when the parallax of the subject included in the composite image adjusted by the parallax adjustment unit 94 exceeds a predetermined parallax, and is included in the composite image. Control is performed to fix the parallax of the subject to a predetermined parallax for display.

  The communication state detection unit 96 detects the communication state between the imaging device 1 and the display device 200. For example, when the imaging device 1 and the display device 200 are connected via HDMI (registered trademark), the communication state detection unit 96 detects the communication state between the imaging device 1 and the display device 200 according to the CEC protocol. To do. When the imaging device 1 and the display device 200 are connected via the Internet, the communication state detection unit 96 detects the communication state between the imaging device 1 and the display device 200 according to the TCP / IP protocol. Note that the communication between the imaging device 1 and the display device 200 may be wireless communication.

  In the imaging apparatus 1 having the above-described configuration, a situation when the imaging unit 2 generates two image data in which one end in the left-right direction of each field of view overlaps will be described. FIG. 4 is a schematic diagram illustrating a situation when the imaging unit 2 generates two image data in which one end in the horizontal direction of each field of view overlaps. As shown in FIG. 4, first, the imaging unit 2 includes a first imaging that is arranged in parallel by a distance B1 with respect to a subject A1 (distance d1) and a subject A2 (distance d2) having different distances from the imaging unit 2. The right eye image data and the left eye image data are generated by photographing with the unit 21 and the second imaging unit 22.

  Thereafter, the transmission image generation unit 92 extracts the right eye image WR1 and the left eye image WL1 by cutting out the right eye image data and the left eye image data respectively generated by the first imaging unit 21 and the second imaging unit 22 at a predetermined aspect ratio. Generate. FIG. 5 is a diagram illustrating an example of two images respectively corresponding to two image data generated by the imaging unit 2 under the situation illustrated in FIG. In FIG. 5, an image WR <b> 1 is a right-eye image generated by the transmission image generation unit 92 cut out from an image corresponding to the right-eye image data generated by the first imaging unit 21. In FIG. 5, an image WL <b> 1 is a left-eye image generated by the transmission image generation unit 92 cut out from an image corresponding to the left-eye image data generated by the second imaging unit 22. FIG. 6 is a diagram illustrating an example of an image in which the right-eye image and the left-eye image generated by the transmission image generation unit 92 are virtually superimposed under the situation illustrated in FIG.

  5 and 6 indicate image areas corresponding to the image data generated by the first imaging unit 21 and the second imaging unit 22, respectively. Hereinafter, also in FIG. 8 and FIG. 9, a broken line and a dashed-dotted line mean the same image area as FIG.

  FIG. 7 is a diagram illustrating the relationship between the imaging distances between the imaging unit 2 and the subject under the situation illustrated in FIG. In FIG. 7, the horizontal axis is the subject position in the image W1 when the left end is the origin, and the vertical axis is the distance between the imaging unit 2 and the subject. As shown in FIG. 7, the distance between the imaging unit 2 and the subject A2 is larger than the distance between the imaging unit 2 and the subject A1. For this reason, the area of the subject A2 almost overlaps. Specifically, as shown in FIG. 6, the area of the subject A2 almost overlaps in the image W1. On the other hand, the area of the subject A1 does not overlap (parallax a1). Thus, in the right eye image WR1 and the left eye image WL1, the subject (subject A1) that is closer to the imaging unit 2 has a larger parallax in the image, and the subject that is farther from the imaging unit 2 (subject A2) is the image. The parallax inside is small.

  Next, an outline of processing performed by the parallax adjustment unit 94 will be described. FIG. 8 is a schematic diagram illustrating an outline of processing performed by the parallax adjustment unit 94. The image WR21 illustrated in FIG. 8A and the image WR22 illustrated in FIG. 8B are generated by the transmission image generation unit 92 cut out from the right-eye image data generated by the first imaging unit 21 at a predetermined aspect ratio. It is a right eye image. In addition, the image WL21 illustrated in FIG. 8A and the image WL22 illustrated in FIG. 8B are cut out from the left-eye image data generated by the second imaging unit 22 by the transmission image generation unit 92 at a predetermined aspect ratio. It is the generated left eye image.

  FIG. 9 is a diagram illustrating an example of a composite image obtained by combining the right eye image and the left eye image. A composite image W2 (region surrounded by a solid line) shown in FIG. 6 is an image obtained by superimposing the right-eye image and the left-eye image generated by the display image generation unit 93 on each other.

  Up to this point, the outline of the processing for generating the right-eye image and the left-eye image for the 3D image in the transmission image generation unit 92 has been described. However, the processing for generating the right-eye image and the left-eye image for the 3D image by the display image generation unit 93 is also performed. It is the same.

  The parallax adjustment unit 94 changes the cut-out areas of the right-eye image and the left-eye image that the transmission image generation unit 92 generates from the right-eye image data and the left-eye image data, respectively, according to the trajectory of the object that has touched the touch panel 7. Adjust the parallax of the subject.

  Specifically, when the parallax adjustment unit 94 virtually causes the subject A1 to jump out in a vertical direction perpendicular to the display screen of the display unit 6, the parallax ((1) of the subject A1 included in the right eye image WR1 and the left eye image WL1) By increasing the area overlap), the distance at which the subject virtually jumps out in the vertical direction orthogonal to the display screen (hereinafter referred to as “jump distance”) is adjusted (see image W1 in FIG. 6). On the other hand, when the parallax adjustment unit 94 virtually retracts the subject A1 in a vertical direction orthogonal to the display screen of the display unit 6, the parallax of the subject A1 included in the right-eye image WR1 and the left-eye image WL1. By reducing the distance, the distance that the subject A1 is virtually retracted in the direction orthogonal to the display screen (hereinafter referred to as “retraction distance”) is adjusted (see image W2 in FIG. 9).

  In the first embodiment, since the imaging device 1 and the display device 200 are linked, the user can give the imaging device 1 the stereoscopic effect (the jumping distance and the retracting distance) of the 3D image displayed on the display device 200. Adjustment can be performed using an operation member such as the touch panel 7 provided. Therefore, the user can easily adjust while viewing the 3D image displayed on the display device 200.

  In FIG. 8, the parallax adjustment unit 94 changes only the cut-out area of the right-eye image. However, the cut-out areas of the right-eye image and the left-eye image may be changed while synchronizing the right-eye image and the left-eye image. .

  FIG. 10 is a diagram illustrating a display example of a virtual 3D image displayed on the display unit 6 or the display device 200 using the right eye image and the left eye image adjusted by the parallax adjustment unit 94 and recognized by the user. FIG. 10 shows a case where the subject A1 appears to virtually protrude.

  Next, processing performed by the imaging apparatus 1 will be described. FIG. 11 is a flowchart illustrating an outline of processing performed by the imaging apparatus 1. In FIG. 11, first, the control unit 9 determines whether or not the power of the imaging device 1 is turned on (step S <b> 101). When the power supply of the imaging device 1 is on (step S101: Yes), the imaging device 1 proceeds to step S102. On the other hand, when the power of the imaging apparatus 1 is not turned on (step S101: No), the imaging apparatus 1 ends this process.

  Subsequently, the control unit 9 determines whether or not the imaging apparatus 1 is set to the shooting mode (step S102). When the imaging device 1 is set to the imaging mode (step S102: Yes), the display control unit 95 displays a through image corresponding to image data that the imaging unit 2 continuously generates at a constant minute time interval. It is displayed on the part 6 (step S103). In this case, the through image may be either a 2D image or a 3D image.

  Subsequently, the control unit 9 determines whether or not a release signal for instructing photographing is input by operating the release switch 42 by the user (step S104). When a release signal instructing shooting is input within a predetermined time after the display unit 6 starts displaying a through image (step S104: Yes), the imaging unit 2 performs shooting and stores the obtained image data in the storage unit 8 Is stored in the image data storage unit 81 (step S105).

As a result of detection by the communication state detection unit 96, when the imaging device 1 and the display device 200 are connected and are in a communicable state (step S106: Yes), the control unit 9 generates the transmission image generation unit 92. Control to transmit the display image via the communication unit 10 is performed (step S107). Thereafter, the control unit 9 performs control to display a 2D image on the display unit 6 as a display image for a time t ₁ (step S108). Note that step S107 and step S108 may be performed in parallel.

On the other hand, in the case of detection by the communication status detection unit 96 result, where the display device 200 and the imaging apparatus 1 is not connected (Step S106: No), the control unit 9, rec 3D images by a time t ₂ as the display image A view is displayed (step S109). This time t ₂ is more preferably shorter than the above-described time t ₁ (t ₂ <t ₁ ). Thus, when the image is displayed on both the display unit 6 and the display device 200, the user can view the REC view display longer than when the image is displayed only on the display unit 6.

  Next, the case where the release signal is not input for a predetermined time after starting to display the through image in step S104 (step S104: No) will be described. In this case, when the communication state detection unit 96 detects the connection with the display device 200 (step S110: Yes), the control unit 9 transmits the transmission image generated by the transmission image generation unit 92 to the communication unit 10. The transmission control to the display device 200 is performed (step S111). Thereafter, the control unit 9 causes the display unit 6 to display the composite image generated by the display image generation unit 93 as a display image (step S112).

  Subsequently, the control unit 9 determines whether or not a signal corresponding to the contact position from the outside of the touch panel 7 is input (step S113). When the signal according to the contact position from the outside is input (step S113: Yes), the imaging device 1 performs a parallax adjustment process for adjusting the jump distance or the retract distance of the subject included in the composite image (step S114). . When the imaging device 1 is connected to the display device 200 when the parallax adjustment processing is completed (step S115: Yes), the control unit 9 transmits the transmission image after performing the parallax adjustment via the communication unit 10. Then, control to transmit to the display device 200 is performed (step S116). Thereafter, the imaging apparatus 1 returns to step S101.

  In step S113, when the signal according to the contact position from the outside is not input (step S113: No), if the predetermined time has passed (step S117: Yes), the imaging device 1 returns to step S101. On the other hand, if the predetermined time has not elapsed in step S117 (step S117: No), the imaging apparatus 1 returns to step S113.

  When connection with the display device 200 is not detected in step S110 (step S110: No), the control unit 9 displays a 3D image on the display unit 6 as a display image (step S118). Thereafter, when the touch panel 7 is touched by the user (step S119: Yes), the imaging device 1 proceeds to step S112. On the other hand, when the touch panel 7 is not touched by the user for a predetermined time (step S119: No), the imaging device 1 returns to step S101.

  Next, the case where the imaging apparatus 1 is not set to the shooting mode in step S102 will be described (step S102: No). In this case, the imaging apparatus 1 executes a reproduction display process for displaying the captured image data on the display unit 6 (step S120), and returns to step S101.

  Next, the parallax adjustment processing in step S114 will be described. FIG. 12 is a flowchart illustrating an outline of the parallax adjustment processing. In FIG. 12, first, the control unit 9 determines whether or not the locus of the object touching the touch panel 7 corresponds to an operation for increasing the parallax of the subject included in the composite image (step S201). When the locus of the object touching the touch panel 7 corresponds to the operation of increasing the parallax of the subject included in the composite image (step S201: Yes), the imaging device 1 proceeds to step S202 described later. On the other hand, when the trajectory of the object touching the touch panel 7 does not correspond to the operation of increasing the parallax of the subject included in the composite image (step S201: No), the imaging device 1 proceeds to step S211.

FIG. 13 is a diagram for explaining an operation of increasing the parallax of the subject included in the composite image by the user. As shown in FIG. 13, the control unit 9, the region of the object A1 having no parallax in the image W4 in which the display unit 6 is currently displayed, from the left side of the image W4 while a user contacting the index finger F ₁ on the touch panel 7 When it is moved toward the right side (FIG. 13 (a) → FIG. 13 (b)), this operation is determined as an operation for increasing the parallax of the subject.

In step S202, the control unit 9 determines whether or not a near subject is included in an image corresponding to an area where the user first touches the touch panel 7 with the index finger. Here, the near subject is a subject having the shortest shooting distance between the imaging unit 2 and the subject when the user uses the imaging device 1 to photograph a plurality of subjects (see FIG. 7). Specifically, as shown in FIG. 13, the user determines whether contains subject A1 in the image corresponding to the regions first contacted the touch panel 7 with the index finger F _1. When the near subject is included in the image corresponding to the area where the user first touches the touch panel 7 with the index finger F ₁ (step S202: Yes), the imaging device 1 proceeds to step S203.

  In step S203, the control unit 9 causes the parallax adjustment unit 94 to adjust the parallax of the subject included in the synthesized image according to the trajectory of the object that has touched the touch panel 7 with respect to the synthesized image displayed on the display unit 6. Then, it is determined whether or not the pop-out distance of the subject has exceeded the limit value of the pop-up distance stored in the parallax storage unit 83. When the subject jump distance set by the parallax adjustment unit 94 exceeds the limit value of the jump distance (step S203: Yes), the parallax adjustment unit 94 seems to fix the parallax of the subject included in the composite image at the limit value. Then, the cut-out areas of the right-eye image data and the left-eye image data by the transmission image generation unit 92 are changed, and the pop-out distance of the subject is adjusted with a limit value (step S204).

  Subsequently, the display control unit 95 causes the display unit 6 to display a warning that the subject pop-out distance has exceeded the limit value in the composite image displayed by the display unit 6 (step S205). Specifically, as illustrated in FIG. 14, the display control unit 95 causes the display unit 6 to display an icon Q1 for warning the user that the parallax is the limit in the image W5. Thereby, the user can know the limit of the distance to which the subject jumps out, and can prevent the human eye from exceeding the correspondence limit of the human eye due to the subject image that has jumped out during viewing. The display control unit 95 may display a warning when the user makes an erroneous operation, for example, when the direction of adjusting the parallax of the subject is reversed. Thereafter, the imaging apparatus 1 returns to the main routine shown in FIG.

  Next, in step S203, the cut-out areas of the right-eye image data and the left-eye image data adjusted by the parallax adjustment unit 94 are changed according to the trajectory of the object touching the touch panel 7 with respect to the composite image displayed by the display unit 6. The case where the parallax of the subject included in the composite image does not exceed the parallax limit value stored in the parallax storage unit 83 will be described (step S203: No). In this case, the parallax adjustment unit 94 changes the cut-out areas of the right-eye image data and the left-eye image data by the transmission image generation unit 92 according to the locus of the object that has touched the touch panel 7, and the object included in the composite image is changed. By adjusting the parallax, the pop-out distance of the subject is adjusted (step S206).

  Thereafter, the display control unit 95 displays the parallax information of the subject adjusted by the parallax adjustment unit 94 in the composite image displayed by the display unit 6 (step S207). Specifically, as shown in FIG. 15, the display control unit 95 causes the display unit 6 to display an icon Q2 on the image W6. The icon Q2 is an icon for notifying the user of the subject jump distance information corresponding to the subject parallax information adjusted by the parallax adjusting unit 94. Thereby, the user can easily recognize the parallax of the subject adjusted by the operation. Thereafter, the imaging apparatus 1 returns to the main routine shown in FIG.

Next, in step S202, if in the image corresponding to the user first touches the touch panel 7 with the index finger F ₁ region contains no near-object (step S202: No) will be described. In this case, the parallax adjustment unit 94 changes the cut-out areas of the right-eye image data and the left-eye image data by the transmission image generation unit 92 according to the locus of the object that has touched the touch panel 7, and the object included in the composite image is changed. By adjusting the parallax, the retraction distance of the subject is adjusted (step S208).

  Thereafter, the display control unit 95 causes the display unit 6 to display the parallax of the subject set by the parallax adjustment unit 94 in the composite image displayed by the display unit 6 (step S209), and the imaging apparatus 1 performs the main routine illustrated in FIG. Return to.

  Next, a case where the locus of the object that has touched the touch panel 7 is not an operation for increasing the parallax of the subject included in the composite image in step S201 (step S201: No) will be described. In this case, the control unit 9 determines whether or not the locus of the object touching the touch panel 7 is an operation for reducing the parallax of the subject included in the composite image (step S210). When the trajectory of the object in contact with the touch panel 7 does not correspond to the operation of reducing the parallax of the subject included in the composite image (step S210: No), the imaging device 1 returns to the main routine illustrated in FIG. On the other hand, when the locus of the object touching the touch panel 7 corresponds to the operation of reducing the parallax of the subject included in the composite image (step S210: Yes), the imaging device 1 proceeds to step S211.

FIG. 16 is a diagram for explaining an operation of reducing the parallax of the subject included in the composite image by the user. As shown in FIG. 16, the control unit 9 is an area of a subject having parallax in the image currently displayed on the display unit 6, and the user touches the touch panel 7 with the index finger F ₁ while the left side of the image W 7 from the right side. In the case of moving toward () (FIG. 16 (a) → FIG. 16 (b)), this operation is determined as an operation for reducing the parallax of the subject.

In step S211, the control unit 9 determines whether or not the user is included near the object in the image corresponding to the regions first contacted the touch panel 7 with the index finger F _1. When the near subject is included in the image corresponding to the region where the user first touches the touch panel 7 with the index finger F ₁ (step S211: Yes), the parallax adjustment unit 94 follows the trajectory of the object touching the touch panel 7. Accordingly, the cut-out areas of the right-eye image data and the left-image data by the transmission image generation unit 92 are changed, and the subject retraction distance is adjusted by adjusting the parallax of the subject included in the composite image (step S212). .

  Thereafter, the display control unit 95 displays the retraction distance information corresponding to the parallax information of the subject set by the parallax adjustment unit 94 in the composite image displayed by the display unit 6 (step S213). After step S213, the imaging apparatus 1 returns to the main routine shown in FIG.

Next, in step S211, if in the image corresponding to the user first touches the touch panel 7 with the index finger F ₁ region contains no near-object (step S211: No) will be described. In this case, with respect to the composite image displayed on the display unit 6, the control unit 9 determines that the parallax of the subject included in the composite image adjusted by the parallax adjustment unit 94 according to the locus of the object touching the touch panel 7 is the parallax storage unit. It is determined whether or not the parallax limit value stored in 83 has been exceeded (step S214).

  When the parallax of the subject included in the synthesized image adjusted by the parallax adjusting unit 94 exceeds the parallax limit value described in the parallax storage unit 83 (step S214: Yes), the parallax adjusting unit 94 is included in the synthesized image. By fixing the parallax of the subject at a limit value and changing the cut-out areas of the right-eye image data and the left-eye image data by the transmission image generation unit 92 and adjusting the parallax of the subject included in the composite image, the subject jump-out distance Is adjusted by the limit value (step S215).

  Subsequently, the display control unit 95 causes the display unit 6 to display a warning that the parallax of the subject is the limit value in the composite image displayed by the display unit 6 (step S216). Thereafter, the imaging apparatus 1 returns to the main routine shown in FIG.

  In step S214, when the parallax of the subject included in the composite image adjusted by the parallax adjusting unit 94 does not exceed the parallax limit value described in the parallax storage unit 83 (step S214: No), the parallax adjusting unit 94 7 according to the trajectory of the object in contact with the object 7, the cut-out areas of the right-eye image data and the left-eye image data by the transmission image generation unit 92 are changed, and the parallax of the subject included in the composite image is adjusted, thereby popping out the subject The distance is adjusted (step S217).

  After that, the display control unit 95 causes the display unit 6 to display the subject jump distance set by the parallax adjustment unit 94 in the composite image displayed by the display unit 6 as parallax information (step S218). After step S218, the imaging apparatus 1 returns to the main routine shown in FIG.

  Next, the reproduction display process in step S120 of FIG. 11 will be described. FIG. 17 is a flowchart showing an outline of the reproduction display process. In FIG. 17, first, the display control unit 95 causes the display unit 6 to display an image selection screen in which a plurality of images stored in the image data storage unit 81 are displayed together (step S301). Here, the image displayed on the display unit 6 is a 2D image.

  Subsequently, the control unit 9 determines whether or not an image is selected from the image selection screen displayed on the display unit 6 when the user operates the touch panel 7 (step S302). When no image is selected from the image selection screen by the user (step S302: No), the imaging apparatus 1 returns to step S301. On the other hand, when the image is selected from the image selection screen by the user (step S302: Yes), when the imaging device 1 is connected to the display device 200 (step S303: Yes), the control unit 9 selects The transmission image corresponding to the image thus transmitted is transmitted to the display device 200 via the communication unit 10 (step S304). Thereafter, the control unit 9 causes the display unit 6 to display the combined image corresponding to the selected image as a display image on the full screen (step S305).

  Subsequently, the control unit 9 determines whether or not a signal corresponding to the contact position from the outside of the touch panel 7 has been input (step S306). When the signal according to the contact position from the outside of the touch panel 7 is input (step S306: Yes), the imaging device 1 performs a parallax adjustment process (see FIG. 12) (step S307). When the imaging device 1 is connected to the display device 200 (step S308: Yes), the control unit 9 transmits the transmission image after parallax adjustment to the display device 200 via the communication unit 10 (step S309). . When the imaging device 1 is not connected to the display device 200 in step S308 (step S308: No), the imaging device 1 proceeds to step S310 described later.

  After step S309, when an instruction to end image reproduction is input by the operation input unit 4 (step S310: Yes), the imaging apparatus 1 returns to the main routine illustrated in FIG. On the other hand, after step S309, when an instruction to end image reproduction is not input by the operation input unit 4 (step S310: No), the imaging apparatus 1 returns to step S301.

  In step S306, when there is no input of a signal corresponding to the contact position of the object from the outside of the touch panel 7 (step S306: No), if the predetermined time has elapsed (step S311: Yes), the imaging device 1 performs the step. The process proceeds to S310. On the other hand, if the predetermined time has not elapsed in step S311 (step S311: No), the imaging apparatus 1 returns to step S306.

  If the imaging device 1 is not connected to the display device 200 in step S303 (step S303: No), the control unit 9 causes the display unit 6 to display a 3D image corresponding to the image selected as the display image (step S303: No). Step S312). Thereafter, when the 2D display icon displayed on the display unit 6 is selected (step S313: Yes), the control unit 9 causes the display unit 67 to display the composite image generated by the display image generation unit 93 ( Step S314). Thereafter, the imaging apparatus 1 proceeds to step S306. On the other hand, when the 2D display icon displayed on the display unit 6 is not selected (step S313: No), the imaging device 1 proceeds to step S310.

  According to the first embodiment of the present invention described above, the display image to be displayed on the imaging device side and the transmission image to be transmitted to the external device (display device) for display on the external device side are individually generated. Therefore, an image that does not make the user feel uncomfortable can be displayed even when the user views the 3D image on the external device while being connected to an external device capable of displaying the 3D image.

  Further, according to the first embodiment, since the imaging device and the display device are linked, the operation member such as a touch panel provided on the imaging device has a stereoscopic effect of a 3D image displayed by the user on the display device. It can be adjusted easily. Therefore, according to the first embodiment, the operability of the entire system can be improved by linking the imaging device and the display device through communication.

  In the first embodiment, when the imaging device 1 and the display device 200 are communicably connected, the display device 200 performs 3D display, while the display unit 6 of the imaging device 1 performs 2D display. However, the display unit 6 of the imaging device 1 may perform 3D display having a stereoscopic effect different from that of the display device 200. In this case, for example, the virtual pop-out amount of the subject from the display screen can be made larger on the display unit 6 than on the display screen 201.

Further, in the first embodiment, the parallax adjustment unit 94 changes the cut-out area of the two image data according to the trajectory of the two objects from the outside on the touch panel 7 to change the parallax of the subject included in the composite image. You may make it adjust. Specifically, as shown in FIG. 18, the parallax adjustment unit 94 may adjust the parallax of the subject A1 included in the image W9 according to the trajectory of the user's index finger F ₁ and thumb F ₂ . In this case, the control unit 9 compares the position where the index finger F ₁ and the thumb F ₂ first contact the touch panel 7 with the position of the touch panel 7 after the operation, thereby opening the operation (increasing parallax). It is determined whether or not it corresponds to a closing operation (corresponding to an operation for reducing parallax). After that, the parallax adjustment unit 94 increases the parallax of the subject included in the composite image when it corresponds to the opening operation (FIG. 18A → FIG. 18B). On the other hand, the parallax adjustment unit 94 reduces the parallax of the subject included in the composite image when it corresponds to the closing operation. In addition, you may provide a restriction | limiting in the operable range.

Further, in the first embodiment, the parallax adjusting unit 94 may be configured to adjust using the trajectories of the thumbs F _1L and F _1R of both hands of the user as shown in FIG. In this case, the control unit 9 opens or closes by comparing the position where the left thumb F _1L and the right thumb F _1R first contact the touch panel 7 with the position of the touch panel 7 after the operation. It is determined whether the operation is supported. The processing after the determination is the same as that shown in FIG.

  In the first embodiment, the lens driving units 21b and 22b are driven while being synchronized with each other, and the fields included in the composite image are changed by changing the visual field areas of the first imaging unit 21 and the second imaging unit 22, respectively. The parallax may be adjusted.

  In the first embodiment, for example, immediately after shooting by the imaging unit 2, the display unit 6 may be able to perform parallax adjustment processing on an image that is displayed in rec view.

(Embodiment 2)
FIG. 20 is a block diagram showing the configuration of the imaging apparatus according to Embodiment 2 of the present invention. The imaging device 11 shown in the figure includes a monocular imaging unit 111, a motion detection unit 112 that detects the motion of the imaging device 11, and a control unit 113. The configuration of the imaging unit 111 is the same as the configuration of the first imaging unit 21 of the imaging device 1 described above. The configuration of the imaging apparatus 11 other than these is the same as the configuration of the imaging apparatus 1 described in the first embodiment. For this reason, the same reference numerals as those of the imaging device 1 are given to the components corresponding to the components of the imaging device 1.

  The motion detection unit 112 includes, for example, a speed sensor, detects a speed when the imaging device 11 moves, and outputs a sensor signal as a detection result to the control unit 113.

  The control unit 113 includes a sensor received from the motion detection unit 112 in addition to the image processing unit 91, the transmission image generation unit 92, the display image generation unit 93, the parallax adjustment unit 94, the display control unit 95, and the communication state detection unit 96. A motion determination unit 114 that determines the motion of the imaging device 11 using a signal is included.

  FIG. 21 is a diagram illustrating an outline of photographing using the imaging device 11. As illustrated in FIG. 21, the imaging device 11 continuously captures images at a predetermined interval while the user moves substantially linearly along the horizontal direction. In the second embodiment, the transmission image generation unit 92 and the display image generation unit 93 perform 3D by appropriately extracting two images from a plurality of images continuously captured while the imaging device 11 is moving. Image data corresponding to the right eye image and the left eye image for the image is generated.

  FIG. 22 is a diagram illustrating an example of two images respectively corresponding to two image data generated by the imaging unit 111 under the situation illustrated in FIG. 21, and is a display image generated by the display image generation unit 93. It is a figure which shows the example of a pair of image which comprises 3D image. The image WL11 is an image generated by the display image generation unit 93 cut out from an image corresponding to the image data generated by the imaging unit 111 when the imaging device 11 is located at the left end of FIG. The image WR11 is an image generated by the display image generation unit 93 by cutting out from an image corresponding to the image data generated by the imaging unit 111 when the imaging unit 111 is located at the right end of FIG. For this reason, the image WL11 corresponds to a left-eye image, and the image WR11 corresponds to a right-eye image. Note that the broken line and the alternate long and short dash line shown in FIG. 22 indicate image areas corresponding to the image data generated by the imaging unit 111, respectively.

The parallax L ₁ between the center of the subject A1 and the center of the subject A2 in the left-eye image WL11 is smaller than the parallax L ₂ between the center of the subject A1 and the subject A2 in the right-eye image WR11 (L ₁ <L ₂ ). Therefore, a 3D image can be displayed by using the two images WL11 and WR11.

  FIG. 23 is a diagram illustrating another example of two images respectively corresponding to two image data generated by the imaging unit 111 under the situation illustrated in FIG. 21, and a transmission image generated by the transmission image generation unit 92. It is a figure which shows the example of. The image WL11 is an image generated by the transmission image generation unit 92 cut out from an image corresponding to the image data generated by the imaging unit 111 when the imaging device 11 is located at the left end in FIG. The image WR12 is an image generated by the display image generation unit 93 by cutting out from an image corresponding to the image data generated by the imaging unit 111 when the imaging unit 111 is located in the center of FIG. Therefore, the image WL11 corresponds to the left eye image, and the image WR12 corresponds to the right eye image. Note that a broken line and an alternate long and short dash line shown in FIG. 23 indicate image areas corresponding to image data generated by the imaging unit 111, respectively.

Parallax L ₁ between the centers of the object A2 of the object A1 in the image WL11 is parallax L ₃ is smaller than the center and the object A2 of the object A1 in the image WR12 (L ₁ <L _3). Therefore, a 3D image can be displayed by using the two images WL11 and WR12. Further, the parallax L ₃ between the center of the subject A1 and the subject A2 in the right eye image WR12 is smaller than the parallax L ₂ between the center of the subject A1 and the subject A2 in the right eye image WR12 (L ₃ <L ₂ ). Therefore, virtual pop-out amount in the case of 3D display using the image WL11 and WR12 are smaller than a virtual pop-out amount in the case of 3D display using the image WL11 and WR11. In this way, by making the virtual pop-out amount in the transmission image smaller than the virtual pop-out amount in the display image, the pop-out amount in the case of 3D display on a large screen like the display device 200 is suppressed. Thus, it is possible to create a situation that is easy for the user to view.

  Note that the user may be able to appropriately set which two images are extracted from a plurality of continuously captured images to form a 3D image.

  FIG. 24 is a flowchart illustrating an outline of processing performed by the imaging apparatus 11. In FIG. 24, first, the control unit 113 determines whether or not the power of the imaging device 11 is turned on (step S401). When the power of the imaging device 11 is on (step S401: Yes), the imaging device 11 proceeds to step S402. On the other hand, when the power of the imaging device 1 is not turned on (step S401: No), the imaging device 11 ends this process.

  Subsequently, the control unit 113 determines whether or not the imaging device 11 is set to the shooting mode (step S402). When the imaging device 11 is set to the imaging mode (step S402: Yes), the display control unit 95 displays a through image corresponding to the image data that the imaging unit 111 continuously generates at a constant minute time interval. It is displayed on the part 6 (step S403). In this case, the through image may be either a 2D image or a 3D image.

  Subsequently, the control unit 113 determines whether or not a release signal instructing photographing is input by operating the release switch 42 by the user (step S404). When a release signal instructing photographing is input (step S404: Yes), when the motion determination unit 114 determines that the imaging device 11 is not moving as a result of determining the motion of the imaging device 11 (step S405: No). ), The imaging unit 111 performs imaging, and stores the obtained image data in the image data storage unit 81 of the storage unit 8 (step S405). This image data corresponds to a through image and is a 2D image or a 3D image.

  After that, the display control unit 95 displays the image corresponding to the image data captured by the imaging unit 111 on the display unit 6 in a rec view display (step S407).

  If the release signal is not input within the predetermined time in step S404 (step S405: No), the imaging device 11 returns to step S401.

  Next, the case where the motion detection unit 112 detects the motion of the imaging device 11 in step S405, that is, the case where the imaging device 11 is moving (step S405: Yes) will be described. In this case, the imaging unit 111 performs continuous shooting at a predetermined interval, and stores the obtained image data in the image data storage unit 81 of the storage unit 8 (step S408). If the imaging device 11 is not stationary (step S409: No), the imaging unit 111 continues to perform continuous imaging processing (step S408).

  Hereinafter, the case where the imaging device 11 is stationary (step S409: Yes) will be described. In this case, when the communication state detection unit 96 detects connection with the display device 200 (step S410: Yes), the control unit 113 transmits an image for transmission to the display device 200 via the communication unit 10 (step S410). S411). As described with reference to FIG. 23, the transmission image transmitted here is an image with a smaller parallax between the subjects than the set of images generated by the display image generation unit 93.

  Thereafter, the control unit 113 causes the display unit 6 to display the composite image generated by the display image generation unit 93 as a display image (step S412). Also in the second embodiment, the processes of step S411 and step S412 may be executed in parallel.

  Subsequently, the control unit 113 determines whether or not a signal corresponding to the contact position from the outside of the touch panel 7 has been input (step S413). When a signal corresponding to the contact position from the outside is input (step S413: Yes), the imaging apparatus 1 performs a parallax adjustment process for adjusting the jump distance or the retract distance of the subject included in the composite image (step S414). . When the communication state detection unit 96 detects that the imaging device 1 is communicably connected to the display device 200 when the parallax adjustment processing is completed (step S415: Yes), the control unit 113 performs the parallax adjustment. Control is performed to transmit the transmitted image to the display device 200 via the communication unit 10 (step S416). Thereafter, the imaging apparatus 1 returns to step S401.

  In step S413, when the signal according to the contact position from the outside is not input (step S413: No), if the predetermined time has passed (step S417: Yes), the imaging device 11 returns to step S401. On the other hand, if the predetermined time has not elapsed in step S417 (step S417: No), the imaging device 11 returns to step S413.

  In step S410, when the connection with the display device 200 is not detected (step S410: No), the control unit 113 displays a 3D image on the display unit 6 as a display image (step S418). Thereafter, when the touch panel 7 is touched by the user (step S419: Yes), the imaging device 11 proceeds to step S412. On the other hand, when the touch panel 7 is not touched for a predetermined time by the user (step S419: No), the imaging device 11 returns to step S401.

  In step S402, when the imaging device 11 is not set to the shooting mode (step S402: No), the imaging device 11 executes reproduction display processing for displaying the captured image data on the display unit 6 (step S420). The process returns to step S401. The reproduction display process in step S420 is the same as the reproduction display process described in the first embodiment (see FIG. 17).

FIGS. 25 and 26 are diagrams for explaining a preferable moving distance when a 3D image is generated using the imaging device 11. Among these, FIG. 25 is a diagram illustrating a situation when the user views the display screen 201 of the display device 200. In FIG. 25, the distance when the user views the display screen 201 is Lt, and the distance between the right eye E _R and the left eye E _L is Wt. At this time, the parallax for giving a stereoscopic effect by virtually projecting the subject (assuming a face in FIG. 25) from the display screen 201 may be about the interval Wt between both eyes.

  On the other hand, FIG. 26 is a diagram illustrating a situation when the user views the display unit 6. In FIG. 26, the distance when the user views the display unit 6 is Lc. The distance from the imaging device 11 to the subject when the user captures a person or the like can be assumed to be approximately the same as the distance Lt when the user views the display screen 201. Under this assumption, in order to produce a stereoscopic effect by virtually projecting the subject on the display unit 6, it is necessary to move the imaging device 11 by about Wc to (Lt / Lc) × Wt in FIG. . Specifically, for example, when Lt = 2 (m) and Wt = 50 (cm), Wc˜4 × Wt. Here, the symbol “˜” means substantially equal.

  According to the second embodiment of the present invention described above, the display image displayed on the imaging device side and the transmission image transmitted to the external device (display device) for display on the external device side are individually generated. Therefore, an image that does not make the user feel uncomfortable can be displayed even when the user views the 3D image on the external device while being connected to an external device capable of displaying the 3D image.

  Further, according to the second embodiment, the operability of the entire system can be improved as in the first embodiment.

  Up to this point, two embodiments have been described as modes for carrying out the present invention. However, the present invention should not be limited to the above-described first and second embodiments. For example, in the above-described embodiment, since the user's field of vision is dark when glasses 300 are put on, the display is performed when the display unit 6 performs framing confirmation during shooting or display confirmation during operation. There is a risk that the display screen of the unit 6 may become difficult to see. Therefore, in order to compensate for the darkness of the glasses 300, it is preferable to devise measures such as increasing the brightness of display on the display unit 6, enhancing a specific color, and increasing the contrast.

  In the present invention, the configuration of the touch panel is not limited to that described above. FIG. 27 is a schematic diagram illustrating another configuration example of the touch panel. As illustrated in FIG. 27, the touch panel 70 includes a front panel 71, a drive unit 72, a drive electrode 73, a reception electrode 74, and a detection unit 75.

  The front panel 71 is made of glass or PET (Polyethylene Terephthalate) which has a predetermined thickness and is formed in a rectangular shape when seen in a plan view. The driving unit 72 outputs a driving pulse (for example, an applied voltage of 5 V) to the driving electrode 73 to form a capacitance between the driving electrode 73 and the receiving electrode 74. The drive electrode 73 and the reception electrode 74 are composed of ITO (Indium Tin Oxide) electrodes, and are alternately provided at a predetermined pitch (for example, about 5 mm) with respect to the lower surface of the front panel 71. The detection unit 75 is configured by a capacitance sensor, and a minute amount of change in capacitance formed between the drive electrode 73 and the reception electrode 74 when the user's hand H approaches the electric field 400, for example, A value of about 1 pF is detected as the amount of change when the user's hand H contacts the front panel 71. A more detailed configuration of the detection unit 75 is disclosed in, for example, US Pat. No. 7,148,704.

  In the touch panel 70 having the above configuration, the detection unit 75 detects a minute change in capacitance formed between the drive electrode 73 and the reception electrode 74 before the user's hand H touches the front panel 71. be able to. Specifically, as shown in FIG. 27, the detection unit 75 is very small as in the case where the user's hand H is located at a distance h1 (for example, 0.5 cm) and a distance h2 (for example, 1 cm). It is possible to detect a change in the capacitance formed between the drive electrode 73 and the reception electrode 74 when moving between two places that are separated by a short distance. As a result, the touch panel 70 can accept an input of an operation signal even when there is no direct external contact.

  The imaging apparatus according to the present invention can be applied to various electronic devices having a shooting function and a display function such as a digital video camera and a camera-equipped mobile phone, in addition to a digital stereo camera.

  In the present invention, the display device as an external device is not limited to a 3D television, and any electronic device may be used as long as it has a display unit capable of displaying a 3D image.

DESCRIPTION OF SYMBOLS 1, 11 Imaging device 2, 111 Imaging part 3 Posture detection part 4 Operation input part 5 Clock 6 Display part 7, 70 Touch panel 8 Storage part 9, 113 Control part 10 Communication part 21 1st imaging part 21a, 22a Lens part 21b, 22b Lens drive unit 21c, 22c Aperture 21d, 22d Aperture drive unit 21e, 22e Shutter 21f, 22f Shutter drive unit 21g, 22g Imaging element 21h, 22h Signal processing unit 22 Second imaging unit 41 Power switch 42 Release switch 43 Changeover switch 44 Zoom switch 61 Backlight 62 Display panel 63 Parallax barrier 71 Front panel 72 Drive unit 73 Drive electrode 74 Reception electrode 75 Detection unit 81 Image data storage unit 82 Program storage unit 83 Parallax storage unit 91 Image processing unit 92 Transmission image generation unit 93 Display image Generating section 94 parallax adjustment unit 95 display control unit 96 a communication state detection unit 100 an image communication system 112 motion detection unit 114 motion determination section 200 display 201 display screen

Claims (5)

An imaging apparatus having an imaging unit that images a subject and generates image data, and capable of communicating with an external device capable of displaying a three-dimensional image according to a predetermined communication standard,
A display unit capable of displaying a three-dimensional image based on the two images;
A display image generating unit for generating a three dimensional image for display said display unit to display by using the two images,
A touch panel that is provided on the display screen of the display unit and receives an input of a signal according to the position of an object that comes into contact with the outside;
A parallax adjustment unit that adjusts the parallax between the two images according to a trajectory of an object that has touched the touch panel while displaying the three-dimensional image for display;
A transmission image to be transmitted for display on the external device by using the two images whose parallax adjustment unit has adjusted the parallax is a three-dimensional image in which the parallax between the two images is smaller than that of the display three-dimensional image. A transmission image generation unit for generating a certain transmission three-dimensional image ;
A communication unit that transmits the transmission image generated by the transmission image generation unit to the external device;
An imaging apparatus comprising: The display image generation unit
The imaging apparatus according to claim 1 , wherein a different display image is generated according to whether the communication unit transmits the transmission image. The display image generation unit
The imaging apparatus according to claim 1, wherein when the communication unit transmits the transmission image, a composite image in which the two images are superimposed is generated as the display image. The imaging device according to any one of claims 1 to 3 ,
A display device that is communicably connected to the imaging device according to the communication standard and displays a three-dimensional image based on the transmission image received from the imaging device;
An image communication system comprising: It is possible to display a three-dimensional image based on two images generated by picking up a subject, and to communicate with an external device capable of displaying the three-dimensional image according to a predetermined communication standard. An image communication method executed by an imaging apparatus including a touch panel that receives an input of a signal according to the position of an object that comes into contact with the outside on the screen,
A display image generation step of generating a 3-dimensional image display by using the two images,
A display step for displaying the display image generated in the display image generation step;
A parallax adjustment step of adjusting the parallax between the two images according to a trajectory of an object that has touched the touch panel while displaying the three-dimensional image for display;
As a transmission image to be transmitted for display on the external device by using the two images whose parallax is adjusted in the parallax adjustment step, a three-dimensional image in which the parallax between the two images is smaller than the three-dimensional image for display. A transmission image generating step for generating a certain transmission three-dimensional image ;
A communication step of transmitting the transmission image generated in the transmission image generation step to the external device;
An image communication method comprising:

Images