JP2009094724A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus capable of obtaining merits of both integrated type compound eye camera and separation type compound eye camera and easily determining a composition when picking up images. <P>SOLUTION: A camera unit is a monocular electronic camera. When the other camera unit is not connected to the camera unit and the operation mode of the camera unit is set to a compound eye mode (step S12), the imaging apparatus functions as the separation type compound eye camera. When the other camera unit is connected through a connector to the camera unit and the operation mode of the camera unit is set to the compound eye mode (S34), the imaging apparatus functions as the integrated type compound eye camera. When the operation mode of the camera unit is set to a monocular mode (S34), an imaging unit can be independently controlled (S38). <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, and more particularly to an imaging apparatus capable of imaging a subject by a plurality of imaging means.

  Patent Document 1 discloses an integrated compound eye image processing apparatus including two imaging optical systems.

Patent Document 2 discloses a camera that has a main camera lens unit and a sub camera lens unit and can visually recognize a subject image captured by each camera lens unit with the same viewfinder.
JP-A-10-32842 JP-A-5-95497

  In an integrated compound eye camera (for example, Patent Document 1) in which a plurality of imaging optical systems are provided in one housing, the relative position of each imaging optical system is fixed, and the relative position of the imaging optical system does not change. Does not require calibration. However, in the integrated compound eye camera, the distance between the imaging optical systems is short, and the parallax obtained from each imaging optical system is small. For this reason, there exists a problem that the three-dimensional effect of the three-dimensional image (3D image) imaged with the integral compound eye camera is weak.

  On the other hand, in a separation-type compound eye camera in which a plurality of imaging optical systems are separated, a distance between the imaging optical systems is long, and a stereoscopic image having a stereoscopic effect can be captured. However, the separation-type compound eye camera requires calibration because the relative position of the imaging optical system changes each time the imaging optical system is installed. For this reason, the separation-type compound eye camera has a problem that it is inconvenient because it takes time and effort to capture a stereoscopic image.

  In the camera described in Patent Document 2, the main camera lens unit and the sub camera lens unit are intended to capture images for viewing different subjects, so that 3D image creation and composition determination are performed. It was inconvenient.

  The present invention has been made in view of such circumstances, and can obtain the advantages of both an integrated compound camera and a separate compound camera, and can easily determine the composition at the time of image capture. An object is to provide an imaging device.

  In order to solve the above-described problem, the imaging apparatus according to the first aspect of the present invention includes a plurality of camera units including a main camera unit and one or more sub camera units, and the main camera unit includes an image. First imaging means for imaging the image, first recording means for recording an image captured by the imaging means, first connection means for integrally connecting the sub camera unit, and A first connected state detecting means for detecting whether or not the sub camera unit is connected via the first connecting means; and a case where the sub camera unit is not connected via the first connecting means. A first communication means for communicating with the sub camera unit, a monocular mode for taking a two-dimensional image with the main camera unit, and the main camera. A first imaging mode switching means for switching an imaging mode between a compound eye mode for imaging a subject from a plurality of viewpoints and acquiring a parallax image by the unit and the sub camera unit; and an imaging mode of the main camera unit is a compound eye mode A relative position detecting means for detecting a relative position with respect to the sub camera unit, a calibration means for performing calibration based on the relative position detected by the relative position detecting means, and the first An imaging instruction means for inputting an imaging instruction of an image to the imaging means, and when the imaging instruction is input in the compound eye mode, an imaging instruction signal is sent to a second imaging means provided in the sub camera unit. First imaging control means for transmitting and executing imaging in synchronization with the first and second imaging means; A receiving unit that receives a second image captured by the second imaging unit in response to an imaging instruction signal; a first image and the second image that are captured by the first imaging unit in the compound eye mode; 3D image generation means for generating a 3D image using the second imaging means, and the sub-camera unit records second images captured by the imaging means and second imaging means for capturing images. Two recording means, a second connecting means for connecting to the main camera unit integrally via a first connecting means provided on the main camera unit, and a second connecting means. When the main camera unit is not connected via the connection state detecting means for detecting whether or not the main camera unit is connected and the second connecting means, the main camera unit is connected. A second communication means for communicating with the main camera unit via a first communication means provided in the camera unit; a monocular mode for taking a two-dimensional image by the sub camera unit; and the main camera. A second imaging mode switching means for switching an imaging mode between a compound eye mode for imaging a subject from a plurality of viewpoints and acquiring a parallax image by the unit and the sub camera unit; and from the main camera unit in the compound eye mode A second imaging control unit that executes imaging by the second imaging unit in response to an imaging instruction signal; and a transmission unit that transmits an image captured by the second imaging unit in the compound eye mode to the main camera unit. It is characterized by providing.

  According to the first aspect, the camera unit can be used as an integral compound eye camera by connecting the camera units, and can also be used as a separate compound eye camera by using the communication means. As a result, it is possible to obtain both the advantages of portability of the integrated compound-eye camera and the advantage of being able to capture an image with a good stereoscopic effect of the separate compound-eye camera, and to easily capture the image. Can do.

  The imaging device according to a second aspect of the present invention is the imaging device according to the first aspect, wherein the main camera unit is related to a relative position of the first and second imaging means when connected to the sub camera unit. Relative position recording means for recording the first and second imaging means from the relative position recording means when the main camera unit and the sub camera unit are connected. The information regarding the relative position of is acquired.

  The imaging apparatus according to a third aspect of the present invention is the imaging apparatus according to the first or second aspect, wherein the relative position detecting means transmits a position detection signal to the sub camera unit, and the relative position with respect to the sub camera unit. Is detected.

  In the second and third aspects, the method for detecting the relative position between the camera units is limited.

  In the imaging device according to a fourth aspect of the present invention, in the first to third aspects, the main camera unit includes a first display unit that displays an image captured by the first imaging unit, The sub camera unit includes a second display unit that displays an image captured by the second imaging unit, the main camera unit and the sub camera unit, and the imaging mode is set to a monocular mode. When set, it further comprises control means for controlling the second imaging means independently of the first imaging means.

  According to the fourth aspect, for example, by independently controlling zooming and focusing of the first and second imaging means, an image for checking the angle of view and the subject (live view) using the second imaging means. Image) and the composition can be easily determined.

  In the imaging device according to a fifth aspect of the present invention, in the fourth aspect, the first and second imaging means each include a zoom lens, and the control means includes the main camera unit and the When the sub camera unit is connected and the imaging mode is set to the monocular mode, the zoom lens of the second imaging unit is moved to the wide side with respect to the zoom lens of the first imaging unit. It is characterized by.

  According to the fifth aspect, since the situation around the subject can be imaged over a wide range by the second imaging means, it is easy to determine the composition.

  The imaging device according to a sixth aspect of the present invention is the imaging device according to the fifth aspect, wherein the main camera unit or the sub camera unit is connected to the main camera unit and the sub camera unit, and the imaging mode is The apparatus further comprises composition analysis means for analyzing an image picked up by the second image pickup means when the monocular mode is set, and the second display means is configured to perform optimal composition based on the analysis result of the composition. It displays the information which shows.

  In the imaging device according to a seventh aspect of the present invention, in the sixth aspect, the second display means overlaps an image captured by the second display means with a frame indicating the optimum composition. It is characterized by displaying.

  According to the sixth and seventh aspects, the composition can be easily determined by calculating and displaying the optimum composition.

  The imaging device according to an eighth aspect of the present invention is the imaging device according to the sixth or seventh aspect, wherein the main camera unit or the sub camera unit has a field-of-view range that can be imaged by the first imaging means in the optimum composition. It further comprises a movement direction calculation means for calculating a movement direction for moving the imaging device when matching, and the first display means displays the movement direction calculated by the movement direction calculation means by the first imaging means. It is characterized by being displayed together with the captured image.

  According to the eighth aspect, the composition can be easily determined by displaying the moving direction of the imaging apparatus.

  In the imaging device according to a ninth aspect of the present invention, in the sixth to eighth aspects, the main camera unit or the sub camera unit evaluates a composition of an image captured by the first imaging means. And a composition evaluation output means for outputting an evaluation result of the composition.

  The imaging apparatus according to a tenth aspect of the present invention is characterized in that, in the ninth aspect, the composition evaluation output means outputs the composition evaluation result by at least one means of a numerical value, a figure, or a sound. .

  According to the ninth and tenth aspects, composition determination is facilitated by displaying the composition evaluation result.

  The image pickup apparatus according to an eleventh aspect of the present invention is characterized in that, in the first to tenth aspects, the image pickup apparatus further comprises designation means for designating a camera unit to be used as a main camera unit from the plurality of camera units. .

  According to the eleventh aspect, for example, the main camera unit can be selected according to the user's dominant arm or the like, so that it is easy to determine the composition when capturing a parallax image.

  According to the present invention, it can be used as an integrated compound eye camera by connecting camera units, and can also be used as a separate compound eye camera by using communication means. As a result, it is possible to obtain both the advantages of portability of the integrated compound-eye camera and the advantage of being able to capture an image with a good stereoscopic effect of the separate compound-eye camera, and to easily capture the image. Can do.

  Hereinafter, preferred embodiments of an imaging device according to the present invention will be described with reference to the accompanying drawings.

  FIG. 1 is a block diagram showing the main configuration of an imaging apparatus according to an embodiment of the present invention. As shown in FIG. 1, the imaging device 10 according to the present embodiment includes two camera units 12A and 12B. Each camera unit 12A and 12B includes a CPU 14, an operation unit 16, an imaging mode setting switch (imaging mode setting SW) 18, a main / sub changeover switch (main / sub changeover SW) 20, a display unit 22, a recording medium 24, and an imaging unit. 28, a signal processing unit 30, a relative position detection unit 32, a 3D image generation unit 34, a communication unit 36, and connectors 38 and 40, and functions as a monocular electronic camera.

  The CPU 14 is a control unit that performs overall control of the entire operation of the imaging apparatus 1 according to a predetermined control program based on operation inputs from operation members including the operation unit 16, the operation mode setting SW 18, and the main / sub switch SW 20.

  The operation unit 16 is operation input means including a power switch and a shutter button 42. The power switch is a switch for switching on / off the power of each camera unit 12. The shutter button 42 is configured by a two-stage stroke type switch composed of so-called “half press” and “full press”. When capturing a still image, the CPU 14 performs imaging preparation processing (that is, AE (Automatic Exposure), AF (Auto Focus), AWB (Automatic) in response to half-pressing of the shutter button 42. White Balance (automatic white balance)) is executed, and image capturing / recording processing is executed in response to the shutter button 42 being fully pressed. When capturing a moving image, the CPU 14 starts capturing the moving image in response to the shutter button 42 being fully pressed, and ends capturing the moving image in response to the full press again.

  The operation mode setting SW 18 is an operation unit for setting the operation mode of the imaging apparatus 10. The CPU 14, in response to an operation input from the operation mode setting SW 18, captures an imaging mode (a monocular mode for capturing a two-dimensional image (2D image) / (still image or moving image) using the camera unit 12A), and camera units 12A and 12B. The operation mode of the image capturing apparatus 10 is switched between a reproduction mode for reproducing an image (a compound eye mode in which images (still images or moving images) are captured from a plurality of viewpoints to generate a three-dimensional image) and images.

  The main / sub switch SW20 is an operation means for setting the camera mode (main camera mode or sub camera mode) of each of the camera units 12A and 12B. In the following description, the camera unit 12A will be described as the main camera unit.

  The display unit 22 is configured by, for example, a display device including a color liquid crystal panel, and functions as an image display unit for displaying captured images, and also functions as a GUI during various settings. The display unit 22 functions as an electronic viewfinder for displaying a live view image (through image) in the imaging mode. The display unit 22 can display a three-dimensional image. As a three-dimensional display method, for example, a vertical slit is formed on the front surface of the display unit 22, and strip-shaped image fragments showing left and right images are alternately arranged and displayed on the display surface of the display unit 22 behind the slit. A parallax barrier method, a so-called lenticular lens having a semi-cylindrical lens group on the surface of the display unit 22, an integral photography method using a microlens array sheet, and an interference phenomenon. A holographic method can be applied.

  The recording medium 24 is a means for recording various data including image data, and is detachable from each camera unit 12. Examples of the recording medium 24 include a semiconductor memory card represented by xD picture card (registered trademark), SD card (registered trademark), and smart media (registered trademark), a portable small hard disk, a magnetic disk, an optical disk, and a magneto-optical disk. For example, various media can be used.

  The relative position detection unit 32 includes a distance sensor, transmits a position detection signal to another camera unit, and is positioned relative to the camera unit (for example, the distance between the camera units 12A and 12B, imaging). The angles of the optical axes of the sections 28A and 28B).

  The communication unit 36 is means for performing wireless communication (for example, wireless communication using radio waves or infrared rays) between the camera units 12A and 12B.

  The connectors 38 and 40 are means for connecting the camera units 12A and 12B.

  FIG. 2 is a perspective view showing a state in which the camera units 12A and 12B are connected via the connectors 38 and 40. FIG. As shown in FIG. 2, connectors 38 and 40 are provided on the left and right side surfaces of the camera units 12A and 12B, respectively. The connector 38 has a concave shape, and the connector 40 has a convex shape. The connector 40 can be housed inside the housing of each camera unit 12A and 12B. The camera units 12A and 12B are fixed to each other by fitting the connector 38A and the connector 40B. Thereby, the camera units 12A and 12B can be used as an integrated compound eye camera. It is also possible to connect three or more camera units in a daisy chain.

  Next, the imaging function of the camera unit 12 will be described. The imaging unit 28 includes an imaging optical system (including a zoom lens, a focus lens, and a diaphragm), a driving motor for the imaging optical system, and an imaging element.

  The CPU 14 performs zooming and focusing by outputting a control signal to the imaging unit 28 and moving the zoom lens and the focus lens. Further, the CPU 14 outputs a control signal to the imaging unit 28 to control the aperture amount (aperture value) of the diaphragm, and controls the amount of light of the subject incident on the imaging element.

  The image sensor is composed of, for example, a color CCD solid-state image sensor. Note that an image sensor having another configuration such as a CMOS sensor may be used as the image sensor. A large number of photodiodes are two-dimensionally arranged on the light receiving surface of the image sensor (CCD), and color filters (for example, three primary colors) are arranged in a predetermined arrangement on each photodiode. The optical image of the subject formed on the light receiving surface of the image sensor by the imaging optical system is converted into signal charges corresponding to the amount of incident light by the photodiode. The signal charges accumulated in each photodiode are sequentially read out from the image sensor as a voltage signal (image signal) in accordance with a command from the CPU 14. The image sensor has an electronic shutter function, and the exposure time (shutter speed) is controlled by controlling the charge accumulation time in the photodiode.

  The signal processing unit 30 is a correlated double sampling circuit (CDS) for removing reset noise (low frequency) included in the image signal output from the image sensor, and amplifies the image signal to control it to a certain level. An AGS circuit is included. The signal processing unit 30 performs correlated double sampling processing on the image signal output from the image sensor and amplifies it to convert it into a digital image signal.

  The digital image signal output from the signal processing unit 30 is subjected to a synchronization process (a process of converting a color signal into a simultaneous type by interpolating a spatial shift of the color signal associated with the color filter array of the single CCD), white Processing such as balance adjustment, gradation conversion (for example, gamma correction), contour correction, luminance / color difference signal generation, and the like are performed by the CPU 14 and then output as a luminance signal and a color difference signal (Y / C signal).

  When displaying a live view image (through image), the Y / C signal is output to the display unit 22, converted into a video signal for display, and output to the display unit 22.

  When capturing a still image, the CPU 14 executes AE processing and AF processing in response to half-pressing of the shutter button (S1 on). In the AE process, the CPU 14 calculates an exposure value (imaging EV value) from the subject brightness detected by the division photometry, and determines an aperture value and a shutter speed according to the exposure value and a predetermined program diagram. Further, in the auto mode, the CPU 14 performs setting of flash emission on / off and calculation of the flash emission amount. In the AF process, for example, the CPU 14 moves the focus lens so that the high-frequency component of the G signal of the image signal is maximized. Further, during automatic white balance control, the CPU 14 determines the light source type based on the R, G, and B signals, and applies a gain to the R, G, and B signals.

  After the AE process and the AF process are performed by half-pressing the release switch (S1 on) and then the release switch is fully pressed (S2 on), the recording imaging operation starts. The image signal acquired in response to S2 ON is converted into a Y / C signal by the CPU 14, subjected to predetermined processing such as gamma correction, compressed according to a predetermined format, and then recorded on the recording medium 24. The For example, still images are recorded as JPEG (Joint Photographic Experts Group) format, and moving images are recorded as AVI (Audio Video Interleaving) format image files.

  In the reproduction mode, the compressed data of the last image file (last recorded image file) recorded on the recording medium 24 is read. When the image file related to the last recording is a still image file, the read image compressed data is decompressed by the CPU 14 into an uncompressed Y / C signal and output to the display unit 22. During single frame playback of a still image (including playback of the first frame of a moving image), the operation target 16 can be used to switch the image file to be played back (forward frame advance / reverse frame advance). The image file at the frame-advanced position is read from the recording medium 24 and reproduced and displayed on the display unit 22.

  Next, the case where the imaging device 10 is used as a separation type compound eye camera will be described. When the operation mode of the camera unit 12A is set to the compound eye mode, the CPU 14A transmits a search signal from the communication unit 36A to detect another camera unit 12B within a communicable range. Upon receiving the search signal from the camera unit 12A via the communication unit 36B, the camera unit 12B transmits a response signal to the camera unit 12A.

  When the CPU 14A receives the response signal from the camera unit 12B, the CPU 14A controls the main / sub switch SW 20A to set the camera mode of the camera unit 12A to the main camera mode and transmits a control signal to the camera unit 12B. The camera mode of the unit 12B is set to the sub camera mode.

  The camera mode may be set manually by the main / sub switch SW 20A and 20B of each camera unit 12A and 12B, or the camera that is operated first after the camera units 12A and 12B are connected. A unit or a predetermined (eg, right) camera unit may be automatically set to the main camera mode.

  The CPU 14B (hereinafter referred to as sub CPU 14B) of the sub camera unit 12B controls each part in the sub camera unit 12B in accordance with a control signal from the CPU 14A (hereinafter referred to as main CPU 14A) of the main camera unit 12A. Note that the operation input from the operation members (the operation unit 16B, the operation mode setting SW 18B, and the main / sub switch SW 20B) of the sub camera unit 12B may be invalidated.

  Further, when receiving the response signal via the communication unit 36A, the CPU 14A detects the relative position between the camera units 12A and 12B (particularly, the relative position between the imaging units 28A and 28B) using the relative position detection unit 32A.

  FIG. 3 is a diagram for explaining measurement processing of the relative positions of the camera units 12A and 12B. As shown in FIG. 3, the relative position detector 32A transmits a position detection signal (for example, radio waves, ultrasonic waves, or infrared rays) from a predetermined position P10 of the camera unit 12A. The camera unit 12B has a position detection signal receiver at predetermined positions P12 to P16. The camera units 12A and 12B have inclination sensors P18 and P20 that detect the inclinations of the camera units 12A and 12B, respectively. The sub CPU 14B measures the reception time of the position detection signal in each of the receivers P12 to P16, and informs the main camera unit 12A of the positions of the receivers P12 to P16 and the information about the tilt of the camera unit 12B acquired by the tilt sensor P20. Send. The main CPU 14A calculates the distance from the receivers P12 to P16 based on the transmission time of the position detection signals and the reception times of the position detection signals at the receivers P12 and P16, and the camera units 12A and P20 by the inclination sensors P18 and P20. The inclination of 12B is detected, and the relative position between the camera units 12A and 12B (for example, the distance between the camera units 12A and 12B, the angle θ formed by the optical axis LA of the imaging unit 28A and the optical axis LB of the imaging unit 28B). Measure.

  The main CPU 14A performs AF control in the imaging unit 28B so that the same subject (hereinafter referred to as a standard subject) that is in focus in the imaging unit 28A is in focus, and the brightness of the standard subject is the same. The exposure is controlled as follows. Note that a standard subject may be designated in accordance with an operation input from the operation unit 16A. The through image captured by the imaging unit 28A is displayed on the display unit 22A, and the through image captured by the imaging unit 28B is displayed on the display unit 22B. Note that the through image captured by the imaging unit 28B of the sub camera unit 12B may be transmitted to the main camera unit 12A and displayed on the display unit 22A.

  The main CPU 14A performs AE processing and AF processing based on the image signal obtained from the imaging unit 28A in response to half-pressing of the shutter button 42A, and transmits a control signal to the sub CPU 14B to obtain from the imaging unit 28B. AE processing and AF processing are performed based on the received image signal. The main CPU 14A simultaneously performs recording for recording by the imaging units 28A and 28B in response to the full depression of the shutter button 42A. The main CPU 14A and the sub CPU 14B calculate the time required to transmit the imaging instruction signal based on the relative position between the camera units 12A and 12B, and the imaging unit 28A so that still images are captured at the same timing. And 28B are controlled. The still image captured by the imaging unit 28B is transmitted to the main camera unit 12A via the communication units 36B and 36A. The 3D image generation unit 34A generates a three-dimensional image (3D image) using still images from a plurality of viewpoints captured by the imaging units 28A and 28B and information regarding the relative positions of the imaging units 28A and 28B. The 3D image generated by the 3D image generation unit 34A is converted into an image file of a predetermined format and recorded on the recording medium 24A.

  When a 3D moving image is captured, moving image capturing is performed in synchronization by the imaging units 28A and 28B in response to the shutter button 42A being fully pressed, and moving image capturing is performed in response to the shutter button 42A being fully pressed again. Ends. The moving images imaged by the imaging units 28A and 28B are recorded in the recording media 24A and 24B, respectively. Then, the moving image captured by the imaging unit 28B is transmitted to the main camera unit 12A via the communication units 36B and 36A. The 3D image generation unit 34A generates a 3D image by using the moving images of the multiple viewpoints captured by the imaging units 28A and 28B and information regarding the relative positions of the imaging units 28A and 28B. The 3D image generated by the 3D image generation unit 34A is converted into an image file of a predetermined format and recorded on the recording medium 24A.

  If there is no free space on the recording medium 24A, a 3D image may be transmitted and recorded on the recording medium 24B of the sub camera unit 12B. In this case, an image captured by the imaging unit 28A may be transmitted to the sub camera unit 12B, and a 3D image may be generated by the 3D image generation unit 34B of the sub camera unit 12B.

  Next, a case where the imaging device 10 is used as an integrated compound eye camera will be described. When the camera units 12A and 12B are connected via the connectors 38A and 40B and the operation mode of the camera unit 12A is set to the compound eye mode, the CPU 14A controls the main / sub switching SW 20A to control the camera mode of the camera unit 12A. Set to the main camera mode. The CPU 14A transmits a control signal to the camera unit 12B via the connectors 38A and 40B, and sets the camera mode of the camera unit 12B to the sub camera mode.

  The camera mode may be set manually by the main / sub switch SW 20A and 20B of each camera unit 12A and 12B, or the camera that is operated first after the camera units 12A and 12B are connected. A unit or a predetermined (eg, right) camera unit may be automatically set to the main camera mode.

  The CPU (sub CPU) 14B of the sub camera unit 12B controls each part in the sub camera unit 12B in accordance with a control signal from the CPU (main CPU) 14A of the main camera unit 12A. Note that the operation input from the operation members (the operation unit 16B, the operation mode setting SW 18B, and the main / sub switch SW 20B) of the sub camera unit 12B may be invalidated.

  Further, when receiving the response signal via the communication unit 36A, the CPU 14A acquires the relative position information of the camera units 12A and 12B and the relative position information of the imaging units 28A and 28B. The relative position information of the camera units 12A and 12B and the relative position information of the imaging units 28A and 28B are recorded, for example, in the built-in memories of the camera units 12A and 12B. The relative position information may be detected in the same manner as in FIG.

  When capturing an image, the main CPU 14A controls the image capturing units 28A and 28B in accordance with an operation input from the operation unit 16A, always having the same focal length (zoom magnification), and always focusing on the same subject. Thus, the aperture is adjusted so that the aperture value is always the same. The through image captured by the imaging unit 28A is displayed on the display unit 22A, and the through image captured by the imaging unit 28B is displayed on the display unit 22B.

  The main CPU 14A transmits a control signal to each part of the main camera unit 12A and the sub CPU 14B in response to half-pressing of the shutter button 42A, and based on the image signal obtained from one of the imaging units 28A and 28B. AE processing and AF processing are performed. The main CPU 14A simultaneously captures still images by the imaging units 28A and 28B in response to the full press of the shutter button 42A. The still image imaged by the imaging unit 28B is transmitted to the main camera unit 12A via the connectors 38A and 40B. The 3D image generation unit 34A generates a three-dimensional image (3D image) using still images captured from a plurality of viewpoints by the imaging units 28A and 28B and information regarding the relative positions of the imaging units 28A and 28B. The 3D image generated by the 3D image generation unit 34A is converted into an image file of a predetermined format and recorded on the recording medium 24A.

  When a 3D moving image is captured, moving image capturing is performed in synchronization by the imaging units 28A and 28B in response to the shutter button 42A being fully pressed, and moving image capturing is performed in response to the shutter button 42A being fully pressed again. Ends. The moving images imaged by the imaging units 28A and 28B are recorded in the recording media 24A and 24B, respectively. Then, the moving image captured by the imaging unit 28B is transmitted to the main camera unit 12A via the communication units 36B and 36A. The 3D image generation unit 34A generates a 3D image by using the moving images of the multiple viewpoints captured by the imaging units 28A and 28B and information regarding the relative positions of the imaging units 28A and 28B. The 3D image generated by the 3D image generation unit 34A is converted into an image file of a predetermined format and recorded on the recording medium 24A.

  If there is no free space on the recording medium 24A, a 3D image may be transmitted and recorded on the recording medium 24B of the sub camera unit 12B. In this case, an image captured by the imaging unit 28A may be transmitted to the sub camera unit 12B, and a 3D image may be generated by the 3D image generation unit 34B of the sub camera unit 12B.

  On the other hand, when the camera units 12A and 12B are connected, if one of the connected camera units 12A and 12B is set to the monocular mode, each camera unit 12A and 12B can be controlled individually. Become. That is, zooming, focusing, and adjustment of the aperture of the imaging units 28A and 28B can be individually controlled according to operation inputs from the operation units 16A and 16B, respectively.

  When a still image is captured, an image is captured by the main camera unit 12A and recorded on the recording medium 24A in response to the full press of the shutter button 42A.

  Note that in response to the full press of the shutter button 42A, the sub camera unit 12B may simultaneously capture an image and record it on the recording medium 24A in association with the image captured by the main camera unit 12A. If there is no free space on the recording medium 24A, an image may be transmitted and recorded on the recording medium 24B of the sub camera unit 12B.

  The camera mode may be set manually by the main / sub switch SW 20A and 20B of each camera unit 12A and 12B, or the camera unit 12A and 12B that is operated first after connection. The camera unit or the right camera unit may be automatically set to the main camera mode.

  The imaging apparatus 10 according to the present embodiment has an imaging assist mode for assisting the imaging of the 2D image in the main camera unit 12A when the monocular mode is set when the camera units 12A and 12B are connected.

  FIG. 4 is a diagram for explaining the operation of the imaging apparatus 10 in the imaging assist mode. When the imaging assist mode is set, as shown in FIG. 4, the main CPU 14A transmits a control signal to the imaging unit 28B of the sub camera unit 12B, and the zoom lens of the imaging unit 28B is set to the imaging unit 28A of the main camera unit 12A. The zoom lens is controlled to be positioned on the wide side (for example, the wide end) from the zoom lens. Thereby, a through image zoomed to the wide side is displayed on the display unit 22B of the sub camera unit 12B, and the user can visually recognize the situation around the subject.

  FIG. 5 is a diagram for explaining a second embodiment of the imaging assist mode. In this embodiment, as shown in FIG. 5, an optimal composition frame F10 indicating the optimal composition is displayed on the display unit 22B together with the through image zoomed to the wide side, and composition advice (arrow A10) is displayed on the display unit 22A. ) Is displayed. The composition advice (arrow A10) indicates the moving direction of the imaging apparatus 10 when the imaging apparatus 10 is moved so that the field of view (view angle) of the imaging unit 28A matches the optimal composition frame F10.

  When calculating the position of the optimum composition frame F10, the main CPU 14A extracts the focused subject O10 from the image captured by the imaging unit 28A. Next, the main CPU 14A acquires an image captured by the imaging unit 28B, and extracts the subject O10 from the image. Then, the CPU 14A calculates the position of the optimal composition frame F10 so that the subject O10 is positioned at the center of the optimal composition frame F10. The size of the optimal composition frame F10 is, for example, a size corresponding to the zoom magnification in the imaging unit 28A. The optimum composition frame F10 moves in conjunction with the movement of the imaging device 10.

  The direction and length of the arrow A10 for composition advice are calculated based on the position of the optimum composition frame F10 and the relative position of the field of view of the imaging unit 28A.

  According to the present embodiment, it is easy to adjust to the optimum composition frame F10 when a 2D image is captured by the imaging unit 28A.

  The optimal composition frame F10 is, for example, an optimal composition frame F10 that accompanies the movement of the imaging apparatus 10 by making the zoom lens of the imaging unit 28B considerably wider (for example, the wide end) than the zoom lens of the imaging unit 28A. May be substantially fixed. Further, when the main CPU 14A detects that the field of view of the imaging unit 28A matches the optimal composition frame F10, the composition advice (arrow A10) display may be erased.

  The calculation of the position of the optimum composition frame F10 and the like may be performed by the sub CPU 14B.

  FIG. 6 is a diagram for explaining a third embodiment of the imaging assist mode. In the present embodiment, as shown in FIG. 6, the composition evaluation value (score) H10 in the current imaging unit 28A is displayed on the display unit 22A. The CPU 14A quantifies the evaluation value of the current composition based on, for example, the degree of coincidence between the field of view of the imaging unit 28A and the optimum composition frame F10, the size of the subject O10, and the balance between the subject O10 and the background portion, and displays it on the display unit 22A. indicate. The composition evaluation value may be displayed by, for example, a graphic (for example, ◎, ◯ or Δ) or a message (for example, a character or a voice).

  According to the present embodiment, it is possible to provide a composition evaluation value to the user when a 2D image is captured by the imaging unit 28A.

  FIG. 7 is a flowchart illustrating processing of the imaging apparatus 10 at the time of capturing an image. First, when no other camera unit is connected to the camera unit 12A (No in step S10) and the operation mode of the camera unit 12A is set to the monocular mode (step S12), the camera unit 12A It functions as a monocular electronic camera and can capture 2D images (step S14).

  On the other hand, if the operation mode of the camera unit 12A is set to the compound eye mode in step S12, it is detected whether there is another camera unit within a communicable range via the communication unit 36A (step S16). . If no other camera unit is detected (No in step S16), the camera unit 12A functions as a monocular electronic camera (step S14).

  On the other hand, when another camera unit 12B is detected (Yes in step S16), the relative position to the detected camera unit 12B (for example, the distance between the camera units 12A and 12B, and the camera units 12A and 12B). The angle formed by the optical axis of the imaging optical system is detected by the relative position detector 32A (step S18). Based on the relative position detected in step S18, calibration of each camera unit 12A and 12B is performed in accordance with the same subject (standard subject) in the field of view of each camera unit 12A and 12B (step S20). ). In step S20, according to the control signal from the main CPU 14A, each camera unit 12A and 12B performs AF control so that the standard subject is in focus, for example, and the brightness of the standard subject is the same. Exposure control is performed.

  Next, when the shutter button 42A is fully pressed, an imaging instruction signal is transmitted from the main camera unit 12A to the sub camera unit 12B, and images are simultaneously captured by the main camera unit 12A and the sub camera unit 12B (steps). S22). In step S22, the main CPU 14A and the sub CPU 14B calculate the time required for transmitting the imaging instruction signal based on the relative position between the camera units 12A and 12B, and perform imaging so that images are captured at the same timing. The units 28A and 28B are controlled.

  An image captured by the sub camera unit 12B is transmitted to the main camera unit 12A (step S32) and received by the main camera unit 12A (step S26). Then, the image captured by the main camera unit 12A and the image captured by the sub camera unit 12B are processed by the 3D image generation unit 34A of the main camera unit 12A to synthesize 3D image data (step S28), and the recording medium 24A is recorded (step S30).

  Next, the case where the camera unit 12B is connected to the camera unit 12A via the connectors 38A and 40B (Yes in step S10) will be described. When the operation mode of the camera unit 12A is set to the compound eye mode (step S34), the main CPU 14A causes the relative position information of the camera units 12A and 12B (for example, the distance and the convergence angle between the camera units 12A and 12B). Is acquired by the relative position detector 32A (step S36). The relative position information may be measured every time the camera units 12A and 12B are connected, or may be stored in advance in the camera units 12A and 12B.

  Next, when the shutter button 42A is fully pressed, an imaging instruction signal is transmitted from the main camera unit 12A to the sub camera unit 12B, and images are simultaneously captured by the main camera unit 12A and the sub camera unit 12B (steps). S22). In step S22, the main CPU 14A and the sub CPU 14B calculate the time required for transmitting the imaging instruction signal based on the relative position between the camera units 12A and 12B, and perform imaging so that images are captured at the same timing. The units 28A and 28B are controlled. When the camera unit 12B is connected to the camera unit 12A, the imaging units 28A and 28B are always set to the same focal length (zoom magnification), and focus adjustment is performed so that the same subject is always in focus. Is called. In addition, the aperture is adjusted so that the same aperture value is always obtained.

  An image captured by the sub camera unit 12B is transmitted to the main camera unit 12A (step S32) and received by the main camera unit 12A (step S26). Then, the image captured by the main camera unit 12A and the image captured by the sub camera unit 12B are processed by the 3D image generation unit 34A of the main camera unit 12A to synthesize 3D image data (step S28), and the recording medium 24A is recorded (step S30).

  On the other hand, in step S34, when the operation mode of the camera unit 12A is set to the monocular mode, the imaging units (28A and 28B) of the camera units 12A and 12B can be controlled independently (separately). It is set (step S38). In step S38, for example, when the shutter button 42A is fully pressed, an image is captured by the imaging unit 28A of the main camera unit 12A (step S40) and recorded on the recording medium 24A (step S42).

  According to the present embodiment, the camera units 12A and 12B can be connected to be used as an integrated compound eye camera, and can also be used as a separate compound eye camera by using wireless communication. As a result, it is possible to obtain both the advantages of portability of the integrated compound-eye camera and the advantage of being able to capture an image with a good stereoscopic effect of the separate compound-eye camera, and to easily capture the image. Can do.

  In the present embodiment, two camera units are used. However, a parallax image may be captured by three or more camera units.

1 is a block diagram illustrating a main configuration of an imaging apparatus according to an embodiment of the present invention. The perspective view which shows the state which connected camera unit 12A and 12B via the connectors 38 and 40. FIG. The figure for demonstrating the measurement process of the relative position of camera unit 12A and 12B The figure for demonstrating operation | movement of the imaging device 10 at the time of imaging assistance mode The figure for demonstrating the 2nd Example of imaging assistance mode The figure for demonstrating the 3rd Example of imaging assistance mode The flowchart which shows the process of the imaging device 10 at the time of imaging of an image

Explanation of symbols

  DESCRIPTION OF SYMBOLS 10 ... Imaging device, 12 ... Camera unit, 14 ... CPU, 16 ... Operation part, 18 ... Imaging mode setting switch (imaging mode setting SW), 20 ... Main / sub changeover switch (main / sub changeover SW), 22 ... Display , 24 ... recording medium, 28 ... imaging unit, 30 ... signal processing unit, 32 ... relative position detection unit, 34 ... 3D image generation unit, 36 ... communication unit, 38, 40 ... connector, 42 ... shutter button

Claims (11)

A plurality of camera units including a main camera unit and one or more sub camera units are provided.
The main camera unit is
First imaging means for capturing an image;
First recording means for recording an image picked up by the image pickup means;
First connecting means for integrally connecting the sub camera units;
First connection state detection means for detecting whether or not the sub camera unit is connected via the first connection means;
First communication means for communicating with the sub camera unit when the sub camera unit is not connected via the first coupling means;
An imaging mode between a monocular mode for capturing a two-dimensional image by the main camera unit and a compound eye mode for acquiring a parallax image by capturing an object from a plurality of viewpoints by the main camera unit and sub camera unit First imaging mode switching means for switching;
When the imaging mode of the main camera unit is switched to the compound eye mode, a relative position detecting means for detecting a relative position with respect to the sub camera unit;
Calibration means for performing calibration based on the relative position detected by the relative position detection means;
An imaging instruction means for inputting an imaging instruction of an image to the first imaging means;
When the imaging instruction is input in the compound eye mode, an imaging instruction signal is transmitted to the second imaging unit provided in the sub camera unit, and imaging is performed in synchronization with the first and second imaging units. First imaging control means for executing
Receiving means for receiving a second image imaged by the second imaging means in response to the imaging instruction signal;
Three-dimensional image generation means for generating a three-dimensional image using the first image and the second image captured by the first imaging means in the compound eye mode;
The sub camera unit is
A second imaging means for capturing an image;
Second recording means for recording an image picked up by the image pickup means;
Second connection means for connecting integrally with the main camera unit via first connection means provided in the main camera unit;
A connection state detection means for detecting whether or not the main camera unit is connected via the second connection means;
Second communication for communicating with the main camera unit via first communication means provided in the main camera unit when the main camera unit is not connected via the second connecting means Means,
An imaging mode between a monocular mode for capturing a two-dimensional image by the sub camera unit and a compound eye mode for acquiring a parallax image by capturing a subject from a plurality of viewpoints by the main camera unit and the sub camera unit. Second imaging mode switching means for switching;
Second imaging control means for performing imaging by the second imaging means in response to an imaging instruction signal from the main camera unit in the compound eye mode;
Transmitting means for transmitting an image captured by the second imaging means to the main camera unit in the compound eye mode;
An imaging apparatus comprising: The main camera unit further includes a relative position recording unit that records information about a relative position of the first and second imaging units when connected to the sub camera unit.
The relative position detection means acquires information on the relative positions of the first and second imaging means from the relative position recording means when the main camera unit and the sub camera unit are connected. The imaging apparatus according to claim 1.   The imaging apparatus according to claim 1, wherein the relative position detection unit transmits a position detection signal to the sub camera unit to detect a relative position with respect to the sub camera unit. The main camera unit includes first display means for displaying an image picked up by the first image pickup means,
The sub camera unit is
Second display means for displaying an image picked up by the second image pickup means;
Control for controlling the second imaging unit independently of the first imaging unit when the main camera unit and the sub camera unit are connected and the imaging mode is set to the monocular mode. The imaging apparatus according to claim 1, further comprising means. Each of the first and second imaging means includes a zoom lens,
When the main camera unit and the sub camera unit are connected and the imaging mode is set to a monocular mode, the control unit controls the zoom lens of the second imaging unit to the first imaging unit. The image pickup apparatus according to claim 4, wherein the image pickup apparatus is moved to the wide side of the zoom lens. The main camera unit or the sub camera unit is an image captured by the second imaging unit when the main camera unit and the sub camera unit are connected and the imaging mode is set to a monocular mode. Further comprising a composition analysis means for analyzing
The imaging apparatus according to claim 5, wherein the second display unit displays information indicating an optimum composition based on an analysis result of the composition.   The image pickup apparatus according to claim 6, wherein the second display unit displays a frame indicating the optimum composition so as to overlap the image picked up by the second display unit. The main camera unit or the sub camera unit further includes a moving direction calculating unit that calculates a moving direction in which the imaging device is moved when the visual field range that can be imaged by the first imaging unit matches the optimal composition. ,
The imaging apparatus according to claim 6 or 7, wherein the first display means displays the movement direction calculated by the movement direction calculation means together with an image captured by the first imaging means. The main camera unit or sub camera unit is
Composition evaluation means for evaluating the composition of an image captured by the first imaging means;
Composition evaluation output means for outputting an evaluation result of the composition;
The imaging apparatus according to claim 6, further comprising:   The imaging apparatus according to claim 9, wherein the composition evaluation output unit outputs the composition evaluation result by at least one of a numerical value, a graphic, and a sound.   The imaging apparatus according to claim 1, further comprising a designation unit that designates a camera unit to be used as a main camera unit from a plurality of camera units.

Images