JP2006033395A - Image pickup device and stereoscopic image pickup system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image pickup device and a stereoscopic image pickup system by which image pickup directions of two digital cameras can be matched with each other when executing the stereoscopic image pickup of a landscape by using the two digital cameras. <P>SOLUTION: First and second digital cameras 2, 3 are connected with each other by a communication control circuit 64. A first through-image picked up by the first digital camera 2 and a second through-image picked up by the second digital camera 3 are simultaneously displayed on a liquid crystal panel 37. A cross button is operated so as to match the image pickup direction of the second through-image with the first through-image by observing the liquid crystal panel 37. A sensor moving mechanism 44 is operated on the basis of the operation of the cross button. An image sensor 33 is moved to an image pickup optical axis. Consequently, the adjustment of the image pickup direction can be executed. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a stereoscopic imaging system that performs stereoscopic imaging by linking at least two imaging devices, and an imaging device used in the stereoscopic imaging system, and more specifically, stereoscopic imaging of distant subjects such as landscapes. The present invention relates to an imaging device and a stereoscopic imaging system.

  As is well known, the image captured by the human eye has a stereoscopic effect because a parallax image captured from different directions by the left and right eyes is recognized as one image. In order to create a 3D image using the 3D recognition method based on the parallax between the left and right eyes of the human, each image sensor of the 2 imaging optical systems captures a common subject and combines the captured image data. A stereoscopic digital camera that generates stereoscopic image data that can be stereoscopically viewed is known (for example, see Patent Document 1).

  In a stereoscopic digital camera, in order to give an appropriate stereoscopic effect to a synthesized image, the imaging directions of a pair of imaging optical systems must match. For this reason, the conventional stereoscopic digital camera is provided with a mechanical adjustment mechanism that matches the imaging direction of one imaging optical system with the imaging direction of the other imaging optical system. In addition, in the stereoscopic digital camera described in Patent Document 1, in order to reduce the man-hour and cost of manual adjustment of the adjustment mechanism, the deviation of the imaging optical axis is corrected by manipulating the address of the image data on the image memory. Yes.

  In order to capture a natural stereoscopic image with a stereoscopic digital camera, it is preferable that the base length of the two imaging optical systems (distance between the imaging optical systems) be 1/50 to 1/100 of the distance to the subject. Yes. However, when taking a three-dimensional image of a landscape photograph, the distance between the camera and the subject may be several kilometers, and the base line length required at that time is several tens of meters. When the base line length becomes long in this way, two digital cameras are used and placed at a predetermined position, both digital cameras are pointed in the same direction of the subject, and one digital camera is linked to the other. Just take a picture.

Japanese Patent Laid-Open No. 06-273172

  However, when two digital cameras are arranged at a distance of several tens of meters, it is impossible to confirm the imaging directions of both digital cameras at the same time. Therefore, it is difficult to point the two cameras in the same direction.

  An object of the present invention is to solve the above-described problems, and it is an object of the present invention to easily adjust the imaging direction when performing stereoscopic imaging of a landscape using two digital cameras.

  In order to solve the above-described problems, an imaging apparatus according to the present invention includes a communication unit that is connected to the second imaging apparatus to transmit and receive various signals and data and interlocks the second imaging apparatus with various operations, and performs image processing. The first through image data generated by the means and the second through image data of the second imaging device can be simultaneously displayed on the display means.

  In addition, the imaging directions of the first through image data and the second through image data can be adjusted by operating the operation means. The adjustment of the actual imaging direction is performed by the adjustment unit based on the adjustment signal generated by the operation of the operation unit or the second adjustment signal received from the second imaging device by the communication unit.

  The adjusting means moves only the image sensor or moves the imaging optical system and the image sensor together. It is also possible to analyze the first through image data and the second through image data and automatically generate an adjustment signal that can match the imaging directions of the two.

  In addition, a stereoscopic imaging apparatus capable of performing stereoscopic imaging was configured by using at least two imaging apparatuses described above and connecting them by communication means.

  According to the imaging apparatus and the stereoscopic imaging system of the present invention, since the second imaging apparatus is connected by the communication means for transmitting and receiving various signals and data, it is possible to perform imaging by linking at least two imaging apparatuses. The captured image data can be managed by a single imaging device. In addition, since the first through image data captured by itself and the second through image data captured by the second imaging device are simultaneously displayed on the display means of one imaging device, Even if the image pickup apparatus is installed at a remote position, the image pickup directions of both can be easily confirmed.

  In addition, since the adjustment of the imaging direction can be performed while viewing the first through image data and the second through image data of the display means, the adjustment accuracy is improved and the time required for the adjustment is also shortened. be able to. Since the adjustment means for adjusting the imaging direction moves only the image sensor, it is not necessary to provide a large adjustment mechanism in the imaging apparatus, and fine adjustment of the imaging direction can be performed with sufficient accuracy. In addition, the adjustment means that moves the image sensor and the imaging optical system together can make adjustments over a wide range, although the adjustment mechanism is somewhat complicated, and the adjustment accuracy can be further improved. Furthermore, since the first through image data and the second through image data are analyzed and automatic adjustment can be performed, a certain adjustment accuracy can be obtained regardless of the skill of the adjuster.

  1A and 1B are perspective views showing an external shape of a digital camera 2 embodying the present invention as viewed from the front and the rear. As shown in FIG. 2, this digital camera 2 is connected to a second digital camera 3 having the same function as a first digital camera constituting a stereoscopic imaging system by a communication cable 4 and is separated by a predetermined distance. Each of which is fixed at a certain position with a tripod 5 and has the function of creating stereoscopic imaging data capable of stereoscopic viewing by imaging the same subject 6 in conjunction with the imaging operation.

  The digital camera 2 is disposed in a horizontal direction, and has a substantially cylindrical main body 11 in which an imaging lens 10 is incorporated, and a grip portion provided so as to project laterally from the rear end side of the main body 11. 12, an openable / closable strobe light emitting portion 13 integrally provided above the main body portion 11, and an operation portion 14 provided on the back surface of the main body portion 11 and the grip portion 12 and used for various operations. Yes.

  On the upper surface of the grip portion 12, a release button 17 and an operation dial 18 that are operated at the time of photographing are provided. The release button 17 can be pressed to a two-stage depth called so-called half-press and full-press. The digital camera 2 performs photometry and distance measurement of the subject when the release button 17 is half-pressed, and performs focus adjustment according to data obtained by distance measurement when the release button 17 is fully pressed, and images are taken at the aperture and shutter speed obtained by photometry. .

  The operation dial 18 is an operation member that is rotated, and the digital camera 2 is set to various operation modes such as a still image capturing mode, a moving image capturing mode, a stereoscopic image capturing mode, and a reproduction mode depending on the rotation stop position.

  The operation unit 14 on the back of the digital camera 2 is provided with an eyepiece-side finder window 21, a display monitor 22 as display means, a cross button 23 as operation means, and the like. The display monitor 22 is composed of a liquid crystal panel (LCD), displays various setting screens, reproduces and displays recorded image data, and displays images during standby for shooting in the still image capturing mode, the moving image capturing mode, and the stereoscopic imaging mode. The image captured by the sensor is displayed in real time.

  The cross button 23 is an operation button that can be operated in the up / down / left / right cross directions, and is used to move the cursor on the menu screen displayed on the display monitor 22 when various settings of the digital camera 2 are performed. In the imaging mode, it is used to change the zoom magnification of the imaging lens 10. In the stereoscopic imaging mode, it is used for an operation for finely adjusting the imaging direction.

  A communication connector 26 used for connection with the second digital camera 3 when performing stereoscopic imaging is provided on the side surface of the main body 11. A connection terminal 4 a provided at one end of the connection cable 4 is inserted into the communication connector 26.

  Although not shown in detail in the form, as shown in the block diagram of FIG. 3, the digital camera 2 is provided with a memory card slot in which a connector 29 for a memory card is incorporated. The captured image data is set in the memory card slot and recorded in the memory card 30 connected to the connector 29.

  Behind the imaging lens 10 is an image sensor 33 that captures a subject image formed by the imaging lens 10. The image sensor 33 is an image area sensor in which light receiving elements are arranged in a matrix, and a CCD, a CMOS, or the like is used. The image sensor 33 generates an analog imaging signal by imaging and inputs the analog imaging signal to the image processing circuit 34.

  The image processing circuit 34 generates an image data of digital RGB from an analog imaging signal, and performs various image processing such as gradation conversion, white balance correction, and γ correction on the generated image data. An image quality processing unit for improving image quality, and a compression processing unit for generating image files such as jpeg by performing YC conversion processing, fixed length processing, compression processing, and the like on the image data subjected to various types of image processing Consists of.

  The image data generated by the image processing circuit 34 includes through image data and main image data. The through image data is displayed on the liquid crystal panel 37 constituting the display monitor 22 when the digital camera 2 is set to a still image capturing mode, a moving image capturing mode, a stereoscopic image capturing mode, or the like and is in a capturing standby state where actual capturing is not performed. This is image data for simple display used for displaying captured images in real time. The image processing circuit 34 generates through image data by performing simple image processing on the digital image data converted from the imaging signal.

  With respect to the through image data, the main image data is high-quality image data for recording and storage, and is subjected to higher-level image processing than the through-image data by the image quality processing unit of the image processing circuit 34, so that higher image quality is achieved. To correct image data. The image data is generated when the release button 17 is fully pressed, and a release signal is input from the release switch 40 that detects the operation of the release button 17 to the system controller 41 that controls the entire digital camera 2. Sometimes done.

  The system controller 41 is a well-known microcomputer, and includes a CPU that performs various arithmetic processes, a ROM that records program data, a RAM that appropriately records data generated in the control of the digital camera 2, and the like.

  The sensor moving mechanism 44 connected to the image sensor 33 constitutes an adjustment unit used for fine adjustment of the imaging direction in the stereoscopic imaging mode. As shown in FIG. 4 showing the external shape and FIG. 5 which is a cross-sectional view, the sensor moving mechanism 44 includes a rectangular moving table 46 that holds the image sensor 33 and the moving table 46. A fixed base 47 having a rectangular shape, and four tilt mechanisms 48 for moving the four sides of the moving base 46 in the imaging optical axis X direction with respect to the fixed base 47. Each tilt mechanism 48 operates based on the adjustment signal output from the cross switch 50 that detects the operation of the cross button 23.

  The tilt mechanism 48 connects the moving base 46 and the fixed base 47, and a spring 53 that biases the moving base 46 in a direction in which the moving base 46 abuts the fixed base 47, a motor 54 incorporated in the fixed base 47, and imaging. A lead screw 55 arranged along the optical axis X direction and rotated by the motor 54, a guide pin 56 arranged along the vicinity of the lead screw 55, a screw hole screwed into the lead screw 55, and a guide pin It comprises a spherical moving member 57 having a guide hole into which 56 is inserted. The moving member 57, the lead screw 55, and the guide pin 56 are inserted into a receiving hole 58 provided in the moving table 46, and the moving member 57 is in contact with the inner wall surface of the receiving hole 58.

  As shown in FIG. 5A, the sensor moving mechanism 44 in the normal state has the back surface of the moving table 46 in contact with the front surface of the fixed table 47 by the bias of the spring 53, and the imaging surface 33a of the image sensor 33 is It is held perpendicular to the imaging optical axis X. When the digital camera 2 is set to the stereoscopic imaging mode and the above-described cross button 23 is operated for fine adjustment of the imaging direction, the motor 54 of each tilt mechanism 48 rotates in accordance with the operation. As shown in FIG. 5B, when the lead screw 55 is rotated by the rotation of the motor 54, the moving member 57 whose rotation is blocked by the guide pin 56 moves in the imaging optical axis X direction. During this movement, the receiving hole 58 is pressed against the urging of the spring 53, and each side of the moving base 46 is moved in the imaging optical axis X direction. Thereby, the imaging surface 33a of the image sensor 33 is inclined with respect to the imaging optical axis X, and the imaging direction is finely adjusted.

  The moving position of the moving base 46 can be detected by detecting the rotation of the motor 54 with the encoder 61 and counting the detection signal with the system controller 41, so that the moving position is moved when the digital camera 2 is turned off. The base 46 can be returned to the initial position, or a predetermined movement position can be stored. In the present embodiment, the image sensor 33 is inclined with respect to the imaging optical axis X, but may be shifted with respect to the imaging optical axis X.

  The communication control circuit 64 is a circuit that transmits and receives various signals and data such as a release signal, an adjustment signal, through image data, and main image data to and from the second digital camera 3 described above. A (Universal Serial Bus) standard communication circuit is used. The stereoscopic image processing circuit 65 combines the first main image data and the second main image data generated by the first digital camera 2 and the second digital camera 3 by imaging in the stereoscopic imaging mode. This is an image processing circuit that generates stereoscopic image data that can be stereoscopically viewed.

  When the first digital camera 2 and the second digital camera 3 are connected by the communication cable 4 and set to the stereoscopic imaging mode, both system controllers 41 are connected to the other party by the communication control circuit 64 and perform a negotiation operation. Establish communication status. As shown in FIG. 6, when the setting menu of the digital camera 2 is called in a state where the stereoscopic imaging mode is set, the display monitor 22 has setting items 70a to 70c related to the stereoscopic imaging mode and these setting items 70a to 70c. A cursor 71 for selecting an item to be set from 70c is displayed. The operation of the cursor 71 is performed by the cross button 23.

  The “main camera” of the setting item 70a is an item for setting which one of the first digital camera 2 and the second digital camera 3 is mainly operated to perform stereoscopic imaging. When the setting item 70a is selected, ID numbers (for example, DSC1, DSC2, etc.) of the first digital camera and the second digital camera are displayed on the display monitor 22, and can be selected with the cursor. The digital camera selected by this selection item becomes the main camera, and the digital camera not selected becomes the sub camera linked to the main camera. Further, “main camera” is displayed on the display monitor 22 of the main camera, and the identification becomes easy.

  On the display monitor 22 of the digital camera set as the main camera, the first through image data captured by its own image sensor 33 during imaging standby in the stereoscopic imaging mode and the second through image data received by the communication control circuit 64 are displayed. Through-image data is displayed at the same time. Further, in the operation for imaging, the sensor moving mechanism 44 of the sub camera can be operated by operating the cross button 23 of the main camera, and the imaging operation is also performed in the sub camera by the release signal of the main camera. become. To adjust the imaging direction of two digital cameras at different positions, first adjust coarsely on the tripod 5, and then check the deviation of both through image data on the display monitor 22 of the main camera, It is possible to finely adjust the imaging direction by driving the sensor moving mechanism 44 of the sub-camera at a position separated by the button 23. As a result, it is possible to save the trouble of going back and forth between the two cameras as in the prior art, and to easily perform stereoscopic imaging of a landscape.

  The “data recording destination” of the selection item 70b is an item for selecting which digital camera to record the stereoscopic image data generated by the stereoscopic imaging. The digital camera selected in this item receives the second main image data generated by the other party's digital camera by the communication control circuit 64, and the first image captured by its own image sensor 33 by the stereoscopic image processing circuit 65. 3D image data is created by combining with the main image data. The created stereoscopic image data is recorded in the memory card 30 of the digital camera. Since the processing capacity of the system controller 41 is deprived in the creation processing of the stereoscopic image data, it is possible to prevent the operation of the main camera from slowing down if it is set on the sub camera side.

  The “through image” of the setting item 70c is an item for selecting a display form of the first and second through image data displayed on the display monitor 22 of the main camera. For example, when “parallel display” is selected in this selection item, as shown in FIG. 7A, the display monitor 22 includes a first through image 80 of the main camera and a second through image 81 of the sub camera. Are displayed side by side at the same time. When “overlapping display” is selected, the first through image 83 and the second through image 84 are displayed so as to overlap each other as shown in FIG. Accordingly, it is possible to freely select a display method in which the user can easily confirm the shift in the imaging direction, and to make the adjustment of the imaging direction easier.

  Next, the effect of stereoscopic imaging performed using two digital cameras 2 of the present invention will be described with reference to the flowchart of FIG. As shown in FIG. 2, the first digital camera 2 and the second digital camera 3 are arranged at predetermined positions and connected by the communication cable 4, and the operation dials 18 of the respective digital cameras 2 and 3 are operated. Set to stereoscopic imaging mode. Also, the main camera, data recording destination, through image display form, etc. are set by operating the setting menu of the stereoscopic imaging mode.

  After setting the mode, the digital cameras 2 and 3 and the tripod 5 are moved to make coarse adjustments in the imaging direction while checking the display images on the finder 21 and the display monitor 22 of each digital camera. Next, the display monitor 22 of the main camera confirms the deviation of the imaging direction between the first through image and the second through image, and the cross is adjusted so that the imaging direction of the second through image is aligned with the first through image. The button 23 is operated.

  The adjustment signal output from the cross switch 50 that detects the operation of the cross button 23 is transmitted to the sub camera by the communication control circuit 64. The sensor moving mechanism 44 of the sub camera rotates the motor 54 based on the received adjustment signal, moves the four sides of the moving base 46 in the imaging optical axis X direction, tilts the imaging surface 33a of the image sensor 33, and performs imaging. The direction is fine-tuned.

  When the release button 17 of the main camera is pressed halfway after fine adjustment of the imaging direction, distance measurement and photometry are performed in the main camera. Since the operation signal of the release switch 40 when the release button 17 is pressed halfway is also transmitted to the sub camera by the communication control circuit 64, distance measurement and photometry are similarly performed in the sub camera.

  When the release button of the main camera is fully pressed, a release signal is output from the release switch 40, and the main camera and the sub camera perform an imaging operation according to the release signal. The first main image data generated by the main camera and the second main image data generated by the sub camera are input to the three-dimensional image processing circuit 65 of the digital camera set as the data recording destination, and the three-dimensional image Data is generated. This stereoscopic image data is recorded in the memory card 30 of the data recording destination digital camera.

  In the above-described embodiment, the sensor moving mechanism 44 that moves the image sensor is used to finely adjust the imaging direction of the sub camera. However, if the imaging optical system is moved together with the image sensor, fine adjustment is possible. The imaging direction of the sub camera can be moved greatly beyond the level. An embodiment in which the image sensor and the imaging optical system are moved together will be described below.

  9A and 9B are an upper cross-sectional view and a horizontal cross-sectional view of the image pickup system moving mechanism 90 in which the image sensor and the image pickup lens are moved together. In this image pickup system moving mechanism 90, a lens barrel 92 incorporating an image pickup lens 91 and an image sensor 93 are combined with two hemispherical parts 94a and 94b so that the spherical optical member 94 has an image pickup optical axis. The spherical member 94 is housed in a box-shaped frame member 95 and is rotatably supported by a plurality of rollers 96 supported in the frame member 95. Of the plurality of rollers 96, motors 97a and 97b for rotating the rollers 96a and 96b are attached to the rollers 96a and 96b.

  When the roller 96a is rotated by the rotation of the motor 97a, the spherical member 94 is rotated on the vertical plane, and the imaging direction of the imaging lens 91 and the image sensor 93 is moved in the vertical direction. When the motor 97b rotates, the spherical member 94 is rotated on the horizontal plane by the roller 96b, and the imaging direction moves in the left-right direction. By combining these movements in the vertical and horizontal imaging directions, the imaging direction can be freely changed, and not only fine adjustment but also coarse adjustment can be performed by remote operation of the main camera.

  In each of the above embodiments, the imaging direction is adjusted by confirmation on the display monitor and manual operation. However, the imaging direction may be automatically performed. For example, as shown in the block diagram of FIG. 10, an automatic adjustment circuit 100 to which the first through image data of the main camera and the second through image data of the sub camera are input is provided. The first through image data and the second through image data are subjected to image analysis, and an adjustment signal for driving the sensor moving mechanism and the imaging system moving mechanism may be calculated so that the imaging directions of the two through image data match. The accuracy of the confirmation and manual adjustment of the imaging direction deviation on the display monitor varies depending on the skill of the person to be adjusted, but if automatic adjustment is used as in this embodiment, no matter who operates it, it will have a certain accuracy. Adjustment results can be obtained.

  In the above embodiments, the first digital camera and the second digital camera are connected by a wired communication circuit, but may be connected by a wireless communication circuit. The radio may be a radio wave type communication circuit or a communication circuit using infrared rays. Although the stereoscopic imaging by the digital still camera has been described as an example, it can also be used for stereoscopic imaging by a video camera or a silver salt camera. When applied to a silver salt camera, a low-resolution imaging camera and monitor for confirming the imaging direction may be provided.

1 is an external perspective view of a digital camera embodying the present invention. It is an external appearance perspective view which shows the structure of the three-dimensional imaging system of this invention. It is a block diagram which shows the structure of a digital camera. It is an external appearance perspective view of a sensor moving mechanism. It is sectional drawing of a sensor moving mechanism. It is explanatory drawing which shows the setting screen of stereoscopic imaging mode. It is explanatory drawing which shows the display form of through image data. It is a flowchart which shows the imaging procedure of a stereo image. It is sectional drawing which shows the structure of an imaging system moving mechanism. It is a block diagram which shows the structure of the digital camera provided with the automatic adjustment circuit.

Explanation of symbols

2 First digital camera 3 Second digital camera 4 Communication cable 10, 91 Imaging lens 22 Display monitor 23 Cross button 33, 93 Image sensor 34 Image processing circuit 40 Release switch 44 Sensor moving mechanism 50 Cross switch 64 Communication control circuit 65 Stereoscopic image processing circuit 90 Imaging system moving mechanism 100 Automatic adjustment circuit

Claims (6)

An imaging optical system that forms a subject image;
An image sensor that picks up the imaged subject image and generates an imaging signal;
Image processing means for generating through image data from an imaging signal waiting for shooting, and generating main image data from the imaging signal based on a release signal by a shooting operation;
A communication means connected to the second imaging device to transmit and receive various signals and data, and to link various operations with the second imaging device;
Display means for simultaneously displaying the first through image data generated by the image processing means and the second through image data received by the communication means;
First main image data generated by the image processing means, and second main image data generated by the second imaging device in conjunction with the generation of the first main image data and received by the communication means. An imaging apparatus comprising: a stereoscopic image generation unit configured to combine and generate stereoscopic image data that can be stereoscopically viewed. An operation unit that is operated to match the imaging directions of the first through image data and the second through image data displayed on the display unit, and generates an adjustment signal according to the operation content;
2. The imaging apparatus according to claim 1, further comprising an adjustment unit that adjusts an imaging direction based on a first adjustment signal input from the operation unit or a second adjustment signal received by the communication unit.   The imaging apparatus according to claim 2, wherein the adjustment unit includes a sensor moving mechanism that moves the image sensor with respect to the imaging optical axis.   The imaging apparatus according to claim 2, wherein the adjustment unit includes an imaging system moving mechanism that moves the imaging optical system and the image sensor.   Analyzing means for analyzing the first through image data and the second through image data, and the imaging directions of the first through image data and the second through image data based on the analysis result of the analyzing means. 5. The image pickup apparatus according to claim 2, further comprising an automatic adjustment unit that generates an adjustment signal for matching.   6. A stereoscopic imaging system, wherein at least two imaging devices according to claim 1 are used and are connected by communication means to perform stereoscopic imaging.

Images