JP4590134B2 - 3D camera - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a camera for photographing a stereoscopically visible image.
[0002]
[Prior art]
Since the beginning of photographic technology development, a method of stereoscopic viewing using the parallax of an observer has been known. In this method, by observing images taken from a plurality of viewpoints with the left and right eyes, a subject image is synthesized in the head to enable three-dimensional observation. However, this method has the disadvantages that it makes observation from an unnatural angle, so that there are large individual differences in how it looks, and it is easy to learn fatigue.
The human eye does not necessarily obtain a three-dimensional effect by such parallax. Like many artists who have tried to leave a three-dimensional work on the canvas by perspective, the line perspective and the air perspective have been known for a long time. Was also effective.
[0003]
In recent years, some have been taught as a technique related to a camera (three-dimensional camera or 3D camera) for photographing a stereoscopically visible image. For example, a technique such as a hologram in which a light beam having a predetermined angle is incident on a predetermined position at a predetermined position is also known. Japanese Patent No. 3022558 displays a transparent two-dimensional image in a three-dimensional manner. A method of stereoscopic viewing that produces various effects is taught.
[0004]
[Problems to be solved by the invention]
However, it is more effective that the image displayed in a superimposed manner as proposed in the above-mentioned Japanese Patent No. 3022558 is shifted in focus position, but it is not described in the above-mentioned proposal. Further, it is more effective to increase the brightness of the image in front of the plurality of superimposed images, but no means or method for obtaining such a stereoscopic image easily and effectively has been described.
[0005]
Therefore, the present invention has been made in view of the above points, and an object of the present invention is to provide a simple three-dimensional camera as a photographing means that can easily capture and enjoy effective and fatigue-free stereoscopic images. There is to provide in configuration.
[0006]
[Means for Solving the Problems]
In order to solve the above problems and achieve the object, the present invention takes the following measures. That is, according to the first aspect, the photographing lens for photographing the subject, the light dividing means for dividing the light beam incident through the photographing lens into a plurality of optical paths, and the different light paths divided into the plurality of optical paths. A plurality of imaging means provided at the focus position; a plurality of display means for displaying a plurality of images obtained by the imaging means; and a display control means for displaying images on the plurality of display means. The display control means includes a positional deviation on the imaging surface when the plurality of imaging means image the same subject, and a display position deviation when the plurality of display means display the same image. A three-dimensional camera having storage means for storing a correction coefficient for correcting the image and reading the correction coefficient from the storage means at the time of display control to display an image in which image deviation is corrected. Propose .
[0008]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, the present invention will be described in detail with reference to a plurality of embodiments.
(First embodiment)
A first embodiment of the present invention will be described with reference to FIGS. FIG. 1A shows the configuration of the three-dimensional camera of the first embodiment, and FIG. 1B partially shows the appearance and the internal state of the three-dimensional camera.
[0009]
As shown in FIG. 1A, the three-dimensional camera includes a photographing lens 2 for photographing a subject 11, and a half mirror 2a as a light splitting means for dividing a light beam incident through the photographing lens 2 into a plurality of optical paths. In the optical system, the imaging system has a plurality of CCDs 3a and 3b as imaging means provided at different focus positions on the optical path divided into a plurality, and a plurality of images obtained by the plurality of imaging means As a display means for displaying the above images in a superimposed manner, two LCDs 6a and 6b are arranged so as to overlap each other to form a dual structure to constitute a display system.
[0010]
In addition, the display unit 6 including the LCDs 6a and 6b includes a plurality of LCD drivers 5a and 5b as display control means for displaying images, and a storage means (EEPROM 4) for storing the shift amounts of the displayed images. The LCD drivers 5a and 5b are adapted to display the image with the image shift corrected during display control (details will be described later). At this time, a backlight light source 7a for backlight illumination and a backlight driver 7 for driving the backlight 6 are disposed from behind the LCD 6b. The display can be displayed by the display switch 8b.
A distance measuring means 9 for measuring the distance L to the subject 11 by a predetermined method is provided, and the photographing lens 2 is connected to a lens driver 10 for driving the lens along the optical axis.
[0011]
Further, this three-dimensional camera having an appearance as shown in FIG. 1B and provided with one LCD 6a constituting the display unit 6 on the surface is controlled by the ASIC 1 of a one-chip microcomputer as a control means of the entire camera. The operation is started based on the target control, and photographing is started by the second release operation of the release switch 8a by the user.
[0012]
Outline the process up to the shooting operation. First, when the camera is held toward the subject 11 and the release switch 8a is operated for the first release, the subject image that has passed through the photographing lens 2 is passed through the half mirror 2a that divides the light path into two optical paths 2a of the CCDs 3a and 3b. Guided to imaging means. The focus position of the photographic lens 2 is controlled by driving the lens driver 10 based on the subject distance L, which is measured by the distance measuring means 9, but the first imaging means (CCD) 3a that transmits the half mirror is at that time. A focused image is incident, but an image out of focus is incident on the second image pickup means (CCD) 3b reflecting the half mirror, and the focused and slightly focused images are controlled by photographing control. Two images of the shifted one are taken.
[0013]
The control of each of these units is also programmed to be performed in accordance with the operation of the release switch 8a at the time of photographing by the ASIC 1 in which an image processing circuit is incorporated in a one-chip microcomputer.
The two images thus obtained are respectively displayed on the transmissive color LCDs 6a and 6b having a double structure as display means arranged as shown in FIG. 2A by operating the display switch 8b. .
[0014]
2A to 2C illustrate images displayed on the transmissive color LCDs 6a and 6b, respectively.
Of the dual-structure LCDs 6a and 6b, the image focused in front is displayed on the LCD 6a in front, and the image focused in a farther position is displayed on the LCD 6b in the back.
Such display control is performed via the LCD drivers 5a and 5b in consideration of the result of the ASIC 1 stored in the EEPROM 4. At this time, the backlight light source 7 a is controlled to be appropriately illuminated from the back side via the backlight driver 7.
[0015]
Of the two images displayed as illustrated in FIG. 2A, the front LCD 6a is focused on the portion of the subject that overlaps the face of the front hair or the tip of the nose as shown in FIG. 2B. As shown in FIG. 2C, the back LCD 6b displays not only the subject's eyes but also a focus image that focuses on the subject's ears or the hair on the back. Thereby, since the display according to the depth is displayed on the display with depth, a camera capable of displaying a three-dimensional image with a stereoscopic effect can be provided.
[0016]
In such a three-dimensional camera, as shown in FIG. 3, if the difference between the positions of the two CCDs 3a and 3b provided as the imaging means and the positions of the two transmissive color LCDs 6a and 6b is not adjusted well, a correct photographing display is performed. I can't.
Therefore, a device made in the adjustment process in the assembly process as shown in FIG. 3 will be described. FIG. 3 illustrates the positional relationship between the imaging system and display system elements in the three-dimensional camera and the adjustment thereof.
[0017]
The personal computer 20 which is one equipment in the assembly process obtains necessary information by controlling the display board 21 and the area sensor 22 and performs a predetermined calculation, and communicates with the ASIC 1 of the three-dimensional camera which is a product. Data necessary for the EEPROM 4 is stored in advance.
[0018]
Since both the image pickup means (CCD) and the LCD are composed of pixels arranged in the X and Y directions, if there is an error with respect to the rotation direction, images cannot be superimposed only with a simple data shift. Therefore, in this adjustment step, a unique correction value calculated in advance for each product is stored, so that the image can be seen in three dimensions by superimposing images.
[0019]
More specifically, the control operation of the three-dimensional camera of the first embodiment will be described with reference to the flowcharts of FIGS. 4 and 5.
FIG. 4 shows an “adjustment” procedure for each part of the three-dimensional camera, and tilt correction and shift correction of the two image sensors (CCDs 3a and 3b) of the camera are performed in the following order. .
[0020]
In step S1, the display panel 21 prepared as a master is first adjusted in the Q1 direction in order to adjust the displacement of the CCDs 3a and 3b (S1). For example, in the XY direction of the first image pickup means (CCD) 3a, The display panel 21 is aligned so that one direction of + display coincides with one direction.
Next, in step S2, the rotational direction theta ₃ of the second imaging means (CCD) 3b adjusted and fixed with adhesive or the like (S2). In steps S3 and S4, the + display of the chart is monitored by each imaging means, and the coordinates of the cross position of the vertical line and horizontal line are obtained (S3 and S4).
[0021]
Similarly, in the processing procedure of steps S5 to S7, LCD6a, try to even + displayed on 6b, these θ direction error, seeking _{Δθ 4 (S5, S6, S7} ). Then, the LCD is fixed by rotating so that the error Δθ ₄ becomes zero.
[0022]
Next, in the same manner as in steps S3 and S4, correction amounts ΔX ₁ and ΔY ₁ are obtained so that the + displays coincide in the X and Y directions (S8). If the X and Y of one display are shifted and the state when the images overlap is detected by the area sensor 22, this can be automatically performed without the operator's visual inspection.
[0023]
In step S9, correction coefficients ΔX and ΔY for correcting errors in the imaging system and display system thus obtained are calculated by a personal computer (S9), and the results are written and stored in the EEPROM 4 of the camera (S10). Through a series of these processes, the captured image can be correctly displayed in three dimensions. Then return.
[0024]
Further, the flowchart of FIG. 5 shows the operation at the time of photographing display of the three-dimensional camera adjusted as described above.
In step S11, it is determined whether or not the user has selected whether the mode is the shooting mode or the display mode with the display switch 8b (S11). At the time of shooting, the LCD display and the backlight are turned off (S12). When the release switch 8a is turned on (S13), ranging, focusing and photographing are performed after step S14 (S14 to S16). In step S17, the image data corrected by the correction data ΔX and ΔY input in the EEPROM 4 is stored in the memory (S17). Then return.
[0025]
If the display mode is selected in step S11, LCD display is performed from step S21 (S21), and it is determined whether the user has operated a lighting switch (not shown) (S22), and the determination result The illumination is controlled for a predetermined time (S23), and then the process returns to step S11.
[0026]
As described above, according to the first embodiment, it is possible to provide a camera capable of photographing and displaying a stereoscopic image. Since the amount of shift when images are displayed in an overlapping manner is automatically corrected, for example, portraits, etc., appear as if the main subject is projected forward, creating a three-dimensional screen, and even with a simple camera configuration, a beautiful and natural three-dimensional image Can be obtained.
[0027]
(Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS.
FIG. 6A shows the configuration of the three-dimensional camera of the second embodiment.
This three-dimensional camera has a photographing lens 2 and one image sensor 3 for photographing a subject (main subject 11a, background 11b), and strobe means (light emitting body 14, light emission) for mainly irradiating the main subject 11a. 14a), and is configured and controlled to change the focal point by driving the lens with the lens driver 10 based on a command from the ASIC 1 as changing means for changing the focus position of the photographing lens 2. Then, a plurality of display means (LCDs 6a and 6b) are provided which can superimpose and display a plurality of images photographed under the strobe light irradiation by the strobe means while changing the focus position to a plurality of positions. Yes.
[0028]
That is, the feature of the second embodiment is not to obtain two images at a time as in the first embodiment described above, but to shoot two images in two steps, but the imaging that is configured Since there is only one element 3, it is not necessary to perform tilt correction or deviation correction of the two elements as in the first embodiment.
[0029]
However, there is a restriction that the subject needs to be stationary. Therefore, in this second embodiment, in order to avoid the influence of the movement of the subject as much as possible, the strobe light is emitted from the light emitter 14a in response to a command from the light emitting unit 14, and photographing is performed instantaneously.
In addition, the depth of the subject is taken into consideration by using the “multi-AF” technique, thereby enabling more effective stereoscopic photography (details will be described later).
[0030]
As shown in the drawing, the configuration of the three-dimensional camera of the second embodiment is the same as that of the first embodiment in that the ASIC 1 is mainly configured, and the switches, two LCDs, and their LCD drivers are also the same. . As for the displacement when the LCDs are superimposed, the amount of displacement is stored in the EEPROM 4 in the same manner as in the first embodiment, and at the time of display, the corrected amount is displayed to enable natural and beautiful stereoscopic image display. However, the distance measuring means has a pair of sensor arrays 9a and 9b, and further includes an A / D conversion means 9c.
[0031]
The ASIC 1 controls the light emission of the strobe and performs focus control of the photographing lens 2 and the image sensor 3 by the lens driver 10 as appropriate. The focus positions are two lenses 12a and 12b, the light receiving elements of the sensor arrays 9a and 9b, and It is programmed to perform position control based on the output of the distance measuring means comprising the A / D conversion means 9c and the like.
[0032]
The distance measuring means uses the image signal to measure the distance between the main subject 11a and the background 11b. For example, the image of the person (11a) is displayed on the sensor array 9a on the optical axis of the lens 12a. In addition, when the image is formed, the light having the parallax B and passing through the lens 12b on the sensor array 9b side forms an image at a position on the sensor array whose optical axis position is shifted by the relative position difference X.
The relative positional difference X is related to the subject distance L ₁ by the “principle of distance measurement”, and the relational expression X = B · f / L is established. However, B in this expression represents the distance between the principal points (base line length) of both lenses 12a and 12b, and f represents the focal length.
[0033]
Further, when an image signal at a position X away from the lens optical axis position on the sensor array is used, a subject distance at an angle of Y = arctanX / f is also obtained. Accordingly, as shown in FIG. 6B, distances L _1, L _{2 and} L ₃ corresponding to a plurality of points in the screen are obtained, and the distance (L ₂ or L ₃ ) to the background 11b can also be obtained. It has become.
[0034]
If such “multi-AF (multi-point distance measurement)” technology is used, the focus position of the two shootings is optimized, and either the main subject 11a or the other subject 11b is displayed on either LCD. It is possible to obtain a more effective image by devising the control.
That is, the three-dimensional camera executes the “photographing” sequence according to the control procedure shown in the flowchart of FIG.
[0035]
In step S31, photometry is performed to determine camera exposure (S31). For example, the ASIC 1 determines using the output of the distance measuring means. In the brightness determination at that time (S32), if the shooting scene is bright, the process proceeds to step S41, and if dark, the process branches to step S33. This judgment process takes into account the problem that even if the exposure time is short even if the flash light is not illuminated, the correct exposure can be obtained, while the flash light does not reach long distances even in the dark scene. It is.
That is, bright scene, first focusing on the distance _{L 1} of the center of the person obtained by the distance measurement (main subject body) (S41, S42), performs shooting (S43).
[0036]
Next, shooting is performed with infinite focus on the landscape (background) or the like (S44), and the shooting sequence ends. At the time of this photographing, the display is performed by focusing on a person on the front LCD 6a and displaying an image focused on the landscape on the back LCD 6b. As a result, the user can feel a three-dimensional effect from a screen in which a person is displayed in front and a background is displayed behind.
[0037]
On the other hand, if the scene is bright, (see FIG. 6 (b)) by the distance measuring three points in the screen in step S33, it obtains the distance _{L 1, L} 2, _{L 3} of each point (S33). Accordingly, the ASIC 1 selects two focus positions in step S34 as to which distance is to be focused (S34). Since the points P _{1 and} P ₂ are the focus positions determined here, in each of the steps S35 and S36, the flash emission photographing is performed with the respective focus positions being successively focused (S35 and S36). Then, a series of shooting sequences is completed.
[0038]
In FIGS. 8A and 8B, control rules in the three-dimensional camera are shown in two tables. According to the list of FIG. 8A, the subject distance (L) and the display means (LCDs 6a and 6b) at the time of focusing are set. That is, with respect to the distance L _2, L ₃ major central object distance L ₁ of the peripheral object obtained when the subject distance to the main subject and L _1, determines whether distant or close, as a result Accordingly, the conditions for determining the points P ₁ and P ₂ as the multipoints to be focused twice are determined.
Focus position _{P 1} is a short distance from the focus position _{P 2,} and displays the results in front of LCD6a, shooting result of the focus position _{P 2} is displayed in the rear back of LCD6b.
[0039]
The idea of this table is a result that the distance L _{2 and} L ₃ of the surrounding subject is farther than L ₁ in that the short distance that the strobe light can reach is prioritized over the long distance that the strobe light is difficult to reach. When appears, focus shooting is performed only at close range.
[0040]
Since the main object exists at a distance L ₁ as a reference, performs always taken to adjust the focus in any case. When one of L ₂ or L ₃ is equal to L _1, there is a focus can cover a distance of L _1, performs photographing by L ₁ Pinto, retake towards unequal. Also all substantially if the same distance, and focusing taken L _1, performs to retake focusing it from a distance close to the predetermined amount [Delta] L.
[0041]
Similarly, in the table of FIG. 8B, rules for shooting and display control when branching to the step S41 side in the flowchart of FIG. 7 (when bright) are determined. It is set like this list. That is, as a result of photometry at the distances L _1, L _{2 and} L _{3 to} the three points, particularly in the case of shooting in bright conditions, the LCD drivers 5a and 5b of the display control means similarly controlled under the conditions based on this table Control content. Also, LCD driver 5a is a display control so that the reference distance _{L 1} of LCD6a, LCD driver 5b is adapted to the display drive so that the LCD6b infinite.
[0042]
As described above, according to the second embodiment, since only one imaging element (CCD) can be used as a component, it is not necessary to perform element inclination correction or deviation correction as in the case of a plurality of elements. Cost reduction including adjustment man-hours can be achieved.
In addition, since high-speed shooting is possible with the flash emission exposure, the movement of the subject during the second shooting can be minimized.
Furthermore, since the distance information (L ₂ , L ₃ ) of subjects other than the main subject is considered, natural and effective stereoscopic image reproduction can be performed.
[0043]
(Modification)
The first and second embodiments described above can be variously modified without departing from the scope of the present invention.
[0044]
As mentioned above, although demonstrated based on embodiment, the following invention is included in this specification.
(1) a photographic lens for photographing the subject;
A half mirror that divides a light beam incident through the photographing lens into a plurality of optical paths;
Two CCDs provided at different focus positions on the optical path separated into two;
Two LCDs for displaying a plurality of images obtained by the two CCDs,
An LCD driver for displaying images on the two LCDs;
A three-dimensional camera can be provided.
[0045]
(2) a photographing system that divides light that has passed through the photographing lens into two optical paths by the half mirror, and changes the focus position to obtain two images;
A display system that superimposes and outputs the two images obtained by the imaging system;
The display system is characterized in that the first image related to the main subject is transparently displayed and output with a predetermined deviation superimposed on the display of the second image related to the background (1). Can provide a camera.
[0046]
(3) The image shift correction amount when displaying the images in a superimposed manner is calculated in advance for each product in the assembly process of the camera, and the value is stored in the built-in EEPROM.
The camera according to (1), wherein the LCD driver refers to the EEPROM that stores the shift amounts of the plurality of images, and performs control so that the shift of the images is corrected and displayed during display control. Can be provided.
[0047]
【The invention's effect】
As described above, according to the present invention, it is possible to provide a stereoscopic camera as a three-dimensional camera that can easily enjoy a stereoscopic portrait and the like with a low price and a simple configuration.
[Brief description of the drawings]
FIGS. 1A and 1B show a three-dimensional camera according to a first embodiment of the present invention,
(A) is a block diagram showing the configuration of this three-dimensional camera,
(B) is a perspective view partially showing the appearance and the inside of the three-dimensional camera.
2 (a) to 2 (c) show a transmissive color LCD of a three-dimensional camera,
(A) is a perspective view showing the double structure of this color LCD,
(B), (c) is explanatory drawing which illustrates the image each displayed on these LCD.
3 is an explanatory diagram showing the positional relationship between the imaging system and display system elements and the adjustment process in the assembly process of the three-dimensional camera of FIG. 1;
FIG. 4 is a flowchart showing a procedure for adjusting each part of the three-dimensional camera.
FIG. 5 is a flowchart showing an imaging display procedure of the three-dimensional camera after adjustment.
FIGS. 6A and 6B show a three-dimensional camera according to a second embodiment of the present invention.
(A) is a block diagram showing the configuration of this three-dimensional camera,
(B) is explanatory drawing which shows the screen in the multipoint ranging of this three-dimensional camera.
FIG. 7 is a flowchart showing a photographing sequence of the three-dimensional camera.
FIGS. 8A and 8B show the rules for controlling the three-dimensional camera, and FIG. 8A is a table showing three object distances and display means for focusing;
(B) is a table | surface which shows the rule of imaging | photography and display control in the case of being bright.
[Explanation of symbols]
1 ASIC (microprocessor),
2 ... photographic lens,
2a: Half mirror (light splitting means)
3 ... Image sensor,
3a: CCD (first imaging means transmitting through a half mirror),
3b CCD (second imaging means for half mirror reflection),
4 ... EEPROM (storage means),
5a, 5b ... LCD driver (display control means),
6 ... display part (liquid crystal screen),
6a, 6b ... LCD (display means),
7 ... Backlight driver,
7a: Light source for backlight,
8a ... Release switch,
8b ... switch for display,
9: Ranging means,
9a, 9b ... sensor array (light receiving element),
9c ... A / D conversion means,
10: Lens driver (LD: change means),
11a ... main subject, 11b ... background,
12a, 12b ... lenses (ranging lenses),
14: Strobe light emitter (strobe means),
14a ... light emitting part,
20 ... PC (for adjustment calculation),
21 ... Display board (for assembly process),
22 Area sensor (for assembly process).
S1-S10 ... adjustment processing steps,
S11 to S23 ... Shooting display processing steps;
S31 to S44: Shooting processing steps.

Claims (1)

A photographic lens to shoot the subject,
A light splitting means for splitting a light beam incident through the photographing lens into a plurality of optical paths;
A plurality of imaging means provided at different focus positions on the optical path divided into a plurality of;
A plurality of display means for displaying a plurality of images obtained by the plurality of imaging means,
Display control means for displaying an image on the plurality of display means;
Comprising
The display control means includes a positional shift on the imaging surface when the plurality of imaging means capture the same subject and a display position shift when the plurality of display means display the same image. A three-dimensional camera comprising storage means for storing a correction coefficient for correction, and displaying an image in which the correction coefficient is read by reading the correction coefficient from the storage means during display control .

Images