JP2001281754A - Camera, picture converting device, picture converting display device, stereoscopic picture display system and readable recording medium with picture conversion program recorded thereon - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a subject as a stereoscopic picture viewed from plural angles and to effectively suppress cost rising. SOLUTION: In this camera with which stereoscopic photographing that the same subject is photographed from different viewing points in a state where the lines of sight are parallel with each other, is realized, and the picture of the subject stereoscopically photographed is displayed as the stereoscopic picture on the display surface 621 of a display device 62 in the picture converting display device 60; photographing information such as the focal distance of a lens, a distance between the viewing points, photographing magnification, the FNo. of the lens and frame numbers becoming a pair in stereoscopic photographing is recorded at least at the time of photographing the subject.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera, an image conversion device, an image conversion display device, a three-dimensional image display system, and an image conversion program that enable a stereoscopic image of a subject to be displayed on a display surface of a monitor as a three-dimensional image. Readable recording medium.

[0002]

2. Description of the Related Art A camera capable of stereo photographing including two photographing optical systems for photographing the same subject at different positions in the left-right direction has been well known. A set of subject images photographed by such a camera can be observed as a stereoscopic image with a depth by using a viewer after printing on a photographic paper. That is, this viewer is composed of a photographic paper mounting portion for mounting a pair of photographic papers side by side, and a pair of left and right transparent lenses installed toward the center of each photographic paper. The left and right images are combined by directing both eyes to the lens and observing the corresponding photographic paper images, so that a stereoscopic image with depth can be observed.

[0003] A set of subject images as described above is
It has also been studied to convert the data into digital data by reading it with a scanner or the like, and to use the digital data to display a stereoscopic image on a display surface of a monitor of a personal computer or the like. When a subject is photographed by a digital camera, image data obtained by photographing can be directly displayed on a display surface of a monitor such as a personal computer as a stereoscopic image.

[0004]

However, in the case of using a viewer, although the subject image can be observed as a stereoscopic image having a depth, only one stereoscopic image can be observed. When a stereoscopic image viewed from an angle (viewing direction) is required, the demand cannot be satisfied, and there is a problem that convenience is lacking. Further, when a stereoscopic image is displayed on a display surface of a monitor of a personal computer or the like, it is possible to display a stereoscopic image viewed from a plurality of angles, but the computational processing becomes complicated and the C
There is a problem that a high burden is imposed on a PU (Central Processing Unit), so that an increase in price is inevitable.

The present invention has been made in view of such circumstances, and a camera capable of displaying a subject as a stereoscopic image viewed from a plurality of angles and effectively suppressing an increase in cost. It is an object of the present invention to provide a readable recording medium in which an image conversion device, an image conversion display device, a stereoscopic image display system, and an image conversion program are recorded.

[0006]

In order to achieve the above object, according to the first aspect of the present invention, it is possible to perform stereo photography in which the same subject is photographed from different viewpoints whose eyes are parallel to each other. A camera capable of displaying a subject image as a stereoscopic image on a display surface of a monitor in an image conversion display device, wherein at least at the time of shooting the subject, the focal length of the lens, the distance between viewpoints, the shooting magnification, and the FNo. Is recorded.

According to this configuration, the image conversion / display apparatus determines whether or not the subject exists within the depth of field of the camera using predetermined photographing information, and determines whether the subject exists within the depth of field. Only in such a case, it is possible to calculate the position of the subject in the three-dimensional coordinates. For this reason, it is possible to effectively suppress an increase in price despite the fact that the subject can be displayed as a stereoscopic image viewed from a plurality of angles.

[0008] According to a second aspect of the present invention, in accordance with the first aspect, at least two of the first and second antennas are spaced apart from each other.
A pair of photographing optical systems are provided, and the distance between the optical axes of the lenses in the two sets of photographing optical systems is defined as the distance between the viewpoints.

According to this configuration, two frames of subject images having parallax can be easily obtained by the two sets of photographing optical systems.
For this reason, a stereoscopic image can be easily obtained using the image conversion display device.

[0010] The invention of claim 3 is based on claim 1 or 2.
Wherein a silver halide film having an information recording section in which photographing information is recorded is used, and writing means for writing the photographing information in the information recording section of the silver halide film is provided.

According to this configuration, the necessary photographing information is written into the information recording section of the silver halide film by the writing means. For this reason, a stereoscopic image can be easily obtained using the image conversion display device.

Further, the invention of claim 4 is the invention of claim 1 or 2
Wherein a recording medium in which image information and photographing information are recorded as digital data is used,
A writing unit for writing the image information and the photographing information on the recording medium is provided.

According to this configuration, the writing unit writes the image information and the photographing information into the predetermined storage area of the recording medium. For this reason, a stereoscopic image can be easily obtained using the image conversion display device.

According to a fifth aspect of the present invention, it is possible to perform stereo photography in which the same subject is photographed from different viewpoints whose sight lines are parallel to each other, and the focal length of the lens, the distance between the viewpoints, the photographing magnification, and the lens. FNo. An image conversion display device that displays a subject image stereo-photographed by a camera capable of recording each photographing information as a stereoscopic image on a display surface of a monitor, wherein the stereo-photographed subject image is displayed on a plane coordinate. Using the image position deriving means for deriving a position, and each image position derived by the image position deriving means and predetermined photographing information among the photographing information, a position in the depth direction of the subject in stereoscopic coordinates is derived. First subject position deriving means, depth of field deriving means for deriving a depth of field of the camera using predetermined photographing information of the photographing information, and a depth of field deriving means derived by the depth of field deriving means. Position determining means for determining whether or not the subject exists within the depth of field; and, when the subject exists within the depth of field, the image position and the shooting information. It is characterized in that a second subject position deriving means for deriving the position of the horizontal and vertical direction in the three-dimensional coordinates of the object using the predetermined photographing information in the.

According to this configuration, the position of each frame photographed in stereo on the subject image on the plane coordinates is derived, and the depth of the subject in the three-dimensional coordinates is obtained using the derived image positions and predetermined photographing information. The position of the direction is derived. Further, while the depth of field of the camera is derived using the predetermined shooting information, it is determined whether or not the subject exists within the depth of field, and when the subject exists within the depth of field. The horizontal and vertical positions in the three-dimensional coordinates of the subject are derived using the image position of the subject image and predetermined photographing information only. For this reason, it is possible to effectively suppress an increase in price despite the fact that the subject can be displayed as a stereoscopic image viewed from a plurality of angles.

According to a sixth aspect of the present invention, there is provided the camera according to the fifth aspect, wherein the camera uses a silver halide film having an information recording section for recording the photographing information corresponding to each frame. A film image reading device having image reading means for converting a subject image of each frame shot on the silver halide film into image data, and information reading means for reading shooting information recorded in the information recording section; An image conversion device for obtaining a three-dimensional image by using image information and photographing information obtained by the image reading device.

According to this structure, the subject image of each frame photographed on the silver halide film is converted into image data by the image reading means, while the photographing information recorded in the information recording section of the silver halide film is the information. Read by the reading means,
A stereoscopic image is displayed using the image information and the photographing information.

According to a seventh aspect of the present invention, in the fifth aspect, a recording medium on which image information and photographing information are recorded as digital data is used, and the image information recorded on the recording medium is used. And a data reading means for reading the shooting information, and an image conversion device for obtaining a three-dimensional image using the image information and the shooting information read by the data reading means.

According to this configuration, the image information and the photographic information recorded on the recording medium are read by the data reading means, and a three-dimensional image is displayed by the image conversion device using the read image information and the photographic information. You.

According to another aspect of the present invention, there is provided a camera capable of taking a stereo image of the same subject from different viewpoints, and an image displaying a subject image stereo-photographed by the camera as a stereoscopic image on a display surface of a monitor. In the stereoscopic image display system provided with the conversion display device, at least at the time of photographing the subject, the camera has a focal length of a lens, a distance between viewpoints, a photographing magnification, and an FNo. The image conversion and display device is configured to be able to record the respective shooting information, and the image conversion display device derives the position of each of the stereo-photographed frames on the plane coordinates of the subject image and the image position deriving unit. First subject position deriving means for deriving a position in the depth direction in the three-dimensional coordinates of the subject using each of the obtained image positions and predetermined shooting information of the shooting information; A subject depth deriving unit that derives a subject depth of the camera using photographing information; a position determining unit that determines whether the subject exists within the subject depth derived by the subject depth deriving unit; Is present within the depth of the subject, using the image position and predetermined shooting information of the shooting information in the horizontal direction in the three-dimensional coordinates of the subject and It is characterized in that a second subject position deriving means for deriving the position of the direction.

According to this configuration, the camera performs stereo shooting of the subject and records predetermined shooting information. The image conversion display device derives the position of each frame photographed in stereo on the plane coordinates of the subject image, and uses the derived image positions and predetermined photographing information to set the position of the subject in the depth direction in the three-dimensional coordinates. Is derived. Further, while the depth of field of the camera is derived using the predetermined shooting information, it is determined whether or not the subject exists within the depth of field, and when the subject exists within the depth of field. The horizontal and vertical positions in the three-dimensional coordinates of the subject are derived using the image position of the subject image and predetermined photographing information only. For this reason, it is possible to effectively suppress an increase in price despite the fact that the subject can be displayed as a stereoscopic image viewed from a plurality of angles.

According to a ninth aspect of the present invention, it is possible to perform stereo photography in which the same subject is photographed from different viewpoints whose sight lines are parallel to each other, and the focal length of the lens, the distance between the viewpoints, the photographing magnification, and the lens. FNo. An image conversion apparatus for displaying a subject image stereo-photographed by a camera capable of recording each photographing information as a stereoscopic image on a display surface of a monitor, wherein the stereoscopic photographed subject image is displayed on a plane coordinate of the subject image. Using the image position deriving means for deriving the position in the image position and each image position derived by the image position deriving means and predetermined photographing information of the photographing information, the position in the depth direction of the subject in the three-dimensional coordinates is derived. A first subject position deriving unit for performing the operation, a depth of field deriving unit that derives a depth of field of the camera using predetermined photographing information of the photographing information, and a deriving unit that derives the depth of field. Position determining means for determining whether or not the subject exists within the determined depth of field; and, when the subject exists within the depth of field, the image position and the photographing position. It is characterized in that a second subject position deriving means for deriving the position of the horizontal and vertical direction in the three-dimensional coordinates of the object using the predetermined photographing information out of the information.

According to this configuration, the position of each frame photographed in stereo on the plane coordinates of the subject image is derived, and the depth of the subject in three-dimensional coordinates is calculated using the derived image positions and predetermined photographing information. The position of the direction is derived. Further, while the depth of field of the camera is derived using the predetermined shooting information, it is determined whether or not the subject exists within the depth of field, and when the subject exists within the depth of field. The horizontal and vertical positions in the three-dimensional coordinates of the subject are derived using the image position of the subject image and predetermined photographing information only. For this reason, it is possible to effectively suppress an increase in price despite the fact that the subject can be displayed as a stereoscopic image viewed from a plurality of angles.

According to the tenth aspect of the present invention, it is possible to perform stereo photography in which the same subject is photographed from different viewpoints whose sight lines are parallel to each other, and the focal length of the lens, the distance between the viewpoints, and the photographing magnification. And the FNo. Of the lens. A readable recording medium on which an image conversion program for displaying a subject image stereo-photographed by a camera capable of recording each photographing information as a stereoscopic image on a display surface of a monitor is recorded. An image position deriving step of deriving a position of the subject image on planar coordinates, and three-dimensional coordinates of the subject using each image position derived in the image position deriving step and predetermined photographing information of the photographing information. A first subject position deriving step of deriving a position in a depth direction of the camera; a depth of field deriving step of deriving a depth of field of the camera using predetermined photographing information of the photographing information; A position determining step of determining whether or not the subject exists within the depth of field derived in the depth of field deriving step; A second subject position deriving step of deriving a horizontal position and a vertical position in the three-dimensional coordinates of the subject using the image position and predetermined photographing information of the photographing information when the subject is present within the depth of field It is characterized by having.

According to this structure, the position of each frame photographed in stereo on the subject coordinate on the plane coordinates is derived in the image position deriving step, and the subject is obtained by using the derived image positions and predetermined photographing information. Is derived in the first subject position deriving step in the depth direction in the three-dimensional coordinates. Also, while the depth of field of the camera is derived in the depth of field derivation step using predetermined shooting information, whether or not a subject exists within the depth of field is determined in the position determination step, Only when the subject is within the depth of field, the horizontal and vertical positions in the three-dimensional coordinates of the subject are derived in the second subject position deriving step using the image position of the subject image and predetermined shooting information. Is done. For this reason, it is possible to effectively suppress an increase in price despite the fact that the subject can be displayed as a stereoscopic image viewed from a plurality of angles.

[0026]

FIG. 1 is a schematic configuration diagram of a stereoscopic image display system according to an embodiment of the present invention. In FIG. 1, the stereoscopic image display system 10 includes a stereo camera 20, a film image reading device 40, and an image conversion display device 60. FIG. 2 is a block diagram showing a schematic configuration of the stereo camera 20, and FIG. 3 is a block diagram showing a schematic configuration of the film image reading device 40 and the image conversion display device 60. In addition, the film image reading device 40 and the image conversion display device 60 are connected to the communication cable C
The three-dimensional image conversion device 80 is configured by being connected by A.

Here, prior to describing each component of the stereoscopic image display system 10, a subject for displaying a subject as a stereoscopic image on a display surface of a monitor from two frames of subject images stereo-photographed by the stereo camera 20. The basic principle will be schematically described. That is, as shown in FIG.
Observing the same subject (object) from two different viewpoints whose eyes are parallel to each other to obtain a stereoscopic image, and trying to obtain three-dimensional position information of the target subject from the difference in the projection position of each subject image It is.

In FIG. 4, a point P indicates a point of a subject (object) existing in a three-dimensional space.
It is represented by the coordinate value of P (X, Y, Z) in XYZ solid coordinates. When a subject is photographed by the stereo camera 20, the stereo camera 20 has two photographing optical systems on the left and right as described later. Is projected at the position of the point Pl, and the right frame (the frame of the light camera when photographing is performed by the two left and right cameras) is projected at the position of the point Pr. These points P
When the XY plane coordinates are set to include two coma planes, Pl (Xl, Yl) and Pr (Xr,
Yr).

In the figure, f is the focal length of the left and right lenses, and bh is the distance between the optical axes of the left and right lenses (ie, between the viewpoints).
Assuming that dh = X1−Xr (that is, parallax), the coordinate value of a point P of the subject can be obtained by the equation shown in Equation 1 based on the principle of triangulation.

[0030]

(Equation 1)

In order to obtain the coordinate values of the points Pl and Pr, since the Y coordinates of the left and right projected points are always equal, when the left frame is used as the reference image, the coordinate values of the point Pl are scanned from the reference position. On the other hand, by extracting features of the point Pl, a corresponding point on the same scan line is searched for the point Pr of the right frame serving as a reference image, and its coordinate value may be obtained.

Therefore, the coordinate value of each point of the subject in the XYZ three-dimensional coordinates is obtained by the arithmetic processing according to the above equation (1).
Based on each of the obtained coordinate values, a three-dimensional image can be displayed on three-dimensional coordinates on the display surface of the monitor.
In this case, the position of the subject in the depth direction (that is, the Z coordinate value) is determined by the depth of field (object depth) of the stereo camera 20.
If the Z coordinate value deviates from the depth of field, it is impossible to obtain an accurate three-dimensional image even if the XY coordinate values of the subject are calculated. The value is not calculated, so that no extra burden is placed on the CPU (Central Processing Unit).

The depth of field can be obtained as follows. That is, as shown in FIG.
Is defined as O (an image of an object point on O is clearly generated on O ′). Assuming that planes at distances of Δ1 and Δ2 from O are O1 and O2, respectively, the object point P on O1 and O2 is
The light beams that have passed through the optical system from P1, P2 are P1 ', P
It converges to 2 'and becomes a circle of a predetermined size on the image plane O'. If the diameter of this circle is less than ε (permissible circle of confusion), P
L and P2 can be regarded as having produced a clear image on O '. O1, O when the diameter of this blur circle is equal to ε
When the distances Δ1 and Δ2 of O.2 from O are obtained, and Δ = Δ2−Δ1, this Δ becomes the depth of field. Δ1 and Δ2 are
It can be obtained by the equation shown in Equation 2.

[0034]

(Equation 2)

In the equation (2), ε is the permissible circle of confusion, and the permissible circle of confusion ε is about 1/30 mm when the film FM is 35 mm. Β is a photographing magnification, and D is an entrance pupil diameter. The entrance pupil diameter D is obtained by setting the focal length f of the lens to the FNo. Of the lens. (D = f / FNo.).

Returning to FIGS. 1 to 3, the stereo camera 20
Performs stereo photography, and is disposed on the left side of the first photography optical system 21 at a predetermined distance from the first photography optical system 21 disposed on the right side toward the subject. A second photographing optical system 22, a zoom / shutter driving unit 23, a film mounting unit 24, a feeding control unit 25,
A magnetic writing unit 26, a display unit 27, an operation unit 28, a flash control unit 29, and a camera control unit 30 that controls the entire operation are provided.

The first photographing optical system 21 and the second photographing optical system 22 are disposed on the front surface of a housing 31 constituting a camera, and include a zoom / shutter driving unit 23, a film mounting unit 24, and a feeding unit. The control unit 25, the magnetic writing unit 26, the flash control unit 29, and the camera control unit 30 are arranged inside the housing 31 by being incorporated in a predetermined circuit board or the like. The display unit 27 is provided on the back side of the housing 31, and the operation unit 28 is provided at an appropriate position on the outer surface of the housing 31.

A first flash valve section 32 is provided on the front surface of the housing 31 and above the first photographing optical system 21, and a second flash valve section 32 is provided above the second photographing optical system 22. A flash valve section 33 is provided. A finder window 34 is provided between the first and second flash valve sections 32 and 33, and a release button 35 which constitutes a part of the operation section 28 is provided on the upper right side of the housing 31 toward the subject. Are arranged.

The first photographing optical system 21 includes a photographing lens 21a having a construction of a zoom lens, and has a built-in diaphragm / shutter.
Further, the second photographing optical system 22 includes a photographing lens 22a configured as a zoom lens, and also has a built-in diaphragm / shutter. The zoom / shutter driving unit 23 controls the driving of the zoom and the driving of the shutter.

The film loading section 24 has a cartridge placement section 241 located on the left side and a reel 24 located on the right side.
And 2. A film cartridge CT containing a long silver halide film FM (hereinafter, referred to as a film FM) as a recording medium is disposed in the cartridge placement section 241.
The film FM pulled out from the film cartridge CT can be sequentially wound by locking the leading end of the film FM pulled out from the reel 242.

As shown in FIG. 6, this film FM
A large number of perforations (detection holes) PF that define a frame (an imaging region surrounded by a rectangular frame line) CM are formed along the longitudinal direction at one end side in the longitudinal direction.
That is, each frame CM is defined by a pair of adjacent perforations PF1 and PF2 formed at a predetermined interval. Also, on the other end side in the longitudinal direction,
A band-shaped magnetic recording portion MR is formed corresponding to each frame CM, and various kinds of photographing information can be recorded.

The first and second photographing optical systems 21 and 22
Are projected on every other frame of the film FM in the following manner, for example. That is, at the time of the first shooting, the subject image projected via the first shooting optical system 21 is the frame A
The subject image exposed to 1 and projected via the second photographing optical system 22 is exposed to a frame B1 that has jumped one frame to the left. At the time of the next photographing, the subject image projected through the first photographing optical system 21 is exposed to a frame A2 between the frame A1 and the frame B1, and projected through the second photographing optical system 22. The subject image thus exposed is exposed on a frame B2 adjacent to the left of the frame B1.

The feed control unit 25 controls the winding of the film FM by rotating a reel 242 a predetermined number of times by driving a drive motor (not shown). The magnetic writing unit 26 includes a recording unit such as a magnetic write head, and records predetermined photographing information in the magnetic recording unit MR of each frame of the film FM when photographing a subject image. The photographing information includes, for example, a photographing date, a frame to be paired with stereoscopic photographing, and the left and right photographing optical systems 21 and
Frame number, lens focal length, camera type, shooting magnification, lens FN
o. Etc. are recorded.

The shooting date may be obtained by providing a date information generation unit having a timer or the like inside the camera and reading the date from the date information generation unit. The frame number of the film FM can be obtained from a count value of the counter provided inside a camera, which has a counter for counting the number of perforations PF formed on the film FM. In the case of a zoom lens as in the present embodiment, for example, the focal length of the lens is stored in advance in the ROM or the like of the camera control unit 30 in association with the amount of lens movement, and the amount of lens movement is detected by a sensor or the like. And reading out the corresponding value.

The type of the camera is also stored in advance in the ROM or the like of the camera control unit 30 and can be obtained by reading this. The photographing magnification is calculated by the camera control unit 30 at the time of photographing based on a well-known formula from the focal length of the lens and the photographing distance, and is stored in a RAM or the like, for example. It can be obtained by reading. FNo. Of lens
Is stored in a RAM or the like of the camera control unit 30 at the time of photographing, and can be obtained by reading this value.

Note that the type of camera is two lenses 21
a, distance between optical axes of 22a (that is, distance between viewpoints)
Therefore, the distance between the optical axes of the two lenses 21a and 22a (that is, the distance between the viewpoints) may be recorded instead of the type of camera. Therefore, in the present invention, recording the type of the camera,
Lenses 21a, 2 in second photographing optical systems 21, 22
This is synonymous with recording the distance between the optical axes 2a (that is, the distance between the viewpoints). Further, instead of the photographing magnification, the photographing distance may be recorded. That is, as described above, since the photographing magnification can be calculated from the focal length of the lens and the photographing distance, as described later, when calculating the effective depth range of the object scene, the image conversion of the image converting device 60 is performed. The calculation may be performed by the control unit 63 or the like. Therefore, in the present invention, recording the photographing magnification and recording the photographing distance are synonymous.

The display section 27 is composed of a liquid crystal display (not shown) disposed on the rear side of the housing 31 and the state of the camera at the time of shooting (for example, the focal length of a lens, a stereo shooting mode, Mode, flash emission, in-focus or out-of-focus, etc.). The operation unit 28 includes the above-described release button 35, a switch (not shown) for switching between a stereo shooting mode and a general shooting mode, and the like.

The flash control section 29 controls light emission of the first and second flash valve sections 32 and 33 in response to the release button 35 being turned on. The camera control unit 30 controls the overall operation of the stereo camera 20, and executes a CPU (Central
A processing unit), a ROM (Read-Only Memory) in which predetermined programs and data are recorded, and a RAM (Random Access Memory) in which data is temporarily recorded.

The film image reading device 40 is for converting a film image into digital data.
The front panel 42 has a mounting opening 43 for the film cartridge CT, and an operation section 44 is provided below the front panel 42 so as to protrude therefrom. The operation unit 44 includes a plurality of instruction keys for performing a predetermined instruction to the apparatus main body,
An operation key 45 including a confirmation key or the like for confirming the input instruction is provided.

Further, inside the housing 41, the mounting portion 46 of the film cartridge CT and the developed film FM stored in the film cartridge CT mounted on the mounting portion 46 are placed at a predetermined pitch from the film cartridge CT. The feed control unit 4 that pulls out and winds up on the reel 461
7, a CCD for sequentially reading a set of film images of the film FM taken out from the film cartridge CT in a stereo unit, and an A / D converter for converting analog data read by the CCD into digital data. An image reading unit 48 having a magnetic read head for reading photographic information recorded on a magnetic recording unit MR formed at a longitudinal edge of the film FM; Image / photographing information storage unit 5 for storing image information (image data) read by unit 48 and photographing information (photographing data) read by information reading unit 49
0 and an image reading control unit 51 for controlling the entire operation.

The image reading section 48 has a light source 481 for illuminating the film surface. On the rear side of the housing 41, a connection portion 51 having a connector or the like for connecting the communication cable CA is provided. In addition, image /
The photographing information storage unit 50 includes an electrically rewritable EEP
It is composed of a ROM (Electrically Erasable Programmable) and the like. Further, the image reading control unit 51 includes a CPU (Central Processing Unit) for executing arithmetic processing, a ROM (Read-Only Memory) in which predetermined programs and data are recorded.
ry) and RAM (Random A) for temporarily recording data
ccess Memory).

The image conversion display device 60 is a device for converting a subject image into a three-dimensional image from the image information and the photographing information read by the film image reading device 40, and includes a control device (image conversion device) 61 and a display device. Device (monitor) 62
It is composed of The control device 61 includes, inside the housing 67, an image conversion control unit 63 that executes a predetermined calculation process for obtaining a stereoscopic image based on the image information and the photographing information sent from the film image reading device 40; A primary storage unit 64 for temporarily storing image information and photographing information sent from the film image reading device 40, and a detachable secondary storage unit for storing calculation results and the like executed by the image conversion control unit 63 65. Further, on the front side of the housing 67, an operation unit having a plurality of operation buttons such as a power switch, a change button for changing a display angle of an image (that is, changing a viewpoint), and a confirm button for confirming operation contents. A connecting portion 67 having a connector for connecting a communication cable CA from the film image reading device 40 is provided on the rear side of the housing 67.

The image conversion control unit 63 includes a CPU (Central Processing Unit) for executing arithmetic processing, and a ROM (Read-Only Mesh) in which predetermined programs and data are recorded.
mory) and RAM (Random A) for temporarily recording data
ccess Memory). The image conversion control unit 63 includes an image position deriving unit 631, a first subject position deriving unit 632, and a second subject position deriving unit 63.
3. It has respective function realizing means such as a depth of field deriving means 634, a position determining means 635 and a drawing instructing means 636.

Of these function realizing means, the image position deriving means 631 is provided at each point (point in FIG. 4) of the subject image projected on each frame based on the image data of the subject image stored in the primary storage unit. (Corresponding to Pl, Pr) in the XY plane coordinates. Also, the first
The object position deriving means 632 derives the position in the depth direction (coordinate value in the Z direction) at each point (corresponding to the point P in FIG. 4) of the object in the three-dimensional coordinates,
The second subject position deriving means 633 is for deriving the horizontal and vertical positions (coordinate values in the X and Y directions) at each point of the subject in the three-dimensional coordinates. Further, the depth of field deriving means 634 derives the depth of field of the stereo camera 20.
This is to determine whether or not the position in the depth direction of the subject obtained by the first subject position deriving means 632 is within the depth of field.

The drawing instructing means 636 includes the first subject position deriving means 632 and the second subject position deriving means 6.
This is for instructing the display device 62 to draw a three-dimensional image based on the coordinate values of each point of the subject in the three-dimensional coordinates derived by 33. Also, the drawing instruction means 636
Calculates a new coordinate value (rotation data) of each point of the subject corresponding to the display angle in response to an instruction to change the display angle of the subject (viewpoint with respect to the subject) on the display device 62. Display device 6 based on coordinate values
2 is instructed to draw a stereoscopic image.

The display device 62 is a CRT (Cathode-Ray Tu
be) and the like, and on the display surface 621, a menu display such as instruction contents for giving an operation instruction to the control device 61 and a display of photographing information etc. taken into the control device 61 are displayed. Drawing instruction means 63 of image conversion control section 63
The stereoscopic image is displayed on the display surface based on the drawing instruction from the display device 6.

That is, the display device 62 is provided with a signal processor and an image processor, and the first subject position deriving means 63 is provided by the signal processor.
Calculation for converting a position in the three-dimensional space based on the coordinate value of each point of the subject in the three-dimensional coordinates derived by the second and second subject position deriving means 633 to a position in the pseudo three-dimensional space is performed. The image processor executes a process of writing image data to be drawn in the RAM based on the calculation result. Then, the image data written in the RAM is read, a drawing process is executed, and a stereoscopic image is displayed on the display surface 621. Of course, the signal processor and the image processor are included in the control device 61.
May be provided. Note that the control device (image conversion device) 61 and the display device 62 are not limited to those configured to be separated from each other as shown in the figure, but may be configured integrally so as to be inseparable.

FIG. 7 is a flowchart for explaining the photographing operation of the stereo camera 20. First, when a power switch (not shown) is turned on and power supply to each unit is started,
It is determined whether or not a stereo shooting mode (3D shooting mode) has been set (step # 1). If this determination is affirmative, the condition of the stereo shooting mode is set, and the film FM is fed to a predetermined frame position required for stereo shooting (step # 3). At this stage, when the photographer operates the operation unit 28 to perform the zoom setting, the camera control unit 30 controls the zoom / shutter driving unit 2.
3 is operated to adjust the respective focal lengths of the first and second photographing optical systems 21 and 22.

Next, it is determined whether or not the release button 35 has been turned on (step # 5). If the determination is affirmative, the camera controller 3 receives a signal from a distance measuring system (not shown).
In response to a signal from a photometry system (not shown), exposure adjustment is performed, and the first and second photographing optical systems 21 and 22 are operated.
Is operated to expose the film FM (step # 7).

Next, the magnetic writing unit 26 is operated by the control operation of the camera control unit 30, and the photographing date and the left and right photographing optical systems 21 and 22, which are a pair of frames for stereo photography.
Frame number, lens focal length, camera type, shooting magnification, lens FNo. Is recorded in the magnetic recording unit MR (step # 9). Note that the camera type is a means for knowing the base line length bh (FIG. 4) which is the distance between the lenses 21a and 22a of the first and second photographing optical systems 21 and 22. The information may be recorded in the magnetic recording unit MR. In this manner, simultaneously with the recording of the photographing information in the magnetic recording unit MR, the film FM is fed to enable the next photographing (step # 11), and the photographing operation in the stereo photographing mode ends.

If the determination in step # 1 is negative, it is determined that the general photographing mode has been set, and the conditions for the general photographing mode are set (step # 1).
3). In this case, for example, shooting is performed by the first shooting optical system 21 located on the right side of the subject.

After the photographer operates the operation unit 28 to set the zoom after the general photographing mode is set,
The camera control unit 30 operates the zoom / shutter drive unit 23 to adjust the focal length of the first photographing optical system 21. Then, it is determined whether or not the release button 35 has been turned on (step # 15). If this determination is affirmative, the camera control unit 30 receives a signal from a distance measuring system (not shown) and the zoom / shutter drive unit 23 Is operated to adjust the focus, while receiving a signal from a photometry system (not shown), exposure adjustment is performed, and the shutter of the first photography optical system 21 is actuated to operate the first photography optical system 21 of the film FM. Is exposed (step # 17).

Next, the magnetic writing unit 26 is operated by the control operation of the camera control unit 30, and the photographing information such as the date is recorded in the magnetic recording unit MR (step # 19). At the same time as the recording of the photographing information in the magnetic recording unit MR,
The film FM is fed to enable the next photographing (step # 21), and the photographing operation in the general photographing mode ends. If the determination in steps # 5 and # 15 is negative, the process waits until the release button 35 is turned on. Further, in the case of performing the shooting continuously in the stereo shooting mode and the general shooting mode, the process returns to Step # 1 and the respective steps are repeatedly executed.

FIG. 8 is a main flowchart for explaining the operation of the three-dimensional image conversion device 80 including the film image reading device 40 and the image conversion display device 60. First, a power switch (not shown) is turned on to supply power to each unit. Then, when the film cartridge CT containing the developed film FM is set in the film image reading device 40 and a predetermined operation key of the operation unit 45 is operated, the feed control unit 47 is operated, and F
M is pulled out from the film cartridge CT, and the image reading unit 48 reads (pre-scans) the film image of each frame, while the information reading unit 49 reads the imaging information of the magnetic recording unit MR in each corresponding frame. (Step # 31). The reading of the film image is executed in a rough state with a predetermined number of lines thinned out for pre-scanning. These read image data and photographed data are recorded in the image / information recording unit 50. Each of these operations is executed by an instruction of the image reading control unit 51.

Next, the image data and the photographic data recorded in the image / information recording section 50 are transferred to the image conversion control section 6.
3 is read out in accordance with an instruction from
(Step # 33). The transferred image data and photographed data are stored in the primary storage unit 64. All the image data and part of the photographic data stored in the primary storage unit 64 are read from the primary storage unit 64 and displayed on the display surface 621 of the display device 62 as a thumbnail screen as a preview screen as shown in FIG. Displayed (step #
35).

In the preview screen shown in FIG. 9, the photographing date (for example, “99/9/9 to 00/1 /
1)), the type of camera (eg, “VPS-1”) is displayed in the upper right corner, and frame numbers (1, 2, 3,...) Are displayed in the lower left part of each frame. It is displayed. In addition, images shot in the stereo shooting mode are displayed in a state surrounded by a thick frame, and below each image, a frame number corresponding to the stereo shooting is displayed together with the frame number of the image (for example, In the image of the frame number 2, “pair with 4”, and in the image of the frame number 4, “pair with 2”).

Further, below the image photographed in the general photographing mode, the photographing date of the image is displayed. Further, a button B1 for performing a page return operation is displayed at the lower left corner of the preview screen, and a button B2 for performing a page forward operation is displayed at the lower right corner of the preview screen. The screen of the previous page is displayed by clicking the button, and the screen of the next page is displayed by clicking the button B2.

Next, it is determined whether or not a frame for displaying a stereoscopic image has been selected from among the images photographed in the stereo photographing mode (step # 37). The selection of this frame is performed, for example, by clicking the image of the paired frame (for example, the image of the frame number 2 and the image of the frame number 4) to perform the reverse display, and turning on the confirmation button of the operation unit 66. Is to be executed. Therefore, the determination in step # 37 is executed by determining the presence or absence of the reverse display and the operation of the confirmation button.

If the determination in step # 37 is affirmative, the frames corresponding to the selected pair of images on the film FM of the film cartridge CT are sequentially fed to the position of the image reading unit 48 by the feed control unit 47. Then, a film image is sequentially read by the image reading unit 48 for each line (step # 39). The read image data (that is, the image data obtained by the main scan) is temporarily stored in the image / information storage unit 50.

Then, the main scanned image data stored in the image / information storage unit 50 is read out according to an instruction from the image conversion control unit 63, and is read out by the image conversion display unit 60.
(Step # 41). The transferred image data is stored in the primary storage unit 64. Thereafter, the image data and the photographing data are read from the primary storage unit 64, and a predetermined calculation process for displaying a stereoscopic image is executed by the image conversion control unit 63 based on the data (step # 43). . Thereafter, based on an instruction from the drawing instruction means 636, a stereoscopic image is displayed on the display surface 621 of the display device 62, for example, as shown in FIG. 10 (step # 45).

The display screen shown in FIG. 10 is a three-dimensional image corresponding to the image of frame number 2 and frame number 4 shown in FIG. 9. In this display screen, a "thumbnail" command is displayed at the upper left corner, and the upper right corner is displayed. A "Save" command is now displayed in the corner. In addition, a “machining” command is displayed in the lower left corner, and an “end” command is displayed in the lower right corner. When the "thumbnail" command is clicked, the screen shown in FIG. 9 is displayed.
The data can be stored in the next storage unit 65.

When the "processing" command is clicked, the screen shifts to another operation processing screen. When the "end" command is clicked, the display operation is terminated and the film FM is rewound into the film cartridge CT. The film cartridge CT is ejected to the outside of the film image reading device 40. By operating a predetermined operation key of the operation unit 63, an image number (for example, “Camera 0
1 ").

Buttons B1, B2, B3, and B4 for changing the display angle of the stereoscopic image are displayed at the upper, lower, left, and right ends of the display screen shown in FIG.
That is, when the button B1 is sequentially clicked, the reference image is sequentially rotated rightward, and a screen viewed from the left side of the reference image can be displayed. When the button B2 is sequentially clicked, the reference image sequentially moves leftward. The screen rotated and viewed from the right side of the reference image can be displayed. In addition, by sequentially clicking the button B3, the reference image is sequentially rotated downward, and a screen viewed from above the reference image can be displayed. By sequentially clicking the button B4, the reference image sequentially moves upward. The screen rotated and viewed from below the reference image can be displayed.

Returning to FIG. 8, it is determined whether or not another frame for displaying a stereoscopic image has been selected (step #).
47) If the determination is affirmative, the process returns to step # 39, and the subsequent steps are repeatedly executed. In order to select another frame for displaying a stereoscopic image, for example, a “thumbnail” command shown in FIG. 10 is clicked to display a thumbnail screen shown in FIG. The operation can be executed by turning the confirmation button on the operation unit 66 ON.

Next, when the next frame is not selected in step # 47, it is determined whether or not the "end" command is clicked (step # 49). If this determination is affirmative, the film FM is rewound as described above, and the film cartridge CT is ejected outside the film image reading device 40 (step # 5).
1), a series of display operations ends. Step # 4
If a negative determination is made in step 9, the process returns to step # 47, and the subsequent operations are repeatedly executed. Although not shown in the flowchart, when the "save" command or the "processing" command shown in FIG. 10 is clicked, the above-described predetermined operation is executed. Further, a two-dimensional image other than a stereoscopic image can be displayed.

FIG. 11 is a flowchart showing a subroutine of "arithmetic processing" in step # 43 shown in FIG. In this figure, first, the photographing data is analyzed (step # 61), and then the effective depth range of the object field is calculated (step # 63). That is, step #
In step 61, the entrance pupil diameter D is calculated, and in step # 63, the effective depth range of the object field is calculated based on the above equation (2) using the value obtained in step # 61. The calculated effective depth range of the field is stored in a RAM or the like.

Next, the distance (Z coordinate value in XYZ three-dimensional coordinates) of the object (subject) to the predetermined point P is calculated (step # 65). It is determined whether or not there is (Step # 6)
7). If this determination is affirmative, the X coordinate value and the Y coordinate value of the point P in the XYZ solid coordinates are calculated (step # 69). These calculated data (X
The coordinate value, the Y coordinate value, and the Z coordinate value) are temporarily stored in a RAM or the like.

Next, it is determined whether or not the calculation of the distance to each of the preset points P of the object has been completed (step # 71). If the determination is affirmative, the process returns to the main routine. If the determination at step # 67 is negative, and if the determination at step # 71 is negative, the process proceeds to step # 65, and the subsequent steps are repeatedly executed. Note that the number of points P calculated in step # 65 is reduced, and when the calculated point P is within the effective depth range of the object field, the vicinity of the calculated point P is similarly set in the object field. Within the effective depth range of Therefore, when the X coordinate value and the Y coordinate value are obtained in step # 69, the Z coordinate value of the vicinity of the point P calculated in step # 65 is calculated in addition to the X coordinate value and the Y coordinate value. The time required for the entire arithmetic processing can be reduced.

FIG. 12 is a diagram for explaining the configuration when the stereo camera 20 constituting the stereoscopic image display system 10 is a digital camera. In this figure, a digital stereo camera 100 has a first photographing optical system 101 disposed on the right side toward the subject and a left side separated from the first photographing optical system 101 by a predetermined distance. A second imaging optical system 102, a zoom / shutter driving unit 103, a first imaging unit 104 arranged on the back side of the first imaging optical system 101, and a second imaging optical system 102 Imaging unit 105, image processing unit 106, memory card mounting unit 107, display unit 108, operation unit 109, flash control unit 110
And a camera control unit 111 for controlling the entire operation.

The first photographing optical system 101 and the second photographing optical system 102 are disposed on the front surface of a housing 112 constituting a camera, and include a zoom / shutter driving unit 103, a first image pickup unit 104, Second imaging unit 105, memory card mounting unit 107, flash control unit 110, and camera control unit 1
Reference numeral 11 is provided inside the housing 112. The display unit 108 is provided on the back side of the housing 112, and the operation unit 109 is provided at an appropriate position on the outer surface of the housing 112.

A first flash valve similar to the stereo camera 20 is disposed on the front surface of the housing 112 and above the first photographing optical system 101, and above the second photographing optical system 102. , A second flash valve unit similar to the stereo camera 20 is provided. A finder window similar to that of the stereo camera 20 is provided between the first and second flash bulbs, and the upper right side of the housing 112 is similar to the stereo camera 20 that forms part of the operation unit 109. Release button is provided.

The first photographing optical system 101 includes a photographing lens 101a having a structure of a zoom lens, and has an aperture and a shutter incorporated therein. Further, the second photographing optical system 102 includes a photographing lens 102a configured as a zoom lens, and also has a built-in diaphragm / shutter. The zoom / shutter driving unit 103 controls the driving of the zoom and the driving of the shutter.

The first image pickup unit 104 includes a CCD (Charge D)
evice) and the release button is O
In response to the release signal N, a release signal output from the first imaging optical system 101 is received in response to a release signal. The second imaging unit 105 includes a CCD (Charge
The imaging device is configured by an imaging device such as a coupled device, and receives a release signal output when a release button is turned on to capture a subject image introduced from the second imaging optical system 102. First imaging unit 104 and second imaging unit
The image picked up by the image pickup unit 105 is the first image pickup unit 10
After being converted into digital signals by A / D converters provided in the fourth and second imaging units 105, the signals are transmitted to the image processing unit 106.

The image processing unit 106 performs predetermined signal processing such as pixel interpolation, gamma conversion, white balance adjustment, and image compression / decompression processing on the input digital signal. The memory card mounting section 107 is for detachably mounting a recording medium MC such as a memory card. On the recording medium MC mounted on the memory card mounting unit 107, image data on which predetermined signal processing has been performed by the image processing unit 106 in accordance with an instruction from the camera control unit 111 is recorded. alike,
Shooting date, frame numbers corresponding to the left and right shooting optical systems 101 and 102 which are a pair of frames for stereo shooting, lens focal length, camera type, shooting magnification, lens FN
o. And the like are recorded.

The display unit 108 is composed of a liquid crystal display or the like disposed on the rear side of the housing 112. The state of the camera at the time of photographing (for example, the focal length of a lens, the distinction between stereo photographing and general photographing, flashing) The display is for displaying the presence or absence of light emission, distinction between in-focus and out-of-focus, and an image of a subject. The operation unit 109 includes the above-described release button, a changeover switch for switching between a stereo shooting mode and a general shooting mode, and the like.

The flash control section 110 controls the light emission of the first and second flash valve sections in response to the release button being turned on. Camera control unit 111
The CPU controls the overall operation of the stereo camera 100, and executes a central processing (CPU) that executes arithmetic processing.
ng Unit), R on which the specified programs and data are recorded
It comprises an OM (Read-Only Memory) and a RAM (Random Access Memory) for temporarily recording data.

As described above, when the digital stereo camera 100 is used instead of the stereo camera 20 constituting the stereoscopic image display system 10, the film image reading device 40 constituting the image conversion and display device 80 is unnecessary. Therefore, the image conversion display device 80 is constituted only by the image conversion display device 60. For this reason, the connection unit 67 of the image conversion and display device 60 is configured to be able to mount a recording medium such as a memory card.

FIG. 13 is a flowchart for explaining the photographing operation of the stereo camera 100. First, when a power switch (not shown) is turned on and power supply to each unit is started, it is determined whether or not a stereo shooting mode (3D shooting mode) has been set (step # 101). If this determination is affirmative, the conditions for the stereo shooting mode are set (step # 103). At this stage, when the photographer operates the operation unit 109 to perform zoom setting, the camera control unit 111 operates the zoom / shutter driving unit 103 to operate the first and second photographing optical systems 101 and 1.
02 are adjusted.

Next, it is determined whether or not the release button has been turned on (step # 105). If the determination is affirmative, the camera controller 1 receives a signal from a distance measuring system (not shown).
The zoom / shutter drive unit 103 is operated by 11 to focus the image, and the exposure is adjusted by receiving a signal from a photometric system (not shown), and the first and second photographing optical systems 10 are adjusted.
The shutters 1 and 102 are operated to expose the first and second imaging units 104 and 105 (step # 1).
07).

Next, predetermined image processing is performed by the image processing unit 106 (step # 109), and the camera control unit 111
While the image data is recorded on the recording medium MC in accordance with the instruction from, the photographing date, frame numbers corresponding to the left and right photographing optical systems 101 and 102, which are images to be paired for stereo photographing, the focal length of the lens, Type, shooting magnification, lens FNo. Are simultaneously recorded (step # 111), and the photographing operation in the stereo photographing mode ends.

If the determination in step # 101 is negative, it is determined that the general photographing mode has been set, and the conditions for the general photographing mode are set (step # 101).
113). In this case, for example, shooting is performed by the first shooting optical system 101 located on the right side of the subject.

After the general photographing mode is set, when the photographer operates the operation unit 109 to perform zoom setting, the camera control unit 111 operates the zoom / shutter driving unit 103 to operate the first photographing optical system. The focal length of 101 is adjusted. Then, it is determined whether or not the release button has been turned on (step # 115). If the determination is affirmative, the camera / control unit 111 receives a signal from a distance measuring system (not shown) and causes the zoom / shutter drive unit 103 to operate. While being operated and focused, exposure adjustment is performed in response to a signal from a photometry system (not shown), and the shutter of the first imaging optical system 101 is operated to perform exposure on the first imaging unit 104. (Step # 117).

Next, predetermined image processing is performed in the image processing section 106 (step # 119), and the camera control section 111
The image data is recorded on the recording medium MC according to the instruction from, while the photographing information such as the photographing date is recorded.
121), the photographing operation in the general photographing mode ends. If the determination in steps # 105 and # 115 is negative, the process waits until the release button is turned on. In addition, in the case of performing the shooting continuously in both the stereo shooting mode and the general shooting mode, the process returns to step # 101 and the respective steps are repeatedly executed.

FIG. 14 is a main flowchart for explaining the operation of the three-dimensional image conversion and display device comprising the image conversion and display device 60. First, the power switch (not shown) is turned on.
Then, power is supplied. Then, the image conversion display device 60
When the recording medium MC is mounted on the connection section 67 of the storage section 67 and a predetermined operation key of the operation section 66 is operated, the image data and the photographing data recorded on the recording medium MC are changed according to an instruction from the image conversion control section 63. Is read (Step # 13)
1). The read image data and photographed data are 1
It is stored in the next storage unit 64. All the image data and a part of the photographic data stored in the primary storage section 64 are read out from the primary storage section 64 and read out from the display surface 62 of the display device 62.
A preview screen similar to that of FIG. 9 is displayed as a thumbnail in FIG. 1 (step # 133). Since this display screen is a preview screen, the image data is read out and displayed with a predetermined number of lines thinned out.

Next, it is determined whether or not a frame for displaying a stereoscopic image has been selected from among the images photographed in the stereo photographing mode (step # 135). If this determination is affirmative, the image data of the frame corresponding to the selected paired image is read from the recording medium MC (step # 137). The read image data is stored in the primary storage unit 64. Thereafter, a predetermined calculation process for displaying the stereoscopic image is executed by the image conversion control unit 63 (Step # 139), and the stereoscopic image is displayed on the display surface 621 of the display device 62 as shown in FIG. Step # 141). Note that "end" shown in FIG.
When the command is clicked, the display operation is terminated, and the recording medium MC is ejected outside the image conversion and display device 60.

Next, it is determined whether or not another frame for displaying a stereoscopic image has been selected (step # 14).
3) If the determination is affirmative, the process returns to step # 137, and the subsequent steps are repeatedly executed. And step #
If the next frame is not selected in 143, it is determined whether or not the "end" command has been clicked (step # 145). If this determination is affirmative, the recording medium MC is ejected outside the image conversion and display device 60 as described above (step # 147), and a series of display operations ends. If the determination is negative in step # 145, the process returns to step # 143, and the subsequent operations are repeatedly executed. Note that the “calculation processing” in step # 139
This subroutine is the same as the flowchart shown in FIG.

As described above, the stereo cameras 20, 100 applied to the stereoscopic image display system 10 according to the present invention can perform stereo photography in which the same subject is photographed from different viewpoints whose eyes are parallel to each other. The stereo image of the subject is displayed on the display surface 621 of the display device 62.
At least at the time of photographing the subject, the focal length of the lens, the distance between the viewpoints, the photographing magnification, and the FNo. Of the lens. In addition, each piece of shooting information of a frame number forming a set of stereo shooting is recorded.

Further, as described above, the image conversion display device 80 applied to the stereoscopic image display system 10 according to the present invention performs stereo photography in which the same subject is photographed from different viewpoints whose eyes are parallel to each other. Possible and focal length of lens, distance between viewpoints, shooting magnification, lens FN
o. And a subject image photographed in stereo by a stereo camera capable of recording each photographing information of a frame number forming a pair of stereo photographing, as a stereoscopic image on a display surface of a display device, wherein An image position deriving unit for deriving a position of the subject image on planar coordinates, and a depth of the subject in three-dimensional coordinates using each image position derived by the image position deriving unit and predetermined photographing information of the photographing information. First subject position deriving means for deriving a position in the direction, subject depth deriving means for deriving a subject depth of the camera using predetermined photographing information of the photographing information, and a subject derived by the subject depth deriving means Position determining means for determining whether or not the subject exists within the depth; and, when the subject is within the depth of the subject, determining the image position and the shooting information. Chino is obtained by so and a second subject position deriving means for deriving the position of the horizontal and vertical direction in the three-dimensional coordinates of the object using the predetermined imaging information.

Further, the stereoscopic image display system 10 according to the present invention includes a camera capable of performing stereo photography for photographing the same subject from different viewpoints, and a stereoscopic image of the subject photographed by the camera on a display surface of a monitor. In a stereoscopic image display system provided with an image conversion display device that displays images as subjects, at least at the time of photographing a subject, the focal length of the lens, the distance between viewpoints, the photographing magnification, the FNo. The image conversion display device is configured to be able to record each shooting information of a frame number that is a set of stereo shooting and an image position deriving unit that derives a position of each of the stereo shot frames on a plane coordinate of a subject image. A first subject position deriving unit that derives a position in a depth direction of the subject in three-dimensional coordinates using each image position derived by the image position deriving unit and predetermined photographing information of the photographing information; A subject depth deriving unit that derives a subject depth of the camera using predetermined photographing information of the photographing information; and determining whether the subject is located within the subject depth derived by the subject depth deriving unit. A position determining unit that performs the image capturing using the image position and predetermined photographing information of the photographing information when the object is located within the subject depth. It is obtained by so and a second subject position deriving means for deriving the position of the horizontal and vertical direction in the three-dimensional coordinates.

The image conversion device 61 according to the present invention
It is possible to perform stereo photography in which the same subject is photographed from different viewpoints whose sight lines are parallel to each other.
An image conversion apparatus for displaying a subject image stereo-photographed by a camera capable of recording each photographing information as a stereoscopic image on a display surface of a monitor, wherein the stereoscopic photographed subject image is displayed on a plane coordinate of the subject image. Using the image position deriving means for deriving the position in the image position and each image position derived by the image position deriving means and predetermined photographing information of the photographing information, the position in the depth direction of the subject in the three-dimensional coordinates is derived. First subject position deriving means, and a depth of field deriving means for deriving a depth of field of the camera using predetermined photographing information of the photographing information;
Position determining means for determining whether or not the subject exists within the depth of field derived by the depth of field deriving means; and the image position when the subject is within the depth of field. And a second subject position deriving means for deriving each of the horizontal and vertical positions in the three-dimensional coordinates of the subject by using predetermined photographing information of the photographing information.

Further, the readable recording medium according to the present invention can perform stereo photography in which the same subject is photographed from different viewpoints whose sight lines are parallel to each other, and the focal length of the lens, the distance between the viewpoints, and the photographing magnification. And FNo. A readable recording medium on which an image conversion program for displaying a subject image stereo-photographed by a camera capable of recording each photographing information as a stereoscopic image on a display surface of a monitor is recorded. An image position deriving step of deriving a position of the subject image on planar coordinates, and three-dimensional coordinates of the subject using each image position derived in the image position deriving step and predetermined photographing information of the photographing information. A first subject position deriving step of deriving a position in a depth direction of the camera; a depth of field deriving step of deriving a depth of field of the camera using predetermined photographing information of the photographing information; A position determining step of determining whether or not the subject exists within the depth of field derived in the depth of field deriving step; A second subject position deriving step for deriving a horizontal position and a vertical position in the three-dimensional coordinates of the subject using the image position and predetermined photographing information of the photographing information when the subject is present within the depth of field It is provided with.

Therefore, the depth of field of the camera at the time of shooting can be obtained, and it is determined whether or not the position of the subject in the depth direction in the three-dimensional coordinates is within the depth of field of the camera at the time of shooting. While the determination can be performed, the horizontal and vertical positions in the three-dimensional coordinates of the subject can be obtained only when the determination is affirmative. As a result, the three-dimensional object viewed from a plurality of angles can be obtained. Despite being able to observe as an image, CPU
Can be effectively reduced, thereby effectively preventing an increase in price. If there is a portion where the position of the subject in the depth direction in the three-dimensional coordinates does not exist within the depth of field of the camera, for example, such a portion may be blurred or displayed with another background image. do it.

Note that the present invention is not limited to the above-described embodiment, and various modifications as described below can be adopted.

(1) In the above embodiment, when the stereoscopic image display system 10 is constituted by using the stereo camera 20, the film image reading device 40 becomes the image conversion display device 60
Is connected by the communication cable CA, but is not limited to this. For example, it is also possible to establish a wireless connection using an infrared communication technology or the like.

(2) In the above embodiment, the three-dimensional image display system 10 only displays the three-dimensional image on the display device. However, the three-dimensional image is printed by attaching a printer to the image conversion display device 60. Is also possible.

(3) In the above embodiment, when the camera is a digital camera, the recording medium MC is detachably mounted. However, the recording medium MC can be mounted irremovably. In this case, for example, the stereo camera 20 and the image conversion / display device 80 may be connected via a communication cable, and data may be taken into the primary storage unit 64 from the recording medium MC via the communication cable.

(4) In the above embodiment, the stereo cameras 20 and 100 have two photographing optical systems 21 and 22a01,
The two-lens type provided with 102, for example, a three-lens type provided with three photographing optical systems as shown in FIG.
It may have four or more photographing optical systems. The three-lens stereo camera shown in FIG. 15 (FIG. 15 (a) is an external view of the camera, and FIG. 15 (b) is an internal configuration diagram) is a system using a silver halide film, and has a configuration shown in FIG. In addition, a window hole 121 formed in the housing 31 at a position above the first photographing optical system 21, a lens 122 provided inside the housing 31, and provided inside the housing 31. And three mirrors 123. The window 121, the lens 122, and the mirror 123 constitute a third photographing optical system. In the case of a digital type, an optical system and an imaging system may be provided at the position of the window hole 121.

In the stereo camera configured as described above, two frames of subject images having parallax in the left and right directions are photographed by the first photographing optical system 21 and the second photographing optical system 22, while the image is taken from the window 121. The incident subject image is incident on the lens 122 via the three mirrors 123 and the first
The subject image of the third frame having a vertical parallax with the imaging optical system 21 is photographed. According to this configuration, as described above, the position of the subject can be obtained based on the two frames of the subject image having parallax in the left-right direction, while the stereoscopic coordinates can also be obtained based on the two frames of the subject image having parallax in the vertical direction. Can be obtained.

That is, the distance between the optical axis of the first photographing optical system 21 and the optical axis of the window hole 121 is defined as the base line length bv in the vertical direction, and based on the same principle of triangulation as in the case of the above-mentioned horizontal direction. The position of the subject can be obtained.
Thus, even if the subject is hidden behind an obstacle and cannot be photographed in the second photographing optical system 22, the third photographing optical system may be able to perform photographing. Therefore, the position of the subject is more reliably obtained. Will be able to do it.

Note that, instead of the three-lens stereo camera shown in FIG. 15, for example, a three-lens configuration as shown in FIG. 16 can be adopted. That is, the one shown in FIG. 16 has a first photographing optical system 125 and a second photographing optical system 126 arranged in the upper left and right direction of the housing 124 and a lower part of the second photographing optical system 126. And a third photographing optical system 127 is provided. Flash valve part 1
Reference numeral 28 is provided at a position substantially equidistant from the three photographing optical systems 125 to 127. In the three-lens camera configured as described above, the position of the subject can be more reliably obtained as in the three-lens camera shown in FIG.

(5) In the above embodiment, the stereo cameras 20 and 100 are configured as a two-lens type by integrally providing two photographing optical systems, but the present invention is not limited to this. For example, it is also possible to combine two monocular cameras in the left-right direction to form a two-lens camera. FIG. 17 and FIG. 18 show one example.
That is, in the camera shown in FIG. 17, for example, a male connector is provided on the left side of the first camera 131, and a female connector is provided on the right side of the second camera 132, for example. , The second cameras 131 and 132 are electrically connected to each other by fitting the two connectors to each other so that they can communicate with each other, and the zoom lens of both cameras 131 and 132 is moved by operating the operation unit of one of the cameras 131 or 132 And shutter operation of both cameras 131 and 132 can be performed by operating one of the release buttons.

In the camera shown in FIG. 18, for example, female connectors are provided on the lower surfaces of the first camera 133 and the second camera 134, respectively.
For example, a male connector is provided on the pedestal 135 located below the first and second cameras 133 and 134, and the first and second cameras 133 and 134 are fitted by fitting the respective connectors of the first and second cameras 133 and 134 and the pedestal 135. Are electrically connected to each other so that the zoom lens of both cameras 133 and 134 can be moved by operating the operation unit of one of the cameras 133 or 134, and the release button of one of the release buttons By operation, both cameras 133, 134
The shutter operation is made possible. 17 and 18 may be of a type using a silver halide film or a digital type. In addition, the distance between the lenses (distance between viewpoints), which is the base line length of both cameras, may be stored in a ROM or the like in advance.

(6) In the above embodiment, the digital stereo camera 100 has two photographing optical systems 101, 1
In FIG. 2, the distance between the two lenses 101a and 102a is fixed, but is not limited thereto. For example, the distance between the lenses may be made variable by a configuration as shown in FIG. The camera shown in FIG. 19 includes a main housing 112a having a housing 112 provided with a first imaging optical system 101 and a second imaging optical system 102, and has a left-right direction with respect to the main housing 112a. And a sub-housing 112b slidably disposed on the sub-case 112b. FIG. 19A shows that the sub-housing 112 b is replaced with the main housing 112.
FIG. 2B is a diagram in which the sub-housing 112b is pulled out from the main housing 112a, and FIGS. 2C and 2D are diagrams schematically showing a slide mechanism.

That is, a spiral rod 141 extending toward the main housing 112a is attached to the lower front portion of the sub-housing 112b, and a nut member 142 to which the spiral rod 141 is screwed into an appropriate lower front portion of the main housing 112a.
Are arranged. The nut member 142 is connected to the reduction system 1
The drive motor 144 attached via the base 43 can rotate in both forward and reverse directions along the circumferential direction. In addition, a guide rod 1 is provided at the upper and lower positions on the back side of the main housing 112a.
45 and 146 are arranged to extend in the left-right direction, while engaging members (not shown) integrally formed with the sub-housing 112b are slidably engaged with the guide rods 145 and 146. Further, a guide plate 147 to which the sub-housing 112b is pressed in contact is provided at an appropriate position near the sub-housing 112b on the front side of the main housing 112a.

In such a configuration, the drive motor 14 is operated by operating a predetermined button provided on the operation section.
When the nut 4 is driven to rotate, the spiral rod 141 moves left and right in accordance with the rotation direction of the nut member 142, and the sub-housing 112b is engaged with the guide rods 145, 146 with respect to the main housing 112a. Will slide right and left. Thereby, the two photographing optical systems 101, 1
02, the distance between the two lenses 101a and 102a is changed.

According to this configuration, when the photographed subject image is observed with a viewer as described in the related art,
Since it is desirable to set the distance between the two lenses 101a and 102a to be a value approximating the distance between the human eyes, the sub-housing 112b can be moved to, for example, the position shown in FIG. . In addition, when a three-dimensional image is displayed on the display surface 621 of the display device 62 as in the present invention, the display accuracy can be increased as the distance between the two lenses 101a and 102a is increased.
12b can be moved, for example, to the position shown in FIG.

(7) In the above embodiment, the stereo cameras 20 and 100 have two photographing optical systems 21 and 22a01,
102, and two frames of the subject image are obtained at the same time, but the present invention is not limited to this configuration. For example, as shown in FIG. 20, it is also possible to adopt a configuration in which one single-lens camera 151 is moved left and right to sequentially photograph a subject, thereby obtaining two subject images. That is, in the configuration shown in FIG. 20, the monocular camera 151 is attached to the rail member 152 so as to be slidable in the left-right direction. According to this configuration, the subject image of the right frame can be obtained by moving the monocular camera 151 to the specified position on the right side toward the subject as shown in FIG. As shown in b), the monocular camera 151 is located at a specified position on the left side of the subject.
The subject image of the left frame can be obtained by moving and photographing. This configuration can be a system using a silver halide film or a digital system. In addition, the distance between the lenses that is the base line length (distance between viewpoints)
Is stored in advance in the ROM corresponding to the moving distance of the monocular camera 151.
And so on.

(8) In the above embodiment, the digital stereo camera 100 has two photographing optical systems 101, 1
02 is fixed, but is not limited to this configuration. For example, as shown in FIG.
A single-lens or twin-lens image pickup unit 156 (two-lens type in the figure) may be attached to one end face of the lens unit 5 via a connector (not shown) so as to be exchangeable. According to this configuration, by mounting the two-lens image pickup unit 156 only during stereo shooting, it is possible to effectively prevent the camera from becoming larger at all times.

(9) In the above embodiment, the stereo cameras 20 and 100 have two photographing optical systems 21 and 22a01,
Although 102 is fixed, it is not limited to this configuration. For example, as shown in FIG. 22, a dedicated stereo lens 162 is interchangeably attached to a single-lens camera 161. According to this configuration, two subject images are exposed in one frame, but it is sufficient that the image areas for specifying the left and right subject images in one frame are captured as the photographing information. Further, as shown in FIG. 23, the stereo adapter 1 is attached to the single-lens camera 165.
66 can be attached to be exchangeable.

(10) In the above embodiment, the image conversion control section 63 of the image conversion and display device 60 includes the image position deriving means 631, the first subject position deriving means 632, the second subject position deriving means 633, Although various function realizing means such as the depth of field deriving means 634 and the position determining means 635 are provided, when the three-dimensional image conversion display device 80 includes the film image reading device 40 and the image conversion display device 60,
Image position deriving means 631, first subject position deriving means 6
32, the second subject position deriving unit 633, the depth of field deriving unit 634, the position determining unit 635, and other function realizing units are set as functions of the image reading control unit 51 of the film image reading device 40. Is also possible.

(11) In the above embodiment, the camera 20,
A frame number which is a set for stereo shooting is recorded in 100 as shooting information.
In the case where the rotation is performed only once, it is only necessary to be able to identify the left and right frames. Therefore, it is not always necessary to record the frame numbers.

[0122]

As described above, according to the present invention,
When the camera at least captures an object, the focal length of the lens, the distance between viewpoints, the imaging magnification, and the FNo. Is configured to be able to record the respective shooting information, so that the depth of field of the camera can be obtained, and whether the position of the subject in the depth direction in the solid coordinates exists within the depth of field of the camera. Can be determined. Therefore, only when the determination is affirmed, the horizontal and vertical positions of the subject in the three-dimensional coordinates can be obtained. As a result, the subject can be observed as a three-dimensional image viewed from a plurality of angles. In spite of the above, the load on the CPU can be efficiently reduced and the cost increase can be effectively prevented.

[Brief description of the drawings]

FIG. 1 is a diagram showing a schematic configuration of a stereoscopic image display system according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a configuration of a stereo camera used in the stereoscopic image display system shown in FIG.

FIG. 3 is a block diagram showing a schematic configuration of a film image reading device and an image conversion display device used in the stereoscopic image display system shown in FIG.

FIG. 4 is a diagram for explaining a basic principle of displaying two subject images as a stereoscopic image on a monitor.

FIG. 5 is a diagram for explaining a calculation formula for calculating a depth of field.

FIG. 6 is a view for explaining a configuration of a silver halide film.

FIG. 7 is a flowchart illustrating a shooting operation of the stereo camera.

FIG. 8 is a flowchart for explaining the operation of the stereoscopic image conversion device.

FIG. 9 is a diagram showing a preview screen displayed on the display surface of the display device.

FIG. 10 is a diagram illustrating a stereoscopic image displayed on a display surface of a display device.

FIG. 11 is a flowchart showing a subroutine of the flowchart shown in FIG. 8;

FIG. 12 is a block diagram illustrating a configuration of a digital stereo camera.

FIG. 13 is a flowchart illustrating a shooting operation of a digital stereo camera.

FIG. 14 is a flowchart illustrating an operation of the stereoscopic image conversion device when a digital stereo camera is used.

15A and 15B are diagrams showing a configuration of a three-lens type stereo camera, wherein FIG. 15A is an external view thereof, and FIG. 15B is an internal configuration diagram.

FIG. 16 is a diagram showing another configuration of a three-lens stereo camera.

FIG. 17 is a diagram illustrating another configuration of a twin-lens stereo camera.

FIG. 18 is a diagram showing another configuration of the twin-lens stereo camera.

19A and 19B are diagrams illustrating a configuration of a two-lens stereo camera in which the distance between lenses is variable, wherein FIG. 19A is a diagram illustrating a state in which the distance between lenses is reduced, and FIG. FIGS. 3C and 3D are views for explaining the configuration of the slide mechanism.

FIGS. 20A and 20B are diagrams illustrating a configuration that enables stereo shooting with one single-lens camera, where FIG. 20A illustrates a state in which the single-lens camera is moved to one end, and FIG. FIG. 5 is a view showing a state where the end portion is moved to an end portion of FIG.

FIG. 21 is a diagram showing a configuration of a camera in which monocular and binocular imaging units are interchangeably mounted.

FIG. 22 is a diagram showing a configuration of a camera in which a dedicated stereo lens is interchangeably mounted.

FIG. 23 is a diagram showing a configuration of a camera in which a stereo adapter is attached in a replaceable manner.

[Explanation of symbols]

 Reference Signs List 10 stereoscopic image display system 20, 100 stereo camera (camera) 21, 101 first photographing optical system 22, 102 second photographing optical system 40 film image reader 48 image reader (image reader) 49 information reader ( Information reading means) 50 image / photographing information storage unit 60 image conversion display device 62 display device (monitor) 80 stereoscopic image conversion device 21a, 22a, 101a, 102a lens 621 display surface 631 image position deriving means 632 first object position derivation Means 633 Second subject position deriving means 634 Depth of field deriving means 635 Position discriminating means 636 Drawing instruction means FM Silver halide film MR information recording unit MC Recording medium

Claims (10)

[Claims] 1. A stereo photographing method in which the same subject is photographed from different viewpoints whose eyes are parallel to each other,
A camera capable of displaying the subject image photographed in stereo as a stereoscopic image on a display surface of a monitor in an image conversion display device, wherein at least the focal length of a lens, the distance between viewpoints, the photographing magnification, and the FN
o. A camera characterized by recording the respective shooting information. 2. At least two spaced apart from each other
2. The camera according to claim 1, further comprising: a pair of photographing optical systems, wherein a distance between optical axes of respective lenses in the two sets of photographing optical systems is a distance between the viewpoints. 3. A silver halide film having an information recording section on which photographing information is recorded, further comprising writing means for writing the photographing information in the information recording section of the silver halide film. Item 3. The camera according to Item 1 or 2. 4. The recording medium according to claim 1, wherein a recording medium on which image information and photographing information are recorded as digital data is used, and a writing unit for writing the photographing information on the recording medium is provided. Camera. 5. It is possible to perform stereo photography in which the same subject is photographed from different viewpoints whose eyes are parallel to each other,
And the focal length of the lens, the distance between the viewpoints, the shooting magnification, and the FNo. An image conversion display device for displaying a subject image stereo-photographed by a camera capable of recording each of the photographing information as a stereoscopic image on a display surface of a monitor, wherein the stereo-photographed subject image is displayed on a plane coordinate. Using the image position deriving means for deriving a position, and each image position derived by the image position deriving means and predetermined photographing information among the photographing information, a position in the depth direction of the subject in stereoscopic coordinates is derived. First subject position deriving means, depth of field deriving means for deriving a depth of field of the camera using predetermined photographing information of the photographing information, and a depth of field deriving means derived by the depth of field deriving means. Position determining means for determining whether or not the subject exists within the depth of field; and, when the subject exists within the depth of field, the image position and the shooting information. A second subject position deriving means for deriving horizontal and vertical positions of the subject in three-dimensional coordinates using predetermined photographing information of the report. 6. The camera uses a silver halide film provided with an information recording section in which the photographing information is recorded corresponding to each frame, and a subject image of each frame photographed on the silver halide film is recorded. A film image reading device having image reading means for converting image data into image information and information reading means for reading photographing information recorded in the information recording section, and image information obtained by the film image reading device; The image conversion display device according to claim 5, further comprising: an image conversion device that obtains a three-dimensional image by using shooting information. 7. A recording medium on which image information and photographing information are recorded as digital data, wherein said data reading means reads image information and photographing information recorded on said recording medium. The image conversion display device according to claim 5, further comprising: an image conversion device that obtains a three-dimensional image using the read image information and the photographing information. 8. A camera which is capable of performing stereo photography for photographing the same subject from different viewpoints, and an image conversion display device which displays a subject image stereo-photographed by the camera as a stereoscopic image on a display surface of a monitor. In the three-dimensional image display system, the camera is configured to have a focal length of a lens, a distance between viewpoints, a photographing magnification, and an FNo.
The image conversion and display device is configured to derive a position on the plane coordinates of the subject image of each of the stereo-photographed frames, and the image conversion display device derives the image by the image position deriving unit. First subject position deriving means for deriving a position in the depth direction of the subject in three-dimensional coordinates using each of the obtained image positions and predetermined photographing information of the photographing information; Depth-of-field deriving means for deriving the depth of field of the camera using shooting information; and determining whether the subject exists within the depth of field derived by the depth-of-field deriving means. Position determining means, and when the subject is present within the depth of field, using the image position and predetermined shooting information of the shooting information in the horizontal direction of the subject in three-dimensional coordinates and A second subject position deriving unit that derives each position in the vertical direction. 9. Stereo photographing in which the same subject is photographed from different viewpoints whose sight lines are parallel to each other is possible,
And the focal length of the lens, the distance between the viewpoints, the shooting magnification, and the FNo. An image conversion apparatus for displaying a subject image stereo-photographed by a camera capable of recording each photographing information as a stereoscopic image on a display surface of a monitor, wherein the stereoscopic photographed subject image has Deriving the position in the depth direction of the subject in the three-dimensional coordinates using an image position deriving unit that derives the position of the subject, and each image position derived by the image position deriving unit and predetermined photographing information of the photographing information. A first subject position deriving unit for performing the operation, a depth of field deriving unit that derives a depth of field of the camera using predetermined photographing information of the photographing information, and a deriving unit that derives the depth of field. Position determining means for determining whether or not the subject exists within the determined depth of field; and, when the subject is within the depth of field, determining the image position and the photographing position. An image conversion apparatus comprising: a second subject position deriving unit configured to derive horizontal and vertical positions in the three-dimensional coordinates of the subject using predetermined shooting information of the shadow information. 10. A stereo photographing method in which the same subject is photographed from different viewpoints whose eyes are parallel to each other,
And the focal length of the lens, the distance between the viewpoints, the shooting magnification, and the FNo. A readable recording medium on which an image conversion program for displaying a subject image stereo-photographed by a camera capable of recording each photographing information as a stereoscopic image on a display surface of a monitor is recorded, wherein each of the stereo-photographed frames is An image position deriving step of deriving a position of the subject image on planar coordinates, and three-dimensional coordinates of the subject using each image position derived in the image position deriving step and predetermined photographing information of the photographing information. A first subject position deriving step of deriving a position in a depth direction of the camera; a depth of field deriving step of deriving a depth of field of the camera using predetermined photographing information of the photographing information; A position determining step of determining whether or not the subject exists within the depth of field derived in the depth of field deriving step; A second subject position derivation for deriving a horizontal position and a vertical position in the three-dimensional coordinates of the subject using the image position and predetermined photographing information of the photographing information when the subject is within the depth of field; And a readable recording medium on which an image conversion program is recorded.