JPH10224821A - Compound-eye camera and video display system using the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide the compound-eye camera provided with a stereoscopic display function where no high display speed (frame rate) is required in the case of displaying a stereoscopic video image. SOLUTION: The compound-eye camera 1 is provided integrally with image pickup optical systems 2, 3 and a display device 4, two images having a parallax picked up by the image pickup optical systems 2, 3 are split as stripes in a horizontal direction and arranged alternately by one line each to be synthesized with a stripe image and the stripe synthesis image is displayed on the display device 4 by an incorporated display control section. The display device 4 is configured to be sequential stacks of a back light 5, an aperture mask 6 having a chequer opening, lenticular lenses 7, 8, a PDLC 9, a display picture element section 10 and a glass board 11, and different directivity is provided to a display of an odd numbered line and a display of an even numbered line of a strip image and a stereoscopic vision is obtained at a prescribed view position.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention
The present invention relates to a compound eye camera capable of capturing and displaying a two-dimensional image. Further, the present invention relates to a video display system using the compound eye camera.

[0002]

2. Description of the Related Art As a system for photographing and displaying a stereoscopic video, there is, for example, a stereoscopic television apparatus as disclosed in Japanese Patent Application Laid-Open No. 62-21396, which basically has parallax from a plurality of cameras. A set of images is obtained and stereoscopically displayed on a stereoscopic image display device dedicated to the system to provide a stereoscopic image to a photographer. Such a three-dimensional image display system generally has a configuration in which a camera for taking a picture and a display for displaying a three-dimensional picture are separated, and usually, after taking a picture by separating the camera from the display, Work such as displaying and editing a video on a display is performed.

As a method for obtaining a stereoscopic display, there is a method using a stereoscopic television system in which the polarization state is made different between the right-eye image and the left-eye image, and the left and right images are separated using polarized glasses. is there. Specifically, a liquid crystal shutter is provided on the display side to change the polarization state, and the polarization state is switched in synchronization with the field signal of the display image on the display. Separates images to enable stereoscopic viewing. However, in this method, there is an annoyance that the observer must always wear polarized glasses.

[0004] As a stereoscopic display system not using polarized glasses, there is a stereoscopic display system in which a lenticular lens is provided on the front surface of a display to spatially separate images entering left and right eyes. FIGS. 11A and 11B are explanatory diagrams of a stereoscopic display method using a lenticular lens. FIG. 11A is a cross-sectional view of a display pixel portion of a liquid crystal display as viewed from above a viewer, and FIG. 11B is a diagram illustrating a filter configuration of the display pixel portion. It is.

The display pixel section 60 shows a display pixel of a liquid crystal display, and here, a glass substrate, a color filter, an electrode, a polarizing plate, a backlight and the like are omitted.
As shown in FIG. 11B, the display pixel section 60 includes an opening 61 in which a color filter for forming a pixel is arranged, and a black matrix 62 for separating pixels. On the display surface of the liquid crystal display, there is provided a lenticular lens 63 composed of a cylindrical lens having a semicircular cross section and extending in a direction perpendicular to the plane of the paper, and the display pixel portion 60 of the liquid crystal display is located on the focal plane. It has become. The display pixel units 60 are arranged alternately so that the right-eye image (R) and the left-eye image (L) form a pair in a stripe shape corresponding to one pitch of the lenticular lens 63 as illustrated. Lenticular lens 63
And optically separated observer right eye E _R, the left eye E _L by being imaged, This enables stereoscopic vision.

FIG. 11 (a) shows only a spatial area where each of the right-eye image and the left-eye image can be observed by the lenticular lens at the center of the display. Similarly, there is also a spatial region separated to the left and right, and these regions overlap at the positions of the left and right eyes of the observer, so that the left and right images are uniformly separated and observed over the entire screen.

[0007] In addition to the above-mentioned stereoscopic display system,
And Japanese Patent Application Laid-Open No. 7-234459. As an example, FIG.
1 shows a basic configuration of a three-dimensional image display device disclosed in Japanese Patent Application Laid-Open Publication No. H10-26095.

The three-dimensional image display device comprises a light directivity switching device 72 comprising a matrix type surface light source 70 and a lenticular lens 71, and a transmission type display device 73. A stripe light source for the right eye (70 in FIG. 12B)
When (R) is lit, the image for the right eye (73R in FIG. 12C) is displayed in odd frames (fields) in synchronization with this, and a striped light source for the left eye (FIG.
When (70L) in (b) is lit, the image for the left eye (73L in FIG. 12 (c)) is displayed in an even-numbered frame (field) in synchronization with this, whereby each pixel is displayed in an even-numbered frame. (Field) and odd frame (field)
Can all be used according to In this case, there is no need to perform pixel division.

[0009]

As described above, conventionally, the compound eye camera and the stereoscopic display are separated from each other, and the compound eye camera itself is not provided with a function of displaying a stereoscopic image. So, usually,
After photographing with the compound-eye camera separated from the display, an operation of displaying and editing a video on the display has been performed. However, in such shooting work,
Whether or not a good three-dimensional image is obtained can be determined only at the time of editing, and it is difficult to easily obtain a good three-dimensional image. Therefore, it has been strongly desired to provide a compound-eye camera having a display function capable of checking a stereoscopic image on the spot while shooting.

In the conventional stereoscopic display system as described above, connection to a system using a personal computer, which is the mainstream of the current image system, is not considered. If you try to import it to your computer and display it, you need to build a new system,
The burden on the user increases.

In the case of providing a lenticular lens on the surface of a liquid crystal display as described above to obtain a three-dimensional view, the image quality is impaired due to surface reflection from the lens or the like, and the black matrix of the liquid crystal display becomes moire fringes. There is a problem that the image cannot be displayed in a good manner. Further, in a case where two parallax images of a right-eye image and a left-eye image are displayed in a time-division manner and stereoscopically viewed, image switching must be performed at high speed in order to solve the occurrence of flicker. There is. For example, "Television Society Journal", Isono et al., Vol. 4
1, No. 6, pp. 549-555, 1987,
According to the report, "conditions for establishing time-division stereoscopic vision" indicate that stereoscopic vision cannot be performed using a time-division method with a field (frame) frequency of 30 Hz. Furthermore, flicker when both eyes are alternately opened and closed is shown. The limit frequency at which no is perceived (referred to as the critical fusion frequency CFF) is about 5
5 Hz, which indicates that the field (frame) frequency needs to be at least 110 Hz in terms of flicker. As described above, the conventionally used display method has a problem that a display device capable of high-speed display is required as a transmissive display device.
From the above, when providing a three-dimensional display function in a compound-eye camera or a video display system, it is necessary to consider each problem in the above-described three-dimensional display method.

An object of the present invention is to solve the above-mentioned problems and to provide a compound eye camera having a stereoscopic display function which does not require a high display speed (frame rate) in displaying a stereoscopic video. is there. It is still another object of the present invention to provide a video display system capable of capturing and displaying a stereoscopic video on a personal computer.

[0013]

In order to achieve the above object, a compound eye camera according to the present invention comprises a plurality of image pickup means and an image which is divided into one or a plurality of scanning lines and displayed in a stripe form. A compound-eye camera having different directivities for display of odd-numbered lines and display of even-numbered lines of a stripe image, and a display means for obtaining a stereoscopic display at a predetermined observation position; The two images having parallax photographed by the imaging means are each divided into stripes in the horizontal direction, and alternately arranged line by line to be combined into a stripe image, and the combined stripe image is displayed on the display means. , A display control means for causing the display to be displayed.

In the above case, the display means has a self-luminous display element, and the display element forms a light emitting pattern for giving a different directivity between odd-line display and even-line display of the stripe image. The configuration may be as follows.

[0015] The display means may include an illumination light source, an opening mask having a checkerboard-shaped opening for transmitting light from the illumination light source, and an odd line of the stripe image for a light beam transmitted through the opening mask. And a first lenticular lens having different directivities corresponding to the even lines and a second lenticular lens having a viewing zone corresponding to each line of the stripe image with respect to a light beam transmitted through the first lenticular lens. The lenticular lens may include two lenticular lenses and liquid crystal display means for displaying the stripe image.

Further, storage means for holding the parallax images photographed by the plurality of imaging means is further incorporated.
The display control unit may be configured to combine the parallax images held in the storage unit into a stripe shape and display the resultant on the display unit.

Further, there is provided mode setting means for selectively setting a three-dimensional image photographing mode and a two-dimensional image photographing mode, and the display means has different directivity for displaying odd lines and displaying even lines. Stereoscopic image display to be performed and two-dimensional image display without directivity in displaying each line are configured to be possible, and when the stereoscopic image photographing mode is set, The parallax images captured by the above are combined in a stripe shape and displayed on the display means in a stereoscopic video mode. When a two-dimensional video shooting mode is set, the two-dimensional images captured by the plurality of imaging means are displayed on the display means. The means may be configured to display a two-dimensional image.

In the above case, the two-dimensional video shooting mode is a panoramic video shooting mode, and the display control means includes:
When the panoramic video shooting mode is set, the left and right images having the overlapped portion photographed by the plurality of image pickup units are horizontally aligned so that the overlapped portions are overlapped to form a panoramic image. May be configured to cause the display means to display a two-dimensional image.

Further, the mode setting means further has a function of selectively setting a recording mode and a reproduction mode, and a storage means for holding images photographed by the plurality of imaging means, and a recording mode being set. Then, the parallax image captured by the plurality of imaging units or 2 is stored in the storage unit.
Control means for reading the parallax image or the two-dimensional image held in the storage means when the playback mode is set, wherein the display control means stores the two-dimensional image from the storage means. The read parallax image or the two-dimensional image may be combined and displayed on the display unit.

In the above case, 2 stored in the storage means.
The two-dimensional image is a left and right image having an overlapped portion captured by the plurality of imaging units, and the display control unit is configured to read the left and right images having the overlapped portion from the storage unit. May be configured such that the left and right images are aligned in the horizontal direction so that the overlapped portions overlap each other to form a panoramic image, and the display unit displays the two-dimensional image on the display unit.

In any one of the above-described compound eye cameras, a digital interface connected to an external device via an interface cable is further incorporated, and the control means transmits the image synthesized by the display control means to the digital interface. May be configured to be transmitted via the Internet.

According to a second aspect of the present invention, there is provided a compound-eye camera comprising a plurality of image pickup means, wherein an image having a parallax is taken by the image pickup means. Image synthesizing means for synthesizing a striped image by alternately arranging the images, a digital interface connected to an external device via an interface cable, and an image synthesized by the image synthesizing means. The digital
And control means for transmitting the data via an interface.

In the above case, there is provided a mode setting means for selectively setting a three-dimensional image shooting mode and a two-dimensional image shooting mode, and the image synthesizing means is adapted to set the plurality of the plurality of images when the three-dimensional image shooting mode is set. When the two-dimensional video shooting mode is set, a two-dimensional composite image is obtained from the images shot by the plurality of imaging means. You may. In this case, the two-dimensional video shooting mode is a panoramic video shooting mode, and when the panoramic video shooting mode is set, the image synthesizing unit includes, when the panoramic video shooting mode is set, left and right sides having overlapping portions shot by the plurality of imaging units. The image may be configured to be a panoramic image in the horizontal direction such that the overlapping portions overlap.

In the compound eye camera according to the second aspect,
A storage unit for holding an image captured by the plurality of imaging units is further incorporated; the control unit reads an image from the storage unit; and combines the read image with the image combining unit; The digital
You may comprise so that it may transmit via an interface.

An image display system according to the present invention is an image display system in which any one of the above-described compound-eye cameras having a digital interface and a personal computer are connected via an interface cable. An image is divided for each one or a plurality of scanning lines and displayed in a stripe shape, and a stereoscopic display is obtained at a predetermined observation position by giving different directivities to display of the stripe image by odd lines and display by even lines. A stereoscopic display is provided, and a composite image transmitted from the compound-eye camera is displayed on the stereoscopic display.

In the above case, the compound-eye camera has a function of transmitting a photographed image or an image read from a storage device via an interface cable, is connected to the compound-eye camera via the interface cable, and has a parallax. When two images are transmitted, each image is divided into stripes in the horizontal direction, and the images are alternately arranged one by one to be combined into a stripe image, and the left and right images having an overlap portion are transmitted. If the personal computer is connected to the adapter via an interface cable, the personal computer is connected to the personal computer via an interface cable. The composite image sent from the adapter means is configured to be displayed on the stereoscopic display. Good.

According to the present invention as described above, since the compound-eye camera itself is provided with a display means capable of stereoscopic display, it is possible to confirm a stereoscopic image on the spot while taking a picture and adjust various parallaxes. Adjustments can be made.

Further, the display means displays the image in a stripe by dividing the image for each one or a plurality of scanning lines, and imparts different directivities to the display of the stripe image by the odd lines and the display by the even lines. Stereoscopic display is obtained at a predetermined observation position, and two parallax images of a right-eye image and a left-eye image are simultaneously displayed on a screen, so that a display speed (frame rate) of a stereoscopic image is obtained. Is slower than a conventional one that displays a parallax image in a time-division manner, which is １ ／.

Further, in the case where the display means is configured so that the light beam from the illumination light source illuminates the liquid crystal display means via a lenticular lens,
The luminous flux (image) illuminating the liquid crystal display means is observed, and no lens is provided on the entire surface of the liquid crystal display means as in the prior art. Therefore, at the time of stereoscopic display,
The image quality is not impaired by surface reflection from a lens or the like, and the black matrix of the liquid crystal display does not appear as moire fringes.

Furthermore, the compound eye camera of the present invention has a built-in digital interface connected to an external device via an interface cable, and divides two captured images having parallax into stripes in the horizontal direction. Since it is configured so that a composite image obtained by alternately arranging one line at a time and synthesizing it into a striped image is transmitted via a digital interface, it can be connected to a personal computer via an interface cable, The obtained stereoscopic image can be taken into a personal computer. According to the present invention, the display means capable of displaying the captured synthesized image in three dimensions on the personal computer side, that is, by giving different directivities to the display of the stripe image by the odd lines and the display of the even lines, the stereo image is displayed at a predetermined observation position. Since the display means for obtaining the display is provided, the captured composite image can be stereoscopically displayed on the personal computer side.

According to the present invention, in which a system using a personal computer can be constructed as described above, a user re-enters a stereoscopic image photographed by a compound eye camera when the user tries to display the stereoscopic image on the personal computer. There is no need to build a system.

Here, the display control means means for performing signal processing in a signal processing circuit of an embodiment described later and display control by an LCD control unit based on the result of the signal processing. Further, the image synthesizing means is means for performing signal processing in a signal processing circuit.

[0033]

Next, embodiments of the present invention will be described with reference to the drawings.

<Embodiment 1> FIG. 1 is a block diagram showing an embodiment of a compound eye camera according to the present invention. In FIG. 1, a compound-eye camera has a display in which a stereoscopic image and a two-dimensional image are displayed based on parallax images captured by the imaging optical systems 2 and 3 provided on the left and right, and the imaging optical systems 2 and 3. A device 4 is provided integrally, and a circuit (not shown) for controlling image display on the display device 4 is built therein.

Each of the imaging optical systems 2 and 3 has a lens barrel having a lens inside, and is disposed on the left and right sides to obtain a stereoscopic image or a panoramic image, so that the base line length can be increased. In the present embodiment, the imaging optical systems 2 and 3 are provided on the left and right sides of the display device 4, and their relative positional relationship is fixed. The display device 4 is rotatable in the tilt direction, so that the relative positional relationship between the imaging optical systems 2 and 3 does not change even if the display device 4 rotates in the tilt direction.

The display device 4 includes a backlight 5 serving as an illumination light source, an opening mask 6 formed with a mask pattern having a checkered aperture through which light passes, lenticular lenses 7, 8, PDLC (polymer dispersed liquid crystal). 9, a display pixel section 10 composed of a liquid crystal layer and a glass substrate 11 are sequentially superposed, and a stereoscopic image or a panoramic image can be displayed according to the setting mode. The mask pattern of the opening mask 6 is made of a metal deposition film such as chromium or a light absorbing material, and is formed by a known patterning on a mask substrate made of glass or resin. The lenticular lenses 7, 8 provided between the aperture mask 6 and the liquid crystal display pixel section 10 are transparent resin or glass microlenses, and are arranged orthogonal to each other. The configuration of the display device 4 shown in FIG. 1 does not include a polarizing plate, a color filter, an electrode, a black matrix, an antireflection film, and the like.

The stereoscopic display by the display device 4 is performed based on the following display principle called a rear barrier wrench method.

FIG. 2A is a view showing the display principle of a rear barrier wrench type display. The rear barrier wrench type display includes a backlight 901, a checkered mask 902, a lenticular lens A903, a lenticular lens B904, and a PDLC (polymer dispersed liquid crystal) 90.
5. It comprises a display LCD 906. First, backlight 9
The light is irradiated from the first through the check mask 902. This is to separate the left and right images from the display into irradiation light to be displayed with directivity. The separated irradiation light enters the lenticular lens 903 and the lenticular lens 904. The lenticular lens 903 has lenticular lenses arranged vertically. When light separated by the checkered mask 902 is incident on the lenticular lens 903, the light separated for displaying the right image is left on the display, that is, the right eye 907 of the observer. Towards the left, the light separated for displaying the left image refracts and travels toward the right of the display, that is, toward the left eye 908 of the observer. Similarly, the lenticular lens 904 has lenticular lenses arranged side by side. While the lenticular lens 903 separates the image in the left-right direction, the lenticular lens 904 plays a role of expanding the vertical viewing area. In this manner, the light is separated into light having directivity. On the other hand, the display LCD 90
Reference numeral 6 denotes one in the vertical scanning direction by the stereoscopic image display control unit.
The left pixel 910 and the right pixel 909 are arranged so as to line up every other line. Here the lenticular lens 90
3. PDLC 9 transmitted through lenticular lens 904
The right pixel 909 is displayed on the right side of the viewing zone for the observer, and the left pixel 910 is displayed on the left side of the viewing zone for the observer, of the pixels arranged in a stripe shape when irradiated through the pixel 05. The observer can observe a stereoscopic image.

Hereinafter, the operation principle of the PDLC 905 will be described. As shown in FIG. 2B, the PDLC 905 has a special polymer 912 including liquid crystal molecules 911 between electrodes 913, and the outside thereof is sandwiched by a base material 914. Here, when a voltage is applied between the electrodes, the liquid crystal molecules 911 in the special polymer 912 are in a transmission state. Therefore,
Lenticular lens 903, lenticular lens 9
Since the light having directivity on the left and right that has passed through 04 is transmitted as it is, the image on the display LCD 906 is separated to the left and right, and the observer can observe a stereoscopic image. On the other hand, when no voltage is applied, the liquid crystal molecules 911 in the special polymer 912 are in a scattering state. Therefore, the left and right directional lights passing through the lenticular lens 903 and the lenticular lens 904 lose their directivity, and the display LC
The image on D906 is displayed as a two-dimensional image. P
Display switching on the DLC 905 is controlled by a control signal from a stereoscopic image display control unit 802 in the PC 9. This switching is performed in units of windows, and a two-dimensional image and a three-dimensional image (stereoscopic image) can be switched and displayed on the display screen according to the setting mode.

In the compound eye camera 1 of the present embodiment configured as described above, the left and right images taken by the imaging optical systems 2 and 3 are temporarily stored in a storage device (not shown) in the body of the compound eye camera 1. After that, the data is transmitted from the storage device to the display device 4 as a video signal. In the display device 4,
A stereoscopic video or a panoramic video is displayed based on the video signals (left and right images) transmitted from the imaging optical systems 2 and 3 according to the setting mode.

In the case of the stereoscopic image photographing mode, left and right parallax images are photographed by the imaging optical systems 2 and 3, and the left and right parallax images are sent to the display device 4 as video signals. In the display device 4, the left and right parallax images are alternately arranged in the vertical direction in a horizontal stripe shape, the composite image in the stripe shape is displayed on the liquid crystal display pixel unit 10, and light from the backlight 5 is applied to each of the aperture masks 6. The liquid crystal display pixel unit 10 is illuminated through the openings and through the lenticular lenses 7, 8 and PDLC 9, respectively. In the illumination of the liquid crystal display pixel unit 10, an electric field is applied to the PDLC 9 (PDLC 9).
9 is in a transparent state. The left and right parallax images are separately observed by both eyes of the observer according to the display principle of the rear barrier wrench method described above, and a stereoscopic image is displayed.

In the case of the panoramic video shooting mode, left and right overlapping images are shot by the imaging optical systems 2 and 3, and these left and right images are displayed as video signals on the display device 4.
Sent to The display device 4 forms a panoramic image in which the left and right images are aligned in the horizontal direction so that the overlapped portion overlaps (the left or right image is used for the overlapping portion), and the panoramic image is displayed on the liquid crystal display pixel unit 10. Will be displayed. In the illumination of the liquid crystal display pixel section 10 in this panoramic image shooting mode, no electric field is applied to the PDLC 9 and the directional light is scattered by the liquid crystal molecules in the PDLC 9 and the liquid crystal display is distorted in a state where the directivity is lost. The pixel unit 10 is illuminated. Thus, the observer observes the panoramic image as a two-dimensional display.

The above-described display device 4 uses a self-luminous display element such as an LED, which forms a light-emitting pattern for giving different directivities to the display by the odd-numbered scanning lines and the display by the even-numbered scanning lines. You may comprise. In addition, the left pixel 910 and the right pixel 909 are arranged so as to be arranged every other line in the vertical scanning direction.
The right pixels 909 may be arranged.

As described above, in the compound-eye camera of the present embodiment, the images photographed by the imaging optical systems 2 and 3 are displayed on the display device 4 as stereoscopic images or panoramic images. Can be observed on the spot, and can also be observed while shooting. Further, since the display device 4 is configured to be rotatable in the tilt direction, the orientation of the display device 4 can be set to a direction in which the photographer can easily observe the stereoscopic image or the panoramic image at the optimal observation position. Can be observed.

Next, a specific configuration of the compound eye camera will be described in detail. FIG. 3 is a block diagram showing a specific configuration of the compound-eye camera shown in FIG.

CCD (Charge Coupled Device) 20
Reference numerals a and 20b denote image pickup devices constituting left and right image pickup optical systems 2 and 3 of the compound-eye camera 1, respectively. The drive of these is controlled by a CCD drive circuit 24. CCD 20a, 2
Left and right image signals from 0b are respectively CDS / AGC
(Correlated Double Sampling: Automatic gain control: automatic gain control) 2
1, 21b, the clamp circuits 22a and 22b, and the A / D conversion circuits 23a and 23b are input to the signal processing circuit 27. The drive circuit and the processing circuit for generating the left and right image signals are all timing generators 25.
Synchronization is achieved by the control of.

The signal processing circuit 27 includes a color processing circuit 26a,
26b, the process memories 31a and 31b, the compression / decompression circuit 32, and the VRAM 28, respectively.
The left and right image signals converted into digital signals by the A / D conversion circuits 23a and 23b are input to the color processing circuits 26a and 26b to perform a color conversion process, and the left and right digital images subjected to the color conversion processes The signal processing is performed such that the signal is converted into a predetermined pixel size and alternately transferred to the VRAM 28 one line at a time, and the image data is stored in the process memories 31a and 31b. Since the number of pixels of the image held in the process memories 31a and 31b and the number of pixels of the display image on the LCD 30 are not always the same as described later, the signal processing circuit 27 has A processing function for performing thinning and interpolation according to the difference in the number of pixels is also provided.

Liquid crystal display (LCD: Liquid cryst)
al display) 30 constitutes the display device 4 of the compound-eye camera 1, and is driven and controlled by the LCD control unit 29. The VRAM 28 is a display memory and has a sufficient capacity for an image displayed on the LCD 30.
The content written in the AM 28 is displayed on the LCD 30. The display control of the LCD 30 by the LCD control unit 29 is performed according to a setting mode (such as stereoscopic video shooting or panoramic video shooting).

The camera control section 40 is a section in which an input operation is performed by the photographer, and sets recording / reproduction of an image and various modes (for example, setting of a stereoscopic image shooting mode and a panoramic image shooting mode). This camera control unit 40
Is connected to the LCD control unit 29 and to the MPU 36 via the bus line 39.

The MPU 36 is connected to the process memories 31a and 31b, the compression / decompression circuit 32, and the recording medium 35 via the bus line 39.
The camera controller 40 is connected to the interface 34, the work memory 37, and the matching circuit 38, respectively.
Each part is controlled based on the setting input in. As the recording medium 35, various memories such as a magnetic tape, a magnetic disk, an optical disk, and a semiconductor memory can be used. Here, a flash memory is used.

The memory interface 34 saves the video signals held in the process memories 31a and 31b in a free area of the recording medium 35 as a file in a digital format, and registers the saved file in the file management area. Go. Further, the memory interface 34 checks the management area of the recording medium 35 and reads out registered file data.

Next, recording / reproduction in the compound eye camera will be described in detail. The compound eye camera of the present embodiment can set two shooting modes, that is, a stereoscopic video shooting mode and a panoramic video shooting mode, and these modes will be separately described below. There are two modes for storing images captured by the CCDs 20a and 20b: a frame storage mode in which storage is performed in units of frames, and a field storage mode in which storage is performed in units of fields (one frame is composed of two fields). However, here, the frame accumulation mode will be described as an example.

(1) Stereoscopic Image Shooting Mode When the photographer sets the stereoscopic image shooting mode in the camera control unit 40 and performs input such as recording and reproduction of an image, a signal corresponding to this input operation is transmitted to the camera control unit 40. To MPU36
The MPU 36 controls each unit.

First, the three-dimensional display of a photographed image will be described.

When photographing is performed by the imaging optical systems 2 and 3, the images formed by the CCDs 20a and 20b are photoelectrically converted, and the left and right parallax images are converted to CDS / AGC 21 and 21.
b, clamp circuits 22a, 22b, A / D conversion circuit 23
a and 23b are input to the signal processing circuit 27, respectively. The left and right parallax image signals input to the signal processing circuit 27 are synchronized by the control of the timing generator 25. Is performed.

The signal processing circuit 27 includes an A / D converter 23
The left and right parallax images converted into digital signals by the a and b are output to the respective color signal processing circuits 26a and 26b. In the color signal processing circuits 26a and 26b, known color conversion processing is performed on the input left and right parallax images, and the left and right parallax images subjected to the color conversion are converted into signal processing circuits 27.
Is entered again.

When the left and right parallax images subjected to the color conversion are input, the signal processing circuit 27 stores the image data relating to the left and right parallax images subjected to the color conversion in the process memory 3.
1a and 31b, and the left and right parallax images are converted to match the pixel size of the LCD 30.
An image interlaced and synthesized alternately line by line in VR
Write to AM28. By this processing, the CCD 20a,
The left and right parallax images from 20b are held in the process memories 31a and 31b and the VRAM 28, respectively.

FIG. 4 schematically shows the image synthesis by the signal processing circuit 27. The left image subjected to color conversion by the color signal processing circuit 26a has 640 × 480 (L0 to L479 lines) effective pixels as in the left image (a) shown in FIG. The color-converted right image is 640 × 48 like the right image (b) shown in FIG.
It has an effective pixel of 0 (line of R0 to R479). In the present embodiment, the left image (a) and the right image (b) are directly stored as image data in the process memories 31a and 31b via the signal processing circuit 27. The following image compression is performed.

First, the left image (a) and the right image (b) are, for example, 320 × 240 (L′ 0 to L′ 239 lines, R′0 to L × 0) compressed in half vertically and horizontally according to the display size of the LCD 30. R'239 line) compressed image (c),
(D). Such image conversion can be performed by simple thinning or interpolation processing. Subsequently, these compressed images (c) and (d) are referred to as "L'0, R'1, L '
2,. . . , R'237, L'238, R'239 "in this order, alternately for each line to generate a composite image (e). The generated composite image (e) is stored in the VRAM 28
Is written to.

When the combined image (e) relating to the left and right parallax images is written in the VRAM 28 as described above, LC
The composite image (e) written in the VRAM 28 by the D control unit 29 is alternately displayed on the LCD 30 (display device 4) for each scanning line. At the time of this display, since the shooting mode in the camera control unit 40 is set to the stereoscopic video shooting mode, the LCD control unit 29
An electric field is applied to. As a result, the photographer can observe the image photographed by the imaging optical systems 2 and 3 three-dimensionally on the LCD 30, and can see the stereoscopic image while photographing.

Next, recording of a photographed image will be described.
The recording of the photographed image is started when the photographer performs an input operation for starting image recording on the camera control unit 40, and the image data stored in the process memories 31a and 31b is stored in the recording medium 35. The MPU 36 performs the following processing.

When the photographer performs an input operation for starting image recording, a signal indicating the input operation is transmitted from the camera control unit 40 to the MPU 3.
Sent to 6. The MPU 36 first processes the process memory 3
Each of the image data held in 1a and 31b is read line by line through the signal processing circuit 27 and interlaced and synthesized, and the interlaced synthesized image is once held in the work memory 37. After that, the interlaced composite image held in the work memory 37 is sent to the compression / decompression circuit 32.
The compression / expansion circuit 32 performs a known compression process on the transmitted interlaced composite image. When the compression processing is completed, the MPU 36 stores the compressed image data in the work memory 37 again.

The process memory 3 is stored in the work memory 37.
When the interlaced combined images (compressed data) of the left and right image data held in 1a and 31b are held, M
The PU 36 stores the held interlaced composite image in the recording medium 35 through the memory interface 34. At the time of this data saving, the memory interface 34 saves the video signals held in the process memories 31a and 31b in a free area of the recording medium 35 as a file in a digital format, and registers the video signal in the file management area. Do. For example, in the left image, "s001
L. jpg ”and the right image are given file names such as“ s001R.jpg ”, and the left and right compressed images are registered as a pair, and identification information for identifying the pair is simultaneously registered in the file management area.

Next, reproduction of a recorded image will be described.
The reproduction of the recorded image is started by the photographer performing an input operation for starting the recorded image reproduction to the camera control unit 40, and the compressed data stored in the recording medium 35 is converted to L
This is performed by the following processing by the MPU 36 to be displayed on the CD 30.

When the photographer performs an input operation for starting recording image reproduction, the MPU 36 causes the file registration data stored in the recording medium 35 to be read through the memory interface 34. When reading this data,
The interface 34 first checks the management area of the recording medium 35, and sends all file registration data to the MPU 36.

When the file registration data is transmitted from the memory interface 34, the MPU 36 selects a file that can be reproduced as a stereoscopic video from all the transmitted file registration data, and displays a list of the selected file names in an arbitrary manner. It is arranged in a display format and sent to the signal processing circuit 27 as display data.

When the list of file name data is sent, the list of file name data is written into the VRAM 28 by the signal processing circuit 27, and the list of written file name data is
Will be displayed.

Here, when the photographer selects a file to be reproduced from the displayed list of file name data and performs an input operation on the camera control unit 40 to display an image relating to the selected file, the camera control unit 40 Sends a signal to that effect to the MPU 36. MPU36
Stores data about the selected file in memory
The file data is read from the recording medium 35 through the interface 34 and the read file data is stored in the work memory 37.
Transfer to

The file data transferred to the work memory 37 is transferred to the compression / decompression circuit 32 and subjected to decompression processing, then divided into left and right image data and transmitted to the process memories 31a and 31b, respectively. Can be The image data sent to the process memories 31a and 31b is subjected to the above-mentioned compression processing by the signal processing circuit 27 for adjusting to the display size of the LCD 30, then further subjected to image synthesis processing and written into the VRAM 28. . Then, the contents written in the VRAM 28 are read by the LCD control unit 29 in the same manner as in the above-described stereoscopic display.
Displayed at D30.

(2) Panoramic video shooting mode In the panoramic video shooting mode, the arrangement of the imaging optical systems 2 and 3 is different from that in the above-described stereoscopic video shooting mode. That is, the imaging optical systems 2 and 3 are arranged such that two left and right images that overlap each other are captured.

When the photographer sets the panoramic image shooting mode to the camera control unit 40 and performs input such as recording / reproduction of an image, a signal corresponding to the input is transmitted from the camera control unit 40 to the MPU 36, and the MPU 36 Each part is controlled.

First, the three-dimensional display of a photographed image will be described.

Until the two images photographed by the imaging optical systems 2 and 3 are input to the respective color processing circuits 26a and 26b, signal processing is performed in the same procedure as in the case of stereoscopic display in the stereoscopic image photographing mode described above. .

When the left and right images subjected to the color conversion are input to the signal processing circuit 27, the signal processing circuit 27 stores the image data regarding the left and right images subjected to the color conversion in the process memories 31a and 31b. At the same time, the panoramic image synthesized by arranging the overlapped portions of the left and right images side by side so as to overlap each other is further converted to fit the pixel size of the LCD 30 and written into the VRAM 28. This LC
In the conversion to the pixel size of D30, the image is reduced in the vertical direction. For example, when the overlap amount is 0, the left and right images are reduced to a size of, for example, 160 × 120, and synthesized so as to be arranged side by side, and the size is reduced to 320 × 120
To generate a panoramic image. Here, the detection of the amount of overlap between the left and right images when generating the panoramic image is performed by the signal processing circuit 27.

When the panoramic images related to the left and right images are written in the VRAM 28 as described above, the panoramic image written in the VRAM 28 by the LCD control unit 29 is displayed on the LCD 30 (display device 4). At the time of this display, the LCD control unit 29 does not apply an electric field to the PDLC 9 unlike the above-described three-dimensional display, because the shooting mode in the camera control unit 40 is set to the panoramic video shooting mode. Thus PD
If no electric field is applied to the LC 9, light having directivity before passing through the PDLC 9 will cause the PD 9 to pass through the PD 9 when passing therethrough.
The light is scattered by the liquid crystal molecules in the LC 9 and illuminates the liquid crystal display pixel section 10 in a state where the directivity is lost. Thus, the photographer can observe the panorama image as a two-dimensional display, instead of observing the image displayed on the LCD 30 separately from the left and right, and view the panorama image while taking a picture. be able to.

The recording and reproduction of the captured image in the panoramic video shooting mode are the same as those in the stereoscopic video shooting mode except that the signal processing circuit 27 performs a process of obtaining a panoramic image instead of the process of obtaining an interlaced composite image. Since almost the same processing is performed, the description of the processing is omitted here.

In the embodiment described above, the interlaced composition is such that the odd lines of the left image are the odd lines of the composite image,
Although the composition is such that the even-numbered lines of the right image are set to the even-numbered lines of the composite image, interlace combination can be performed in various combinations in addition to this. For example, as in Example 1 shown in FIG. 5, the interlaced composition may be such that the odd lines of the left image are the odd lines of the composite image and the odd lines of the right image are the even lines of the composite image. In addition, as an example of interlaced synthesis, an even line of the left image is used as an odd line of the composite image, and an even line of the right image is used as an even line of the composite image (FIG. 5).
Example 2), when the odd lines of the left image are combined as the even lines of the combined image and the even lines of the right image are combined as the odd lines of the combined image (example 3 in FIG. 5), the odd lines of the left image are combined with the odd lines of the combined image. There are cases such as combining even lines and odd lines of the right image as odd lines of the combined image (Example 4 in FIG. 5), and any of them can be applied. However, in the case where the right image is an odd line of the composite image (Example 3, Example 4, and Example 5 in FIG. 5), a checkered shape of the aperture mask 6 is set so that the right image is observed with the right eye of the observer. Use the one with the opening reversed.

In the compound-eye camera described above, if microphones are provided on the left and right along with each of the imaging optical systems 2 and 3, it is possible to reproduce a stereoscopic sound while displaying an image.

<Second Embodiment> In the description of the first embodiment, the image storage by the CCDs 20a and 20b has been described as the frame storage mode in which the image is stored in units of frames. A field accumulation mode in which accumulation is performed in units of (one field). FIG. 6 schematically shows image synthesis in the signal processing circuit 27 in the field accumulation mode.

In the case of the field accumulation mode, the left image of the parallax images color-converted by the color signal processing circuit 26a is 640 × 240 like the left image (a) shown in FIG.
(L0 to L239) effective pixels, and the right image is 640 × 24 like the right image (b) shown in FIG.
It has 0 (R0-R239) effective pixels. In the present embodiment, the left image (a) and the right image (b) are directly stored as image data in the process memories 31a and 31b via the signal processing circuit 27 in the same manner as in the frame accumulation mode described above. However, on the other hand, the following image compression is performed by the signal processing circuit 27.

First, the left image (a) and the right image (b) are halved only in the horizontal direction according to the display size of the LCD 30.
Compressed, 320 × 240 (L'0 to L'239, R '
0 to R′239) (c) and (d). Such image conversion can be performed by simple thinning or interpolation processing. Subsequently, these compressed images (c) and (d) are referred to as “L′ 0, R′1, L′ 2,.
R′237, L′ 238, R′239 ”are alternately combined for each line in this order to generate a combined image (e). The generated composite image (e) is
The data is written to the VRAM 28. The stereoscopic display based on the composite image (e) written in the VRAM 28 is the same as in the above-described frame accumulation mode.

<Embodiment 3> In the compound eye camera of each of the embodiments described above, the VRAM 28 has twice the capacity,
For example, as shown in FIG. 7, the interlace synthesis in the signal processing circuit 27 is performed as “L0, R0, L1, R1, L
2, R2,. . . L479, R479 "may be alternately combined from the left and right images without being thinned out line by line. In this case, a synthesized image having a size (640 × 960) twice as large as that of one of the captured images (640 × 480) is obtained.

<Embodiment 4> Here, a video display system in which a personal computer is connected to the compound eye camera of each of the above embodiments via an interface cable will be described. FIG. 8 is a configuration diagram showing an embodiment of the video display system.

In FIG. 8, the image display system comprises a compound eye camera 1 integrally provided with imaging optical systems 2 and 3 provided on the left and right and a display device 4 capable of stereoscopic display. Computer body 13 having a memory and a storage device and a three-dimensional display 12 as a peripheral device
And a personal computer composed of Here, the compound eye camera 1 has the same configuration as the compound eye camera shown in FIG. 1 described above.

The three-dimensional display 12 has the same configuration as the display device 4 of the compound-eye camera 1. That is, a backlight 5 'serving as an illumination light source, an opening mask 6' formed with a mask pattern having a checkered opening through which light passes, lenticular lenses 7 'and 8', PDLC
9 ', a display pixel portion 10' composed of a liquid crystal layer or the like, and a glass substrate 11 'are sequentially stacked.

In this video photographing / display system, a composite image or panoramic image interlaced and synthesized in the compound-eye camera 1 is transferred to the personal computer main unit 13, and the transfer data is transferred to the personal computer main unit 1.
3 is displayed on the stereoscopic display 12. Also on the display on the stereoscopic display 12, display using the rear barrier wrench method on the display device 4 of the compound eye camera 1 described above is performed, and stereoscopic video or panoramic video is displayed according to the setting mode. That is, in the case of displaying a three-dimensional image, an electric field is applied to the PDLC 9 ′ to display the combined images arranged alternately in a horizontal stripe in the vertical direction for each scanning line, and in the case of displaying a panoramic image, The transferred panoramic image is displayed without applying an electric field to the PDLC 9 '.

Next, a specific configuration of the stereoscopic video display system will be described in detail. FIG. 9 is a block diagram showing a specific configuration of the stereoscopic video display system shown in FIG.

In FIG. 9, each component of the compound-eye camera 1 has the same configuration as that shown in FIG.
Here, the description of the configuration is omitted. The digital interface (USB) 33 of the compound-eye camera 1 and the digital interface (US) of a personal computer
B) It is connected to 41 via an interface cable. The digital interface 41 is an ISA bus 50
The ISA bus 50 is connected to a PCI bus 51 via an ISA-PCI bridge circuit 42. The PCI bus 51 includes a memory 43 and an MPU 4
4 and the VRAM 45 are connected to each other.

The LCD 47 constitutes the three-dimensional display 12 of the personal computer shown in FIG.
Display control is performed by the CD control unit 46. VRAM45
Is a display memory similar to the VRAM 28 of the compound-eye camera 1 and has a sufficient capacity for image display.
The VRAM 45 is controlled by the display control by the control unit 46.
Is written on the LCD 47. In the display control by the LCD control unit 46, the stereoscopic video or the panoramic video is displayed according to the setting mode, as in the display control by the LCD control unit 29 in the compound-eye camera 1 described above.

Hereinafter, display control in this video display system will be described. Note that the shooting, recording, reproduction, and display of a stereoscopic image and a panoramic image in the compound-eye camera 1 are as described above, and thus description thereof is omitted here, and only display control in the personal computer will be described.

In the above-described stereoscopic video shooting mode, the work memory 37 of the compound-eye camera 1 holds an interlaced image, and the held image is stored in the digital interface 33 under the control of the MPU 36.
Is transmitted to the personal computer via the PC.

In the personal computer, the interlaced composite image transmitted from the compound-eye camera 1 is received via the digital interface 41 and recorded in the memory 43 via the ISA-PCI bridge circuit 42. The interlaced composite image recorded in the memory 43 is
Is transferred to the VRAM 45 under the control of. This MP
At the time of transfer to the VRAM 45 by the U44, a conversion process for matching the interlaced composite image to the display size of the stereoscopic display 12 is performed. In the case where compression processing is performed on the interlaced composite image transferred by the compound-eye camera 1, the personal computer performs decompression processing on the transferred interlaced composite image before adjusting the display size. Done.

When the interlaced composite image is transferred to the VRAM 45, the LCD 46 converts the interlaced composite image written in the VRAM 45 into the stereoscopic display 12 under the same control as the stereoscopic display control in the display device 4 of the compound-eye camera 1 described above. Display above. This allows the photographer to capture the image captured by the compound-eye camera 1 into a personal computer and observe the image three-dimensionally on the three-dimensional display 12.

Next, a case will be described in which image data recorded on the recording medium 36 of the compound-eye camera 1 is taken into a personal computer and observed on the stereoscopic display 12.

When the photographer performs an input operation to capture the recorded image reproduction into the personal computer and display it, M
The PU 36 causes the file registration data stored in the recording medium 35 to be read through the memory interface 34. When reading this data, the memory interface 34 first checks the management area of the recording medium 35,
All file registration data is sent to the MPU 36.

When the file registration data is transmitted from the memory interface 34, the MPU 36 selects a file that can be reproduced as a stereoscopic video from all the transmitted file registration data, and displays a list of the selected file names in an arbitrary manner. It is arranged in a display format and sent to the signal processing circuit 27 as display data.

When the list of the file name data is sent, the list of the file name data is written into the VRAM 28 by the signal processing circuit 27, and the list of the written file name data is
Will be displayed.

Here, when the photographer selects a file to be reproduced from the displayed list of file name data and performs an input operation on the camera control unit 40 to display an image relating to the selected file, the MPU 36 Data related to the selected file is read from the recording medium 35 through the memory interface 34, and the read file data is transferred to the work memory 37.
The file data transferred to the work memory 37 is transmitted to the personal computer via the digital interface 33 under the control of the MPU 36,
The stereoscopic display is performed by the same control as the stereoscopic display described above.

Next, a case where a panoramic image captured by the compound-eye camera 1 is transferred to a personal computer and displayed will be described.

In the panoramic video shooting mode, the work memory 37 of the compound-eye camera 1 holds an image obtained by combining left and right images into a panoramic image.
The control unit 6 sends the held composite image to the personal computer via the digital interface 33. In the personal computer, the panoramic composite image transmitted from the compound-eye camera 1 is received via the digital interface 41 and once recorded in the memory 43 via the ISA-PCI bridge circuit 42, and then the MPU
The data is transferred to the VRAM 45 under the control of 44. At the time of transfer to the VRAM 45 by the MPU 44, a conversion process is performed to adjust the panoramic composite image to the display size of the stereoscopic display 12.

When the panoramic composite image is transferred to the VRAM 45, the LCD controller 46 converts the panoramic composite image written in the VRAM 45 into a stereoscopic image under the same control as the panoramic video display control on the display device 4 of the compound eye camera 1 described above. It is displayed on the display 12. Thereby, the photographer can capture the image photographed by the compound-eye camera 1 into the personal computer and observe the panoramic image on the stereoscopic display 12.

As described above, in the video display system of the present embodiment, the video (stereoscopic video or panoramic video) photographed by the compound-eye camera 1 can be observed on the spot by the display device 4 provided in the compound-eye camera 1. Can be taken into a personal computer and observed on the three-dimensional display 12.

<Embodiment 5> In the above-described video shooting / display system, an image interlaced and synthesized in the compound-eye camera 1 is transferred to a personal computer. May be performed. The specific configuration is shown in FIG.

In FIG. 10, the video shooting / display system has the same configuration as that shown in FIG. 9 except that a 3D adapter 80 is provided. In the drawings, the same components are denoted by the same reference numerals.

The 3D adapter 80 is connected to the digital interface (USB) 33 of the compound-eye camera 1 and the digital interface (USB) 4 of the personal computer.
1, a digital interface (USB) 81 connected via an interface cable, a memory 82 for holding image data received via the digital interface 81, and image data recorded on the memory 82. And an image synthesizing circuit 83 for performing a process of synthesizing an interlaced image or a panoramic image.

In the video shooting / display system according to the present embodiment, the photographer inputs an operation to start video recording by the camera control unit 4.
0, the MPU 36 first sets the process memory 3
The image data is sent to the 3D adapter 80 via the digital interface (USB) 33 without interlacing the image data from 1a. In the 3D adapter 80, the image data (not interlaced) transmitted from the compound-eye camera 1 is received via the digital interface 81, and the image data is held in the memory.
When the image data is held in the memory 82 from the process memory 31a, the MPU 36 subsequently performs the 3D processing via the digital interface (USB) 33 without interlacing the image data from the process memory 31b.
Send to adapter 80. In the 3D adapter 80, the transmitted image data is transmitted to the digital interface 81.
, And the image data is stored in the memory 82. Each image data held in the memory 82 is sent to the image synthesizing circuit 83, interlaced and synthesized by the image synthesizing circuit 83, and then held again in the memory 82. The interlaced composite image stored in the memory 82 is sent to the personal computer via the digital interface 81.

On the personal computer side, the image data (interlaced composite image) transmitted from the 3D adapter 80 is received via the digital interface 81, and stereoscopic display is performed in the same manner as in the above-described fourth embodiment. .

In the case of the panoramic video shooting mode, left and right image data overlapping with each other are sent from the process memories 31a and 31b to the memory 82 of the 3D adapter 80, and the left and right image data are sent to the image synthesizing circuit 83. Are combined into a panoramic image. On the personal computer side, the image data (panoramic image) transmitted from the 3D adapter 80 is received via the digital interface 81, and the panoramic video is displayed in the same manner as in the fourth embodiment.

[0109]

According to the present invention configured as described above, a stereoscopic image can be confirmed on the spot while shooting, and various adjustments such as adjustment of parallax can be performed. There is an effect that it can be obtained.

In addition, during the three-dimensional display, the image quality is not impaired by surface reflection from a lens or the like, and the black matrix of the liquid crystal display does not appear as moiré fringes. There is an effect that it can be obtained.

Furthermore, since the display speed (frame rate) of the stereoscopic video is half that of the conventional method for displaying parallax images in a time-division manner, there is no need for a display device capable of high-speed display. is there.

Furthermore, since a two-dimensional image can be displayed, it is possible to provide a compound eye camera and a video display system having compatibility between the two-dimensional image and the three-dimensional image.

Further, it is possible to realize a video display system having each of the above-mentioned effects, which can capture and display a stereoscopic video taken by a compound-eye camera on a personal computer.

[Brief description of the drawings]

FIG. 1 is a configuration diagram showing one embodiment of a compound eye camera of the present invention.

2A is a diagram illustrating a display principle of a rear barrier wrench type display, and FIG. 2B is a diagram illustrating an operation principle of a PDLC.

FIG. 3 is a block diagram showing a specific configuration of the compound eye camera shown in FIG.

FIGS. 4A to 4E are schematic diagrams for explaining image synthesis by a signal processing circuit.

FIG. 5 is a diagram illustrating an example of interlace synthesis.

FIGS. 6A to 6E are schematic diagrams for explaining image synthesis in a signal processing circuit in a field accumulation mode.

FIG. 7 is a schematic diagram for explaining another example of image synthesis by the signal processing circuit.

FIG. 8 is a configuration diagram showing one embodiment of a video display system of the present invention.

FIG. 9 is a block diagram showing a specific configuration of the stereoscopic video display system shown in FIG.

FIG. 10 is a block diagram illustrating an example of interlace synthesis using an adapter.

11A and 11B are explanatory diagrams of a stereoscopic display method using a lenticular lens, wherein FIG. 11A is a cross-sectional view of a display pixel portion of a liquid crystal display as viewed from above a viewer, and FIG. 11B is a diagram illustrating a filter configuration of the display pixel portion. FIG.

FIGS. 12A to 12C are diagrams showing a basic configuration of a stereoscopic image display device disclosed in Japanese Patent Application Laid-Open No. 7-234459.

[Explanation of symbols]

 Reference Signs List 1 compound eye camera 2 imaging optical system 3 imaging optical system 4 display device 5 backlight 6 aperture mask 7 lenticular lens 8 lenticular lens 9 PDLC 10 display pixel section 11 glass substrate

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Nao Kurahashi 3-30-2 Shimomaruko, Ota-ku, Tokyo Inside Canon Inc.

Claims (15)

[Claims] An image is divided into one or more scanning lines and displayed in the form of a stripe, and different directivities are displayed for displaying odd lines and even lines of the stripe image. And a display means for obtaining a stereoscopic display at a predetermined observation position, wherein the compound eye camera is integrally formed, and two images having parallax taken by the plurality of image pickup means are respectively arranged in a horizontal direction. Divided into stripes,
A compound-eye camera, comprising display control means for alternately arranging lines one by one to synthesize a striped image and displaying the striped synthesized image on the display means. 2. The compound-eye camera according to claim 1, wherein the display means has a self-luminous display element, and the display element displays the stripe image in different directions for displaying odd-numbered lines and displaying even-numbered lines. A compound eye camera characterized in that it forms a light emitting pattern having a property. 3. The compound-eye camera according to claim 1, wherein the display means includes: an illumination light source; an opening mask having a checkered opening through which light from the illumination light source passes; and a light flux transmitted through the opening mask. A first lenticular lens having different directivities corresponding to odd and even lines of the stripe image; and a light beam transmitted through the first lenticular lens, for each of the stripe images. A compound-eye camera comprising: a second lenticular lens for providing a viewing zone corresponding to a line; and a liquid crystal display for displaying the stripe image. 4. The compound-eye camera according to claim 1, further comprising a storage unit for storing parallax images taken by the plurality of imaging units, and wherein the display control unit is stored in the storage unit. A compound-eye camera, wherein a parallax image is synthesized in a stripe shape and displayed on the display unit. 5. The compound eye camera according to claim 1, further comprising: mode setting means for selectively setting a stereoscopic image shooting mode and a two-dimensional image shooting mode, wherein the display means displays odd lines and even numbers. A stereoscopic video display having different directivity from the line display and a two-dimensional video display having no directivity in the display of each line are configured to be possible. When set, the parallax images captured by the plurality of imaging units are combined in a stripe shape to display a stereoscopic video on the display unit, and when the two-dimensional video shooting mode is set, the plurality of imaging units are set. A two-dimensional image displayed by the display means on the display means. 6. The compound-eye camera according to claim 5, wherein the two-dimensional video shooting mode is a panoramic video shooting mode, and the display control unit is configured to perform the plurality of imaging when the panoramic video shooting mode is set. The left and right images having the overlapped portion photographed by the means are aligned in the horizontal direction so that the overlapped portions overlap each other to form a panoramic image, and the panoramic image is displayed on the display means in a two-dimensional image. Compound eye camera. 7. The compound-eye camera according to claim 5, wherein the mode setting unit further has a function of selectively setting a recording mode and a reproduction mode, and holds images captured by the plurality of imaging units. When a recording mode is set, the storage means stores a parallax image or a two-dimensional image captured by the plurality of imaging means, and when a reproduction mode is set, the storage means stores the parallax image or the two-dimensional image. Control means for reading out the read parallax image or two-dimensional image, and the display control means combines the parallax image or the two-dimensional image read from the storage means and displays it on the display means A compound eye camera characterized in that 8. The compound-eye camera according to claim 7, wherein the two-dimensional image stored in the storage unit is a left and right image having an overlapped portion captured by the plurality of imaging units. When the left and right images having the overlap portion are read from the storage unit, the left and right images are laterally aligned such that the overlap portion overlaps to form a panorama image, and the panorama image is A compound eye camera, wherein the display means displays a two-dimensional image. 9. The compound eye camera according to claim 1, further comprising a digital interface connected to an external device via an interface cable, wherein said control means is synthesized by said display control means. A compound-eye camera, wherein the image is transmitted through the digital interface. 10. A compound eye camera comprising a plurality of image pickup means, wherein an image having parallax is taken by said image pickup means, wherein each of the images having parallax taken by said image pickup means is divided into stripes in a horizontal direction, Image synthesizing means for alternately arranging striped images, a digital interface connected to an external device via an interface cable, and an image synthesized by the image synthesizing means via the digital interface And a control means for transmitting the data. 11. The compound-eye camera according to claim 10, further comprising: mode setting means for selectively setting a stereoscopic image photographing mode and a two-dimensional image photographing mode; When set, the parallax images captured by the plurality of imaging units are combined in a stripe shape, and when the two-dimensional video shooting mode is set, two-dimensional images are captured from the images captured by the plurality of imaging units. A compound-eye camera characterized by obtaining a composite image. 12. The compound-eye camera according to claim 11, wherein the two-dimensional video image capturing mode is a panoramic video image capturing mode, and the image synthesizing unit is configured to output the plurality of images when the panoramic video image capturing mode is set. A left-right image having an overlap portion photographed by the means is horizontally aligned so that the overlap portion overlaps to form a panoramic image. 13. The compound-eye camera according to claim 10, further comprising a storage unit for holding images captured by the plurality of imaging units, and wherein the control unit reads the image from the storage unit. Wherein the read image is synthesized by the image synthesizing means, and the synthesized image is transmitted through the digital interface. 14. The ninth, tenth to thirteenth aspects of the present invention.
An image display system in which the compound eye camera according to any one of the above and a personal computer are connected via an interface cable, wherein the personal computer has a stripe in which an image is divided for each one or a plurality of scanning lines. A stereoscopic display having different directivities for displaying odd-numbered lines and displaying even-numbered lines of the stripe image, and providing a stereoscopic display at a predetermined observation position, and a composite image transmitted from the compound-eye camera. Is displayed on the stereoscopic display. 15. The video display system according to claim 14, wherein the compound-eye camera has a function of transmitting a captured image or an image read from a storage device via an interface cable, and the compound-eye camera and the interface cable When two images having parallax are transmitted, each image is divided into stripes in the horizontal direction, and the images are alternately arranged line by line to be combined into a stripe image.
When left and right images having an overlapped portion are transmitted, the image processing apparatus further includes adapter means for combining each image into a panoramic image so that the overlapped parts are overlapped with each other in a horizontal direction. And a video display system connected to the stereoscopic display via the interface cable and displaying the composite image transmitted from the adapter means.