JP2013090180A - Stereoscopic image photographing/displaying apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a stereoscopic image where stereoscopic effect has been enhanced.SOLUTION: A stereoscopic image photographing/displaying apparatus includes: a left eye corresponding photographing part 10L for photographing a subject to thereby generate left eye corresponding photographic data corresponding to a left eye; a right eye corresponding photographing part 10R for photographing the subject while setting an inter-optical axis distance from a photographing optical axis of the left eye corresponding photographing part 10L at a predetermined distance to thereby generate right eye corresponding photographic data corresponding to a right eye; a left eye image area extracting part 20 L for extracting a rectangular image area from left eye corresponding image data to thereby generate left eye image area data; a right eye image area extracting part 20R for extracting a rectangular image area from right eye corresponding image data to thereby generate right eye image area data; an image synthesizing part 30 for synthesizing the left eye image area data and the right eye image area data with each other to thereby generate synthetic image data; and an image presenting part 40 for displaying the synthetic image data, presenting the left eye image area data contained in the synthetic image data so as to correspond to the left eye, and presenting the right eye image area data contained in the synthetic image data so as to correspond to the right eye.

Description

  The present invention relates to a stereoscopic video shooting and display device.

  In order to obtain a three-dimensional effect equivalent to the visual three-dimensional effect obtained from the retinal image captured by the observer with both eyes, the distance between the optical axes of the photographic optical systems of each of the two imaging devices is There is known a stereoscopic video imaging apparatus set to about 65 mm, which is equivalent to the standard center-to-center distance of both eyes (see, for example, Patent Document 1). According to this stereoscopic image capturing apparatus, the field of view for the subject in photographing and the field of view on the display screen of the photographed image are approximately the same in resolution.

  In addition, as the distance between the observer and the object to be observed increases, the stereoscopic effect of the object perceived by the observer becomes weaker. Similarly, even if the distance between the observer and the object is constant, the stereoscopic effect of the object perceived by the observer becomes weaker as the distance between the eyes of the observer becomes narrower.

JP 2001-147401 A

There is a desire to improve the amusement by enhancing the sense of reality in entertainment facilities that allow viewers to view stereoscopic images. In addition, there is a demand for obtaining the depth with high accuracy in the field of video surveillance in which monitoring is performed using stereoscopic video. In the medical field, for example, there is a demand for taking a detailed state of laparotomy as a stereoscopic image and using it for surgery and medical education.
That is, there is a problem that it is desired to acquire a stereoscopic video with a more enhanced stereoscopic effect.
The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a stereoscopic video shooting and display device that obtains a stereoscopic video with enhanced stereoscopic effect.

[1] In order to solve the above-described problem, a stereoscopic video shooting and display device according to an aspect of the present invention captures a subject and generates left-eye corresponding shooting data corresponding to the left eye of the user. A distance between the optical axes of the photographing unit and the photographing optical axis of the left-eye photographing unit is provided as a predetermined distance, and the subject is photographed to generate right-eye photographing data corresponding to the right eye of the user. A left eye that captures the left-eye corresponding photographing data generated by the right-eye corresponding photographing unit and the left-eye corresponding photographing unit, extracts a rectangular image region from the left-eye corresponding video data, and generates left-eye image region data. A right-eye image that captures the right-eye-captured shooting data generated by the video-region extraction unit and the right-eye-capable shooting unit, extracts a rectangular video region from the right-eye-corresponding video data, and generates right-eye video region data A region extraction unit and a left eye image region extraction unit Capturing the left-eye video area data and the right-eye video area data generated by the right-eye video area extraction unit, and generating the synthesized video data by combining the left-eye video area data and the right-eye video area data And the composite video data generated by the video composite unit is displayed to display the composite video data, and the left eye video area data included in the composite video data corresponds to the left eye of the user And a video presentation unit that presents the right-eye video region data included in the composite video data in correspondence with the right eye of the user.
Here, the left-eye corresponding photographing unit and the right-eye corresponding photographing unit are provided so that a parallax is generated between the left-eye corresponding photographing video data and the right-eye corresponding photographing video data. Specifically, for example, the optical axis (imaging optical axis) of the imaging optical system of the imaging unit corresponding to the left eye is parallel to the optical axis of the imaging optical system of the imaging unit corresponding to the right eye, or convergence (the imaging unit corresponding to the left eye and The distance between the optical axes in the imaging optical system (inter-optical axis distance) is about 65 mm, which is the standard center-to-center distance between both human eyes. The left-eye imaging unit and the right-eye imaging unit are provided so that the distance is 5 times to about 10 times or more.
[2] In the stereoscopic video shooting and display device according to [1], the direction of the video presentation unit is detected, and the left eye video region extraction unit and the right eye video region extraction unit are respectively based on the direction. A left-eye image region extraction unit that determines a cut-out position of a rectangular video region to be extracted and supplies the cut-out position to the left-eye video region extraction unit and the right-eye video region extraction unit; The video area extraction unit takes in the cut-out position supplied from the cut-out position designation unit, extracts a rectangular video area from the left-eye corresponding video data based on the cut-out position, and extracts the right-eye video area The unit captures the cut-out position supplied from the cut-out position specifying unit, and extracts a rectangular video area from the right-eye corresponding video data based on the cut-out position.
Here, the cut-out position designation unit takes in the pan direction and tilt direction of the video display unit and the movement amount for each direction as movement information from an external direction sensor, and cuts out a rectangular video area based on the movement information. Determine the position. Alternatively, the cut-out position designation unit takes in movement information corresponding to the pan operation and the tilt operation from the direction operation unit such as a lever or a button. That is, the movement information is information indicating the physical direction of the video display device 200.

  According to the present invention, it is possible to obtain a stereoscopic image in which the stereoscopic effect is emphasized.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a perspective view showing an outline appearance of a stereoscopic video shooting and display device that is a first embodiment of the present invention. It is a block diagram which shows the function structure of the three-dimensional video imaging | photography display apparatus in the same embodiment. It is a figure which shows typically the rectangular video area | region extracted from the frame image of a left-eye corresponding | compatible imaging | video image | video by the left eye image | video area extraction part based on the cutting position designated by the cutting position designation | designated part. 4 is a schematic timing chart of synthesized video data and control signals generated by a video synthesis unit in the embodiment. FIG. 2 is a schematic schematic cross-sectional view of the video presentation unit as viewed from above in the same embodiment. It is a block diagram which shows the function structure of the stereoscopic video imaging | photography display apparatus which is 2nd Embodiment of this invention. FIG. 2 is a schematic schematic cross-sectional view of the video presentation unit as viewed from above in the same embodiment. It is a block diagram which shows the function structure of the stereo image imaging | photography display device which is 3rd Embodiment of this invention. It is a figure which shows typically the structure of the frame image in the synthetic | combination video data which a video synthetic | combination part produces | generates. FIG. 2 is a schematic schematic cross-sectional view of the video presentation unit as viewed from above in the same embodiment. It is a block diagram which shows the function structure of the three-dimensional video imaging | photography display apparatus which is 4th Embodiment of this invention. FIG. 2 is a schematic schematic cross-sectional view of the video presentation unit as viewed from above in the same embodiment.

Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings.
[First Embodiment]
FIG. 1 is a perspective view showing an outline of the appearance of a stereoscopic video shooting and display apparatus according to the first embodiment of the present invention. As shown in the figure, the stereoscopic video shooting and display device 1 includes a shooting device 100 and a video display device 200. The imaging device 100 is a stereo imaging device (binocular imaging device) including a left-eye imaging unit 10L and a right-eye imaging unit 10R. The positional relationship between the left-eye imaging unit 10L and the right-eye imaging unit 10R will be described later.

The imaging device 100 is fixed with respect to the ground. Specifically, the left-eye corresponding imaging unit 10L is fixed to the other end of the column 301 having one end fixed to the ground so that the axis of the column is substantially vertical (including vertical, the same applies hereinafter). Further, the right-eye imaging unit 10R is fixed to the other end of the column 302 having one end fixed to the ground so that the column axis is substantially vertical.
The video display device 200 is movably supported by the support column 400. The video display device 200 can change the direction by a panning operation centered on the axis of the support column 400 (a chain line in FIG. 1) and a tilting operation centered on an axis orthogonal thereto. The video display device 200 realizes a pan operation and a tilt operation by a manual operation by a user (observer, viewer, etc.), and uses a pan direction, a tilt direction, and a movement amount (for example, a rotation angle) for each direction as movement information. get.

  The stereoscopic video shooting and display device 1 is applied to, for example, a landscape observation device for observing scenic scenery, an appreciation device for watching a game in a stadium, a monitoring device for monitoring a monitoring area, and the like.

FIG. 2 is a block diagram showing a functional configuration of the stereoscopic video shooting and display apparatus 1.
In the figure, an imaging device 100 captures a subject and captures left-eye-corresponding captured video data corresponding to the left eye of the user of the stereoscopic image capturing and display device 1 and a right-eye corresponding to the right eye of the user. Shooting video data is generated, and the left-eye corresponding shooting video data and the right-eye corresponding shooting video data are supplied to the video display device 200. Specifically, the imaging apparatus 100 captures a subject and generates a left-eye-capable shooting video data 10L, and a right-eye support that captures the subject and generates a right-eye-captured shooting video data. And an imaging unit 10R.

  The left-eye imaging unit 10L and the right-eye imaging unit 10R are video camera devices having an equivalent imaging function. Each of the left-eye corresponding captured video data generated by the left-eye corresponding capturing unit 10L and the right-eye corresponding captured video data generated by the right-eye corresponding capturing unit 10R is, for example, ultra-high-definition image data. Specifically, the super high-definition video is a super high-definition video having a resolution of horizontal 7680 pixels × vertical 4320 pixels, a digital cinema video having a resolution of horizontal 4096 pixels × vertical 2160 pixels, or the like.

  The left eye corresponding photographing unit 10L and the right eye corresponding photographing unit 10R are provided so that a parallax is generated between the left eye corresponding photographing video data and the right eye corresponding photographing video data. Specifically, for example, the optical axis (imaging optical axis) of the imaging optical system of the left-eye imaging unit 10L and the optical axis of the imaging optical system of the right-eye imaging unit 10R are parallel or converged (left-eye imaging unit). 10L and the right-eye imaging unit 10R in front of each other), and the distance between the optical axes in the imaging optical system (the distance between the optical axes) is about 65 mm, which is the standard center-to-center distance between the human eyes. On the other hand, the left-eye imaging unit 10L and the right-eye imaging unit 10R are provided so that the distance is about 5 times to about 10 times or more.

When the distance between the optical axes of the left-eye imaging unit 10L and the right-eye imaging unit 10R is constant, the longer the distance between the imaging device 100 and the subject, the longer the left-eye imaging data and the right-eye imaging data. The parallax obtained from Further, when the distance between the photographing apparatus 100 and the subject is constant, the longer the distance between the optical axes of the left-eye corresponding photographing unit 10L and the right-eye corresponding photographing unit 10R, the longer the left-eye corresponding photographing video data and the right-eye corresponding photographing. The parallax obtained from the video data increases.
Accordingly, the left-eye corresponding photographing unit 10L and the right-eye corresponding photographing unit 10R are assumed in accordance with the distance between the three-dimensional image photographing display device 1 and the subject, which is assumed depending on the installation environment, usage, purpose of use, and the like of the three-dimensional image photographing display device 1. The distance between the optical axes is determined.

  The video display device 200 takes in the left-eye-capable photographic video data and the right-eye-captured photographic video data supplied from the photographic device 100, and forms a rectangular video area from each of the left-eye-capable photographic video data and the right-eye photographic video data. Extract and synthesize and display these rectangular video areas. However, the video display device 200 determines the position of the rectangular video region in the frame image of the captured video according to the amount of change in the direction of the video display device 200 with respect to a predetermined reference direction.

  The video display device 200 includes a left-eye video region extraction unit 20L, a right-eye video region extraction unit 20R, a video composition unit 30, a video presentation unit 40, and a cut-out position designation unit 50 as functional configurations. .

The left-eye video region extraction unit 20L takes in the left-eye-corresponding photographic video data supplied from the left-eye-corresponding photographing unit 10L of the photographing apparatus 100, and takes in the cut-out position signal supplied from the cut-out position designation unit 50. . The cut-out position signal is a signal indicating the cut-out position of a rectangular video region cut out from each of the left-eye-corresponding captured video data and the right-eye-capable captured video data. The cutout position is, for example, a cutout start point (reference point) in the frame image of the captured video.
The left-eye video region extraction unit 20L, based on the cut-out position indicated by the cut-out position signal, is a rectangular video region corresponding to the maximum number of pixels that can be displayed by the video presentation unit 40 from the left-eye-captured video data. A rectangular video area corresponding to a smaller number of pixels is extracted, and data of this video area is supplied to the video composition unit 30 as left-eye video area data.

The right-eye video region extracting unit 20R takes in the right-eye-captured video data supplied from the right-eye-capturing photographing unit 10R of the photographing apparatus 100, and takes in the cut-out position signal supplied from the cut-out position specifying unit 50. .
The right-eye video region extraction unit 20R uses a rectangular video region corresponding to the maximum number of pixels that can be displayed by the video presentation unit 40 based on the cut-out position indicated by the cut-out position signal. A rectangular video area corresponding to a smaller number of pixels is extracted, and the video area data is supplied to the video composition unit 30 as right-eye video area data.

  As described above, the left-eye video area extraction unit 20L and the right-eye video area extraction unit 20R extract (cut out) a rectangular video area from the left-eye-captured video data and the right-eye-captured video data. The parallax between the rectangular image area corresponding to the eye and the rectangular image area corresponding to the right eye is larger than the parallax between the captured image corresponding to the left eye and the captured image corresponding to the right eye. Therefore, the stereoscopic video provided by the video presentation unit 40 is a video with a more enhanced stereoscopic effect.

  The video composition unit 30 takes in the left eye video region data supplied from the left eye video region extraction unit 20L, and takes in the right eye video region data supplied from the right eye video region extraction unit 20R. The video composition unit 30 then synthesizes the left-eye video region data and the right-eye video region data in the time direction to generate composite video data. Specifically, the video compositing unit 30 generates composite video data in which the frame images of the left eye video area data and the right eye video area data are rearranged alternately and in time series.

Further, the video composition unit 30 generates a control signal for causing the video presentation unit 40 to display the composite video. The control signals in the present embodiment are a left-eye shutter control signal and a right-eye shutter control signal. The left-eye shutter control signal is a signal for controlling opening / closing of the left-eye shutter corresponding to the left eye of the user. The right-eye shutter control signal is a signal that controls opening and closing of the right-eye shutter corresponding to the right eye of the user. Details of the control signal, the left-eye shutter, and the right-eye shutter will be described later.
The video composition unit 30 supplies the composite video data and the control signal to the video presentation unit 40.

  The video presentation unit 40 captures the composite video data supplied from the video synthesis unit 30, displays the composite video, and presents the left-eye video region data included in the composite video data corresponding to the left eye of the user, The right eye image area data included in the composite image data is presented in correspondence with the right eye of the user. Specifically, the video presentation unit 40 takes in the synthesized video data and the control signal supplied from the video synthesis unit 30, displays the synthesized video, and controls the opening / closing of the left-eye shutter and the right-eye shutter. A detailed configuration of the video presentation unit 40 will be described later.

The cut-out position designation unit 50 takes in the pan direction and tilt direction of the video display device 200 and the movement amount for each direction as movement information from an external direction sensor, and cuts out the rectangular video area based on the movement information. To decide. That is, the movement information is information indicating the physical direction of the video display device 200. Based on the captured movement information, the cutout position designation unit 50 sets the pan direction and the tilt direction in the horizontal direction and the vertical direction of the frame image of the captured video data (left-eye-captured video data and right-eye-captured video data). Associate. Then, the cutout position designation unit 50 determines a position corresponding to the movement amount from the center position of the frame image as the cutout position.
The cut position specifying unit 50 generates a cut position signal indicating the cut position, and supplies the cut position signal to the left eye video region extracting unit 20L and the right eye video region extracting unit 20R.

FIG. 3 is a diagram schematically showing a rectangular video region extracted from the frame image of the left-eye-captured video image by the left-eye video region extraction unit 20L based on the cut-out position designated by the cut-out position designation unit 50. It is.
The figure shows an example of video region extraction by the left-eye video region extraction unit 20L, but the video region extraction by the right-eye video region extraction unit 20R is similarly performed. Therefore, here, an example of the left eye will be described, and description of the example of the right eye will be omitted.

  In FIG. 3, a frame image F is a frame image in the left-eye-captured captured video data, and is an ultra-high-definition image having a resolution of horizontal 7680 pixels × vertical 4320 pixels. The position O (O) is a cut-out position of the video area Ps corresponding to the shooting reference direction, for example, the center position of the frame image F. When the upper left corner of the frame image F is the origin (0, 0) and the two-dimensional coordinate system in the horizontal and vertical directions is applied to the frame image F, the coordinate value of the position O (O) is (3840, 2160). . The video area Ps is a rectangular video area centered on the position O (O). The position S is a cut position specified by the cut position specifying unit 50. For example, the coordinate value of the position S is (5600, 1000). The video area Pe is a rectangular video area centered on the position S. The video area Ps and the video area Pe are areas of high-definition video having a resolution of horizontal 1920 pixels × vertical 1080 pixels. In the example in the figure, the amount of change from the position O (O) to the position S is 1760 pixels wide and 1160 pixels vertical. Note that the position O (O) and the position S are the above-described base points (reference points) for cutting.

FIG. 4 is a schematic timing chart of synthesized video data and control signals generated by the video synthesis unit 30.
In the figure, the horizontal axis represents time. The vertical synchronization signal is a frame synchronization signal obtained by synchronizing the left eye image area data supplied from the left eye image area extraction unit 20L and the right eye image area data supplied from the right eye image area extraction unit 20R. is there. In this vertical synchronization signal, the period corresponding to the low level corresponds to the vertical blanking period, and the period corresponding to the high level corresponds to the video valid period. The frequency of vertical synchronization is, for example, 120 hertz (Hz).

  The composite video data is obtained by arranging the frame image of the left eye video area data (left eye image) and the frame image of the right eye video area data (right eye image) alternately and in time series, and synchronizing them with the vertical synchronization signal. Video data. The left-eye shutter control signal indicates “open” when the frame image in the composite video data is the frame image of the left-eye video region data, and indicates “closed” when the frame image is the frame image of the right-eye video region data. Signal. The right-eye shutter control signal indicates “open” when the frame image in the composite video data is the frame image of the right-eye video region data, and indicates “closed” when the frame image is the frame image of the left-eye video region data. Signal. In FIG. 4, the low level in the left-eye shutter control signal and the right-eye shutter control signal indicates “open”, and the high level indicates “closed”.

  FIG. 5 is a schematic schematic cross-sectional view of the video presentation unit 40 as viewed from above. As shown in the figure, the video presentation unit 40 includes a display unit 41, a left-eye compatible eyepiece 42L, a right-eye compatible eyepiece 42R, a left-eye compatible shutter 43L, and a right-eye compatible shutter 43R.

  The display unit 41 has a display surface, takes in the composite video data supplied from the video composition unit 30, and displays the composite video data on the display surface. The composite image displayed on the display surface has parallax in the horizontal direction (H direction in FIG. 5). Further, the resolution of the display surface included in the display unit 41 is lower than the resolution of the synthesized video data generated by the video synthesizing unit 30, and is, for example, horizontal 1920 pixels × vertical 1080 pixels. The display unit 41 is realized by, for example, a liquid crystal display panel.

  The left-eye eyepiece 42L is an optical system that enlarges an image that arrives from the display surface of the display unit 41 via the left-eye shutter 43L and presents it to the left eye of the user. Similarly, the right-eye eyepiece 42R is an optical system that enlarges an image that arrives from the display surface of the display unit 41 via the right-eye shutter 43R and presents it to the right eye of the user. The left-eye eyepiece lens 42L and the right-eye eyepiece lens 42R are provided so that their optical axes are parallel, and a plane including these optical axes is parallel to the horizontal direction (H direction). The distance between the optical axes of the left-eye-compatible eyepiece 42L and the right-eye-compatible eyepiece 42R is about 65 millimeters, which is a standard human eye-space.

  The left-eye corresponding shutter 43L is provided on the optical path between the display surface of the display unit 41 and the left-eye corresponding eyepiece 42L. The left-eye corresponding shutter 43L takes in the left-eye corresponding shutter control signal supplied from the image synthesizing unit 30, and based on the left-eye corresponding shutter control signal, the left-eye corresponding image out of the combined image light flux coming from the display surface. This is a shutter that is opened to allow the light beam to pass through the left-eye corresponding eyepiece lens 42L and closed to block it.

  The right-eye shutter 43R is provided on the optical path between the display surface of the display unit 41 and the right-eye eyepiece 42R. The right-eye shutter 43R receives the right-eye shutter control signal supplied from the video composition unit 30, and based on the right-eye shutter control signal, the right-eye corresponding image out of the combined image light flux coming from the display surface. Is a shutter that is opened to pass through the right eye corresponding eyepiece 42R and closed to block.

  Each of the left-eye shutter 43L and the right-eye shutter 43R is realized by an electronic shutter circuit (for example, a liquid crystal shutter) or a mechanical shutter (mechanical shutter).

  As described above, the distance between the optical axes of the left-eye imaging unit 10L and the right-eye imaging unit 10R is much larger than the standard center-to-center distance between both eyes (for example, about 5 times to about 10 times or 3), the stereoscopic video presented to the user of the stereoscopic video shooting and display device 1 becomes a video with enhanced stereoscopic effect. Since the stereoscopic effect of a distant subject is enhanced, the sense of reality by the stereoscopic image is also enhanced. In addition, since the parallax is increased, the depth accuracy obtained from the parallax can be increased. Also, the resolution of the captured video is higher than the resolution of the stereoscopic video displayed on the display unit. Since the video display device 200 changes the cutout position of the rectangular video area based on the direction of the video presentation unit 40, the video display device 200 can dynamically present a shot video with a wide angle of view.

[Second Embodiment]
FIG. 6 is a block diagram showing a functional configuration of a stereoscopic video shooting and display apparatus according to the second embodiment of the present invention. As shown in the figure, the stereoscopic video shooting and display device 1a has a configuration in which the video display device 200 in the stereoscopic video shooting and display device 1 according to the first embodiment is changed to a video display device 200a.

  The video display device 200a has a configuration in which the video synthesis unit 30 and the video presentation unit 40 are changed to the video synthesis unit 30a and the video presentation unit 40a with respect to the video display device 200.

The video composition unit 30a takes in the left eye video region data supplied from the left eye video region extraction unit 20L, and takes in the right eye video region data supplied from the right eye video region extraction unit 20R. Then, the video composition unit 30a alternately extracts image data (line data) for one horizontal line from the frame images of the left-eye video region data and the right-eye video region data, and generates the composite video data by arranging them in the vertical direction. To do. Specifically, the video composition unit 30 performs left eye video area data and right eye video area data, for example, even lines are line data of left eye video area data, and odd lines are line data of right eye video area data. The composite video data rearranged as described above is generated.
The video composition unit 30a supplies the composite video data to the video presentation unit 40a.

The video presentation unit 40a takes in the synthesized video data supplied from the video synthesis unit 30a and displays the synthesized video.
FIG. 7 is a schematic schematic cross-sectional view of the video presentation unit 40a as viewed from above. As shown in the figure, the video presentation unit 40a changes the display unit 41 to the display unit 41a with respect to the video presentation unit 40 in the first embodiment, and includes a left-eye shutter 43L and a right-eye shutter 43R. The left-eye corresponding filter 44L and the right-eye corresponding filter 44R are changed.

The display unit 41a has a display surface in which the polarization characteristics of the even-numbered lines and the odd-numbered lines among the lines in the horizontal direction (H direction in FIG. 7) are different. The display unit 41a has a display surface including, for example, an even line having a left circular polarization characteristic and an odd line having a right circular polarization characteristic. Alternatively, the display unit 41a has a display surface including, for example, even lines having horizontal linear polarization characteristics and odd lines having vertical linear polarization characteristics.
The display unit 41a takes in the synthesized video data supplied from the video synthesis unit 30a and displays the synthesized video data on the display surface. Specifically, for example, the display unit 41a displays line data corresponding to the left-eye video region data in the composite video data on an even line on the display surface, and displays line data corresponding to the right-eye video region data on the display surface. Display on odd lines. The composite image displayed on the display surface has parallax in the horizontal direction (H direction). The resolution of the display surface of the display unit 41a is lower than the resolution of the synthesized video data generated by the video synthesis unit 30a, for example, horizontal 1920 pixels × vertical 1080 pixels. The display unit 41a is realized by a liquid crystal display panel, for example.

  The left-eye correspondence filter 44L is a filter having the same polarization characteristic as the polarization characteristic corresponding to the display surface on which the line data of the left-eye video area data is displayed. The left-eye correspondence filter 44L has the same polarization characteristic as that corresponding to the display surface on which the line data of the left-eye video area data is displayed, and the display surface of the display unit 41a and the left-eye correspondence eyepiece 42L. On the optical path between the two.

  The right eye corresponding filter 44R is a filter having the same polarization characteristic as the polarization characteristic corresponding to the display surface on which the line data of the right eye image area data is displayed. The right-eye correspondence filter 44R has the same polarization characteristic as the polarization characteristic corresponding to the display surface on which the line data of the right-eye video area data is displayed, and the right-eye corresponding eyepiece 42R. On the optical path between the two.

By configuring in this way, the left-eye correspondence filter 44L transmits the light flux based on the line data of the left-eye video area data displayed on the display surface of the display unit 41a. Further, the right eye corresponding filter 44R transmits the light flux by the line data of the right eye video region data displayed on the display surface of the display unit 41a.
Therefore, according to the video display device 200a, without performing shutter control, the video of the left eye video area data is captured through the left eye corresponding eyepiece 42L, and the right eye video area data is displayed through the right eye compatible eyepiece 42R. Can be caught.

[Third Embodiment]
FIG. 8 is a block diagram showing a functional configuration of a stereoscopic video shooting and display apparatus according to the third embodiment of the present invention. As shown in the figure, the stereoscopic video shooting and display device 1b has a configuration in which the video display device 200 in the stereoscopic video shooting and display device 1 according to the first embodiment is changed to a video display device 200b.

  The video display device 200b has a configuration in which the video synthesis unit 30 and the video presentation unit 40 are changed to the video synthesis unit 30b and the video presentation unit 40b with respect to the video display device 200.

The video composition unit 30b takes in the left eye video region data supplied from the left eye video region extraction unit 20L and takes in the right eye video region data supplied from the right eye video region extraction unit 20R. Then, the video composition unit 30b synthesizes the left-eye video region data and the right-eye video region data into a single video frame to generate composite video data. Specifically, the video composition unit 30b generates composite video data in which the frame image of the left eye video area data is adjacent to the left side and the frame image of the right eye video area data is adjacent to the right side.
The video composition unit 30b supplies the composite video data to the video presentation unit 40b.
The video presentation unit 40b takes in the synthesized video data supplied from the video synthesis unit 30b and displays the synthesized video. The detailed configuration of the video presentation unit 40b will be described later.

  FIG. 9 is a diagram schematically illustrating a configuration of a frame image in the synthesized video data generated by the video synthesis unit 30b. As shown in the figure, the frame image P of the composite video data includes the left eye corresponding image DL on the left side and the right eye corresponding image DR on the right side when the horizontal direction is horizontal. The left eye corresponding image DL is an image obtained by reducing the frame image of the left eye video area data. The right eye corresponding image DR is an image obtained by reducing the frame image of the right eye video area data. When the resolution of the frame image P is 1920 horizontal pixels × 1080 vertical pixels, the resolution of each of the left-eye corresponding image DL and the right-eye corresponding image DR is 960 horizontal pixels × vertical 540 pixels. In the frame image P, a region BU above the left eye corresponding image DL and the right eye corresponding image DR and a region BB below the left eye corresponding image DL and the right eye corresponding image DR are regions not including the composite video data. For example, it is a monotone region such as black or gray.

  FIG. 10 is a schematic schematic cross-sectional view of the video presentation unit 40b as viewed from above. As shown in the figure, the video presentation unit 40b has a configuration in which a light shielding unit 45 is added to the video presentation unit 40 in the first embodiment and the left-eye shutter 43L and the right-eye shutter 43R are deleted. Have.

  The light shielding unit 45 is a flat light shielding plate with a low light reflectance, and a boundary portion between the left eye corresponding image DL and the right eye corresponding image DR in the composite video data displayed on the display surface of the display unit 41. Are provided so that a flat plate follows. The light shielding unit 45 prevents the left eye corresponding image DL from reaching the right eye corresponding eyepiece 42R, and the right eye corresponding image DR does not reach the left eye corresponding eyepiece 42L.

  Therefore, according to the video display device 200b, the left eye video area data is captured through the left eye corresponding eyepiece lens 42L and the right eye video area data is captured through the right eye corresponding eyepiece lens 42R without performing shutter control. Can be caught.

[Fourth Embodiment]
FIG. 11 is a block diagram showing a functional configuration of a stereoscopic video shooting and display apparatus according to the fourth embodiment of the present invention. As shown in the figure, the stereoscopic video shooting and display device 1c has a configuration in which the video display device 200 in the stereoscopic video shooting and display device 1 according to the first embodiment is changed to a video display device 200c.

The video display device 200c has a configuration in which the video presentation unit 40 is changed to the video presentation unit 40c and the video synthesis unit 30 is deleted from the video display device 200.
In the video display device 200c, the left eye video region extraction unit 20L supplies the left eye video region data to the video presentation unit 40c, and the right eye video region extraction unit 20R supplies the right eye video region data to the video presentation unit 40c.

  The video presentation unit 40c takes in the left-eye video region data supplied from the left-eye video region extraction unit 20L and the right-eye video region data supplied from the right-eye video region extraction unit 20R, respectively. And the image of the right eye image area data are respectively displayed.

FIG. 12 is a schematic schematic cross-sectional view of the video presentation unit 40c as viewed from above. As shown in the figure, the video presentation unit 40c has a configuration in which the display unit 41 is changed to a display unit 41Lc and a display unit 41Rc with respect to the video presentation unit 40b in the third embodiment.
The display unit 41Lc and the display unit 41Rc are display devices having the same display function. Each of the display unit 41Lc and the display unit 41Rc is a display device in which the number of pixels in the horizontal direction (H direction in FIG. 12) is halved with respect to the display unit 41.

The display unit 41Lc takes in the left eye video region data supplied from the left eye video region extraction unit 20L and displays the left eye video region data on the display surface.
The display unit 41Rc takes in the right-eye video region data supplied from the left-eye video region extraction unit 20R and displays the right-eye video region data on the display surface.

  Therefore, according to the video display device 200c, the left eye video area data is captured through the left eye corresponding eyepiece lens 42L and the right eye video area data is captured through the right eye corresponding eyepiece lens 42R without performing shutter control. Can be caught.

  In the video presentation unit 40c, the light beam from the display unit 41Lc and the light beam from the display unit 41Rc may be combined using a half mirror instead of the light shielding unit 45. Specifically, in the video presentation unit 40c, the left eye correspondence filter 44L is provided on the optical path between the display surface of the display unit 41Lc and the left eye correspondence eyepiece 42L, and the right eye correspondence filter 44R is displayed on the display unit 41Rc. It is provided on the optical path between the surface and the right eye corresponding eyepiece 42R, and the light shielding portion 45 is deleted. Then, in the video presentation unit 40c, the luminous flux from the display unit 41Lc and the luminous flux from the display unit 41Rc are orthogonalized and synthesized by a half mirror, and this synthesized light is guided to the left-eye correspondence filter 44L and the right-eye correspondence filter 44R. Let me.

  Further, in the above-described stereoscopic video shooting and display devices 1, 1a, 1b, and 1c, the video display device 200 is fixed and a direction operation unit such as a lever or a button is provided, and is switched according to the operation of the direction operation unit by the user. The outgoing position designating unit 50 may capture movement information corresponding to the pan operation and the tilt operation from the direction operation unit.

  Moreover, you may comprise so that the stereoscopic video imaging display apparatus 1, 1a, 1b, 1c can be mounted | worn on a user's head. For example, the three-dimensional image photographing display devices 1, 1a, 1b, and 1c may be configured by a head mounted display (HMD) type.

  Further, in the stereoscopic video imaging display devices 1, 1a, 1b, and 1c, the imaging device 100 and the video display device 200 may be installed separately. For example, the photographing apparatus 100 may be installed in a place where a scenic spot can be seen, and the video display apparatuses 200, 200a, 200b, and 200c may be installed in an observation room away from the place. In addition, the imaging device 100 may be installed in a place where the monitoring area can be included in the field of view, and the video display devices 200, 200a, 200b, and 200c may be installed in a monitoring room away from the location.

  In this case, the connection between the photographing device 100 and the video display devices 200, 200a, 200b, and 200c is connected by, for example, a network cable or an optical fiber cable, and the left eye is supported from the photographing device 100 to the video display devices 200, 200a, 200b, and 200c. The imaging data and the right-eye imaging data are configured to be transmitted.

  Further, in the stereoscopic video imaging display devices 1, 1a, 1b, and 1c, the optical axis of the imaging optical system of the left-eye imaging unit 10L and the optical axis of the imaging optical system of the right-eye imaging unit 10R are parallel or converged. And the distance between the optical axes in the photographing optical system is about 5 times to about 10 times or more than the standard center distance (about 65 millimeters) of both human eyes. A corresponding photographing unit 10L and a right eye corresponding photographing unit 10R are provided. The distance between the optical axes of the left-eye corresponding photographing unit 10L and the right-eye corresponding photographing unit 10R is not limited to this, and the installation environment, application, and use of the stereoscopic image photographing display devices 1, 1a, 1b, and 1c or the photographing device 100 are not limited thereto. Depending on the distance between the photographing apparatus 100 and the subject, which is assumed depending on the purpose of use, for example, the distance may be about several meters to 100 meters.

On the contrary, in each embodiment, the optical axis of the imaging optical system of the left-eye imaging unit 10L and the optical axis of the imaging optical system of the right-eye imaging unit 10R are parallel or converged, and the imaging optical system. The left-eye imaging unit 10L is set so that the distance between the optical axes at is about 0.2 times to about 0.1 times or less than the standard distance between the centers of both eyes of the human. Alternatively, a right-eye imaging unit 10R may be provided.
In this case, each of the left eye video region extraction unit 20L and the right eye video region extraction unit 20R enlarges the extracted video region, and outputs the enlarged data as left eye video region data and right eye video region data.

Thus, while making the distance between the optical axes shorter than the standard distance between the centers of both human eyes, the relative parallax between the captured image and the user can be increased by enlarging the image area. It is possible to obtain a stereoscopic image in which the stereoscopic effect is emphasized as in the above-described embodiments.
If each of the left-eye corresponding photographing unit 10L and the right-eye corresponding photographing unit 10R is realized by an ultra-small photographing device such as a micro camera, the stereoscopic image photographing display devices 1, 1a, 1b, and 1c can, for example, close the surgical site at a short distance. The three-dimensional image in which the stereoscopic effect is emphasized can be obtained.

  As mentioned above, although embodiment of this invention was explained in full detail with reference to drawings, the specific structure is not restricted to that embodiment, The design of the range which does not deviate from the summary of this invention, etc. are included.

1, 1a, 1b, 1c Stereoscopic image capturing and displaying apparatus 10L Left-eye corresponding capturing unit 10R Right-eye corresponding capturing unit 20L Left-eye image region extracting unit 20R Right-eye image region extracting unit 30, 30a, 30b Image combining unit 40, 40a, 40b, 40c Video presentation unit 41, 41a, 41b, 41Lc, 41Rc Display unit 42L Left-eye eyepiece 42R Right-eye eyepiece 43L Left-eye shutter 43R Right-eye shutter 44L Left-eye filter 44R Right-eye filter 45 Light-shielding part 50 Cutting position designation part 100 Image pick-up device 200, 200a, 200b, 200c Video display device

Claims (2)

A left-eye imaging unit that captures a subject and generates left-eye imaging data corresponding to the left eye of the user;
A right-eye-capable photographing that creates a right-eye-captured photographing data corresponding to the right eye of the user by photographing the subject and providing a distance between the optical axes of the photographing portion of the left-eye corresponding to the photographing optical axis as a predetermined distance. And
A left-eye video region extraction unit that captures the left-eye-captured shooting data generated by the left-eye-captured shooting unit, extracts a rectangular video region from the left-eye-corresponding video data, and generates left-eye video region data;
A right-eye video region extracting unit that captures the right-eye-capable shooting data generated by the right-eye-capable shooting unit, extracts a rectangular video region from the right-eye-corresponding video data, and generates right-eye video region data;
The left eye image area data generated by the left eye image area extracting unit and the right eye image area data generated by the right eye image area extracting unit are captured, and the left eye image area data and the right eye image area data are obtained. A video composition unit that synthesizes and generates composite video data;
The composite video data generated by the video composite unit is captured to display the composite video data, the left eye video region data included in the composite video data is presented in correspondence with the left eye of the user, A video presentation unit that presents the right-eye video region data included in the composite video data in correspondence with the right eye of the user;
A stereoscopic video shooting and display device comprising: A direction of the video presentation unit is detected, and based on the direction, a cutout position of a rectangular video region extracted by the left eye video region extraction unit and the right eye video region extraction unit is determined, and the cutout position is determined. Further comprising a cut-out position specifying unit for supplying a position to the left-eye video region extracting unit and the right-eye video region extracting unit;
The left-eye video region extraction unit takes in the cut-out position supplied from the cut-out position designation unit, and extracts a rectangular video region from the left-eye corresponding video data based on the cut-out position,
The right-eye video area extracting unit takes in a cut-out position supplied from the cut-out position specifying unit, and extracts a rectangular video area from the right-eye corresponding video data based on the cut-out position. The stereoscopic video shooting and display device according to claim 1.

Images