JPH1070740A - Stereoscopic camera and video transmission system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain stereoscopy by the stereoscopic camera capable of stereoscopic photography even at the time of zooming. SOLUTION: To photograph a target point 2 by cameras 1a and 1b, the cameras 1a and 1b are arranged having their optical axes aligned with the prolongation connecting the target point 2 and both virtual eyes 3a and 3b when the cameras 1a and 1b are zoomed so as to obtain the same visual fields viewed from the positions of both the virtual eyes 3a and 3b. Thus, the visual fields of the cameras 1a and 1b and both the eyes 3a and 3b match each other even at the time of zooming by controlling the positions and angles of the cameras 1a and 1b, so reproduced images of the cameras 1a and 1b provide correct stereoscopy.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional camera capable of performing zoom photographing while maintaining a three-dimensional effect of a subject, and a video image transmission system capable of realizing virtual reality by applying the three-dimensional camera.

[0002]

2. Description of the Related Art For example, in the case of watching sports in a stadium, spectators who are actually in the stadium can enjoy a powerful game together with the atmosphere of the stadium. However, the number of spectators that can be accommodated in such a stadium is limited, and it is impossible to accommodate all those who want to watch a game. For this reason, for example, by broadcasting a live game, it is possible to watch the game on a television receiver or the like.

[0003]

However, the watching with the conventional television receiver is performed in a two-dimensional plane image, and cannot display a sense of depth, and thus lacks a sense of speed, power, and realism. There was a problem. Therefore, a display device and a photographing device capable of providing a three-dimensional display have been demanded.

At present, some display devices capable of displaying a moving image in three dimensions have already been put to practical use.
In addition, a stereoscopic photographing apparatus that can cope with these has been proposed. FIG. 13 schematically illustrates the principle of this conventional stereoscopic camera. Interlocking manner zoomable camera 100a and 100b are in parallel Te than at intervals, such as intervals E _d standard right 101a and left 101b,
It is fixedly arranged. E _d is, for example, about 7 to 10 cm. The subject 102 is photographed by the cameras 100a and 100b. With this configuration, it is possible to reproduce a three-dimensional effect with the naked eye.

[0005] Here, as shown in FIG.
At the positions of the naked eyes 101a and 101b and at the position t in the cameras 100a and 100b
Let us consider a case where the subject 103 and 104 are imaged with the point a in the subject 103 as a point of interest, as if viewed with the naked eyes 101a and 101b. In this case, the cameras 100a and 100b are zoomed according to the ratio of the distance from the point a to the positions s and t.

When the naked eye 101a has a viewing angle φ, the naked eye 101a can see ranges A and B indicated by thick lines on the subjects 103 and 104.
Further, with the naked eye 101a, the point a, which is the point of interest, is focused, whereas the range B of the subject 104 is seen in the back.

[0007] As is well known, zooming of a camera is accomplished by reducing the viewing angle of the camera. Therefore, in the fixedly arranged camera 100a, the size of the subject 10 at the position t is the same as when viewed at the position s.
When zooming is performed so that images 3 and 104 can be taken, a difference in the visual field occurs in the range indicated by C in the figure with respect to the naked eye 101a, and the point a ′ in the subject 103 is focused. Become. This is the same for the camera 100b. Therefore, the camera 10
With 0a and 100b, there is a problem that the stereoscopic effect as viewed at the position s cannot be correctly expressed.

[0008] In addition, in watching a game with a television receiver, the atmosphere in the stadium cannot be conveyed after all, and there is a problem that it is not possible to wipe out the lack of satisfaction.

Accordingly, an object of the present invention is to provide a three-dimensional camera capable of correctly expressing a three-dimensional effect while enabling zooming, and to reproduce a sense of realism as if one were at the site by using the three-dimensional camera. Such a video image transmission system is provided.

[0010]

SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, the present invention provides a first camera for photographing the right eye side, a second camera for photographing the left eye side, and a virtual camera. A first camera is arranged on the extension of the first line connecting the right eye position with the first line so as to align the optical axis with the first line, and connects the target point with the virtual left eye position of the right eye and the pair. Control means for controlling the positions and angles of the first and second cameras in a predetermined relationship so that the second camera is arranged on the extension of the second line so that the second line is aligned with the optical axis. And a predetermined relationship is maintained even if the distance between the subject and the virtual right and left eyes changes due to zooming.

According to the present invention, in order to solve the above-mentioned problems, a plurality of cameras respectively arranged at a plurality of first locations and a plurality of cameras arranged at a plurality of first locations are provided. A plurality of three-dimensional cameras capable of three-dimensional imaging, a plurality of cameras, multiplexing means for multiplexing the video signals and the video signals of the plurality of three-dimensional cameras, and a multiplexed signal in a second location. A first transmission means for transmitting to
Portable stereoscopic video display means respectively owned by one or a plurality of spectators present at the second place, receiving means arranged at the second place for receiving the multiplexed signal, and displaying the received multiplexed signal in a stereoscopic manner. A second transmission unit for transmitting to the video display unit, wherein the stereoscopic video display unit separates the multiplexed signal into respective video signals, and a required video signal can be selected from the respective video signals. A video image transmission system characterized in that:

As described above, according to the present invention, the respective cameras corresponding to the left and right eyes are arranged on the extension of the line connecting the subject and the virtual left and right eyes, with their optical axes aligned. Since the arrangement is maintained even when zooming is performed on the subject, the captured video can be reproduced with a correct stereoscopic effect.

Further, according to the present invention, an image captured three-dimensionally at a first location can be projected while reproducing a three-dimensional effect at a second location, so that an image full of a sense of reality can be displayed at another location. You can see.

[0014]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 schematically shows the principle of a stereoscopic camera according to the present invention. In the present invention, the cameras 1a and 1b constituting the three-dimensional camera are respectively replaced with the subject 2 and the naked eyes 3a and 3b.
And placed on the extension of the line connecting them. Further, the cameras 1a and 1b are respectively directed toward the subject 2 so that the optical axes of the cameras 1a and 1b at this time coincide with these lines. By arranging the cameras 1a and 1b in this manner, these cameras 1a
And 1b and the naked eye 3a and 3b can match the visual field range at the time of zooming.

In the following description, unless otherwise specified, a diagram showing the relationship between such a camera, the naked eye, and a subject is a diagram viewed from above.

As shown in FIG. 2, in a camera 1a having a viewing angle α ₀ when no zoom is performed,
When zooming is performed, the viewing angle is set to a viewing angle α satisfying α <α ₀ . The difference between the viewing angles α and α ₀ corresponds to the presence or absence of zooming. The naked eye 3a having a viewing angle β
, The ranges A and B in the subjects 4 and 5
Is the field of view. Therefore, by setting the viewing angle α of the camera 1a so that the visual field range of the naked eye 3a matches the visual field range of the camera 1a, the camera image of the camera 1a during zooming and the visual field of the naked eye 3a at the position s are obtained. Can be matched with the picture inside. This description is the same for the camera 1b.

On the other hand, at the camera position described in the above-described conventional example, as in the case of the camera 100a, when the zoom is performed at the same zoom ratio as that of the camera 1a, the difference in the visual field by the range indicated by C in FIG. Camera 1 when zooming
The camera image of 00a does not match the image in the visual field with the naked eye 3a at the position s.

Next, the relationship between the right camera 1a and the left camera 1b will be described. First, each variable and fixed value used in the following description will be defined with reference to FIG. _Ed is the distance between the left and right eyes of a human. d (or d ′) is the distance between the eye and the subject 6. This distance d is actually a virtual value. l
Is the distance between the cameras 1a and 1b. D is the center point of a straight line connecting camera 1a and camera 1b and subject 6
And the distance.

When defined as above, d: E _d / 2 =
From the relationship of D: 1/2, the zoom ratio Z is obtained as Z = D / d. In FIG. 3, when the position of the eyes approaches d to d ′, the distance between the left and right cameras 1a and 1b increases from l to l ′. Of course, the eye interval E _d is fixed. Therefore, the distance between the cameras 1a and 1b increases as the distance to the subject 2 increases.

FIG. 4 shows the parallax composed of the cameras 1a and 1b. For example, a subject 5 to be expressed with depth relative to the subject 4 is indicated by F in the figure from the cameras 100a and 100b arranged at the position t by the above-described conventional method. While it is possible to obtain only a parallax, a sufficient parallax can be obtained from the cameras 1a and 1b arranged at the same position t by the method according to the present invention, as indicated by G in the figure. it can.

Next, a more specific example of this embodiment will be described. FIG. 5 shows a more specific configuration example of the stereoscopic camera according to the present invention, which includes the cameras 1a and 1b. The camera 1a includes, for example, a turntable 1 whose rotation angle is controlled by an externally controlled stepping motor.
0a. Similarly, the camera 1b is attached to the turntable 10b. At this time, it is preferable that the centers of rotation of the turntables 10a and 10b coincide with the start points of the optical axes of the cameras 1a and 1b, respectively.

The turntables 10a and 10b to which the cameras 1a and 1b are attached, respectively,
Attached to. Each of the turntables 10a and 10b is movable in the lateral direction with respect to the arm 11,
An operation part whose operation is controlled by an external control is provided (not shown).
The cameras 1a and 1b are moved laterally based on, for example, a guide of a rail 12 provided on the arm 11. The arm 11 is fixed to a camera platform or the like, for example, by a turntable 13 whose rotation angle is controlled by a stepping motor controlled from the outside.

The angle between the optical axes of the camera 1a and the camera 1b is controlled to θ by the turntables 10a and 10b. Similarly, the distance between the start point of the optical axis between the camera 1a and the camera 1b is controlled to be l. FIG. 6 shows the angle θ formed by the optical axis and the distance 1 between the starting points of the optical axis at this time. θ is the starting point of the optical axis of the cameras 1a and 1b,
The subject 2 through the virtual naked eyes 3a and 3b, respectively
And the angle formed by the straight line connecting As described above, the zoom ratio Z =
From D / d and this figure, the following equations (1) and (2) are derived.

L = Z · E _d (1)

Θ = 2 tan ⁻¹ (Z · E _d / 2D) Equation (2)

That is, since _Ed is a fixed value, if the zoom ratio Z and the distance D between the cameras 1a and 1b (actually, their center points) and the subject 2 are known, these 1 and θ can be calculated. That is, the positions and angles of the cameras 1a and 1b can be controlled. It should be noted that l that determines the size of the arm 11 forming a stereoscopic image (zoom rate “10” from the camera position) viewed from the audience seats is, for example, E _d = 0.0
Assuming that the distance is 7 m, d = 5 m and D = 50 m are at most about 70 cm.

FIG. 7 shows the cameras 1a and 1b as described above.
1 shows an example of a configuration for controlling the position and angle of an image.
As will be described later in detail, one of the left and right cameras 1a and 1b is used as a reference camera, and the focus and zoom of the other camera are controlled. Here, the reference camera is camera 1a.

The cameras 1a and 1b are controlled for automatic focusing and zooming according to the following method.
Prior to the description of this control, adjustment of the output levels of the cameras 1a and 1b will be described. First, these cameras 1
The difference between the output signals a and 1b is calculated. Then, the minimum and maximum amplitude parts in the output signal are found in the image part with a small difference, and the camera parts 1a and 1b of this part are found.
The output signal level of the camera 1b is adjusted to the output signal level of the camera 1a, which is the reference camera, so that the output signals of the camera 1b are the same. The cameras 1a and 1b are adjusted in this way.

The turntable 10a includes two motors 30 and 31. The motor 30a is composed of, for example, a stepping motor and controls the rotation of the camera 1a. The motor 31b controls the lateral movement of the camera 1a along the guide 12. Similarly, the turntable 10b also includes a motor 30b for controlling rotation and a motor 31b for controlling movement in the lateral direction.

An external control signal is supplied to the camera controller 20. The method of supplying the control signal will be described later. The control signal includes a zoom ratio Z which is information for issuing a zooming instruction to the cameras 1a and 1b. In addition, the control signal may include the distance D to the subject to be used as autofocus information in the cameras 1a and 1b.

Video information captured by the camera 1a is transmitted to the camera controller 20. In the camera controller 20, processing for performing zoom and autofocus control in the camera 1a is performed based on the supplied video information. In the camera 1a, zoom and autofocus are performed based on the result. The result of the autofocus processing and the above-described zooming instruction are also supplied to the camera 1b.
Thereby, the same operation as the camera 1a is performed in the camera 1b.

When information on the distance D is included in the control signal supplied to the camera controller 20, the autofocus operation may be performed based on the information.

By performing the auto-focus processing in the camera controller 20, the distance D to the subject can be obtained. The distance D and the zoom ratio Z are supplied from the camera controller 20 to the motor control unit 21. In the motor control unit 21, the above equation (2) is calculated from the supplied distance D and the zoom ratio Z, and the motors 30a and 3 are calculated based on the calculation result.
0b is controlled, and the angles of the camera 1a and the camera 1b are each set to the inside angle θ / 2. Further, the zoom ratio Z is supplied from the camera controller 20 to the motor control unit 22. In the motor control unit 22, the above equation (1) is calculated from the supplied zoom rate Z,
The motors 31a and 31b are controlled based on the calculation result, and the distance between the cameras 31a and 31b is set to the distance l.

On the other hand, the subject automatic tracking section 23 tracks the subject, and generates a control signal.
This control signal is supplied to the camera controller 20. This tracking is performed, for example, by comparing an image photographed by the camera 24 and subjected to predetermined processing by the camera controller 25 with, for example, the shape of the subject stored in advance. Further, this tracking may not be performed automatically, but may be performed, for example, by operating the camera 24 by an operator to chase the subject. In this case, it is desirable that the camera 24 be attached so as to move integrally with the arm 11.
Furthermore, a wide-angle lens may be used to capture a wide area, and the operator may follow the subject with a predetermined instruction means such as a joystick while watching the monitor screen. Furthermore, a transmitter can be provided for a subject, and the subject can be tracked by receiving radio waves and ultrasonic waves transmitted from the transmitter with a plurality of receiving devices.

By tracking the subject, position information of the subject can be obtained over time. Based on the obtained position information, a distance D from the cameras 1a and 1b to the subject is obtained. The position information and the time information of the subject are supplied to the direction / speed detection unit 26. The direction / speed detector 26 obtains the moving direction, moving speed, and acceleration of the moving of the subject from the supplied position information and time information of the subject.

In this embodiment, the zoom ratio Z of the cameras 1a and 1b during automatic tracking of a subject is performed.
Is selected based on the moving direction, moving speed, and acceleration of the subject. For example, when the moving speed is high, the zoom ratio Z is set to a small value, and when the moving speed is low, the zoom ratio Z is set to a large value. Further, when the tracking of the subject is performed by the operation of the camera 24 by the operator without automatically tracking the subject, the zoom ratio Z can be directly obtained based on the operation of the operator. Also in this case, the zoom ratio Z can be automatically selected. The distance D and the zoom ratio Z obtained as described above are used as the above-mentioned control signals in the camera controller 25.
From the camera controller 20.

Next, an application example of the stereoscopic camera according to this embodiment will be described. FIG. 8 shows an example in which this stereoscopic camera is installed in, for example, a stadium where a soccer game is performed, and a live broadcast of the game performed in this stadium is performed. In this case, the stadium 4 where the competition actually takes place
A number of cameras are installed in the camera 0, and video signals captured by these cameras are multiplexed and transmitted to another stadium 60. At the stadium 60, the audiences 61a, 61
Each of the stadiums 40b, 61c,...
Is received via the receiving system of the stadium 60. As a result, the game being played in the stadium 40 is played live, and the player can watch the game in the stadium 40 three-dimensionally while staying in the stadium 60.

In the stadium 40, stereo cameras according to the present invention are provided with stereo cameras 41a, 41b, 41c, and 4
Plural units are installed as in 1d. In addition, the high resolution cameras are cameras 42a, 42b, 42c, and 42d.
Multiple units are installed. High resolution camera 42
For a, 42b, 42c, and 42d, for example, a camera having a resolution of about 1125 lines in the vertical resolution and having a resolution of about the HDTV system or higher is used, and each covers a fixedly wide range. Stereo cameras 41a, 41b, 41
As described above, c and 41d track the subject (for example, a soccer ball in a soccer game). The stereo cameras 41a, 41b, 41c, and 41d are each movable. These three-dimensional cameras 41a, 41b, 41c, and 41d, and high-resolution cameras 42a, 42b, 42c, and 42
The video signal captured by d is supplied to the encoder 50, respectively.

In the encoder 50, these supplied video signals are respectively compressed by a predetermined compression system, for example, the MPEG-2 system. These compressed video signals are multiplexed by a multiplexer 51 to form a multiplexed stream, which is supplied to a transmission system 52. And
The transmission system 52 performs processing such as modulation and amplification, and transmits a transmission radio wave composed of multiple streams.

On the other hand, a large number of spectators 61a,
61b, 61c,...
Each of 1a, 61b, 61c,... Has a receiving system including a portable stereoscopic video display device and an attached signal processor described later.

The transmission radio wave transmitted from the transmission system 52 of the stadium 40 is received by the reception system 53 provided in the stadium 60. The received signal is converted into a predetermined format by a converter 54 and supplied to a local transmission system 55 for transmitting to a spectator in the stadium 60. Local transmission system 55
., The converted signals are transmitted to the receiving systems of the spectators 61a, 61b, 61c,. As described above, the transmitted signal is a multiplexed stream in which the video signal compressed by the MPEG-2 system on the transmitting side is multiplexed.

In the control center 56, service information is provided to the portable stereoscopic video display device and the attached signal processor of the spectators 61a, 61b, 61c,. When these devices are lent to the spectators 61a, 61b, 61c,..., The devices are managed in the control center 56. The provision of information and the management of devices by the control center 56 are performed by transmitting / receiving a signal processed by a predetermined method using an antenna 57 installed in the stadium. This transmission /
For the reception, for example, a method used in a PHS (simplified mobile phone system) can be applied.

FIG. 9 shows audiences 61a, 61b, 61c,.
1 shows an example of a portable stereoscopic image display device of the receiving system of the. This is an application of an existing spectacle type display. 9A and 9B
FIG. 1 is a diagram showing a state in which the portable stereoscopic image display device is mounted on a human head, as viewed from above and from the side, respectively. The display device 70 has the shape of glasses as described above, and is attached to the head by the strings 71 and the elastic bands 72 and 73. The optical system is configured inside a box 74 attached to the front part. The string 71 is provided with a receiving device 76 having an antenna and switches 77a, 77b, and 77c for performing various operations. Further, although not shown, cables are respectively drawn from the strings 71 on both sides and connected to earphones attached to both ears.

A cable 78 is connected to the string 71.
The other end of the cable 78 is connected to the attached signal processor 90. FIG. 10 shows an example of the configuration of the attached signal processor 90. The attached signal processor 90 is owned by each audience wearing the display device 70. The attached signal processor 90 includes a communication controller section 91, a signal processing section 93, and a power supply section 94. An antenna 92 is connected to the communication controller 91.

The communication control section 91 comprises a memory, a microprocessor and its peripheral circuits, a communication circuit and the like. The communication control section 91 includes information for managing the display device 70 and the attached signal processor 90,
For example, ID information is stored. For example, when an error occurs in the display device 70 or the attached signal processor 90, an alarm is sounded to notify the owner of the occurrence of the error, and the ID information and the error information are transmitted from the antenna 92 to the antenna 57. And control center 56
Can be automatically notified of the abnormality of the device.

When the display device 70 and the attached signal processor 90 are lent, the control center 5
6 and the communication control unit 91 to periodically manage the ID information, thereby making it possible to prevent the rented audience from taking these devices without permission.

The service information transmitted from the control center 56 by the antenna 57 is supplied to the communication controller 91 via the antenna 92. This information is stored in a memory or the like, for example, as a database relating to a live competition.

The signal processing section 93 comprises a memory, a microprocessor and its peripheral circuits, a video / audio signal processing circuit, etc., and performs processing of video / audio signals and processing of service information. The multiplexed stream received by the antenna 76 of the display device 70 is supplied to the signal processing unit 93. In the signal processing section 93, the multiplexed stream is separated, and the separated stream is decoded. Information such as virtual position switching, zoom rate selection, display mode selection, and information window display control performed by operating the switches 77a, 77b, and 77c of the display device 70 is transmitted to the signal processing unit 93. Supplied to In addition, data related to the played game and the like stored in the memory of the communication controller 91 are supplied to the signal processing unit 93.

Based on the supplied information, the signal processing section 93 selects a separated and decoded stream, cuts out and enlarges video data, generates a status display section 81 and an information window 82, and displays a display screen 80 Processing such as multiplexing is performed. The video signal subjected to such processing is supplied to the display device 70 via the cable 78. The signal processing unit 9
In 3, the audio signal included in the stream is also processed, and the processed audio signal is supplied to the display device 70 via the cable 78 together with the video signal.

The power supply 94 comprises a power supply for the display device 70 and a power supply for the attached signal processor 90 itself. Power for the display device 70 is supplied to the display device 70 via the cable 78.

FIG. 11 schematically shows an optical system formed in the box 74. The liquid crystal panel 81 is driven by a driving circuit (not shown) based on the supplied video signal. This video signal is obtained by synthesizing the video signals from the cameras 1a and 1b described above. When the video signal is displayed, the camera 1a and the camera 1b Is projected. Actually, a video image is projected by controlling the amount of transmitted light by the liquid crystal panel 81. For example, a backlight 80 composed of a white fluorescent tube
The white light emitted by the light source is transmitted through a liquid crystal panel 81 having an RGB filter and a diffuser 82 to a half mirror 83.
Is irradiated. The diffuser 82 makes the boundary of the pixel inconspicuous by appropriately diffusing the light from the liquid crystal panel 81.

The video image projected on the half mirror 83 is reflected leftward in FIG. 11 and is projected on the concave half mirror 84. Then, the video image that has entered the concave half mirror 84 is reflected, passes through the half mirror 83, and enters the naked eye 85. Since the image reflected by the concave half mirror 84 having a concave reflective surface is applied to the naked eye 85, the person wearing this portable stereoscopic image display device 70 can use the actual concave half mirror 84. It is possible to feel as if the image was displayed farther away than the position. In this example,
At a distance of about 2 m from the position of the naked eye 85, it can be felt as if the image 86 was virtually displayed with the size of a 52-inch screen.

In this case, as the image 86, two images having a difference in parallax between the left and right eyes are displayed side by side. Therefore, for example, by partitioning the inside of the box 74 so that the visual fields of the left and right eyes do not overlap, a three-dimensional image can be displayed.

The above configuration is provided for each of the two eyes. For example, the liquid crystal panel 81 corresponding to the right eye is the output of the camera 1a, and the liquid crystal panel 81 corresponding to the left eye is the output of the camera 1b. By driving with the video signal of the corresponding side,
A three-dimensional image can be displayed.

Since the front surface of the box 74 is transparent or translucent, turning on / off the liquid crystal shutter 87 allows the user to view only the video image or simultaneously view the video image and the external scene. Can be selected.

FIG. 12 shows an example of display on the portable stereoscopic video display device 70. At the lower right of the main screen 80, a status display section 81 is displayed. The status display section 81 displays information such as the virtual position of the spectator wearing the display device 70 in the stadium 40, the position and direction of the subject (the ball in this example), the screen mode, and the like. At the lower left of the main screen 80, an information window 82 is provided in a predetermined manner by an instruction of the spectator wearing the device 70.
Can be displayed. In the information window 82, for example, information provided by the organizer of the competition in which the relay is being performed can be displayed.

The display of the main screen 80 includes a 2D cutout display mode for performing a two-dimensional display and a 3D display mode for performing a three-dimensional display.
There are two types of display modes, a display mode. These two
The type of display mode can be selected by a switch 71 a provided on the string 71 of the display device 70. The selected mode is displayed at the center of the status display section 81.

In the 2D cut-out display mode, the image of the camera selected by the method described later among the above-described high-resolution cameras 42a to 42d is cut out to a predetermined size and zoomed and displayed. At this time, the selection of the zoom ratio is performed by the string 7 of the display device 70.
This is performed by the switch 77b provided in the switch 1. For this selection, a method of selecting a zoom ratio that changes stepwise each time the switch 77b is pressed once, a method of selecting a zoom ratio that continuously changes by continuously pressing the switch 77b, and the like can be considered. In any of these methods, it is preferable in terms of operability to cyclically change the zoom ratio.

In the 3D display mode, an image of a camera selected by the method described later among the stereo cameras 41a to 41d is displayed. In this mode,
The liquid crystal panel 81 provided for each of the two eyes in the display device 70 is a right camera 1a of the stereoscopic camera.
And the left camera 1b are independently driven by the video signals. For this reason, the audience will see the stereoscopic camera 41a.
Screens that have been properly zoomed in ~ 41d,
Can be seen in three dimensions.

A spectator wearing the display device 70 can select a virtual position of the spectator in the stadium 40 by a switch 77c provided on the string 71 of the display device 70. The signal received by the display device 70 is
As described above, they are multiplexed. This switch 77
c, the cameras 41a to 41d and the cameras 42a to 4d are selected from the multiplexed signals.
By selecting the signal of the desired camera position from 2d,
This virtual position is selected. The selected position is displayed on the status display section 81. In this example, it is shown that the spectator is virtually located at a location represented on the upper side in the overall display of the stadium in the status display section 81.

A spectator wearing the display device 70 can display the information window 82. In this information window 82, for example, in this example of soccer relay, in this example, personal information of a player, a match result of a team, and the like are displayed.
Various information provided can be displayed. The spectator can easily select information to be displayed by designating items in a predetermined manner according to a menu screen displayed in the information window 82.

The operation of switching the display / non-display of the information window 82 and designating items is performed by, for example, the display device 70.
Can be performed by a remote controller connected by a thin cable. This controller includes:
For example, when a so-called cross key is provided, the operation can be performed comfortably. Of course, it may be performed by a wireless remote controller using infrared rays or the like. Further, similarly to the above-described switches 77a, 77b, and 77c, a switch may be provided on the string 71 and operated by the switch.

Further, this operation is performed by, for example, winking one of the left and right eyes of the spectator wearing the device 70,
It is also possible to perform based on this combination of winks. This is because, inside the device 70, that is, on the side of the eyes, an infrared emitter and an infrared detector that emit weak infrared rays that do not affect the eyes are provided, and the reflectance of infrared rays between the eyelids and the eyes is provided. This can be realized by detecting the movement of the eyes and eyelids such as winks by detecting the difference between them.

In the above description, it is assumed that the present invention is used for watching live games from another stadium.
Of course, this is not limited to this example. For example, the present invention is also applicable to a case where a movie shot by the stereoscopic camera according to the present invention is viewed in a theater.

[0065]

As described above, according to the present invention, since the two cameras for capturing a stereoscopic video are properly arranged, an accurate stereoscopic effect can be reproduced even when zooming is performed. There is an effect that can be.

Further, according to the application of the present invention, it is possible to watch the game from the best position of the stadium without being in the stadium where the competition is actually being performed, and to prepare a separate watching place. In the case of the stadium, it is possible to sense a sense of unity with other spectators, and thus, it is possible to perform a realistic watching game.

Further, since it is possible to watch a game with a sense of reality at another stadium, there is an effect that more people can enjoy the game without being caught by the capacity of the stadium where the game actually takes place. .

Also, in the application of the present invention, it is possible to enjoy both watching along a flow like television broadcasting and watching the game by changing the viewpoint independently by the viewer's intention. There is an effect that a more attractive watching game can be enjoyed than watching a normal stadium.

[Brief description of the drawings]

FIG. 1 is a schematic diagram schematically showing the principle of a stereoscopic camera according to the present invention.

FIG. 2 is a schematic diagram schematically showing the principle of a stereoscopic camera according to the present invention.

FIG. 3 is a schematic diagram for defining each variable and fixed value used in the description.

FIG. 4 is a schematic diagram illustrating parallax composed of two cameras.

FIG. 5 is a schematic diagram illustrating a more specific configuration example of a stereoscopic camera including two cameras.

FIG. 6 is a schematic diagram illustrating an angle θ between optical axes of two cameras and a distance 1 between start points of the optical axes.

FIG. 7 is a block diagram showing an example of a configuration for controlling the positions and angles of two cameras constituting the stereoscopic camera.

FIG. 8 is a diagram for explaining an application example of the stereoscopic camera according to the present invention, and is a schematic diagram illustrating an example in which a stereoscopic camera is installed in a stadium and a live broadcast of a competition performed in the stadium is performed.

FIG. 9 is a schematic diagram illustrating an example of a portable stereoscopic image display device of a receiving system of an audience.

FIG. 10 is a schematic diagram illustrating an example of a configuration of an attached signal processor.

FIG. 11 is a schematic diagram schematically showing an optical system configured in a box body.

FIG. 12 is a schematic diagram illustrating an example of display on the portable stereoscopic image display device.

FIG. 13 is a schematic diagram schematically illustrating the principle of a stereoscopic camera according to the related art.

FIG. 14 is a schematic diagram schematically showing the principle of a conventional stereoscopic camera.

[Explanation of symbols]

1a, 1b: camera, 3a, 3b: naked eye, 2,
4, 5, 6: subject, 40, 60: stadium, 41a to 41d: stereoscopic camera, 42a to 42d
... High resolution camera, 70 ... Portable stereoscopic image display device, 80 ... Display screen, 81 ... Status display section, 8
2 ... information window, 90 ... attached signal processor,
D · · · distance from the stereoscopic camera to an object, d · · · distance from hypothetical gross position to the object, E _d · · · distance between both eyes, l · · · of the two cameras constituting the stereo camera The distance between the starting points of the optical axis, Z: the zoom ratio, θ: the angle between the optical axes of the two cameras constituting the stereoscopic camera

Claims (9)

[Claims] 1. A stereo camera capable of zooming and stereoscopically photographing a subject, comprising: a first camera for photographing the right eye side, a second camera for photographing the left eye side, and a virtual The first camera is arranged on an extension of the first line connecting the position of the right eye and the optical axis with the first line, and the position of the virtual left eye paired with the target point and the right eye The position and angle of the first and second cameras are set to predetermined positions so that the second camera is arranged on the extension of the second line connecting Control means for controlling the relationship, wherein the predetermined relationship is maintained even if the distance between the subject and the virtual right and left eyes changes due to zooming. 2. The three-dimensional camera according to claim 1, further comprising tracking means for tracking the subject. 3. The three-dimensional camera according to claim 1, wherein a zoom ratio of the first and second cameras is automatically selected according to a moving speed of the subject. 4. The three-dimensional camera according to claim 1, wherein one of the first and second cameras is set as a reference camera, and the other camera different from the one camera is controlled by the reference camera. Stereoscopic camera characterized in that it is performed on the basis of: 5. A video image transmission system for transmitting a video image from a first place to a second place, comprising: a plurality of cameras respectively arranged at a plurality of places of the first place; A plurality of three-dimensional cameras capable of three-dimensional imaging arranged at a plurality of places in the place; and a multiplexing unit for multiplexing the plurality of cameras and the video signal and the video signals of the plurality of three-dimensional cameras. Means, first transmission means for transmitting the multiplexed signal to a second location, portable three-dimensional video display means each of one or more spectators present at the second location, 2, a receiving unit that receives the multiplexed signal, and a second transmitting unit that transmits the received multiplexed signal to the stereoscopic video display unit, wherein the stereoscopic video display unit is , Above multiplex Video transmission system, characterized in that the signal is separated into the respective video signal, there is a the video signal required from the said respective video signal can be selected. 6. The video image transmission system according to claim 5, wherein said stereoscopic image display means supplies predetermined information to said stereoscopic image display means and manages said stereoscopic image display means. A video image transmission system, further comprising communication means for communicating with the management means. 7. The video image transmission system according to claim 5, wherein said stereoscopic image display means multiplexes and displays an image based on said image signal and said selection information. 8. The video image transmission system according to claim 5, wherein said stereoscopic image display means multiplexes and displays an image based on said image signal and a display based on said predetermined information. Video transmission system. 9. The video image transmission system according to claim 7, wherein the three-dimensional image display means further includes a detection means for detecting a movement of a human eye wearing the three-dimensional image display means. The video image transmission system, wherein the display multiplexed on the image based on the image signal is performed based on the detection result.