JPH10336702A - Video display method and video display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enhance a distinguishing sense of a front part and a rear part and a stereoscopic sense by displaying an overlapped center image plane at a deeper position than a position to be displayed in the case of displaying a 2-dimension image. SOLUTION: A high pass filter 25 and a rectifier circuit 26 are used to generate a detection signal Sd in response to the amount of edge information. A detection signal Sd is fed to a variable delay circuit 14L and a detection signal Sd' is fed to a variable delay circuit 14R. Depending on the amount of the edge information, the variable delay circuits 14L, 14R are controlled so as to move a left eye video image and a right eye video image are moved reversely. Then an overlapped center image plane is displayed at a deeper position than a position to be displayed and the dissolved video images are displayed in front of the overlapped center image plane. The left and right video images are respectively displayed on CRTs 20L, 20R. The projected lights pass through a horizontal polarization light filter 21L and a vertical polarization light filter 21R and the left and right video images are overlapped on a screen 22. The user views the left right video images separately by using an eyeglass 23 having polarization filters 24L, 24R to enhance a stereoscopic sense.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an input video signal,
In particular, the present invention relates to a video display method and a video display device capable of enhancing a front-back feeling and a three-dimensional feeling of a displayed object when displaying a video based on a normal two-dimensional image.

[0002]

2. Description of the Related Art Among the three-dimensional display methods, the most feasible one is a three-dimensional display method using left and right parallax information. In this method, two cameras are used at the time of shooting, and a left-eye image and a right-eye image are shot so as to have parallax information. Then, three-dimensional display is possible by reproducing the two images so that the two images appear separately on the left and right eyes.

FIG. 16 shows the principle of stereoscopic operation using binocular (left and right) parallax. On the display surface 1, the left eye image 3L
And a right-eye image 3R shifted horizontally. Normally, the focus of the left and right eyes (2L, 2R) (the point where the left and right lines of sight intersect and is called the point of convergence) and the focus of each eye (2L, 2R) (eye adjustment with a single eye) Matching point) is the same place. Specifically, CR
In T and the like, the CRT surface is a place where the convergence and adjustment are matched, and in a projector and the like, the screen is a place where the convergence and adjustment are matched.

FIG. 16A shows a case of cross congestion. In this case, the video 3R shifted to the left is projected to the right eye 2R, and the video 3L shifted to the right is projected to the left eye 2L. At this time, the image is fused in the head as if there is an object at the position where the left and right eyes are congested. This virtual image 4 </ b> A appears to jump out of the display surface 1. On the other hand, FIG. 16B shows a case of parallel congestion (non-crossing congestion). In this case, the image 3L shifted to the left is moved to the left eye 2
L to the right eye 2
Make it appear in R. In the parallel convergence, the virtual image 4B is fused deeper than the display surface 1.

The use of the principle of the left and right parallax to obtain a three-dimensional effect even in a normal two-dimensional image is to enhance the three-dimensional effect using the Pulfrich effect. The Pulfrich effect (or Pulfrich's law) means that an object that reciprocates right and left in a vertical plane in front of the eye is viewed by both eyes with a filter (ND filter) that reduces light in one eye. The object appears to move in an elliptical trajectory with depth, such as in front of and behind this plane. " For example, as shown in FIG. 17, when the pendulum reciprocating left and right in the plane 6 is seen with the ND filter 5 attached to the left eye 2L, when the pendulum moves from right to left, the plane 6 When the pendulum moves further forward and moves from left to right, on the other hand, it is observed that the pendulum passes behind the surface 6 and the trajectory of the pendulum forms an elliptical trajectory 7.

[0006] The Pulfrich effect occurs because the left eye 2L whose light is weakened has a time lag when transmitting a signal from the eye to the cerebrum, as compared with the right eye 2R which does not weaken the light. That is, in the example of FIG. 17, when the pendulum moves from right to left and is at the position of q, the signal of the left eye 2L is delayed, so that at this moment, the pendulum moves to the left as if it were at the position of p. The eye 2L recognizes. In this way, binocular parallax is generated, and it is felt as if the pendulum is at the N position due to the cross convergence shown in FIG. 16A described above. Conversely, when the pendulum moves from left to right and is at position q, the left eye 2L recognizes the pendulum as if it were at position r. Due to this binocular parallax, it is felt as if the pendulum is at the position of F due to the parallel convergence shown in FIG. 16B.

[0007]

Conventionally, as a method of enhancing the stereoscopic effect of a normal two-dimensional image, a method utilizing the above-described Pulfrich effect is known. However, this method has a drawback that only the object moving in a specific direction is displayed with its three-dimensional effect (feeling of depth), and the effect is not exhibited in a stationary part. In addition, this method has a disadvantage that the three-dimensional effect is affected by the speed and direction of the movement of the object. That is, the sense of depth changes with the speed of the movement, and the direction of the movement determines the foreground and the depth uniquely. As described above, the conventional three-dimensional effect emphasis method can correctly express the three-dimensional effect (depth effect) only for an object moving in a specific direction.

Accordingly, an object of the present invention is to provide a video display method and a video display device that can use a two-dimensional video signal source and can express a three-dimensional effect even in a stationary portion.

[0009]

According to a first aspect of the present invention, there is provided a video display method for receiving a video signal and displaying a video on a display device, wherein edge information of the input video signal is detected, and the detected edge information is added to the detected edge information. Based on the detected anterior-posterior relationship of the subject in the video, based on the detected anterior-posterior relationship, the position of the image is controlled to move in the horizontal direction, and the video having the left-right parallax generated as a result of the control is displayed on the display surface. A video display method for displaying, wherein a center fusion plane of a video having a left-right parallax is set at a position deeper than a display surface.

According to a second aspect of the present invention, in a video display method in which a video signal is input and a video is displayed on a display device, edge information of the input video signal is detected, and a video image is displayed based on the detected edge information. Detects the context of the subject, modulates depth information as stereoscopic information based on the detected context, displays an image having the modulated depth information on a display surface, and centers the image having the depth information. This is a video display method characterized in that the fusion plane is set deeper than the display surface.

According to a ninth aspect of the present invention, in a video display device to which a video signal is input and a video is displayed on a display device, edge information of the input video signal is detected and a video image is displayed based on the detected edge information. Detecting means for detecting the anterior-posterior relationship of the subject, and means for controlling the position of the image to move in the horizontal direction based on the detected anterior-posterior relationship,
An image display device characterized by displaying an image having left and right parallax generated as a result of control on a display surface, and setting a center fusion plane of the image having left and right parallax deeper than the display surface.

According to a tenth aspect of the present invention, in a video display device to which a video signal is input and a video is displayed on a display device, edge information of the input video signal is detected and a video image is displayed based on the detected edge information. Detecting means for detecting the anterior-posterior relationship of the subject, and means for modulating depth information as stereoscopic information based on the detected anterior-posterior relationship, and displaying an image having the modulated depth information on a display surface. ,
An image display device characterized in that a center fusion plane of an image having depth information is set to be deeper than a display surface.

[0013] Video shooting is usually performed using a camera. In many cases, a camera takes a picture mainly at a focused position. In this focused area, the amplitude of the high frequency component of the video signal is often higher than in other areas. Also in the autofocus processing of the video camera, a point having a large amplitude of a high-frequency component is used as a focused point.
Utilizing this property, it is determined whether an area is in focus or not, depending on how much high frequency components are included. In the case of a video taken by a normal video camera, it is customary to determine a focused area as a foreground video without any problem.

Utilizing such a property, in the present invention,
When the left and right parallax is given according to the amount of the high frequency component of the video (object), a sense of front and back (foreground / background) is obtained for each object.
Specifically, even in a normal two-dimensional video source, if the video is captured by a normal camera, a front-back feeling or a pseudo three-dimensional feeling is reproduced. And this effect is independent of the stationary / moving of the object. At this time, the method of fusing the center fusion plane deeper than the display surface, that is, using the method of fusing the image deeper than the display surface (parallel convergence), causes the position of the image itself to be separated from the display surface. Thus, the method of the front-back feeling that gives the left-right parallax works effectively, and a more natural three-dimensional feeling (depth feeling) can be realized. By these operations, a pseudo three-dimensional effect is usually expressed in a two-dimensional video.

[0015]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the present invention will be described below with reference to the drawings. FIG. 1 shows a first embodiment of the present invention. The first embodiment is an example in which the present invention is applied to a projection display using two projectors that respectively display left and right images. In the first embodiment, a horizontal position is controlled in accordance with edge information of an input video signal, thereby generating disparity information between left and right videos.

In FIG. 1, a two-dimensional video signal (composite color video signal) is supplied to an input terminal indicated by reference numeral 11. For example, a television broadcast signal received by an antenna and a tuner is an example of a two-dimensional video signal source. Alternatively, a two-dimensional video signal may be received from a video signal reproducing device using a medium such as analog satellite broadcast, digital broadcast, disk, or tape.

An input color video signal is supplied to a Y / C separation circuit 12.
And a luminance signal Y and a chrominance signal (carrier chrominance signal) C
Are separated. The color signal C is supplied to the color demodulation circuit 13,
Color demodulation is performed. Two color difference signals (RY and BY) from the color demodulation circuit 13 are generated. The luminance signal Y is supplied to the variable delay circuit 14L of the video signal path for the left eye, and the color difference signals RY and BY are supplied to fixed delay circuits 15L and 16L of the video signal path for the left eye, respectively. . Further, similarly to the video signal path for the left eye, the variable delay circuit 14R and the fixed delay circuit 15R are provided in the video signal path for the right eye.
R and 16R are provided. The variable delay circuits 14L and 14R have their delay amounts varied by the detection signals Sd and Sd '. In the description of this specification, reference symbols L and R are used to represent the correspondence between a left-eye image and a right-eye image.

The output signals of the variable delay circuit 14L and the delay circuits 15L and 16L are supplied to a matrix circuit 17L, and the variable delay circuit 14R, the delay circuits 15R and 16R
Is supplied to the matrix circuit 17R. The three primary color signals R and R are output by the matrix circuits 17L and 17R.
G and B are formed. For simplicity, audio signal processing is omitted.

The three primary color signals R, G, B formed by the matrix circuit 17L are supplied to a CRT drive circuit 19L via a preamplifier 18L. The three primary color signals R, G, B formed by the matrix circuit 17R are supplied to a CRT drive circuit 19R via a preamplifier 18R.

Projection CRTs 20L and 20R are driven by CRT drive circuits 19L and 19R, respectively. These CRT drive circuits and CR
T forms two projectors. As a projector, three CRs driven by each primary color signal
It is also possible to use T or a liquid crystal instead of a CRT. Further, the projector can use any of a reflection type and a transmission type configuration.

A left-eye image and a right-eye image generated by the projector are superimposed and displayed at the same position on the screen 22. At the time of this superimposition, the position of the image is not shifted. The left-eye image projected by the CRT 20L is assumed to have passed through the horizontal polarization filter 21L. On the other hand, the right-eye image projected by the CRT 20R is assumed to have passed through the vertical polarization filter 21R.

By using the glasses 23 having the horizontal polarization filter 24L for the left eye and the vertical polarization filter 24R for the right eye, it is possible to separate and view the image projected on the screen 22 by the CRTs 20L and 20R. It becomes possible. Not only horizontal / vertical polarizing filters,
A filter having a different polarization direction, for example, a right-handed / left-handed polarization filter may be used.

In the first embodiment, the variable delay circuit 14
By controlling the horizontal positions of the left and right images in the reverse direction according to the edge information in the input video signal by L and 14R, left and right images having parallax information are generated. At the same time, if the object has a large amount of edge information, it is determined to be the foreground, and the fusion is performed in the foreground by the disparity information. On the other hand, if the object has little edge information, the object is determined to be the foreground (background). Is controlled so that fusion is performed later. The amount of edge information is detected based on the luminance signal Y from the Y / C separation circuit 12. That is, the detection signal Sd is formed by passing the luminance signal Y through the high-pass filter 25 and the rectifier circuit 26.

The high-pass filter 25 detects a high-frequency component in the luminance signal. This high frequency component (differential component)
Includes positive and negative polarity pulses. The rectifier circuit rectifies the output signal of the high-pass filter 25 and generates a detection signal Sd having one of positive and negative polarities. As a configuration for detecting the amount of edge information, a configuration other than the high-pass filter 25 and the rectifier circuit 26 is possible. For example, an edge portion may be extracted by digital signal processing, the magnitude of the edge inclination and the amplitude of the edge may be detected, and a detection signal Sd corresponding to the amount of edge information may be generated.
Further, if a filter or a logic circuit having a function of cutting a DC component, that is, a function of detecting an edge (change) of an image can be configured instead of the high-pass filter 25, the analog-accurate high-pass filter may not be used. .

The variable delay circuit 14L has a delay amount of D−α + Δx, and the variable delay circuit 14R has a delay amount of D + α−Δx. ± α is a fixed delay amount for setting the center fusion plane on the back side of the display surface. Here, the center fusion surface is a surface on which an image determined to be the rearmost is displayed.
Further, for example, (0 ≦ Δx ≦ α), and when α = Δx, the delay amounts of the variable delay circuits 14L and 14R are D
Becomes This is the image that is considered the most foreground,
In that case, an image is displayed on the display surface. actually,
Since the phase of the signal cannot be advanced, the delay time is controlled around the fixed delay amount D. Delay circuit 15
The delay amount of each of L, 15R, 16L, and 16R is D
Fixed to

The detection signal Sd is supplied to the variable delay circuit 14L as a signal for controlling the delay amount Δx of the variable delay circuit 14L, and is also supplied to the inverter 27. The detection signal Sd ′ inverted by the inverter 27 is supplied to the variable delay circuit 14R as a signal for controlling the delay amount Δx of the variable delay circuit 14R. Variable delay circuits 14L and 14R
Then, according to the supplied detection signals Sd and Sd ′,
The variation Δx is varied. Note that the inverter 27 is not limited to the configuration for inverting the polarity, but may be configured to generate a complementary output. In the complementary configuration, when the level of the detection signal Sd is (0 ≦ Sd ≦ 1), a signal having a level of (1-Sd) is generated as the level of the detection signal Sd ′. The detection signals Sd and Sd 'are output from the variable delay circuit 14
L, 14R, the luminance signals in the left and right video signals are reversed in the time axis (that is, ± Δx).
Is modulated. That is, the horizontal position of the left and right images is controlled to move in the opposite direction by the detection signals Sd and Sd '. Further, the control based on the detection signals Sd and Sd ′ reflecting the amount of the edge information causes the object having the edge to be fused to one of the front and the rear.

As the variable delay circuits 14L and 14R, those having the digital circuit configuration shown in FIG. 2 can be used. In FIG. 2, an input terminal denoted by reference numeral 41 has an unillustrated A /
A luminance signal digitized by the D converter is supplied. The luminance signal is sampled at a predetermined sampling frequency, and each sample is converted into 8-bit data.
Reference numeral 42 denotes an input terminal of a sampling clock CK synchronized with the digital luminance signal.

To the input terminal 41, an n-stage latch is connected in series. Each latch has a data input terminal D, a data output terminal Q, and a clock terminal. n stages (n:
The outputs of the 1, 2, 3,..., N) latches are supplied to the selector 43. The outputs of the n-stage latches are delayed by T (T: one cycle of the sampling clock), 2T,..., nT with respect to the input luminance data. Therefore, by selecting one of the input luminance data by the selector 43, it is possible to generate the luminance data delayed for an integral multiple of the clock cycle T. The selector 43 is controlled by the first control signal CTLa.

The sampling clock CK is supplied to the delay circuit 44. The delay circuit 44 delays the sampling clock CK for a time obtained by subdividing one clock cycle T. If a time obtained by equally dividing one clock cycle by m is ΔT (m: 1, 2, 3,..., M), the delay circuit 44
Outputs m sampling clocks each having a delay amount of 0, ΔT, 2ΔT,..., (M−1) ΔT. The delay circuit 44 can be configured by a configuration in which a combination of a plurality of delay lines is changed, a configuration using a time constant circuit, a configuration using a clock having a frequency higher than the sampling clock, and the like.

The sampling clock selected by the selector 45 is supplied to the D / A converter 46. Selector 45
, A control signal CTLb for selecting one of the m sampling clocks is supplied via a latch 49. The digital luminance signal selected by the selector 43 and passed through the latch 47 is supplied to the D / A converter 46. An analog luminance signal is extracted from an output terminal 48 of the D / A converter 46.

In the configuration shown in FIG. 2, when the delay amount is 0, the control signal CTLa controls the selector 43 so that the selector 43 selects a digital luminance signal having a delay amount of n / 2 · T. And m / 2 · Δ
A sampling clock having a delay amount of T
The control signal CTLb controls the selector 45 so that 5 is selected. n / 2 · T and m / 2 · ΔT
Is the center value of the variable delay. This center value corresponds to D-α or D + α described above. In the case of the variable delay circuit 14L, the control signals CTLa and CTLb
Is formed based on the detection signal Sd. In the case of the variable delay circuit 14R, the control signals CTLa and C
TLb is formed based on the detection signal Sd '.

Since the inverter 27 is provided, the amount of delay generated between the variable delay circuits 14L and 14R has the opposite polarity. That is, in the variable delay circuit 14L, (n / 2 · T) + a · T + (m / 2 · ΔT) + b ·
When a delay amount of ΔT is generated, the variable delay circuit 14R
In (n / 2 · T) −a · T + (m / 2 · ΔT)
A delay amount of −b · ΔT occurs. The values a.T + b..DELTA.T and a.T-b..DELTA.T correspond to the variation .DELTA.x. The delay by the variable delay circuits 14L and 14R is for generating parallax information and enhancing the stereoscopic effect.
What is necessary is just to generate a delay amount of the order. Further, ΔT may be about several nsec.

The variable delay circuits 14L and 14R can be constituted by analog circuits shown in FIG. FIG. 3 shows an input terminal 5 to which an analog luminance signal is supplied.
1 and the base of the transistor 52 are connected. The resistor R has the same value as the collector and the emitter of the transistor 52.
Are connected to the positive power supply terminal 53 and the ground, respectively. The collector of transistor 52 is connected to the base of transistor 54 via coil L and capacitor C. A variable resistance element Rc is connected between the emitter of transistor 52 and the base of transistor 54 in parallel with the series circuit of coil L and capacitor C. The collector of the transistor 54 is connected to the power supply terminal 53, the emitter is grounded via a resistor, and the output terminal 55 is led out of the emitter.

An opposite-phase luminance signal is generated at the collector and the emitter of the transistor 52. The signal phase of the collector output is shifted by the coil L and the capacitor C, and is combined at the base of the transistor 54 with the emitter output via the variable resistance element Rc. The phase shift amount, that is, the delay amount α is controlled by the resistance value of the variable resistance element Rc. Therefore, the analog detection signals Sd, S
By controlling the resistance value of the variable resistance element Rc according to d ′, it is possible to control the amount of delay of the luminance signal extracted to the output terminal 55.

As the variable delay circuits 14L and 14R, various types can be used in addition to the configuration shown in FIG. 2 or FIG. For example, a configuration of an analog delay circuit configured by a CCD may be used. Another example is R
A digital circuit configuration using AM can also be used.

As described above, the polarities of the modulation of the left-eye image and the right-eye image are reversed, that is, the movement (modulation) direction of the time axis is reversed. Thereby, when only one eye signal is modulated, 2
Double parallax occurs. In this embodiment, since the variable delay circuits 14L and 14R have a delay time of ± α separately from the changing portion ± Δx, the central fusion plane is located deeper than the display surface, and the detection of the front-rear sense is performed. A method is employed in which the amount of deviation toward the front side from the center fusion plane is controlled by controlling the variation Δx based on the obtained detection signals Sd and Sd ′. In other words, if the detection amount of the preceding high-frequency component is sufficiently large, that is, if it is a focus area, it is determined that the object is a foreground object, and it is more prominent before the center fusion plane, and conversely, if the detection of the high-frequency component is small, In other words, if it is not the focus area, a method of determining the object as a background and adopting a method of slightly reducing the appearance before the center fusion plane is adopted.

With reference to the embodiment of the present invention described above, a process for enhancing the three-dimensional effect (front-back feeling) will be described with reference to FIG. In FIG. 4, the horizontal axis is the time axis (that is, the position in the horizontal direction), and the vertical axis is the level.
Signals S1 and S11 shown in FIGS. 4A and 4B
Are inputs to the variable delay circuits 14L and 14R when -α + Δx and α-Δx are 0. However, the signals S1 and S11 have been delayed by a fixed amount D of the delay amounts of the variable delay circuits 14L and 14R.

The example of FIG. 4A shows a process for a signal (object) S1 having a steep and large front edge E1 and rear edge E2 in the input video signal. Signal S1 is supplied to variable delay circuits 14R and 14L. α-Δx
The output of the variable delay circuit 14R of the delay amount of the variable A and the variable delay circuit 14L of the delay amount of the -α + Δx
Shown as 1L. The signal S1R is displayed on the display surface 91 as a right-eye image 93R, and the signal S1L is displayed on the display surface 91 as a left-eye image 93L. The right-eye image 93R and the left-eye image 93L displayed on the display surface 91 correspond to the right-eye image 92R.
And the left eye 92L.
A is displayed as shown in FIG.

Since the signal S1 shown in FIG. 4A has a steep slope and large front and back edges E1 and E2, the change Δx is large. Thereby, as shown in FIG. 4A, the right-eye image 93R and the left-eye image 9 are displayed on the display surface 91.
The deviation from 3L is reduced. As described above, by increasing the value of the change Δx, the amount of movement from the reference position to which ± α is added increases, and the parallax information decreases.
As a result, the virtual image 94 </ b> A is fused at a position protruding considerably before the center fusion surface 95, that is, near the display surface 91.

In the example of FIG. 4B, a process for a signal (object) S11 having a front edge E11 and a rear edge E12 with a gentle inclination in the input video signal is shown. Signal S11
Is supplied to variable delay circuits 14R and 14L, and output signals thereof are indicated by S11R and S11L. Signal S
11R is displayed on the display surface 91 as a right-eye image 93R, and the signal S11L is displayed on the display surface 91 as a left-eye image 93L. Right eye image 93R displayed on display surface 91
And the left eye image 93L are composed of the right eye 92R and the left eye 92L.
And displayed as shown in the virtual image 94B.

Since the signal S11 shown in FIG. 4B has a front edge E11 and a rear edge E12 with gentle slopes, the change Δx is small. Thereby, FIG. 4B
As shown in the figure, there is a large difference between the right-eye image 93R and the left-eye image 93L on the display surface 91. As described above, by reducing the value of the change Δx, the amount of movement from the reference position to which ± α has been added is reduced, and the parallax information is large. As a result, the virtual image 94B is fused near the center fusion plane 95.

As described above, the center fusion surface 95 is connected to the display surface 91.
Instead, it is set farther than the display surface 91. That is, by the fixed delay amount α, the left-eye image 93L is moved to the left by a certain amount, and the right-eye image 93R is moved to the right by that amount. The display position of the image is modulated left and right by controlling the variation Δx in accordance with.

More specifically, as shown in FIG. 4A, when a signal containing a steep and large edge is supplied and the signal is determined to be the foreground, the change Δx has a large value, and the delay time of the variable delay circuit 14L ( D−α + Δx) increases, so that the left-eye image 93L moves rightward on the display surface 91. on the other hand,
Since the delay time (D + α−Δx) of the variable delay circuit 14R decreases, the right-eye image 93R moves to the left on the display surface 91. This results in less parallax information and, as a result,
The virtual image 94 </ b> A appears to be considerably protruded from the central fusion plane 95.

As shown in FIG. 4B, when a signal containing a gentle edge is supplied and the background is determined, the change Δx becomes a small value, and the increase in the delay time of the variable delay circuit 14L decreases. Therefore, the left-eye image 93L moves little to the right on the display surface 91. On the other hand, since the decrease in the delay time of the variable delay circuit 14R is reduced, the right-eye image 93R is less likely to move leftward on the display surface 91. As a result, the amount of reduction in the parallax information is small, and the virtual image 9
4B appears to have a smaller amount of protrusion toward the display surface 91 side than the central fusion surface 95.

As described above, a comparison between the case of the edge having a high sharpness as shown in FIG. 4A and the case of the gentle edge as shown in FIG. 4B shows that the sharpness of the left and right images is high. It can be seen that the amount of parallax information is smaller in the case of a high edge. The fact that the amount of parallax information is small means that the image is fused closer to the display surface, and the parallax information is reduced as the image is closer to the foreground.

In the above description, a method of fusing an image deeper than a display surface using parallel convergence has been described. Specifically, when an image is fused by parallel convergence, the center fusion plane 95, which is the deepest surface (background) of the image, is used as a reference for convergence, and as shown in FIG. The left and right parallaxes are set so that the edge part having a high degree is considerably in front, and the delay amount is set such that left and right parallax is set so that the gentle edge part is slightly in front of the center fusion plane as shown in FIG. 4B. Is modulated.

By changing the amount of parallel convergence (the delay amount ± α of the variable delay circuits 14L and 14R) of the central fusion plane serving as the reference, the background (reference) of the fused image can be set at an arbitrary position. It is possible to move. For example, if the delay amount α is set to be sufficiently large, the central fusion plane is fused considerably deeper than the display surface. In this case, although the amount of change Δx in the left and right parallax for which the detection of the front and rear sensation (left and right parallax) is detected does not change, the absolute value of the left and right parallax increases, so that the modulated front and rear sensation (three-dimensional feeling) is emphasized. .

When the absolute value of the delay amount α is decreased with the same polarity as described above, it is felt that there is an image fused around the display surface 91. When the delay amount α = 0, the background (the center fusion surface 95) is on the display surface 91, and the focus point with sharpness appears to be fused before the display surface 91. If the polarity of the delay amount α is reversed, the entire image is fused before the display surface 91.
At this time, the fused image looks smaller than the actual size on the display surface (see FIG. 15A).

As shown in FIG. 5A, the left-right parallax amount on the display surface 91 is a, the standard human eye width is 65 mm, and the distance between the display surface 91 and the human eye 92 is 1 m (= 1000 m).
m), the depth X ₀ at which the image is fused is a / X ₀ = 65 / (1000 + X ₀ ), and therefore X ₀ = (1000 × a) / (65−a).

[0050] As can be seen from the graph shown in equation or Figure 5B, as can be seen from equation of the left and right parallax amount a and the depth X ₀ of the display surface 91, the parallax amount on the display surface 91 is 6
When the distance decreases from 5 mm and the left-right parallax amount a <0, the state shifts from parallel convergence to cross convergence. That is, when the left-right parallax amount a on the display surface 91 is in the range of (65 mm ≧ a> 0), parallel convergence occurs, and in the range of (0> a), cross convergence occurs. As can be seen from FIG. 5B, when the intersection convergence occurs, the ratio of the change of the depth sensation (the front-back sensation) to the left-right parallax a on the display surface 91 (ie, the sensitivity) decreases. For this reason, when the cross convergence is used, the front-back sensation (three-dimensional sensation) obtained by modulating the left-right parallax by detecting the front-back sensation is reduced as compared with the case where the parallel convergence is used as in the present invention. By changing the reference congestion amount in this way, it is possible to select a preferable image.

As described above, when the image is stereoscopically viewed due to the cross convergence, the image looks smaller than the actual size on the display surface, and the change in the sense of depth (the sense of front and rear) with respect to the left-right parallax amount a on the display surface 91. (Ie, the sensitivity) decreases. Based on such points, the present invention employs parallel congestion.

FIG. 6 shows a modification of the first embodiment of the present invention. Parts corresponding to those in FIG. 1 are denoted by the same reference numerals. The difference from the configuration of FIG.
Instead, a fixed delay circuit 14R 'is used.
In the configuration of FIG. 1, the left-eye video signal and the right-eye video signal are controlled so as to be delayed in opposite directions. However, in the configuration of FIG.
Only one left-eye video signal is controlled, and a fixed delay is given to the right-eye video signal. Since the control is performed in one direction, the amount of delay is halved compared to the control in both directions, but only one variable delay circuit may be used.

In FIG. 6, a fixed delay (D + α) is given to the right eye video signal, and the delay amount (D
+ Α), the amount of delay is controlled by giving a change Δx. However, by giving a fixed delay to the left-eye video signal and giving a change Δx to the right-eye video signal, the amount of delay is reduced. It goes without saying that the same configuration and effect can be obtained even if the control is performed.

Although the time axis (position in the horizontal direction) is controlled only for the luminance signal, the two color difference signals may be controlled similarly to the luminance signal. In general, the resolution of the color difference signal is harder to be perceived as compared to the luminance signal, and therefore, control of only the luminance signal has an effect of enhancing the three-dimensional effect (front-back feeling).

Next, a second embodiment of the present invention will be described. In the above-described first embodiment, two projector CRTs are used, whereas in the second embodiment, the input video signal is subjected to a field doubling process, and Use a CRT. As an example,
The first field of the two fields forming a pair of the field doubled video signal is defined as a left-eye video signal, and the second field doubled is a right eye video signal.

FIG. 7 shows the configuration of the second embodiment of the present invention. The luminance signal Y and the color signal C corresponding to the composite color video signal from the input terminal 11 are obtained by the Y / C separation circuit 12. The luminance signal Y is applied to the field doubling circuit 6
1 and the color signal C is supplied to the color demodulation circuit 13. The two color difference signals from the color demodulation circuit 13 are supplied to a field doubling circuit 61. Field doubling circuit 6
1 generates a video signal whose field frequency is doubled from the input video signal.

FIG. 8 shows the processing by the field doubling circuit 61. In FIG. 8, the color difference signal is omitted for simplicity. When an input luminance signal Y (FIG. 8A) having a field period Tv (1/60 second in the case of the NTSC system and 1/50 second in the case of the PAL system and the SECAM system) is supplied, the field period is reduced to １ ／. An output luminance signal of Tv (FIG. 8B) is formed. That is, a pair of fields A1 and A2 having a double field frequency is formed from the field A of the input luminance signal, and a pair of fields B1 and B2 having a double field frequency is formed from the field B. FIG. 8C shows a pulse signal 2V whose level is inverted every double speed field. Such doubling processing can be performed by a configuration in which the video signal is digitized and the time axis is compressed by a digital memory.

In the second embodiment, the first field (A1, B1,...) In which the pulse signal 2V synchronized with the double-speed field is at a high level is used as a left-eye video signal, and is used at a low level. Certain second fields (A2, B
2,...) Are used as right-eye video signals. A field double speed luminance signal 2Y and a field double speed color difference signal 2 (RY), 2 (BY) are output from the field double speed circuit 61.
Occurs.

The double-speed luminance signal 2Y is supplied to a variable delay circuit 62, and the double-speed color difference signals 2 (RY) and 2 (BY) are supplied to fixed delay circuits 63 and 64, respectively. Further, the double-speed luminance signal 2Y is supplied to the high-pass filter 25, and the output signal of the high-pass filter 25 is supplied to the rectifier circuit 26. The high-pass filter 25 and the rectifier circuit 26 generate a detection signal Sd according to the amount of edge information in the luminance signal, as in the first embodiment. Inverter 27 forms detection signal Sd ′ complementary to detection signal Sd.

The detection signals Sd and Sd ′ are supplied to two input terminals of the switching circuit 65, respectively. The output of the switching circuit 65 is supplied to the variable delay circuit 62 as a signal for controlling the delay amount α. The switching circuit 65 supplies the detection signal Sd to the variable delay circuit 62 during the period when the pulse signal 2V is at the high level, that is, during the left-eye video signal, and during the period when the pulse signal 2V is at the low level, that is, during the right-eye period. During the period of the video signal for use, the detection signal Sd ′ output from the inverter 27 is
2 is supplied. Therefore, in the variable delay circuit 62, the left-eye video signal is delayed by the detection signal Sd, and the right-eye video signal is delayed by the detection signal Sd '.

The luminance signal from the variable delay circuit 62 and the two color difference signals from the fixed delay circuits 63 and 64 are supplied to the matrix circuit 17. By the matrix circuit 17,
The field double speed three primary color signals 2R, 2G, and 2B are formed. Three primary color signals are preamplifier & CRT drive circuit 6
6 to the CRT 200. CRT200
Is configured to be able to display a field double speed color video signal. That is, the vertical scanning frequency and the horizontal scanning frequency of the CRT 200 are set to be twice those frequencies when displaying a non-double-speed video signal. CRT200
The left-eye video signal and the right-eye video signal having the parallax information generated by the variable delay circuit 62 are displayed in the double-speed field.

Further, left and right shutters 224L, 224
By wearing and watching the glasses 223 provided with R,
The left and right eyes respectively see the left-eye image and the right-eye image. As the shutters 224L and 224R,
A shutter that can be electrically turned on / off, for example, a liquid crystal shutter can be used. Shutter 224L, 22
4R is controlled to perform an ON / OFF operation by a pulse signal synchronized with the pulse signal 2V. As an example, the pulse signal 2V is received from the receiver side by infrared transmission, and while the pulse signal 2V is at a high level, the shutter 224L is turned on and the shutter 224R is turned off.
FF, and when the pulse signal 2V is at the low level, O
Invert the N / OFF state. Thereby, CRT
The left-eye image and the right-eye image displayed by 200 can be viewed by the left and right eyes, respectively.

In the second embodiment of the present invention shown in FIG. 7, the delay amount of only one of the left-eye video signal and the right-eye video signal is made variable, and the other is fixed. Control may be performed as follows.

In the first and second embodiments of the present invention described above, the sense of front and rear is detected based on edge information, and the edge information is detected based on a luminance signal.
According to the present invention, the edge information may be detected based on the three primary color signals R, G, and B in addition to the luminance signal.

FIG. 9 shows a first example of a configuration for detecting edge information based on the three primary color signals R, G, and B, and FIG.
10 is shown in FIG. 10, and a third example is shown in FIG. These three configuration examples are obtained by applying the present invention to the first embodiment of the present invention shown in FIG. 1 or FIG. A luminance signal from the Y / C separation circuit 12 and two color difference signals from the color demodulation circuit 13 are supplied to a matrix circuit 67.

The three primary color signals R, G and B generated by the matrix circuit 67 are supplied to the maximum value detection circuit 68. The maximum value detection circuit 68 detects the maximum value among the three primary color signals R, G, and B, and outputs the detected maximum value. The output signal of the maximum value detection circuit 68 is supplied to the rectification circuit 26 via the high-pass filter 25, and the rectification circuit 26 outputs the detection signal S
d occurs. The detection signal Sd is generated based on the signal detected as the maximum among the three primary color signals.

The delay amount of the variable delay circuit 14L is controlled by the detection signal Sd from the rectifier circuit 26. This control is performed so that the stereoscopic effect is enhanced based on the edge information, as described above. The luminance signal Y from the variable delay circuit 14L, the color difference signal (RY) from the fixed delay circuit 15L, and the color difference signal (B−
Y) is supplied to the matrix circuit 17. In the configuration of FIG. 1, the detection signal Sd is supplied to the variable delay circuit 1 via the inverter.
4R.

In the configuration shown in FIG.
7, the three primary color signals are output from the high-pass filter 25R,
25G and 25B. Outputs of the high-pass filters 25R, 25G, 25B are supplied to rectifier circuits 26R, 26G, 26B. Rectifier circuit 26
The output signals of R, 26G, and 26B are supplied to the maximum value detection circuit 69. The maximum value of the output signals of the rectifier circuits 26R, 26G, 26B is taken out as the detection signal Sd at the output of the maximum value detection circuit 69. The configuration of FIG. 10 performs a process of generating a detection signal based on each of the three primary color signals, and outputs the maximum value of the generated signals as a detection signal Sd.

In the third example shown in FIG. 11, FIG.
Similarly to 0, the three primary color signals formed by the matrix circuit 67 are supplied to the high-pass filters 25R, 25G, and 25B, respectively. High-pass filters 25R, 25G, 25B
Are supplied to the rectifier circuits 26R, 26G, 26B. The output signals of the rectifier circuits 26R, 26G, 26B are supplied to the maximum value detection circuit 69. Rectifier circuit 26
The maximum value among the output signals of R, 26G, and 26B is detected by the maximum value detection circuit 69. The detected maximum value is supplied to the area extension / detection circuit 100, and the detection signal Sd
Is taken out. The configuration of FIG. 11 performs a process of generating a detection signal based on each of the three primary color signals, and generates a detection signal Sd based on the maximum value of the generated signals.

In the area extension / detection circuit 100, the area surrounded by the outer edge of the target object is processed as the area of the target object. That is, the area extension / detection circuit 100 first detects a block including an external edge, and then detects an area surrounded by the block including the external edge. Then, a block including the outer edge and a region surrounded by the block including the outer edge are combined to form a target object region. Specifically, as shown in FIG. 12A, the area of the target object is detected from a block expanded from the basic block to the number of MAXH blocks in the X direction and to the number of MAXV blocks in the Y direction. Although the outer edge of the target object is almost included in the enlarged block, but it is difficult to include the entire area of the object just by including the edge, as shown in FIG. Is performed so as to fill the space between the blocks including.
The region 101 is a region including blocks including external edges, and the region 102 is a region surrounded by blocks including external edges.

As described above, in the area extension / detection circuit 100, in the process of detecting the sense of front and back from the sharpness of the edge information, the edge information on which the sense of front and back is detected is estimated.
As the image is further extended, the sense of front and rear is detected in units of regions.
By giving the left and right parallax for each of the detected regions, a sense of front and rear for each region can be obtained. A detection signal Sd is output from the area expansion / detection circuit 100 based on the sense of front and rear for each area.

The method of detecting the sense of front and rear based on the three primary color signals R, G and B is different from the method of detecting this from the luminance signal in that the matrix circuit 67 and the maximum value detection circuits 68 and 6 are used.
9. Although the area expansion / detection circuit 100 is required, a more natural sense of front and rear can be generated. The configuration shown in FIG. 9, FIG. 10, or FIG. 11 can be applied not only to the first embodiment using the projector but also to the second embodiment using the double-speed field processing.

Further, in the third embodiment of the present invention, a glasses-type liquid crystal display device is used in addition to the projector and the field double-speed CRT. FIG.
Shows an example of such a display device. FIG. 13A and FIG.
FIG. 3B is a view of the eyeglass-type liquid crystal display device (indicated by reference numeral 70) mounted on a human head, as viewed from above and from the side, respectively. The display device 70 is mounted on the head by strings 71 and elastic bands 72 and 73. The optical system including the liquid crystal display is configured inside a box 74 attached to the front.

FIG. 14 schematically shows an optical system formed in the box 74. The color liquid crystal display panel indicated by 81 is
It is driven based on the supplied video signal. Two liquid crystal display panels, each of which can be seen by the left and right eyes, are used. FIG. 14 shows the configuration on one side. 80
Is a backlight such as a white fluorescent tube, and 82 is a diffuser (diffusion plate).

The display light of the liquid crystal display panel 81 is reflected by the half mirror 83 and enters the concave half mirror 84. The image light reflected by the concave half mirror 84 enters the eye 85 through the half mirror 83. Therefore, the image on the liquid crystal display panel 81 can be viewed through the half mirror 83. Since the concave half mirror 84 is provided, the user can feel as if a larger image is displayed farther than the actual position of the concave half mirror 84.
For example, at a distance of about 2 m from the position of the eye 85, it can be felt that the image 86 is virtually displayed with the size of a 52-inch screen.

The two liquid crystal display panels 81 are provided so that they can be viewed separately by the left and right eyes.
By displaying the left-eye image and the right-eye image processed in the same manner as in the first embodiment on each liquid crystal display panel, the stereoscopic effect can be enhanced. FIG. 15 shows a signal processing system when such a glasses-type liquid crystal display is used. The three primary color signals processed in the same manner as in the configuration of FIG.
Supplied to The liquid crystal display panels 29L and 29R are driven by the outputs of the liquid crystal drive circuits 28L and 28R, respectively. Further, even when only one liquid crystal display panel is used, the stereoscopic effect can be enhanced by using the field double speed processing and the shutter as in the second embodiment.

Further, as another example slightly different from the form of the display device 70 shown in FIG. 13, there is no use of the bands 72, 73, and the display device 70 hangs down on the front of the head or is positioned at the front of the head. It is possible to envisage one with two small displays (not limited to liquid crystal displays). However, in using two small displays, the signal processing is the same as the signal processing shown in FIG. That is, the liquid crystal display panels 29L and 29R are driven by the liquid crystal drive circuits 28L and 28R.

In the fourth embodiment (not shown) of the present invention, the sense of front and rear is detected in the same manner as in the above-described first embodiment using the luminance signal or the three primary color signals.
The depth information is controlled (modulated) instead of the horizontal position according to the detection result. For example, a plurality of liquid crystal display panels are stacked, the foreground is displayed on the front liquid crystal display panel, and the background is displayed on the rear liquid crystal display panel.
A display that can display depth information other than the multilayer liquid crystal display panel may be used.

[0079]

According to the present invention, by controlling the amount of delay between the right-eye image and the left-eye image using a two-dimensional image signal source, the center fusion plane, virtual image, etc. Since the front and rear positions can be controlled, it is possible to display a video in which the front-back feeling and the three-dimensional feeling are emphasized. With the conventional method using Pulfrich's law, the three-dimensional effect can be increased only for a moving object.However, the present invention can be applied not only to a moving object but also to a stationary object with a relatively simple circuit. The feeling and the three-dimensional effect can be enhanced.

Further, when a two-dimensional video source is displayed stereoscopically using cross-convergence, the displayed image is reduced. In the present invention, however, the two-dimensional video signal source is stereoscopically displayed using parallel congestion. Since the display is performed, there is no such a problem, and since the parallel convergence is used, the sensitivity to the left-right parallax amount increases as compared with the cross convergence.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment of the present invention.

FIG. 2 is a connection diagram illustrating an example of a variable delay circuit according to the first embodiment;

FIG. 3 is a connection diagram of another example of the variable delay circuit in the first embodiment.

FIG. 4 is a schematic diagram for explaining the operation of the first embodiment of the present invention.

FIG. 5 is a schematic diagram for explaining the operation of the first embodiment of the present invention.

FIG. 6 is a block diagram showing a modification of the first embodiment of the present invention.

FIG. 7 is a block diagram showing a second embodiment of the present invention.

FIG. 8 is a timing chart for explaining a field doubling process according to the second embodiment.

FIG. 9 is a block diagram showing a first example of a configuration for detecting a sense of front and rear;

FIG. 10 is a block diagram showing a second example of a configuration for detecting a sense of front and rear.

FIG. 11 is a block diagram illustrating a third example of a configuration for detecting a sense of front and rear;

FIG. 12 is a schematic diagram used for describing area extension and detection.

FIG. 13 is a schematic diagram used for describing a glasses-type display device used in a third embodiment of the present invention.

FIG. 14 is a schematic diagram used for description for optical description of a glasses-type display device.

FIG. 15 is a block diagram of a third embodiment using a glasses-type display device.

FIG. 16 is a schematic diagram for explaining a method of enhancing a three-dimensional effect by disparity information.

FIG. 17 is a schematic diagram for explaining Pulfrich's law as an example of a method of enhancing a three-dimensional effect by parallax information.

[Explanation of symbols]

14L, 14R: variable delay circuit, 21L, 24L
..Horizontal polarization filters, 21R, 24R: vertical polarization filters, 25: high-pass filters, 26: rectifier circuits, 61: field doubler circuits

 ────────────────────────────────────────────────── ─── Continuing on the front page (72) Inventor Kazuhiko Fujiwara Sony Corporation, 6-7-35 Kita Shinagawa, Shinagawa-ku, Tokyo

Claims (10)

[Claims] 1. A video display method for receiving a video signal and displaying a video on a display device, comprising detecting edge information of the input video signal and determining a front-back relationship of a subject in the video based on the detected edge information. Detecting, controlling to move the position of the image in the horizontal direction based on the detected anteroposterior relation, displaying the image having the left-right parallax generated as a result of the control on the display surface, and having the left-right parallax. An image display method, wherein a center fusion plane of an image is set at a position deeper than the display surface. 2. A video display method in which a video signal is input and a video is displayed on a display device, wherein edge information of the input video signal is detected, and a front-back relationship of a subject in the video is determined based on the detected edge information. Detecting, modulating depth information as stereoscopic information based on the detected context, displaying an image having the modulated depth information on a display surface, and a center fusion plane formed by the image having the depth information. Is set deeper than the display surface. 3. The video display method according to claim 1, wherein the edge information is detected from a luminance signal in a color video signal. 4. The video display method according to claim 1, wherein the edge information is detected from three primary color signals. 5. The image display method according to claim 1, wherein the center fusion plane is changed to an arbitrary position. 6. The video display method according to claim 1, wherein an amount of left / right parallax or depth information is varied according to the detected context. . 7. The image display method according to claim 1, wherein the central fusion plane is changed to an arbitrary position, and the amount of left-right parallax or depth information is determined according to the detected front-rear relationship. The image display method characterized by making it variable. 8. The image display method according to claim 1, wherein the context is detected from the detected edge information,
A video display method comprising: estimating an area having the anterior-posterior relation; and adding left and right parallax to each of the estimated areas. 9. A video display device that receives a video signal and displays a video on a display device, detects edge information of the input video signal, and determines a front-back relationship of a subject in the video based on the detected edge information. Detecting means for detecting, and means for controlling the position of the image to move in the horizontal direction based on the detected front-to-back relation, displaying on the display surface an image having left and right parallax generated as a result of the control An image display device, wherein a center fusion plane of an image having the left-right parallax is set deeper than the display surface. 10. A video display device that receives a video signal and displays a video on a display device, detects edge information of the input video signal, and determines a front-back relationship of a subject in the video based on the detected edge information. Detecting means for detecting, and means for modulating depth information as stereoscopic information based on the detected context, displaying a video having the modulated depth information on a display surface, and displaying the depth information An image display device, wherein a central fusion plane of an image having a depth is set at a position deeper than the display surface.