JP2012100084A - Stereoscopic image display device and stereoscopic image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate confirmation of a superimposed image by making it easy to concentrate on observation of a stereoscopic image.SOLUTION: A signal input part 101 acquires a signal containing a stereoscopic image signal. A right and left image separation part 102 separates the stereoscopic image signal acquired by the signal input part 101 into a right-eye image signal and a left-eye image signal. An expansion/reduction part 104 changes the right-eye image signal and the left-eye image signal with the centers of respective expansion and reduction as reference points. A right and left image composition part 105 composes the right-eye image signal and the left-eye image signal expanded or reduced by the expansion/reduction part 104. A display 106 displays the stereoscopic image signal composed by the right and left image composition part 105.

Description

  The present invention relates to a stereoscopic video display apparatus and a stereoscopic video display method that enable an observer to stereoscopically view a left-eye video and a right-eye video by observing the left-eye video and the right-eye video with the left eye and the right eye, respectively.

  As a method of displaying emergency broadcasts and other telops on the screen while viewing a 3D broadcast program without losing the stereoscopic effect of the 3D image, the pilot lamp is turned on when the received signal contains telop data, and the observer Japanese Laid-Open Patent Publication No. 10-327430 (Patent Document 1) discloses a technique in which telop information to which parallax is added is OSD-displayed on a video display unit when a remote controller operation is noticed. Japanese Laid-Open Patent Publication No. 2006-32516 (Patent Document) discloses a technique for recognizing a stereoscopic image and a stereoscopic object to which a telop is to be added within the frame and automatically adding a telop with parallax added to the side of the stereoscopic object. 2).

Japanese Patent Laid-Open No. 10-327430 JP 2006-32516 A

However, in the technique disclosed in Patent Document 1, since the observer concentrates on the close-up image of the stereoscopic image when viewing the stereoscopic image, the pilot lamp located at the distance of the display device is not aware of the pilot lamp. There were problems such as being unable to concentrate on the close-up video because the eye congestion was away from the close-up video. Also, in the technology for providing a telop in a stereoscopic video disclosed in Patent Document 2, since it is not only a telop related to a video object, an appropriate display cannot be performed for a telop not related to a video object. There was no problem.
Therefore, the present invention makes it easy to concentrate for observation in the observation of stereoscopic images, and thereby facilitates confirmation of telops and various OSDs (hereinafter referred to as superimposed images). An object is to provide a display device.

In order to solve the above-described problems, the present invention provides the following three-dimensional image display devices (a) to (d) and the three-dimensional image display method (e).
(A) a video signal input unit (101) for inputting a video signal including a stereoscopic video signal, a left-right video separation unit (102) for separating the input stereoscopic video signal into a left-eye video signal and a right-eye video signal, The left-eye video signal and the right-eye video signal are changed with the first reference point that is the center for scaling the left-eye video and the second reference point that is the center for scaling the right-eye video as the reference points. An enlargement / reduction unit (104), a left / right video synthesis unit (105) that synthesizes the changed left-eye video signal and the right-eye video signal, and a video signal obtained by synthesizing the left-eye video signal and the right-eye video signal. A display unit (106) that displays the image so as to be perceived as an image, and the left and right image synthesis unit sets the interval between the first reference point and the second reference point on the display unit before and after the enlargement or reduction. And the enlargement / reduction portion is not Stereoscopic image display apparatus characterized by setting a reference point and the upper second direction parallel to the same line of left and right images are shifted to a reference point as a base of the binocular parallax.
(B) a superimposed image generation unit (202) that generates a left-eye superimposed image signal and a right-eye superimposed image signal having parallax, and a left-eye video signal and a right-eye video signal before being input to the left-right video synthesis unit And a superimposed image combining unit (203) for respectively combining the left-eye superimposed image signal and the right-eye superimposed image signal having the parallax, and the left-eye superimposed image signal and the right-eye superimposed image signal having the parallax. Are combined with the left-eye video signal in order to reduce the left-eye video signal and the right-eye video signal, respectively, with the first reference point and the second reference point as the center. The stereoscopic video display device according to (a), wherein the right-eye video signal is changed.
(C) The three-dimensional image display device according to (a) or (b), wherein at least one of the first reference point and the second reference point is located outside the display screen.
(D) The stereoscopic video signal display device according to (b) or (c), wherein the positions of the first reference point and the second reference point are set according to a position where the superimposed image is displayed.
(E) a video signal input step for inputting a video signal including a stereoscopic video signal, a left-right video separation step for separating the input stereoscopic video signal into a left-eye video signal and a right-eye video signal, a left-eye video and a right-eye The left eye video signal and the right eye with the respective centers of enlargement / reduction set as the first reference point and the second reference point on the same line parallel to the direction in which the left and right images that are the basis of binocular parallax are shifted An enlargement / reduction step for changing the video signal for the image, and the changed left-eye video signal and the right-eye video signal without changing the interval on the display portion between the first reference point and the second reference point before and after the enlargement / reduction. 3D video display method, comprising: a left and right video synthesis step for synthesizing the video signal; and a display step for displaying the video signal obtained by synthesizing the left-eye video signal and the right-eye video signal so as to be perceived as a stereoscopic video. .

  According to the three-dimensional image display device of the present invention, it is possible to facilitate the concentration for observation, thereby facilitating the confirmation of the superimposed image.

It is a figure for demonstrating the example of imaging | photography with a stereoscopic camera, and the display by a stereoscopic video display apparatus. It is a figure for comparing the image formation position at the time of displaying on a stereo image display apparatus, after expanding and reducing the stereo image image | photographed with the stereo camera. It is a block diagram which shows the structure of the three-dimensional video display apparatus based on Embodiment 1 of this invention. It is a flowchart for demonstrating operation | movement of the three-dimensional video display apparatus based on Embodiment 1 of this invention. It is a figure which shows the example of a display at the time of image expansion / reduction. It is a figure for demonstrating the change of the image formation position before and behind the image expansion / reduction of the image | video located in a reference point. It is a figure for demonstrating the change of the image formation position before and behind the expansion / contraction of the image | video imaged in a close distance position with respect to an observer. It is a block diagram which shows the structure of the three-dimensional video display apparatus based on Embodiment 2 of this invention. It is a flowchart for demonstrating operation | movement of the stereoscopic video display apparatus based on Embodiment 2 of this invention. It is a figure which shows the example of a display of a superimposed image. It is a figure for demonstrating the change of the image formation position of a display image before and after a superimposed image display.

FIG. 1A is a diagram illustrating a situation in which a subject is photographed with a stereoscopic camera, and the positional relationship between the left and right cameras and the subject is indicated by xy coordinates. The left camera coordinates are (0, b), the right camera coordinates are (0, d), and the subject coordinates are (e, f). FIG. 1B is a diagram illustrating a state in which the image captured in FIG. 1A is displayed on the stereoscopic image display device, and the coordinates of the left eye of the observer are illustrated in FIG. It is assumed that the coordinates of the right camera of the observer are the same (0, b) and the coordinates of the right eye of the observer are the same (0, d) as the coordinates of the right camera in FIG.
When the video shot in FIG. 1A is displayed on the display device at the position of x = g, the subject video shot by the left camera is displayed at coordinates (g, i), and the subject video shot by the right camera is coordinated. When the observer observes the display device, the subject image at coordinates (g, i) is visible to the left eye, but the subject image at coordinates (g, h) is not visible, and the coordinate image ( In the case of a stereoscopic video display device configured such that the subject video of g, h) can be seen but the subject video of coordinates (g, i) cannot be seen, the viewer looks as if the subject is in coordinates (e ′, f ′). ) Is visible as though it is located. The video at coordinates (g, i) is the left-eye video, and the video at coordinates (g, h) is the right-eye video.

A line extending from the left and right cameras shown in FIG. 1A to the subject, and a line extending from the left and right eyes of the observer shown in FIG. , Referred to as right gaze.
From the left camera coordinates (0, b) and subject coordinates (e, f) in FIG.
y = (f−b) x / e + b Equation 1
Similarly, from the right camera coordinates (0, d) and subject coordinates (e, f) in FIG.
y = (f−d) x / e + d Equation 2

Since the left and right eye coordinates in FIG. 1B and the left and right camera coordinates in FIG. 1A are the same, the imaging position coordinates (e ′, f ′) in FIG. 1B and FIG. In order for the subject coordinates (e, f) of () to be the same, the left / right line of sight in FIG. 1 (B) needs to be the same as the left / right line of sight in FIG. 1 (A).
If the x coordinate of the display device is g in FIG. 1B, the y coordinate (i) of the left-eye video and the y coordinate (h) of the right-eye video on the display device are expressed by the following equations 3 and 4, respectively. I will.
i = (f−b) g / e + b Equation 3
h = (f−d) g / e + d Equation 4

Next, the imaging position of the stereoscopic image that can be seen by the observer is calculated from the left and right eye coordinates, the left-eye image coordinates, and the right-eye image coordinates.
From the left-eye coordinates (0, b) and the left-eye video coordinates (g, i) in FIG.
y = (ib) x / g + b Formula 5
Similarly, from the right eye coordinates (0, d) and the right eye image coordinates (g, h) in FIG.
y = (h−d) x / g + d Equation 6
By obtaining the intersection of the left line of sight and the right line of sight from Expression 5 and Expression 6, the x coordinate (e ′) and y coordinate (f ′) of the imaging position of the stereoscopic image are expressed by Expression 7 and Expression 8, respectively. Is done.
e ′ = (db) g / (ib−h + d) Expression 7
f ′ = (h−d) ((d−b) g / (i−b−h + d)) / g + d Expression 8

FIG. 2 shows the result of calculating these coordinate numerical values for conditions 1 to 8 by setting four types of subject coordinates. The left eye coordinates are the same as the left camera coordinates, and each condition is (0, 30). The right eye coordinates are the same as the right camera coordinates, and each condition is (0, -30). The unit of coordinates set here is mm, that is, the base line length of the photographing means is 60 mm, and the interocular distance of the observer is also 60 mm.
The y-coordinate (f) of the subject at the time of shooting is set to 50 mm in common for each condition, but the x-coordinate (e) is set to four types of 850 mm, 1700 mm, 4000 mm, and 100,000 mm. Here, since the x coordinate of the display device is 1700 mm, one of the four types of subjects is set closer to the display device, one is the same as the distance to the display device, and two are further from the display device. .

  The y-coordinate (i) of the left-eye image is obtained from the subject coordinates and the expression 3 at the time of shooting, and similarly, the y-coordinate (h) of the right-eye image is obtained from the expression 4. The x coordinates of the left-eye video and the right-eye video are all 1700 mm. Further, the x-coordinate (e ′) of the stereoscopic image imaging position is obtained from the left-eye video coordinate and the right-eye video coordinate and Expression 7, and similarly, the y-coordinate (f ′) of the stereoscopic image imaging position is obtained from Expression 8. . The values of e ′ and f ′ calculated in this way are shown in the column of stereoscopic image imaging coordinates before deformation in FIG. It can be confirmed that the coordinates (e ′, f ′) have the same value as the coordinates (e, f) of the subject position during shooting.

Each coordinate when the stereoscopic image is enlarged or reduced is shown in the column after transformation in FIG.
The magnification N is an enlargement magnification of the video imaged on the display screen. Conditions 1 to 4 are magnified 2 times, and conditions 5 to 8 are 0.5 times, that is, reduced to half.
When shooting an object at infinity, the image at the position corresponding to the parallel optical axis of the left and right cameras shows the same part of the same subject, but the position on the display screen where this part of the left-eye image is shown The distance from the position on the display screen where this part of the right-eye video image is projected is referred to herein as the base line length of the display video. Here, the base line length of the display video is the same as the base line length of the imaging means. Therefore, the value in the base line length column of the display device of FIG. 2 is 60 mm under all conditions.

  When the left and right images are enlarged / reduced in a positional relationship in which the centers of the respective images are fixed, the base line length of the display image is similarly enlarged / reduced. Here, when a stereoscopic image obtained by photographing an infinite subject with an imaging means having a base length of 60 mm is projected with a base length of 60 mm of the display image and observed by an observer with an interocular distance of 60 mm, the subject exists as if it is at infinity. I can feel it. When this image is reduced by, for example, 0.5 times, the base line length of the display image also changes from 60 mm to 30 mm. In this case, the observer feels that the subject image at infinity is 3400 mm if the viewing distance is twice as long as the distance between the observer and the display device, that is, the viewing distance is 1700 mm. This can be regarded as a significant reduction in stereoscopic effect.

On the other hand, when the stereoscopic image captured in this way is enlarged, for example, twice, the base length of the display image also changes from 60 mm to 120 mm. In this case, since the convergence angle of the eyes is extremely widened, the observer cannot recognize a subject image at infinity as a stereoscopic image. On the other hand, when the enlargement magnification is close to 1, the human eye and brain somehow try to fuse, causing problems such as fatigue.
For this reason, such a problem will not occur unless the base line length of the display image is changed before and after scaling.
Here, in order to prevent the baseline length from changing before and after enlargement / reduction, a method of moving the entire image after enlargement / reduction with respect to the center of the display screen will be described as an example. The movement is performed based on the left image display position movement amount j and the right image display position movement amount k shown in FIG. Assuming that the enlargement magnification is N, j and k are expressed by Equation 9 and Equation 10, respectively.
j = (b−d) / 2 × (N−1) Equation 9
k = (d−b) / 2 × (N−1) Equation 10

The values of j and k calculated for conditions 1 to 8 are shown in the left image display position movement amount and right image display position movement amount columns of FIG.
Here, the moving direction is positive in the y-axis direction and moving from right to left as viewed from the observer.
Further, the y-coordinate i ′ of the transformed left-eye image and the y-coordinate h ′ of the transformed right-eye image are expressed by Equations 11 and 12, respectively.
i ′ = i × N + j Equation 11
h ′ = h × N + k Equation 12
This is based on the premise that the base line length on the display screen enlarged / reduced according to the enlargement / reduction ratio of the entire video is returned to the base line length before the enlargement / reduction by moving equally between the left and right videos.
The values of i ′ and h ′ calculated for conditions 1 to 8 are shown in the columns of the transformed left-eye video coordinates and the transformed right-eye video coordinates in FIG. Note that the value (g) of the x coordinate does not change before and after the deformation.

As described above, the left-eye image displayed at the coordinates (g, i) is enlarged or reduced at the magnification N, and then moved in the y-axis direction by the left image display position movement amount j. It is displayed at the position of coordinates (g, i ′). Similarly, the video for the right eye displayed at the coordinates (g, h) is enlarged or reduced at the magnification N, and then moved in the y-axis direction by the right image display position movement amount k. It is displayed at the position (g, h ′).
Further, from the transformed left-eye image coordinates (g, i ′) and the transformed right-eye image coordinates (g, h ′), the x-coordinate e ″ of the transformed stereoscopic image forming position is obtained by Equation 13, and from Equation 14 A y-coordinate f ″ of the post-deformation stereoscopic image forming position is obtained.
e ″ = (d−b) g / (i′−b−h ′ + d) Equation 13
f ″ = (h−d) ((d−b) g / (i′−b−h ′ + d)) / g + d Equation 14
The values of e ″ and f ″ calculated for the conditions 1 to 8 are shown in the column of the transformed stereoscopic image imaging coordinates in FIG.

2 is compared with the post-deformation stereoscopic image imaging coordinates (e ′, f ′) and the post-deformation stereoscopic image imaging coordinates (e ″, f ″) of FIG. On the other hand, e ′ and e ″, which are x-coordinates, are different values, and e ″ is half of e ′ in conditions 1 to 4 where the magnification N is 2. It can be confirmed that e ″ is twice e ′ in conditions 5 to 8 where the magnification N is 0.5.
As described above, enlargement without changing the baseline length makes the image size larger and closer, and reduction without changing the baseline length makes the image size smaller and looks farther away. Natural video transformations are possible.

  Here, for the sake of simplicity, the left and right images have been moved after being scaled in a positional relationship with the center of each image fixed, and the method for correcting the baseline length before and after scaling has been explained. Instead of the method, two base points that are the same distance as the baseline length of the displayed video are set as the reference points for the left and right videos, and the baseline length can also be increased by scaling the left and right videos around each reference point. It can be scaled without changing, and the same effect can be obtained.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

(Embodiment 1)
FIG. 3 is a block diagram showing the configuration of the stereoscopic video display apparatus according to Embodiment 1 of the present invention.
The stereoscopic video display apparatus 100 includes a video signal input unit 101, a left / right video separation unit 102, an enlargement / reduction unit 104, a left / right video synthesis unit 105, a display unit 106, a user input unit 107, and a control unit 108.

  A stereoscopic video signal is input to the video signal input unit 101. The method of the stereoscopic video signal is not limited, and any method such as side-by-side method / top-and-bottom method / interlace method may be used. The stereoscopic video signal input to the video signal input unit 101 is sent to the left and right video separation unit 102. The left and right video separation unit 102 separates the stereoscopic video signal received from the video signal input unit 101 into a left-eye video signal and a right-eye video signal, and sends them to the enlargement / reduction unit 104. The enlargement / reduction unit 104 sets the center position on the video at the time of enlargement / reduction for each of the left-eye video signal and the right-eye video signal received from the left / right video separation unit 102, and then the left-eye video and the right-eye video Is changed to enlarge or reduce around the reference point and sent to the left and right video composition unit 105.

  The left and right video synthesis unit 105 synthesizes the left-eye video signal and the right-eye video signal received from the enlargement / reduction unit 104 and sends them to the display unit 106. The display unit 106 displays the stereoscopic video signal received from the left and right video synthesis unit 105. Here, the left-eye video signal and the right-eye video signal in the left-right video synthesis unit 105 may be combined in a format that matches the display method of the display unit 106. The display method of the display unit is, for example, a polarized glasses method or a shutter. Although the glasses method is common, other methods may be used and the display method is not limited.

  In the user input unit 107, the user sets the position of the reference point and gives an instruction to enlarge or reduce the image. Reference point position information and video enlargement / reduction instruction information input by the user through the user input unit 107 are sent to the control unit 108 as data. The control unit 108 sends data relating to the position of the reference point received from the user input unit 107 to the enlargement / reduction unit 104, and the enlargement / reduction unit 104 sets the reference point based on this data. The control unit 108 controls the operation of the enlargement / reduction unit 104 based on the video enlargement / reduction instruction information received from the user input unit 107. The enlargement / reduction unit 104 enlarges / reduces the image under the control of the control unit 108.

The operation of the stereoscopic image display apparatus 100 in the present embodiment will be further described with reference to FIGS.
FIG. 4 is a flowchart for explaining the operation of the stereoscopic video display apparatus 100 according to the present embodiment. FIG. 5 is a diagram showing a display example at the time of video enlargement / reduction. FIG. 6 is a diagram for explaining a change in the imaging position before and after video enlargement / reduction of an image located at the reference point. FIG. 7 is a diagram for explaining a change in the imaging position before and after enlargement / reduction of an image formed at a position at a close distance to the observer.

A stereoscopic video signal is input to the video signal input unit 101 in step S101 of FIG. In step S102, the left and right video separation unit 102 separates the input stereoscopic video signal into a left-eye video signal and a right-eye video signal. On the other hand, data relating to the position of the reference point input from the user input unit 107 is sent to the enlargement / reduction unit 104 through the control unit 108.
The reference point of the video signal for the left eye and the reference point of the video signal for the right eye must be set on the same line parallel to the direction in which the left and right images that cause binocular parallax are shifted. The position of the reference point of the signal can be set. The reference point does not necessarily need to be located in the video, and either one or both of the left and right video signals may not be located in the video. Here, the interval between the reference points of the left and right video signals is preferably equal to or less than the interval between the viewer's eyes.

  FIG. 5 (B-LR) is an example of a stereoscopic video signal input to the video signal input unit 101. In this example, the left and right video signals are transmitted by a method that requires glasses using a liquid crystal shutter and a polarizing plate for viewing stereoscopic images. When viewing with the naked eye, the left and right video signals are displayed as shown in FIG. 5 (B-LR). Seem to overlap. In the figure, the face image is a close-up image, and the round image is an image at infinity. Further, in FIG. 5 (B-LR), the face image located on the right side and the round image located on the left side are the left-eye image, and the separated left-eye image is shown in FIG. 5 (B-L). Show. In FIG. 5 (B-LR), the face image located on the left side and the round image located on the right side are right eye images, and the separated right eye image is shown in FIG. 5 (BR).

  Returning to FIG. In step S <b> 103, the enlargement / reduction unit 104 sets a reference point based on data regarding the position of the reference point sent from the control unit 108 for each of the left-eye video signal and the right-eye video signal received from the left-right video separation unit 102. I do. Here, in order to simplify the explanation, it is assumed that the reference point is set at the center position of the round image shown in FIG. 5 (B-LR). That is, the center position of the round image in FIG. 5 (B-L) is the reference point for the left-eye image, and the center position of the round image in FIG. 5 (B-R) is the reference point for the right-eye image. Become.

  In step S <b> 104, the control unit 108 determines whether an enlargement / reduction instruction has been input from the user input unit 107. The input / output format of the enlargement / reduction instruction may be configured to set an enlargement / reduction ratio in advance and select whether to enlarge, reduce, or neither enlargement nor reduction, or a configuration in which the user inputs an arbitrary enlargement / reduction ratio But it ’s okay. In the case of a configuration in which the user inputs an arbitrary enlargement / reduction ratio, it means that if the enlargement / reduction ratio input by the user is smaller than 1, the image is reduced if it is 1, and if it is larger than 1, it means that the image is enlarged.

  When the control unit 108 determines in step S104 that an enlargement / reduction instruction has not been input or when it is determined that the enlargement / reduction ratio input by the user is 1 (S104 / no), the control unit 108 performs the enlargement / reduction unit. 104 is controlled not to enlarge or reduce the left and right video signals. The enlarging / reducing unit 104 sends the left and right video signals to the left / right image synthesis unit 105 without enlarging / reducing. In step S <b> 105, the left and right image combining unit 105 combines the left and right video signals received from the enlargement / reduction unit 104. In step S106, display unit 106 displays the stereoscopic video signal received from the left and right image combining unit.

  If the control unit 108 determines in step S104 that a reduction instruction has been input, or if it is determined that the user's input enlargement / reduction ratio is less than 1 (S104 / reduction), the process proceeds to step S107, and the control unit 108 The enlargement / reduction unit 104 is controlled to reduce the video. The enlargement / reduction unit 104 changes the left-eye video signal and the right-eye video signal so as to reduce the left-eye video and the right-eye video around the respective reference points. FIG. 5 (AL) is an image obtained by reducing the image of FIG. 5 (B-L) around a reference point (center of a round image). FIG. 5 (A-R) is an image obtained by reducing the image of FIG. 5 (B-R) around a reference point (center of a circular image). Next, proceeding to step S105, the left and right video composition unit 105 synthesizes the left and right videos. FIG. 5 (A-LR) is an image obtained by combining the reduced left image shown in FIG. 5 (AL) and the reduced right image shown in FIG. 5 (AR).

  If the control unit 108 determines in step S104 that an enlargement instruction has been input or if it is determined that the enlargement / reduction ratio input by the user is greater than 1 (S104 / enlargement), the control unit 108 proceeds to step S108. The enlargement / reduction unit 104 is controlled to enlarge the video signal. The enlargement / reduction unit 104 changes the left-eye video signal and the right-eye video signal so that the left-eye video and the right-eye video are enlarged around the respective reference points. FIG. 5 (CL) is an image obtained by enlarging the image of FIG. 5 (B-L) around a reference point (center of a round image). FIG. 5 (CR) is an image obtained by enlarging the image of FIG. 5 (B-R) around a reference point (center of a round image). Next, proceeding to step S105, the left and right video composition unit 105 synthesizes the left and right videos. FIG. 5 (C-LR) is an image obtained by combining the enlarged left image shown in FIG. 5 (CL) and the enlarged right image shown in FIG. 5 (CR).

A change in the image formation position of the stereoscopic video when the video signal is enlarged and reduced in steps S107 or S108, S105, and S106 will be described with reference to FIGS. FIG. 6 is a diagram for explaining a change in the imaging position of the round image described in FIG. 5, that is, an image located at the reference point of the left and right images before and after image enlargement / reduction. FIG. 6B illustrates the image forming position of the round image when the image of FIG. 5B-LR, which is the image before enlargement / reduction, is stereoscopically viewed on the display screens of the left and right images. Let the interval be α. At this time, the imaging position is a position indicated by the imaging position b, which is farther from the display screen than the viewer.
FIG. 6 (A) illustrates how the round image looks when the image of FIG. 3 (A-LR), which is a reduced image, is stereoscopically viewed. The interval between the left and right images on the display screen is as follows. As in FIG. 6B, it is α, so that the imaging position a is the same as the imaging position b. However, the size of the round image is reduced by a predetermined magnification with respect to FIG.

  FIG. 6C illustrates the image formation position of a round image when the image of FIG. 5C-LR, which is an enlarged image, is stereoscopically viewed, and the interval between the left and right images on the display screen. Is equal to α as in FIG. 6B, and the imaging position c is the same position as the imaging position b. However, the size of the round image is enlarged at a predetermined magnification with respect to FIG. As described above, when the image at the reference point is enlarged or reduced, the size of the image is enlarged or reduced, but the image forming position is not changed.

FIG. 7 is a diagram for explaining the change in the image formation position before and after image enlargement / reduction of the face image formed at a close distance with respect to the observer described with reference to FIG. FIG. 7B illustrates the image formation position of the face image when stereoscopically viewing the image of FIG. 5B (B-LR), which is the image before enlargement / reduction, and the interval on the display screen of the left and right images. Is βe. At this time, the imaging position is a position indicated by the imaging position e, which is closer to the viewer than the position of the display screen.
FIG. 7A illustrates how the face image looks when the image of FIG. 5A-LR, which is a reduced image, is stereoscopically viewed, and the interval on the display screen of the left and right images is βe. Which is narrower than βd. Therefore, the image formation position d is closer to the viewer than the image formation position e. At this time, the size of the face image in FIG. 4A is reduced by a predetermined magnification with respect to FIG. 4B.

  FIG. 7C illustrates the image formation position of the face image when the image of FIG. 5C-LR, which is an enlarged image, is stereoscopically viewed, and the interval on the display screen of the left and right images is as follows. βf is wider than βe. Therefore, the imaging position f is closer to the viewer than the imaging position e. At this time, the size of the face image is enlarged at a predetermined magnification with respect to FIG. As described above, when an image that is not at the position of the reference point is enlarged or reduced, the size of the image is enlarged or reduced, and the imaging position is changed.

  By using the characteristics described above, the distance between the reference points of the left and right images is set to a value close to the distance between the viewer's eyes, and when the image is enlarged or reduced, the image is formed far away from the viewer. For images, there is little change in the image formation position, and the closer the image formation position to the viewer, the greater the change in the image formation position, so the distance of the closest image without changing the sense of distance of distant images You can change the feeling.

(Embodiment 2)
FIG. 8 is a block diagram showing a configuration of a stereoscopic video display apparatus according to Embodiment 2 of the present invention. In the figure, the same reference numerals are given to portions common to FIG. In the stereoscopic video display device of FIG. 8, a superimposed image generation unit 202 and a superimposed image synthesis unit 203 are added to the stereoscopic video display device of FIG.

  The operation of the stereoscopic video signal display apparatus 200 according to the present embodiment will be described with reference to FIGS. FIG. 9 is a flowchart for explaining the operation of the stereoscopic video apparatus 200 according to the second embodiment. FIG. 10 is a diagram illustrating a display example of a superimposed image. FIG. 11 is a diagram for explaining a change in the imaging position of the display image before and after displaying the superimposed image.

  Steps S201 to S203 in FIG. 9 are the same as steps S101 to S103 described in FIG. In step S204, the control unit 108 determines whether there is an instruction to display a superimposed image. The superimposition image display instruction is normally input by the user through a user input unit 107 using a remote controller (not shown), but is not limited thereto. Additional information is added to the video signal input to the video signal input unit 101. It is good also as a structure which detects the emergency signal etc. which were added as, and displays a superimposed image automatically. When the control unit 108 determines that there is no instruction to display a superimposed image (S204 / no), the process proceeds to step S205. Steps S205 to S206 are the same as steps S105 to S106 in FIG. At this time, the control unit 108 controls the enlargement / reduction unit 104 not to enlarge / reduce, and simultaneously controls the superimposed image generation unit 202 not to generate a superimposed image. Accordingly, at this time, in step S205, the left and right images are combined without being enlarged or reduced and without combining the superimposed images.

  When the control unit 108 determines in step S204 that there is an instruction to display a superimposed image (S204 / yes). In step S207, the control unit 108 controls the enlargement / reduction unit 104 to reduce the image. The enlargement / reduction unit 104 changes the left-eye video signal and the right-eye video signal so as to reduce the left-eye video and the right-eye video around the respective reference points. Here, the reduction ratio may be set in advance as a default value, or may be set by the user.

  The control unit 108 instructs the superimposed image generation unit 202 to generate a superimposed image. The superimposed image generation unit 202 generates a left-eye video signal superimposed image and a right-eye video signal superimposed image, and sends them to the superimposed image synthesis unit 203. In step S <b> 208, the superimposed image composition unit 203 adds the left-eye video signal and the right-eye video signal received from the superimposed image generation unit 202 to the left-eye video signal and right-eye video signal received from the enlargement / reduction unit 104, respectively. The superimposed image signal is synthesized. The flow of steps S205 and S206 is the same as S105 and S106 of FIG.

FIG. 10 (B-LR) is an example of a stereoscopic video input to the video signal input unit 101, and is the same as FIG. 5 (B-LR). 10B and 10B are a left-eye image and a right-eye image, respectively, separated by the left and right image separation unit 102. Like the example described in the first embodiment, enlargement / reduction is performed. It is assumed that the reference point is set at the center position of the round image for each of the left-eye image and the right-eye image in the unit 104. A video obtained by reducing the video in FIG. 10 (B-L) by the enlargement / reduction unit 104 and then synthesizing the superimposed image by the superimposed image synthesis unit 203 is the video in FIG. 10 (A-L). The video obtained by reducing the video of (BR) by the enlargement / reduction unit 104 and then synthesizing the superimposed image by the superimposed image synthesis unit 203 is the video of FIG.
10 (A-LR) is an image obtained by synthesizing the image of FIG. 10 (A-L) and the image of FIG. 10 (A-R) by the left and right image synthesizing unit 105, and the display unit 106 has a stereoscopic image with a superimposed image. Is displayed. As shown in FIG. 10, when the video is reduced, a portion where the video is not displayed appears on the screen. By superimposing the superimposed image so that the superimposed image is displayed at this portion, the superimposed image can be displayed without hiding the original video.

A change in the imaging position of the stereoscopic video shown in FIG. 10 will be described with reference to FIG. FIG. 11C is a diagram illustrating the imaging position of the face image in the stereoscopic image illustrated in FIG. 10B-LR. The parallax on the display screen of the face image is βi, and the imaging position is the imaging position i. FIG. 11B is a diagram showing the imaging position of the reduced face image. The parallax on the display screen of the face image after the reduction is βg which is smaller than βi, and the imaging position is an imaging position g closer to the display screen than the imaging position i.
By moving the image formation position of the projected image closer to the display screen, the burden on the viewer who has concentrated on the closest image is reduced. On the other hand, in order to facilitate the recognition of the superimposed image for the viewer who is viewing the stereoscopic video, the distance from the display screen between the imaging position of the close image and the imaging position of the superimposed image that the viewer is interested in is reduced. It is effective to do.

FIG. 11A shows an example of the close-up image formation position and the overlap image formation position when the superimposed image is combined with the reduced image. In this example, the imaging position q of the superimposed image is set near the display screen so that the burden on the viewer is reduced when the viewer confirms the display content of the superimposed image. At this time, the difference in distance from the display screen between the image formation position of the close-up image and the image formation position of the superimposed image is small (d2), and the viewer who is concentrated on the close-up image can easily recognize the superimposed image. .
If the superimposed image is superimposed so that the image formation position is the same as in the above example without reducing the image, the difference in the distance from the display screen between the image formation position of the closest image and the image formation position of the overlap image is large. (D1) A viewer who is concentrated on the close-up image may not notice the display of the superimposed image.

  By reducing the image, the superimposed image is displayed so that the superimposed image is formed at a position where the difference in the distance from the display screen is small with respect to the imaging position of the close-up image, which is a position that the viewer can easily recognize. As a result, the image formation position of the superimposed image is close to the display screen, and the burden on the viewer for confirming the content of the recognized superimposed image can be reduced. Even when the superimposed image is displayed so that the image is formed closer to the viewer than the image forming position of the close-up image, it is necessary to set the superimposed image imaging position at a position extremely close to the viewer after image reduction. This eliminates the burden on viewers.

100 stereoscopic video signal display device 101 video signal input unit 102 left and right video separation unit 104 enlargement / reduction unit 105 left and right video synthesis unit 106 display unit 107 user input unit 108 control unit 200 stereoscopic video signal display device 202 superimposed image generation unit 203 superimposed image superposition Part

Claims (5)

A video signal input unit for inputting a video signal including a stereoscopic video signal;
A left and right video separation unit that separates the input stereoscopic video signal into a left-eye video signal and a right-eye video signal;
An enlargement / reduction unit that changes the left-eye image and the right-eye image with reference to the first reference point that is the center for enlarging / reducing the left-eye image and the second reference point that is the center for enlarging / reducing the right-eye image When,
A left and right video synthesis unit that synthesizes the changed left-eye video signal and the right-eye video signal;
A display unit that displays a video signal obtained by synthesizing the left-eye video signal and the right-eye video signal so as to be perceived as a stereoscopic video;
The left and right image combining unit does not change the interval on the display unit between the first reference point and the second reference point before and after the enlargement / reduction, and the enlargement / reduction unit does not change the first reference point and the second reference point. The three-dimensional image display apparatus is characterized in that the reference point is set on the same line parallel to the direction in which the left and right images that are the basis of binocular parallax are shifted. A superimposed image generating unit that generates a superimposed image signal for the left eye and a superimposed image signal for the right eye with parallax;
A superimposed image combining unit that combines the left-eye video signal and the right-eye superimposed video signal with the parallax with the left-eye video signal and the right-eye video signal before being input to the left-right video combining unit;
Further comprising
When the left-eye superimposed image signal and the right-eye superimposed image signal having the parallax are combined, the enlargement / reduction unit converts the left-eye video and the right-eye video, respectively, to the first reference point and the second Changing the video signal for the left eye and the video signal for the right eye to reduce the image around a reference point,
The stereoscopic image display apparatus according to claim 1.   The three-dimensional image display device according to claim 1, wherein at least one of the first reference point and the second reference point is located on the outside of the display screen.   4. The stereoscopic video signal display device according to claim 2, wherein positions of the first reference point and the second reference point are set according to a position where the superimposed image is displayed. 5. A video signal input step for inputting a video signal including a stereoscopic video signal;
A left and right video separation step of separating the input stereoscopic video signal into a left-eye video signal and a right-eye video signal;
The respective centers of enlargement / reduction set with the left-eye video and the right-eye video set on the same line parallel to the direction in which the left-right video that is the basis of binocular parallax is shifted are defined as the first reference point and the second reference point. A scaling step for changing the left-eye video signal and the right-eye video signal;
A left-right video synthesis step of synthesizing the changed left-eye video signal and the right-eye video signal without changing the interval between the first reference point and the second reference point on the display unit before and after scaling;
And a display step of displaying a video signal obtained by synthesizing the left-eye video signal and the right-eye video signal so as to be perceived as a stereoscopic video.

Images