JP4827783B2 - Image display device - Google Patents

Description

  The present invention relates to an image display device that displays a right eye image that is an image for the right eye that is captured at a predetermined cycle and a left eye image that is an image for the left eye that is captured at the predetermined cycle.

  In recent years, the demand for stereoscopic images has been increasing, and development of image capturing technology and image display technology for providing a stereoscopic image using stereoscopic perception by binocular parallax has been vigorously performed.

  2. Description of the Related Art Conventionally, as an imaging method for capturing a right eye image that is an image for the right eye and a left eye image that is an image for the left eye, the right eye image and the left eye image are captured at predetermined intervals by two cameras. A first imaging method that captures images at substantially the same time and a second imaging method that alternately captures a right-eye image and a left-eye image with a substantially half-cycle difference of a predetermined cycle by a single liquid crystal shutter camera are known. Further, as a display method for displaying the right eye image and the left eye image, a first display method for simultaneously displaying the right eye image and the left eye image with two series of data, a right eye image and a left eye image, Is known as a second display method that alternately displays a single series of data.

  As shown in FIG. 13A, in the first imaging method, the right eye image R (R1, R2, R3...) And the left eye image L (L1, L2, L3...) Are predetermined by two cameras. Images are taken simultaneously at a period (1/60 seconds). Further, as shown in FIG. 13B, in the second imaging method, the right eye image R (R2, R4...) And the left eye image L (L1, L3. Images are alternately captured with a half-cycle (1/120 second) difference. In the second imaging method, the imaging interval of the right eye image or the left eye image is a predetermined cycle (1/60 seconds).

Generally, the right eye image and the left eye image captured by the first imaging method are displayed without causing a time lag according to the first display method (see, for example, Patent Document 1), and the second imaging is performed. According to the second display method, the right eye image and the left eye image captured by the method are displayed without causing a time shift.
Japanese Patent Publication No. 7-50945

  However, there is a situation that the imaging method used by the video content creator and the display method used by the video content shower are not necessarily consistent.

  For example, the right eye image R (R2) and the left eye image L (L1) simultaneously captured by the first imaging method shown in FIG. 13A are alternately displayed by the second display method shown in FIG. When displayed, the right eye image R is displayed with a delay from the timing that should be originally displayed with respect to the left eye image L, so that the viewer feels uncomfortable.

  Further, FIG. 14B shows a right eye image R (R1) and a left eye image L (L1) which are alternately picked up in the order of L → R by the second imaging method shown in FIG. 13B. When simultaneously displayed in the first display method, the right eye image R is always displayed earlier than the timing at which it should be originally displayed with respect to the left eye image L, and the viewer feels uncomfortable.

  In addition, a problem may occur even when the imaging method and the display method match. For example, even when an image captured by the second imaging method shown in FIG. 13B is displayed by the second display method, as shown in FIG. 14C, the occurrence of flicker is reduced. In addition, when the same right eye image R and left eye image L are alternately displayed twice each time with the display time being reduced to the original half, each image is not periodically displayed. Learn.

  As described above, even when the imaging method and the display method are not consistent, or even when the imaging method and the display method are consistent, when the number of times the image is displayed is changed, a high-quality three-dimensional image is displayed to the viewer. There was a problem that images could not be displayed.

 Therefore, the present invention has been made in view of the above problems, and an object thereof is to provide an image display device capable of displaying a stereoscopic image that does not make the viewer feel uncomfortable.

  An image display device according to a first feature of the present invention is an image display device that displays a stereoscopic image composed of a right eye image and a left eye image for stereoscopic viewing using stereoscopic perception by binocular parallax, An input unit that inputs a right eye image and a left eye image captured by the imaging device, a relative position of the right eye image and the left eye image when displaying these images, and a right eye image and a left when capturing images When the relative positions of the eye images are not aligned, a control unit that performs display control so as to align the relative position during display and the relative position during imaging, and the right eye and the left eye based on display control by the control unit The gist is to include a display unit that displays an image.

  An image display device according to a second feature of the present invention is an image display device that displays a stereoscopic image composed of a right eye image and a left eye image for stereoscopic viewing using stereoscopic perception by binocular parallax, An input unit that inputs a right eye image and a left eye image captured by the imaging device, a display unit that displays the right eye image and the left eye image, and an input unit that is input according to the specifications of the display unit The gist of the present invention is to include a control unit that controls the brightness, display time, display order, and number of displays per predetermined period of the right eye image and the left eye image.

A third feature of the present invention relates to the first feature of the present invention, and in the case where the right eye image and the left eye image are simultaneously captured, the control unit includes the right eye image and the left eye. Controlling at least one of the brightness of the image, the display times of the right eye image and the left eye image, and the display time per display frequency so as to satisfy the following formula 1:

(In Equation 1, N represents the number of times the right eye image is displayed, Wr represents the luminance of the right eye image, ΔTr represents the display time per display number of the right eye image, and Tor represents the right eye image. Represents the display start time of the eye image, Tcr represents the display end time of the right eye image, M represents the display count of the left eye image, Wl represents the luminance of the left eye image, and ΔTl represents the left eye image. The display time per display count of the image is represented, Tol represents the display start time of the left eye image, Tcl represents the display end time of the left eye image, and T represents the predetermined period). The gist is that the display unit alternately displays the right eye image and the left eye image.

  A fourth feature of the present invention relates to the first feature of the present invention, and in the case where a right eye image and a left eye image are simultaneously captured, the control unit controls the right eye image and the left eye image. Among them, the display number of one image is set to an even number, the display number of the other image is set to an odd number, and the display unit alternately displays the right eye image and the left eye image. To do.

  A fifth feature of the present invention is according to the third feature of the present invention, wherein the control unit assigns a display time per display count evenly for the right eye image and displays the display count for the left eye image. The display time per one time is equally allocated, and the total display time assigned to the right eye image is equal to the total display time assigned to the left eye image.

A sixth feature of the present invention relates to the first feature of the present invention, and in the case where a right eye image and a left eye image are alternately captured, the control unit controls the right eye image and the left eye image. Controlling at least one of the luminance, the number of times the right eye image and the left eye image are displayed, and the display time per display number so as to satisfy the following number 2:

(In Equation 2, N represents the number of times the right eye image is displayed, Wr represents the luminance of the right eye image, ΔTr represents the display time per display number of the right eye image, and Tor represents the right eye image. Represents the display start time of the eye image, Tcr represents the display end time of the right eye image, M represents the display count of the left eye image, Wl represents the luminance of the left eye image, and ΔTl represents the left eye image. The display time per display count of the image is represented, Tol represents the display start time of the left eye image, Tcl represents the display end time of the left eye image, and T represents the predetermined period). The gist is that the display unit simultaneously displays the right eye image and the left eye image.

  A seventh feature of the present invention relates to the first feature of the present invention, wherein the display unit can simultaneously display a plurality of images, and the right eye and the left obtained by the imaging device taking images alternately. When displaying the eye image using the plurality of display units, the control unit controls the right so that the display period of the right (left) eye image overlaps the display period of the plurality of consecutive left (right) eye images. The gist is to perform control to display an eye image and a left eye image.

  An eighth feature of the present invention relates to the first feature of the present invention, wherein the display unit can simultaneously display a plurality of images, and the right eye and the left eye obtained by alternately capturing images by the imaging device. When displaying an eye image using the plurality of display units, the control unit displays a plurality of images including at least a plurality of left (right) eye images whose imaging frame periods overlap with the right (left) eye image. The gist of the present invention is to generate a combined image and perform display control so that the display timings of the right (left) eye image and the combined image are aligned.

A ninth feature of the present invention relates to the first feature of the present invention. In the case where the right eye image and the left eye image are alternately captured at a predetermined period, the control unit Controlling the brightness of the image and the left-eye image, the number of display times of the right-eye image and the left-eye image, and at least one of the display times per display number so as to satisfy the following equation (3):

(In Equation 3, N represents the number of times the right eye image is displayed, Wr represents the luminance of the right eye image, ΔTr represents the display time per display number of the right eye image, and Tor represents the right eye image. Represents the display start time of the eye image, Tcr represents the display end time of the right eye image, M represents the display count of the left eye image, Wl represents the luminance of the left eye image, and ΔTl represents the left eye image. Represents the display time per display number of images, Tol represents the display start time of the left eye image, Tcl represents the display end time of the left eye image, T represents the predetermined period, and K represents It represents a positive integer.) The gist is that the display unit alternately displays the right eye image and the left eye image.

  A tenth feature of the present invention relates to the first feature of the present invention, wherein the right eye image and the left eye image are alternately captured in at least one of the right eye image and the left eye image, It is summarized that imaging method information indicating whether the right eye image and the left eye image are simultaneously captured is added, and the control unit performs the display control based on the imaging method information.

  The eleventh feature of the present invention is that when the right eye image and the left eye image are sequentially imaged at substantially the same timing by each of the plurality of imaging devices, the control unit images simultaneously with the right (left) eye image. A composite image is generated by combining a plurality of images including at least a left (right) eye image and a left (right) eye image captured next, and the right (left) eye image is generated for a half period of the predetermined period. The gist of the present invention is that after the display unit displays the composite image, the display unit displays the composite image repeatedly for a half period of the predetermined period.

  According to the image display device of the present invention, it is possible to display a stereoscopic image that does not make the viewer feel uncomfortable.

First Embodiment-In the case of the second display method-
Next, a first embodiment of the present invention will be described. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. However, it should be noted that the drawings are schematic and ratios of dimensions and the like are different from actual ones.

  Accordingly, specific dimensions and the like should be determined in consideration of the following description. Moreover, it is a matter of course that portions having different dimensional relationships and ratios are included between the drawings.

<Block Configuration of Image Display Device 10>
FIG. 1 shows the configuration of the image display apparatus 10. The image display apparatus 10 according to the present embodiment displays a right eye image that is an image captured for the right eye in a predetermined cycle and a left eye image that is an image captured for the left eye in the predetermined cycle. . In the following, the “first imaging method” is a method of capturing a right eye image and a left eye image at substantially the same time in a predetermined cycle, and the “second imaging method” is a method of capturing a right eye image and a left eye image. In this method, images are alternately captured with a substantially half-cycle difference of a predetermined cycle.

  For example, in the “first imaging method”, binocular images are simultaneously captured by two cameras. Alternatively, a case where a binocular image is simultaneously captured by attaching a stereoscopic photographing adapter to one camera is also included in the first imaging method.

  In the second imaging method, basically, a right-eye image and a left-eye image are alternately captured by a single liquid crystal shutter camera, but a right-eye image and a left-eye image are alternately captured by a plurality of cameras. Including.

  In addition, the “first display method” is a method in which a right eye image and a left eye image are simultaneously displayed using two series of data, and the “second display method” is a method in which a right eye image and a left eye image are displayed. This is a method of alternately displaying by one series of data.

  For example, in the “first display method”, a plurality of images (binocular images) are simultaneously displayed by two projectors (display devices). Alternatively, a case where a plurality of images are simultaneously displayed by one display device such as a parallax barrier system is included.

  The “second display method” basically refers to a case where a right eye image and a left eye image are alternately displayed by one display device, but is not limited to this configuration. Note that the image display device 10 according to the present embodiment displays the right eye image R and the left eye image L by the second display method.

  The image display apparatus 10 according to the present embodiment includes an acquisition unit 11, a determination unit 12, a control unit 13, and a display unit 14.

  The acquisition unit 11 acquires the right eye image R and the left eye image L from an image reproduction device (not shown) or the like. The acquisition unit 11 transfers the imaging method information P assigned to at least one of the acquired right eye image R and left eye image L to the determination unit 12. Here, the imaging method information P is information indicating whether the right eye image R and the left eye image L have been imaged by the first imaging method or the second imaging method. Further, the acquisition unit 11 transfers the acquired right eye image R and left eye image L to the display unit 14.

  Based on the imaging method information P, the determination unit 12 determines whether the right eye image R and the left eye image L are captured by the first imaging method or the second imaging method. The determination unit 12 notifies the control unit 13 of the determination result. The determination unit 12 can be integrated with the control unit 13.

  The control unit 13 performs display control of the right eye image R and the left eye image L. That is, based on the determination result notified from the determination unit 12, the control unit 13 displays a relative relationship between the right eye image R and the left eye image L on the time axis when displaying the right eye image R and the left eye image L. Display control is performed so that the positions are aligned with the relative positions of the right eye image R and the left eye image L when the right eye image R and the left eye image L are captured. Since the relative position and display control relate to the characteristic part of the present invention, they will be described in detail later.

  The display unit 14 displays the right eye image R and the left eye image L acquired from the acquisition unit 11 in accordance with a predetermined cycle based on display control by the control unit 13. In the present embodiment, “display in accordance with a predetermined period” means that the right eye image R and the left eye image L are matched with a predetermined period in which the right eye image R and the left eye image L are captured. Is displayed by the second display method. The display unit 14 according to the present embodiment is a shutter glasses projector using the DLP method. Therefore, the display unit 14 displays the right eye image R and the left eye image L by the second display method.

<Operation of Image Display Device 10>
FIG. 2 is a flowchart showing the operation of the image display apparatus 10 according to the present embodiment.

  In step 101, the acquisition unit 11 acquires the right eye image R and the left eye image L, and transfers the imaging method information P to the determination unit 12.

  In step 102, the determination unit 12 determines whether the right eye image R and the left eye image L are captured by the first imaging method or the second imaging method based on the imaging method information P. Then, the control unit 13 is notified of the determination result.

  In step 103, the control unit 13 captures the right eye image R and the left eye image L with respect to the relative positions of the right eye image R and the left eye image L when the right eye image R and the left eye image L are displayed. Display control is performed so that the right eye image R and the left eye image L at the same time are aligned with the relative positions on the time axis. The terms “relative position” and “display control” used in the above description will be described in detail later because they relate to the characteristic part of the present invention. Note that, when the right eye image R and the left eye image L are captured by the second imaging method that is consistent with the second display method, the control unit 13 basically displays the captured image according to the input order. Display it.

  In step 104, the display unit 14 displays the right eye image R and the left eye image L in accordance with the predetermined cycle by the second display method based on the display control by the control unit 13.

<Display Control by Control Unit 13>
The control unit 13 performs display control so that the relative position on the time axis between the right eye image R and the left eye image L during display is aligned with the relative position between the right eye image R and the left eye image L during imaging. Do. Hereinafter, after describing the relative position, an example of display control in the display unit 14 will be described.

(1) Relative position between right eye image R and left eye image L The control unit 13 displays the right eye image R and the left eye image L when displaying the right eye image R and the left eye image L by the second display method. Display control is performed so that the relative positions of the right eye image R and the left eye image L when the right eye image R and the left eye image L are imaged by the first imaging method are aligned. Here, “the relative position of the right eye image R and the left eye image L at the time of imaging” refers to the time axis between the time when the right eye image R is captured and the time when the left eye image L is captured. Relative positional relationship. Therefore, when the image is captured by the first imaging method, the right eye image R and the left eye image L are captured at the same time every predetermined period T (1/60 seconds) (see FIG. 13A). The relative position on the time axis is the same.

  The “relative position between the right eye image R and the left eye image L at the time of display” refers to the “center of gravity position Cr of the right eye image R determined from the luminance, the number of times of display, and the display time of the right eye image R to be displayed. ”And the“ center of gravity position Cl ”of the left eye image L determined by the luminance, the number of times of display, and the display time of the left eye image L to be displayed.

  Therefore, when an image captured by the first imaging method is displayed by the second display method, “the relative position on the time axis between the right eye image R and the left eye image L at the time of display, and the right eye image R at the time of imaging. "Controls the relative position of the left eye image L and the left eye image L to approximate each other" is equivalent to "control the difference between the gravity center position Cr and the gravity center position Cl to approach zero". . In this way, by controlling the difference between the gravity center position Cr and the gravity center position Cl to approach zero, the right eye image R and the left eye image L are simultaneously viewed by the viewer.

  The “center of gravity position” between the right eye image R1 and the left eye image L1 will be described below.

  FIG. 3 shows a case where the right eye image R1 and the left eye image L1 are alternately displayed four times within a predetermined period T (1/60 seconds). In this case, the center of gravity position Cr of the right eye image R is determined by the following (A).

…(I)
In the above (a), r represents a coefficient relating to the right eye image R1, i represents which display time (1st to 4th) the coefficient is applied, and N is the number of display times (4 times). , W represents the luminance at each display time, ΔT represents the display time per display, To represents the display start time at each display time, and Tc represents the display end time at each display time. Therefore, ΔT at each display number is obtained by Tc−To. Here, the luminance in the present embodiment is the luminance when the display unit 14 is fully lit during the display time ΔT per display of the right eye image R1 or the left eye image L1. That is, in FIG. 3, the luminance in the display times of the right eye image R1 and the left eye image L1 is different. When the display unit 14 cannot adjust the luminance at each display time, the luminance at each display time is a constant value. In this case, the above (A) is also established. Thus, in the above (a), the luminance W is also considered in order to define the position of the center of gravity of the displayed image because the visual recognition for the low luminance image is more visually recognized than the high luminance image. This is because the optical illusion effect (Pulfrich effect) is relatively added.

  Similarly, the center-of-gravity position Cl of the left eye image L1 is defined by the following (b), similarly to Cr.

... (b)
In (b) above, l represents a coefficient relating to the left eye image L1, M represents the number of times of display (4 times), and the others are the same as in the case of (b) above.

  The control unit 13 causes the difference | Cr−Cl | between the centroid position Cr of the right eye image R1 determined by (A) and the centroid position Cl of the left eye image L1 determined by (B) to approach zero. In addition, the brightness of the right eye image R1 and the left eye image L1, the number of display times of the right eye image R1 and the left eye image L1, and the display time per display number are controlled.

  In addition, when the display unit 14 displays the images after the right eye image R2 and the left eye image L2, the control unit 13 performs control so that the difference between the respective center of gravity positions approaches zero as described above.

(2-1) In the case of controlling only the display count and the display time per display count The above is the luminance, display count, and display count 1 of the right eye image R and the left eye image L displayed by the second display method. The case where the display time per turn is controlled to match the first imaging method has been described. Hereinafter, a case will be described in which only the number of display times and the display time per display number of times (the luminance is not controlled) are controlled so as to match the first imaging method.

  The control unit 13 sets the display count of one image of the right eye image R1 or the left eye image L1 to an even number and sets the display count of the other image to an odd number in a predetermined cycle T (1/60 seconds). Display control is performed so that the images are displayed alternately. Further, the display time per display count is assigned equally to the right eye image R1, and the display time per display count is assigned equally to the left eye image L1. Accordingly, the total display time assigned to the right eye image R1 is equal to the total display time assigned to the left eye image L1.

  FIG. 4 shows a case where the right eye image R1 is displayed one time and the left eye image L1 is displayed two times alternately. In the present embodiment, the control unit 13 displays the left eye image L1 for 1/20 second for the right eye image R1 and the left eye image L1, and then displays the right eye image R1 for 1/120 second, Subsequently, control is performed so that the left eye image L1 is displayed for 1/240 second.

  When such control is performed, the center-of-gravity position Cr of the right-eye image R1 and the center-of-gravity position Cl of the left-eye image L1 match at x1, as shown in FIG. That is, the control unit 13 sets the right eye image R1 and the left eye image L1 so that the difference | Cr−Cl | between the centroid position Cr of the right eye image R1 and the centroid position Cl of the left eye image L1 becomes zero. Brightness, display count, and display time per display count are controlled.

  This can also be confirmed from the fact that the following (c) derived from (a) and (b) above holds.

(C)
In (c) above, N = 1, M = 2, W = 1 (in FIG. 4, 1 is substituted because the luminance is not changed), ΔTr = 1/120 seconds, Tor = 1/240 seconds, Tcr = 3/240 seconds, ΔTl = 1/240 seconds, Tol = 0 seconds (first display), 3/240 seconds (second display), Tcl = 1/240 seconds (first display), 4 / Substituting 240 seconds (second display) establishes (c).

  By such display control of the control unit 13, the relative position on the time axis of the right eye image R and the left eye image L at the time of display, and on the time axis of the right eye image R and the left eye image L at the time of imaging. It was confirmed that the relative position of the two approximates. The same applies to the right eye image R2 and the left eye image L2 and later.

  As described above, the right-eye image R1 and the left-eye image L1 are displayed in accordance with the predetermined cycle of being captured by the display control of the control unit 13.

(2-2) Display by Display Unit 14 Next, an operation in which the display unit 14 (shutter glasses projector using the DLP method) displays the right eye image R and the left eye image L by the second display method is shown in FIG. Will be described. Hereinafter, the display of the right eye image R1 and the left eye image L1 illustrated in FIG. 4 will be described.

  In the present embodiment, the display unit 14 is a projector that uses a reflective display element with a micromirror array. An example of a micro-mirror array is Texas Instruments Inc. Digital light processing (DLP) chip available from Each mirror of the micromirror array has two different angle states. In the first state, it is a black display that does not guide light to the screen, and in the second state, it is a white display that guides light to the screen. Suppose there is. A hatched portion in FIG. 5 indicates that the mirror is in the first state, and a portion without the hatched portion indicates that the mirror is in the second state. By controlling the time between the first state and the second state by a PWM (Pulse Width Modulation) method, it is possible to express luminance of a plurality of gradations. As an example, the display period is divided at a ratio of 16: 8: 4: 2: 1, and 32 gradations (that is, the time when each mirror of the micromirror array is in the first or second state is combined) The luminance of pixel values 0 to 31) can be expressed.

  Here, in the present embodiment, it is assumed that the pixel value of the left eye image L1 at the time of imaging is 19, and the pixel value of the right eye image R1 is 0. Therefore, as shown in FIG. 5A, the display unit 14 sets the mirror in the second state for a period of 19/32 of 1/240 seconds for displaying the left eye image L1 (pixel value 19). The mirror is set to the first state for a period of 1/120 second during which the right eye image R1 (pixel value 0) is displayed. Thereby, the right eye image R1 and the left eye image L1 can be displayed without changing the luminance at the time of imaging.

  On the other hand, when complicated control as described above is difficult, the display unit 14 may display as shown in FIG. That is, the first period in which the left eye image L1 is displayed is divided at a ratio of 16: 8: 4: 2: 2, and the second period in which the left eye image L1 is displayed is 16: 8: 4: 2. Split the ratio. In this case, the left eye image L1 is displayed at the pixel value 20 with the mirror in the second state for a period of 20/32 of 1/240 seconds for displaying the left eye image L1 for the first time, and the left eye image L1 is displayed for the second time. In the period of 18/30 of / 240 seconds, the average pixel value of the left eye image L1 can be displayed as 19 by displaying the pixel value 18 with the mirror in the second state.

  According to the display control as described above, stereoscopic viewing is possible as follows.

  A polarizing plate for polarizing image light and a liquid crystal panel for switching the polarization direction are arranged on the optical path of the projector. On the display element, the right eye image and the left eye image are alternately displayed in terms of time. When the right eye image is displayed, S-polarized light is displayed. When the left eye image is displayed, P-polarized light is displayed. To control the LCD panel. The viewer wears polarizing glasses including a polarizing plate that transmits S-polarized light for the right eye and a polarizing plate that transmits P-polarized light for the left eye. Accordingly, the right eye image and the left eye image are appropriately observed in the right eye and the left eye, and stereoscopic viewing is possible.

<Action and effect>
According to the image display device 10 according to the present embodiment, the control unit 13 determines the relative position between the right eye image R and the left eye image L when the right eye image R and the left eye image L are displayed, and the right eye image. Display control is performed so that the right eye image R and the left eye image L are aligned at the relative positions when the R and left eye images L are captured.

  Specifically, when the control unit 13 displays the right eye image R and the left eye image L captured by the first imaging method by the second display method, the center-of-gravity position defined by (a) above. The brightness, the number of times of display, and the number of times of display of the right eye image R and the left eye image L so that the difference | Cr−Cl | between Cr and the center of gravity position Cl defined by (b) above approaches zero. Control the display time.

  Thus, the right eye image R and the left eye image L are simultaneously recognized by the viewer by making the difference between the gravity center position Cr and the gravity center position Cl close to zero. As a result, a stereoscopic image that does not make the viewer feel uncomfortable can be displayed.

  As described above, as the value of | Cr-Cl | approaches 0, the viewer can view a high-quality stereoscopic image. However, conventionally, when the right eye image R and the left eye image L captured by the first imaging method are displayed by the second display method (see FIG. 14A), the right eye image R is more than the left eye image L. It was displayed with a delay of a half cycle (T / 2) of a predetermined cycle T (1/60 seconds). Therefore, if the value of | Cr-Cl | is smaller than T / 2, an advantageous effect is recognized as compared with the conventional display method.

<< Modification of First Embodiment >>
FIG. 6 shows another example in which the right eye image and the left eye image are alternately displayed when the right eye image and the left eye image are simultaneously captured. The control unit 13 displays the left-eye image L1 for a half period of a predetermined period, and then predetermines a composite image R1 + R2 obtained by synthesizing the right-eye image R1 captured simultaneously with the right-eye image R2 captured next Display only half of the cycle.

  Next, the control unit 13 displays the left eye image L2 for a half period of a predetermined period, and then combines the right eye image R2 captured at the same time with the right eye image R3 captured next time. R2 + R3 is displayed for a half period of a predetermined period. Thereafter, the control unit 13 repeats the same control.

  According to this method, it is possible to perform display control while maintaining the relative relationship between the gravity center positions of the right eye image and the left eye image. If the predetermined period is 1/60 [s], the center of gravity of the left eye image L1 is 1/120 [s] and the center of gravity of the composite image R1 + R2 is 1/60 [s]. Therefore, the difference between the gravity center positions of the two images at the time of shooting is 1/120 [s].

  On the other hand, at the time of display (FIG. 6B), the centroid position of the left eye image L1 is 1/240 [s], and the centroid position of the composite image R1 + R2 is 3/240 [s]. Accordingly, the relative time difference of the barycentric position between the images at the time of display is also 1/120 [s], and this relative time difference can be kept the same.

Second Embodiment-In the case of the first display method-
Next, a second embodiment of the present invention will be described. The image display device 20 according to the present embodiment displays the right eye image and the left eye image simultaneously or substantially simultaneously using the first display method.

<Block Configuration and Operation of Image Display Device 20>
FIG. 7 shows the configuration of the image display device 20. The image display apparatus 20 according to the present embodiment includes an acquisition unit 21, a determination unit 22, a control unit 23, and a display unit 24. In the image display device 20 according to the present embodiment, the acquisition unit 21 acquires the right eye image R and the left eye image L captured by the second imaging method, and the display unit 24 acquires the right eye image R by the first display method. And the left eye image L are displayed. Since other configurations and operations are the same as those of the image display device 10 according to the first embodiment, description thereof will be omitted.

  Hereinafter, the control of the luminance, the number of display times, and the display time in the control unit 23 according to the present embodiment will be described in detail.

<Display Control in Control Unit 23>
(1) Relative position of right eye image R and left eye image L The control unit 23 captures the right eye image R and the left eye image captured by the second imaging method (for example, using two cameras respectively). Control for displaying L by the same display unit is performed. For this purpose, control is performed so that the relative positions of the captured right and left eye images are aligned with the relative positions of the right and left eye images to be displayed.

  Here, “the relative position of the right eye image R and the left eye image L on the time axis at the time of imaging” is the time when the right eye image R is captured and the time when the left eye image L is captured. It means the relative positional relationship on the time axis. Therefore, when the image is picked up by the second image pickup method, the right eye image R and the left eye image L are alternately picked up by a half cycle T / 2 (1/120 seconds) difference of a predetermined cycle T (1/60 seconds). (Refer to FIG. 13 (b)), the relative position on the time axis is T / 2 (1/120 seconds).

  The “relative position on the time axis between the right eye image R and the left eye image L at the time of display” is “the right eye image R determined by the brightness, the number of times of display, and the display time of the right eye image R”. It means a relative positional relationship on the time axis between the “centroid position Cr” and the “centroid position Cl” of the left eye image L determined by the luminance, the number of times of display, and the display time of the left eye image L to be displayed.

  Accordingly, when an image captured by the second imaging method is displayed by the first display method, “the relative position on the time axis between the right eye image R and the left eye image L at the time of display, and the right eye image R at the time of imaging. “Controlling the relative position between the center of gravity and the left eye image L” is equivalent to “controlling the difference between the center of gravity position Cr and the center of gravity position Cl so as to approach T / 2”. Thus, by controlling the difference between the gravity center position Cr and the gravity center position Cl so as to approach T / 2, the right eye image R and the left eye image L are alternately viewed by the viewer.

  Hereinafter, the “center of gravity position” between the right eye image R1 and the left eye image L2 will be described.

  FIG. 8 shows a case where the right eye image R1 and the left eye image L2 are displayed four times each, and the difference between the gravity center position Cr and the gravity center position Cl is T / 2.

  In this case, the center-of-gravity position Cr of the right eye image R is defined by the following (2). The following (2) is the same as (b) above.

…(two)
In (2) above, r represents a coefficient relating to the right-eye image R1, i represents which display time (1st to 4th) the coefficient is applied, and N is the number of display times (4 times). , W represents the luminance at each display time, ΔT represents the display time per display time, To represents the display start time at each display time, and Tc represents the display end time at each display time. . Therefore, ΔT at each display number is obtained by Tc−To. Here, the luminance in the present embodiment is the luminance when the display unit 14 is fully lit during the display time ΔT per display of the right eye image R1 or the left eye image L1.

  Similarly, the center-of-gravity position Cl of the left eye image L2 is defined by the following (e) similarly to Cr. The following (e) is the same as (b) above.

... (e)
In (e) above, l represents a coefficient relating to the left eye image L2, M represents the number of times of display (4 times), and the others are the same as in the case of Cr.

  The control unit 23 sets the difference | Cr−Cl | between the centroid position Cr of the right eye image R1 determined by (2) and the centroid position Cl of the left eye image L1 determined by (e) to T / 2. The brightness, the number of display times, and the display time per display number of the right eye image R1 and the left eye image L2 are controlled to approach each other.

  In addition, when the display unit 24 displays the image after the right eye image R3 and the left eye image L4, the control unit 23 performs control so that the difference between the respective gravity center positions approaches T / 2 as described above. To do.

(2-1) When controlling only the display count and the display time per display count The above is the luminance, display count, and display per display count when the right eye image R and the left eye image L are captured. The case where the time is controlled to match the first display method has been described. Hereinafter, a case will be described in which only the display count and the display time per display count are controlled so as to match the first display method. Hereinafter, control of the right eye image R2 and the left eye image L1 will be described.

  The control unit 23 controls the right eye image R2 and the left eye so that one of the right eye image R2 and the left eye image L1 is displayed with a delay of a half period of a predetermined period (1/60 seconds) from the other image. Display control with the image L1 is performed.

  FIG. 9 shows a case where the right eye image R2 and the left eye image L1 are displayed at the same time as one display. Moreover, the display time per time of the right eye image R2 and the left eye image L1 is a predetermined period T (1/60 seconds) in which each is imaged.

  As shown in FIG. 9, the control unit 23 displays the left-eye image L1 and the right-eye image R2 that are alternately captured for 1/60 second each, and later captures as shown in FIG. 13 (b). The displayed right eye image R2 is controlled to be displayed with a delay of 1/120 second from the left eye image L1. Note that the display unit 24, which is a projector using a reflective display element using a micromirror array, can control the luminance, the number of times of display, and the display time in the same manner as described in the first embodiment.

  According to the display control as described above, stereoscopic viewing is possible as follows.

  Two DLP projectors are prepared, the right-eye projector projects S-polarized video light, and the left-eye projector projects P-polarized video light. indicate. The viewer wears polarizing glasses including a polarizing plate that transmits S-polarized light for the right eye and a polarizing plate that transmits P-polarized light for the left eye. Accordingly, the right eye image and the left eye image are appropriately observed in the right eye and the left eye, and stereoscopic viewing is possible.

  When such control is performed, as shown in FIG. 9, the centroid position Cl of the left eye image L1 and the centroid position Cr of the right eye image R2 are y1 and y2 on the time axis, which is 1/120 second. There is a difference. That is, the control unit 23 controls the difference | Cr−Cl | between the centroid position Cr of the right eye image R2 and the centroid position Cl of the left eye image L1 to be T / 2 (1/120 seconds). Yes.

  This can also be confirmed from the fact that the following (f) derived from (2) and (e) holds.

... (F)
N = 1, M = 1, W = 1 (substitute 1 in FIG. 9 because luminance is not changed), ΔTr = 1/60 seconds, Tor = 1/120 seconds, Tcr Substituting = 3/120 seconds, ΔTl = 1/60 seconds, Tol = 0 seconds, and Tcl = 2/120 seconds, the above (f) holds.

  As described above, the control unit 23 displays the right eye image R2 and the left eye image L1 for a predetermined period, and displays one of the right eye image R2 and the left eye image L1 with a half period delayed from the other. By controlling in such a manner, the relative position on the time axis between the right eye image R2 and the left eye image L1 at the time of display, and the relative position on the time axis between the right eye image R2 and the left eye image L1 at the time of imaging. And are approximated.

  The same applies to the right eye image R4 and the left eye image L3 and later.

<Action / Effect>
According to the image display device 20 according to the present embodiment, the control unit 23 determines the relative position between the right eye image R and the left eye image L when the right eye image R and the left eye image L are displayed. Display control is performed so that the right eye image R and the left eye image L are aligned at the relative positions when the R and left eye images L are captured.

  Specifically, when the control unit 23 displays the right eye image R and the left eye image L captured by the second imaging method by the first display method, the right eye defined by (2) above. The right eye so that the difference | Cr−Cl | of the center of gravity position Cr of the image R and the center of gravity position Cl of the left eye image L defined by (e) above approaches a half cycle (T / 2) of a predetermined cycle. The brightness, display frequency, and display time of the image R and the left eye image L are controlled.

  Thus, the right eye image R and the left eye image L are alternately visually recognized by the viewer by making the difference between the gravity center position Cr and the gravity center position Cl close to T / 2. As a result, a stereoscopic image that does not make the viewer feel uncomfortable can be displayed.

  As described above, as the value of | Cr-Cl | approaches T / 2, the viewer can view a high-quality stereoscopic image. By the way, conventionally, when the right eye image R and the left eye image L captured by the second imaging method are displayed by the first display method (see FIG. 14B), the right eye image R becomes the left eye image L. On the other hand, it was displayed earlier by a half period of the predetermined period T (1/60 seconds) than the timing to be originally displayed. Therefore, if the value of | Cr—Cl | is smaller than T, an advantageous effect is recognized as compared with the conventional display method.

<Modification of Second Embodiment>
Next, a modification of this embodiment will be described.

  In the present modification, the right eye image R and the left eye image L are alternately captured, and the predetermined cycle of one of the right eye image R and the left eye image L is the same as the predetermined cycle of the other image. There is a difference of a half cycle (T / 2) of a predetermined cycle (see FIG. 13B).

  The control unit 23 acquires a composite image obtained by combining a plurality of other images having a predetermined period overlapping with one image, and performs display control so that the display timings of the one image and the composite image are aligned.

  Specifically, as shown in FIG. 10, the left eye image L (L1, L3, L5...) Is displayed for a predetermined period T (1/60 seconds), and the left eye image L is captured. The composite image (R2 + R4, R4 + R6, R6 + R8...) Of the right eye image R captured in the period before and after the period (see FIG. 13B) is displayed for a predetermined period T (1/60 seconds). Is done. In this case, the left eye image L is controlled to be displayed with a delay of a half cycle (1/120 seconds) of the predetermined cycle T from the synthesized image.

  As such a frame interpolation method, for example, the following three methods or a combination thereof can be used.

  The first method is to add the pixel values at the same address (x, y) in the frame of the right eye image R2 and the frame of the right eye image R4 at a predetermined ratio (contribution rate), and the same in the composite image (R2 + R4) In this method, the pixel value of the address (x, y) is used. If the contribution ratios are both 50%, the center of gravity of the composite image is the center of the R2 frame and the R4 frame. The center of gravity position of the composite image can be moved according to the contribution rate.

  The second method takes corresponding point matching between the frame of the right eye image R2 and the frame of the right eye image R4, and corresponds to the center position of the corresponding point determined to indicate the same information in the frame of R2 and the frame of R4. In this method, the pixel value of the address of the composite image (R2 + R4) is used as the pixel value of the corresponding point. The center of gravity of the composite image is the center of the R2 frame and the R4 frame. Further, by selecting another point on the line connecting the corresponding points, it is possible to move the barycentric position of the composite image.

  The third method is a method of dividing a frame into regions, acquiring a motion vector by calculation, and generating a composite image therebetween. The motion prediction when generating one frame of the composite image (R2 + R4) uses at least the frame of the right eye image R2 captured in the previous cycle and the frame of the right eye image R4 captured in the subsequent cycle. Then, the display position of each region in the frame of the composite image is determined to generate a composite image.

  In the above frame interpolation method, the barycentric position of the composite image can be moved in accordance with the contribution ratio of the pixel value of each image frame used for generating the composite image. When a composite image is generated using three or more image frames, the center of gravity can be obtained in consideration of the contribution ratio of the pixel value of each image frame.

  The display unit 24 simultaneously displays the right eye image R and the left eye image L by the first display method based on the display control as described above.

  When controlled in this way, as shown in FIG. 10, the same effect is produced as when the right eye image R4 is displayed between the left eye images L3 and L5. That is, as shown in FIG. 13B, the right eye image R and the left eye image L that are alternately captured with a half cycle difference of a predetermined cycle are alternately displayed with a half cycle difference of the predetermined cycle T. Therefore, the control unit 23 according to this modification example displays the relative positions of the right eye image R and the left eye image L when displaying the right eye image R and the left eye image L, and the right eye image R and the left eye image L. Display control is performed so that the right eye image R and the left eye image L are aligned at the relative position when the image is captured.

<< Other Embodiments >>
Although the present invention has been described according to the above-described embodiments, it should not be understood that the descriptions and drawings constituting a part of this disclosure limit the present invention. From this disclosure, various alternative embodiments, examples and operational techniques will be apparent to those skilled in the art.

 For example, in the above embodiment, the predetermined period T in which the right eye image R and the left eye image L are captured is 1/60 second, but it may be a period that is short enough to be recognized as a moving image.

 In the above embodiment, a projector using a reflective display element with a micromirror array is used as the display units 14 and 24. However, a self-luminous display such as a plasma display or a non-self-luminous display such as a liquid crystal display is used. However, the same effect can be obtained. Control of display image data in the case of a plasma display or the like can be performed in the same manner as in the case of a projector using a reflective display element with a micromirror array. Control of display image data in the case of a liquid crystal display or the like can be performed by controlling the transmittance by the voltage applied to each pixel instead of PWM control.

 In the first embodiment, Tc and To are described as matching (see FIG. 3), but Tc and To may be separated from each other.

 Further, in the first embodiment, the case where the control unit 13 does not change only the luminance is described. However, even if only the luminance is changed, the same applies as long as the relationship | Cr−Cl | <T / 2 is satisfied. An effect is obtained. Specifically, as shown in FIG. 11 (a), the left eye image L1 can be reduced by reducing the luminance of the left eye image L1 even in the case of display similar to the conventional display control shown in FIG. 14 (a). The difference in relative position between the center of gravity of the eye image L1 and the center of gravity of the right eye image R1 can be made close to zero. Further, even in the case of display as shown in FIG. 11B, by reducing the luminance of the left eye image L1, while increasing the luminance of the right eye image R1, the center of gravity position of the left eye image L1 is obtained. The difference in relative position with the center of gravity position of the right eye image R1 can be brought close to zero. Thus, according to the present invention, various control methods can be adopted as long as the relationship | Cr-Cl | <T / 2 is satisfied.

 In the second embodiment, the case where the control unit 13 does not change only the luminance is described. However, even if only the luminance is changed, the same is true as long as the relationship 0 <| Cr-Cl | <T is satisfied. An effect is obtained. Specifically, as shown in FIG. 12A, even when the display is performed in the same manner as the conventional display method shown in FIG. The difference in relative position between the gravity center position of the eye image L1 and the gravity center position of the right eye image R1 can be brought close to T / 2. Thus, according to the present invention, various display controls can be performed as long as the relationship of 0 <| Cr-Cl | <T is satisfied.

 In the second embodiment, the case where the right eye image R and the left eye image L captured by the first imaging method are displayed by the second display method has been described. However, the image was captured by the second imaging method. Even when the right eye image R and the left eye image L are displayed by the second display method as shown in FIG. 14C, T / 2K <| Cr-Cl | <T (1-1 / As long as the relationship 2K) is satisfied, the same effect can be obtained. Here, K represents a positive integer. Specifically, as shown in FIG. 12B, the center of gravity of the left eye image L1 and the right eye image R1 are increased by increasing the luminance of the left eye image L1 and decreasing the luminance of the right eye image R2. The difference in the relative position with respect to the center of gravity position can be brought close to T / 2. As described above, when the right eye image R and the left eye image L captured by the second imaging method are displayed by the second display method, T / 2K <| Cr-Cl | <T (1-1 As long as the relationship of / 2K) is satisfied, various display controls can be performed.

 In the above embodiment, the determination unit 12 automatically determines the imaging method based on the imaging method information P. However, the imaging method may be manually input to the control unit 13.

  As described above, the present invention naturally includes various embodiments not described herein. Therefore, the technical scope of the present invention is defined only by the invention specifying matters according to the scope of claims reasonable from the above description.

It is a figure which shows the structure of the image display apparatus which concerns on 1st Embodiment. It is a figure which shows operation | movement of the image display apparatus which concerns on 1st Embodiment. It is a figure for demonstrating the display control in the image display apparatus which concerns on 1st Embodiment. It is a figure for demonstrating the display control in the image display apparatus which concerns on 1st Embodiment. It is a figure for demonstrating the display control in the image display apparatus which concerns on 1st Embodiment. It is a figure for demonstrating the other display control in the image display apparatus which concerns on 1st Embodiment. It is a figure which shows the structure of the image display apparatus which concerns on 2nd Embodiment. It is a figure for demonstrating the display control in the image display apparatus which concerns on 2nd Embodiment. It is a figure for demonstrating the display control in the image display apparatus which concerns on 2nd Embodiment. It is a figure which shows the structure of the display image data which concerns on 2nd Embodiment. It is a figure for demonstrating the display control in the image display apparatus which concerns on 1st Embodiment. It is a figure for demonstrating the display control in the image display apparatus which concerns on 2nd Embodiment. It is a figure which shows the outline | summary of the conventional 1st imaging method and a 2nd imaging method. It is a figure for demonstrating the display control in the conventional image display apparatus.

Explanation of symbols

Cl: Center of gravity position, Cr: Center of gravity position, L: Left eye image, P: Imaging method information, R: Right eye image, T ... Predetermined period, W ... Luminance, 10 ... Image display device, 11 ... Acquisition unit, 12 ... Discriminating unit, 13 ... control unit, 14 ... display unit, 20 ... image display device, 21 ... acquisition unit, 22 ... discriminating unit, 23 ... control unit, 24 ... display unit

Claims (10)

An image display device that displays a stereoscopic image composed of a right eye image and a left eye image for stereoscopic viewing using stereoscopic perception by binocular parallax at a predetermined display cycle ,
An acquisition unit for acquiring a right eye image and a left eye image captured at a predetermined imaging cycle by the imaging device;
When the display cycle and the imaging cycle are not aligned,
A control unit that performs display control so that the difference between the gravity center position of the right eye image and the gravity center position of the left eye image on the time axis when displaying these images approaches the imaging cycle ;
An image display apparatus comprising: a display unit that displays right and left eye images based on display control by the control unit. In the case where the right eye image and the left eye image are simultaneously captured,
The control unit controls at least one of the luminance of the right eye image and the left eye image, the display count of the right eye image and the left eye image, and the display time per display count so as to satisfy the following formula 1. ,

(In Equation 1, N represents the number of times the right eye image is displayed, Wr represents the luminance of the right eye image, ΔTr represents the display time per display number of the right eye image, and Tor represents the display of the right eye image. Represents the start time, Tcr represents the display end time of the right eye image, M represents the number of times the left eye image is displayed, Wl represents the luminance of the left eye image, and ΔTl represents the number of times the left eye image is displayed. (Indicating the display time, Tol represents the display start time of the left eye image, Tcl represents the display end time of the left eye image, and T represents the predetermined period.)
The image display device according to claim 1, wherein the display unit alternately displays a right eye image and a left eye image . In the case where the right eye image and the left eye image are simultaneously captured,
The control unit sets the display count of one image among the right eye image and the left eye image to an even number, sets the display count of the other image to an odd number,
The image display device according to claim 1, wherein the display unit alternately displays the right eye image and the left eye image. The control unit equally assigns a display time per display count for the right eye image, and evenly assigns a display time per display count for the left eye image,
The image display device according to claim 3 , wherein a total display time assigned to the right eye image is equal to a total display time assigned to the left eye image . In the case where the right eye image and the left eye image are alternately captured,
The control unit controls at least one of the luminance of the right eye image and the left eye image, the display count of the right eye image and the left eye image, and the display time per display count to satisfy the following formula 2. ,

(In Equation 2, N represents the number of times the right eye image is displayed, Wr represents the luminance of the right eye image, ΔTr represents the display time per display number of the right eye image, and Tor represents the display of the right eye image. Represents the start time, Tcr represents the display end time of the right eye image, M represents the number of times the left eye image is displayed, Wl represents the luminance of the left eye image, and ΔTl represents the number of times the left eye image is displayed. (Indicating the display time, Tol represents the display start time of the left eye image, Tcl represents the display end time of the left eye image, and T represents the predetermined period.)
The image display apparatus according to claim 1 , wherein the display unit displays a right eye image and a left eye image simultaneously . The display unit can simultaneously display a plurality of videos, and when the right and left eye images obtained by the imaging device alternately capturing images are displayed using the plurality of display units,
The control unit performs control to display a right eye image and a left eye image such that a display period of a right (left) eye image overlaps a display period of a plurality of continuous left (right) eye images. The image display device according to claim 1. The display unit can simultaneously display a plurality of videos, and when the right and left eye images obtained by the imaging device alternately capturing images are displayed using the plurality of display units,
The control unit generates a composite image obtained by combining a plurality of images including at least a plurality of left (right) eye images whose imaging frame periods overlap with the right (left) eye image, and the right (left) eye image The image display apparatus according to claim 1 , wherein display control is performed so that display timings of the composite images are aligned . In the case where the right eye image and the left eye image are alternately captured in a predetermined cycle,
The control unit controls at least one of the luminance of the right eye image and the left eye image, the number of display times of the right eye image and the left eye image, and the display time per display number so as to satisfy the following Expression 3. ,

(In Equation 3, N represents the number of times the right eye image is displayed, Wr represents the luminance of the right eye image, ΔTr represents the display time per display number of the right eye image, and Tor represents the display of the right eye image. Represents the start time, Tcr represents the display end time of the right eye image, M represents the number of times the left eye image is displayed, Wl represents the luminance of the left eye image, and ΔTl represents the number of times the left eye image is displayed. (Tol represents the display start time of the left eye image, Tcl represents the display end time of the left eye image, T represents the predetermined period, and K represents a positive integer.)
The image display device according to claim 1, wherein the display unit alternately displays a right eye image and a left eye image . At least one of the right eye image and the left eye image is added with imaging method information indicating whether the right eye image and the left eye image are alternately captured or simultaneously captured,
The image display apparatus according to claim 1, wherein the control unit performs the control based on the imaging method information . When the right eye and left eye images are sequentially captured at substantially the same timing by each of the plurality of imaging devices,
The controller is
Generating a composite image composed of a plurality of images including at least a left (right) eye image captured simultaneously with the right (left) eye image and a left (right) eye image captured next;
After the right (left) eye image is displayed on the display unit for the half cycle of the predetermined cycle, the control for repeatedly displaying the composite image on the display unit for the half cycle of the predetermined cycle is performed. The image display device according to claim 1.