JP2015142141A - Image processing device, display device, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a viewer with information even when a display surface at the front and a display surface at the back are seen individually.SOLUTION: An image processing device comprises: an image acquisition unit which acquires a first image and a second image different from the first image; a depth information acquisition unit which acquires depth information expressing the distribution of a depth direction; and an image conversion unit which generates images to display on respective two display surfaces by changing the brightness of at least one of the first image and the second image such that the brightness ratio between the first image and the second image is based on the depth information, with respect to the respective pixels of the first image and the second image.

Description

  The present invention relates to an image processing device, a display device, and a program.

  In recent years, two images with a luminance ratio according to the depth position of a three-dimensional image are displayed on the front display surface and the rear display surface with different depth positions to generate binocular parallax, thereby A display method using a stereoscopic illusion phenomenon (also referred to as a DFD (Depth-Fused 3-D) illusion phenomenon) that perceives a stereoscopic effect is known (see, for example, Patent Document 1).

Japanese Patent No. 3464633

  However, in the display method as described above, when each of the front display surface and the back display surface is seen individually, an unnatural image is formed, so that information can be provided to the viewer. There is a problem that it becomes only when viewed from a predetermined position where a stereoscopic effect can be perceived.

  The present invention has been made in view of such circumstances, and displays two images with brightness ratios on the front display surface and the rear display surface at different depth positions to perceive a stereoscopic effect. In the method, an image processing device, a display device, and a program capable of providing information to a viewer even when a front display surface and a back display surface are individually viewed are provided.

  The present invention has been made in order to solve the above-described problem, and one embodiment of the present invention provides an image acquisition unit that acquires a first image and a second image different from the first image, and a depth. A depth information acquisition unit that acquires depth information representing a distribution of directions, and the depth information between the first image and the second image for each pixel of the first image and the second image. An image conversion unit that generates an image to be displayed on each of the two display surfaces by changing the brightness of at least one of the first image and the second image so that the brightness ratio is based An image processing apparatus comprising:

  According to another aspect of the present invention, there are provided two display units for displaying an image, an image acquisition unit for acquiring a first image and a second image different from the first image, and a distribution in the depth direction. A depth information acquisition unit that acquires depth information indicating the brightness of each pixel of the first image and the second image, and a brightness based on the depth information between the first image and the second image. An image conversion unit that generates an image to be displayed on each of the two display units by changing the brightness of at least one of the first image and the second image so that the ratio is This is a display device.

  According to another aspect of the present invention, an image acquisition unit that acquires a first image and a second image that is different from the first image, and a depth that acquires depth information representing a distribution in the depth direction. For each pixel of the information acquisition unit, the first image, and the second image, the brightness ratio between the first image and the second image is based on the depth information. A program for functioning as an image processing unit that generates an image to be displayed on each of two display surfaces by changing the brightness of at least one of the first image and the second image.

  According to the present invention, in a method for perceiving a stereoscopic effect by displaying two images with a brightness ratio on a front display surface and a rear display surface having different depth positions, the front display surface and the back Information can be provided to the viewer even when the display surface of the screen is viewed separately.

1 is an external view showing a configuration of a stereoscopic image display apparatus 10 according to a first embodiment of the present invention. It is the elements on larger scale which show the structural example of the front image display part 12 in the embodiment. It is a schematic block diagram which shows the structure of the image processing apparatus 13 in the embodiment. It is a figure which shows example FG1 of the front original image in the embodiment. It is a figure which shows example BG1 of the back surface original image in the embodiment. It is a figure showing typically example D1 of depth information in the embodiment. It is the figure which represented typically example Fr1 of the luminance distribution ratio Fr in the same embodiment. It is the figure which represented typically example Br1 of the luminance distribution ratio Br in the same embodiment. It is an example SG1 of an image perceived by the viewer U1 located in front of the front image display unit 12 in the same embodiment. It is an external view which shows the example of arrangement | positioning of the front image display part 12 when the half mirror in the embodiment is used, and the rear image display part 11. It is a schematic block diagram which shows the structure of the stereo image display apparatus 10a by 2nd Embodiment of this invention.

  Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is an external view showing a configuration of a stereoscopic image display apparatus 10 which is a display apparatus according to the first embodiment of the present invention. As shown in FIG. 1, the stereoscopic image display device 10 includes a rear image display unit 11, a front image display unit 12, and an image processing device 13. The stereoscopic image display device 10 uses a stereoscopic illusion phenomenon (also referred to as a DFD (Depth-Fused 3-D) illusion phenomenon) to display a stereoscopic image to the viewer U1 at a predetermined position in front of the front image display unit 12. Make them perceive. In addition, the viewer U2 at a position shifted from the front of the front image display unit 12 includes an image displayed by the rear image display unit 11 (hereinafter referred to as a rear image) and an image displayed by the front image display unit 12 (hereinafter referred to as “rear image”). It can be viewed separately from the front image).

  The DFD illusion phenomenon is an illusion phenomenon that a viewer perceives when a stereoscopic image is at a position proportional to the luminance ratio of the plurality of display surfaces when images are displayed on a plurality of display surfaces having different depth positions. It is. For example, it is assumed that the ratio between the luminance on the back display surface of a certain subject in the image and the luminance on the front display surface is 1: 2. At this time, the position at which the three-dimensional image of the subject is perceived by the viewer at the position where the subject on the far side display surface and the subject on the near side display surface are seen overlap each other from the far side display surface. It becomes a position of 1/3 from the back side to the display surface. In the stereoscopic image display device 10, the rear image display unit 11 is a display surface with a depth position on the back side, and the front image display unit 12 is a display surface with a depth position on the near side.

  The rear image display unit 11 displays an image according to the rear image signal input from the image processing device 13. The front image display unit 12 displays an image according to the front image signal input from the image processing device 13. The front image display unit 12 is installed in front of the display surface of the rear image display unit 11 and transmits light of an image displayed by the rear image display unit 11.

  For example, the front image display unit 12 transmits a light of the image displayed by the rear image display unit 11 by, for example, an LED (Light Electronic Diode), a liquid crystal display, an organic EL (light-emitting diode), and a transparent plate with a gap. Electro Luminescence) display or the like may be arranged, or an LED, a liquid crystal display, an organic EL display, or the like may be arranged on a lattice or interlaced member. When the LEDs are arranged, the front image display unit 12 displays the front image by setting the luminance of each LED to the luminance according to the front image signal. When the liquid crystal display and the organic EL display are arranged, the front image display unit 12 displays a front image by causing each display to display a portion of the front image corresponding to the installation position of the display.

  The image processing device 13 is an image signal that represents the original rear image that is the basis of the rear image displayed on the rear image display unit 11 and an image that is the original of the front image displayed on the front image display unit 12. When an image signal representing a front original image, which is an image different from the image, and depth information are input, a front image signal and a rear image signal are generated so that a stereoscopic effect according to the depth information is obtained. . The image processing device 13 inputs the generated front image signal to the front image display unit 12 and the rear image signal to the rear image display unit 11.

  FIG. 2 is a partially enlarged view showing a configuration example of the front image display unit 12. In the example shown in FIG. 2, a plurality of LEDs 122 are arranged on a support member 121 assembled in a comb shape. As shown in FIG. 2, the support members 121 are arranged at intervals. The light of the image displayed by the rear image display unit 11 passes through this interval. Therefore, as shown in FIG. 1, the viewer U1 located at a predetermined position in front of the front image display unit 12 appears to overlap the image displayed on the front image display unit 12 with the rear image display unit 11. .

  Here, since the front image display unit 12 has the support members 121 arranged at intervals, the displayed image is an image in which the portion of the interval is thinned out. When the viewer U1 sees an image of light emitted from the LED 122 of the front image display unit 12, an image that is thinned out but interpolated may be formed in the brain of the viewer U1. For example, when the viewer U1 sees an image by light emitted from the LED 122 of the front image display unit 12, an image of the letters “Aiueo” as shown in FIG. 4 is formed in the brain of the viewer U1. There is.

  In addition, among the light of the image displayed by the rear image display unit 11, the light blocked by the support member 121 of the front image display unit 12 does not reach the eyes of the viewer U1. For this reason, among the images displayed by the rear image display unit 11, an image that can be viewed by the viewer U <b> 1 is an image in which a portion blocked by the support member 121 is thinned out. When the viewer U1 sees an image of light emitted from the rear image display unit 11, an image that is thinned out but interpolated may be formed in the brain of the viewer U1. For example, when the viewer U1 sees an image by light emitted from the rear image display unit 11, an image of the letters “ABCDEFGHKM” as shown in FIG. 5 may be formed in the brain of the viewer U1. .

  Thus, when an image in which the thinned portion is interpolated is formed in the brain of the viewer U1, the viewer U1 displays the images displayed by the rear image display unit 11 and the surface image display unit 12. Can be recognized. That is, even if the distance between the LEDs 122 is relatively wide, or even when the portion blocked by the support member 121 is relatively wide, the viewer U1 can obtain the rear image display unit 11 and the surface image display unit 12 from each other. Can be recognized.

  FIG. 3 is a schematic block diagram showing the configuration of the image processing apparatus 13. The image processing device 13 includes a rear surface original image acquisition unit 31, a depth information acquisition unit 32, a front surface original image acquisition unit 33, a rear surface image generation unit 34, a distribution ratio calculation unit 35, and a front image generation unit 36. In the present embodiment, the rear surface original image acquisition unit 31 and the front surface original image acquisition unit 33 constitute an image acquisition unit. Further, the rear surface image generation unit 34, the distribution ratio calculation unit 35, and the rear surface original image generation unit 36 constitute an image conversion unit. The rear surface original image acquisition unit 31 acquires a rear surface original image (first image) that is a source of the rear surface image. For example, the rear surface original image acquisition unit 31 may receive an image by communicating with another device, may read an image from a recording medium such as a hard disk or a memory card, or may be captured by an imaging unit such as a camera. An image may be acquired. The rear surface original image is preferably a binary image.

  The depth information acquisition unit 32 acquires depth information. The depth information is information representing the position in the depth direction (line-of-sight direction) for each pixel of the stereoscopic image to be displayed. In the present embodiment, the information indicating the position in the depth direction is a depth value that increases as the distance from the viewpoint increases. The depth information acquisition unit 32 may receive the depth information by communicating with another device, for example, or may read the depth information from a recording medium such as a hard disk or a memory card. In addition, the depth information acquisition unit 32 may calculate parallax from an image captured by the stereo camera and convert the parallax into distance to obtain depth information, or may use the distance image captured by the distance image sensor as depth information. .

  The front original image acquisition unit 33 acquires a front original image (second image) that is a source of the front image. For example, the front original image acquisition unit 33 may receive an image by communicating with another device, may read an image from a recording medium such as a hard disk or a memory card, or may be captured by an imaging unit such as a camera. An image may be acquired. Note that the front original image is preferably a binary image. The rear surface image generation unit 34 multiplies the luminance distribution ratio Br to the rear surface image among the luminance distribution ratios of the respective pixels calculated by the distribution ratio calculation unit 35 by the pixel value of the corresponding pixel of the rear surface original image. Generate an image. The rear image generation unit 34 inputs an image signal representing the generated rear image to the rear image display unit 11 to display the rear image.

  The distribution ratio calculation unit 35 refers to the depth information acquired by the depth information acquisition unit 32, and determines the luminance distribution ratio between the pixels of the front image and the pixels of the rear image corresponding to the pixels. The distribution ratio calculation unit 35 inputs the luminance distribution ratio Fr that is the luminance distribution ratio of the front image to the front image generation unit 36, and inputs the luminance distribution ratio Br that is the luminance distribution ratio of the rear image to the rear image generation unit 34. . For example, when displaying the stereoscopic image having the depth value Df on the display surface of the front image display unit 12 and displaying the stereoscopic image having the depth value Db on the display surface of the rear image display unit 11, the distribution ratio calculation unit 35 is displayed. Calculates the luminance distribution ratios Fr and Br of the pixel having the depth value D as follows.

  When D ≦ Df, Fr = 1 and Br = 0. When Df <D <Db, Fr and Br satisfying Fr: Br = D−Df: Db−D and Fr + Br = 1. When Db ≦ D, Fr = 0 and Br = 1. For Df and Db, the value set by the user or the like may be stored in advance by the distribution ratio calculation unit 35, and the minimum value among the depth values included in the acquired depth information is Df, The maximum value may be Db.

  It should be noted that among the depth values included in the acquired depth information, a value that is smaller by a predetermined value α1 than the minimum value is set as Df, and the predetermined value lower than the maximum value is set so that neither of the luminance distribution ratios Fr and Br becomes 0. A value larger by the value α2 may be set as Db. By doing so, neither D ≦ Df nor Db ≦ D is satisfied, so that both of the luminance distribution ratios Fr and Br are 0 or more. For this reason, a pixel whose pixel value is not 0 in the rear surface original image does not have a pixel value of 0 in the rear surface image, and the viewer views information represented by the rear surface original image only when the rear surface image is viewed. I can grasp it. Similarly, a pixel whose pixel value is not 0 in the front original image does not have a pixel value of 0 in the front image. For this reason, the viewer can grasp the information represented by the front original image when only the front image is viewed.

  The front image generation unit 36 multiplies the luminance distribution ratio Fr to the front image among the luminance distribution ratios of the respective pixels calculated by the distribution ratio calculation unit 35 by the pixel value of the corresponding pixel of the front original image. Generate an image. The front image generation unit 36 inputs an image signal representing the generated front image to the front image display unit 12 to display the front image.

  FIG. 4 is a diagram illustrating an example FG1 of the front original image. The front original image FG1 is an image in which characters “Ai Ueoki” are arranged near the center. FIG. 5 is a diagram illustrating an example BG1 of the rear surface original image. The rear original image BG1 is an image in which the characters “ABCDEFGHKM” are arranged near the center. FIG. 6 is a diagram schematically illustrating an example D1 of depth information. The depth information D1 represents a shape having a hemispherical protrusion in the vicinity of the center of a plane having a constant depth value.

  FIG. 7 is a diagram schematically illustrating an example Fr1 of the luminance distribution ratio Fr corresponding to the depth information D1. The luminance distribution ratio Fr has the same shape as the depth information D1, that is, a shape having a hemispherical bulge in the vicinity of the center of the plane where the luminance distribution ratio Fr is constant. FIG. 8 is a diagram schematically illustrating an example Br1 of the luminance distribution ratio Br corresponding to the depth information D1. The luminance distribution ratio Br is a shape in which the depth information D1 is turned over, that is, a shape having a hemispherical recess near the center of the plane where the luminance distribution ratio Dr is constant.

  FIG. 9 is an example SG1 of an image perceived by the viewer U1 located in front of the front image display unit 12. The example of FIG. 9 is an example when the front original image FG1, the rear original image BG1, and the depth information D1 are input to the image processing device 13. As described above, the front image display unit 12 transmits the light of the rear image displayed by the rear image display unit 11. Therefore, from the viewer U1, there are a front image (character “Ai Ueoki”) displayed on the front image display unit 12 and a rear image (character “ABCDEFGHKM”) displayed on the rear image display unit 11. Looks like they overlap.

  Here, in the front image displayed on the front image display unit 12 (characters “Ai Ueoki”), the characters “Ai Ueoki” are arranged so as to fill the circle. That is, the front image displayed by the front image display unit 12 is a circular image in which portions other than lines forming characters are thinned out. Here, the portion other than the line forming the character is, for example, a blank portion in a substantially circular region where the characters “Ai Uoki” are gathered in the front original image FG1 of FIG. When the viewer U1 sees the image displayed by the front image display unit 12, a circle that is thinned out but interpolated may be formed in the brain of the viewer U1.

  In addition, the rear image (character “ABCDEFGHKM”) displayed by the rear image display unit 11 is arranged with the characters “ABCDEFGHKM” so as to fill the circle. That is, the rear image displayed by the rear image display unit 11 is a circular image in which portions other than lines forming characters are thinned out. When the viewer U1 sees the image displayed by the rear image display unit 11, a circle that is thinned out but interpolated may be formed in the brain of the viewer U1.

  For this reason, the image formed in the brain of the viewer U1 has the circle of the luminance distribution ratio Fr1 shown in FIG. 7 displayed on the front image display unit 12, and the image of the luminance distribution ratio Br1 shown in FIG. A circle is the same as that displayed on the rear image display unit 11. That is, this is the same as the conventional method of perceiving a stereoscopic image using the stereoscopic illusion phenomenon to perceive a depth as indicated by the depth information D1 in FIG. Therefore, the viewer U1 perceives an image in which the front image and the rear image overlap as a stereoscopic image of the shape represented by the depth information D1 (semispherical protrusion HB1).

  However, the viewer U2 can view the front image displayed by the front image display unit 12 and the rear image displayed by the rear image display unit 11 separately. That is, for the viewer U2 who can see the front image display unit 12 and the rear image display unit 11 separately, information represented by the front original image (character “Ai Ueoki”) and information represented by the rear original image (character “ABCDEFGHKM”). ) And can be provided.

  When the front original image and the rear original image are binary images having pixel values of only “1” or “0”, the rear image generation unit 34 and the front image generation unit 36 The pixel value “1” may be “1” as it is, and the pixel value “0” may be the distribution ratio value as the pixel value. In this case, the background portion having the pixel value “0” is perceived by the viewer as a stereoscopic image having a shape corresponding to the depth information.

  Further, as shown in FIGS. 4 and 5, the information presented by the front original image is preferably different from the information presented by the rear original image. Thereby, the information presented by the front image is different from the information presented by the rear image, and the information presented by the front image and the information presented by the rear image can be presented to the viewer U2. Because.

  Moreover, the case where the front image display unit 12 has the LED 122 for displaying each pixel of the front image and the region for transmitting the light of the image displayed by the rear image display unit 11 has been described. However, the device for displaying each pixel of the front image is transparent so as to transmit the light of the image displayed by the rear image display unit 11, and the front image display unit 12 includes the rear image display unit 11. A region for transmitting light of the displayed image may not be provided separately from the device for displaying pixels.

  Even if the device for displaying each pixel of the front image is transparent, the image formed in the brain of the viewer U1 is displayed on the front image display unit 12 as a circle with the luminance distribution ratio Fr1 shown in FIG. This is the same as the case where the circle of the luminance distribution ratio Br1 shown in FIG. 8 is displayed on the rear image display unit 11. Therefore, the viewer U1 perceives an image in which the front image and the rear image overlap as a stereoscopic image having a shape represented by the depth information D1.

  In the present embodiment, the case where the front image display unit 12 is arranged in front of the rear image display unit 11 has been described, but even if the arrangement of the front image display unit 12 is changed by using a half mirror. Good. FIG. 10 is an external view showing an arrangement example of the front image display unit 12 and the rear image display unit 11 when the half mirror 20 is used. In FIG. 10, the angle formed by the display surface of the rear image display unit 11 and the display surface of the front image display unit 12 is 90 degrees. The angle formed by the display surface of the rear image display unit 11 and the half mirror 20 and the angle formed by the display surface of the front image display unit 12 and the half mirror 20 are both 45 degrees. Further, the distance from the rear image display unit 11 to the half mirror 20 is longer than the distance from the front image display unit 12 to the half mirror 20.

  From the viewer U1 ', the rear image transmitted through the half mirror 20 and the front image reflected by the half mirror 20 appear to overlap. The front image reflected by the half mirror 20 can be regarded as being in a position that is a plane target with the front image display unit 12 with the half mirror 20 as a symmetry plane. That is, the depth position of the front image is the sum of the distance from the viewer U <b> 1 ′ to the half mirror 20 and the distance from the half mirror 20 to the front image display unit 12. It arrange | positions so that the distance of the half mirror 20 and the front image display part 12 may become shorter than the distance with the rear surface image display part 11. FIG. Therefore, the rear image display unit 11 is the rear display surface, and the front image display unit 12 is the front display surface. On the other hand, the viewer U <b> 2 ′ can directly see the front image and the rear image without using the half mirror 20.

  Thus, in the image processing apparatus 13, the rear surface original image acquisition unit 31 acquires the rear surface original image, and the front surface original image acquisition unit 33 acquires a front surface original image different from the rear surface original image. The depth information acquisition unit 32 acquires depth information of a stereoscopic image to be displayed. The rear image generation unit 34 and the front image generation unit 36 are configured such that, for each of the pixels of the rear surface original image and the front surface original image, the distribution ratio calculation unit 35 is based on the depth information between the rear surface original image and the front surface original image. A rear image and a front image to be displayed on the rear image display unit 11 and the front image display unit 12 are generated by changing the brightness of at least one of the rear original image and the front original image so that the calculated luminance distribution ratio is obtained. To do.

  Accordingly, the viewer U1 in FIG. 1 and the viewer U1 ′ in FIG. 10 perceive the stereoscopic image represented by the depth information, while the viewer U2 in FIG. 1 and the viewer U2 ′ in FIG. In addition, even when the front image display unit 12 and the rear image display unit 11 are individually viewed, the information represented by the rear original image or the information represented by the front original image can be provided.

Furthermore, the rear surface original image and the front surface original image are binary images. In addition, the rear image generation unit 34 and the front image generation unit 36 change the luminance of either one of two pixel values that can be taken in the binary image among the pixels of the rear original image and the front original image. Only pixels with pixel values.
Thereby, when the rear surface original image and the front surface original image are binary images, the viewer can perceive a stereoscopic image using a pixel having one of the two pixel values.

[Second Embodiment]
The second embodiment of the present invention will be described below with reference to the drawings. The rear surface original image and the front original image are input to the image processing apparatus 13 in the first embodiment. In contrast, not the image but the information presented by the rear image display unit 11 and the front image display unit 12 is input to the image processing device 13a which is the display device in the second embodiment.

  FIG. 11 is a schematic block diagram showing the configuration of the stereoscopic image display apparatus 10a in the present embodiment. In the figure, the same reference numerals (11, 12, 32, 34 to 36) are assigned to portions corresponding to the respective portions in FIG. The stereoscopic image display device 10a includes a rear image display unit 11, a front image display unit 12, and an image processing device 13a. The image processing device 13a includes a rear-surface original image acquisition unit 31a, a depth information acquisition unit 32, a front-surface original image acquisition unit 33a, a rear-surface image generation unit 34, a distribution ratio calculation unit 35, a front-surface image generation unit 36, and a rear-surface presentation information acquisition unit 37a. The front presentation information acquisition unit 38a is included.

  The rear surface presentation information acquisition unit 37a acquires rear surface presentation information that is information to be presented as a rear surface image. The front presentation information acquisition unit 38a acquires front presentation information that is information to be presented as a front image. The rear face presentation information and the front face presentation information are, for example, character strings. Further, the rear presentation information is different from the front presentation information.

  The rear surface original image acquisition unit 31a generates a rear surface original image by arranging an image representing the rear surface presentation information acquired by the rear surface presentation information acquisition unit 37a with reference to the depth information acquired by the depth information acquisition unit 32. . When the rear surface original image acquisition unit 31a refers to the depth information and arranges an image representing the rear surface presentation information, the image representing the rear surface presentation information in an area within a range in which the depth value indicated by the depth information is determined in advance. May be arranged. For example, when the depth information is the example shown in FIG. 6, if only the depth value of the hemispherical area in FIG. 6 is included in the predetermined range, the rear face presentation information is It is arranged only in the hemispherical area. As a result, the original rear image is as shown in FIG.

  The front original image acquisition unit 33a generates an original front image by arranging an image representing the front presentation information acquired by the front presentation information acquisition unit 38a with reference to the depth information acquired by the depth information acquisition unit 32. . When the front original image acquisition unit 33a also refers to the depth information and arranges the image representing the front presentation information, the depth value indicated by the depth information is within a predetermined range as in the rear original image acquisition unit 31a. An image representing the front presentation information may be arranged in this area. In this case, it is desirable that the predetermined range is the same in the rear surface original image acquisition unit 31a and the front surface original image acquisition unit 33a. By making it the same, the viewer U1 in FIG. 1 sees the image representing the front presentation information in the front image and the image representing the rear presentation information in the rear image overlapping, and is perceived as a stereoscopic image. is there.

  As described above, in the image processing device 13a as well as the image processing device 13, the rear surface original image acquisition unit 31a acquires the rear surface original image that is the source of the rear surface image. The front original image acquisition unit 33a acquires a front original image that is a source of the front image. The depth information acquisition unit 32 acquires depth information of a stereoscopic image to be displayed. The distribution ratio calculation unit 35 refers to the depth information and determines a luminance distribution ratio between the rear surface original image and the front surface original image for each pixel of the rear surface original image and the front surface original image. The rear image generation unit 34 converts the luminance of each pixel of the original rear image according to the distribution ratio, and generates a rear image. The front image generation unit 36 converts the luminance of each pixel of the front original image according to the distribution ratio, and generates a front image. The front original image is an image different from the rear original image.

  Accordingly, the viewer U1 in FIG. 1 and the viewer U1 ′ in FIG. 10 perceive the stereoscopic image represented by the depth information, while the viewer U2 in FIG. 1 and the viewer U2 ′ in FIG. In addition, even when the front image display unit 12 and the rear image display unit 11 are individually viewed, the information represented by the rear original image or the information represented by the front original image can be provided.

Further, the image processing device 13a is a rear-surface presentation information acquisition unit 37a that acquires rear-surface presentation information that is information to be presented in the rear-surface image, and the front-surface that is information different from the rear-surface presentation information and is presented as the front image. And a front presentation information acquisition unit 38a that acquires the presentation information. And the back surface original image acquisition part 31a makes a back surface original image by arrange | positioning the image showing back surface presentation information with reference to depth information. In addition, the front original image acquisition unit 33a refers to the depth information and arranges an image representing the front presentation information to generate a front original image.
Thereby, the information represented by the rear image can be different from the information represented by the front image.

In each of the above embodiments, luminance is used as a value representing brightness, and luminance ratio is used as a value representing brightness ratio. For example, other values such as brightness are used as values representing brightness. , And a ratio such as brightness may be used as a value representing the brightness ratio.
In each of the above-described embodiments, the luminance of both the rear original image and the front original image is changed. However, the rear original image is set so that the luminance ratio becomes the distribution ratio determined by the distribution ratio calculation unit 35. Or the luminance of only one of the front original images may be changed.

  Further, a program for realizing the functions of the image processing apparatus 13 in FIG. 1 or the image processing apparatus 13a in FIG. 11 is recorded on a computer-readable recording medium, and the program recorded on the recording medium is stored in the computer system. The image processing apparatus 13 or the image processing apparatus 13a may be realized by reading and executing. Here, the “computer system” includes an OS and hardware such as peripheral devices.

  The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

  The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and includes design changes and the like within a scope not departing from the gist of the present invention.

DESCRIPTION OF SYMBOLS 10, 10a ... Three-dimensional image display apparatus 11 ... Rear surface image display part 12 ... Front image display part 13, 13a ... Image processing apparatus 20 ... Half mirror 31, 31a ... Rear surface image acquisition part 32 ... Depth information acquisition part 33, 33a ... Front Image acquisition unit 34 ... rear image generation unit 35 ... distribution ratio calculation unit 36 ... front image generation unit 37a ... rear surface presentation information acquisition unit 38a ... front surface presentation information acquisition unit 121 ... support member 122 ... LED

Claims (7)

An image acquisition unit for acquiring a first image and a second image different from the first image;
A depth information acquisition unit for acquiring depth information representing a distribution in the depth direction;
For each pixel of the first image and the second image, the first image has a brightness ratio based on the depth information between the first image and the second image. Or an image conversion unit that generates an image to be displayed on each of the two display surfaces by changing the brightness of at least one of the second images. The first image and the second image are binary images;
The image conversion unit changes the brightness only for a pixel having one of the two pixel values that can be taken in the binary image among the first image and the second pixel. The image processing apparatus according to claim 1, wherein the image processing apparatus is provided. A presentation information acquisition unit that acquires information to be presented in the first image and information to be presented in the second image;
The image acquisition unit
By referring to the depth information and arranging an image representing information to be presented in the first image, the first image is generated,
The image processing apparatus according to claim 1, wherein the second image is generated by arranging an image representing information presented in the second image with reference to the depth information. Two display units for displaying images;
An image acquisition unit for acquiring a first image and a second image different from the first image;
A depth information acquisition unit for acquiring depth information of a stereoscopic image to be displayed;
For each pixel of the first image and the second image, the first image has a brightness ratio based on the depth information between the first image and the second image. Or an image conversion unit that generates an image to be displayed on each of the two display units by changing the brightness of at least one of the second images.   The display device according to claim 4, wherein the depth positions of the two display units are different.   6. The first display unit whose depth position is located in front of the two display units transmits light of an image displayed by a second display unit which is the other display unit. The display device described in 1. Computer
An image acquisition unit for acquiring a first image and a second image different from the first image;
A depth information acquisition unit for acquiring depth information of a stereoscopic image to be displayed;
For each pixel of the first image and the second image, the first image has a brightness ratio based on the depth information between the first image and the second image. Alternatively, a program for causing an image conversion unit to generate an image to be displayed on each of the two display surfaces by changing the brightness of at least one of the second images.

Images