JP2000267038A - Picture observation device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a picture observation device by which both of an outside picture and a picture displayed on a display means can be excellently observed within the same visual field. SOLUTION: This picture observation device is constituted so that both light beams of the outside picture and the picture displayed at the display means 13 are guided to an observer side through an optical path split means and observed within the identical visual field. Then, it is provided with an image pickup means picking up the image of the outside picture and a spatial modulation element having two-dimensional pixel structure in an optical path. Besides, it is provided with a control means SP enabling the observation of luminous flux constituting the outside picture and the observation of luminous flux constituting the display picture to be switched by modulating at least one part area of the spatial modulation element, controlling the spatial modulation element so as to cut off or shield the luminous flux in the area of the outside picture according to the area of the display picture and complement image information obtained by picking up the image by the image pickup means in the circumferential area of the display picture so that an area becoming dark because the luminous flux is vignetted by the spatial modulation element is not caused at the circumferential area of the display image.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image observation apparatus, for example, so that an external scene (external information, external image) and an image (display image) displayed on a display device (image display means) can be observed in the same visual field. Or an image (virtual object) artificially created by computer graphics or the like or a video (image information) recorded by video on a real scene (external world information) directly viewed by the observer The present invention relates to an image observation device capable of performing various pseudo experiences by doing so.

[0002]

2. Description of the Related Art Conventionally, an image (virtual image) generated by computer graphics or an image recorded by a video camera or the like is synthesized and displayed on an external image (external information) in which an observer directly observes the external world. In addition, various image observation apparatuses have been proposed in which a real space and a virtual space can be synthesized and observed.

FIG. 13 is a schematic view of a main part of a conventional image observation apparatus for observing both external world information and a display image within the same field of view. In FIG. 1, an image generated by computer graphics or the like is displayed on a display 101, and the image is transmitted to a concave mirror 10 through a half mirror 102.
3 and again displayed as a virtual image magnified on the observer's eye 104 at a fixed magnification via the half mirror 102, and at the same time, a real external scene (external image) where the observer is present is superimposed via the half mirror 102. It is made to be seen directly.

[0004] The image observation apparatus having such a configuration has an advantage that, for example, an operator can obtain information necessary for the operation at the same time while performing the actual operation by using characters and images displayed on the display 101. It can be used for such purposes.

[0005] Alternatively, an image of the vase 106 with parallax is created by computer graphics or the like as shown in FIG. 14 and displayed on a display for the left and right eyes of the observer, so that the vase 106 is realized as if it were a real vase. The present invention can also be used for a head-mounted image observation apparatus that makes it appear as if it is on a desk 105 in a space and gives the observer various pseudo experiences.

[0006]

In the conventional image observation apparatus, the image displayed on the display (display means) is reflected on the eyes of the observer as a virtual image, so that the displayed image appears as a transparent image. Accordingly, there is a problem that the outside world information is too bright especially in the outdoors where sunlight is strong, so that the display of image information such as characters and images displayed on the display becomes dark and difficult to see. As a countermeasure, it is possible to adjust the amount of light from the outside world with a filter or the like to make the display screen easier to see, but it is only for the entire display screen and only for the part corresponding to the character or image area to be displayed I couldn't do that.

[0007] Further, even if a vase created by computer graphics or the like as a virtual object is superimposed on a desk in a real space as external world information to make it seem as if the vase is actually on the desk, There was a problem that the vase was seen through and did not look as if the vase were actually on a desk. Further, even if an attempt is made to display a black color image, the image is transparent and cannot be displayed.

Therefore, in order to avoid such a phenomenon, a method of converting a scene in the real space (external world information) into an electric signal by a photographing device such as a CCD camera and synthesizing it with a virtual image created by computer graphics or the like and displaying it. There is. However, in this case, the actual scene (external world information) depends on the resolution of the camera, and at present, a dense image cannot be obtained as easily as seen by the naked eye. Therefore, there is a problem that it is inevitable that the scene will be different from reality.

According to the present invention, when both an external image from the outside and a display image displayed on a display means (display) are observed in the same field of view, an area corresponding to the image (display image) displayed on the display means is obtained. A virtual image (display image) created by computer graphics or the like, and an image observation device that blocks a light beam from the outside world from passing through and entering the observer's eyes so that both the display image and the outside world image are easy to see. ) Is superimposed on the real world scene (external world information)
It is an object of the present invention to provide an image observation device that can prevent a virtual image from being a transparent image and can favorably observe both images.

[0010]

According to the first aspect of the present invention, there is provided an image observing apparatus for guiding both an external image of an external environment and a display image displayed on a display means to an observer through an optical path dividing means. An image observation apparatus for observing in a field of view, comprising: an imaging unit for imaging the external world image; and a spatial modulation element having a two-dimensional pixel structure, and modulating at least a part of the spatial modulation element to form the external world image. To switch the observation of the light beam and the light beam constituting the display image, and control the spatial modulation element so as to block or reduce the light beam in the region of the external image corresponding to the region of the display image, A light source is provided by the spatial modulation element in a peripheral region of the display image, and a control unit is provided for complementing image information captured by the imaging unit to the peripheral region so that a darkened region does not occur.

According to a second aspect of the present invention, in the first aspect, the luminous flux forming the external image and the luminous flux forming the display image are luminous fluxes having different polarization states, and the spatial modulation element is a transmission type. It is characterized by using a liquid crystal panel.

According to a third aspect of the present invention, there is provided an image observation apparatus which guides both an external image of an external environment and a display image displayed on a display means to an observer through an optical path dividing means, and observes the image in the same visual field. The observation device includes a spatial light modulator having a two-dimensional pixel structure in an optical path, and observes a light beam constituting the external image and a light beam constituting the display image by modulating at least a part of the spatial light modulator. And a control means for controlling the spatial modulation element so as to block or diminish the luminous flux in the area of the external image corresponding to the area of the display image.

According to a fourth aspect of the present invention, in the third aspect of the present invention, the spatial modulation element utilizes a transmission type liquid crystal panel.

According to a fifth aspect of the present invention, in the third aspect of the present invention, the light beam forming the external image and the light beam forming the display image are light beams having different polarization states.

According to a sixth aspect of the present invention, there is provided an image observation apparatus for observing an external image of an external environment and a display image displayed on a display means in the same visual field via an optical path dividing means.
The external image is observed through a spatial modulation element having a two-dimensional pixel structure, and the spatial modulation element selects a part or all of the external image and the display image by modulation in area within the same field of view. And a control unit that complements a surrounding area of the selected display image by using image information obtained by an imaging unit that captures the external image.

According to a seventh aspect of the present invention, in the sixth aspect of the invention, the spatial modulation element selects at least a part of the external image and the display image using polarized light orthogonal to each other to guide the light to an observer. It is characterized by having.

[0017]

(Embodiment 1) FIG. 1 is a schematic view of a main part of Embodiment 1 of the present invention. The image observation apparatus according to the present embodiment includes a display observation system for observing image information displayed on the display element 13 for displaying a virtual object formed by computer graphics or the like and external information (external image) obtained by imaging means. It has an observation system for directly observing image information of the outside world, and a photographing system for forming an image of the outside world on the image sensor 18. The image information by the display observation system and the image information of the outside world by the observation system, and The image information such as the image information of the outside world obtained by the photographing system is observed from the observation position (eye) E in the same field of view.

The image observation apparatus of the present embodiment has a polarization beam splitter 10 that transmits P-polarized light and reflects S-polarized light.
A spatial light modulator 11 having a two-dimensional pixel structure, a polarizing plate 12 arranged to transmit P-polarized light, a backlight, a liquid crystal element, a display means 13 for emitting P-polarized light, and a P-polarized light; A polarizing beam splitter 14 for reflecting S-polarized light, a quarter-wave plate 15, a mirror (curved mirror) 16 having a positive power, an imaging optical system 17,
It has a two-dimensional image sensor 18 such as a CCD. E in the figure
Is the eye of the observer.

The spatial modulation element 11 is, for example, a transmission type TN
It is composed of a liquid crystal panel or the like, and has a function of preserving the polarization direction of incident light for each pixel in the case of an ON operation and rotating the polarization direction of the incident light by 90 degrees in an OFF operation. The focal length, position, and the like of the mirror 16 are determined so that the display surface of the display unit 13 is displayed as a virtual image enlarged, for example, to a position 2 m ahead and presented to the observation eye E. Each element for observing the image displayed on the display means 13 constitutes a display observation system.

Of the light beam L0 from the outside, the P-polarized light component passes through the polarization beam splitter 10 and
It is led to. In the region where the spatial modulation element 11 is in the ON state, the light beam of the P-polarized light component that has passed through the spatial modulation element 11 passes through the polarizing plate 12 and is guided to the observation eye E. This observation system does not allow a light beam to pass through an optical system or the like having power, so that the observer can naturally see image information of the outside world as in the case of viewing through a glass window. Each element for directly observing image information of the outside world constitutes an observation system. On the other hand, in the region where the spatial modulation element 11 is in the off state, when passing through the spatial modulation element 11, the P-polarized light is rotated in the plane of polarization and becomes an S-polarized light component. Does not reach.

On the other hand, of the light beam L0 from the outside, the S-polarized light component is reflected by the polarizing beam splitter 10 and the polarizing beam splitter 14, is focused by the imaging optical system 17, and forms image information of the outside on the imaging device 18. .

Image information obtained by the image pickup device 18 is processed by a signal processing circuit (control means) SP, and
3 is displayed. Each element for forming image information of the outside world on the imaging element 18 constitutes an imaging system.

The display image light emitted from the display means 13 is P
Since the light is polarized, it passes through the polarizing beam splitter 14 and the polarizing beam splitter 10, passes through the quarter-wave plate 15, is reflected by the mirror 16, and passes through the quarter-wave plate 15 again. At this time, since the light passes through the quarter-wave plate twice, the polarization plane rotates, and the display image light becomes S-polarized light. 1/4 wavelength plate 1
5 is S-polarized light, so that it is reflected by the polarization beam splitter 10 this time, and
It is led to. In the region where the spatial modulation element 11 is in the ON state, the polarization plane is held by the spatial modulation element 11, so that the luminous flux of the S-polarized component that has passed therethrough is blocked by the polarizing plate 12,
It does not reach the observation eye E. On the other hand, in the region where the spatial modulation element 11 is in the off state, the S-polarized light component becomes a light beam of a P-polarized light component whose polarization plane is rotated when passing through the spatial light modulation element 11,
It passes through the polarizing plate 12 and is guided to the observation eye E.

Next, the features of this embodiment will be described. For example, assume that the object 22 exists in the real space as shown in FIG. FIG. 2A shows an external image observed by the observation system at that time. In FIG. 2A, reference numeral 21 denotes an observation area. Here, the computer graphics C shown in FIG.
FIG. 2A shows a virtual object (display image) 23 created by G or the like.
The case where the image is superimposed and displayed in front of the real object 22 will be described.

In the conventional image observation apparatus, since the display image 23 is a virtual image as shown in FIG. 2C, the virtual object 23 is transparent at the portion overlapping the real object 22 and
2 is visible.

Therefore, as shown in FIG.
The area 11a through which the light beam forming the virtual object (display image) 23 passes on 1 is turned off, and the other area 11b is turned on. FIG. 3 is an enlarged view of a portion from the spatial light modulator 11 of this embodiment shown in FIG. P represents the entrance pupil of the observation eye E. The area 11a to be turned off on the spatial light modulator 11 is the position and size of the virtual object 23, the size of the entrance pupil of the observation eye, the position of the spatial light modulator 11, the rotation of the eyeball, and both when displaying a three-dimensional image. The position and size are determined based on the amount of parallax.

In this case, since the light beam from the outside and passing through the polarizing beam splitter 10 is P-polarized light, the region 11b of the spatial modulation element 11 which is in the on state is turned on.
Incident on the observation eye E passes through the polarizing plate 12 because it remains P-polarized light, but the region 11a in the off state
Are emitted as S-polarized light, and are blocked by the polarizing plate 12.

On the other hand, the light beam from the display means 13 is S-polarized when it enters the spatial
Is incident on the polarizing plate 12 as S-polarized light.
The light beam that has been cut off and incident on the area 11a becomes P-polarized light and passes through the polarizing plate 12. As a result, the luminous flux from the outside in the region Q does not reach the observation eye E, and in the region S, the light passes through the ON portion 11b of the spatial modulation element 11.
Observation can be made without the light beam being blurred.

However, as shown in FIG. 3, since the virtual image M of the display panel of the display means 13 is not located at an optically equivalent position to the spatial modulation element 11 and the entrance pupil P has a size, the light flux from the outside world is reduced. A region R where a light beam is partially blocked exists around the region Q that is completely shielded. The observation image at this time is as shown in FIG. 4A, and a dark region 24 is generated around the virtual object 23. Observation area 2 in FIG.
4 (B) and 4 (C) show the transmittance distributions T of the external light flux and the display light flux on the AA 'line on FIG.

In the present embodiment, the external image 22 received by the image sensor 18 and the virtual image 23 created by computer graphics and the like are superimposed, and image processing is performed by the control means SP. An image as shown in FIG. 4D is displayed on the display means 13 so that the area overlapping with the image does not show through.

In this manner, the scene of the outside world partially shaded by the spatial light modulator 11 and the polarizing plate 12 in the area around the virtual image 23 is received by the image sensor 18 and displayed by the display means 13.
Is complemented by the external image displayed on the screen, so that it is possible to observe without discomfort. Although the quality is slightly lower than in the case where the actual scene is viewed directly, since the directly viewed external image and the image once digitized are superimposed, the image becomes quite high in quality. Further, in an area occupying most of the observation area, the outside world can be directly observed.

The control means SP superimposes the external image 22 received by the image pickup device 18 and the virtual image 23 created by computer graphics CG or the like, displays the superimposed image on the display means 13, and calculates based on the above-mentioned parameters. Is performed, and the spatial modulation element 11 is controlled by determining the ON / OFF region, so that the observer can favorably observe both the display image and the external image.

Since the spatial light modulator 11 can be controlled to block the external light beam, a "black color" can be displayed and superimposed on the external image.

In the above embodiment, the spatial light modulator 1
Although an example in which the operation state of 1 is a binary state of on and off is shown, an intermediate state between them, that is, the rotation angle of the polarization direction of the incident light beam is set to an arbitrary angle instead of 90 degrees, so that an arbitrary state can be obtained. May be presented.

FIG. 5 is a schematic view of a main part of a second embodiment of the present invention. 5, components having the same functions as those of the first embodiment shown in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted.

In FIG. 5, a polarization-selective optical thin film that transmits P-polarized light and reflects S-polarized light is formed on a boundary surface 31 between the prism bodies L1 and L2. The prism bodies L1 and L2 are made of a material having no birefringence.

S-polarized light is emitted from the display means 13a. The s-polarized light beam emitted from the display means 13a is refracted by the surface 35, enters the prism L2, enters the surface 36 at an angle equal to or greater than the critical angle, is totally reflected, and has a positive power because it is s-polarized light. Is reflected by the surface 31 having the angle L, enters the surface 36 again at an angle smaller than the critical angle, is refracted, and
2 and is guided to the spatial modulation element 11. Face 3
1, 35 and 36 each have an optical power,
An enlarged virtual image of the display means 13a is formed. Face 31,
By configuring each of 35 and 36 with a rotationally asymmetric aspheric surface having different power depending on the azimuth angle around the surface vertex, it becomes possible to correct various aberrations caused by decentering the optical system with a small number of optical elements. The light beam L0 from the outside world is refracted by the surface 30 and is incident on the prism L1, and the P-polarized light component of the light beam L0 is transmitted through the surface 31 and is incident on the surface 36, is refracted and is emitted from the prism body L2, and is spatially modulated. It is led to the element 11. The prism bodies L1 and L2 are made of a material having the same refractive index, and are configured so as to have no power with respect to a light beam from the outside by optimizing the shapes of the surfaces 30 and 36.

On the other hand, the light beam L from the outside refracted by the surface 30
0, the S-polarized light component is reflected by the surface 31 having a negative power and the surface 30 having a positive power at an angle equal to or larger than the critical angle.
Again, totally reflected, refracted by the surface 32 and emitted from the prism body Ll, condensed by the lens group 33 having positive power, and forms an external image on the image sensor 34. The surfaces 30 and 32 are each formed of a rotationally asymmetric aspheric surface having different power depending on the azimuth angle around the surface term point.

Other configurations in FIG. 5 are the same as those in the first embodiment in FIG.

FIG. 6 is a schematic view of a main part of a third embodiment of the present invention. In this embodiment, the prism body L of the second embodiment shown in FIG.
l, a lens group 33, and an image pickup device 34, the image pickup system portion is replaced with a polarizing beam splitter 37 and an image pickup optical system 3.
8 and the configuration is the same as that of the first embodiment except that the image sensor 34 is used.

In the light beam L0 from the outside, the polarization beam splitter 37 reflects S-polarized light and transmits P-polarized light. The P-polarized light transmitted through the polarization beam splitter 37 is incident on the spatial light modulator 11 after passing through the prisms L1 and L2. The S-polarized light reflected by the polarization beam splitter 37 is guided by the imaging optical system 38 onto the imaging device 34. The optical path of the S-polarized light from the display means 13a is the same as in FIG.

The embodiment shown in FIG. 5 and FIG.
The superimposition of the real scenery and the virtual image is possible on the same principle as the embodiment shown in FIG.

FIG. 7 is a schematic view of a main part of a fourth embodiment of the present invention. The image observation device of the present embodiment transmits P-polarized light,
A polarizing beam splitter 40 that reflects S-polarized light, a spatial modulation element 43 having a two-dimensional pixel structure, a display unit 45 that includes a backlight, a liquid crystal element, a polarizing plate, and the like, and that emits P-polarized light. , A polarizing beam splitter 44, a quarter-wave plate 46, a mirror 47 having a positive power, an imaging optical system 41, and a two-dimensional imaging device 42 such as a CCD. E in the figure is the eye of the observer.

The spatial modulation element 43 is composed of a liquid crystal panel or the like, and has a function of preserving the polarization direction of the incident light for each pixel in the case of the ON operation, and rotating the polarization direction of the incident light by 90 degrees in the OFF operation. . The focal length and position of the mirror 47 are determined so that the display surface of the display means 45 is presented to the observation eye as a virtual image enlarged to a position 2 m ahead, for example.

The P-polarized light component of the light beam L0 from the outside passes through the polarization beam splitter 40,
It is led to. The light beam of the P-polarized light component that has passed through the polarization plane without being rotated by the spatial modulation element 43 passes through the polarization beam splitter 44 and is guided to the observation eye E. In this case, since the light flux does not pass through the optical system or the like having power,
The observer can naturally see the outside world image as if looking through a glass window.

On the other hand, the luminous flux of the S-polarized light component whose polarization plane has been rotated when passing through the spatial light modulator 43 is reflected by the polarization beam splitter 44 and does not reach the observation eye E. Of the light beam L0 from the outside world, the S-polarized light component is polarized light beam splitter 4
0, is converged by the imaging optical system 41,
2 to form an external image.

The display image light emitted from the display means 45 is P
Since the light is polarized, it passes through the polarizing beam splitter 44, passes through the １ ／ wavelength plate 46, is reflected by the mirror 47, and passes through the 波長 wavelength plate 46 again. At this time, 1/4
Since the light passes through the wave plate twice, the polarization plane rotates, and the display image light becomes S-polarized light. The luminous flux transmitted through the quarter-wave plate 46 again is S-polarized light, and is reflected by the polarization beam splitter 44 and guided to the observation eye E.

The light beam L0 from the outside world can be shielded from light in an arbitrary area by controlling the spatial modulation element 43 according to the principle shown in FIG. On the other hand, the display means 45
An image having a light quantity distribution as shown in FIG. 8B is displayed so as to complement the transmittance distribution of the external light flux shown in FIG.
With such a configuration, the same effect as in the first embodiment can be obtained. Further, it is possible to provide the position of the spatial modulation element 43 at a position further away from the pupil of the observation eye,
The effect of the shaking on the area near the light shielding area can be reduced.

FIG. 9, FIG. 10 and FIG. 11 are schematic views of main parts of the fifth, sixth and seventh embodiments of the present invention. In these embodiments, portions having the same functions as those in the embodiment shown in FIGS. 1, 5, and 6 are denoted by the same reference numerals, and description thereof is omitted.

FIG. 9 shows the polarization beam splitters 10 and 14 of the first embodiment shown in FIG.
0 ', 14', except for the quarter-wave plate 15, P
The difference is that a polarizing plate 48 arranged to transmit polarized light is added to the outside, and the spatial modulation element 11 is provided outside the half mirror 10 ′. The other configuration is the same.

FIG. 10 shows the display means 13a for emitting S-polarized light in the embodiment shown in FIG.
3, the prism joint surface 31 was replaced with a half mirror 31 ', a polarizing plate 48 arranged to transmit P-polarized light was added to the outside, and the spatial modulation element 11 was provided outside the prism Ll. The points are different, and the other configurations are the same.

FIG. 11 is different from the embodiment shown in FIG. 6 in that the prism joining surface 31 is replaced with a half mirror 31 ', and the spatial modulation element 11 and the polarizing plate 12 are provided on the outer side of the prism body Ll. Other configurations are the same.

According to each of the embodiments shown in FIGS. 9, 10, and 11, the same effects can be obtained by performing the same control as that of the fourth embodiment shown in FIG. 7 by adopting such a configuration.

FIG. 12A is a schematic view of a main part of an eighth embodiment of the present invention. In the present embodiment, when an image to be presented in the observation space does not need to consider the positional relationship in the depth direction with a real object as shown in FIG. A configuration as shown in FIG. Note that components having the same functions as those of the embodiment shown in FIG. 1 are denoted by the same reference numerals and description thereof is omitted.

The P polarization component of the light beam L0 from the outside is P
Passing through a polarizing plate 50 arranged to transmit polarized light,
The light passes through the half mirror 51 and is guided to the spatial light modulator 11. It is composed of a backlight, a liquid crystal element, a polarizing plate, etc.
The display light flux emitted from the display means 13a which emits polarized light passes through the half mirror 51, is reflected by the mirror 16, and
The light is reflected by the half mirror 51 and guided to the spatial light modulator 11. With such a configuration, according to the above-described principle, the display image 23 can be observed in the observation area 21 without the outside world being transparent as shown in FIG. In this case, as in the case shown in FIG. 4A, a dark portion occurs around the display image, but the computer screen can be displayed at an arbitrary position in the field of view without the outside world being transparent.

In each of the above embodiments, the display means 13,
Although a transmissive liquid crystal panel is used as the display element 13a, a reflective liquid crystal panel, an EL panel, or the like may be used as the display element.

[0057]

According to the present invention, when observing both the external image from the external world and the display image displayed on the display means (display) in the same field of view, the image (display image) displayed on the display means is displayed. An image observing device and a virtual image created by computer graphics or the like, in which a luminous flux from the outside passes through the corresponding area and blocks the light from entering the observer's eyes so that both the display image and the outside image can be easily viewed. When an image (display image) is superimposed on a scene (external world information) in the real space, the virtual image is prevented from being a transparent image,
An image observation device capable of favorably observing both images can be achieved.

In addition, according to the present invention, when a virtual image (display image) created by computer graphics or the like is superimposed on a scene (external world information) in a real space, information of an imaging system for acquiring external world information is obtained. Based on the calculated positional relationship between the virtual image and the real space, the external information in the image (display image) area displayed on the display (image display means) is accurately cut off in accordance with the display image, In addition, by supplementing the surrounding information with the outside information captured by the imaging unit so that a darkened area does not occur in the surrounding area of the area, it is possible to favorably observe both the display image and the outside image. Can be. In addition, it is possible to achieve an image observation device that can display a “black color” which was impossible in the related art.

Further, according to the present invention, in a case where an image from a display is superimposed on an image light from the outside and displayed, it is possible to remove an image light flux from the outside in an arbitrary area in an area where the images overlap. it can. Therefore, it is possible to prevent an image such as a character or an image displayed on the display from being difficult to see even in a place where external light is strong, such as outdoors. Further, it is possible to prevent the virtual image from being seen through when the virtual image displayed by the display is synthesized and displayed in the external scene, that is, the real image.

Further, according to the present invention, the same effects as those described above can be obtained, and a computer screen or the like can be displayed at an arbitrary position in the field of view without the outside world being transparent, thereby reducing the burden on the observer. It becomes possible.

[Brief description of the drawings]

FIG. 1 is a schematic view of a main part of a first embodiment of the present invention.

FIG. 2 is an explanatory view of a part of FIG. 1;

FIG. 3 is an explanatory view of a part of FIG. 1;

FIG. 4 is an explanatory view of a part of FIG. 1;

FIG. 5 is a schematic diagram of a main part of a second embodiment of the present invention.

FIG. 6 is a schematic diagram of a main part of a third embodiment of the present invention.

FIG. 7 is a schematic diagram of a main part of a fourth embodiment of the present invention.

FIG. 8 is an explanatory view of a part of FIG. 7;

FIG. 9 is a schematic view of a main part of a fifth embodiment of the present invention.

FIG. 10 is a schematic diagram of a main part of a sixth embodiment of the present invention.

FIG. 11 is a schematic view of a main part of a seventh embodiment of the present invention.

FIG. 12 is a schematic view of a main part of an eighth embodiment of the present invention.

FIG. 13 is a schematic diagram of a main part of a conventional image observation device.

FIG. 14 is an explanatory diagram when a virtual image is added to an external image

[Explanation of symbols]

11, 43 Spatial modulation element 12, 50 Polarizing plate 13, 45, 13a Display means 10, 14, 37, 40, 44 Polarizing beam splitter 15 λ / 4 plate 16, 47 Mirror 17, 38, 41 Imaging optical system 18, 34 , 42 Image sensor E Observer's eye 21 Observation area 22 Real object 23 Virtual object L1 Prism body L2 Prism body 33 Lens group SP Control means CG Computer graphics 10 ', 14', 31 ', 51 Half mirror

[Procedure amendment]

[Submission Date] March 14, 2000 (200.3.1)
4)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claim 1

[Correction method] Change

[Correction contents]

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] Claim 3

[Correction method] Change

[Correction contents]

[Procedure amendment 3]

[Document name to be amended] Statement

[Correction target item name] 0010

[Correction method] Change

[Correction contents]

[0010]

According to the first aspect of the present invention, there is provided an image observing apparatus for guiding both an external image of an external environment and a display image displayed on a display means to an observer through an optical path dividing means. An image observation apparatus for observing in a field of view, comprising: an imaging unit for imaging the external world image; and a spatial modulation element having a two-dimensional pixel structure, and modulating at least a part of the spatial modulation element to form the external world image. To switch the observation of the light beam and the light beam constituting the display image, and control the spatial modulation element so as to block or reduce the light beam in the region of the external image corresponding to the region of the display image, The image processing apparatus further includes a control unit that complements a surrounding area of the display image of the external image, which is obtained by the spatial modulation element, with image information captured by the imaging unit.

[Procedure amendment 4]

[Document name to be amended] Statement

[Correction target item name] 0012

[Correction method] Change

[Correction contents]

According to a third aspect of the present invention, there is provided an image observation apparatus which guides both an external image of an external environment and a display image displayed on a display means to an observer through an optical path dividing means, and observes the image in the same visual field. In the observation device, a light beam having a spatial modulation element having a two-dimensional pixel structure in an optical path between the optical path dividing means and the observation eye, and modulating at least a part of the spatial modulation element to constitute the external image And control means for controlling the spatial light modulator so as to block or reduce the light flux in the area of the external image corresponding to the area of the display image. It is characterized by:

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 2H091 FA07Z FA08X FA08Z FA10Z FA11Z FA14Z FA15Z GA11 HA07 LA16 MA10 5C058 AA07 AA08 AB04 BA24 BA31 BB25

Claims (7)

[Claims] 1. An image observation apparatus which guides both an external image of an external environment and a display image displayed on a display means to an observer through an optical path dividing means and observes the external image in the same visual field. A spatial light modulating device having a two-dimensional pixel structure, and modulating at least a partial area of the spatial light modulating device to switch between observation of a light beam constituting the external image and a light beam constituting the display image. And controlling the spatial modulation element so as to block or diminish the luminous flux in the area of the external image corresponding to the area of the display image, and the luminous flux is blocked by the spatial modulation element in a peripheral area of the display image. An image observation apparatus comprising control means for complementing image information taken by the image pickup means to the surrounding area so that a dark area does not occur. 2. A light beam forming the external image and a light beam forming the display image are light beams having different polarization states, and the spatial modulation element uses a transmission type liquid crystal panel. The image observation device according to claim 1, wherein: 3. An image observation apparatus in which both an external image of the external world and a display image displayed on a display means are guided to an observer via an optical path dividing means and observed in the same visual field. A spatial modulation element having a pixel structure, and modulating at least a partial region of the spatial modulation element to enable switching between observation of a light beam forming the external image and a light beam forming the display image; An image observation apparatus, comprising: a control unit that controls the spatial modulation element so as to block or diminish a light flux in the area of the external world image corresponding to the area. 4. An image observation apparatus according to claim 3, wherein said spatial modulation element uses a transmission type liquid crystal panel. 5. The image observation apparatus according to claim 3, wherein the light beam forming the external image and the light beam forming the display image are light beams having different polarization states. 6. An image observing apparatus for observing an external image of the external world and a display image displayed on a display means in the same field of view via an optical path dividing means, wherein the external image is transmitted through a spatial modulation element having a two-dimensional pixel structure. The spatial modulation element has selected a part or all of the external image and the display image by modulation in terms of area within the same field of view, and the surrounding area of the selected display image is displayed as the external image. An image observation apparatus comprising a control unit for complementing using image information obtained by an imaging unit for imaging. 7. The image according to claim 6, wherein the spatial modulation element selects at least a part of the external image and the display image using polarized light orthogonal to each other and guides the selected image to an observer. Observation device.