JP2007156096A - Head-mounted display device and head-mounted display system - Google Patents

Head-mounted display device and head-mounted display system Download PDF

Info

Publication number
JP2007156096A
JP2007156096A JP2005350965A JP2005350965A JP2007156096A JP 2007156096 A JP2007156096 A JP 2007156096A JP 2005350965 A JP2005350965 A JP 2005350965A JP 2005350965 A JP2005350965 A JP 2005350965A JP 2007156096 A JP2007156096 A JP 2007156096A
Authority
JP
Japan
Prior art keywords
display
light
beam splitter
image
wearer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2005350965A
Other languages
Japanese (ja)
Other versions
JP4883271B2 (en
Inventor
Kaname Hasebe
要 長谷部
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shimadzu Corp
Original Assignee
Shimadzu Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shimadzu Corp filed Critical Shimadzu Corp
Priority to JP2005350965A priority Critical patent/JP4883271B2/en
Publication of JP2007156096A publication Critical patent/JP2007156096A/en
Application granted granted Critical
Publication of JP4883271B2 publication Critical patent/JP4883271B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Polarising Elements (AREA)
  • Liquid Crystal Display Device Control (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Structure And Mechanism Of Cameras (AREA)

Abstract

<P>PROBLEM TO BE SOLVED: To provide a head-mounted display device which makes a monitor image obtained by combining a photographed image with a display image correspond to a real visually recognizing state of an outside world and the display image by a mounting user. <P>SOLUTION: A display 3 for emitting image display light, an optical system 4 guiding the image display light emitted from the display 3 to eyes of the mounting user and a camera 5 for photographing the outside world are held by a holding part 2 mounted on the head part of the mounting user. The optical system 4 has an optical element 13 for display disposed in front of the eyes of the mounting user. The optical path of the image display light is changed by the optical element 13 for display and a portion of outside world light having an optical path coincident with the visual axis of the mounting user is transmitted. In front of the eyes of the mounting user, the portion of the outside world light having the optical path coincident with the visual axis of the mounting user is guided to the camera 5 after the optical path is changed by the optical element 13 for monitoring. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

本発明は、装着者に画像と外界の双方を視認させ、且つ、装着者が視認する画像と外界とをモニタするために用いられる頭部装着型表示装置および頭部装着型表示システムに関する。   The present invention relates to a head-mounted display device and a head-mounted display system used for allowing a wearer to visually recognize both an image and the outside world and to monitor the image and the outside world viewed by the wearer.

図６に示す従来例の頭部装着型表示システムは、頭部装着型表示装置５００とモニタ装置５０６とを備えている。頭部装着型表示装置５００は、装着者の頭部に装着される保持部５０１と、保持部５０１により保持される画像表示光出射用表示器５０２と、表示器５０２から出射される画像表示光Ｌ１を装着者の目Ｅに導くように保持部５０１により保持される光学系５０４と、前記保持部５０１により保持される外界撮影用カメラ５０５とを有する。モニタ装置５０６は、カメラ５０５による撮影画像と表示器５０２による表示画像とを合成した画像を表示する。光学系５０４は、装着者の目Ｅの前方に配置される表示用光学素子５０７を有する。表示用光学素子５０７は、例えばハーフミラーやホログラム素子により構成され、画像表示光Ｌ１の光路を変更すると共に、装着者の視軸に一致する光路を有する外界光Ｌ２を透過する。これにより、画像表示光Ｌ１と外界光Ｌ２とが装着者の目Ｅに導かれるので、装着者は表示器５０２による表示画像と外界とを重畳して視認することができる。   The conventional head-mounted display system shown in FIG. 6 includes a head-mounted display device 500 and a monitor device 506. The head-mounted display device 500 includes a holding unit 501 worn on the wearer's head, an image display light emitting display 502 held by the holding unit 501, and image display light emitted from the display unit 502. The optical system 504 is held by a holding unit 501 so as to guide L1 to the eye E of the wearer, and an external shooting camera 505 is held by the holding unit 501. The monitor device 506 displays an image obtained by combining the image captured by the camera 505 and the display image displayed by the display unit 502. The optical system 504 includes a display optical element 507 disposed in front of the wearer's eye E. The display optical element 507 is composed of, for example, a half mirror or a hologram element, changes the optical path of the image display light L1, and transmits the external light L2 having an optical path that matches the visual axis of the wearer. As a result, the image display light L1 and the external light L2 are guided to the wearer's eyes E, so that the wearer can visually recognize the display image displayed on the display device 502 and the external environment.

モニタ装置５０６は、映像信号合成装置５０６ａとモニタ本体５０６ｂとを有する。表示器５０２は、画像生成装置５０８から送信される映像信号に対応する画像を表示することで画像表示光Ｌ１を出射する。その映像信号は表示器５０２に送信されると同時に映像信号合成装置５０６ａに送信される。映像信号合成装置５０６ａは、その映像信号とカメラ５０５による外界の撮像信号との合成信号をモニタ本体５０６ｂに送信する。これにより、モニタ本体５０６ｂによって外界撮影画像と表示器５０２による表示画像とを合成したモニタ画像を表示できる。そのモニタ画像をモニタ本体５０６ｂを介して装着者以外の者に提供することで、装着者の視認状態に応じた行動を確認したり、装着者に視認状態に応じた情報を提供できる。例えば、外界の目標物と表示画像であるシンボルとが重なった時に、装着者の視認状態と行動との関係を確認したり、装着者に視認方向や目標物の情報を提供したり、何らかの操作を行うよう指示できる。   The monitor device 506 includes a video signal synthesis device 506a and a monitor main body 506b. The display 502 emits the image display light L1 by displaying an image corresponding to the video signal transmitted from the image generation device 508. The video signal is transmitted to the display device 502 and simultaneously to the video signal synthesis device 506a. The video signal synthesizing device 506a transmits a synthesized signal of the video signal and an external imaging signal from the camera 505 to the monitor main body 506b. As a result, a monitor image obtained by synthesizing the outside-field photographed image and the display image by the display 502 can be displayed by the monitor main body 506b. By providing the monitor image to a person other than the wearer via the monitor main body 506b, it is possible to confirm the action according to the wearer's visual recognition state or provide the wearer with information according to the visual recognition state. For example, when a target in the external world overlaps with a symbol that is a display image, the relationship between the wearer's visual status and behavior is confirmed, the viewing direction and target information are provided to the wearer, and any operation Can be instructed to do.

従来例においては、図７に示すように、装着者の視軸Ｅ１の方向とカメラ５０５の視軸Ｃ１の方向とは一致するが、装着者の視軸Ｅ１の位置とカメラ５０５の視軸Ｃ１の位置との間には一定距離差Ｓがある。装着者から外界の目標物Ｔまでの距離をＬ、正面を向く装着者が目標物Ｔを見込む角度をθE とした時、カメラ５０５が目標物Ｔを見込む角度θM はθM ＝ｔａｎ-1（ｔａｎθE −Ｓ／Ｌ）により求められる。そのため、距離差Ｓが大きい場合や、目標物Ｔまでの距離Ｌが小さい場合、目標物Ｔを装着者が見込む角度θE とカメラ５０５が見込む角度θM との差が大きくなる。すなわち、カメラ５０５は、装着者の頭部や表示器５０２や光学系５０４と干渉しないように配置する必要があることから、距離差Ｓは例えば１０ｃｍ以上になる。そのため、目標物Ｔが例えば１ｋｍ以上先に存在する場合、装着者が目標物Ｔを視る方向とカメラ５０５が目標物Ｔを捕らえる方向は殆ど一致するが、目標物Ｔが例えば数ｍ先に存在する場合、装着者とカメラ５０５との間に視差が生じる。その視差の影響により、モニタ本体５０６ｂにより表示されるモニタ画像が、装着者による実際の視認状態に対応しないという問題がある。 In the conventional example, as shown in FIG. 7, the direction of the wearer's visual axis E1 coincides with the direction of the visual axis C1 of the camera 505, but the position of the wearer's visual axis E1 and the visual axis C1 of the camera 505 There is a certain distance difference S from the position of. When the distance from the wearer to the target T in the outside world is L and the angle at which the wearer facing the front looks at the target T is θ E , the angle θ M at which the camera 505 looks at the target T is θ M = tan − 1 (tan θ E −S / L). Therefore, when the distance difference S is large or the distance L to the target T is small, the difference between the angle θ E at which the wearer looks at the target T and the angle θ M at which the camera 505 looks at becomes large. That is, since the camera 505 needs to be disposed so as not to interfere with the wearer's head, the display device 502, and the optical system 504, the distance difference S is, for example, 10 cm or more. Therefore, when the target T exists for example 1 km or more ahead, the direction in which the wearer views the target T and the direction in which the camera 505 catches the target T are almost the same, but the target T is several meters ahead, for example. If present, parallax occurs between the wearer and the camera 505. Due to the influence of the parallax, there is a problem that the monitor image displayed by the monitor main body 506b does not correspond to the actual viewing state by the wearer.

例えば、図８に示すように、一定位置における装着者Ｕが遠方（装着者Ｕからの距離Ｌ１）の第１目標物Ｔ１と、近く（装着者Ｕからの距離Ｌ２）の第２目標物Ｔ２とを視認する場合を想定する。また、図９に示すように、表示画像として第１〜第３シンボルα、β、γが表示され、第１シンボルαは画面の中心位置に配置され、第２シンボルβは装着者Ｕが一定方向を向く時に第１目標物Ｔ１と重畳して視認する位置に配置され、第３シンボルγは装着者Ｕが一定方向を向く時に第２目標物Ｔ２と重畳して視認する位置に配置されるものとする。この場合、図１０に示すように、装着者Ｕにより視認される外界と表示画像においては、第２シンボルβと第１目標物Ｔ１とが重畳され、第３シンボルγと第２目標物Ｔ２とが重畳される。しかし、モニタ本体５０６ｂにより表示される画像においては、図１１に示すように、第２シンボルβと第１目標物Ｔ１とは重畳されるが、視差の影響により第３シンボルγと第２目標物Ｔ２とにずれが生じる。   For example, as shown in FIG. 8, the wearer U at a fixed position is far away (distance L1 from the wearer U) and the second target T2 near (distance L2 from the wearer U). Assume that the user is visually recognized. Also, as shown in FIG. 9, the first to third symbols α, β, γ are displayed as display images, the first symbol α is arranged at the center position of the screen, and the wearer U is constant for the second symbol β. The third symbol γ is disposed at a position where the wearer U is visually recognized by being superimposed on the second target T2 when the wearer U is directed in a certain direction. Shall. In this case, as shown in FIG. 10, the second symbol β and the first target T1 are superimposed in the outside world and the display image visually recognized by the wearer U, and the third symbol γ and the second target T2 are overlapped. Are superimposed. However, in the image displayed by the monitor main body 506b, as shown in FIG. 11, the second symbol β and the first target T1 are superimposed, but the third symbol γ and the second target are affected by the parallax. There is a deviation from T2.

目標物までの距離が一定であれば、撮影画像と表示画像とを合成する際に予め視差の影響分だけずらすことで対処できる。しかし、目標物までの距離が一定でない場合、目標物までの距離が測定できない場合、装着者からの距離が異なる複数の目標物が存在する場合等においては、そのような視差を影響をなくすことができない。本発明は、そのような問題を解決することのできる頭部装着型表示装置および頭部装着型表示システムを提供することを目的とする。   If the distance to the target is constant, it can be dealt with by shifting in advance by the influence of parallax when combining the captured image and the display image. However, if the distance to the target is not constant, if the distance to the target cannot be measured, or if there are multiple targets with different distances from the wearer, such parallax should be eliminated. I can't. An object of the present invention is to provide a head-mounted display device and a head-mounted display system that can solve such problems.

本発明は、装着者の頭部に装着される保持部と、前記保持部により保持される画像表示光出射用表示器と、前記表示器から出射される画像表示光を前記装着者の目に導くように前記保持部により保持される光学系と、前記保持部により保持される外界撮影用カメラとを備え、前記光学系は、前記装着者の目の前方に配置される表示用光学素子を有し、前記表示用光学素子により、前記画像表示光の光路が変更され、前記装着者の視軸に一致する光路を有する外界光の一部が透過される頭部装着型表示装置において、前記装着者の目の前方において、前記外界光の一部を透過し、前記外界光の一部の光路を変更するモニタ用光学素子が前記保持部により保持され、前記モニタ用光学素子により光路変更された前記外界光の一部が前記カメラに導かれることを特徴とする。
本発明の頭部装着型表示システムは、本発明の頭部装着型表示装置と、前記カメラによる撮影画像と前記表示器による表示画像とを合成した画像を表示するモニタ装置とを備える。
本発明の頭部装着型表示装置によれば、装着者の視軸に一致する光路を有する外界光の一部が、モニタ用光学素子により光路変更された後にカメラに導かれる。すなわち、装着者の視軸とカメラの視軸とを一致させることができる。これにより、装着者とカメラとの間に視差を生じないので、本発明の頭部装着型表示システムによれば撮影画像と表示画像とを合成したモニタ画像を、装着者による実際の視認状態に対応させることができる。 The present invention provides a holding unit to be worn on the wearer's head, an image display light emitting display held by the holding unit, and image display light emitted from the display to the wearer's eyes. An optical system held by the holding unit so as to guide the camera, and an external shooting camera held by the holding unit. The optical system includes a display optical element disposed in front of the wearer's eyes. In the head-mounted display device in which the optical path of the image display light is changed by the display optical element and a part of external light having an optical path that matches the visual axis of the wearer is transmitted, In front of the wearer's eyes, a monitoring optical element that transmits part of the external light and changes a part of the optical path of the external light is held by the holding unit, and the optical path is changed by the monitoring optical element. In addition, a part of the external light is guided to the camera. Characterized in that it is.
A head-mounted display system according to the present invention includes the head-mounted display device according to the present invention and a monitor device that displays an image obtained by combining an image captured by the camera and a display image displayed by the display.
According to the head-mounted display device of the present invention, part of the external light having an optical path that coincides with the wearer's visual axis is guided to the camera after the optical path is changed by the monitoring optical element. In other words, the wearer's visual axis can coincide with the camera's visual axis. As a result, no parallax is generated between the wearer and the camera. Therefore, according to the head-mounted display system of the present invention, the monitor image obtained by synthesizing the captured image and the display image is brought into an actual viewing state by the wearer. Can be matched.

前記表示用光学素子は前記モニタ用光学素子を兼用するのが好ましい。これにより部品点数を削減できる。   It is preferable that the display optical element also serves as the monitor optical element. Thereby, the number of parts can be reduced.

前記表示用光学素子は、特定方向の偏光を反射し、別の特定方向の偏光を透過する第１偏光ビームスプリッタにより構成され、前記光学系は、前記第１偏光ビームスプリッタと前記表示器との間において、特定方向の偏光を反射し、別の特定方向の偏光を透過する第２偏光ビームスプリッタを有し、第１偏光ビームスプリッタにより反射される直線偏光を円偏光にする１／４波長板と、前記１／４波長板を通過した偏光を再び前記１／４波長板に導くように反射する反射素子とが前記保持部により保持され、前記画像表示光を構成する特定方向の偏光は、前記第２偏光ビームスプリッタにより反射された後に前記第１偏光ビームスプリッタに導かれ、前記第１偏光ビームスプリッタにより反射されることで前記装着者の目に導かれ、前記外界光を構成する特定方向の偏光は、前記第１偏光ビームスプリッタにより反射された後に前記１／４波長板を通過して前記反射素子に導かれ、前記反射素子により反射された後に再び前記１／４波長板に導かれることで別の特定方向の偏光とされ、前記１／４波長板を再び通過した別の特定方向の偏光は、前記第１偏光ビームスプリッタと前記第２偏光ビームスプリッタとを透過した後に前記カメラに導かれるのが好ましい。これにより、画像表示光とカメラに入射する外界光の光量を大きく減衰させることなく、画像表示光がカメラに迷光として入射することを防止し、明瞭な撮影画像を形成でき、モニタ装置に不要な映り込みが生じるのを防止でき、装着者に表示画像と外界を明瞭に視認させることができる。   The display optical element includes a first polarization beam splitter that reflects polarized light in a specific direction and transmits polarized light in another specific direction, and the optical system includes the first polarized beam splitter and the display. A quarter-wave plate having a second polarization beam splitter that reflects polarized light in a specific direction and transmits polarized light in another specific direction, and that converts linearly polarized light reflected by the first polarized beam splitter into circularly polarized light. And a reflective element that reflects the polarized light that has passed through the ¼ wavelength plate again so as to guide it to the ¼ wavelength plate again, and the polarized light in a specific direction that constitutes the image display light is After being reflected by the second polarizing beam splitter, it is guided to the first polarizing beam splitter, and is reflected by the first polarizing beam splitter to be guided to the wearer's eyes, and After being reflected by the first polarizing beam splitter, the polarized light in a specific direction is guided to the reflecting element through the quarter-wave plate, and after being reflected by the reflecting element, the 1/4 again. The polarized light in another specific direction is guided to the wave plate, and the polarized light in another specific direction that has passed through the quarter wavelength plate again is transmitted through the first polarizing beam splitter and the second polarizing beam splitter. After that, it is preferably guided to the camera. This prevents the image display light from entering the camera as stray light without greatly reducing the amount of image display light and external light incident on the camera, and can form a clear captured image, which is unnecessary for the monitor device. The occurrence of reflection can be prevented, and the display image and the outside world can be clearly seen by the wearer.

前記第１偏光ビームスプリッタと前記第２偏光ビームスプリッタとの間に、前記画像表示光と前記カメラに導かれる偏光とが通過するレンズ系が配置されているのが好ましい。画像表示光により画像を形成するためのレンズ系は、外界光により画像を形成するためのレンズ系として機能させることができる。よって、画像表示光により画像を形成するためのレンズ系により、外界撮影用カメラのレンズ系を構成できる。   It is preferable that a lens system through which the image display light and polarized light guided to the camera pass is disposed between the first polarizing beam splitter and the second polarizing beam splitter. A lens system for forming an image with image display light can function as a lens system for forming an image with external light. Therefore, a lens system for an external shooting camera can be configured by a lens system for forming an image with image display light.

本発明によれば、撮影画像と表示画像とを合成したモニタ画像を、外界と表示画像の装着者による実際の視認状態に対応させることができ、さらに、そのモニタ画像と表示画像の明瞭化と構成の簡単化を図ることができる頭部装着型表示装置を用いた頭部装着型表示システムを提供できる。   According to the present invention, the monitor image obtained by synthesizing the captured image and the display image can be made to correspond to the actual visual state by the wearer of the outside world and the display image, and the monitor image and the display image can be clarified. A head-mounted display system using a head-mounted display device that can be simplified in configuration can be provided.

図１に示す第１実施形態の頭部装着型表示システムは、頭部装着型表示装置１とモニタ装置３１とを備える。頭部装着型表示装置１は、装着者の頭部に装着される保持部２を備える。保持部２は例えばヘルメット、バンド、ゴーグル等により構成できる。保持部２により画像表示光出射用表示器３、光学系４、外界撮影用カメラ５が保持される。   The head-mounted display system of the first embodiment shown in FIG. 1 includes a head-mounted display device 1 and a monitor device 31. The head-mounted display device 1 includes a holding unit 2 that is mounted on the head of the wearer. The holding part 2 can be comprised, for example with a helmet, a band, goggles, etc. The holding unit 2 holds the image display light emitting display 3, the optical system 4, and the external shooting camera 5.

表示器３は、例えば液晶表示装置や有機ELディスプレイ装置等により構成され、画像生成装置８から送信される映像信号に対応する画像を表示することで画像表示光を前方に向かい出射する。画像生成装置８は特に限定されず、例えばコンピュータやビデオ装置等により構成される。なお、本明細書において前後左右上下の方向は装着者を基準とする。   The display 3 is composed of a liquid crystal display device, an organic EL display device, or the like, for example, and emits image display light forward by displaying an image corresponding to the video signal transmitted from the image generation device 8. The image generation device 8 is not particularly limited, and is configured by, for example, a computer or a video device. In the present specification, the front, rear, left, right and up directions are based on the wearer.

光学系４は、表示器３から出射される画像表示光を装着者の目Ｅに導くように保持部２により保持される。本実施形態の光学系４は、表示器３の前方に配置される偏光板１１及びレンズ系１２と、第１偏光ビームスプリッタ１３と、第２偏光ビームスプリッタ１４を有する。   The optical system 4 is held by the holding unit 2 so as to guide the image display light emitted from the display 3 to the eyes E of the wearer. The optical system 4 of the present embodiment includes a polarizing plate 11 and a lens system 12 that are disposed in front of the display device 3, a first polarizing beam splitter 13, and a second polarizing beam splitter 14.

偏光板１１は、画像表示光を図中破線で示すＳ偏光（特定方向の偏光）としてレンズ系１２に導く。なお、表示器３が画像表示光としてＳ偏光を出射するものである時は偏光板１１は不要である。   The polarizing plate 11 guides the image display light to the lens system 12 as S-polarized light (polarized light in a specific direction) indicated by a broken line in the drawing. When the display 3 emits S-polarized light as image display light, the polarizing plate 11 is not necessary.

第１偏光ビームスプリッタ１３は、装着者の目Ｅの前方に配置され、Ｓ偏光を反射し、図中２点鎖線で示すＰ偏光（別の特定方向の偏光）を透過する。第２偏光ビームスプリッタ１４は、レンズ系１２の前方であって第１偏光ビームスプリッタ１３の上方に配置され、第１偏光ビームスプリッタ１３と表示器３との間において、Ｓ偏光を反射し、Ｐ偏光を透過する。レンズ系１２を通過した画像表示光を構成するＳ偏光は、第２偏光ビームスプリッタ１４により反射された後に第１偏光ビームスプリッタ１３に導かれ、第１偏光ビームスプリッタ１３により反射されることで装着者の目Ｅに導かれる。第１偏光ビームスプリッタ１３は、装着者の視軸に一致する光路を有する外界光の一部であるＰ偏光を透過させ、装着者の目Ｅに導く。   The first polarization beam splitter 13 is disposed in front of the wearer's eye E, reflects S-polarized light, and transmits P-polarized light (polarized light in another specific direction) indicated by a two-dot chain line in the drawing. The second polarizing beam splitter 14 is disposed in front of the lens system 12 and above the first polarizing beam splitter 13, reflects S-polarized light between the first polarizing beam splitter 13 and the display 3, and P Transmits polarized light. S-polarized light constituting the image display light that has passed through the lens system 12 is reflected by the second polarizing beam splitter 14, then guided to the first polarizing beam splitter 13, and reflected by the first polarizing beam splitter 13 to be mounted. Guided by the person's eyes E. The first polarization beam splitter 13 transmits P-polarized light, which is a part of external light having an optical path that coincides with the wearer's visual axis, and guides it to the wearer's eyes E.

本実施形態の第１偏光ビームスプリッタ１３は、装着者の目Ｅの前方において、Ｓ偏光とされた画像表示光の光路を変更し、装着者の視軸に一致する光路を有する外界光の一部であるＰ偏光を透過し、装着者の視軸に一致する光路を有する外界光の一部であるＳ偏光を反射することで、表示用光学素子とモニタ用光学素子とを兼用する。   The first polarization beam splitter 13 of the present embodiment changes the optical path of image display light that has been S-polarized in front of the wearer's eye E, and is an external light having an optical path that matches the visual axis of the wearer. By transmitting the P-polarized light that is a part and reflecting the S-polarized light that is part of the external light having an optical path that coincides with the wearer's visual axis, the display optical element and the monitoring optical element are used together.

第１偏光ビームスプリッタ１３により光路変更された装着者の視軸に一致する光路を有する外界光の一部であるＳ偏光は、Ｐ偏光とされた後にカメラ５に導かれる。すなわち、第１偏光ビームスプリッタ１３により反射されるＳ偏光を円偏光にする１／４波長板２１と、１／４波長板２１を通過した偏光を再び１／４波長板２１に導くように反射する反射素子であるミラー２２とが保持部２により保持される。外界光を構成するＳ偏光は、第１偏光ビームスプリッタ１３により反射された後に１／４波長板２１を通過して円偏光としてミラー２２に導かれ、ミラー２２により反射された後に再び１／４波長板２１に導かれる。反射後の円偏光は１／４波長板２１を再び通過することによりＰ偏光となり、第１偏光ビームスプリッタ１３と第２偏光ビームスプリッタ１４とを透過した後に、第２偏光ビームスプリッタ１４の上方に配置されるカメラ５に導かれる。カメラ５は、撮像素子と、入射した外界光により画像を形成するための専用のレンズ系とを内蔵し、外界の撮影を行う。   S-polarized light, which is part of the external light having an optical path that matches the visual axis of the wearer whose optical path has been changed by the first polarizing beam splitter 13, is converted to P-polarized light and then guided to the camera 5. That is, the ¼ wavelength plate 21 that converts the S-polarized light reflected by the first polarizing beam splitter 13 into circularly polarized light, and the polarized light that has passed through the ¼ wavelength plate 21 is reflected again to the ¼ wavelength plate 21. The holding part 2 holds the mirror 22 which is a reflecting element. The S-polarized light constituting the external light is reflected by the first polarization beam splitter 13, passes through the quarter-wave plate 21, is guided as circularly polarized light to the mirror 22, and is reflected by the mirror 22 and then is 1/4 again. Guided to the wave plate 21. The reflected circularly polarized light passes through the quarter-wave plate 21 again to become P-polarized light, passes through the first polarizing beam splitter 13 and the second polarizing beam splitter 14, and then above the second polarizing beam splitter 14. It is guided to the camera 5 to be arranged. The camera 5 incorporates an image pickup device and a dedicated lens system for forming an image with incident external light, and shoots the external environment.

モニタ装置３１は、カメラ５による撮影画像と表示器３による表示画像とを合成した画像を表示する。モニタ装置３１は従来と同様の構成でよく、映像信号合成装置３１ａとモニタ本体３１ｂとを有する。画像生成装置８から送信される映像信号は表示器３に送信されると同時に映像信号合成装置３１ａに送信される。映像信号合成装置３１ａは、その映像信号とカメラ５による外界の撮像信号との合成信号をモニタ本体３１ｂに送信する。これにより、モニタ本体３１ｂによって外界撮影画像と表示器３による表示画像とを合成したモニタ画像を表示する。   The monitor device 31 displays an image obtained by combining the image captured by the camera 5 and the display image displayed by the display 3. The monitor device 31 may have the same configuration as the conventional one, and includes a video signal synthesizer 31a and a monitor body 31b. The video signal transmitted from the image generation device 8 is transmitted to the display device 3 and simultaneously to the video signal synthesis device 31a. The video signal synthesizer 31a transmits a synthesized signal of the video signal and an external imaging signal from the camera 5 to the monitor main body 31b. As a result, the monitor main body 31b displays a monitor image obtained by synthesizing the outside-field photographed image and the display image by the display 3.

上記第１実施形態によれば、装着者の視軸に一致する光路を有する外界光の一部が、第１偏光ビームスプリッタ１３により光路変更された後にカメラ５に導かれる。すなわち、装着者の視軸とカメラ５の視軸とを一致させることができる。これにより、装着者とカメラ５との間に視差を生じないので、撮影画像と表示画像とを合成したモニタ画像を、装着者による実際の視認状態に対応させることができる。例えば、図８に示すように、装着者Ｕが第１目標物Ｔ１と第２目標物Ｔ２とを視認し、図９に示すように、表示器３により第１〜第３シンボルα、β、γを表示し、図１０に示すように、装着者Ｕにより視認される外界と表示画像において、第２シンボルβと第１目標物Ｔ１とが重畳され、第３シンボルγと第２目標物Ｔ２とが重畳される場合、モニタ本体３１ｂにより表示される画像を図１０による装着者の視認状態に一致させることができる。また、第１偏光ビームスプリッタ１３は表示用光学素子とモニタ用光学素子とを兼用するので部品点数を削減できる。さらに、第１偏光ビームスプリッタ１３と第２偏光ビームスプリッタ１４により画像表示光と外界光をＳ偏光とＰ偏光に分岐し、カメラ５にはＰ偏光とされた外界光のみが入射され、Ｓ偏光とされた画像表示光はカメラ５に入射されないように光学系４を構成している。よって、ハーフミラーやホログラム素子等により光を分岐するのに比べて画像表示光とカメラ５に入射する外界光の光量を大きく減衰させることなく、画像表示光がカメラ５に迷光として入射することを防止し、明瞭な撮影画像を形成でき、モニタ装置３１に不要な映り込みが生じるのを防止でき、装着者に表示画像と外界を明瞭に視認させることができる。なお、装着者の目Ｅに導かれるのは外界光のＰ偏光成分であり、カメラ５に導かれるのは外界光のＳ偏光成分であるが、外界光は通常は無偏光であるため、装着者が視認する外界とモニタ装置３１によりモニタされる外界とに差異を生じることはない。また、各偏光ビームスプリッタ１３、１４、１／４波長板２１、ミラー２２における光の入出射面を平面で構成し、厚い平面ガラスを介して外界を見た場合と同等の光がカメラ５に入射するようにすることで、歪みのない撮影画像を形成できる。   According to the first embodiment, part of the external light having an optical path that matches the visual axis of the wearer is guided to the camera 5 after the optical path is changed by the first polarization beam splitter 13. That is, the wearer's visual axis and the visual axis of the camera 5 can be matched. As a result, no parallax is generated between the wearer and the camera 5, so that the monitor image obtained by combining the captured image and the display image can be made to correspond to the actual viewing state by the wearer. For example, as shown in FIG. 8, the wearer U visually recognizes the first target T1 and the second target T2, and as shown in FIG. 9, the first to third symbols α, β, γ is displayed, and as shown in FIG. 10, the second symbol β and the first target T1 are superimposed on the outside and the display image visually recognized by the wearer U, and the third symbol γ and the second target T2 are superimposed. Is superimposed, the image displayed by the monitor main body 31b can be matched with the wearer's visual recognition state shown in FIG. Further, since the first polarizing beam splitter 13 serves as both the display optical element and the monitor optical element, the number of parts can be reduced. Further, the first polarizing beam splitter 13 and the second polarizing beam splitter 14 split the image display light and the external light into S-polarized light and P-polarized light, and only the external light that has been converted to P-polarized light is incident on the camera 5. The optical system 4 is configured so that the image display light that has been determined is not incident on the camera 5. Therefore, the image display light is incident on the camera 5 as stray light without greatly reducing the amount of image display light and the amount of external light incident on the camera 5 compared to the case where the light is split by a half mirror or a hologram element. Therefore, a clear captured image can be formed, unnecessary reflection on the monitor device 31 can be prevented, and the display image and the outside world can be clearly seen by the wearer. Note that it is the P-polarized component of the external light that is guided to the wearer's eye E, and the S-polarized component of the external light that is guided to the camera 5, but the external light is usually unpolarized, so There is no difference between the outside world visually recognized by the person and the outside world monitored by the monitor device 31. In addition, the light incident / exit surfaces of the polarization beam splitters 13 and 14, the quarter-wave plate 21 and the mirror 22 are configured by planes, and light equivalent to the case of viewing the outside through a thick flat glass is supplied to the camera 5. By making the light incident, a photographic image without distortion can be formed.

図２は第２実施形態の頭部装着型表示システムを示す。以下、第１実施形態との相違を説明し、第１実施形態と同様部分は同一符号で示す。
本実施形態の頭部装着型表示装置１′においては、表示器３は第２偏光ビームスプリッタ１４の前方に配置され、偏光板１１は設けられておらず、画像表示光は第２偏光ビームスプリッタ１４によりＳ偏光とＰ偏光とに分岐される。 FIG. 2 shows a head-mounted display system according to the second embodiment. Hereinafter, differences from the first embodiment will be described, and the same parts as those in the first embodiment are denoted by the same reference numerals.
In the head-mounted display device 1 ′ of the present embodiment, the display 3 is disposed in front of the second polarizing beam splitter 14, the polarizing plate 11 is not provided, and the image display light is the second polarizing beam splitter. 14 is branched into S-polarized light and P-polarized light.

レンズ系１２は第１偏光ビームスプリッタ１３と第２偏光ビームスプリッタ１４との間に配置される。カメラ５は専用のレンズ系を備えておらず、カメラ５を構成する撮像素子５ａは第２偏光ビームスプリッタ１４の上方に配置され、レンズ系１２がカメラ５のレンズ系を兼用する。   The lens system 12 is disposed between the first polarizing beam splitter 13 and the second polarizing beam splitter 14. The camera 5 is not provided with a dedicated lens system, the image sensor 5 a constituting the camera 5 is disposed above the second polarization beam splitter 14, and the lens system 12 also serves as the lens system of the camera 5.

画像表示光を構成するＰ偏光は、第２偏光ビームスプリッタ１４を透過後に装着者の目Ｅに入らない方向（本実施形態では後方）に導かれる。画像表示光を構成するＳ偏光は、第２偏光ビームスプリッタ１４により反射された後にレンズ系１２を通過し、しかる後に第１偏光ビームスプリッタ１３に導かれ、第１偏光ビームスプリッタ１３により反射されることで装着者の目Ｅに導かれる。第１偏光ビームスプリッタ１３により光路変更された外界光の一部であるＳ偏光は、１／４波長板２１とミラー２２によりＰ偏光とされた後に、第１偏光ビームスプリッタ１３を透過し、レンズ系１２を通過し、第２偏光ビームスプリッタ１４を透過してカメラ５に導かれる。他は第１実施形態と同様の構成とされている。   The P-polarized light constituting the image display light is guided in a direction that does not enter the eyes E of the wearer after passing through the second polarizing beam splitter 14 (backward in this embodiment). The S-polarized light constituting the image display light is reflected by the second polarizing beam splitter 14, passes through the lens system 12, and thereafter is guided to the first polarizing beam splitter 13 and reflected by the first polarizing beam splitter 13. This leads to the eyes E of the wearer. S-polarized light, which is part of the external light whose optical path has been changed by the first polarizing beam splitter 13, is converted to P-polarized light by the quarter-wave plate 21 and the mirror 22, and then transmitted through the first polarizing beam splitter 13 to be a lens. The light passes through the system 12, passes through the second polarizing beam splitter 14, and is guided to the camera 5. The other configuration is the same as that of the first embodiment.

上記第２実施形態によれば、画像表示光により画像を形成するためのレンズ系１２を、外界光により画像を形成するためのレンズ系として機能させることができる。よって、画像表示光により画像を形成するためのレンズ系１２により、カメラ５のレンズ系を構成でき、構成の簡単化を図ることができる。また、偏光板１１を不要にすることでも構成の簡単化を図ることができる。他は第１実施形態と同様の作用効果を奏することができる。   According to the second embodiment, the lens system 12 for forming an image with image display light can function as a lens system for forming an image with external light. Therefore, the lens system 12 for forming an image with image display light can constitute the lens system of the camera 5, and the configuration can be simplified. Further, the configuration can be simplified by eliminating the polarizing plate 11. Others can achieve the same operational effects as the first embodiment.

図３は第３実施形態の頭部装着型表示システムを示す。以下、第２実施形態との相違を説明し、第２実施形態と同様部分は同一符号で示す。本実施形態の頭部装着型表示装置１″においては、第１偏光ビームスプリッタ１３とレンズ系１２との間に外界光と画像表示光を反射するミラー４０が配置され、外界光と画像表示光の光路がミラー２２と第２偏光ビームスプリッタ１４との間において前後方向に沿うものとされている。なお、外界光はカメラ５に入射するまでに奇数回反射されるため、カメラ５において形成される画像は鏡像となるが、これはモニタ装置３１において撮影画像を反転処理すれば解決できる。また、カメラ画角の調整については、撮像素子５ａとして適切な大きさのものを選択したり、モニタ装置３１において必要画角のキャプチャ処理を行うことで解決できる。他の構成、作用効果は第２実施形態と同様である。   FIG. 3 shows a head-mounted display system according to the third embodiment. Hereinafter, differences from the second embodiment will be described, and the same parts as those of the second embodiment are denoted by the same reference numerals. In the head-mounted display device 1 ″ of this embodiment, a mirror 40 that reflects external light and image display light is disposed between the first polarizing beam splitter 13 and the lens system 12, and the external light and image display light are disposed. The optical path of the light beam is along the front-rear direction between the mirror 22 and the second polarizing beam splitter 14. The external light is reflected an odd number of times before entering the camera 5, and thus is formed in the camera 5. The image is a mirror image, but this can be solved by reversing the captured image in the monitor device 31. Further, for the adjustment of the camera angle of view, an image sensor 5a having an appropriate size can be selected, or the monitor can be monitored. This can be solved by performing a capture process of a required angle of view in the device 31. Other configurations and operational effects are the same as those of the second embodiment.

図４は第４実施形態の頭部装着型表示システムを示す。以下、第１実施形態との相違を説明し、第１実施形態と同様部分は同一符号で示す。
本実施形態の頭部装着型表示装置１００においては、偏光板１１および１／４波長板２１は設けられておらず、第１偏光ビームスプリッタ１３に代えて第１光路変更素子１３′が用いられ、第２偏光ビームスプリッタ１４に代えて第２光路変更素子１４′が用いられている。第１、第２光路変更素子１３′、１４′は、光の一部を透過すると共に一部を反射する偏光機能のない単純なビームスプリッタ、ハーフミラー等により構成される。 FIG. 4 shows a head-mounted display system according to the fourth embodiment. Hereinafter, differences from the first embodiment will be described, and the same parts as those in the first embodiment are denoted by the same reference numerals.
In the head-mounted display device 100 of the present embodiment, the polarizing plate 11 and the quarter wavelength plate 21 are not provided, and the first optical path changing element 13 ′ is used instead of the first polarizing beam splitter 13. Instead of the second polarization beam splitter 14, a second optical path changing element 14 'is used. The first and second optical path changing elements 13 ′ and 14 ′ are configured by a simple beam splitter, a half mirror, or the like that does not have a polarization function that transmits part of the light and reflects part of the light.

第１光路変更素子１３′は、装着者の目Ｅの前方に配置される。第２光路変更素子１４′は、表示器３の前方であって第１光路変更素子１３′の上方に配置される。表示器３から出射された図中一点鎖線で示す画像表示光の一部は、第２光路変更素子１４′により反射された後に第１光路変更素子１３′に導かれ、第１光路変更素子１３′により反射されることで装着者の目Ｅに導かれる。第１光路変更素子１３′は、装着者の視軸に一致する光路を有する図中一点鎖線で示す外界光の一部を透過させ、装着者の目Ｅに導く。   The first optical path changing element 13 ′ is arranged in front of the wearer's eyes E. The second optical path changing element 14 ′ is disposed in front of the display 3 and above the first optical path changing element 13 ′. Part of the image display light that is emitted from the display 3 and indicated by a one-dot chain line in the drawing is reflected by the second optical path changing element 14 ′ and then guided to the first optical path changing element 13 ′. It is guided to the wearer's eye E by being reflected by '. The first optical path changing element 13 ′ transmits a part of the external light indicated by a one-dot chain line in the drawing having an optical path that coincides with the wearer's visual axis, and guides it to the wearer's eyes E.

第１光路変更素子１３′は、装着者の目Ｅの前方において、画像表示光の一部の光路を変更し、装着者の視軸に一致する光路を有する外界光の一部を透過し、装着者の視軸に一致する光路を有する外界光の一部を反射してカメラ５に導くことで、表示用光学素子とモニタ用光学素子とを兼用する。   The first optical path changing element 13 'changes a part of the optical path of the image display light in front of the wearer's eye E, and transmits a part of the external light having an optical path that coincides with the wearer's visual axis. By reflecting a part of the external light having an optical path that coincides with the wearer's visual axis and guiding it to the camera 5, the display optical element and the monitoring optical element are combined.

第１光路変更素子１３′により光路変更された外界光の一部はミラー２２に導かれ、ミラー２２により反射された後に第１光路変更素子１３′、第２光路変更素子１４′を透過し、カメラ５に導かれる。他は第１実施形態と同様の構成とされている。   A part of the external light whose optical path has been changed by the first optical path changing element 13 ′ is guided to the mirror 22, reflected by the mirror 22, and then transmitted through the first optical path changing element 13 ′ and the second optical path changing element 14 ′. Guided to camera 5. The other configuration is the same as that of the first embodiment.

上記第４実施形態によれば、１／４波長板２１を必要としないので第１実施形態よりも構成を簡単化できる。なお、第４実施形態においては、画像表示光の一部が第１光路変更素子１３′を透過してミラー２２に導かれ、ミラー２２での反射後に第１光路変更素子１３′、第２光路変更素子１４′を透過し、迷光としてカメラ５に入射する。また、外界光や画像表示光を偏光機能のないビームスプリッタやハーフミラー等の光路変更素子１３′、１４′による分岐するため、偏光ビームスプリッタにより分岐するのに比べて光量の減衰量が大きくなる。そのため、装着者により視認される表示画像や外界やモニタ装置３１により表示されるモニタ画像の明瞭性は第１実施形態よりも低下するが、他は第１実施形態と同様の作用効果を奏することができる。   According to the fourth embodiment, since the quarter-wave plate 21 is not required, the configuration can be simplified as compared with the first embodiment. In the fourth embodiment, part of the image display light is transmitted through the first optical path changing element 13 ′ and guided to the mirror 22, and after being reflected by the mirror 22, the first optical path changing element 13 ′ and the second optical path are used. It passes through the changing element 14 'and enters the camera 5 as stray light. In addition, since the ambient light and the image display light are branched by the optical path changing elements 13 'and 14' such as a beam splitter or a half mirror having no polarization function, the amount of attenuation of the light amount is larger than that of the branch by the polarization beam splitter. . Therefore, the clarity of the display image visually recognized by the wearer, the outside world, and the monitor image displayed by the monitor device 31 is lower than that of the first embodiment, but the other effects are the same as those of the first embodiment. Can do.

図５は第５実施形態の頭部装着型表示システムを示す。以下、第４実施形態との相違を説明し、第４実施形態と同様部分は同一符号で示す。
本実施形態の頭部装着型表示装置２００においては、第２光路変更素子１４′に代えてミラー１４″が用いられる。表示器３から出射された画像表示光は、ミラー１４″により反射された後に第１光路変更素子１３′に導かれ、その一部が第１光路変更素子１３′により反射されることで装着者の目Ｅに導かれる。第１光路変更素子１３′の前方にモニタ用第２光路変更素子５０が配置される。ミラー２２に代えて第２光路変更素子５０の下方にミラー５１が配置される。第２光路変更素子５０としては、光の一部を透過すると共に一部を反射する素子であればよく、偏光ビームスプリッタでもよいし、偏光機能のない単純なビームスプリッタやハーフミラーでもよい。第２光路変更素子５０と第１光路変更素子１３′は、装着者の視軸に一致する光路を有する外界光の一部を透過させ、装着者の目Ｅに導く。第２光路変更素子５０により光路変更された装着者の視軸に一致する光路を有する外界光の一部は、ミラー５１に導かれ、ミラー５１により反射された後に第２光路変更素子５０を透過し、カメラ５に導かれる。これにより、第１光路変更素子１３′は表示用光学素子としてのみ機能し、第２光路変更素子５０がモニタ用光学素子として機能する。なお、第１光路変更素子１３′として偏光ビームスプリッタを用いてもよい。他は第４実施形態と同様の構成とされている。 FIG. 5 shows a head-mounted display system according to the fifth embodiment. Hereinafter, differences from the fourth embodiment will be described, and the same parts as those of the fourth embodiment are denoted by the same reference numerals.
In the head-mounted display device 200 of the present embodiment, a mirror 14 ″ is used instead of the second optical path changing element 14 ′. The image display light emitted from the display 3 is reflected by the mirror 14 ″. Later, it is guided to the first optical path changing element 13 ′, and a part thereof is reflected by the first optical path changing element 13 ′ to be guided to the eyes E of the wearer. A monitoring second optical path changing element 50 is disposed in front of the first optical path changing element 13 '. A mirror 51 is arranged below the second optical path changing element 50 in place of the mirror 22. The second optical path changing element 50 may be an element that transmits part of the light and reflects part of the light, and may be a polarization beam splitter, or a simple beam splitter or half mirror having no polarization function. The second optical path changing element 50 and the first optical path changing element 13 ′ transmit a part of the external light having an optical path coinciding with the wearer's visual axis and guide it to the wearer's eyes E. Part of the external light having an optical path that matches the visual axis of the wearer whose optical path has been changed by the second optical path changing element 50 is guided to the mirror 51, reflected by the mirror 51, and then transmitted through the second optical path changing element 50. Then, it is guided to the camera 5. Thus, the first optical path changing element 13 ′ functions only as a display optical element, and the second optical path changing element 50 functions as a monitoring optical element. A polarizing beam splitter may be used as the first optical path changing element 13 ′. The other configuration is the same as that of the fourth embodiment.

上記第５実施形態においては、表示用光学素子とモニタ用光学素子とを個別に設ける必要があり、そのため、第１実施形態よりも装置が大型化する。又、外界光が光路変更素子を２回通過して目Ｅに導かれる為、光量減衰が大きくなり装着者による外界視認性が低下する。他は第１実施形態と同様の作用効果を奏することができる。   In the fifth embodiment, it is necessary to separately provide a display optical element and a monitor optical element. Therefore, the apparatus becomes larger than that in the first embodiment. Further, since the external light passes through the optical path changing element twice and is guided to the eye E, the light quantity attenuation is increased and the external visibility by the wearer is reduced. Others can achieve the same operational effects as the first embodiment.

本発明は上記実施形態に限定されない。例えば、表示器や光学系やカメラの配置は特に限定されるものではなく、また、第３実施形態以外の実施形態において外界光の反射回数が奇数回になるように光学系を構成してもよい。   The present invention is not limited to the above embodiment. For example, the arrangement of the display, the optical system, and the camera is not particularly limited, and the optical system may be configured so that the number of external light reflections is an odd number in embodiments other than the third embodiment. Good.

本発明の第１実施形態の頭部装着型表示システムの構成説明図Structure explanatory drawing of the head mounted display system of 1st Embodiment of this invention. 本発明の第２実施形態の頭部装着型表示システムの構成説明図Structure explanatory drawing of the head mounted display system of 2nd Embodiment of this invention. 本発明の第３実施形態の頭部装着型表示システムの構成説明図Structure explanatory drawing of the head mounted display system of 3rd Embodiment of this invention. 本発明の第４実施形態の頭部装着型表示システムの構成説明図Structure explanatory drawing of the head mounted display system of 4th Embodiment of this invention. 本発明の第５実施形態の頭部装着型表示システムの構成説明図Structure explanatory drawing of the head mounted display system of 5th Embodiment of this invention. 従来の頭部装着型表示システムの構成説明図Configuration explanatory diagram of a conventional head-mounted display system 従来の頭部装着型表示システムにおける問題の説明図Explanatory diagram of problems in conventional head-mounted display systems 装着者による外界視認状態の一例を示す図The figure which shows an example of the external world visual recognition state by a wearer 表示画像の一例を示す図The figure which shows an example of a display image 装着者による表示画像と外界の視認状態の一例を示す図The figure which shows an example of the display image by a wearer, and the visual recognition state of the external world 従来の頭部装着型表示システムにおけるモニタ画像の一例を示す図The figure which shows an example of the monitor image in the conventional head mounted display system

符号の説明Explanation of symbols

２ 保持部
３ 表示器
４ 光学系
５ カメラ
１２ レンズ系
１３ 第１偏光ビームスプリッタ
１３′ 第１光路変更素子
１４ 第２偏光ビームスプリッタ
１４′ 第２光路変更素子
２１ １／４波長板
２２ ミラー
３１ モニタ装置
５０ 第２光路変更素子 DESCRIPTION OF SYMBOLS 2 Holding part 3 Display 4 Optical system 5 Camera 12 Lens system 13 1st polarization beam splitter 13 '1st optical path change element 14 2nd polarization beam splitter 14' 2nd optical path change element 21 1/4 wavelength plate 22 Mirror 31 Monitor Device 50 Second optical path changing element

Claims (5)

装着者の頭部に装着される保持部と、
前記保持部により保持される画像表示光出射用表示器と、
前記表示器から出射される画像表示光を前記装着者の目に導くように前記保持部により保持される光学系と、
前記保持部により保持される外界撮影用カメラとを備え、
前記光学系は、前記装着者の目の前方に配置される表示用光学素子を有し、
前記表示用光学素子により、前記画像表示光の光路が変更され、前記装着者の視軸に一致する光路を有する外界光の一部が透過される頭部装着型表示装置において、
前記装着者の目の前方において、前記外界光の一部を透過し、前記外界光の一部の光路を変更するモニタ用光学素子が前記保持部により保持され、
前記モニタ用光学素子により光路変更された前記外界光の一部が前記カメラに導かれることを特徴とする頭部装着型表示装置。 A holding part to be worn on the wearer's head;
An image display light emitting display held by the holding unit;
An optical system held by the holding unit so as to guide image display light emitted from the display to the eyes of the wearer;
An external shooting camera held by the holding unit,
The optical system has a display optical element disposed in front of the wearer's eyes,
In the head-mounted display device in which an optical path of the image display light is changed by the display optical element and a part of external light having an optical path that matches the visual axis of the wearer is transmitted.
In front of the eyes of the wearer, a monitoring optical element that transmits a part of the external light and changes a part of the optical path of the external light is held by the holding unit,
A head-mounted display device characterized in that a part of the external light whose optical path is changed by the monitoring optical element is guided to the camera. 前記表示用光学素子は前記モニタ用光学素子を兼用する請求項１に記載の頭部装着型表示装置。 The head-mounted display device according to claim 1, wherein the display optical element also serves as the monitor optical element. 前記表示用光学素子は、特定方向の偏光を反射し、別の特定方向の偏光を透過する第１偏光ビームスプリッタにより構成され、
前記光学系は、前記第１偏光ビームスプリッタと前記表示器との間において、特定方向の偏光を反射し、別の特定方向の偏光を透過する第２偏光ビームスプリッタを有し、
第１偏光ビームスプリッタにより反射される直線偏光を円偏光にする１／４波長板と、前記１／４波長板を通過した偏光を再び前記１／４波長板に導くように反射する反射素子とが前記保持部により保持され、
前記画像表示光を構成する特定方向の偏光は、前記第２偏光ビームスプリッタにより反射された後に前記第１偏光ビームスプリッタに導かれ、前記第１偏光ビームスプリッタにより反射されることで前記装着者の目に導かれ、
前記外界光を構成する特定方向の偏光は、前記第１偏光ビームスプリッタにより反射された後に前記１／４波長板を通過して前記反射素子に導かれ、前記反射素子により反射された後に再び前記１／４波長板に導かれ再び通過することで別の特定方向の偏光とされ、前記第１偏光ビームスプリッタと前記第２偏光ビームスプリッタとを透過した後に前記カメラに導かれる請求項２に記載の頭部装着型表示装置。 The display optical element includes a first polarization beam splitter that reflects polarized light in a specific direction and transmits polarized light in another specific direction.
The optical system includes a second polarization beam splitter that reflects polarized light in a specific direction and transmits polarized light in another specific direction between the first polarized beam splitter and the display device,
A quarter-wave plate that converts the linearly polarized light reflected by the first polarizing beam splitter into circularly-polarized light, and a reflective element that reflects the polarized light that has passed through the quarter-wave plate again to the quarter-wave plate. Is held by the holding part,
The polarized light in a specific direction that constitutes the image display light is reflected by the second polarizing beam splitter, then guided to the first polarizing beam splitter, and reflected by the first polarizing beam splitter. Led to the eyes,
The polarized light in a specific direction constituting the external light is reflected by the first polarization beam splitter, then passes through the quarter-wave plate, is guided to the reflecting element, and is reflected by the reflecting element and then again. 3. The polarized light of another specific direction by being guided to a quarter-wave plate and passing again, and transmitted to the camera after being transmitted through the first polarizing beam splitter and the second polarizing beam splitter. Head-mounted display device. 前記第１偏光ビームスプリッタと前記第２偏光ビームスプリッタとの間に、前記画像表示光と前記カメラに導かれる偏光とが通過するレンズ系が配置されている請求項３に記載の頭部装着型表示装置。 The head mounted type according to claim 3, wherein a lens system through which the image display light and polarized light guided to the camera pass is disposed between the first polarizing beam splitter and the second polarizing beam splitter. Display device. 請求項１〜４の中の何れか１項に記載の頭部装着型表示装置と、
前記カメラによる撮影画像と前記表示器による表示画像とを合成した画像を表示するモニタ装置とを備える頭部装着型表示システム。 The head-mounted display device according to any one of claims 1 to 4,
A head-mounted display system including a monitor device that displays an image obtained by combining an image captured by the camera and a display image displayed by the display.
JP2005350965A 2005-12-05 2005-12-05 Head-mounted display device and head-mounted display system Expired - Fee Related JP4883271B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2005350965A JP4883271B2 (en) 2005-12-05 2005-12-05 Head-mounted display device and head-mounted display system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005350965A JP4883271B2 (en) 2005-12-05 2005-12-05 Head-mounted display device and head-mounted display system

Publications (2)

Publication Number Publication Date
JP2007156096A true JP2007156096A (en) 2007-06-21
JP4883271B2 JP4883271B2 (en) 2012-02-22

Family

ID=38240545

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2005350965A Expired - Fee Related JP4883271B2 (en) 2005-12-05 2005-12-05 Head-mounted display device and head-mounted display system

Country Status (1)

Country Link
JP (1) JP4883271B2 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009086007A (en) * 2007-09-27 2009-04-23 Shimadzu Corp Head-mounted image obtaining device and head-mounted display device using the same
WO2012105500A1 (en) * 2011-01-31 2012-08-09 ブラザー工業株式会社 Head mounted display
WO2013019371A1 (en) * 2011-08-02 2013-02-07 Google Inc. Method and apparatus for a near-to-eye display
US20130070338A1 (en) * 2011-09-21 2013-03-21 Google Inc. Lightweight eyepiece for head mounted display
WO2013012484A3 (en) * 2011-07-15 2013-03-21 Google Inc. Eyepiece for near-to-eye display with multi-reflectors
WO2014041872A1 (en) * 2012-09-12 2014-03-20 ソニー株式会社 Image display device
US8699842B2 (en) 2011-05-27 2014-04-15 Google Inc. Image relay waveguide and method of producing same
US9069115B2 (en) 2013-04-25 2015-06-30 Google Inc. Edge configurations for reducing artifacts in eyepieces
US9087471B2 (en) 2011-11-04 2015-07-21 Google Inc. Adaptive brightness control of head mounted display
JP2015132787A (en) * 2014-01-16 2015-07-23 コニカミノルタ株式会社 Spectacle type display device
US9239415B2 (en) 2012-03-08 2016-01-19 Google Inc. Near-to-eye display with an integrated out-looking camera
JP2021513687A (en) * 2018-02-12 2021-05-27 マトリックスド、リアリティー、テクノロジー、カンパニー、リミテッドＭａｔｒｉｘｅｄ Ｒｅａｌｉｔｙ Ｔｅｃｈｎｏｌｏｇｙ Ｃｏ．， Ｌｔｄ． Augmented reality device and optical system for it

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000105348A (en) * 1998-07-27 2000-04-11 Mr System Kenkyusho:Kk Picture observation device
JP2000267038A (en) * 1999-03-12 2000-09-29 Mr System Kenkyusho:Kk Picture observation device
JP2004126869A (en) * 2002-10-01 2004-04-22 Canon Inc Position/attitude setting device, conversion parameter setting method and composite reality feeling system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000105348A (en) * 1998-07-27 2000-04-11 Mr System Kenkyusho:Kk Picture observation device
JP2000267038A (en) * 1999-03-12 2000-09-29 Mr System Kenkyusho:Kk Picture observation device
JP2004126869A (en) * 2002-10-01 2004-04-22 Canon Inc Position/attitude setting device, conversion parameter setting method and composite reality feeling system

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009086007A (en) * 2007-09-27 2009-04-23 Shimadzu Corp Head-mounted image obtaining device and head-mounted display device using the same
WO2012105500A1 (en) * 2011-01-31 2012-08-09 ブラザー工業株式会社 Head mounted display
JP2012159681A (en) * 2011-01-31 2012-08-23 Brother Ind Ltd Head mount display
US8699842B2 (en) 2011-05-27 2014-04-15 Google Inc. Image relay waveguide and method of producing same
WO2013012484A3 (en) * 2011-07-15 2013-03-21 Google Inc. Eyepiece for near-to-eye display with multi-reflectors
US8471967B2 (en) 2011-07-15 2013-06-25 Google Inc. Eyepiece for near-to-eye display with multi-reflectors
CN103620479A (en) * 2011-07-15 2014-03-05 谷歌公司 Eyepiece for near-to-eye display with multi-reflectors
WO2013019371A1 (en) * 2011-08-02 2013-02-07 Google Inc. Method and apparatus for a near-to-eye display
US8767305B2 (en) 2011-08-02 2014-07-01 Google Inc. Method and apparatus for a near-to-eye display
WO2013043252A1 (en) * 2011-09-21 2013-03-28 Google Inc. Lightweight eyepiece for head mounted display
CN103765294A (en) * 2011-09-21 2014-04-30 谷歌公司 Lightweight eyepiece for head mounted display
US20130070338A1 (en) * 2011-09-21 2013-03-21 Google Inc. Lightweight eyepiece for head mounted display
US9013793B2 (en) 2011-09-21 2015-04-21 Google Inc. Lightweight eyepiece for head mounted display
US9087471B2 (en) 2011-11-04 2015-07-21 Google Inc. Adaptive brightness control of head mounted display
US9239415B2 (en) 2012-03-08 2016-01-19 Google Inc. Near-to-eye display with an integrated out-looking camera
JPWO2014041872A1 (en) * 2012-09-12 2016-08-18 ソニー株式会社 Image display device
WO2014041872A1 (en) * 2012-09-12 2014-03-20 ソニー株式会社 Image display device
US9740008B2 (en) 2012-09-12 2017-08-22 Sony Corporation Image display device
US9069115B2 (en) 2013-04-25 2015-06-30 Google Inc. Edge configurations for reducing artifacts in eyepieces
JP2015132787A (en) * 2014-01-16 2015-07-23 コニカミノルタ株式会社 Spectacle type display device
JP2021513687A (en) * 2018-02-12 2021-05-27 マトリックスド、リアリティー、テクノロジー、カンパニー、リミテッドＭａｔｒｉｘｅｄ Ｒｅａｌｉｔｙ Ｔｅｃｈｎｏｌｏｇｙ Ｃｏ．， Ｌｔｄ． Augmented reality device and optical system for it
US11500205B2 (en) 2018-02-12 2022-11-15 Matrixed Reality Technology Co., Ltd. Wearable AR system, AR display device and its projection source module
JP7285579B2 (en) 2018-02-12 2023-06-02 マトリックスド、リアリティー、テクノロジー、カンパニー、リミテッド Augmented reality device and optical system therefor
US11693245B2 (en) 2018-02-12 2023-07-04 Matrixed Reality Technology Co., Ltd. Wearable AR system, AR display device and its projection source module
US11693244B2 (en) 2018-02-12 2023-07-04 Matrixed Reality Technology Co., Ltd. Augmented reality apparatus and optical system therefor
US11874466B2 (en) 2018-02-12 2024-01-16 Matrixed Reality Technology Co., Ltd. Augmented reality apparatus, and optical system and semi-reflector therefor
US11988839B2 (en) 2018-02-12 2024-05-21 Matrixed Reality Technology Co., Ltd. Augmented reality apparatus and optical system therefor

Also Published As

Publication number Publication date
JP4883271B2 (en) 2012-02-22

Similar Documents

Publication Publication Date Title
JP4883271B2 (en) Head-mounted display device and head-mounted display system
US20230418069A1 (en) Head-mounted display eyeball tracker integrated system
US9958680B2 (en) Near-eye display device and methods with coaxial eye imaging
US10845606B1 (en) Eye tracking for a head mounted display including a pancake lens block
US10684477B2 (en) Near-eye display device and methods with coaxial eye imaging
JP3338837B2 (en) Composite display
US9001030B2 (en) Heads up display
US6239915B1 (en) Composite display apparatus
JP5803784B2 (en) Head mounted display
JP2019086556A (en) Virtual image display device and head-mounted display using the same
KR101524933B1 (en) Optical system and head mount display apparatus for augmented reality implementation
JP2009015128A (en) Three-dimensional image display device
WO2012105500A1 (en) Head mounted display
JP2020037379A (en) Display system, electronic mirror system, and movable body
WO2019017274A1 (en) Display device
JP3310325B2 (en) Head mounted display device and system using the same
US20210231957A1 (en) Image display apparatus
JP2011053564A (en) Display device and imaging device
JP5077545B2 (en) Combiner optical system, wearable display device, and glasses
JP2009258212A (en) Information synthesis structure of astronomical telescope eyepiece
US11617508B2 (en) Eye-tracking fundus imaging system
JP3604979B2 (en) Image observation device
KR101846097B1 (en) See through display apparatus
TW202107158A (en) Virtual reality optical device with two focusing planes
US20240019737A1 (en) Optical system, display apparatus having the same, and control apparatus

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20080402

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20110117

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20110119

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110303

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20111109

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20111122

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20141216

Year of fee payment: 3

R151 Written notification of patent or utility model registration

Ref document number: 4883271

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20141216

Year of fee payment: 3

LAPS Cancellation because of no payment of annual fees