JP2011059435A - Head mounted display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make an observer sense an environment in which a monitor is actually installed when a display emission area in a video projection face of a head mounted display (HMD) from which display light is emitted toward the eye balls of the observer moves on a video projection face so that a virtual image formation face in the install space of the HMD may be fixed not in conjunction with the variation of the observer's head to which the HMD is mounted. <P>SOLUTION: The HMD includes: a display element which displays a real image; a light guiding member 110 which guides display light to the observer; an attitude monitoring sensor; and a control part which controls the display element on the basis of detection information from the attitude monitoring sensor. The control part controls the display of the display element so that the virtual image forming face which is recognized as an enlarged video I in a space in which the HMD is fixed regardless of the attitude variation of a video projection face 110a of the light guiding member 110. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a head mounted display (hereinafter referred to as “HMD”) that enables an arbitrary enlarged image to be presented to an observer while being mounted on the observer's head. The present invention relates to a light transmission type head-mounted display for providing the observer with a pseudo space that allows the user to experience the experience.

  Usually, when viewing visual information such as video in a living room of a general household, it is common to adopt a configuration as shown in FIG. That is, the observer 10 sits on the chair 30 with the table 40 facing forward. The display device 20 including the monitor 21 is installed on the table 40, and the observer 10 sees an image displayed on the monitor 21 in a state of being separated by a predetermined distance.

  However, in recent years, HMDs to be worn on the observer's head have been developed as means for providing visual information such as images in an environment where a sufficient monitor installation space cannot be secured, such as transportation such as railways, automobiles, and airplanes. . In particular, such an HMD includes a light transmission type HMD that provides visual information in a state where an observer's own visual field is secured, as disclosed in Patent Document 1 below.

JP 2009-92810 A Japanese Patent No. 3074677

Kenkichi Kenno, “Latest Trends and Prospects of HMD”, IEICE, IEICE Technical Report EID2000-222, November 2000

  As a result of examining the conventional HMD, the inventors have found the following problems. That is, since the conventional HMD is used while being mounted on the observer's head, it is possible to present an enlarged image at a predetermined magnification to the observer even in an environment where it is difficult to install an actual monitor device or the like. . Therefore, as shown in FIG. 1B, when the observer 10 wears the HMD 50 on the head, the observer 10 himself / herself recognizes the virtual image I presented on the virtual image forming surface IP. As a result, the monitor installation environment can be experienced in a pseudo space, while the monitor installation space can be effectively saved.

  However, in the conventional HMD 50, since the emission position of the display light provided to the observer 10 is fixed, the virtual image I recognized by the observer himself in conjunction with the head variation of the observer 10 is always the observer 10 as well. Will be presented within the field of view. This means that the virtual image I is presented in the field of view of the observer 10 even when the observer 10 performs a non-observation operation other than video observation. Obviously, it interferes with non-observation movements. As an environment in which the observation operation and the non-observation operation are repeated, for example, a medical site where surgery is performed can be considered. It is well known that the operation at the medical site repeats an operation for confirming monitor screens of various measuring instruments and an operation (non-observation operation) requiring precise manual work. Under such circumstances, if an image is presented in the observer's field of view during a non-observation operation, the operation itself will be hindered.

  The present invention has been made to solve the above-described problems, and is a pseudo-space that allows the user to experience the monitor installation environment, that is, the monitor screen observation operation and the non-observation operation as in the actual monitor installation environment. However, it is an object of the present invention to provide a light transmission type head mounted display having a structure for providing a pseudo space that can be arbitrarily realized in conjunction with a change in posture of the observer's head.

  A head-mounted display (HMD) according to the present invention is a structure for enabling an arbitrary enlarged image to be presented to an observer while being attached to the observer's head in a state in which the observer's front visual field is secured. Specifically, a display element, a light guide member made of a material that can transmit visible light, an attitude monitoring sensor, and a control for performing display control on the display element based on detection information from the attitude monitoring sensor A part. Here, the display element displays a real image serving as a video source of a video (virtual image) to be presented to the observer. The light guide member guides the display light emitted from the display element to the eyeball of the observer through the image projection plane. The posture monitoring sensor detects a change in posture of the image projection surface of the light guide member that changes in conjunction with the observer's head. The control unit performs display control on the display element so that a virtual image forming surface recognized as an enlarged image is fixed in a space where the HMD is installed without being interlocked with a change in posture of the image projection surface of the light guide member. Do.

  With the above-described configuration, the display emission area on the video projection surface of the HMD from which the display light is emitted toward the observer's eyeball is not linked to the fluctuation of the observer's head on which the HMD is mounted. It moves on the image projection plane so that the virtual image forming plane in the installation space is fixed. At this time, the observer can feel as if the virtual image forming surface recognized through the image projection surface that fluctuates integrally with his / her head is fixed. Operations other than observation, such as work, can be performed smoothly with the same feeling as the installed environment. Therefore, the HMD according to the present invention is not only used in an environment where it is difficult to install a monitor, but also applied to various fields in which a monitor has been conventionally used for smooth work execution such as a medical site and a video conference. Enable.

  In the HMD according to the present invention, the posture monitoring sensor preferably includes one or more acceleration sensors. The display element may be either a light emitting type or a non-light emitting type. As a light emitting display element, for example, a plasma display, an electroluminescence (EL) device, a light emitting diode (LED) array, and the like are known. As non-light emitting display elements, for example, liquid crystal displays, holographic elements and the like are known.

  In the HMD according to the present invention, the control unit stops the video display operation of the display element when the posture monitoring sensor detects that the posture of the video projection plane has fluctuated at an acceleration exceeding a preset value. Is preferred. This is because an abrupt change in posture is likely to be determined as an emergency situation of the viewer himself, and it is necessary to ensure a sufficient field of view of the viewer regardless of the posture change of the image projection plane. In consideration of extending the life of the HMD, the control unit actually emits from the image projection surface toward the observer's eyeball in the display light emission area preset on the image projection surface. It is preferable to stop the image display operation of the display element when there is no display light emission area. Furthermore, as the video information to be displayed, navigation information can be provided, so the HMD may have a GPS function.

  The HMD having the above-described structure (HMD according to the present invention) can be applied to a field where a monitor has been conventionally used, for example, a video conference system using a bidirectional data communication technique. In this case, the HMD constitutes a part of an information terminal device applicable to a communication system that enables bidirectional data communication via a predetermined transmission means. That is, the information terminal device according to the present invention is taken into the imaging device between the HMD having the above-described structure, the imaging device for photographing the observer wearing the HMD, and the transmission means. An input / output unit for enabling transmission / reception of data including video information is provided.

  The embodiments according to the present invention can be more fully understood from the following detailed description and the accompanying drawings. These examples are given for illustration only and should not be construed as limiting the invention.

  Further scope of applicability of the present invention will become apparent from the detailed description given below. However, the detailed description and specific examples, while indicating the preferred embodiment of the invention, are presented for purposes of illustration only and various modifications and improvements within the scope of the invention may It will be apparent to those skilled in the art from the detailed description.

  According to the present invention, the display light emission area on the video projection surface of the HMD from which the display light is emitted toward the eyeball of the observer is not linked to the fluctuation of the observer head to which the HMD is attached. It moves on the video projection surface so that the virtual image forming surface in the installation space of the HMD is fixed. With this configuration, the observer can experience the environment where the monitor is actually installed.

It is a figure for demonstrating notionally the pseudo | simulation space implement | achieved by HMD which concerns on this invention. It is a figure for demonstrating the appearance and function of 1st Embodiment of HMD which concerns on this invention. It is a figure for demonstrating the structure of the waveguide member in HMD which concerns on 1st Embodiment with the display principle of an enlarged image. It is a figure for demonstrating the pseudo | simulation space (monitor installation environment) implement | achieved by HMD which concerns on 1st Embodiment. It is a figure which shows the basic composition of HMD which concerns on 1st Embodiment. It is a figure for demonstrating the function of the attitude | position monitoring sensor in HMD which concerns on 1st Embodiment. It is a figure for demonstrating the display control performed by the control part in HMD which concerns on 1st Embodiment. It is a flowchart for demonstrating the setting mode and fixed display mode which are performed by the control part in HMD which concerns on 1st Embodiment. It is a flowchart for demonstrating the variable display mode performed by the control part in HMD which concerns on 1st Embodiment. It is a figure which shows the general-view of 2nd and 3rd embodiment of HMD which concerns on this invention. It is a figure which shows the structure of the information terminal device which concerns on this invention.

  Hereinafter, embodiments of a head-mounted display (HMD) according to the present invention will be described in detail with reference to FIGS. Note that, in the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 2 is a diagram for explaining an overview and functions of the first embodiment of the HMD according to the present invention. In particular, FIG. 2A shows a binocular goggles type HMD as the HMD according to the first embodiment. The HMD 100 is a light transmissive HMD provided with a light guide member 110 made of a material that can transmit visible light and a pair of support members for holding the light guide member 110 on the observer's head. The light guide member 110 includes an inner surface 110a (an image projection surface on which display light is emitted toward the eyeball EYE) facing the observer's eyeball EYE (see FIG. 2B), and an outer surface facing the inner surface 110a. It has a side surface 110b. One support member incorporates a display control device 120a including a display element 121a (see FIG. 2B) for displaying a real image, and the instruction information of the observer as an input / output device of the display control device 120a. Switch unit 130 and earphone 140a for providing audio information to the observer. Similarly, a display control device 120b is built in the other support member, and an earphone 140b is provided as an input / output device of the display control device 120b.

  In the HMD 100 according to the first embodiment, the display light emitted from the display element 121a propagates in the light guide member 110, that is, in a region corresponding to the left half of the light guide member 110, and from the image projection surface 110a. It reaches the left eyeball EYE of the observer. On the other hand, the display light emitted from the display element 121b also propagates in a region corresponding to the right half of the light guide member 110, and reaches the right eyeball EYE of the observer from the image projection surface 110a. At this time, the emission angle of the display light irradiated to the left eyeball EYE from the left side of the image projection surface 110a (the angle between the image projection surface 110a and the optical axis of the display light, which is given by the horizontal component and the vertical component) The virtual image I as shown in FIG. 2B is presented to the observer by giving a parallax angle to the emission angle of the display light irradiated on the right eyeball EYE from the right side of the video projection surface 110a. The parallax angle is a parameter that defines a default value of the distance from the surface 110b of the light guide member 110 to the virtual image forming surface, that is, a default value of the magnification of the virtual image I presented to the observer.

  FIG. 3 is a view for explaining the structure of the waveguide member in the HMD according to the first embodiment, together with the principle of displaying an enlarged image.

  For example, as shown in FIG. 3A, the light guide member 110 can be realized by an eccentric free-form surface optical system 11 including curved surfaces 11a to 11C (see Non-Patent Document 1). Further, the light guide member 110 of the HMD 100 according to the first embodiment is a light guide plate having surfaces 110a and 110b facing each other as shown in FIG. Each of the surfaces 110a and 110b is processed as a Fresnel lens that functions in the same manner as the curved surfaces 11b and 11c in the decentered free-form curved optical system 11, respectively. Note that FIG. 3B corresponds to a cross-sectional view of the light guide member 110 taken along the line I-I shown in FIG. Each of the light guide members 110 is made of a material that can transmit visible light, for example, a plastic material such as a glass material or an acrylic resin, and in particular, a light guide plate whose surface is processed as a Fresnel lens (FIG. 3B). In this case, the transmittance for visible light is lowered, but a material having a transmittance of at least 50% or more, preferably 70% or more is preferable. Furthermore, each surface of the light guide member shown in FIGS. 3A and 3B may be half-mirror coated with a dielectric multilayer film.

  Specifically, the principle of virtual image formation using display light will be described using the decentered free-form curved optical system 11 shown in FIG. 3A. From the display element 12 that displays a real image, as shown in FIG. Is emitted into the optical system 11 through the curved surface 11a. The display light is totally reflected at the curved surface 11b and the curved surface 11c, and reaches the observer's eyeball EYE again from the curved surface 11b (projected curved surface). At this time, as shown in FIG. 3C, the virtual image I is presented to the observer at a position (on the virtual image forming surface) that is a predetermined distance away from the curved surface 11 c.

  In the case of the HMD 100 according to the first embodiment of FIG. 2, as shown in FIG. 3D, the face 110a, 110b of the light guide member 110 facing each other directly facing the eyeball EYE of the observer. The surface 110a that functions as an image projection surface from which display light is emitted. In addition, a display light emission area 111 is set in advance on the video projection surface 110a, and the emission area in which the display light is actually emitted toward the eyeball EYE of the observer in the emission area 111. 112 is present. Each of the surfaces 110a and 110b of the light guide member 110 causes display light emitted from any position in the exitable area 111 to reach the observer's eyeball EYE by the cooperation of the surfaces 110a and 110b. It functions as a Fresnel lens designed so.

  Next, a mechanism for forming a pseudo space in the monitor installation environment realized by the HMD 100 according to the first embodiment will be described with reference to FIG. In FIG. 4, the light guide member 110 is shown as a monocular member in order to simplify the description.

  The virtual image (enlarged image) I presented to the observer by the HMD 100 is defined by the visual field of the observer, that is, the visible light incident angle V (viewing angle) that can reach the eyeball EYE via the light guide member 110. Formed in the space. At this time, the actual emission area 112 of the display light is located at the center of the exitable area 111 set in advance on the image projection surface 110a of the light guide member 110 (the lower center in FIG. 4).

  In the HMD 110, the virtual image forming surface (virtual image I) that the controller 123 recognizes as an enlarged image in the space where the HMD 100 is installed without being interlocked with the posture change of the video projection surface 110a of the light guide member 110 is fixed. Thus, display control is performed on the display element 121. Specifically, when the observer's head rotates to the left and right, the light guide member 110 also moves in the direction indicated by the arrow A or the arrow B as shown in the upper part of FIG. Moving.

  For example, when the image projection surface 110a moves in the direction indicated by the arrow A, the position of the exit area 112 is the center as shown in the lower left of FIG. 4 in the exitable area 111 of the image projection surface 110a. Move to the right. On the other hand, when the image projection plane 110a moves in the direction indicated by the arrow B, the position of the exit area 112 is the center of the exitable area 111 of the image projection plane 110a as shown in the lower right of FIG. Move to the left. With this configuration, the formation position of the virtual image I is relatively fixed in the space where the HMD 100 is installed. Therefore, since the observer can feel as if the virtual image I recognized through the image projection surface 110a that fluctuates integrally with his / her head is fixed, the observer himself / herself has actually installed a monitor. It is possible to smoothly perform operations other than observation, such as work, with the same feeling as in the environment.

  Next, a basic configuration of the display control device 120 (corresponding to each of the display control devices 120a and 120b in FIG. 2A) constituting a part of the HMD 100 according to the first embodiment is shown in FIG. This will be specifically described with reference to FIG. In order to improve the portability of the HMD 100, the display control device 120 preferably includes a drive battery.

  As shown in FIG. 5A, the display control device 120 receives necessary video data (PC) from the information processing device 190 (PC) in which information to be provided to the observer such as video data and still image data is stored. An input / output unit 122 (I / O) for capturing a movie composed of a plurality of image frames and a monitor image of a measuring instrument), and a display element 121 for displaying a real image provided to an observer (FIG. 2 ( b) corresponding to each of the display elements 121a and 121b), a control unit 123, an input / output unit 124 (I / O) for capturing support information from an observer via a user interface, a memory 125, An attitude monitoring sensor 126 for detecting a change in attitude of the image projection surface 110a in the optical member 110, a switch unit 130, and a speaker 130 (an earphone in FIG. 2A). 130a, comprises 130b corresponds to each).

  Note that the data communication method between the information processing apparatus 190 and the I / O 122 may be either wired or wireless. The display element is preferably a two-dimensional display element, and may be either a light emitting type or a non-light emitting type. As a light emitting display element, for example, a plasma display, an electroluminescence (EL) device, a light emitting diode (LED) array, and the like are known. As non-light emitting display elements, for example, liquid crystal displays, holographic elements and the like are known. The control unit 123 mainly performs display control on the display element 120. The memory 125 stores video data for display transmitted from the information processing apparatus 190 via the I / O 122 in addition to video data for initial setting and posture information detected by the posture monitoring sensor 126. The posture monitoring sensor 126 is composed of an xy acceleration sensor 126a and an xz acceleration sensor 126b that detect posture fluctuations of orthogonal plane components. The xy acceleration sensor 126a and the xz acceleration sensor 126b are preferably acceleration sensors. The switch unit 130 is a user interface for inputting observer instruction information, and the speaker 140 is a user interface for providing audio information to the observer.

  In the control unit 123, the operation mode specifically shown in FIG. 5B is executed. That is, the control unit 123 sets a setting mode for determining an initial state of the HMD 100 (a coordinate origin in the installation space of the HMD 100 serving as a reference position for posture change detection by the posture monitoring sensor 126) and a specific display operation. Execute the display mode that defines In addition, the control unit 123 also executes an emergency mode in preparation for an unexpected occurrence such as an earthquake or an accident. Note that switching of each operation mode except the emergency mode is performed by the observer via the switch unit 130. In addition, the display mode includes a fixed display mode capable of displaying an image similar to a conventional HMD and a variable display mode that provides a pseudo space for the observer to experience the monitor installation environment.

  Further, as described above, the posture monitoring sensor 126 detects the fluctuation of the horizontal fluctuation component of the HMD 100 in the space where the HMD 100 is installed, specifically, the video projection surface 110a of the light guide member 110. The sensor 126a and the xz acceleration sensor 126b which detects a vertical fluctuation component are included.

  In other words, as shown in FIG. 6A, the xy acceleration sensor 126a rotates the head of the viewer, to which the HMD 100 is attached, in the direction indicated by the arrow zc in the drawing around the z axis. The horizontal fluctuation component is detected. Specifically, the fluctuation amount and the fluctuation acceleration when the image when the light guide member 100 is projected onto the xy plane move to the arrow A1 or B1 are detected. On the other hand, as shown in FIG. 6B, the xz acceleration sensor 126b rotates the head of the observer, to which the HMD 100 is attached, in the direction indicated by the arrow yc in the figure about the y axis. The vertical fluctuation component is detected. Specifically, the fluctuation amount and the fluctuation acceleration when the image when the light guide member 100 is projected onto the xz plane moves to the arrow A2 or B2 are detected.

  The posture monitoring coordinate system shown in FIG. 6 is specified by determining the initial posture in advance in the setting mode executed by the control unit 123 (the sensor in the initial posture set by the setting mode). 126a and 126b are set as coordinate origins).

  Next, display control (display position and magnification control) executed by the control unit 123 in the HMD 100 according to the first embodiment will be described with reference to FIG.

  In the HMD 100 according to the first embodiment, the displayable area 1211 of the display element 120 capable of two-dimensional display corresponds to the display light emission possible area 111 set in advance on the image projection surface 110a. Therefore, the control unit 123 arbitrarily sets the display position and size of the real image 1212 in the displayable area 1211 of the display element 120, thereby controlling the position of the display light emission area 112 in the outputable area 111 and the observer. It is possible to control the magnification of the virtual image I presented in FIG. Here, each surface 110a, 110b of the light guide member 110 is configured so that the display light can reach the eyeball EYE of the observer even when the emission area 112 is located at any position in the displayable area 111. The surface is processed as a Fresnel lens.

  The display control of the control unit 123 for the display element 120 can be variously modified. For example, as shown in FIG. 7B, a lens L, a reflecting mirror, and the like are arranged in a space between the light guide member 110 and the display element 120, and the control unit 123 changes the posture of these optical members. Display control is also possible by controlling the drive system 191 to change. For example, the posture control of the lens L by the drive system 191 is performed by rotating the lens L about axes L1 and L2 that are orthogonal to each other. The magnification of the virtual image I can be adjusted by changing the size of the real image 1212 displayed in the displayable area 1211 of the display element 121. However, even if the magnification is controlled by the attitude control of the optical member. Good.

  Next, various operation modes executed in the control unit 123 shown in FIG. 5B will be described in detail with reference to the flowcharts of FIGS.

  First, the setting mode executed by the control unit 123 will be described with reference to the flowchart of FIG. This setting mode is a mode for setting a reference posture for detecting a posture variation of the image projection surface 110a by the posture monitoring sensor 126. That is, as shown in FIG. 8A, the control unit 123 reads the reference posture setting video data or still image data from the memory 125 and causes the display element 121 to display the read data (default). Display: Step ST801). At this time, since the control unit 123 presents the virtual image I (enlarged video) as the fixed display mode to the observer, the virtual image I presented to the observer also varies in conjunction with the change in the posture of the HMD 100 as in the conventional technique. To do. The reference posture of the HMD 100 is performed by the observer himself via the switch unit 130 (step ST802). Specifically, as shown in FIG. 6, the determination information of the reference posture is the origin coordinates of the xy acceleration sensor 126a and the xz acceleration sensor 126b, and this determination information is detection reference information of posture fluctuation. Is stored in the memory 125 (step ST803).

  Next, among the display modes executed by the control unit 123, the fixed display mode will be described with reference to the flowchart of FIG. Note that in this fixed display mode, the formation position of the virtual image I presented to the observer is also changed in conjunction with the posture change of the HMD 100.

  This fixed display mode may be executed from the operation start time of the HMD 100 or may be switched from a variable display mode described later. When the fixed display mode is executed since the operation of the HMD 100 is disclosed, first, the default display control information stored in the memory 125 is taken into the control unit 123 (step ST811), and the control unit 123 displays this display. Based on the control information, the real image 1212 is displayed in the displayable area 1211 of the display element 121. On the other hand, when the display mode is switched from the later-described variable display mode to the fixed display mode, the display control information at the time of switching is used as default display control information in the fixed mode. Accordingly, by switching to the fixed display mode in a state where the virtual image I is previously displayed at an arbitrary position in the observer's visual field in the variable display mode, an enlarged image with a predetermined magnification is fixedly displayed at an arbitrary position in the observer's visual field. Is possible.

  The video data to be displayed is sequentially transmitted from the information processing device 190 via the I / O 122, and the memory 125 temporarily stores the video data transmitted as a buffer. This video data is composed of a plurality of image frames, and the control unit 123 inputs image frames to be displayed as real images from the memory 125 to the display element 121 (step ST812), and sequentially performs display control operations for the display element 121. Frame display control is performed (step ST813). The display control in the fixed display mode for the display element 121 by the control unit 123 ends when it is completed for all image frames of the video data transmitted from the information processing apparatus 190 (step ST814).

  Further, among the display modes executed by the control unit 123, the variable display mode will be described with reference to the flowchart of FIG. This variation display mode is an operation mode performed after the setting mode illustrated in FIG. 8A is executed. As illustrated in FIG. 4, regardless of the posture variation of the HMD 100, This is a display mode in which the virtual image I is formed so that the virtual image formation position in the space where the HMD 100 is installed is fixed.

  That is, in this variable display mode, the control unit 123 inputs ideographic control information including posture information determined by the setting mode (FIG. 8A) from the memory 125 as default display control information (step ST901). Subsequently, the control unit 123 inputs an image frame constituting a part of video data to be displayed (step ST902) and confirms detection information from the attitude monitoring sensor 126 (step ST903). In step ST906, if it is determined that there is no posture change, the control unit 123 directly performs frame display control (step ST906) On the other hand, if it is determined in step ST903 that there is a posture change, the control unit 123 displays the detection result. It is further determined whether or not the fluctuation is within an allowable range (step ST904). .

  In step ST904, when the detection information of the posture monitoring sensor 126 suggests a variation outside the display allowable range, the mode is temporarily shifted from the variation display mode to the emergency mode. In this emergency mode, when the change acceleration of the posture (movement acceleration of the light guide member 110) is equal to or greater than a certain value, the display control operation for the display element 121 is stopped and the visual field of the observer is secured. Such an emergency mode is executed in order to prepare for the occurrence of an unexpected situation such as an earthquake or an accident. Further, when the posture change of the light guide member 110 occurs, the real image 1212 is not displayed in the displayable area 1211 of the display element 120. Also in this case, the control unit 123 stops display control for the display element 121 in order to save power consumption.

  If it is determined in step ST904 that the detection information of the posture monitoring sensor 126 is within the display allowable range, the control unit 123 corrects the display control information recorded in the memory 125 based on the detection information ( Step ST905), frame display control is performed based on the corrected display control information (step ST906). Then, the display control in the variable display mode for the display element 121 by the control unit 123 ends when it is completed for all image frames of the video data transmitted from the information processing device 190 (step ST907).

  The HMD according to the present invention can be realized by a binocular goggles type HMD as shown in FIG. 2 as the first embodiment, but can also be realized by various forms. FIG. 10 is a diagram showing an overview of the second and third embodiments of the HMD according to the present invention.

  FIG. 10 (a) shows a monocular goggle type HMD as a second embodiment of the HMD according to the present invention. The HMD 200 according to the second embodiment is substantially different from the HMD 100 according to the first embodiment in the overview, but its basic structure and operation are the same as those in the first embodiment. Specifically, the HMD 200 is a light transmissive HMD including a light guide member 210 made of a material that can transmit visible light and a support member 220 for holding the light guide member 210 on the observer's head. The light guide member 210 has substantially the same structure as the light guide member 110 shown in FIGS. 2 and 3. A display control device including a display element is built in the support member 220, and this display control device has a structure substantially shown in FIG. Further, the control unit included in the display control device executes the operation mode shown in FIG. 5B according to the flowcharts shown in FIGS. The support member 220 includes an input / output device for a built-in display control device, a switch unit 230 for inputting the instruction information of the observer, and a speaker (headphone type: not shown) for providing audio information to the observer. ) Are provided.

  Further, FIG. 10B shows a monocular goggle type HMD that can be attached to the glasses 350 as a third embodiment of the HMD according to the present invention. The HMD 300 according to the third embodiment is substantially different from the HMD 100 according to the first embodiment in the same manner as the second embodiment described above, but the basic structure and operation thereof are the same as those of the first embodiment. It is. Specifically, the HMD 300 is a light transmissive HMD including a light guide member 310 made of a material that can transmit visible light and a support member 320 for holding the light guide member 310 on the observer's head. The light guide member 310 has substantially the same structure as the light guide member 110 shown in FIGS. 2 and 3. The support member 320 includes a display control device including a display element, and this display control device has a structure substantially shown in FIG. Further, the control unit included in the display control device executes the operation mode shown in FIG. 5B according to the flowcharts shown in FIGS. The support member 320 is provided with a switch unit 230 for inputting observer instruction information and an earphone 340 for providing audio information to the observer as input / output devices of the built-in display control device. .

  Each embodiment of the HMD according to the present invention configured as described above can be applied to a field where a monitor has been conventionally used, for example, a video conference system using a bidirectional data communication technology (see Patent Document 2). . In this case, the HMD 100 (which may be the HMDs 200 and 300 according to the second and third embodiments) is a communication system that enables bidirectional data communication via predetermined transmission means (whether wired or wireless) 600. Part of applicable information terminal device.

  That is, the information terminal device according to the present embodiment, as shown in FIG. 11, is between the HMD 100, the imaging device 530 for photographing the observer 10 wearing the HMD 100, and the transmission unit 600. , Input / output units 510 and 520 for enabling transmission and reception of data including video information captured by the imaging device 530 are provided.

  In particular, in the configuration of the information terminal device shown in FIG. 11, the observer 10 is sitting on the chair 30 with the table 40 in front. A communication device 500 is installed on the table 40, and this communication device 500 is displayed on the imaging device 530 that images the observer 10, the microphone 540 that captures the voice of the observer 10, and the HMD 100. I / O 510 for transmitting video data to be transmitted, I / O 520 enabling two-way communication of various multimedia data such as audio and video with other information terminal devices via transmission means 600, and A control unit 550 for centrally managing these various components is provided.

  From the above description of the present invention, it is apparent that the present invention can be modified in various ways. Such modifications cannot be construed as departing from the spirit and scope of the invention, and modifications obvious to one skilled in the art are intended to be included within the scope of the following claims.

  The HMD according to the present invention can be used not only in an environment where it is difficult to install a monitor but also in various fields where a monitor has been conventionally used for smooth work execution such as a medical site and a video conference. To.

  DESCRIPTION OF SYMBOLS 100, 200, 300 ... Head mounted display, 110 ... Light guide member, 110a ... Image projection surface, 111 ... Display light emission area, 112 ... Display light emission area, 120, 120a , 120b ... display control device, 121, 121a, 121b ... display element, 123 ... control unit, 126 ... attitude monitoring sensor, 126a ... xy acceleration sensor, 126b ... x -Z acceleration sensor, I ... virtual image (virtual image forming surface).

Claims (6)

In a head mounted display for enabling an arbitrary enlarged image to be presented to the observer while being worn on the observer's head,
A display element for displaying a real image as a video source;
A light guide member made of a material that can transmit visible light, and guides display light emitted from the display element to the eyeball of the observer through a video projection surface;
A posture monitoring sensor for detecting a posture variation of the image projection surface of the light guide member that changes in conjunction with the head of the observer;
A control unit that performs display control on the display element based on detection information from the posture monitoring sensor, wherein the head mounted display is installed without being interlocked with a posture variation of a video projection surface of the light guide member. And a control unit that performs display control on the display element so that a virtual image forming surface recognized as the enlarged image is fixed in the space. The head mounted display according to claim 1, wherein the posture monitoring sensor includes one or more acceleration sensors. The head mounted display according to claim 1 or 2, wherein the display element includes any one of a liquid crystal display, a plasma display, an LED array, and a holographic element. The said control part stops the image | video display operation | movement of the said display element, when the said attitude | position monitoring sensor detects that the attitude | position of the said image projection surface was fluctuate | varied with the acceleration exceeding the preset value. Item 4. The head mounted display according to any one of Items 1 to 3. The control unit has no display light emission area that is actually emitted from the video projection surface toward the observer's eyeball in a display light emission area preset on the video projection surface. 5. The head mounted display according to claim 1, wherein an image display operation of the display element is stopped. An information terminal device applicable to a communication system that enables bidirectional data communication through a predetermined transmission means,
A head-mounted display according to any one of claims 1 to 5;
An imaging device for photographing the observer wearing the head-mounted display;
An information terminal device comprising: an input / output unit for enabling transmission and reception of data including video information captured by the imaging device to and from the transmission unit.

Images