JP5960799B2 - Head mounted display and display method - Google Patents

Description

  The present invention relates to a technique for displaying information.

  In recent years, there has been proposed a technique related to AR (Augmented Reality) in which predetermined information is displayed superimposed on a scene in front of a user using a display device such as a head-mounted display. For example, Patent Literature 1 discloses a head-mounted display that changes the display position of an AR image by detecting the tilt of the wearer's head.

JP 2008-176096 A

  Generally, since the parallax and the like are different for each user, the appropriate display position of the image (AR image) by the head mounted display is different for each user. Therefore, as in Patent Document 1, by detecting the inclination of the wearer's head, the display position of the image cannot be adjusted based on individual differences such as parallax for each user.

  The present invention has been made to solve the above-described problems, and has as its main object to provide a head-mounted display and a display method capable of adjusting the display position of an image to an appropriate position for each user. To do.

The invention according to claim 1 is a head-mounted display that causes a user to recognize an image superimposed on a scene observed through a transmissive member, and that displays the image to be recognized by the user. Photographing means for photographing a front image of the user wearing the head mounted display, a mark provided on a surface opposite to the surface facing the user in the head mounted display, and photographing by the photographing means. viewed contains a part of the front image, with displays on the display means generate the adjustment image the said landmarks included in the front image located at the center when the user is heading in the mirror, and adjusting means for accepting an adjustment of the display position of the image for adjustment, characterized in that Ru comprising a.

The invention according to claim 4 is a display method executed by a head mounted display that superimposes an image on a scene observed through a transmissive member and recognizes the user, and the head mounted display is mounted. a photographing step of photographing a front image of the user who, seeing containing a portion of the forward side image photographed by the photographing step, the mark which the user is included in the front image when heading to the mirror causes display on the display means generates the adjustment image but in the center, has an adjustment step of receiving an input for adjusting the display position of the image for adjustment, the pre-Symbol mark, in the head-mounted display It is provided on the surface opposite to the surface facing the user.

The schematic structure of the head mounted display which concerns on a present Example is shown. The front view in the mounting state of a head mounted display is shown. A state in which a user wearing a head mounted display faces the mirror is shown. A photographed image and a trimmed image are shown. The field of view of the user when a trimmed image is displayed is shown. It is a flowchart which shows a user's operation procedure and the process sequence which a control part performs in connection with it. The display positions of the AR image when the distance from the viewpoint to the display object is short and when the distance is long are shown.

  In one preferred embodiment of the present invention, a head-mounted display that superimposes an image on a scene observed through a transmissive member and allows the user to recognize the display, the display displaying the image to be recognized by the user. A user who is recognized by the user by displaying the adjustment image by means of the display means, a photographing means for photographing an adjustment image that is at least a part of a mirror image of the user wearing the head-mounted display, and the display means. Based on the position of the adjustment image in the landscape and the position of the mirror image observed by the user through the transmission member, the display position of the AR image by the display means is determined by the user. And adjusting means for adjusting.

  The head-mounted display includes a display unit, a photographing unit, and an adjusting unit by superimposing an image on a scene observed through the transmissive member and allowing the user to recognize the image. The display means displays an image (AR image) that is recognized by the user. The imaging means captures an adjustment image that is at least a part of a mirror image of the user wearing the head mounted display. The adjustment means is based on the position of the adjustment image in the landscape recognized by the user by displaying the adjustment image on the display means and the position of the mirror image observed by the user via the transmission member. Then, the user adjusts the display position of the AR image. In this way, the head mounted display can adjust the display position of the AR image to an appropriate position for each user.

  In one aspect of the head-mounted display, the adjustment means includes an image for adjustment recognized by the user via the transmission member and a mirror image observed by the user via the transmission member. So that the user can adjust the display position of the image. By doing in this way, the head mounted display can adjust suitably the shift | offset | difference of the display position of AR image according to a user's eyes | visual_axis position.

  In another aspect of the head mounted display, the adjustment unit displays the adjustment image in which a mark provided on the head mounted display is located at the center. By doing in this way, the head mounted display can adjust suitably the shift | offset | difference of the display position of AR image according to a user's eyes | visual_axis position.

  In another aspect of the head mounted display, an optical path from the mark to the user's viewpoint based on the size of the mark provided on the head mounted display and the size of the mark in the adjustment image. The display means determines a position for displaying the image based on the distance of the optical path. According to this aspect, the head mounted display can accurately determine the display position of the AR image.

  In another aspect of the head-mounted display, the display unit causes the user to recognize the image by reflecting a part of light for drawing the image to the transmissive member. By doing in this way, the head mounted display can adjust suitably the shift | offset | difference of the display position of AR image according to a user's eyes | visual_axis position.

  In another aspect of the head-mounted display, the adjustment unit causes the user to adjust the display position of the image by the display unit for each eye of the user. By doing in this way, even when an AR image is displayed on one of the eyes or an AR image is displayed on both eyes, the head mounted display sets the display position of the AR image to an appropriate position for each user. Can be set to

  In another aspect of the head-mounted display, the photographing unit includes a camera positioned in the vicinity of each eye of the user when the head-mounted display is mounted. According to this aspect, the head-mounted display can capture the adjustment image from the vicinity of the viewpoint of the eye viewing the AR image, so that the display position of the AR image can be adjusted with higher accuracy.

  In another aspect of the head mounted display, the photographing unit includes a camera provided at a central portion in the longitudinal direction of the head mounted display. According to this aspect, the camera is disposed at a position between both eyes close to either eye of the user, and thus the head mounted display can adjust the display position of the AR image with high accuracy.

  In another preferred embodiment of the present invention, there is provided a display method executed by a head-mounted display that superimposes an image on a scene observed through a transmissive member so as to be recognized by the user, and allows the user to recognize the display method. A display step of displaying an image, a photographing step of photographing an adjustment image that is at least a part of a mirror image of the user wearing the head mounted display, and displaying the adjustment image by the display step. Display of the image by the display step based on the position in the landscape of the image for adjustment recognized by the user and the position of the mirror image observed by the user through the transmission member And an adjusting step for adjusting the position. The head mounted display can adjust the display position of the AR image to an appropriate position for each user by executing this display method.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

[Device configuration]
FIG. 1 is a schematic configuration diagram illustrating an example of a head mounted display 1 according to the present embodiment. Hereinafter, the head-mounted display is appropriately expressed as “HMD”.

  As shown in FIG. 1, the HMD 1 mainly includes a control unit 2, a light source unit 3, a half mirror 4, and a camera 5. The HMD 1 is a see-through type HMD configured in, for example, a glasses type, and is configured to be worn on the user's head. The HMD 1 is configured to display an image only on one eye of the user or display an image on both eyes, for example.

  The light source unit 3 emits light constituting the image generated by the control unit 2 toward the half mirror 4. For example, the light source unit 3 includes a laser light source, an LCD light source, and the like, and emits light from such a light source. Thus, the control unit 2 and the light source unit 3 function as “display means” in the present invention.

  The half mirror 4 reflects the light from the light source unit 3 toward the user's eyeball. Thereby, a virtual image corresponding to an image (also referred to as “AR image”) formed by the HMD 1 is visually recognized by the user. The half mirror 4 has substantially the same transmittance and reflectance, but instead of using such a half mirror 4, a mirror (so-called beam splitter) whose transmittance and reflectance are not equal may be used. . The half mirror 4 is an example of the “transmission member” in the present invention.

  Based on the control of the control unit 2, the camera 5 captures a scene in front of the HMD 1 and generates a captured image “Ic”. The camera 5 supplies the generated captured image Ic to the control unit 2. The camera 5 is preferably installed at a central portion in the longitudinal direction of the HMD 1 and is set so as to be positioned between both eyes of the user when the HMD 1 is worn. In this way, the control unit 2 and the camera 5 function as “photographing means” in the present invention.

  The input unit 7 generates an input signal based on a user operation and transmits it to the control unit 2. The input unit 7 is a remote controller having, for example, a button for operation by a user, a cross key, and a button. In this embodiment, the input unit 7 generates an input signal for instructing start of AR image position adjustment based on a user's operation, or instructs to change the display position of the AR image according to the user's operation amount. Generate an input signal. Thus, the control unit 2 and the input unit 7 function as “adjusting means” in the present invention.

  The control unit 2 includes a processor such as a CPU (not shown) and a memory such as a RAM and a ROM, and performs overall control of the HMD 1. For example, the control unit 2 performs control for allowing the user to recognize an AR image superimposed on a scene observed through the half mirror 4. That is, control for AR display is performed.

  Specifically, for the predetermined object (also referred to as “display object”) included in the scenery observed through the half mirror 4, the control unit 2 displays an AR image indicating information on the display object. Generate. Here, the “AR image” is an image indicating information about an object such as a place, a facility, or a signboard, and is represented by an icon, a tag, a comment, a balloon, or the like. For example, the control unit 2 analyzes the captured image Ic of the camera 5 to identify a display object on which information is to be displayed, generates information about the display object, and selects an AR image corresponding to the information. Generate. In another example, the control unit 2 acquires information about a display object from a navigation device (including a portable terminal device such as a smartphone) (not shown) and generates an AR image corresponding to the information.

  Furthermore, the control unit 2 performs control so that the virtual image corresponding to the AR image is recognized at a position corresponding to the display target in the scenery. Here, the “position according to the display object” corresponds to, for example, a position superimposed on the display object or a position near the display object. In general, the display position of the AR image differs depending on the user because of the difference in the distance between the eyes. Therefore, in the present embodiment, the control unit 2 appropriately corrects the display position (focus position) of the AR image based on the user's operation. Specifically, the control unit 2 changes the display position of the AR image, for example, by changing the light emission direction of the light source unit 3 according to the operation amount of the user to the input unit 7. This will be described in detail in the section [AR image position adjustment].

  FIG. 2 shows a front view of the HMD 1 mounted. Hereinafter, the longitudinal direction of the HMD 1 is defined as “X-axis direction”, the lateral direction of the HMD 1 is defined as “Y-axis direction”, and each positive direction is determined as shown in FIG.

  As shown in FIG. 2, a marker 6 is pasted on the front surface of the HMD 1 on the side opposite to the surface facing the user 10. The marker 6 is pasted at a position that does not overlap the drawable range “Rd” indicating the range in which the light source unit 3 can emit light in the HMD 1 so as not to obstruct the field of view of the user 10. The marker 6 preferably has a color or the like different from that of the HMD 1 or the like so that the control unit 2 can easily recognize the position of the marker 6 from the acquired photographed image Ic. Information such as the width “Wm” of the marker 6 in the X-axis direction and the color for identifying the marker 6 is stored in advance in the memory of the control unit 2. The marker 6 is an example of the “mark” in the present invention.

[AR image position adjustment]
Next, a method for adjusting the position of the AR image will be described. Schematically, the control unit 2 operates the user 10 to align the mirror image of the marker 6 captured by the camera 5 and displayed as an AR image with the mirror image of the marker 6 observed through the half mirror 4. Based on. Thereby, the control unit 2 sets the display position of the AR image suitable for the user 10 wearing the HMD 1.

(1) Processing Overview First, an overview of the AR image position adjustment method will be described with reference to FIGS. 3 to 5.

  FIG. 3 shows a state where the user 10 wearing the HMD 1 faces the mirror 8. In FIG. 3, the direction perpendicular to the XY plane and directed from the HMD 1 toward the mirror 8 is defined as a positive Z-axis direction. As shown in FIG. 3, the user 10 first stands still in a state of facing the mirror 8 so that the mirror 8 and the marker 6 are in a parallel position. In this state, the user 10 views the mirror image of the HMD 1 to which the user 10 and the marker 6 are attached through the half mirror 4. At this time, the distance from the mirror 8 to the marker 6 substantially matches the distance from the mirror 8 to the viewpoint of the user 10 (also referred to as “adjustment target distance Dtag”). That is, the gazing point distance is twice the distance from the viewpoint of the user 10 to the mirror 8. That is, the width indicated by the double arrow 90 in FIG. 3 corresponds to ½ of the adjustment target distance Dtag.

  In the present embodiment, by adjusting the position of the AR image with the user 10 facing the mirror 8, the distance twice the distance between the user 10 and the mirror 8 becomes the adjustment target distance Dtag. Therefore, in this case, even when the display position of the AR image is adjusted indoors or the like, it is possible to suppress the adjustment target distance Dtag from becoming excessively short. Further, by adjusting the position of the AR image, which will be described later, with the user 10 facing the mirror 8, the user 10 can be prevented from moving unintentionally during the position adjustment of the AR image, and the position adjustment of the AR image can be performed with high accuracy. It can be carried out.

  Next, the control unit 2 recognizes the marker 6 from the captured image Ic acquired from the camera 5 in the state shown in FIG. 3, and the width in the X-axis direction of the marker 6 in the captured image Ic (“in-image marker width”). Is also measured.). Then, the control unit 2 calculates the adjustment target distance Dtag with reference to a predetermined map or expression based on the width Wm of the marker 6 and the marker width in the image stored in advance in the memory. The above-described map and expression are determined experimentally or theoretically, for example, and stored in advance in the memory of the control unit 2. The use of the calculated adjustment target distance Dtag will be described in detail in the section “Corresponding to Changes in Focal Length”.

  FIG. 4A shows the captured image Ic generated in the state of FIG. In the captured image Ic of FIG. 4A, for the sake of convenience of explanation, a vertical center line “91V”, a horizontal center line “91H”, and a center point “91C” that is an intersection of these are shown. As shown in FIG. 4A, the captured image Ic mainly includes a display area 8A of the mirror 8, a mirror image display area 1A of the HMD 1, a mirror image display area 6A of the marker 6, and a mirror image of the user 10. Display area 10A. In the captured image Ic, the mirror image display area 1A of the HMD 1 is shifted from the vertical center line 91V of the captured image Ic due to the installation position of the camera 5 and the like.

  Here, the control unit 2 generates an image (also referred to as “trimming image It”) obtained by cutting out the captured image Ic so that the mirror image display area 6A of the marker 6 is located at the center of the image. FIG. 4B shows a trimmed image It cut from the captured image Ic so that the mirror image display area 6A of the marker 6 is located at the center. As shown in FIG. 4B, in the trimmed image It, the center point 92C, which is the intersection of the vertical center line 92V and the horizontal center line 92H, and the center of the mirror image display area 6A overlap. That is, the display area 6A of the mirror image of the marker 6 exists at the center point 92C of the trimmed image It. The trimmed image It is an example of the “adjustment image” in the present invention.

  Next, the control unit 2 displays the trimmed image It as an AR image. FIG. 5A shows the field of view of the user 10 when the trimmed image It shown in FIG. 4B is displayed. As shown in FIG. 5 (a), in the field of view of the user 10, a trimmed image It that is an AR image, a mirror 8 that is observed through the HMD1, a mirror image 1B of the HMD1 in the mirror 8, and a marker 6 Mirror image 6B of the user 10 and a mirror image 10B of the user 10 exist.

  Here, there is a deviation between the display area 6A of the marker 6 in the trimming image It that is an AR image and the mirror image 6B of the marker 6 observed through the HMD 1. Therefore, the control unit 2 matches the display area 6A of the marker 6 in the trimming image It with the position of the mirror image 6B of the marker 6 observed through the HMD 1 based on the operation of the user 10 to the input unit 7. . Here, the user 10 instructs parallel movement of the AR image in the XY plane, rotational movement in the XY plane, and the like. Thereby, the control unit 2 adjusts the position of the light source unit 3 in accordance with the input signal received from the input unit 7, so that the display region 6 </ b> A of the marker 6 in the trimming image It is actually observed. 6 on the mirror image 6B. Here, the control unit 2 draws the trimmed image It in a range smaller than the drawable range Rd. Thereby, the control part 2 can perform easily operation which performs the instruction | indication for superimposing the display area 6A of the marker 6 in the trimming image It on the mirror image 6B of the marker 6. FIG.

  FIG. 5B shows the field of view of the user 10 after the display position of the AR image is adjusted by the user 10 operating the input unit 7. As shown in FIG. 5B, in this case, the display area 6A of the marker 6 in the trimmed image It has moved to a position overlapping the mirror image 6B of the marker 6 that is actually observed. Thereby, the control unit 2 can adjust the display position of the AR image to a position suitable for the user 10.

  Note that the control unit 2 and the user 10 execute the above-described processing for each of the right eye and the left eye of the user 10. As a result, the control unit 2 can display the AR image at a display position suitable for the user 10 regardless of whether the AR image is visually recognized by either one of the left eye or the right eye or both eyes. . This will be described later with reference to the flowchart of FIG.

(2) Flowchart FIG. 6 is an example of a flowchart showing an operation procedure of the user 10 and a processing procedure executed by the control unit 2 in association therewith. In the example illustrated in FIG. 6, the control unit 2 adjusts the position of the HMD for each eye of the user 10.

  First, the user 10 wearing the HMD 1 faces the mirror 8 (step S201). Next, the user 10 performs an operation for instructing the start of the position adjustment of the AR image on the input unit 7 (step S202). Thereby, the control part 2 of HMD1 starts the process after step S101.

  Then, after step S202, the control unit 2 notifies the user 10 that the position adjustment of the AR image is performed for a predetermined one eye (for example, the right eye) (step S101). In this case, the control unit 2 performs voice guidance for closing eyes other than the target eye using, for example, a speaker (not shown). Following this, the user 10 closes the eyes that are not the adjustment target of the display position of the AR image (step S203).

  Next, the control unit 2 acquires a captured image Ic (see FIG. 4A) generated by the camera 5 (step S102). Then, the control unit 2 calculates the adjustment target distance Dtag based on the in-image marker width that is the width of the marker 6 in the captured image Ic (step S103). Specifically, the control unit 2 calculates the adjustment target distance Dtag using a predetermined formula based on the width Wm of the marker 6 stored in advance and the marker width in the image. The use of the calculated adjustment target distance Dtag will be described in detail in the section “Corresponding to Changes in Focal Length”.

  Next, the control unit 2 trims the captured image Ic so that the display area 6A of the marker 6 is at the center (step S104). Thereby, the control part 2 produces | generates the trimming image It (refer FIG.4 (b)). Then, the control unit 2 displays the trimmed image It as an AR image (step S105). As a result, the user 10 visually recognizes the mirror image 6B of the marker 6 through the HMD 1 while viewing the trimmed image It (see FIG. 5A). Then, the control unit 2 preferably provides the user 10 with voice guidance indicating that an operation in step S204 described later should be executed.

  Next, the user 10 operates the input unit 7 so that the display area 6A of the marker 6 of the trimmed image It overlaps the mirror image 6B of the marker 6 (step S204). In this case, the user 10 instructs the control unit 2 to perform parallel movement and rotational movement of the AR image in the XY plane by operating the input unit 7.

  And the control part 2 changes the position of the trimming image It which is AR image by changing the position etc. of the light source unit 3 based on the input signal transmitted from the input part 7 (step S106). As a result, the control unit 2 changes the position of the trimming image It that is the AR image to a position where the display area 6A of the marker 6 in the trimming image It overlaps with the mirror image 6B of the marker 6 that is observed through the HMD1. (See FIG. 5B). In this way, the control unit 2 sets the AR image at a display position suitable for the user 10 who is the wearer, regardless of individual differences for each wearing user, alignment errors of each component of the HMD 1, and the like. Can do. Then, the control unit 2 includes the position information of the AR image after execution of step S106 or the amount of movement of the XY plane adjusted in step S106 together with the information for specifying the adjusted one eye and the adjustment target distance Dtag calculated in step S103. And adjustment information such as rotation angle is stored in the memory.

  Next, the control unit 2 determines whether or not both eyes of the user 10 have been adjusted (step S107). In other words, the control unit 2 determines whether or not the processing from step S102 to step S106 has been performed for each of the right eye and the left eye. And when both eyes of the user 10 are adjusted (step S107: Yes), the control part 2 complete | finishes the process of a flowchart. In this case, similarly, the user 10 ends the operation for adjusting the position of the AR image (step S205). On the other hand, when the position adjustment of the AR image with respect to one eye of the user 10 is not performed (step S107: No), the control unit 2 returns the process to step S101. In this case, the control unit 2 notifies that the AR image position is adjusted for one eye different from the one eye (for example, the right eye) targeted in the previous step S101 (step S101). The process of step S106 is performed again. In this case, the user 10 performs the processes of step S203 and step S204.

  In this way, by adjusting the position of the AR image for both the left eye and the right eye, the control unit 2 can control either the left eye or the right eye or both eyes when viewing the AR image. Even so, the AR image can be displayed at a display position suitable for the user 10.

[Responding to changes in focal length]
Next, the adjustment of the position of the AR image when displaying the AR image superimposed on various display objects will be described.

  Generally, the distance (that is, the focal length) from the display object to the viewpoint of the user 10 differs depending on the display object, and when the above-described distance changes, the appropriate display position of the AR image also changes. This will be described with reference to FIG.

  FIG. 7A shows the display position 81 of the AR image when the distance from the viewpoint to the display object 80 is short, and FIG. 7B shows the distance from the viewpoint to the display object 80 shown in FIG. The display position 82 of the AR image when it is longer than the example of FIG. In FIG. 7, for convenience of explanation, it is assumed that the HMD 1 displays only an AR image corresponding to the right eye.

  As shown in FIG. 7, the direction of the line of sight changes according to the distance from the viewpoint to the display object 80. Specifically, the angle “D1” formed between the line of sight and the HMD1 in FIG. 7A is smaller than the angle “D2” formed between the line of sight and the HMD1 in FIG. Thus, as the distance from the viewpoint to the display object 80 is longer, the control unit 2 needs to move the display position of the AR image in the direction away from the center of the HMD 1 on the X axis.

  Considering the above, when displaying an AR image on an arbitrary display object 80, the control unit 2 recognizes the distance from the viewpoint to the display object 80, and determines the AR image according to the distance. Move the display position. For example, the control unit 2 first refers to the current position information acquired from a GPS receiver (not shown), the map information stored in the memory, and the like from the position of the user 10 based on the position information of the display object 80. The distance to the display object 80 is calculated. Next, the control unit 2 determines the display position of the AR image according to the difference or ratio between the calculated distance and the adjustment target distance Dtag when the AR image position adjustment is performed in FIG. Move from the position set in the process. In this case, the control unit 2 determines the movement amount of the AR image based on the above-described difference or ratio with reference to, for example, a map or formula obtained in advance by experiment or theory.

  Thereby, the control unit 2 can appropriately move the position of the AR image to an appropriate position even when the distance from the viewpoint to the display object 80 changes.

[Modification]
Hereinafter, modified examples suitable for the above-described embodiments will be described. The following modifications may be applied in any combination to the above-described embodiments.

(Modification 1)
The HMD 1 is installed in the vicinity of the left eye of the user 10 in the wearing state and is installed in the vicinity of the right eye of the user 10 in the wearing state and a left-eye camera for adjusting the position of the AR image that is visually recognized by the left eye. You may provide two with the camera for right eyes for adjusting the position of AR image visually recognized by eyes. In this case, when the position of the AR image to be visually recognized by the left eye is adjusted, the HMD 1 generates a captured image Ic by the left-eye camera and performs an AR image position adjustment process, and the AR image to be visually recognized by the right eye. When the position adjustment is performed, the captured image Ic is generated by the right-eye camera and the AR image position adjustment process is performed. Thereby, the HMD 1 can adjust the position of the AR image with higher accuracy.

(Modification 2)
The marker 6 is not limited to a member attached to the HMD 1 and may be a protruding shape formed on the front surface of the HMD 1 or a region colored in a predetermined color. Even in this case, the control unit 2 stores in advance the width in the X-axis direction of the above-described shape or region. Also by this, the control part 2 can calculate the adjustment object distance Dtag suitably.

(Modification 3)
The marker 6 may be formed in a cross shape. Accordingly, the user can easily align the position in the X-axis direction when performing an operation of superimposing the display area 6A of the marker 6 in the trimmed image It on the mirror image 6B of the marker 6 in step S204 of FIG. it can.

  The present invention can be suitably applied to an apparatus that performs AR display.

1 Head mounted display (HMD)
2 Control unit 3 Light source unit 4 Half mirror 5 Camera 6 Marker

Claims (4)

A head-mounted display that allows a user to recognize an image by superimposing an image on a scene observed through a transmissive member,
Display means for displaying an image to be recognized by the user;
Photographing means for photographing a front image of the user wearing the head mounted display;
In the head mounted display, a mark provided on the opposite surface of the surface facing the user,
The portion of the forward side image photographed by the photographing means seen including, said display and generates an adjustment image the landmarks the user is included in the front image when heading to the mirror is located at the center Adjusting means for displaying on the means and receiving adjustment of the display position of the adjustment image;
Head-mounted display, characterized in that Ru comprising a. The head mounted display according to claim 1 , wherein the adjustment unit receives an input for adjusting a display position of the adjustment image by the display unit for each eye of the user. The head-mounted display according to claim 2 , wherein the photographing unit includes a camera positioned in the vicinity of each eye of the user when the head-mounted display is mounted. A display method executed by a head mounted display that superimposes an image on a scene observed through a transmissive member and recognizes the user,
A photographing step of photographing a front image of the user wearing the head mounted display;
Said portion only free captured the forward side image photographed by the process, displaying the user generates an adjustment image the landmarks located in the center included in the front image when heading to the mirror means And an adjustment process for receiving an input for adjusting the display position of the adjustment image,
Have
Before SL indicia, display method in the head-mounted display, characterized in that provided on the opposite face of the user and the surface facing.

Images