JP6095196B2 - Head mounted display, control method therefor, and recording medium storing computer program for controlling head mounted display - Google Patents

Description

  The present invention relates to a head-mounted display that is disposed on a user's head and displays information about an object superimposed on a real image in the user's field of view and a method thereof.

In recent years, augmented reality technology (AR technology) has attracted attention as a technology for superimposing and displaying additional information (hereinafter also referred to as annotation) created by a computer on a real image through a user's field of view. ing.
As such a technology, Tochichi Dot Co., Ltd.'s “Sekai Camera (registered trademark)” captures a real image spreading in front of the user with a smartphone and adds information on the computer to the real image displayed on the display. It can be displayed superimposed as an annotation. At this time, in order to superimpose and display the annotation on the actual video, for example, position information by a GPS or an acceleration sensor provided in the smartphone is used.
See also Patent Documents 1 to 4 disclosing conventional techniques related to the present invention.

Special table 2011-521511 gazette JP 2011-209622 A JP 2012-080236 A JP 2012-118882 A

With the spread of the AR technology, the number of annotations associated with objects has increased rapidly. For this reason, there is a concern about a considerable processing load on the CPU or the like in order to specify an annotation related to an object appearing in an actual video and to display the annotation superimposed on a position where the object is displayed. However, in order to solve this problem, if the number of annotations to be displayed is thinned out randomly, the convenience for the user may be reduced.
In view of such a situation, the present inventor has intensively studied to reduce the processing load in consideration of the user's convenience when displaying the annotation using the AR technology. As a result, information related to the annotation is prepared for each layer, the corresponding layer is selected according to the user's state, and the annotation is displayed based on the selected layer. I came up with a solution.

The present invention has been made in view of the above-mentioned problems, and the first aspect is defined as follows. That is,
A head mounted display that displays information about an object superimposed on a real image in a user's field of view,
A first layer for storing first information relating to an object to be displayed on the display screen of the head mounted display when the user is in the first state; and the display when the user is in the second state. A map database for storing a second layer for storing second information relating to objects to be displayed on the screen;
A user state specifying unit for specifying the state of the user;
A layer selection unit that selects either the first layer or the second layer based on the identified state;
A display control unit that controls display on the display screen based on the selected layer;
A head-mounted display.

  According to the head-mounted display (hereinafter also referred to as HMD) of the first aspect defined as described above, a map that stores information on objects to be displayed on the display screen of the HMD for each layer according to the state of the user. Provide a database. Then, a layer corresponding to the identified user state is selected from the map database, and annotations are superimposed on the object based on the selected layer. According to such an HMD, when displaying an annotation, it is only necessary to read out the corresponding annotation by referring to the corresponding layer according to the identified user state. For this reason, it is possible to reduce the processing load on the annotation display. Moreover, since the said layer is selected based on the specified user's state, a user's convenience is not impaired.

The object refers to an object for providing guidance to the user, and examples thereof include facilities, buildings, and scenic spots.
The annotation is an annotation for the object, and is additional information created by a computer. Such annotations are superimposed and displayed on the object in various forms such as text, icons, and animation. Examples of the annotation include an object name, an advertisement, a feature, and a user post.
Examples of the user state include the height of the user position, the change in the height of the user position, the moving speed of the user, and the elevation angle of the user's line of sight. In addition, as other examples, attribute information such as sex and age, moving purpose, and the like may be used.

Compared with the case where the user is located on the ground surface, the visual field range when the user is located at a high place is wide. For example, from a high place such as a tower, you can overlook scenic spots such as mountains and rivers, but at the same time, stores located on the ground surface are also in sight. In this case, as in the case of displaying annotations for mountains and rivers, displaying the annotations up to the store that has entered the field of view will bother the user.
Therefore, the second aspect of the present invention is defined as follows. That is,
In the head mounted display defined in the first aspect, the first layer stores first information suitable for a first height, and the second layer is a second suitable for a second height. Save information for
The user state specifying unit specifies the height of the user,
The layer selection unit selects a layer corresponding to the specified height.

  In this HMD, an annotation suitable for display can be displayed according to the height of the user. Depending on the height of the user, the purpose of the user at the position may be different. Therefore, it is more convenient for the user if the type of annotation and the number of annotations suitable for the height are taken into consideration. For example, it can be inferred that when the user height is low, commuting or shopping, and when the user height is high, it is sightseeing or the like. In order to reflect this difference in purpose in the layer, in the HMD, for example, in the lower layer as the first layer, the name of the facility or building, the advertisement of the surrounding supermarket, the coupon of the cafe, the sale information of the clothes shop, etc. The information regarding the name of a tourist attraction, the name of a scenic spot such as a mountain or a river, and the like are stored in the high layer as the second layer. By providing a layer according to the height in this way, when displaying the annotation, the corresponding layer is selected with reference to the height of the user, and the annotation is displayed based on the information stored in the layer. Is possible. Since the annotation is displayed with reference to the layer corresponding to the user height, the number of displayed annotations is limited, the processing load is reduced, and the annotation desired by the user can be displayed for convenience.

Even if the height of the user is the same, the annotation that the user wants to display varies depending on the change in the height. In other words, when looking at the outside scene while ascending with an elevator or the like of a high-rise building, and when looking at the outside scene while descending, the objects of interest of the user are different even at the same height. For example, when the user is rising, the interest shifts to a farther or higher object, while when falling, the focus shifts to a closer and more peripheral object.
Therefore, the third aspect of the present invention is defined as follows. That is,
In the head mounted display defined in the second aspect, the user state specifying unit specifies a change in the height of the user,
The layer selection unit selects a layer corresponding to the specified change in height.

Here, the layer selection unit corresponds to a height higher than the layer corresponding to the current height of the user when the user state specifying unit specifies that the height of the user is changing upward. When a layer is selected and it is specified that the height of the user is changing downward, a layer corresponding to a height lower than the layer corresponding to the current height of the user can be selected (fourth). Aspect).
In this HMD, in addition to the height of the user, considering the shift of interest of the user to the object according to the change in the height, an appropriate annotation is displayed in advance based on the shift of interest. Can do.

The fifth aspect of the present invention is defined as follows. That is,
In the head mounted display defined in the first aspect, the first layer stores first information suitable for a first moving speed, and the second layer is a second suitable for a second moving speed. Save information for
The user state specifying unit specifies the moving speed of the user,
The layer selection unit selects a layer corresponding to the specified moving speed.

  In this HMD, an annotation suitable for display can be displayed according to the moving speed of the user. Similar to the height of the user, the user's purpose of movement may differ depending on the user's moving speed. Therefore, it is more convenient for the user if the type of annotation and the number of annotations suitable for the moving speed are taken into consideration. For example, if the number of annotations within a certain range is the same, more annotations are displayed as the moving speed increases, which may be troublesome for the user. Further, the difference in moving speed is an indicator of the user's moving purpose. For example, the purpose of commuting or shopping can be inferred when the moving speed is slow, and the purpose of sightseeing can be inferred when the moving speed is fast. For example, the type of annotation to be displayed can be selected based on the difference in the purpose of movement. It is because it is cumbersome for the user to display the advertisement of the peripheral supermarket for the purpose of travel.

Even if the user's position is the same, the annotation that the user wants to display differs depending on the elevation angle of the user's line of sight. That is, when the user's line of sight is an elevation angle, a farther or higher object is of interest, while when the line of sight is a depression angle, closer and more peripheral objects are of interest. Become.
The sixth aspect of the present invention is defined as follows. That is,
In the head mounted display specified in any one of the second to fifth aspects, the user state specifying unit specifies an elevation angle of the user's line of sight,
The layer selection unit selects the layer based on the specified elevation angle.
In this HMD, it is possible to display an annotation of an object of interest of the user in consideration of the elevation angle of the user's line of sight.

The seventh aspect of the present invention is defined as follows. That is,
A method for controlling a head mounted display that displays information about an object superimposed on a real image in a user's field of view,
A first layer for storing first information relating to an object to be displayed on the display screen of the head mounted display when the user is in the first state; and the display when the user is in the second state. A storage step of storing in a map database a second layer for storing second information relating to an object to be displayed on the screen;
A user state specifying step in which a user state specifying unit specifies the state of the user;
A layer selection step in which a layer selection unit selects either the first layer or the second layer based on the specified state;
A display control step for controlling display on the display screen based on the selected layer; and
A control method comprising:
According to the seventh aspect of the invention thus defined, the same effect as the first aspect can be obtained.

The eighth aspect of the present invention is defined as follows. That is,
In the control method defined in the seventh aspect, the first layer stores first information suitable for a first height, and the second layer includes a second information suitable for a second height. Save information,
In the user state specifying step, the height of the user is specified,
In the layer selection step, a layer corresponding to the specified height is selected.
According to the invention of the eighth aspect defined as described above, the same effect as that of the second aspect can be obtained.

The ninth aspect of the present invention is defined as follows. That is,
In the control method defined in the eighth aspect, in the user state specifying step, a change in the height of the user is specified,
In the layer selection step, a layer corresponding to the specified change in height is selected.
According to the ninth aspect of the invention thus defined, the same effect as the third aspect can be obtained.

The tenth aspect of the present invention is defined as follows. That is,
In the control method defined in the ninth aspect, in the layer selection step, when the user state specifying step specifies that the height of the user is changing upward, it corresponds to the current height of the user. When a layer corresponding to a height higher than the layer is selected and it is specified that the height of the user is changing downward, a layer corresponding to a height lower than the layer corresponding to the current height of the user is selected. select.
According to the tenth aspect of the invention thus defined, the same effects as in the fourth aspect can be achieved.

The eleventh aspect of the present invention is defined as follows. That is,
In the method defined in the seventh aspect, the first layer stores first information suitable for a first moving speed, and the second layer stores second information suitable for a second moving speed. Save the
In the user state specifying step, the moving speed of the user is specified,
In the layer selection step, a layer corresponding to the specified moving speed is selected.
According to the eleventh aspect of the invention thus defined, the same effects as in the fifth aspect can be achieved.

The twelfth aspect of the present invention is defined as follows. That is,
In the method defined in any one of the eighth to eleventh aspects, in the user state specifying step, an elevation angle of the user's line of sight is specified,
In the layer selection step, the layer is selected based on the specified elevation angle.
According to the twelfth aspect of the invention thus defined, the same effects as in the sixth aspect are achieved.

Furthermore, the thirteenth aspect of the present invention is defined as follows. That is,
A computer program for controlling a head mounted display that displays information about an object superimposed on a real image in a user's field of view,
A first layer for storing first information relating to an object to be displayed on the display screen of the head mounted display when the user is in the first state; and the display when the user is in the second state. Storage means for storing in a map database a second layer for storing second information relating to an object to be displayed on the screen;
User status specifying means for specifying the status of the user;
Layer selecting means for selecting either the first layer or the second layer based on the specified state;
Display control means for controlling display on the display screen based on the selected layer;
As a computer program.
According to the thirteenth aspect of the invention thus defined, the same effects as those of the first aspect can be achieved.

The fourteenth aspect of the present invention is defined as follows. That is,
In the computer program defined in the thirteenth aspect, the first layer stores first information suitable for a first height, and the second layer is a second suitable for a second height. Save information,
The user state specifying means specifies the height of the user,
The layer selection unit selects a layer corresponding to the specified height.
According to the fourteenth aspect of the invention thus defined, the same effects as those of the second aspect can be achieved.

The fifteenth aspect of the present invention is defined as follows. That is,
In the computer program defined in the fourteenth aspect, the user state specifying unit specifies a change in the height of the user,
The layer selecting unit selects a layer according to the specified change in height.
According to the fifteenth aspect of the invention thus defined, the same effects as those of the third aspect are achieved.

The sixteenth aspect of the present invention is defined as follows. That is,
In the computer program defined in the fifteenth aspect, the layer selecting means corresponds to the current height of the user when the user state specifying means specifies that the height of the user is changing upward. When a layer corresponding to a height higher than the layer is selected and it is specified that the height of the user is changing downward, a layer corresponding to a height lower than the layer corresponding to the current height of the user is selected. select.
According to the sixteenth aspect of the invention thus defined, the same effects as in the fourth aspect can be achieved.

The seventeenth aspect of the present invention is defined as follows. That is,
In the computer program defined in the thirteenth aspect, the first layer stores first information suitable for a first moving speed, and the second layer is a second suitable for a second moving speed. Save information,
The user state specifying means specifies the moving speed of the user,
The layer selection unit selects a layer corresponding to the specified moving speed.
According to the seventeenth aspect of the invention thus defined, the same effects as those of the fifth aspect are achieved.

The eighteenth aspect of the present invention is defined as follows. That is,
In the computer program defined in any one of the fourteenth to seventeenth aspects, the user state specifying means specifies an elevation angle of the user's line of sight,
The layer selection means selects the layer based on the specified elevation angle.
According to the eighteenth aspect of the invention thus defined, the same effects as in the sixth aspect are achieved.

  A recording medium for recording a computer program defined in any of the thirteenth to eighteenth aspects is defined as a nineteenth aspect.

FIG. 1 is a block diagram showing the configuration of the HMD 1 according to the embodiment of the present invention. FIG. 2 is a schematic diagram for explaining layers stored in the map database 3. FIG. 3 is a flowchart illustrating an example of the operation of the HMD 1 according to the embodiment of this invention. FIG. 4 is a block diagram showing the configuration of the HMD 21 according to another embodiment of the present invention. FIG. 5 is a block diagram showing the configuration of the HMD 41 according to the embodiment of the present invention. FIG. 6 is a block diagram showing the configuration of the HMD 51 according to another embodiment of the present invention.

A head mounted display according to an embodiment of the present invention will be described.
FIG. 1 shows a schematic configuration of the HMD 1.
As shown in FIG. 1, the HMD 1 includes a map database 3, a user height specifying unit 5, a user position specifying unit 7, a user orientation specifying unit 9, a layer selecting unit 11, and a display control unit 13.

  The map database 3 includes a first layer for storing first information about an object to be displayed on the display screen of the HMD when the user is at the first height, and when the user is at the second height. A second layer for storing second information relating to an object to be displayed on the display screen; and storing third information relating to an object to be displayed on the display screen when the user is at a third height. A third layer is stored. In this example, the layer is provided with the first to third layers uniformly throughout the country, but is not limited thereto, and may be appropriately provided with each layer for each region and each mesh. Information about the object is superimposed and displayed on the object as an annotation of the object. Further, the number of layers to be stored is not particularly limited.

  FIG. 2 is a diagram schematically showing the first to third layers. The first layer is a lower layer associated with the first height. In the lower layer, information related to an object that is desired to be displayed when the user is located in a low place is stored in association with the position information (see “X” in the figure). Examples of information related to the object include supermarket advertisements, cafe coupons, tourist attractions, and the like. The second layer is a middle layer associated with the second height. In the middle layer, information related to an object desired to be displayed when the user is located at a certain height is stored in association with the position information (see “Δ” in the figure). Examples of information related to the object include names such as tourist attractions and scenic spots, and explanatory comments regarding the famous spots and scenic spots. For example, when the object is a mountain “Mt. Fuji”, information indicating that it is an altitude or a world cultural heritage may be stored together with the name. In accordance with the famousness of the tourist attraction or scenic spot, information on the object with higher visibility can be stored in the higher layer as the third layer (see “●” in the figure). Object layering can be done manually for each object, or automatically based on the genre of the object. In this example, the first height can be “10 m”, the second height can be “50 m”, and the third height can be “300 m”. The height may have an equal width of “100 to 300 m”.

The user height specifying unit 5 specifies the height information of the HMD 1. The user height specifying unit 5 can specify the user height based on height information obtained by the GPS device provided in the HMD 1, for example.
The user position specifying unit 7 specifies position information of the HMD 1. For example, the user position specifying unit 7 can specify the user position based on the position information obtained by the GPS device, similarly to the user height.
The user orientation specifying unit 9 specifies orientation information of the HMD 1. The said user azimuth | direction is the information (azimuth | direction information) of the azimuth | direction where the eyes | visual_axis of the user who wears HMD1 has faced. The user orientation specifying unit 9 can specify a user orientation based on the detected geomagnetism, for example, when the HMD 1 includes a magnetic sensor that detects geomagnetism.

The layer selecting unit 11 selects one of the layers stored in the map database 3 based on the user height specified by the user height specifying unit 5. As the selection method, for example, it is possible to select a layer that is equivalent to or closest to the specified user height.
The display control unit 13 identifies an object appearing in the field of view of the user wearing the HMD 1 based on the user position and user orientation, and refers to the selected layer at a position that matches the object in the field of view. The information about the obtained object is superimposed and displayed as an annotation.

An example of the operation of the HMD 1 shown in FIG. 1 will be described with reference to FIG.
In step 1, the user position specifying unit 7 and the user height specifying unit 9 specify the current position and height of the user wearing the HMD 1 based on a GPS device or the like provided in the HMD 1.
In step 3, the user orientation specifying unit 9 specifies the orientation in which the user's line of sight is directed in step 1 based on a magnetic sensor or the like provided in the HMD 1.
In step 5, the layer selection unit 11 selects a layer associated with the height corresponding to the height based on the height of the user specified in step 1. For example, when the height of the user specified in step 1 is 70 m, the middle layer is selected from the layers stored in the map database 3. This is because the height “50 m” associated with the middle layer is closest to the height of the user.

In step 7, the display control unit 13 specifies an object appearing in the field of view of the HMD user based on the current position and height of the user specified in step 1 and the direction in which the user's line of sight specified in step 3 is facing. To do. For example, it is assumed that Mt. Fuji is specified as the object.
In step 9, the display control unit 13 reads information related to the object specified in step 7 from the layer selected in step 5. For example, information related to the object “Mt. Fuji” is read from the selected middle layer.
In step 11, the display control unit 13 superimposes and displays the information read in step 9 as an annotation of the object specified in step 7 at a position that matches the position of the object. For example, the name of “Mt. Fuji” read in step 9 is displayed in a superimposed manner on Mt. Fuji in the user's field of view in a display form such as a balloon.

An HMD 21 according to another embodiment is shown with reference to FIG. 4, the same elements as those in FIG. 1 are denoted by the same reference numerals, and the description thereof is partially omitted.
FIG. 4 shows an HMD 21 that can display an annotation suitable for display in consideration of the change in the height in addition to the height of the user. That is, the HMD 21 further includes a user height change specifying unit 23 in the HMD 1 illustrated in FIG. 1, and includes a layer selection unit 25 instead of the layer selection unit 11.

The user height change specifying unit 23 specifies the height change of the user. As a method for specifying the height change, it is possible to specify an ascent or a descent based on a change in the height position within a predetermined time with reference to the specification result of the user height specifying unit 5. For example, when the user height changes upward or downward by 1 m / second or more, it can be specified that the user height is rising or falling.
In the HMD 21, the layer selection unit 25 selects any layer from the map database 3 based on the user height specifying unit 5 and the user height change specifying unit 23. That is, when the user height change specifying unit 23 specifies that the height of the user is changing upward, a layer corresponding to a height higher than the layer corresponding to the current height of the user is selected, If it is determined that the height of the user is changing downward, a layer corresponding to a height lower than the layer corresponding to the current height of the user is selected. For example, when it is specified that the specified user height is 70 m and is increasing, a higher layer that is a layer above the middle layer corresponding to the user height is selected. Become.

FIG. 5 shows an HMD 41 of the embodiment. In FIG. 5, the same elements as those in FIGS. 1 and 4 are denoted by the same reference numerals, and description thereof is partially omitted.
FIG. 5 shows an HMD 41 capable of displaying an annotation suitable for display in consideration of the elevation angle of the user's line of sight. That is, the HMD 41 further includes a control unit 141, a memory unit 142, an input unit 143, an output unit 144, an interface unit 145, a user line-of-sight angle specifying unit 146, and a layer selecting unit 147 in the HMD 1 shown in FIG.

The control unit 141 is a computer device including a CPU, a buffer memory, and other devices, and controls other elements constituting the HMD 41. The control unit 141 includes a display control unit 13.
The display control unit 13 controls the annotation to be superimposed on the display screen based on the layer selected by the layer selection unit 11 among the information about the object stored in the map database 3.
A computer program is stored in the memory unit 142, and this computer program is read into the control unit 141, which is a computer device, and causes it to function. This computer program can be stored in a general-purpose medium such as a built-in hard disk or built-in memory as a storage device of the HMD, or a storage medium replaceable with the HMD.

The input unit 143 is used for inputting a user command, for example. As the input unit 143, a voice input device such as a button, a touch sensor, or a microphone provided in the HMD main body can be used.
The output unit 144 includes a display screen, and displays an input screen, annotations based on the control of the display control unit 13, and other information. The output unit 144 can also include a voice transmission unit.
The interface unit 145 connects the HMD 41 to a wireless network or the like.

The user line-of-sight angle specifying unit 146 specifies the elevation angle of the line of sight of the HMD user using an acceleration sensor or the like provided in the HMD 41.
The layer selection unit 147 selects one of the layers from the map database 3 based on the user height specifying unit 5 and the user gaze angle specifying unit 146. That is, when the user's line-of-sight angle specifying unit 146 specifies that the user's line of sight is an elevation angle, a layer corresponding to a height higher than the layer corresponding to the user's current height is selected, and the user's line of sight is If the depression angle is specified, a layer corresponding to a height lower than the layer corresponding to the current height of the user is selected. The layer selection unit 147 may select a layer corresponding to a higher height in accordance with the elevation angle of the user's line of sight.
It is good also as a display control system which makes a part of component of the said HMD41 executable by a server apparatus. Although the structure which can be performed with the said server apparatus is not specifically limited, For example, it can be set as the map database 3 and the layer selection part 11. FIG.

FIG. 6 shows an HMD 51 according to another embodiment. In FIG. 6, the same elements as those in FIGS. 1, 4, and 5 are denoted by the same reference numerals, and description thereof is partially omitted.
FIG. 6 shows an HMD 51 that can display an annotation suitable for display in consideration of the moving speed of the user. That is, in the HMD 1 shown in FIG. 1, the HMD 51 replaces the map database 3, the user height specifying unit 5, the layer selecting unit 11, and the display control unit 13 with a map database 53, a user moving speed specifying unit 55, and a layer, respectively. A selection unit 57 and a display control unit 59 are provided.

  In the map database 53, each layer for storing information related to an object to be displayed on the display screen of the HMD is stored according to the moving speed of the user. For example, “less than 50 km / hour—first layer”, “50 to 200 km / hour—second layer”, “200 km / hour or more—third layer”, and the like are provided. Are arbitrarily linked. For example, the first layer corresponding to a slow moving speed has facilities, stores, buildings, etc., the second layer has a station, buildings, scenic spots, etc. The third layer corresponding to a fast moving speed has a station , Information related to scenic spots and the like is associated with the position information. Some of the objects stored in each layer may be the same. Also, object layering can be performed based on the importance of the object. That is, objects with higher importance are carefully selected and sorted in a layer having a high moving speed. In the case of the object “station”, for example, the station where the Shinkansen Nozomi and Shinkansen trains stop is regarded as the station with high importance, and the station where the Shinkansen Kodama and ordinary trains stop is regarded as a station with low importance. To do. In the case of the object “scenic spot”, for example, an object with a high degree of importance such as Mt. In the above example, the station “Nagoya” and the scenic spot “Mt. Fuji” are sorted in the third layer, and the station “Shin Fuji” and the scenic spot “Hachimanyama” are sorted in the second layer.

The user moving speed specifying unit 55 specifies the moving speed of the user. The movement speed can be specified based on, for example, acceleration information from an acceleration sensor provided in the HMD 1.
Similar to the layer selection unit 11 and the display control unit 13, the layer selection unit 57 and the display control unit 59 select, from the map database 53, a layer associated with the movement speed corresponding to the identified user movement speed. The annotation related to the object stored in the selected layer is superimposed and displayed so as to match the position of the object in the field of view.

  Although the embodiments and examples of the present invention have been described above, two or more of the embodiments (examples) may be combined and implemented. Alternatively, one of these embodiments (examples) may be partially implemented. Furthermore, among these, two or more embodiments (examples) may be partially combined.

  The present invention is not limited to the description of the embodiments and examples of the invention described above. Various modifications may be included in the present invention as long as those skilled in the art can easily conceive without departing from the description of the scope of claims.

1 21 41 51 Head Mount Display (HMD)
3 53 Map database (Map DB)
5 User height specifying unit 7 User position specifying unit 9 User orientation specifying unit 11 25 147 57 Layer selecting unit 13 59 Display control unit 23 User height change specifying unit 146 User line of sight angle specifying unit 55 User moving speed specifying unit

Claims (7)

A head mounted display that displays information about an object superimposed on a real image in a user's field of view,
The first information about the object to be displayed on the display screen of the head mounted display when the user is at the first height, the first information storing the first information suitable for the first height. A second layer that stores second information relating to an object to be displayed on the display screen when the user is at a second height, the second information being suitable for the second height. A map database that stores layers of
A user state specifying unit for specifying a change in the height of the user;
A layer selection unit that selects either the first layer or the second layer according to the change in the specified height;
A display control unit that controls display on the display screen based on the selected layer;
Head mounted display. The layer selection unit selects a layer corresponding to a height higher than a layer corresponding to the current height of the user when the user state specifying unit specifies that the height of the user is changing upward. When the height of the user is changed downward, the layer corresponding to the lower height than the layer corresponding to the current height of the user is selected.
The head mounted display according to claim 1 . A method for controlling a head mounted display that displays information about an object superimposed on a real image in a user's field of view,
The first information about the object to be displayed on the display screen of the head mounted display when the user is at the first height, the first information storing the first information suitable for the first height. A second layer that stores second information relating to an object to be displayed on the display screen when the user is at a second height, the second information being suitable for the second height. A step of saving the layers of the image in the map database;
A user state specifying step in which a user state specifying unit specifies a change in the height of the user;
A layer selection step in which a layer selection unit selects either the first layer or the second layer according to the specified height change;
A display control step for controlling display on the display screen based on the selected layer; and
A control method comprising: In the layer selection step, when the user state specifying step specifies that the height of the user is changing upward, a layer corresponding to a height higher than the layer corresponding to the current height of the user is selected. When the height of the user is changed downward, the layer corresponding to the lower height than the layer corresponding to the current height of the user is selected.
The control method according to claim 3 . A computer program for controlling a head mounted display that displays information about an object superimposed on a real image in a user's field of view,
The first information about the object to be displayed on the display screen of the head mounted display when the user is at the first height, the first information storing the first information suitable for the first height. A second layer that stores second information relating to an object to be displayed on the display screen when the user is at a second height, the second information being suitable for the second height. A storage means for storing the layers in the map database;
User status specifying means for specifying a change in the height of the user;
Layer selection means for selecting either the first layer or the second layer according to the change in the specified height;
Display control means for controlling display on the display screen based on the selected layer;
As a computer program. The layer selection means selects a layer corresponding to a height higher than the layer corresponding to the current height of the user when the user status specifying means specifies that the height of the user is changing upward. When the height of the user is changed downward, the layer corresponding to the lower height than the layer corresponding to the current height of the user is selected.
The computer program according to claim 5 . A recording medium for recording the computer program according to claim 5 .

Images