JP2022164170A - Display device, display method, and display program thereof - Google Patents

Abstract

To provide a display device that suppresses the possibility of not being able to visually recognize video due to a display deviation in a display device worn by a user within a predetermined space.SOLUTION: A display device worn by a user includes: a display unit that displays an image; a positional information acquisition unit that acquires a position of its own device; a display control unit that causes the display unit to display a predetermined virtual image so as to be superimposed on a wall surface of a predetermined space; a determination unit that determines whether its own device is located outside a virtual reference line provided inside the virtual image displayed on the wall surface, in the predetermined space; and a correction unit that corrects a display position of the predetermined virtual image when the determination unit determines that the own device is located outside the virtual reference line.SELECTED DRAWING: Figure 8

Description

The present invention relates to a display device that displays an image according to the user's position.

2. Description of the Related Art Conventionally, there are amusement parks equipped with three-dimensional mazes, haunted houses, and the like as various amusement facilities, which are enjoyed by many users.

Patent Literature 1 discloses an invention relating to electronic equipment that can be used in such amusement facilities.

JP 2016-048301 A

By the way, as in Patent Literature 1, it is conceivable that a user wears a wearable terminal and provides entertainment by images displayed through the wearable terminal. In recent years, entertainment such as AR and MR is provided by combining reality and virtual images. In such entertainment, it is conceivable to provide images according to the user's position, but it is not always possible to obtain correct position information, and images are provided in a manner not intended by the entertainment provider. It was possible.

SUMMARY OF THE INVENTION Accordingly, the present invention has been made in view of the above demands, and an object of the present invention is to provide a display device that allows a user to visually recognize a video or image that the user wants to view.

In order to solve the above problems, a display device according to an aspect of the present invention is a display device worn by a user, comprising: a display unit that displays an image; a position information acquisition unit that acquires the position of the own device; A display control unit that causes a display unit to display a predetermined virtual image so as to be superimposed on a wall surface of a predetermined space, and a virtual reference that is provided inside the virtual image displayed on the wall surface in the predetermined space. a determination unit for determining whether or not the device is positioned outside the line, and correcting the display position of the predetermined virtual image when the determination unit determines that the device is positioned outside the virtual reference line. and a correction unit.

In order to solve the above problems, a virtual image display method according to an aspect of the present invention includes a position information acquisition step in which a computer of a display device that is worn by a user and has a display unit that displays an image acquires the position of the device itself. a display control step of superimposing a predetermined virtual image on a wall surface of a predetermined space and displaying it on a display unit; and a virtual image provided inside the virtual image displayed on the wall surface in the predetermined space. a determination step of determining whether or not the device is positioned outside the reference line; and correction of the display position of a predetermined virtual image when the device is determined to be positioned outside the virtual reference line in the determination step. and a correction step.

In order to solve the above problems, a virtual image display program according to an aspect of the present invention provides a computer of a display device that is worn by a user and has a display unit that displays an image. a display control function for superimposing a predetermined virtual image on the wall surface of a predetermined space and displaying it on the display unit; and a virtual image provided inside the virtual image displayed on the wall surface in the predetermined space. A determination function that determines whether or not the device is positioned outside the reference line, and correction of the display position of a predetermined virtual image when the determination function determines that the device is positioned outside the virtual reference line. and a correction function.

In the above display device, the correction unit, when the determination unit determines that the device is positioned outside the virtual reference line, is configured to display a virtual image to be displayed on a wall surface of the predetermined space relatively close to the display device. The display position of the image may be corrected so as to move away from the own device.

In the above display device, the correction unit, when the determination unit determines that the device is positioned outside the virtual reference line, is configured to display a virtual image to be displayed on a wall surface of the predetermined space relatively close to the display device. The display position of the image may be corrected by changing it to a position farther from the device by a predetermined distance.

In the above-described display device, the display device includes an imaging unit that captures an image of the user's viewing direction, and the display control unit controls a predetermined virtual image within a range included in the predetermined space captured by the imaging unit. may be displayed on the display unit.

In the display device, an object used for adjusting the display position of the virtual image is arranged at a predetermined position in the predetermined space, and the display device is a captured image captured by the imaging unit, An adjustment unit may be provided for adjusting the display position of the virtual image using the captured image including the object.

In the above display device, an object used for adjusting the display position of the virtual image is placed at a predetermined position in a predetermined space, and the display control unit displays the predetermined image for determining the positional relationship with the object. An input unit for displaying on the display unit and displaying on the display unit a message instructing the positional relationship between the object and the predetermined image, and for receiving an input indicating that the object and the predetermined image are in the positional relationship. and an adjustment unit for adjusting the display position of the virtual image based on the position of the object when there is an input from the input unit.

In the display device described above, the virtual reference line may be provided in a rectangular shape within the predetermined space.

In the display device according to one aspect of the present invention, an image to be displayed is displayed within a wall surface in a predetermined space on the display device, and as a result, it may become difficult for the user to visually recognize the image to be provided. However, by detecting that the virtual image is shifted from the position where it should be displayed by the virtual reference line and correcting the display position of the image, it is possible to ensure that the user can visually recognize the video.

1 is a perspective view showing an outline of a system; FIG. It is a top view which shows the example of a composition of a tunnel. FIG. 10 is a plan view showing an example of positions of textures displaying an AR image; (a) is a diagram showing a display example without an AR image. (b) It is a figure which shows the example of a certain display of an AR image. FIG. 11 is a plan view of a tunnel showing that the AR image is shifted; FIG. 4 is a diagram showing an example of a virtual reference line; FIG. 10 is a diagram showing an example of correction of the display position of an AR image; It is a block diagram which shows the structural example of an information processing apparatus. 4 is a flowchart showing an operation example of the information processing device; FIG. 10 is a diagram showing another example of a virtual reference line; FIG. 4 is a diagram showing an example of checkpoints in a tunnel; FIG. 4 is a diagram showing an example of calibration at checkpoints; FIG. 10 is a diagram showing another correction example of the display position of the AR image; FIG. 10 is a diagram showing another correction example of the display position of the AR image;

A display device according to an embodiment of the present invention will be described in detail below with reference to the drawings.

<Embodiment>
<Configuration>
FIG. 1 is a schematic perspective view for explaining a situation in which a display device 100 according to an embodiment is used.

FIG. 1 is a perspective view showing an example of how a user 10 wears a display device 100 and searches a predetermined space, for example, a tunnel in a mine or a cave 20 including a natural cave. Moreover, FIG. 2 is an example of the top view of the cave 20 shown in FIG.

The user 10 wears the display device 100 and moves in the cave 20 as indicated by the arrow 21 in FIG. Here, the display device 100 is a device capable of displaying an image in which a virtual image is superimposed on the inside of the cave 20, and is realized by, for example, a head-mounted display, wearable glasses, or the like. you can The display device 100 may be an entertainment device for providing attractions when exploring the cave 20 .

The display device 100 may display various AR images superimposed on the wall surface of the cave 20 . The display device 100 can provide the user 10 with a more natural image by displaying the AR image in such a manner as to be superimposed on the wall surface of the cave 20 . In this embodiment, the image to be displayed is described as an AR (Augmented Reality) image, but it may be a VR (Virtual Reality) image, an MR (Mixed Reality) image, or It may be an SR (Substitutional Reality) image.

FIG. 3 is an example of a plan view of the cave 20 schematically showing the relationship between the AR image and the walls of the cave 20. As shown in FIG. In FIG. 3 , reference numeral 32 indicates the wall surface of the cave 20 , and reference numeral 31 indicates the display position of the AR image texture superimposed on the wall surface of the cave 20 . As shown in FIG. 3, the AR image 31 is desirably displayed so as to be substantially superimposed on the wall surface 32 .

4(a) and 4(b) are diagrams showing display examples inside the cave 20 through the display device 100, and FIG. FIG. 4B is a diagram showing the inside of the cave 20 with the AR image displayed.

FIG. 4(a) may be the inside of the cave 20 as seen by the user 10 through the lens of the display device 100, or the image inside the cave 20 captured by the display device 100. Alternatively, a virtual image inside the cave 20 generated by the display device 100 may be displayed.

FIG. 4(b) shows an example of displaying an AR image on the contents of the cave 20 displayed on the display unit of the display device 100. FIG. The example shown in FIG. 4B shows an example in which an AR image showing trees and flowers and an AR image showing ores and crystals are displayed on the wall surface 32 of the cave 20 . Moreover, the AR image is not limited to being displayed so as to be superimposed on the wall surface 32, and is displayed at a predetermined location in the cave 20 or at a location having a predetermined relative positional relationship with respect to the user 10. It may be a character generated by the provider of the attraction.

By the way, the display device 100 appropriately displays an AR image according to the position of the user 10 and thus the device itself within the cave 20 . In other words, the user 10 can freely move around in the cave 20, and at that time, the AR image displayed on the wall of the cave 20 or the like is displayed without deviating from the wall according to the location of the user 10. Entertainment highly desirable. However, in order to realize this control, the display device 100 needs to acquire accurate positional information of the display device 100 inside the cave 20 . As an example of acquiring position information, GNSS including GPS may be used, but due to the convenience of using signals from satellites, there is a possibility that accurate measurement cannot be performed inside the cave 20. .

Therefore, the display position of the AR image 31 on the display device 100, which should be displayed in the state shown in FIG. may be controlled. In this case, since the AR image 31 is displayed so as to be buried in the wall surface 32 of the cave 20, the information that should be confirmed by the user 10 cannot be confirmed as entertainment, and the creator side cannot confirm the information. A problem arises in that the quality of the entertainment that is played is degraded.

Therefore, the display device 100 according to the present embodiment sets a virtual reference line 61 inside the cave 20 as shown in FIG. The virtual reference line 61 is a virtual boundary line set inside the wall surface 32 of the cave 20, and when the position of the display device 100 (user 10) exceeds this virtual reference line 61, the display It is a boundary line for triggering the device 100 to correct the display position of the AR image. The position of the virtual reference line 61 is stored in the storage unit 140 in association with the AR image 31 to be displayed so as to be superimposed on the wall surface 32 of the cave 20 . Therefore, when the display position of the AR image 31 deviates from the desired display position, the virtual reference line 61 also deviates. Inside the cave 20, the range in which the user 10 can act is often predetermined. Under such circumstances, when the display device 100 moves over the virtual reference line 61 and moves toward the wall surface 32 as shown in FIG. become more sexual. Therefore, the display device 100 according to the present embodiment corrects the display position of the AR image 31 as shown in FIG. Specifically, the AR image 31 on the side corresponding to the virtual reference line 61 crossed by the user 10 (display device 100), that is, the AR image 31 relatively closer to the user 10 is moved away from the user. The display position of the AR image 31 is corrected. In other words, the display position of the AR image 31 corresponding to the wall surface farther from the user 10 is closer to the user. That is, the display device 100 shifts the display position of the AR image 31 toward the user 10 , that is, as indicated by the arrow 70 . The display device 100 shifts the display position to the user 10 side regardless of whether the AR image 31 is displayed accurately or not. This is because there is a possibility that it will be negative as entertainment.

As another correction example, the display position of the AR image 31 may be corrected as shown in FIG. 13 or FIG.

The example of FIG. 13 shows an example in which the AR image 31 is displaced downward (downward and southward in FIG. 13) from the wall surface 32 that should be displayed. Then, as shown in FIG. 13, the user 10 (display device 100) may cross the lowered virtual reference line 61 . In such a case, the display position of the AR image 31 is corrected as indicated by an arrow 71 in FIG. That is, the display position is corrected so that the AR image 31 that is relatively closer to the user 10 (display device 100 ) is moved away from the user 10 . Inevitably, the display position of the AR image 31 that is relatively far from the user 10 (display device 100 ) is corrected so as to approach the user 10 .

The example shown in FIG. 14 shows an example in which the display position of the AR image 31 is shifted in the upper left direction of the paper surface. Then, as shown in FIG. 14, the user 10 (display device 100) may cross the virtual reference line 61 on the lower side. In such a case, the display position of the AR image 31 is corrected as indicated by an arrow 72 in FIG. That is, the display position is corrected so that the AR image 31 that is relatively closer to the user 10 (display device 100 ) is moved away from the user 10 .

The direction of correcting the display position of the AR image 31 in FIGS. And the direction specified from the position information acquired before that, that is, the direction from the position information acquired last time (may include the one before last and the one before that) to the position information acquired this time is displayed in the AR image. 31 may be shifted.

Although the virtual reference line 61 is basically not displayed and the user 10 cannot confirm its position, it may be configured so that it can be displayed. Moreover, it is desirable that the range of action of the user 10 is only inside the virtual reference line 61 in the state shown in FIG.

The display device 100 will be described in detail below.

<Configuration>
FIG. 8 is a block diagram showing a configuration example of the display device 100. As shown in FIG. As shown in FIG. 8 , display device 100 includes display unit 110 , position information acquisition unit 120 , imaging unit 130 , storage unit 140 , control unit 150 , and input unit 170 . Each unit of the display device 100 may be communicably connected to each other via the bus 160 . Here, an example in which the display device 100 includes the imaging unit 130 will be described, but the imaging unit 130 is not an essential component.

The display device 100 is a device worn by the user 10 to display and provide an image, and is realized by, for example, a head-mounted display or wearable glasses.

Display unit 110 is a monitor having a function of displaying an image designated by control unit 150 . The display unit 110 may be realized by a transmissive screen when the display device 100 is wearable glasses. In other words, the display unit 110 may function as a lens as eyeglasses. As an example, the display unit 110 is superimposed on the wall surface 32 of the cave 20 in the cave 20, or at a specified location in the cave 20, or at a predetermined distance and direction as viewed from the user 10. An AR image specified by the control unit 150 is displayed.

The position information acquisition unit 120 acquires position information indicating the position of the display device 100 in the cave 20 . The position information acquisition unit 120 may acquire absolute coordinates of the display device 100 in the cave 20 as position information, or may acquire position information by relative coordinates with respect to the cave 20 . For example, the position information acquisition unit 120 may acquire the position information of the display device 100 using a positioning system using GNSS including GPS. Further, for example, the position information acquisition unit 120 may use a camera or an infrared sensor attached to the display device 100 to scan the surrounding environment and identify the position and orientation using an inside-out method, or a camera installed on the ceiling or wall of the room. The position may be specified using an outside-in method that acquires the position and orientation of the marker or the display device 100 using an infrared irradiation device. In addition to infrared rays, for example, position tracking using an RF (Radio Frequency)-based communication system using a UWB (Ultra Wide Band) band may be used. Alternatively, the position information acquisition unit 120 may receive a beacon emitted from a beacon generator installed in the cave 20 and acquire the position of the beacon generator included in the beacon as the position information of the display device. The position information acquisition unit 120 transmits the acquired position information to the control unit 150 . In addition, the position information acquisition unit 120 may include a 6-axis sensor (3-axis orientation and acceleration), acquires information on the orientation and height of the display device 100 as well as the position of the display device 100, and uses the position information as the position information. It may be transmitted to the control unit 150 while being included.

The imaging unit 130 is a camera capable of imaging the front direction of the display device 100 . The imaging unit 130 may be a depth camera, and may be capable of acquiring the distance to the imaging target, thereby measuring the distance from the display device 100 to the imaging target (for example, the wall surface 32). can be anything. The imaging unit 130 transmits a video (image) obtained by imaging to the control unit 150 .

The storage unit 140 is a storage medium having a function of storing various programs and data required for the display device 100 to operate. The storage unit 140 can be implemented by, for example, a HDD (Hard Disc Drive), SSD (Solid State Drive), flash memory, or the like. The storage unit 140 stores information regarding AR images to be displayed inside the cave 20 . The storage unit 140 also stores information indicating the position of the virtual reference line 61 .

The control unit 150 is a processor having a function of executing various programs stored in the storage unit 140 and controlling each unit of the display device 100 . The control unit 150 realizes functions as a display control unit 151, a determination unit 152, a correction unit 153, and an adjustment unit 154 by executing each program.

The display control unit 151 causes the display unit 110 to display a virtual image such that the predetermined virtual image is superimposed on a predetermined space within a range visible through the display unit 110 (lens), that is, the wall surface of the cave 20. . In addition, the display control unit 151 superimposes a predetermined virtual image (AR image 31) on a predetermined space included in the captured image captured by the imaging unit 130, that is, the wall surface of the cave 20, and displays the virtual image (AR image 31) on the display unit 110. It is also possible to let The display control unit 151 identifies the position and orientation of the display device 100 inside the cave 20 based on information such as the position information, orientation information, and height information of the display device 100 transmitted from the position information acquisition unit 120 . Then, the display control unit 151 generates an image (AR image) that should be visible to the user in the specified position and posture using the program and data stored in the storage unit 140, and displays the image on the display unit 110. Let

Based on the position information of the display device 100 transmitted from the position information acquisition unit 120, the determination unit 152 determines the position of the predetermined space, that is, the inside of the cave 20, relative to the virtual reference line 61 set inside the wall surface. It is determined whether or not the display device 100 is located on the outer side of the In other words, the determination unit 152 determines whether or not the display device 100 has crossed the virtual reference line 61 from the central side of the predetermined space toward the outside toward the wall surface. If the determination unit 152 determines that the display device 100 is positioned outside the virtual reference line 61 , the determination unit 152 notifies the correction unit 153 to that effect.

When notified by the determination unit 152 that the display device 100 is positioned outside the virtual reference line 61, the correction unit 153 displays the AR image on the wall surface of the predetermined space. Correct the position. The correction unit 153 corrects the AR image so that the portion of the AR image corresponding to the virtual reference line 61 over which the display device 100 crosses the virtual reference line 61 moves relatively away from the display device 100 when the display device 100 crosses the virtual reference line 61 . Correct the display position. As an example, the correction unit 153 moves a predetermined distance (for example, 10 cm, but not limited to this) is corrected to the display position. Therefore, when viewed from the user 10 , the AR image 31 that should be superimposed on the wall surface 32 closer to the user 10 is displayed away from the user 10 and superimposed on the wall surface 32 farther from the user 10 . The AR image 31 to be displayed in , is displayed so as to approach the user 10 . Note that the display device 100 includes an ultrasonic sensor or the like to specify the distance from the display device 100 to the nearest wall surface, and according to the specified distance to the wall surface, the display position for displaying the AR image is changed. may be specified and corrected by moving by the specified distance.

The adjustment unit 154 performs calibration for adjusting the position of the AR image to be displayed based on the input from the user in a predetermined space, that is, a predetermined place installed in the cave 20, such as a checkpoint. to run. Unlike the correction of the image display position by the correction unit 153, the calibration by the adjustment unit 154 performs strict adjustment of the display position of the AR image.

The input unit 170 is an input interface that receives input from the user 10 . The input unit 170 may be realized by hardware keys or the like provided on the display device 100 . The input unit 170 transmits input contents to the control unit 150 .

The above is the configuration example of the display device 100 .

<Action>
An operation example of the display device 100 will be described with reference to FIG.

The control unit 150 of the display device 100 performs initial settings for displaying an AR image on the display device 100 (step S901). The initial setting here may include aligning the initial position in the cave 20 as a predetermined space with the display position of the AR image. Initial setting is not required.

The user 10 wears the display device 100 and starts searching inside the cave 20 (step S902).

The position information acquisition unit 120 of the display device 100 sequentially acquires position information indicating the position of the display device 100 (step S903). The position information acquisition unit 120 transmits the obtained position information and information indicating the orientation and height of the display device 100 to the control unit 150 . Based on the transmitted position information and the position of the virtual reference line 61 stored in the storage unit 140, the determination unit 152 of the control unit 150 determines whether the display device 100 is positioned outside the virtual reference line 61. (step S904).

If the determination unit 152 determines that the display device 100 is positioned outside the virtual reference line 61 (YES in step S904), the determination unit 152 notifies the correction unit 153 to that effect. When the determination unit 152 notifies the correction unit 153 that the display device 100 is positioned outside the virtual reference line 61, the correction unit 153 adjusts the display position of the AR image corresponding to the virtual reference line 61 over which the display device 100 has crossed. is relatively far away from the user 10 (display device 100) (step S905). The display control unit 151 causes the display unit 110 to display the AR image according to the corrected display position.

The display device 100 determines whether or not a calibration execution input is received from the user 10 to the input unit 170 (step S906). If not accepted (NO in step S906), the process proceeds to step S908. If an input to execute calibration has been received (YES in step S906), the adjustment unit 154 performs calibration based on the user's position, that is, the position of the display device 100 and the captured image captured by the imaging unit 130. (step S907), and the process proceeds to step S908.

The display device 100 determines whether or not an AR image display end input has been received from the user 10 (step S908). If an end input has not been received (NO in step S908), the process returns to step S903, and if it has been received (YES in step S908), the process ends.

The above is the description of the operation example of the display device 100 . Note that the processing of steps S904 and S905 and the processing of steps S906 and S907 may be executed in parallel with each other, or their execution order may be reversed.

<Summary>
The display device 100 shown in the above embodiment crosses a virtual reference line set so as to be positioned inside a wall surface in a predetermined space in a passage or the like in a predetermined space, and when the display device 100 is positioned outside When the determination is made, the display position of the virtual image that may be displayed within the wall surface can be corrected. As a result, it is possible to suppress the possibility that the user cannot visually recognize the virtual image.

<Supplement>
Needless to say, the display device according to the above embodiment is not limited to the above embodiment, and may be realized by other methods. Various modifications will be described below.

(1) In the above-described embodiment, an example in which the display device 100 implements all the functions was shown, but this is not the only option. A plurality of devices including the display device 100 may realize the functions described in the above embodiments. For example, an external device generates an AR image to be displayed on the display device 100, and the AR image generated by the external device and its display position are transmitted to the display device 100 by communication. The display device 100 may include a communication unit that wirelessly communicates with the external device. The communication unit receives information about an AR image generated by an external device and its display position, and displays the received AR image at the designated display position. Thus, the functions of the display device 100 may be realized by multiple devices.

(2) In the above-described embodiment, the virtual reference line 61 is set along the shape of the wall surface 32 of the cave 20. However, if the virtual reference line 61 is set inside the wall surface 32, Well, it doesn't have to follow the shape of the wall surface 32 . FIG. 10 is a diagram showing another example of the virtual reference line 61. As shown in FIG. FIG. 10 is a front view when the cave 20 is viewed in the direction of travel. The example of FIG. 10 shows an example in which the virtual reference line 61 is set in a rectangular shape as illustrated. The tunnels in mines and caves basically have routes that humans can pass through. The imaginary reference line 61 may be set in a rectangular cylindrical shape along the traveling route. Also, the distance of the virtual reference line 61 from the wall surface 32 may be constant throughout the cave 20, or may not be constant. For example, the position of the virtual reference line 61 is set so that the distance from the wall surface 32 is short where the passage in the cave 20 is narrow, and the distance from the wall surface 32 is long where the passage in the cave 20 is wide. It is good as a thing.

(3) In the above embodiment, the user 10 acts in the cave 20 as an example, but the user 10 may act anywhere as long as there is a wall. For example, the place where the user 10 acts may be, for example, in a building, in a tunnel, or in a three-dimensional maze.

(4) Although not specifically described in the above embodiment, the user may hold a controller for influencing the virtual image world. In that case, the controller may be equipped with a sensor so that the position and orientation within the predetermined space (cave 20) can be specified, and the virtual image may be affected. Here, the influence may be, for example, treating the controller as a flashlight and processing the image so as to brightly illuminate the image world according to the orientation of the controller held by the user, or using the controller as a gun. , the image may be processed so that when the user pulls the trigger in the image world, the gun is shot in the direction the controller is pointed. Note that the example of image processing using the controller is an example, and other processing may be performed, and the controller may be regarded as another thing.

(5) An example of calibration by the adjustment unit 154 shown in the above embodiment will be described with reference to FIGS. 11 and 12. FIG.

One or more checkpoints may be set in the cave 20 for performing calibration. Calibration means adjusting the display position of the AR image. More specifically, the calibration here means that the accurate position is measured in advance in the cave 20, and at that position, how the display device 100 should display the AR image is determined. , aligning the position information of the display device 100 (including the orientation and height of the display device 100) with the display position of the AR image so that the display device 100 can be viewed in a set manner. FIG. 11 shows an example in which checkpoints 1101 and 1102 are provided inside the cave 20 .

When the user 10 reaches the checkpoints 1101 and 1102, the user 10 performs a predetermined input (for example, pressing a specific button provided on the display device 100) for executing calibration. Then, the display control unit 151 displays a sentence indicating an action desired for the user 10, as shown in a message 1204 in FIG. 12(a). Here, an example in which the display control unit 151 displays a cursor 1203 and displays a message for aligning the cursor 1203 with an object provided as a checkpoint 1101 in the cave 20 is shown. there is The user 10 adjusts his position and viewing direction so that the cursor 1203 is aligned with the object provided as the checkpoint 1101 . Then, as shown in FIG. 12B, the cursor 1203 is aligned with the object, and the adjustment unit 154 aligns the acquired position information of the display device 100 with the position of the object (checkpoint 1101). calibration for determining the display position for displaying the AR image. In this way, the display positions of the AR images may be appropriately aligned in various places within a predetermined space.

Here, an example is shown in which calibration is performed by confirming that the cursor 1203 is aligned with the object based on the captured image captured by the imaging unit 130. This is not limited to that. By performing an input to the input unit 170 of the display device 100 at the timing when the user 10 can confirm that the cursor 1203 is aligned with the object in the visual field visible through the display unit 110 (lens), Calibration may be executed based on the position information at that time.

Also, although an example of using an object as a checkpoint is shown here, a predetermined image pasted on the wall of the cave 20 or the like may be used, and the predetermined image may be a two-dimensional object. It may be an image containing some information such as a bar code. When a two-dimensional barcode is used, calibration by the adjustment unit 154 may be started not by an input from the user 10 to the display device 100 but by the reading of the two-dimensional barcode by the imaging unit 130 as a trigger. .

(6) In addition, in the above-described embodiment, the method of providing an image accompanying the movement of the user on the display device 100 is implemented by the processor of the display device executing a virtual image display program or the like. This may be realized by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like in the device. Moreover, these circuits may be realized by one or more integrated circuits, and the functions of the plurality of functional units shown in the above embodiments may be realized by one integrated circuit. LSIs are sometimes called VLSIs, super LSIs, ultra LSIs, etc., depending on the degree of integration.

The virtual image display program may be recorded on a processor-readable recording medium, and the recording medium may be a "non-temporary tangible medium" such as a tape, disk, card, semiconductor memory, or programmable. A logic circuit or the like can be used. Further, the virtual image display program may be supplied to the processor via any transmission medium (communication network, broadcast wave, etc.) capable of transmitting the virtual image display program. The invention may also be embodied in the form of a data signal embedded in a carrier wave in which the virtual image display program is embodied by electronic transmission.

The virtual image display program is implemented using script languages such as ActionScript and JavaScript (registered trademark), object-oriented programming languages such as Objective-C and Java (registered trademark), and markup languages such as HTML5. can.

(7) The above-described embodiment and various modifications shown in each supplement may be combined as appropriate.

20 tunnel 31 AR image 32 tunnel wall 61 virtual reference line 100 display device 110 display unit 120 position information acquisition unit 130 imaging unit 140 storage unit 150 control unit 151 display control unit 152 determination unit 153 correction unit 154 adjustment unit

Claims (9)

a display unit for displaying an image;
a location information acquisition unit that acquires the location of its own device;
a display control unit that causes the display unit to display a predetermined virtual image so as to be superimposed on a wall surface of a predetermined space;
a determination unit that determines whether or not the device is positioned outside a virtual reference line provided inside a virtual image displayed on the wall surface in the predetermined space;
a correction unit that corrects a display position of a predetermined virtual image when the determination unit determines that the device is positioned outside the virtual reference line;
A display device worn by a user. The correction unit determines a display position of the virtual image to be displayed on the wall surface of the predetermined space relatively close to the display device when the determination unit determines that the device is positioned outside the virtual reference line. 2. The display device according to claim 1, wherein the correction is made so as to keep the distance from the display device. The correction unit determines a display position of the virtual image to be displayed on the wall surface of the predetermined space relatively close to the display device when the determination unit determines that the device is positioned outside the virtual reference line. 3. The display device according to claim 2, wherein the display device is corrected so as to be moved to a position farther from the device by a predetermined distance. The display device
An imaging unit that captures the viewing direction of the user,
4. The display control unit according to any one of claims 1 to 3, wherein the display control unit causes the display unit to display a predetermined virtual image within a range included in the predetermined space captured by the imaging unit. Display device as described. an object used for adjusting the display position of the virtual image is arranged at a predetermined position in the predetermined space;
5. The display device includes an adjustment unit for adjusting a display position of the virtual image using a captured image captured by the imaging unit and including the object. The display device according to . an object used for adjusting the display position of the virtual image is arranged at a predetermined position in the predetermined space;
The display control unit causes the display unit to display a predetermined image for determining a positional relationship with the object, and displays a message indicating a positional relationship between the object and the predetermined image on the display unit. let
The display device
an input unit that receives an input indicating that the object and the predetermined image are in the positional relationship;
4. The apparatus according to any one of claims 1 to 3, further comprising an adjustment unit for adjusting a display position of the virtual image based on the position of the object when there is an input from the input unit. 1. The display device according to item 1. The display device according to any one of claims 1 to 6, wherein the virtual reference line is provided in a rectangular shape within the predetermined space. A display device computer having a display unit worn by a user to display an image,
a position information obtaining step of obtaining the position of the own device;
a display control step of superimposing a predetermined virtual image on a wall surface of a predetermined space and causing the display unit to display the virtual image;
a determination step of determining whether or not the device is positioned outside a virtual reference line provided inside a virtual image displayed on the wall surface in the predetermined space;
a correction step of correcting a display position of a predetermined virtual image when it is determined in the determination step that the device is positioned outside the virtual reference line;
A virtual image display method that performs A display device computer having a display unit worn by a user to display an image,
a location information acquisition function for acquiring the location of the device itself;
a display control function for superimposing a predetermined virtual image on a wall surface of a predetermined space and displaying it on the display unit;
a determination function for determining whether or not the device is positioned outside a virtual reference line provided inside a virtual image displayed on the wall surface in the predetermined space;
a correction function for correcting a display position of a predetermined virtual image when the determination function determines that the device is positioned outside the virtual reference line;
A virtual image display program that realizes

Images