JP2014228595A - Augmented reality space display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an augmented reality space display device that allows a user to visually recognize a composite image and a reality space on the periphery of the image in good condition.SOLUTION: An augmented reality space display device includes an AR display unit 13 that overlaps light output from a self-luminous image display element 11 on external light L1 arriving from a reality space by using a prism 14 to display an augmented reality space in which an image displayed on the image display element 11 is combined with the reality space, and a shutter 14 that shields the external light L1 and can change a light-shielding area in an arbitrary manner. The augmented reality space display device shields, with the shutter 14, the external light L1 illuminating a portion overlapped with the image displayed on the image display element 11 in the augmented reality space seen by a user.

Description

  The present invention relates to an augmented reality space display device that displays an augmented reality space obtained by combining an image with a real space.

  A so-called AR (Augmented Reality) technique is being put to practical use in which an operation guidance and the like are realized by displaying images superimposed in the field of view. A head-mounted display used for this is generally configured to optically combine an image displayed on an image display element with a prism, a half mirror, or the like in the field of view. At this time, depending on the use environment, the visibility of an image superimposed on the field of view may be deteriorated due to backlight, light emitting matter, or color in the field of view.

  As a technique for dealing with this problem, for example, a transmission type head mount that provides an attenuation filter that attenuates light from the outside, detects the brightness of the outside, and controls the transmittance of the neutral density filter according to the brightness of the outside. There is a display (see Patent Document 1).

  In addition, there is a display device that selectively attenuates the amount of transmitted light in a portion with high luminance (see Patent Document 2). In this display device, when information display overlaps a portion with high luminance, the attenuation of the information display portion is made smaller than other portions, thereby preventing the visibility of information display from being lowered.

  In addition, there is an information display system that reduces the amount of light from the outside with a shutter when displaying highly urgent information (see Patent Document 3).

Japanese Patent Laid-Open No. 2004-233908 JP 2008-242134 A JP 2009-251428 A

  In the techniques disclosed in Patent Documents 1 and 3, the brightness of the entire field of view is lowered. For this reason, parts other than the synthesized image become dark and difficult to see.

  In the technique disclosed in Patent Document 2, the amount of transmitted light around the dazzling part and its surroundings is attenuated, or the amount of transmitted light around the information display portion is attenuated. When this is done, it becomes difficult to see the surroundings and workability is reduced. In addition, because information is displayed using external light as a light source (because it is not self-luminous), the color of the displayed information changes due to the color of the external light, and color reproducibility is required. Can not be used in some cases.

  The present invention is intended to solve the above-described problem, and is augmented reality that can ensure good visibility and color reproducibility of displayed information without being affected by the color and brightness of the field of view. The object is to provide a spatial display device.

  The gist of the present invention for achieving the object lies in the inventions of the following items.

[1] An AR display unit that displays an augmented reality space in which an image displayed on the display unit is combined with the real space by superimposing light output from the self-luminous display unit on light arriving from the real space;
A shutter part capable of arbitrarily changing a blocking area for blocking or dimming light coming from the real space; and
A control unit that controls display of an image by the display unit and light shielding or dimming by the shutter unit;
With
The control unit sets the blocking region so that light from the real space that overlaps an image displayed on the display unit in the augmented reality space is blocked or dimmed by the shutter unit. Augmented reality space display device.

  In the above invention, the portion of the external light that overlaps the image displayed on the display unit is blocked or dimmed by the shutter unit. Thereby, it becomes difficult to be influenced by external light, and the color reproducibility and visibility of information displayed in the augmented reality space can be improved.

[2] A camera unit for photographing the real space is further provided,
The control unit sets the overlapping part and the other part other than the overlapping part as the blocking area, and processes the video output from the camera unit or the video in the display part area corresponding to the other part. The augmented reality space display device according to [1], wherein an image is displayed.

  In the above-described invention, a light-shielding region is set in other parts other than the part overlapping with the image displayed on the display unit, and an image of the real space output from the camera unit or a processed image is displayed on the other part. For example, it is possible to set a blocking area also in a high-luminance portion, and to compositely display a camera image corresponding to this portion with reduced brightness. The other part may be an area separated from a part overlapping the displayed image, or may be an area continuous with the overlapping part.

[3] The blocking area is an area wider than the overlapping part including the overlapping part in the augmented reality space with the image to be displayed on the display unit,
In the area of the display unit corresponding to the blocking area, an image of a portion corresponding to the blocking area or an image obtained by processing the image to be displayed is displayed on the image output from the camera unit. The augmented reality space display device according to [2], wherein

  In the above invention, a wider range including an image to be displayed is set as a blocking area, and an image scheduled to be displayed on a camera image in a real space corresponding to the blocking area or an image obtained by processing the same in a portion corresponding to the blocking area. Display the synthesized image. If the real space around the image to be displayed is close to the image to be displayed or if the brightness is too high, the surroundings of the image to be displayed are replaced with a camera image. Color and brightness can be corrected for the field of view to make it easy to see.

[4] The control unit detects a high-luminance region from the video output from the camera unit, and the shutter unit blocks or reduces the light from the real space corresponding to the high-luminance region. An augmented reality space display device according to any one of [1] to [3], wherein a blocking area is set.

  In the said invention, the visibility of the image to synthesize | combine improves by light-shielding a high-intensity part.

[5] The augmented reality space display device according to any one of [1] to [4], wherein the display device is a head mounted display that is used by being mounted on a human head.

  According to the augmented reality space display device of the present invention, it is possible to satisfactorily ensure the visibility and color reproducibility of displayed information without being affected by the color and brightness of the field of view.

It is a figure which shows the structural example of the optical system of the augmented reality space display apparatus which concerns on embodiment of this invention. It is a figure which shows the other structural example of the optical system of the augmented reality space display apparatus which concerns on embodiment of this invention. It is a block diagram which shows schematic structure of the augmented reality space display apparatus which concerns on embodiment of this invention. It is a flowchart of the process performed when the augmented reality space display apparatus of 1st Embodiment synthesize | combines and displays an image. It is a flowchart which shows the detail of the interruption | blocking area | region determination process (step S103 of FIG. 4). It is a figure which shows an example of the real space which the user is seeing, the superimposition image combined with this, and the interruption | blocking area | region. It is explanatory drawing which shows a mode that the augmented reality space which a user sees is formed by superimposing the real space, the interruption | blocking area | region, and a superimposition image. FIG. 7 is an explanatory diagram showing a state in which a high-luminance region is further shielded from the light in FIG. It is a flowchart of the process performed when the augmented reality space display apparatus of 2nd Embodiment displays a composite image. It is a flowchart which shows the detail of the interruption | blocking area | region determination process (step S203 of FIG. 9). It is a figure which shows an example of the real space which the user is seeing, the superimposition image combined with this, and the interruption | blocking area | region. It is explanatory drawing which shows a mode that the augmented reality space which a user sees is formed by superimposing the real space, the interruption | blocking area | region, and a superimposition image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a schematic configuration of an optical system 10A of an augmented reality space display device 10 according to the first embodiment of the present invention. The augmented reality space display device 10 is configured as a so-called head mounted display that is used by being worn like a pair of glasses on a human head.

  The augmented reality space display device 10 emits light (image light L2 and light output from the image display element 11 which is a self-luminous display unit) to light (external light L1) arriving from a real space (view) viewed by the user. The AR display unit 13 displays an augmented reality space in which an image displayed on the image display element 11 is combined with a real space viewed by the user. The image display element 11 is a dot matrix display device and can display an arbitrary image. The image display element 11 is self-luminous, and the portion of the image to be displayed emits light, and the blank portion without the image does not emit light.

  The augmented reality space display device 10 further includes a shutter 14 that blocks or reduces the external light L1 coming from the real space that the user is viewing, and a camera unit 15 that captures the real space that the user is viewing. Yes. One light, which is partly reflected by the prism 16, is incident on the camera unit 15 from the external light L <b> 1 arriving from the real space viewed by the user. The other light transmitted through the prism 16 enters the prism 12 of the AR display unit 13.

  The shutter 14 is provided in front of the prism 12, and blocks or attenuates external light L 1 that enters the prism 12 through the prism 16. Hereinafter, the description will be made assuming that the light shielding includes dimming.

  The shutter 14 is configured to be able to arbitrarily change a light shielding region (hereinafter referred to as a blocking region). For example, the shutter 14 is composed of a liquid crystal shutter in which minute light shielding portions are arranged in a matrix form. The shutter 14 preferably has the same resolution as that of the image display element 11 or a resolution equal to or higher than that of the image display element 11.

  In the augmented reality space display device 10, the external light L <b> 1 from the part of the actual space that overlaps with the image to be displayed on the image display element 11 (assumed to be a superimposed image) is displayed by the shutter 14 in the augmented reality space displayed on the AR display unit 13. Shield from light. Alternatively, an arbitrary region to be shielded from light, for example, a region with high brightness such as the sun or a light emitter, or a region matched to the shape of an object in the outside world is shielded by the shutter 14. As a result, the superimposed image can be shown to the user without being affected by the color and brightness of the outside world, and the color reproducibility and visibility of the superimposed image within the field of view can be greatly enhanced.

  FIG. 2 shows another type of optical system 10 </ b> B that can be employed in the augmented reality space display device 10. The AR display unit is a self-luminous type and includes a transmissive image display element 13B. The shutter 14, the camera unit 15, and the prism 16 are the same as those shown in FIG. The shutter 14 is provided on the rear surface (the side on which the external light L1 from the prism 16 is incident) of the transmissive image display element 13B.

  In the optical system 10B shown in FIG. 2, the external light L1 passes through the prism 16 and the shutter 14 (the unshielded portion) and enters the back surface of the transmissive image display element 13B. The external light L1 incident on the transmissive image display element 13B is superimposed on the image light L2 output from the transmissive image display element 13B in the transmissive image display element 13B and reaches the eyes of the user.

  The optical system of the augmented reality space display device 10 may be either the optical system 10A shown in FIG. 1 or the optical system 10B shown in FIG. In the following description, the augmented reality space display device 10 using the optical system 10A of FIG. 1 will be described.

  FIG. 3 is a block diagram showing a schematic electrical configuration of the augmented reality space display device 10. In addition to the camera unit 15, the image display element 11, and the shutter 14, the augmented reality space display device 10 detects the posture of the camera unit 15 and outputs posture information, and an image display. An in-space object generation unit 22 that generates an image (object) to be displayed on the element 11, a superimposed image generation unit 23 that generates a superimposed image that is an image to be displayed on the image display element 11, and a blocking area determination that determines a blocking area The unit 24 is configured.

  The camera posture detection unit 21, the in-space object generation unit 22, the superimposed image generation unit 23, and the blocking area determination unit 24 serve as a control unit that controls image display by the image display element 11 and light shielding by the shutter 14. A CPU (Central Processing Unit), a nonvolatile memory, and a RAM (Random Access Memory) are configured as main parts. The CPU performs the above control by executing a program stored in the nonvolatile memory. The RAM is used as a work memory for temporarily storing various data when the CPU executes processing based on a program, an image memory for storing image data to be displayed, and the like. In addition to the program, the nonvolatile memory stores original data of an image to be displayed on the image display element 11 and the like.

  The camera posture detection unit 21 detects the posture of the camera unit 15 using, for example, a gyro provided integrally with the camera unit 15. The in-space object generation unit 22 generates an image of an object to be displayed on the image display element 11. The superimposed image generation unit 23 generates a superimposed image to be displayed on the image display element 11. For example, a state in which the user's line-of-sight direction (up / down, left / right, diagonal, etc.) is recognized from the posture information output from the camera unit 15 and the object image generated by the in-space object generation unit 22 is viewed from the user's line-of-sight direction. Is output to the image display element 11 as a superimposed image and displayed. By synthesizing the superimposed image viewed from the user's line of sight with the real space, it is possible to display the augmented reality space in which the superimposed image is synthesized with no sense of incongruity with the three-dimensional real space.

  Based on the superimposed image generated by the superimposed image generation unit 23, the blocking area determination unit 24 determines a blocking area in which the external light L 1 is blocked by the shutter 14, and outputs information indicating the blocking area to the shutter 14. The shutter 14 blocks the external light L1 according to the information indicating the blocking area input from the blocking area determination unit 24.

  FIG. 4 shows an outline of processing performed by the augmented reality space display device 10. The camera posture detection unit 21 detects the posture of the camera unit 15 (step S101), and the superimposed image in a state when the object generated by the in-space object generation unit 22 is viewed from the user's line-of-sight direction detected from the posture of the camera unit 15 is obtained. Create (step S102).

  Next, the blocking area is determined based on the superimposed image created in step S102 and the setting regarding whether or not to reduce the external light of the high-luminance portion (step S103). Then, the superimposed image data is output to the image display element 11 to display the superimposed image on the image display element 11, and information on the blocking area is output to the shutter 14, and the outside light L 1 of the blocking area is output to the shutter 14. The light is shielded (step S104).

  This process is repeatedly executed in a short cycle (for example, a 5 ms cycle). As a result, even if the user wearing the augmented reality space display device 10 that is a head-mounted display moves his / her line of sight, the user can dynamically change the location where the superimposed image is displayed and the shielding area shielded by the shutter 14. Can follow the movement of

  FIG. 5 shows details of the process for determining the blocking area (step S103 in FIG. 4). First, a portion corresponding to the superimposed image (a portion overlapping the superimposed image in the augmented reality space) is set as a blocking region (step S111). Next, it is checked whether or not the setting for reducing the external light is made (step S112). If the setting for reducing the external light is not made (step S112; No), the blocking region set in step S111 is checked. This is finalized.

  When the setting for reducing the external light is made (step S112; Yes), the camera image is analyzed to extract the high-luminance portion, and the portion corresponding to the high-luminance portion is set in step S111. In this case, the blocking area is determined with the contents after the addition, and the process is terminated.

  Next, an example in which the augmented reality space display device 10 displays the superimposed image while blocking the outside light L1 in the blocking area.

  FIG. 6A shows an example of the real space 31 that the user is looking at.

  FIG. 6B shows an example of the object 32 displayed on the image display element 11.

  FIG. 6C shows a superimposed image 33 obtained by deforming the object 32 in accordance with the posture detected by the camera posture detection unit 21.

  FIG. 6D shows the shutter 14 in a state where the blocking area 34 corresponding to the superimposed image 33 is shielded. Note that the light attenuation rate of the light blocking region 34 may be 100% (completely light blocking) or an arbitrary light attenuation rate. Moreover, you may change a light attenuation rate. For example, the dimming rate may be changed according to the brightness of the real space or the ratio of the brightness of the real space and the superimposed image 33.

  In the example of FIG. 6, the blocking area 34 is only the stroke portion of the character, but an area including a blank portion inside the character may be the blocking area 34. That is, in the superimposed image 33 (only the region corresponding to the light emitting portion of the image display element 11 may be the blocking region 34, or the entire region surrounded by the outermost periphery of the light emitting portion may be the blocking region 34.

  FIG. 7 shows that the external light from the real space 31 of FIG. 6A is shielded by the blocking region 34 of the shutter 14 of FIG. 6D, and the superimposed image 33 of FIG. It shows how the real space 35 is formed. The user visually recognizes the augmented reality space 35.

  FIG. 8 shows a case where the light shielding region 37 is provided also in the high luminance part. In this example, the window portion of the room is extracted as the high brightness portion 36. A region corresponding to the high luminance portion 36 (or a region including the high luminance portion 36 and its surroundings) is further added as a blocking region 37 so that external light from the high luminance portion 36 does not reach the eyes of the user. It should be noted that the dimming rate of the blocking area 37 may be determined according to the brightness of the high luminance part 36 in the real space or the ratio between the brightness of the high luminance part 36 in the real space and the surrounding brightness. .

  Note that light wraps around the edge of the blocking region 37 due to the diffraction effect. Therefore, it is preferable that the blocking area 37 is enlarged so as to include the periphery to some extent rather than the shape that exactly matches the high-luminance portion or the object to be displayed. Thereby, it is possible to reduce the influence of light wraparound when the outside light is strong. Further, the minimum line width of the superimposed image may be limited to a certain level or more. As a result, even if the light wraps around to some extent, the light shielding effect is ensured.

  Next, a second embodiment of the present invention will be described. The hardware configuration of the augmented reality space display device 10 is the same as that of the first embodiment, and a description thereof will be omitted.

  In the second embodiment, a portion corresponding to an image displayed on the image display element 11 and another portion are set as a blocking region, and at least the other portion includes a video shot by the camera unit 15 or a video obtained by processing it. indicate.

  In the second embodiment, for example, an area corresponding to the high-intensity part is added as the second blocking area, and the image of the part corresponding to the second blocking area is extracted from the video output from the camera unit 15 to obtain the brightness. It is possible to display the image display element 11 in a portion corresponding to the second blocking area by performing processing for reducing the thickness, processing for correcting the color, or the like. As a result, in the augmented reality space, the image of the real space corresponding to the second blocked area is displayed in the augmented reality space. It does not become a background and does not give the user a feeling of strangeness. Further, by processing the video, the color and visibility of the outside world can be improved.

  In the second embodiment, when displaying in an augmented reality space in which a 3D image is synthesized in accordance with a 3D tag arranged in the real space, the 3D tag and its peripheral part are additionally set in the light-shielding area. If an image in which a 3D tag is deleted from a camera image of a part of the real space is generated and displayed at a position corresponding to the light shielding area, the augmented reality space in which the 3D image is synthesized without showing the 3D tag to the user Can show.

  In the second embodiment, a part of the rectangular field of view can be displayed as the zoom region of the view image. In the second embodiment, a blocking area is set in accordance with the outer shape of the object in the outside world, and the image of the object obtained from the camera image and the predetermined display information are combined at that portion with improved visibility. It is possible to create an image and display the image at a position corresponding to the blocking area.

  Furthermore, the entire field of view (the entire shutter 14) is set as a blocking area, and a superimposed image is created by combining the image of the object to be displayed with the video output from the camera unit 15 or the video processed by the video. It is possible to display an image on the entire display area of the image display element 11 and perform a display ensuring visibility and color reproducibility.

  FIG. 9 shows an outline of processing performed by the augmented reality space display device 10 according to the second embodiment. The camera posture detection unit 21 detects the posture of the camera unit 15 (step S201).

  Next, an image scheduled to be displayed on the image display element 11 is created (step S202). For example, an image in a state where the object generated by the in-space object generation unit 22 is viewed from the user's line-of-sight direction detected from the posture of the camera unit 15 is created as an image to be displayed (step S202).

  Next, a blocking area is determined according to whether or not to synthesize a camera image (step S203). Then, according to the result of step S203, a superimposed image is created by combining the camera image with the image to be displayed, or the image to be displayed is determined as the superimposed image as it is (step S204).

  Creation of a superimposed image obtained by combining a camera image with an image to be displayed is performed as follows. An image of a region corresponding to the cut-off region is extracted from the video output from the camera unit 15, and predetermined processing is performed on the extracted image. For example, the above-mentioned 3D tag is deleted, or the brightness of the image is lowered to improve the visibility. Then, a superimposed image is created by superimposing the image scheduled to be displayed on the processed image.

  Thereafter, the data of the superimposed image is output to the image display element 11 to display the superimposed image on the image display element 11, and the information on the blocking area is output to the shutter 14, and the outside light L 1 of the blocking area is output to the shutter 14. The light is shielded (step S205). This process is repeated as in the process of FIG.

  FIG. 10 shows details of the process for determining the blocking area (step S203 in FIG. 9). First, a portion corresponding to an image scheduled to be displayed (portion overlapping with an image scheduled to be displayed in the augmented reality space) is extracted and set as a blocking area (step S211). Next, it is checked whether or not a synthesis mode for synthesizing camera images is set (step S212). If no setting is made (step S212; No), the blocking area set in step S211 is confirmed, This process ends.

  If the compositing mode is set (step S212; Yes), a region corresponding to the image to be displayed and a region including the surrounding fixed range are set as a blocking region (step S213), and this processing is terminated.

  Next, a display example of the augmented reality space display device 10 in the synthesis mode will be described. Here, a case where a 3D image corresponding to a 3D tag in the real space is synthesized and an augmented reality space in which the 3D tag in the real space is deleted is displayed is exemplified.

  FIG. 11A is an example of the real space 41 that the user is looking at. A 3D tag 42 is arranged in the real space 41.

  FIG. 11B shows a display-scheduled image 43 obtained by deforming an object corresponding to the 3D tag 42 according to the posture detected by the camera posture detection unit 21.

  FIG. 11C shows an augmented reality space when an image 43 to be displayed is simply combined with the actual space 41. Further, in FIG. 11C, a blocking area 44 determined so as to include a portion corresponding to the image 43 to be displayed and the 3D tag 42 is indicated by a broken line.

  FIG. 11D shows an extracted image 45 obtained by extracting a portion corresponding to the blocking area 44 from the video output from the camera unit 15.

  FIG. 11E shows the shutter 14 in a state where the blocking region 44 is shielded from light.

  FIG. 11 (f) shows a processed image 46 that has been processed to delete the 3D tag 42 from the extracted image 45 shown in FIG. 11 (d).

  FIG. 11G shows a superimposed image 47 obtained by synthesizing the processed image 46 shown in FIG. 11F with the image 43 scheduled to be displayed shown in FIG.

  FIG. 12 shows that the external light from the real space 41 in FIG. 11A is shielded by the blocking area 44 of the shutter 14 in FIG. 11E, and the superimposed image 47 in FIG. A state in which the real space 48 is formed is shown. The user visually recognizes the augmented reality space 48. In the augmented reality space 48, the 3D tag 42 does not appear, and the 3D image 43 corresponding to the 3D tag 42 is displayed.

  As described above, in the augmented reality space display device 10, the external light L1 is shielded by the shutter 14 using the portion corresponding to the superimposed image as a blocking region in accordance with the shape of the superimposed image. The image can be displayed without being affected by external light, and the color reproducibility and visibility of the superimposed image in the augmented reality space can be improved.

  The embodiment of the present invention has been described with reference to the drawings. However, the specific configuration is not limited to that shown in the embodiment, and there are changes and additions within the scope of the present invention. Are also included in the present invention.

  In the embodiment, the augmented reality space display device 10 is a head-mounted display. However, the device is not limited to the head-mounted display as long as the device displays the augmented reality space. For example, a mobile terminal equipped with a camera and a display may be used.

The shutter 14 is not limited to a liquid crystal shutter, and may have a function capable of changing a light shielding or dimming region to an arbitrary range and shape.
The prism 12 and the prism 16 are not limited to prisms, and may have a function capable of optically separating or synthesizing images such as a half mirror and a lens optical system.

DESCRIPTION OF SYMBOLS 10 ... Augmented reality space display apparatus 10A, 10B ... Optical system of augmented reality space display apparatus 11 ... Image display element 12 ... Prism 13 ... AR display part 13B ... Transmission type image display element 14 ... Shutter 15 ... Camera part 16 ... Prism DESCRIPTION OF SYMBOLS 21 ... Camera attitude | position detection part 22 ... In-space object generation part 23 ... Superimposed image generation part 24 ... Blocking area determination part 31 ... Reality space 32 ... Object 33 ... Superimposition image 34 ... Blocking area 35 ... Augmented reality space 36 ... High-intensity part 37 ... Blocking region 41 ... Real space 42 ... 3D tag 43 ... Image to be displayed 44 ... Blocking region 45 ... Extracted image 46 ... Processed image 47 ... Superimposed image 48 ... Augmented reality space L1 ... External light L2 ... Image light

Claims (5)

An AR display unit that displays an augmented reality space in which an image displayed on the display unit is combined with the real space by superimposing light output from the self-luminous display unit on light arriving from the real space;
A shutter part capable of arbitrarily changing a blocking area for blocking or dimming light coming from the real space; and
A control unit that controls display of an image by the display unit and light shielding or dimming by the shutter unit;
With
The control unit sets the blocking area so that light from the real space in a portion where the image displayed on the display unit overlaps in the augmented reality space is blocked or dimmed by the shutter unit. Augmented reality space display device. A camera unit for photographing the real space;
The control unit sets the overlapping part and the other part other than the overlapping part as the blocking area, and processes the video output from the camera unit or the video in the display part area corresponding to the other part. The augmented reality space display device according to claim 1, wherein an image is displayed. The blocking region is a region wider than the overlapping portion including a portion overlapping the image scheduled to be displayed on the display unit in the augmented reality space,
In the area of the display unit corresponding to the blocking area, an image of a portion corresponding to the blocking area or an image obtained by processing the image to be displayed is displayed on the image output from the camera unit. The augmented reality space display device according to claim 2. The control unit detects a high-luminance region from an image output from the camera unit, and sets the blocking region so that light from a part of the real space corresponding to the high-luminance region is blocked or reduced by the shutter unit. The augmented reality space display device according to claim 1, wherein the augmented reality space display device is set. The augmented reality space display device according to any one of claims 1 to 4, wherein the display device is a head mounted display that is used by being worn on a human head.