JP2012003598A - Augmented reality display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an augmented reality display system capable of using markers capable of expressing many patterns while power supply is not needed and portability is excellent and preventing unneeded electronic information from being superimposed on video images when superimposing the electronic information corresponding to the respective markers on the video images.SOLUTION: The augmented reality display system 1 includes: a marker 4 with a sheet capable of individually expressing a plurality of patterns by a colored part and the other part by forming the colored part on at least a part of at least one of a front surface and a back surface and being folded by two or more procedures; a camera 3 for photographing an area including the marker 4; and an augmented reality display device 2 for superimposing the electronic information on the video images photographed by the camera 3 and displaying it. The augmented reality display device 2 includes: a marker detection part 242 for detecting the marker 4 in the video images photographed by the camera 3; a superimposing part 243 for superimposing the electronic information corresponding to the pattern of the marker 4 on the video images; and a display part 23 for displaying the video images on which the electronic information is superimposed.

Description

  The present invention relates to an augmented reality display system using augmented reality (AR) technology.

  Conventionally, information on the real environment is expanded by superimposing and displaying electronic information such as images and character information created by computer graphics (CG) on video of the real environment (real space) photographed by the camera. Augmented reality technology is known.

  In this augmented reality technology, there is a method in which a marker is used as a mark for superimposing electronic information on a video photographed by a camera (see, for example, Patent Document 1).

  The marker used in this case is formed, for example, by printing a black rectangular frame having a predetermined size on a sheet made of paper or the like. When a plurality of types of markers are used, a pattern made up of characters, patterns, etc. for specifying the type of marker is provided inside the frame.

  In an augmented reality display system using such a marker, a marker placed in a real environment is photographed by a camera, and the position, orientation, size, and pattern of the marker in the video are detected. The augmented reality display system determines the position, orientation, and size of the electronic information to be superimposed on the video according to the detection result, and superimposes the electronic information on the video according to the marker pattern.

JP 2006-48484 A

  As described above, in the augmented reality display system using markers, a plurality of types of markers are used to change the electronic information to be superimposed on the video.

  If one type of marker is formed on each side of the sheet, only two types of markers can be provided at maximum per sheet. Therefore, when many types of markers are required, a large number of marker sheets must be prepared, which is inconvenient for carrying.

  On the other hand, if a plurality of types of markers are formed on both sides of one sheet, the types of markers that can be formed per sheet can be increased. However, in such a marker sheet, even when it is desired to detect only one type of marker, other markers on the same surface are also detected, and as a result, unnecessary electronic information may be superimposed on the video. is there.

  In addition, there is a method that enables a plurality of types of markers to be switched and displayed using an electronic display device such as a liquid crystal display device, but a power source is necessary for the electronic device, which is inconvenient to carry in terms of weight and flexibility. There is an inconvenience.

  The present invention has been made in view of the above, and uses a marker that does not require a power source and can express many patterns while being excellent in portability, and there is unnecessary electronic information when superimposing electronic information corresponding to each marker on a video. An object of the present invention is to provide an augmented reality display system that can avoid being superimposed on video.

  In order to achieve the above object, the first feature of the augmented reality display system according to the present invention is that a colored portion is formed on at least a part of at least one of the front surface and the back surface and is folded in a plurality of procedures. Then, a marker having a sheet capable of individually expressing a plurality of patterns by the colored portion and the other portion, a photographing device for photographing a region including the marker, and electronic information on an image photographed by the photographing device An augmented reality display device that superimposes and displays the augmented reality display device, wherein the augmented reality display device detects the marker in the video imaged by the imaging device, and the marker detection unit detects the marker. A superimposing unit that superimposes electronic information corresponding to a marker pattern on an image captured by the imaging device, and a display unit that displays an image on which electronic information is superimposed on the superimposing unit. In the door.

  A second feature of the augmented reality display system according to the present invention is that a colored portion is formed on at least a part of at least one of the front surface and the back surface, and is folded in a plurality of procedures, so that the colored portion and the other are And a marker having a sheet that can individually express a plurality of patterns by the portion, an imaging device that captures an area including the marker, and an image captured by the imaging device via a network. A server device that superimposes electronic information on the computer, and an augmented reality display device that acquires and displays a video on which the electronic information is superimposed on the server device via a network. A marker detection unit for detecting the marker in the recorded video, and electronic information corresponding to the marker pattern detected by the marker detection unit. In further comprising a superimposing unit for superimposing the video.

  In the augmented reality display system according to the present invention, the marker can represent a character symbol string including at least one of a character and a symbol by the plurality of patterns, and the superimposing unit includes the character symbol string. It is preferable to superimpose electronic information related to the information indicated by the image.

  According to the first feature of the augmented reality display system according to the present invention, since the marker having a sheet that can be individually expressed by a colored portion and another portion by being folded is used, the marker is a power source. It is unnecessary and can be expressed with many patterns while being portable, and when a desired pattern is completed, only one marker is expressed, so it is unnecessary when superimposing electronic information corresponding to the marker on the video It is possible to avoid superimposing electronic information on the video.

  According to the second feature of the augmented reality display system of the present invention, the augmented reality display device has the same effect as the first feature and performs processing for superimposing electronic information on the video by the server device. Can provide the user with a video on which electronic information is superimposed without installing software related to augmented reality technology.

  In addition, the character symbol string can be expressed by the marker pattern, and the electronic information related to the information indicated by the character symbol string is superimposed on the video, so that the content of the electronic information can be strongly impressed to the user. .

1 is a schematic configuration diagram of an augmented reality display system according to a first embodiment. It is a block diagram which shows the function structure of the augmented reality display system which concerns on 1st Embodiment. It is a figure which shows the structure of the sheet | seat for forming the marker in 1st Embodiment. It is a figure which shows an example of the sheet | seat in 1st Embodiment. It is a figure which shows an example of each pattern which can be formed with the sheet | seat in 1st Embodiment. It is a figure which shows the hardware structural example of an augmented reality display apparatus. It is a figure which shows an example of the image | video with which the electronic information was superimposed. It is a block diagram which shows the function structure of the augmented reality display system which concerns on 2nd Embodiment. It is a figure which shows the structure of the marker in 2nd Embodiment. It is a figure which shows an example of how to fold the sheet | seat in the marker of 2nd Embodiment. It is a figure which shows the specific example of the pattern which can be expressed with the sheet | seat in the marker of 2nd Embodiment. It is a figure which shows the other example of the image | video with which the electronic information was superimposed.

  Embodiments of the present invention will be described below with reference to the drawings. Throughout the drawings, the same or equivalent parts and components are denoted by the same or equivalent reference numerals, and the description thereof is omitted or simplified.

(First embodiment)
FIG. 1 is a schematic configuration diagram of an augmented reality display system according to the first embodiment of the present invention, and FIG. 2 is a block diagram showing a functional configuration of the augmented reality display system shown in FIG.

  As shown in FIGS. 1 and 2, an augmented reality display system 1 according to a first embodiment includes an augmented reality display device 2 including an information processing device such as a personal computer (PC), and a camera (photographing device). ) 3 and a marker 4 used in augmented reality technology.

  As shown in FIG. 2, the augmented reality display device 2 includes an input unit 21, a storage unit 22, a display unit 23, a control unit 24, and a communication unit 25.

  The input unit 21 receives various input operations by the user and outputs operation signals based on the operations.

  The storage unit 22 stores electronic information corresponding to all patterns that can be expressed by the marker 4. The electronic information stored in the storage unit 22 is generated in advance using the augmented reality display device 2 or an external device. The electronic information may be read from the recording medium and taken into the augmented reality display device 2 or may be taken into the augmented reality display device 2 via the network or the like by the communication unit 25. As the electronic information, a three-dimensional (3D) model created by computer graphics, a real image, animation, character information, or the like can be used.

  The display unit 23 displays an image captured by the camera 3 and electronic information superimposed on the image.

  The control unit 24 includes a camera control unit 241 that controls the camera 3 connected to the augmented reality display device 2, a marker detection unit 242 that detects the marker 4 in the video captured by the camera 3, and a marker detection unit 242. Are provided with a superimposing unit 243 that superimposes electronic information corresponding to the pattern of the marker 4 detected in step S3 on the video imaged by the camera 3, and a display control unit 244 that controls display on the display unit 23.

  The communication unit 25 is for connecting the augmented reality display device 2 to a network such as the Internet.

  The camera 3 includes a web camera connected to the augmented reality display device 2. The camera 3 is configured to be able to change the shooting direction in accordance with a user operation or the like.

  The marker 4 includes a black rectangular frame and a pattern made up of characters, patterns, etc. displayed inside the frame. The type of marker is specified by the pattern in the frame.

  The marker 4 in the present embodiment is configured using a sheet 5 as shown in FIG. The sheet 5 is made of a thin sheet-like foldable material such as paper and has a square outer shape with a central portion cut out. The cut-out central portion of the sheet 5 is a square whose one side is half the length of one side of the outer shape.

  And as shown to Fig.3 (a), (b), the twelve square grids divided | segmented by the broken line in a figure are formed in both surfaces of the sheet | seat 5, respectively. A broken line that divides each square indicates a crease line that is folded into a mountain or a valley by the user.

  The alphabets “A” to “F” shown in each square in the figure indicate the correspondence between the squares. One type of marker is formed by combining squares of the same alphabet.

  For example, the crease lines 6a, 6c, 6f, and 6h in FIG. 3A are valley-folded, and the crease lines 6b, 6d, 6e, and 6g are fold-folded to obtain “A” as shown in FIG. The marker 4 is formed by combining the squares corresponding to "." The above folding method is an example, and the marker 4 corresponding to “A” can be formed by other folding methods.

  For example, a pattern as shown in FIG. 4A is formed in each of the four cells corresponding to “A”. In FIG. 4A, the portion painted black is a portion colored black in the sheet 5, and the other portion not colored is a white portion which is the background color of the sheet 5. In addition, colored portions for forming markers having patterns corresponding to the alphabets “B” to “F” are also formed, but the illustration is omitted here. .

  When the user performs the operation of folding the sheet 5 as shown in FIG. 4A according to the above-described procedure, a black frame and a pattern made up of characters “abcd” as shown in FIG. 4B are provided. A marker 4 is formed.

  Thus, the sheet 5 is an origami puzzle that completes the marker 4 by performing a folding operation by the user. Six kinds of markers 4 corresponding to “A” to “F” can be individually expressed by one sheet 5 by the colored portion formed in each square and the other portions.

  In the sheet 5 as described above, if the height of each cell in the marker 4 varies due to the elasticity of the folded sheet 5, the marker 4 may be difficult to be detected by the augmented reality display device 2 due to the influence of light shading. is there. In order to avoid this, the marker 4 may be sandwiched using a colorless and transparent acrylic plate or the like.

  It is desirable that each pattern that can be expressed on one sheet 5 is a character or a symbol, and that each pattern can express a meaningful character / symbol string. Furthermore, it is desirable to superimpose electronic information related to the information indicated by the character symbol string on the video.

  For example, a character string “printer X” can be expressed by markers of each pattern that can be expressed by the sheet 5 as shown in FIG. And the electronic information superimposed on an image | video corresponding to such a marker is set as the information regarding a printer (printing apparatus). In this way, the user can be motivated to complete the origami puzzle, and the contents of the electronic information can be strongly impressed.

  Here, a specific hardware configuration of the augmented reality display device 2 will be described. FIG. 6 is a diagram illustrating a hardware configuration example of the augmented reality display device 2.

  In FIG. 6, a CPU 101, a RAM 102, a ROM 103, and an input / output interface 108 are connected via a bus 109. An input device 104, a storage device 105, a display device 106, and a communication control device 107 are connected to the input / output interface 108.

  The CPU 101 is a central processing unit that controls the entire augmented reality display device 2 and performs the function of the control unit 24 of FIG.

  The RAM 102 is used as a work area for the CPU 101 during temporary data storage and calculation. The ROM 103 stores an operation program at the time of startup.

  The input device 104 includes a keyboard, a mouse, and the like, and fulfills the function of the input unit 21 in FIG.

  The storage device 105 is composed of a hard disk or the like and fulfills the function of the storage unit 22 in FIG. 2, and stores electronic information to be superimposed on the video imaged by the camera 3. The storage device 105 stores various programs such as application software related to augmented reality technology. The functions of the camera control unit 241, the marker detection unit 242, the superimposition unit 243, and the display control unit 244 of the control unit 24 in FIG. 2 are realized by the CPU 101 reading the program from the storage device 105 into the RAM 102 and executing the program.

  The display device 106 includes a liquid crystal display and the like, and corresponds to the display unit 23 in FIG.

  The communication control device 107 fulfills the function of the communication unit 25 in FIG. 2 and is a device for communicating by connecting the augmented reality display device 2 to a network such as the Internet.

  Next, the operation of the augmented reality display system 1 in the first embodiment will be described.

  In the present embodiment, the user performs the folding operation according to the procedure corresponding to “A” to “F” in the sheet 5 illustrated in FIG. 3, thereby performing “p”, “re”, “ It is assumed that a pattern capable of forming the marker 4 having a pattern of six characters “n”, “ta”, “−”, and “X” is formed in each square of the sheet 5. Further, it is assumed that electronic information superimposed on the video corresponding to the marker 4 is stored in the storage unit 22. Further, as shown in FIG. 5, it is assumed that the marker should be completed in the order of “p” → “re” → “n” → “ta” → “−” → “X”.

  In the augmented reality display system 1, when the marker 4 is not placed in an area photographed by the camera 3, the image photographed by the camera 3 is displayed as it is on the display unit 23 of the augmented reality display device 2.

  When the user completes the marker 4 having the pattern “P” using the sheet 5 and places the marker 4 in an area photographed by the camera 3, the marker detection unit 242 captures the image from the image photographed by the camera 3. The position, orientation, and size of the upper marker 4 are detected, and the pattern of the marker 4 is detected using a known template matching method or the like.

  Next, the superimposing unit 243 acquires electronic information corresponding to the pattern of the marker 4 detected by the marker detecting unit 242 from the storage unit 22 and superimposes the electronic information on the video imaged by the camera 3. At this time, the superimposing unit 243 determines the position, orientation, and size of the electronic information to be superimposed on the video by using augmented reality technology based on the position, orientation, and size of the marker 4 detected by the marker detecting unit 242.

  Then, the display control unit 244 performs control so that the video on which the electronic information is superimposed by the superimposing unit 243 is displayed on the display unit 23.

  An example of an image on which electronic information displayed on the display unit 23 is superimposed is shown in FIG. In FIG. 7, for the sake of simplification, the subjects other than the marker 4 are not shown.

  In the present embodiment, it is assumed that the electronic information superimposed on the video is information related to “printer X” which is a new product of the printing apparatus. In the video shown in FIG. 7, as electronic information corresponding to the “P” pattern, an image 30 indicating the appearance of the printing apparatus and character information 31 indicating the guidance of a new product are superimposed.

  In augmented reality technology, if the position, orientation, or size of the marker in the video changes due to the camera 3 changing its orientation or moving the marker 4 during shooting, The display position of the superimposed electronic information also varies. Particularly in the 3D model, the angle of the 3D model varies depending on the direction of the marker. Therefore, if the image 30 of the printing apparatus is a 3D model, the user can view the 3D model of the printing apparatus of various angles by changing the posture of the marker 4 or the like.

  When the image on which the electronic information corresponding to the “P” pattern is superimposed is confirmed, it is the marker 4 of the “Re” pattern that the user should complete next. As shown in FIG. 7, character information 32 for informing the user of this order may be superimposed on the video.

  When the user completes the marker 4 having the pattern “Li” and places the marker 4 in an area photographed by the camera 3, the augmented reality display device 2 performs “Li” according to the same procedure as described above. A video (not shown) on which electronic information corresponding to the pattern is superimposed is displayed. The same applies to the patterns “n”, “ta”, “−”, and “X”.

  In this example, the electronic information superimposed on the video according to each pattern is information on a new product of the printing apparatus, but the contents of each electronic information displayed in order according to the pattern order are continuity and story characteristics. It is desirable to have regularity. By doing in this way, the content of electronic information can be impressed more strongly to a user.

  As described above, according to the first embodiment, by using the sheets 5 constituting the origami puzzle, the markers 4 having many patterns can be formed with a small number of sheets 5. Since the sheet 5 is made of paper or the like, the power source is unnecessary and the portability is excellent.

  In addition, the user can obtain information superimposed on the video by the augmented reality technology while enjoying the origami puzzle.

  Further, when a desired pattern is completed, only one marker is expressed, so that other markers are detected in the video, and as a result, unnecessary electronic information can be avoided from being superimposed on the video.

(Second Embodiment)
FIG. 8 is a block diagram showing a functional configuration of the augmented reality display system according to the second embodiment of the present invention. As shown in FIG. 8, the augmented reality display system 1A according to the second embodiment is roughly configured to include an augmented reality display device 2A, a camera 3, a marker 4, and a server device 6. . The augmented reality display device 2A and the server device 6 can be connected via a network 10 such as the Internet.

  The augmented reality display device 2 </ b> A includes an input unit 21, a display unit 23, a communication unit 25, and a control unit 26.

  The input unit 21, the display unit 23, and the communication unit 25 are the same as those in the augmented reality display device 2 of the first embodiment shown in FIG.

  The control unit 26 includes a camera control unit 261 that controls the camera 3 connected to the augmented reality display device 2 </ b> A, and a browser unit 262 for browsing a website published by the server device 6 on the network 10.

  The camera 3 is a web camera connected to the augmented reality display device 2A. The marker 4 includes a sheet 5 constituting the origami puzzle described in the first embodiment.

  The server device 6 superimposes electronic information on the video captured by the camera 3 using augmented reality technology on the augmented reality display device 2A accessed via the network 10, and displays the video on which the electronic information is superimposed. Has the function to provide. The server device 6 includes a storage unit 61, a control unit 62, and a communication unit 63.

  The storage unit 61 stores electronic information corresponding to each pattern that can be expressed by the marker 4.

  The control unit 62 corresponds to the marker detection unit 621 that detects the marker 4 in the video captured by the camera 3 sent from the augmented reality display device 2A, and the pattern of the marker 4 detected by the marker detection unit 621. A superimposing unit 622 that superimposes electronic information on the video imaged by the camera 3.

  The communication unit 63 communicates with the augmented reality display device 2A via the network 10 to transmit / receive data such as video.

  The augmented reality display device 2A and the server device 6 as described above can also be realized with a hardware configuration equivalent to the configuration shown in FIG.

  Next, the operation of the augmented reality display system 1A in the second embodiment will be described.

  Here, it is assumed that the trader provides the marker 4 (sheet 5) to the user using direct mail and provides a service using augmented reality technology using the marker 4. The server device 6 is assumed to be a server that publishes the website of a direct mail sender.

  The browser unit 262 of the augmented reality display device 2A accesses a web page for viewing a video based on augmented reality technology on the website of the supplier of the direct mail in response to a user operation. Then, the browser unit 262 transmits the video captured by the camera 3 to the server device 6.

  The marker detection unit 621 of the server device 6 performs processing for detecting the marker 4 from the video received from the augmented reality display device 2A. When the marker 4 is not detected in the video, the process of superimposing the electronic information by the superimposing unit 622 is not performed, and the control unit 62 adds the video received from the augmented reality display device 2A to a predetermined area of the web page. Is transmitted to the augmented reality display device 2A.

  When the data from the server device 6 is received, the browser unit 262 of the augmented reality display device 2A causes the display unit 23 to display a web page having an area for displaying an image in the browser screen. In a state where the marker 4 is not placed in the area photographed by the camera 3, the video photographed by the camera 3 is displayed as it is on the browser screen.

  When the user completes the marker 4 having the pattern “P” from the sheet 5 and places the marker 4 in an area photographed by the camera 3, the marker detection unit 621 of the server device 6 causes the augmented reality display device 2A. The position, orientation, and size of the marker 4 on the image are detected from the image captured by the camera 3 received from the above, and the pattern of the marker 4 is detected.

  Next, the superimposing unit 622 acquires electronic information corresponding to the pattern of the marker 4 detected by the marker detecting unit 621 from the storage unit 61, and superimposes this electronic information on the video imaged by the camera 3. At this time, the superimposing unit 622 determines the position, orientation, and size of the electronic information to be superimposed on the video based on the augmented reality technology based on the position, orientation, and size of the marker 4 detected by the marker detecting unit 621.

  Then, the superimposing unit 622 transmits the video on which the electronic information is superimposed to the augmented reality display device 2A via the communication unit 63.

  The browser unit 262 of the augmented reality display device 2A displays the video on which the electronic information is superimposed by the superimposing unit 622 in the server device 6 on the browser screen.

  As a result, a video on which electronic information is superimposed is displayed in the browser screen, similar to FIG. 7 described in the first embodiment. Thereafter, as in the first embodiment, when the user sequentially completes the markers 4 of each pattern and places the markers 4 in the area photographed by the camera 3, an electronic device corresponding to each pattern is obtained accordingly. A video on which information is superimposed is displayed in the browser screen.

  In the second embodiment as described above, the same effect as that of the first embodiment can be obtained by using the sheet 5 made of an origami puzzle in which a plurality of types of markers 4 can be individually formed. In addition, since the server device 6 performs processing for superimposing electronic information on video by using augmented reality technology, the electronic information is superimposed on the augmented reality display device 2A without installing software related to augmented reality technology. Video can be provided to the user.

  In addition, in each said embodiment, although the marker 4 formed using the sheet | seat 5 as shown in FIG. 3 was used, a marker is not restricted to such a thing. What is necessary is just to have the sheet | seat which can express a some pattern separately by the colored part and other part which were formed in at least one part of at least any one. For example, you may use the marker 7 comprised by the sheet | seat 7a and the marker frame 7b as shown in FIG.

  The sheet 7a is made of a thin sheet-like foldable material such as paper, and as shown in FIG. 9A, the outer shape is square and one surface is white, which is the background color of the sheet 7a. The other surface is colored black.

  By folding the sheet 7a, for example, a pattern as shown in FIG. The marker 7 is formed by placing the sheet 7a folded in this pattern within the black rectangular marker frame 7b as shown in FIG. 9C.

  The marker frame 7b may be formed on a colorless and transparent acrylic plate, for example, and the folded sheet 7a may be sandwiched between the acrylic plate and a white plate. Thereby, as shown in FIG.9 (c), areas other than the colored part of the sheet | seat 7a can be whitened.

  The pattern shown in FIG. 9B is formed, for example, by folding the sheet 7a according to the procedure shown in FIG. First, one of the vertices of the sheet 7a is folded as shown in FIG. Next, the one produced by the procedure of FIG. 10A is turned over, and as shown in FIG. 10B, it is folded back by one third from the right side in the figure. And as shown in FIG.10 (c), it completes by folding back only 1/3 from the upper side in the figure.

  A sheet like the sheet 7a can form various patterns depending on how it is folded. For example, it is known that there is a folding method that can form various patterns as shown in FIG.

  In addition, in FIG. 11, although the external shape of each pattern is drawn by the same magnitude | size, the magnitude | size is not necessarily the same. Further, various patterns can be formed other than the pattern in which the folding is square as shown in FIG. If the inner dimension of the marker frame 7b is set to be equal to or greater than the outer dimension of the sheet 7a, the folded sheet 7a can be placed in the marker frame 7b in any pattern.

  When such a marker 7 is used, more patterns can be formed from one sheet 7a than the marker 4 in each of the above embodiments. In the augmented reality display system 1, 1 </ b> A, a plurality of patterns that can be formed by the marker 7 are set in advance, and electronic information corresponding to these patterns is stored in the storage units 22 and 61.

  Such a marker 7 is not suitable for use in a purpose of expressing a meaningful character / symbol string by each pattern, like the marker 4 in each of the above embodiments. Therefore, the marker 7 may be used for providing the user with an origami puzzle as entertainment. In this case, for example, when the user completes a predetermined pattern, the augmented reality display systems 1 and 1A may display an image on which electronic information 33 as shown in FIG. 12 is superimposed.

DESCRIPTION OF SYMBOLS 1,1A Augmented reality display system 2,2A Augmented reality display apparatus 3 Camera 4,7 Marker 5,7a Sheet 7b Marker frame 6 Server apparatus 21 Input part 22,61 Storage part 23 Display part 24,26,62 Control part 25, 63 Communication unit 241, 261 Camera control unit 242, 621 Marker detection unit 243, 622 Superimposition unit 244 Display control unit 262 Browser unit

Claims (2)

A colored portion is formed on at least a part of at least one of the front surface and the back surface, and has a sheet that can be individually expressed in a plurality of patterns by the colored portion and other portions by being folded in a plurality of procedures. Markers,
An imaging device for imaging an area including the marker;
An augmented reality display device that superimposes and displays electronic information on the video imaged by the imaging device,
The augmented reality display device includes:
A marker detection unit for detecting the marker in the video imaged by the imaging device;
A superimposing unit that superimposes electronic information corresponding to the marker pattern detected by the marker detecting unit on an image captured by the imaging device;
An augmented reality display system comprising: a display unit configured to display an image on which electronic information is superimposed by the superimposing unit. A colored portion is formed on at least a part of at least one of the front surface and the back surface, and has a sheet that can be individually expressed in a plurality of patterns by the colored portion and other portions by being folded in a plurality of procedures. Markers,
An imaging device for imaging an area including the marker;
A server device for acquiring a video imaged by the imaging device via a network and superimposing electronic information on the acquired video image;
An augmented reality display device that acquires and displays a video on which electronic information is superimposed on the server device via a network;
The server device
A marker detection unit for detecting the marker in the video imaged by the imaging device;
An augmented reality display system comprising: a superimposing unit that superimposes electronic information corresponding to the marker pattern detected by the marker detecting unit on an image captured by the imaging device.

Images