JP2012003306A - Marker - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a plurality of patterns without power supply in a marker used for an augmented reality system.SOLUTION: The marker is used for the augmented reality system for superimposing electronic information onto a video photographing a real environment, is placed in the real environment as an index for superimposing the electronic information onto the video, and includes a pattern presentation part for presenting a pattern corresponding to the electronic information superimposed onto the video. The pattern presentation part has a change part which changes due to external factors and in which patterns change as the change part changes.

Description

  The present invention relates to a marker used in an augmented reality display system using augmented reality (AR) technology.

  Conventionally, an extension for extending information in the real environment by superimposing electronic information such as images and character information created by computer graphics (CG) on the video of the real environment (real space) photographed by the photographing device. Reality technology is known.

  In this augmented reality technology, there is a method of using a marker as an index for superimposing electronic information on a video imaged by an imaging device (see, for example, Patent Document 1).

  The marker used in this case is formed by, for example, printing a black rectangular frame having a preset size on a sheet such as paper. When a plurality of types of markers are used, a pattern made up of characters, patterns, etc. for specifying the type of marker is provided inside the frame.

  In an augmented reality display system using such a marker, a region including the marker placed in the real environment is photographed by a photographing device, the marker in the image is detected, and electronic information corresponding to the marker pattern is displayed in the image. Superimpose on. Further, the augmented reality display system determines the position, orientation, and size of electronic information to be superimposed on the video according to the position, orientation, and size of the marker in the video.

JP 2006-48484 A

  In the augmented reality display system using the marker as described above, one pattern is fixed to one marker. For this reason, when a plurality of patterns are required, the number of markers increases, which is inconvenient for management.

  On the other hand, there is a method of switching and displaying a plurality of patterns of markers using an electronic display device such as a liquid crystal display device, but a power source is required because an electronic device is used.

  The present invention has been made in view of the above, and an object thereof is to provide a marker that can be used in an augmented reality system and that can display a plurality of patterns without a power source.

  In order to achieve the above object, the first feature of the marker according to the present invention is used in an augmented reality system that superimposes electronic information on a video obtained by photographing a real environment. A pattern presenting unit that presents a pattern corresponding to the electronic information superimposed on the video, and the pattern presenting unit has a changing unit that changes due to an external factor. The pattern is changed by the change of the changing portion.

  A second feature of the marker according to the present invention is that the external factor includes at least one of humidity, ultraviolet light, temperature, and a change with time.

  In the marker according to the present invention, the pattern may be changed by a two-dimensional or three-dimensional physical change of the pattern presenting unit according to a change of the changing unit due to the external factor.

  The augmented reality system using the marker according to the present invention includes an imaging device, a marker detection unit that detects the marker in an image captured by the imaging device, and the pattern of the marker detected by the marker detection unit. And a superimposing unit that superimposes electronic information corresponding to the image captured by the image capturing apparatus.

  According to the first feature of the marker of the present invention, since the pattern changes due to an external factor, a plurality of patterns can be displayed without a power source.

  According to the second feature of the marker according to the present invention, the pattern changes due to an external factor including at least one of humidity, ultraviolet light, temperature, and change over time, and therefore the marker is placed in a predetermined environment. Only a plurality of patterns can be displayed without a power source.

  In the marker according to the present invention, the pattern can be changed without a power source so that the pattern is changed by a two-dimensional or three-dimensional physical change of the pattern presenting unit according to an external factor.

  According to the augmented reality system using markers according to the present invention, by using a marker whose pattern changes due to an external factor, electronic information corresponding to a plurality of patterns with one marker without using a power source for the marker. Can be superimposed on the video.

It is a block diagram which shows the function structure of the augmented reality system using the marker which concerns on 1st Embodiment. It is a top view of the marker which concerns on 1st Embodiment. It is AA sectional drawing in FIG. It is sectional drawing of the panel which changes color by the effect | action of the ultraviolet-ray in the marker shown in FIG. (A) is a figure which shows the state which the panel discolored in the marker shown in FIG. 2, (b) is. It is a figure which shows the state which the discoloration of the panel further advanced from (a). It is a top view of the marker which concerns on 2nd Embodiment. It is a disassembled perspective view of the marker shown in FIG. It is AA sectional drawing in FIG. (A) is a figure which shows the state which the discoloration layer changed in the marker shown in FIG. 6, (b) is a figure which shows the state which the movable layer moved in the marker shown in FIG. It is a top view of the marker which concerns on 3rd Embodiment. It is a disassembled perspective view of the marker shown in FIG. It is AA sectional drawing in FIG. It is a figure which shows a pattern when an expansion member expand | swells in the marker shown in FIG. It is a top view of the marker which concerns on 4th Embodiment. It is a disassembled perspective view of the marker shown in FIG. It is AA sectional drawing in FIG. It is a figure which shows a pattern when an organic material discolors in the marker shown in FIG. It is a disassembled perspective view of the marker which concerns on the modification of 4th Embodiment. FIG. 17 is a cross-sectional view corresponding to FIG. 16 in the fourth embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. Throughout the drawings, the same or equivalent parts and components are denoted by the same or equivalent reference numerals. However, it should be noted that the drawings are schematic and different from the actual ones. Moreover, it is a matter of course that portions having different dimensional relationships and ratios are included between the drawings.

  Each embodiment shown below exemplifies an apparatus or the like for embodying the technical idea of the present invention. The technical idea of the present invention is the arrangement of each component as described below. It is not something specific. The technical idea of the present invention can be variously modified within the scope of the claims.

(First embodiment)
FIG. 1 is a block diagram showing a functional configuration of an augmented reality system using markers according to the first embodiment of the present invention. As shown in FIG. 1, the augmented reality system 1 is schematically configured by a photographing device 2, a video processing device 3, and a display device 4. The augmented reality system 1 extends the information of the real environment by detecting a marker in the video of the real environment photographed by the photographing device 2 and superimposing electronic information corresponding to the pattern on the video.

  First, a marker used in the augmented reality system 1 in the first embodiment will be described.

  FIG. 2 is a plan view of the marker according to the first embodiment, and FIG. 3 is a cross-sectional view taken along line AA in FIG. As shown in FIGS. 2 and 3, the marker 5 according to the first embodiment includes panels 51A to 51H and a case 52 that houses the panels 51A to 51H.

  The panels 51A to 51H are made of, for example, a substantially square plate-like body made of PET (polyethylene terephthalate) or the like, and are formed in white or black by painting or the like. When the panels 51A to 51H are placed in the case 52, a black and white pattern is formed, and the panels 51A to 51H constitute the pattern presentation unit of the present invention.

  Some of the panels 51A to 51H are configured to be discolored by the action of ultraviolet rays. Here, it is assumed that the panel 51B is configured to change color by the action of ultraviolet rays. In this case, the panel 51B corresponds to the changing portion of the present invention.

  FIG. 4 is a cross-sectional view of the panel 51B. As shown in FIG. 4, the panel 51 </ b> B includes a base material layer 511 made of PET or the like, and a protective film layer 512 formed on the base material layer 511.

  The base material layer 511 is formed in white by painting or the like, and photochromic is applied thereon. The protective film layer 512 is a layer for protecting this photochromic, and is made of a colorless and transparent resin or the like.

  Photochromic develops a color change when it receives ultraviolet rays. For example, color change such as “colorless → orange” using azobenzene as photochromic, “colorless → red” using diarylethene, and “colorless → purple” using biradical can be developed. The photochromic color change is reversible.

  The case 52 includes a bottom plate 53 and an outer frame 54 that forms an outer peripheral wall around the bottom plate 53. As shown in FIG. 2, a black rectangular marker frame 55 is formed on the upper surface 54a of the outer frame 54 by painting or the like. The periphery of the marker frame 55 is white due to painting or the like. With the pattern formed by the marker frame 55 and the panels 51 </ b> A to 51 </ b> H inside the marker frame 55, the marker 5 in the image captured by the image capturing device 2 is detected and identified in the image processing device 3.

  The upper surface 54 a of the outer frame 54 and the upper surfaces of the panels 51 </ b> A to 51 </ b> H disposed in the case 52 preferably have the same height. For example, if the upper surface 54a of the outer frame 54 is higher, a shadow is generated, which may cause inconvenience in detection of the marker 5 in the video processing device 3, so that the occurrence of such a shadow is prevented.

  In the marker 5 as described above, a plurality of patterns can be formed by the user changing the arrangement of the panels 51A to 51H. In addition to the change in the arrangement of the panels 51A to 51H, the video processing apparatus 3 recognizes that the pattern has also changed by changing the color of the panel (panel 51B) that changes color due to ultraviolet rays.

  The imaging device 2 of the augmented reality system 1 images a real environment (real space) and sends the obtained video to the video processing device 3.

  The video processing device 3 includes a marker detection unit 31, a superimposition unit 32, a storage unit 33, and an interface unit 34.

  The marker detection unit 31 detects the position, orientation, and size of the marker 5 in the video imaged by the imaging device 2, and detects the pattern of the marker 5 using a known template matching method or the like.

  In the pattern detection, the marker detection unit 31 detects the density at the marker 5 in the video, and determines the pattern with reference to a portion indicating density other than white or black in the pattern. For example, the marker detection unit 31 detects a pattern in which the panel 51B is discolored as shown in FIG. 5A as a different pattern from the pattern shown in FIG.

  In the marker detection unit 31, a threshold value of density for detecting a portion other than white or black may be set in a plurality of stages. Thereby, for example, the marker detection unit 31 recognizes the pattern of FIG. 2 and the pattern of FIG. 5A as different patterns as described above, and further, for the pattern of FIG. Patterns having different densities on the panel 51B as shown in FIG. 5B are detected as different patterns.

  The superimposing unit 32 acquires electronic information corresponding to the pattern of the marker 5 detected by the marker detecting unit 31 from the storage unit 33 and superimposes the electronic information on the video imaged by the imaging device 2. Based on the position, orientation, and size of the marker 5 detected by the marker detection unit 31, the superimposing unit 32 determines the position, orientation, and size of the electronic information to be superimposed on the video using augmented reality technology.

  The storage unit 33 stores electronic information generated in advance corresponding to each pattern of the marker 5 detected by the marker detection unit 31. As the electronic information, a three-dimensional (3D) model created by computer graphics, a real image, animation, character information, or the like can be used.

  The interface unit 34 is for transmitting and receiving data between the photographing device 2 and the display device 4.

  The video processing device 3 is configured by a computer including a CPU, a RAM, a ROM, a storage device such as a hard disk, an input / output interface, and the like. The functions of the marker detection unit 31 and the superimposition unit 32 are realized by the CPU reading and executing an application program related to augmented reality technology stored in a storage device such as a hard disk. The storage unit 33 is configured as a function of a storage device such as a hard disk, and the interface unit 34 is configured as a function of an input / output interface physically connected to the imaging device 2 and the display device 4.

  The display device 4 displays the video imaged by the imaging device 2 and the electronic information superimposed on the video image.

  Next, the operation of the augmented reality system 1 will be described.

  The imaging device 2 captures an area where the marker 5 is arranged, and sends the obtained video to the video processing device 3.

  When the marker detection unit 31 receives an image captured by the imaging device 2 via the interface unit 34, the marker detection unit 31 detects the position, orientation, and size of the marker 5 on the image and also detects the pattern of the marker 5.

  Next, the superimposing unit 32 acquires electronic information corresponding to the pattern of the marker 5 detected by the marker detecting unit 31 from the storage unit 33, and superimposes the electronic information on the video. At this time, the superimposing unit 32 determines the position, orientation, and size of the electronic information to be superimposed on the video based on the position, orientation, and size of the marker 5 detected by the marker detection unit 31.

  Then, the superimposing unit 32 sends the video on which the electronic information is superimposed to the display device 4 via the interface unit 34. The display device 4 displays an image on which electronic information is superimposed.

  When the panel 51B of the marker 5 changes its color upon receiving ultraviolet light, and the marker detection unit 31 detects that the pattern is different from that before the color change, the superimposition unit 32 detects the pattern of the marker 5 after the color change detected by the marker detection unit 31. Is obtained from the storage unit 33, and this electronic information is superimposed on the video.

  As the electronic information, for example, the electronic information corresponding to the pattern before the color change of the panel 51B is a certain 3D model, and the electronic information corresponding to the pattern after the color change of the panel 51B is the high 3D model corresponding to the pattern before the color change. The 3D model is extended in the vertical direction. As a result, the height of the 3D model superimposed on the video changes in accordance with the amount of ultraviolet light applied to the marker 5.

  In this way, for example, when the marker 5 is arranged in the imaging region of the imaging device 2 that is fixedly installed like a surveillance camera, the 3D model is displayed in a time zone in which the marker 5 is exposed to sunlight (ultraviolet rays). The superimposed video is displayed on the display device 4, and a 3D model that is enlarged in the height direction is superimposed in a time zone in which the amount of sunlight irradiation is large. As a result, a superimposed image that allows the user to visually recognize the change in the amount of sunlight irradiated in real time is displayed on the display device 4.

  As described above, according to the first embodiment, the marker 5 forms a pattern with the panels 51A to 51H whose arrangement can be changed. Therefore, the user can change the arrangement of the panels 51A to 51H, thereby The pattern can be changed with, and a plurality of patterns can be displayed with one marker 5. In addition, since the panel (panel 51B) that changes color due to the action of ultraviolet rays, which is an external factor, is provided, the pattern can be changed without power by simply placing the marker 5 in an environment that is exposed to ultraviolet rays. By using such a marker 5, the augmented reality system 1 can superimpose electronic information corresponding to a plurality of patterns on a video with one marker 5.

  Note that one of the panels 51A to 51H may be omitted in advance, and the pattern may be easily changed by the user sliding the panel and moving the panel. In this case, since the upper surface of the bottom plate 53 constitutes a part of the pattern, the upper surface of the bottom plate 53 is painted white or black. The outer frame 54 and the panel may be provided with grooves and protrusions so that the panel can be easily moved.

  Further, the structure may be such that the panels 51A to 51H can be prevented from falling off the marker 5. For example, a panel made of a ferromagnetic material or the like may be attached to the lower surface side of the panels 51A to 51H, and the bottom plate 53 may be made of a magnetic material so that the panels 51A to 51H can be held with magnetic force.

  In this way, for example, the marker 5 can be suspended from a wind chime or the like. When the marker 5 suspended in this manner is arranged in the imaging region of the imaging device 2 that is fixedly installed like a surveillance camera, the marker 5 in the captured image is shaken by the influence of wind or the like. The direction of the change. According to the augmented reality technology, when the orientation or the like of the marker 5 in the video fluctuates, the display of the electronic information superimposed on the video fluctuates accordingly. For this reason, according to the movement of the marker 5, it is possible to superimpose and display a 3D model or the like representing the strength of the wind, the wind direction, or the like on the video. In addition, in the same manner as described above, electronic information indicating a change in the amount of sunlight (ultraviolet rays) irradiated can be superimposed and displayed on the video according to the discoloration of the panel 51B.

  In the panel (panel 51B) that changes color by ultraviolet rays, a filter film that cuts off light in a specific ultraviolet region may be used as the protective film layer 512. In this way, it is possible to prevent the panel from causing unintended discoloration depending on the installation environment of the marker 5.

  Further, the arrangement is not limited to 2 × 4 as shown in FIG. 2 and the like, and other arrangements such as 2 × 2, 3 × 3 may be used.

  Moreover, you may use the panel which changes color with the temperature and pressure as an external factor for some panels among the panels 51A-51H.

(Second Embodiment)
6 is a plan view of the marker according to the second embodiment, FIG. 7 is an exploded perspective view of the marker shown in FIG. 6, and FIG. 8 is a cross-sectional view taken along line AA in FIG. Note that the configuration of the augmented reality system using the marker according to the second embodiment is the same as that of the augmented reality system 1 of FIG. 1 described in the first embodiment, and thus description thereof is omitted. The same applies to other embodiments.

  As shown in FIGS. 6 to 8, the marker 6 according to the second embodiment includes a base layer 61, a movable layer 62, and a surface layer 63.

  The base layer 61 forms the bottom plate of the marker 6 and is made of a rectangular plate-like body such as resin or wood. The periphery of the base layer 61 is surrounded by an outer frame 64 made of the same material as the base layer 61.

  The movable layer 62 is made of a rectangular plate-like body such as resin or wood, and is disposed above the base layer 61. In the movable layer 62, a plurality of black regions 62a elongated in the front-rear direction in the figure are formed by printing or the like. The area other than the black area 62a of the movable layer 62 is white. An expansion member 65 is attached to the movable layer 62 along the left side of the figure, and the expansion member 65 is fixed to the outer frame 64 via a plurality of support members 66.

  The expansion member 65 is made of a material having a property that the volume expands when moisture is absorbed. For example, the expansion member 65 is made of a polymer such as sodium polyacrylate or compressed towel fiber. Due to the expansion of the expansion member 65, the movable layer 62 moves to the right in the figure. In order to allow the movable layer 62 to move, a predetermined space is provided between the right side of the movable layer 62 in the figure and the outer frame 64 when the expansion member 65 is not expanded. ing. The expansion member 65 corresponds to a part of the changing portion of the present invention.

  The support members 66 are arranged at a predetermined interval in the front-rear direction of the figure, and fix the outer frame 64 and the expansion member 65. A space between the support members 66 communicates with the outside through a hole 64 a provided in the outer frame 64. Humidity or moisture in the air is introduced from the hole 64a, and the expansion member 65 is expanded. The introduction of moisture and moisture may be controlled by closing the hole 64a with a seal or removing the seal.

  The surface layer 63 is made of, for example, a colorless and transparent rectangular resin film such as PET. The surface layer 63 is fixed to the upper surface of the outer frame 64 and the support member 66. A black rectangular marker frame 68 is formed on the surface layer 63 by printing or the like. When printing on the surface layer 63, it is preferable to print on the lower surface side in order to prevent the printed portion from being scratched. The ink used for printing is preferably resistant to moisture and moisture and has good fixability to the material of the surface layer 63.

  On the upper surface of the surface layer 63, a plurality of thin and thin discoloration layers 69 are arranged at predetermined intervals in the front-rear direction of the drawing inside the marker frame 68.

  The discoloration layer 69 is configured by adding a coloring material that develops color by moisture to a material such as a hygroscopic polymer. The discoloration layer 69 is white when it does not absorb moisture, and discolors by the action of the coloring material when it absorbs moisture. For example, silica gel can be used as the coloring material. The discoloration layer 69 corresponds to a part of the change portion of the present invention.

  In the surface layer 63, the area | region 70 between each discoloration layer 69 is colorless and transparent. A region 71 between the discoloration layer 69 and the marker frame 68 located at both ends and a region outside the marker frame 68 are white due to printing or the like.

  When the expansion member 65 is not expanded, the discoloration layer 69 is located above the black region 62a of the movable layer 62 so that the black region 62a is not visually recognized when viewed from the upper surface side of the marker 6. The right end portion of the expansion member 65, the support member 66, the movable layer 62, and the like are positioned below the discoloration layer 69 and the region 71 and are not visible from the upper surface side of the marker 6.

  With such a configuration, in the initial state, all the portions of the marker 6 other than the marker frame 68 are visually recognized as white. From the pattern in the initial state, the pattern in the marker 6 changes due to the color change due to moisture absorption of the color change layer 69 and the movement of the movable layer 62 due to the expansion of the expansion member 65. The movable layer 62, the surface layer 63, and the color changing layer 69 constitute the pattern presenting unit of the present invention.

  Next, the operation of the marker 6 in the second embodiment will be described.

  When the discoloration layer 69 absorbs moisture and changes color due to the action of the color forming material from the initial state where it is visually recognized white except for the marker frame 68 described above, a pattern as shown in FIG. Note that the concentration of the discoloration layer 69 changes depending on the amount of absorbed moisture.

  Then, when the expansion member 65 absorbs moisture and expands, the movable layer 62 moves to the right, and the black region 62a moves directly below the region 70 of the surface layer 63. As a result, a pattern in which the region 70 between the color changing layers 69 appears black as shown in FIG. 9B is formed.

  Thus, in the marker 6, the pattern changes due to the color change of the color change layer 69 caused by external factors such as humidity. Further, the pattern changes due to a two-dimensional physical change in which the movable layer 62 moves rightward due to the expansion of the expansion member 65. By such a method, the pattern can be largely changed with a small amount of movement of the movable layer 62.

  In FIGS. 9A and 9B, the movable layer 62 is shown to move after the color change of the color change layer 69, but this order may be reversed or parallel. This can be set by closing the hole 64a of the outer frame 64 with a seal or removing the seal to control the introduction of moisture and moisture.

  As described above, according to the marker 6 in the second embodiment, the pattern can be formed with no power source by discoloration of the discoloration layer 69 due to moisture absorption and movement of the movable layer 62 only by placing it in an environment with moisture or moisture. It can be changed and multiple patterns can be displayed.

  The pattern 6 may be changed only by the movement of the movable layer 62 by omitting the color-changing layer 69 in the marker 6 and making the portion corresponding to the color-changing layer 69 in the surface layer 63 white by printing or the like.

  Alternatively, the movable layer 62 may be omitted from the marker 6 and the pattern may be changed only by the color change of the color change layer 69.

(Third embodiment)
10 is a plan view of a marker according to the third embodiment, FIG. 11 is an exploded perspective view of the marker shown in FIG. 10, and FIG. 12 is a cross-sectional view taken along line AA in FIG.

  As shown in FIGS. 10 to 12, the marker 8 according to the third embodiment includes a patterning layer 81, a surface layer 82, and an expansion member 83.

  The patterning layer 81 is made of a rectangular plate-like material such as resin or wood, and the pattern elements 81a to 81d are formed by printing or the like in black, and regions other than the pattern elements 81a to 81d are printed in white.

  The surface layer 82 is made of, for example, a colorless and transparent rectangular resin film such as PET. The surface layer 82 is disposed above the patterning layer 81 with the expansion member 83 interposed therebetween.

  A black rectangular marker frame 84 is formed on the surface layer 82 by printing or the like, and a region outside the marker frame 84 is white. The ink used for printing is preferably one that is resistant to moisture and moisture and has good fixability to the material of the surface layer 82. The pattern presenting part of the present invention is constituted by the patterning layer 81 and the surface layer 82.

  A region inside the marker frame 84 in the surface layer 82 is colorless and transparent, but a mat processing is applied to the lower surface side of the surface layer 82 in a part of the region 82a. The region 82a is a region that covers a part of the black pattern elements 81a to 81d, and is here a region that covers the pattern element 81b.

  The expansion member 83 has a long and narrow triangular shape in plan view, and is a member provided between the patterning layer 81 and the surface layer 82. Four expansion members 83 are provided along each side of the marker 8.

  The expansion member 83 is made of a material having a property that the volume expands when moisture is absorbed. For example, the expansion member 83 is made of a polymer such as sodium polyacrylate or compressed towel fiber. The expansion member 83 absorbs moisture and expands to widen the space between the patterning layer 81 and the surface layer 82, and corresponds to a changing portion of the present invention. The reason why the expansion member 83 has a long and narrow triangular shape is to detect humidity with high sensitivity at an acute angle portion.

  Each expansion member 83 is located under the marker frame 84 and the surrounding white portion in the surface layer 82, and is not visible when the marker 8 is viewed from the upper surface side.

  Next, the operation of the marker 8 in the third embodiment will be described.

  In the initial state, as shown in FIG. 10, the pattern elements 81a to 81d in the marker frame 84 are all black and the other areas are presented with white patterns.

  When the expansion member 83 absorbs moisture and expands from such an initial state, the distance between the patterning layer 81 and the surface layer 82 increases. As a result, as shown in FIG. 13, the pattern element 81b positioned below the matted region 82a is visually recognized as having a reduced density due to the mat processing. Thereby, it is visually recognized that the pattern of the marker 8 has changed with respect to the initial state. Thus, in the marker 8, the pattern changes due to a three-dimensional physical change in which the expansion member 83 expands due to external factors such as humidity and the surface layer 82 moves upward.

  The change in density can be adjusted by the degree of mat treatment of the surface layer 82. For example, when the spacing between the patterning layer 81 and the surface layer 82 becomes 3 mm wider than the initial state due to the expansion of the expansion member 83, the contrast difference between the pattern element 81b and the surrounding white portion is reduced by about 60%. Perform proper mat processing. Thereby, it is easy to recognize that the density has changed in the video processing device 3 of the augmented reality system 1.

  As described above, according to the marker 8 in the third embodiment, the expansion member 83 expands due to moisture absorption and the interval between the patterning layer 81 and the surface layer 82 can be increased simply by placing it in an environment with moisture or moisture. By expanding the pattern, the pattern can be changed without a power source, and a plurality of patterns can be displayed.

(Fourth embodiment)
FIG. 14 is a plan view of the marker according to the fourth embodiment, FIG. 15 is an exploded perspective view of the marker shown in FIG. 14, and FIG. 16 is a cross-sectional view taken along line AA in FIG.

  As shown in FIGS. 14 to 16, the marker 9 according to the fourth embodiment includes a base layer 91, a cushion material layer 92, a surface layer 93, and an organic material 94.

  The base layer 91 forms the bottom plate of the marker 9 and is made of a rectangular plate-like body such as resin or wood. The periphery of the base layer 91 is surrounded by an outer frame 95 made of the same material as the base layer 91.

  The cushion material layer 92 is made of a material having elasticity, such as polyurethane and foam rubber, and is for pressing an organic material 94 described later against the surface layer 93. The organic material 94 is pressed against the surface layer 93 by the elastic force of the cushion material layer 92 in order to prevent a shadow from being generated at the end of the organic material 94 and thereby causing inconvenience in the detection of the marker 9 in the video processing device 3. .

  The surface layer 93 is made of, for example, a colorless and transparent rectangular resin film such as PET. The surface layer 93 is fixed to the upper surface of the outer frame 95. A black rectangular marker frame 96 and a part of the pattern are formed on the surface layer 93 by printing or the like. When printing on the surface layer 93, it is preferable to print on the lower surface side in order to prevent the printed portion from being scratched. Further, it is preferable to perform mat processing on the upper surface of the surface layer 93 in order to prevent erroneous recognition of the marker 9 in the video processing device 3 due to the influence of ambient light.

  The surface layer 93 is provided with a region that is colorless and transparent without a pattern being printed or the like. In the present embodiment, among the rectangular areas 97a to 97d divided into four inside the marker frame 96, the area 97b is a colorless and transparent area, the areas 97a and 97d are black, and the area 97c is a white area. It has become. An organic material 94 is disposed under the colorless and transparent region 97b, and the organic material 94 is visually recognized from above the marker 9 through the region 97b. The regions 97a and 97d adjacent to the region 97b are preferably black as shown in FIGS. 14 and 15 so that the contrast with the organic material 94 is increased.

  The organic material 94 is made of fresh flower petals and plant leaves. The organic material 94 is preferably a material whose color changes greatly when it withers. For example, a white rose petal or a ginkgo leaf can be used. The organic material 94 forms a part of the pattern in the marker 9 and expresses a change in density in the pattern by changing the color with time such as “white → light brown → dark tea”. It corresponds to the change part. Further, the organic material 94 and the surface layer 93 constitute the pattern presenting unit of the present invention.

  The marker 9 configured as described above changes so that the color of the organic material 94 becomes darker as time elapses. As a result, as shown in FIG. 17, a pattern in which the color of the region 97b in the pattern is darker than the pattern in the initial state of FIG. 14 is expressed. The color in the region 97b becomes darker in proportion to the passage of time until the color becomes completely withered due to the change of the organic material 94 with time.

  As described above, according to the marker 9 in the fourth embodiment, the pattern can be changed with no power supply by changing the color of the organic material 94 over time only by placing it in a normal environment, and a plurality of patterns can be displayed. Is possible.

(Modification of the fourth embodiment)
18 is an exploded perspective view of a marker according to a modification of the fourth embodiment, and FIG. 19 is a cross-sectional view corresponding to FIG. 16 in the fourth embodiment.

  As shown in FIGS. 18 and 19, the marker 9 </ b> A in this modification differs from the marker 9 of the fourth embodiment shown in FIGS. 14 to 16 in that a part of the surface layer 93 is hollowed out. The opening 98 is formed, and the porous sheet 99 that closes the opening 98 is attached from the upper surface side of the surface layer 93.

  The opening 98 is formed by hollowing out a portion corresponding to the region 97b of the surface layer 93 in the marker 9 of FIGS. The organic material 94 is pressed against the porous sheet 99 by the elastic force of the cushion material layer 92 through the opening 98.

  The porous sheet 99 is made of a colorless and transparent sheet made of PET or the like, and has a large number of through holes.

  In the marker 9A of the present modified example, the progress of the color change of the organic material 94 can be made slower than the marker 9 of the fourth embodiment by improving the air permeability to the organic material 94 by the porous sheet 99. it can.

  By adjusting the size and number of through-holes provided in the porous sheet 99, the oxygen permeation amount, the moisture retention amount of the organic material 94, and the like can be adjusted, and the speed of color change of the organic material 94 can be adjusted. it can.

  Moreover, if an aromatic petal is used as the organic material 94, a good scent can be provided to the user.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 Augmented reality system 2 Imaging device 3 Image processing device 4 Display device 5, 6, 8, 9, 9A Marker 31 Marker detection part 32 Superimposition part 33 Storage part 34 Interface part 51A-51H Panel 52 Case 55, 68, 84, 96 Marker frame 61, 91 Base layer 62 Movable layer 63, 82, 93 Surface layer 65, 83 Expansion member 66 Support member 69 Color change layer 81 Patterning layer 92 Cushion material layer 94 Organic material 98 Opening 99 Porous sheet 511 Base material Layer 512 Protective film layer

Claims (2)

A marker that is used in an augmented reality system that superimposes electronic information on an image of a real environment, is placed in the real environment, and is an index for superimposing electronic information on the image,
A pattern presenting unit for presenting a pattern corresponding to the electronic information superimposed on the video;
The said pattern presentation part has a change part which changes with external factors, The said pattern changes with the change of the said change part, The marker characterized by the above-mentioned.   The marker according to claim 1, wherein the external factor includes at least one of humidity, ultraviolet light, temperature, and a change with time.

Images