WO2012015405A2 - Repères de centrage destinés à la réalité augmentée - Google Patents

Repères de centrage destinés à la réalité augmentée Download PDF

Info

Publication number
WO2012015405A2
WO2012015405A2 PCT/US2010/043633 US2010043633W WO2012015405A2 WO 2012015405 A2 WO2012015405 A2 WO 2012015405A2 US 2010043633 W US2010043633 W US 2010043633W WO 2012015405 A2 WO2012015405 A2 WO 2012015405A2
Authority
WO
WIPO (PCT)
Prior art keywords
fiducial marker
data
computer
fiducial
generated content
Prior art date
Application number
PCT/US2010/043633
Other languages
English (en)
Other versions
WO2012015405A3 (fr
Inventor
William H. Mangione-Smith
Original Assignee
Empire Technology Development Llc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Empire Technology Development Llc filed Critical Empire Technology Development Llc
Priority to US13/058,831 priority Critical patent/US8434674B2/en
Priority to KR1020127028937A priority patent/KR101399248B1/ko
Priority to CN201080066854XA priority patent/CN103329120A/zh
Priority to JP2013516559A priority patent/JP5635689B2/ja
Priority to PCT/US2010/043633 priority patent/WO2012015405A2/fr
Publication of WO2012015405A2 publication Critical patent/WO2012015405A2/fr
Publication of WO2012015405A3 publication Critical patent/WO2012015405A3/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K19/06009—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K19/00—Record carriers for use with machines and with at least a part designed to carry digital markings
    • G06K19/06—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code
    • G06K19/06009—Record carriers for use with machines and with at least a part designed to carry digital markings characterised by the kind of the digital marking, e.g. shape, nature, code with optically detectable marking
    • G06K19/06046—Constructional details
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/88—Image or video recognition using optical means, e.g. reference filters, holographic masks, frequency domain filters or spatial domain filters

Definitions

  • Augmented reality often describes a view or image of a real -world environment that has been augmented with computer-generated content. Combining an image of the real-world with computer-generated content has proven useful in many different applications. Advertising, navigation, military, tourism, education, sports, and entertainment are examples of areas where augmented reality can be used.
  • fiducial markers One way to recognize objects in images or real-world objects is through the use of fiducial markers.
  • a fiducial marker is an object that is used in the field of view of an imaging system and which appears in the resulting image.
  • conventional markers are usually used as markers in images and not as markers on real-world objects.
  • fiducial markers in images serves as a reference for image scaling.
  • fiducial markers at known locations in an image can be used to determine the relative scale of the image.
  • Certain cameras can produce reseau crosses as reference marks in an image.
  • Fiducial markers can also be used to make features of an image more visible.
  • Motion capture applications for instance, use fiducial markers to track the motion of a marked subject.
  • Fiducial markers in images can also allow independent images to be correlated.
  • fiducial markers in augmented reality, unfortunately, is quite limited and, as previously stated, fiducial markers are typically found in the image and not on real-world objects.
  • fiducial markers Although there may be some instances of real-world objects that have fiducial markers, these markers are difficult to recognize. Recognizing fiducial markers at medium and long distances is particularly troublesome. Further, conventional fiducial markers are unable to store significant amounts of data that can be converted to or used to generate computer-generated content in augmented reality applications.
  • Fiducial markers store data that can be used to augment an image with computer-generated content.
  • a fiducial marker may include a sheet of a material and can be attached to an object. The material is also configured to reflect electromagnetic radiation. A mask is applied to the material to obscure a first portion of the material and not obscure a second portion of the material. The first and second portions of the material store data to be read by a reading device.
  • a method for augmenting a real-world image with a computer-generated image includes emitting a light beam towards a fiducial marker located on a real-world object.
  • a reflected light beam includes data stored by the fiducial marker can is read, from the fiducial marker is read by the device that emitted the light beam.
  • Computer-generated content is then generated using the data stored in the reflected light beam and an augmented image, which includes the computer-generated content, is displayed on a display of the device.
  • Figure 1 illustrates an example of an environment that includes fiducial markers located in space.
  • Figure 2 illustrates an example of a device reading a fiducial marker that is attached to an object.
  • Figure 4 shows another illustrative embodiment of a fiducial marker.
  • Figure 6 shows an illustrative embodiment of a fiducial marker that includes an array of retroreflectors.
  • Figure 7 shows an illustrative embodiment of a method for generating an augmented image using a fiducial marker.
  • Figure 8 is a block diagram illustrating an example computing device that is arranged for reading a fiducial marker and generating augmented images using the data read from the fiducial marker.
  • Embodiments disclosed herein relate to fiducial markers including fiducial markers for augmented reality applications.
  • fiducial markers can be embodied as tags that are placed in space or in the environment to assist in object recognition, object tracking, and/or object modeling.
  • Embodiments of the fiducial markers disclosed herein by way of example and not limitation, support active interrogation, are recognizable at comparatively longer distances, are less obvious to ordinary inspection, and/or are able to store significantly more data or enable access to significantly more data.
  • Some embodiments of the fiducial markers disclosed herein include retroreflectors. Retroreflectors reflect light back towards the source of the light. As a result, multiple devices can read the fiducial markers from multiple directions. Fiducial markers that incorporate retroreflectors can be configured to store or encode data that can be read or interrogated by a properly configured device. By interrogating the fiducial marker, the data stored or encoded in the fiducial marker can be read or retrieved.
  • the retroreflectors in the fiducial marker can be partially masked or otherwise obscured in order to encode or store data in the fiducial marker.
  • the pattern of the mask formed in or on the fiducial marker can be one dimensional or multidimensional.
  • fiducial markers that support focused scanning read out allow for an increase in the storage factor. In other words, the amount of information that can be stored in the fiducial marker can be increased for a given size or area based on how the data is stored and/or on how the data is read.
  • Fiducial markers can be unobtrusively placed on objects in the environment. Thus, at least some embodiments of the fiducial markers are attached to real-world objects rather than only located in the resulting image. Devices that read these fiducial markers can generate augmented reality images using the data stored in the fiducial markers or made accessible by the fiducial markers. In addition, other components of the device (compass, global positioning sensor, etc.) can be used in combination with data read from the fiducial marker to generate and display an augmented reality image.
  • the fiducial marker generally includes a sheet of material (e.g., molded plastics, semiconductor materials, printed paper, optical reflector, radio frequency reflector) that is attached to an object and configured to reflect electromagnetic radiation.
  • the sheet of material may have a mask applied or affixed thereto that obscures a portion of the reflective material.
  • the mask may take the form of any material that blocks or obscures the reflected electromagnetic radiation, such as grease, a metal shield, optically opaque paper, or dirt.
  • the mask may be applied intentionally or inadvertently.
  • the mask may be applied with an adhesive, stable, nail, rivet, glue, mechanical attachment such as Velcro, or other techniques.
  • the sheet of material may be devoid of reflective components.
  • the sheet of material has reflective portions and less or non- reflective portions.
  • the reflective and non-reflective portions can be arranged to store data that can be read by a reading device.
  • the mask can be formed by an additional material that obscures the underlying reflective material or by forming the sheet of the material such that certain portions do not include or have reflective properties.
  • the non-reflective portions can be formed by damaging selected areas of the reflective portion. The damaged portion is an example of a mask.
  • the sheet of material can be used to create multiple fiducial markers.
  • the sheet of material is then diced to form the individual fiducial markers, which are then packaged as necessary or otherwise prepared for deployment.
  • the fiducial marker can be directly applied to an object, such as by painting the fiducial marker with retro reflective paint according to a pattern.
  • a template with a pattern formed therein may be provided. The template can be held against the object and paint with retroreflective materials can be applied to the template. When the template is removed, the paint on the object forms the fiducial marker according to the pattern of the template.
  • Figure 1 illustrates an example of an environment that includes fiducial markers located in space.
  • a fiducial marker 122 has been placed on an object 120.
  • the fiducial marker 122 can be placed unobtrusively and may be configured to be aesthetically compatible with the object 120.
  • the size of the fiducial marker 122 may depend on the amount of data that is to be stored therein. This allows environmental concerns (e.g., impact of the fiducial marker on the environment) to be balanced with the size of the fiducial marker 122.
  • the fiducial marker 122 may have be on the scale of one inch square - however better printing processes can shrink them dramatically. Effective query distances can range, by way of example only and not limitation, from one inch to more than a mile depending on the sensitivity of the receiver - for example through a telescopic imager. One of skill in the art can appreciate that the fiducial marker 122 can be on the scale of one inch square, or larger, or smaller. The reading distance may depend on the sensitivity of the receiver.
  • Figure 1 also illustrates a device 100 that includes a display 102.
  • the device 100 may include an imaging system (e.g., a camera or a video-camera) that enables the device 100 to display or show a real -world image 104 of the object 120.
  • the display 102 also presents computer-generated content 106 in the real -world image 104. Together, the real-world image 104 and the computer-generated content 106 is an example of an augmented image 114.
  • the computer-generated content 106 can be presented such that both the real-world image 104 and the computer-generated content 106 are simultaneously visible. Thus, at least one of the real-world image 104 and the computer-generated content 106 is partially transparent in one example. In another example, the computer-generated content 106 can be placed in specific portions of the display 102 such that portions of the real- world image 104 are completely obscured by the computer-generated content. Text, for example, can be placed directly on the image 104 of the object 120 in the display 102 or on the bottom of the display 102 so as to minimally interfere with the real -world image 104.
  • the device 100 includes components 112 that are used to generate and display the augmented image 114.
  • the components 112 include, by way of example only, a camera, a compass, a global positioning sensor, or the like or any combination thereof.
  • the components 112 can be used by the device 100 to generate the augmented image 114.
  • the location of the device 100 and the orientation of the device 100 relative to the location of the object 120 can determined, respectively, by the GPS sensor and the compass and can be used in the generation of the computer- generated content 106.
  • the fiducial marker 122 may store location data. This location data, combined with data from the GPS sensor and/or compass can be used to locate the user relative to the object 120 and/or to generate the computer- generated content 106.
  • the device 100 may communicate with a server 108 over a network 110, such as a telephone network, the Internet, a local-area network, or the like or any combination thereof.
  • a network 110 such as a telephone network, the Internet, a local-area network, or the like or any combination thereof.
  • Information generated, detected, or otherwise determined by the components 112 can be transmitted to the server 108 and used in generating the augmented image 114.
  • the information determined by the components 112 can also be used directly by the device 100 and may not be transmitted to the server 108.
  • information read from the fiducial marker 122 can be transmitted to the server 108.
  • the server 108 can reply to the device 100 with at least some of the computer-generated content 106.
  • the global positioning sensor may provide a location to the server 108. The location determined by the global positioning sensor and the data read from the fiducial marker 122 can be combined to generate the computer-generated content 106 and/or display the computer-generated content 106.
  • at least some of the data used to generate the augmented image 114 may be stored locally on the device 100.
  • the data represented in the computer-generated content 106 may be wholly read from the fiducial marker 122.
  • the device 100 is configured to read the fiducial marker 122.
  • Data stored by the fiducial marker 122 or data made accessible by the fiducial marker 122 can be rendered in the computer-generated content 106.
  • the fiducial marker 122 may store a description of the object 120. If the object 120 is a monument, for example, the fiducial marker 122 may store the date of creation, name of the artist, a reason for the monument, a description of the monument, or the like. If the object 120 is a business, the fiducial marker 122 may store contact information such as telephone numbers.
  • the data stored by or encoded in the fiducial marker 122 can vary widely.
  • the format of the fiducial marker 122 can be standardized to enable any properly provisioned device to read and understand the data stored by the fiducial marker 122.
  • the fiducial marker 122 may store a link (e.g., a Uniform Resource Locator (URL)) that can be used by the device 100 to access data from the server 108.
  • a link e.g., a Uniform Resource Locator (URL)
  • URL Uniform Resource Locator
  • the corresponding data received from the server 108 includes the computer-generated content 106.
  • the server 108 may also receive data describing the configuration (e.g., screen size, resolution, etc.) of the device. This allows the server 108 to deliver computer-generated content that is specifically prepared for the requesting device.
  • Figure 2 illustrates an example of the device 100 reading the fiducial marker 122.
  • the components 112 of the device 100 may also include a light source 202 and a light detector 204.
  • the light source 202 is configured to emit a light beam.
  • the light source 202 may include a laser, for example, that emits light at a predetermined frequency or within a predetermined frequency range.
  • the detector 204 may be configured to detect the frequency of the light emitted by the light source 202.
  • the detector 204 may be a photodetector such as a photodiode or the like.
  • the light emitted by light source 202 of the device 100 is directed towards the object 100 and more specifically towards the fiducial marker 122.
  • the fiducial marker 122 reflects the light back toward the device 100.
  • the device 100 detects the reflected light with the detector 204 to read the data stored in the fiducial marker 122.
  • the detector 204 can detect the intensity of the reflected light and generate a waveform that is shaped according to a mask pattern in the fiducial marker 122. The generated waveform can then be decoded and used to generate the computer-generated content 106 that is included in the augmented image 114.
  • the fiducial marker 122 may be or include a retroreflector that reflects light back towards its source.
  • the fiducial marker 122 reflects light emitted by the light source 202 back towards the detector 204. More generally, the fiducial marker 122 reflects electromagnetic radiation back along a vector that is parallel or substantially parallel to the source of the electromagnetic radiation.
  • the fiducial marker 122 may include corner cubes, photonic crystals, a cat's eye retroreflector, or the like or any combination thereof.
  • Figure 3 shows an illustrative embodiment of a fiducial marker 300.
  • the fiducial marker 300 is an example of the fiducial marker 122.
  • the fiducial marker 300 is arranged in a single dimension.
  • the fiducial marker 122 includes reflective areas 304 and less or non-reflective areas 302.
  • the detector 204 may generate a waveform 306 that corresponds to the pattern formed by the reflective areas 304 and the less or non-reflective areas 302.
  • Simple passive reading of the fiducial marker 300 can be accomplished by optically observing ambient reflected light. Alternatively a beam of light can be actively scanned over the fiducial marker 300 in a raster-scan like technique. Either approach can prove effective at both close range and distances of over a mile. However, greater distances may require both greater illumination energy and size of the fiducial marker 300.
  • the fiducial marker 300 can be fabricated in different ways.
  • the fiducial marker 300 may include a sheet of corner cube reflectors. However, a mask may be applied to the surface of the sheet to form the less or non-reflective areas 302. Alternatively, the less or non-reflective areas 302 may not include corner cube reflectors.
  • the fiducial marker 300 can be read using raster-scanning techniques.
  • the light source may be a focused laser to read the data in the fiducial marker 300.
  • FIG. 4 shows another illustrative embodiment of a fiducial marker 400.
  • the fiducial marker 400 is another example of the fiducial marker 122 and stores or codes data in multiple dimensions.
  • the fiducial marker 400 includes reflective areas 402 and less or non-reflective areas 404.
  • the data stored or represented by the fiducial marker 400 can be read with a dispersed laser that can illuminate the area of the fiducial marker or portions of the fiducial marker 400.
  • the multi -dimensional area of the fiducial marker 400 can be read out in parallel in this example with a suitable light source.
  • the multi-dimensional coding of the fiducial marker 400 can encode significantly more information for a given size of the fiducial marker 400.
  • FIG. 5 shows an illustrative embodiment of a fiducial marker 500 that is manufactured from photonic crystals.
  • the fiducial marker 500 is another example of the fiducial marker 122.
  • the fiducial marker 500 is formed from multiple layers 502 and 504.
  • the layer 502 has an index of refraction that is different from an index of refraction of the layer 504.
  • the layers 502 and 504 depict alternating layers of materials having high and low indices of refraction or high and low dielectric constants.
  • the layers 504 and 504 may be formed or grown on a substrate. Examples of suitable materials include silicon, plastic, and some semi-rigid gels.
  • the thickness of each of the layers 502 and 504, for example, may be configured for specific frequencies of light. In some examples, the thickness of each of the layers 502 an 504 is one-fourth of the desired wavelength.
  • the fiducial marker 500 can reflect light from a source back to the source.
  • the fiducial marker 500 can be constructed to provide unidirectional readout without the need to align the illumination source with the fiducial marker 500 in any way.
  • Figure 5 also illustrates that the mask can be formed by etching the fiducial marker 500.
  • the fiducial marker 500 can be etched and another material 510 can be deposited in the etched area of the fiducial marker 500 to form the mask and create a pattern in the fiducial marker 500.
  • the material 510 may not include alternating layers or may be of a material that is non-reflective for certain wavelengths of light such that the relevant frequency or wavelength of light is not reflected for the portion of the fiducial marker 500 occupied by the material 510.
  • FIG. 6 shows an illustrative embodiment of a fiducial marker 600 that includes an array 602 of retroreflectors.
  • the fiducial marker 600 is an example of the fiducial marker 122.
  • the array 602 of retroreflectors includes corner cubes 604.
  • the array 602 can include multiple rows and/or columns of corner cubes 604.
  • the array 602 of corner cubes 604 may be formed using molded plastic.
  • Each of the corner cubes 604 typically includes three mutually perpendicular, intersecting flat surfaces, which reflect electromagnetic radiation, including light, back towards the source.
  • the fiducial marker 600 once placed in an environment, can be read from different positions or locations. In other words, light that approaches the fiducial marker 600 from the front or at an angle is reflected back to the location of the source of the light. As a result, the orientation of the fiducial marker 600 may not impact the ability of the fiducial marker 600 to be read by a device.
  • the fiducial marker 600 may also include a mask to form a pattern that stores data. The mask can be formed by obscuring some of the corner cubes 604 or by manufacturing the array 602 such that certain areas are devoid of corner cubes.
  • FIG. 7 shows an illustrative embodiment of a method 700 for generating an augmented image.
  • a light beam is emitted by a device towards a fiducial marker.
  • the light source may be configured to scan the fiducial marker or the device can be moved such that the emitted light can interrogate the fiducial marker.
  • the device detects and reads the reflected light beam.
  • the reflected light beam is typically modulated according to the mask or pattern of the fiducial marker.
  • the reflected light beam thus contains the data stored by the fiducial marker.
  • the data in the reflected light beam is used to generate computer-generated content to include in the augmented image.
  • the computer-generated content corresponds to the data stored in the fiducial marker.
  • the data stored in the fiducial marker may enable the device to access (e.g., over the Internet) the computer-generated content that is associated with the fiducial marker.
  • the augmented image which includes the computer-generated content and/or an image of a real world object, is displayed on the device.
  • any of the operations, processes, etc. described herein can be implemented as computer-readable instructions stored on a computer-readable medium.
  • the computer-readable instructions can be executed by a processor of a mobile unit, a network element, and/or any other computing device.
  • the implementer may opt for a mainly hardware and/or firmware vehicle; if flexibility is paramount, the implementer may opt for a mainly software implementation; or, yet again alternatively, the implementer may opt for some combination of hardware, software, and/or firmware.
  • a signal bearing medium examples include, but are not limited to, the following: a recordable type medium such as a floppy disk, a hard disk drive, a CD, a DVD, a digital tape, a computer memory, etc.; and a transmission type medium such as a digital and/or an analog communication medium (e.g., a fiber optic cable, a waveguide, a wired communications link, a wireless communication link, etc.).
  • a typical data processing system generally includes one or more of a system unit housing, a video display device, a memory such as volatile and non-volatile memory, processors such as microprocessors and digital signal processors, computational entities such as operating systems, drivers, graphical user interfaces, and applications programs, one or more interaction devices, such as a touch pad or screen, and/or control systems including feedback loops and control motors (e.g., feedback for sensing position and/or velocity; control motors for moving and/or adjusting components and/or quantities).
  • a typical data processing system may be implemented utilizing any suitable commercially available components, such as those typically found in data computing/communication and/or network computing/communication systems.
  • any two components so associated can also be viewed as being “operably connected”, or “operably coupled”, to each other to achieve the desired functionality, and any two components capable of being so associated can also be viewed as being “operably couplable”, to each other to achieve the desired functionality.
  • operably couplable include but are not limited to physically mateable and/or physically interacting components and/or wirelessly interactable and/or wirelessly interacting components and/or logically interacting and/or logically interactable components.
  • FIG 8 is a block diagram illustrating an example computing device 800 that is arranged for reading a fiducial marker and generating augmented images using the data read from the fiducial marker in accordance with the present disclosure.
  • computing device 800 typically includes one or more processors 804 and a system memory 806.
  • a memory bus 808 may be used for communicating between processor 804 and system memory 806.
  • processor 804 may be of any type including but not limited to a microprocessor ( ⁇ ), a microcontroller ( ⁇ ), a digital signal processor (DSP), or any combination thereof.
  • Processor 804 may include one more levels of caching, such as a level one cache 810 and a level two cache 812, a processor core 814, and registers 816.
  • An example processor core 814 may include an arithmetic logic unit (ALU), a floating point unit (FPU), a digital signal processing core (DSP Core), or any combination thereof.
  • An example memory controller 818 may also be used with processor 804, or in some implementations memory controller 818 may be an internal part of processor 804.
  • system memory 806 may be of any type including but not limited to volatile memory (such as RAM), non-volatile memory (such as ROM, flash memory, etc.) or any combination thereof.
  • System memory 806 may include an operating system 820, one or more applications 822, and program data 824.
  • Application 822 may include an augmented reality application 826 that is arranged to produce and display content that is read from or made accessible by reading a fiducial marker.
  • Program data 824 may include fiducial marker data 828 read from the fiducial marker that may be useful for generating augmented images as is described herein.
  • the fiducial marker data 828 may also include other data that may be used in generating augmented images.
  • application 822 may be arranged to operate with program data 824 on operating system 820 such that an augmented image is generated and displayed. This described basic configuration 802 is illustrated in Figure 8 by those components within the inner dashed line.
  • Computing device 800 may have additional features or functionality, and additional interfaces to facilitate communications between basic configuration 802 and any required devices and interfaces.
  • a bus/interface controller 830 may be used to facilitate communications between basic configuration 802 and one or more data storage devices 832 via a storage interface bus 834.
  • Data storage devices 832 may be removable storage devices 836, non-removable storage devices 838, or a combination thereof. Examples of removable storage and non-removable storage devices include magnetic disk devices such as flexible disk drives and hard-disk drives (HDD), optical disk drives such as compact disk (CD) drives or digital versatile disk (DVD) drives, solid state drives (SSD), and tape drives to name a few.
  • Example computer storage media may include volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data.
  • System memory 806, removable storage devices 836 and non-removable storage devices 838 are examples of computer storage media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which may be used to store the desired information and which may be accessed by computing device 800. Any such computer storage media may be part of computing device 800.
  • Computing device 800 may also include an interface bus 840 for facilitating communication from various interface devices (e.g., output devices 842, peripheral interfaces 844, and communication devices 846) to basic configuration 802 via bus/interface controller 830.
  • Example output devices 842 include a graphics processing unit 848 and an audio processing unit 850, which may be configured to communicate to various external devices such as a display or speakers via one or more AV ports 852.
  • Example peripheral interfaces 844 include a serial interface controller 854 or a parallel interface controller 856, which may be configured to communicate with external devices such as input devices (e.g., keyboard, mouse, pen, voice input device, touch input device, etc.) or other peripheral devices (e.g., printer, scanner, etc.) via one or more I/O ports 858.
  • An example communication device 846 includes a network controller 860, which may be arranged to facilitate communications with one or more other computing devices 862 over a network communication link via one or more communication ports 864.
  • the network communication link may be one example of a communication media.
  • Communication media may typically be embodied by computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and may include any information delivery media.
  • a "modulated data signal" may be a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
  • communication media may include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency (RF), microwave, infrared (IR) and other wireless media.
  • RF radio frequency
  • IR infrared
  • the term computer readable media as used herein may include both storage media and communication media.
  • Computing device 800 may be implemented as a portion of a small-form factor portable (or mobile) electronic device such as a cell phone, a personal data assistant (PDA), a personal media player device, a wireless web-watch device, a personal headset device, an application specific device, or a hybrid device that include any of the above functions.
  • a small-form factor portable (or mobile) electronic device such as a cell phone, a personal data assistant (PDA), a personal media player device, a wireless web-watch device, a personal headset device, an application specific device, or a hybrid device that include any of the above functions.
  • PDA personal data assistant
  • Computing device 800 may also be implemented as a personal computer including both laptop computer and non-laptop computer configurations.
  • a range includes each individual member.
  • a group having 1 -3 cells refers to groups having 1, 2, or 3 cells.
  • a group having 1-5 cells refers to groups having 1, 2, 3, 4, or 5 cells, and so forth.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention a trait à des repères de centrage destinés à la réalité augmentée. Un repère de centrage peut être situé sur un objet de l'environnement et comprend des rétroréflecteurs qui réfléchissent la lumière et la renvoient vers la source de ladite lumière. Une partie du repère de centrage est masquée ou obscurcie pour constituer, dans ledit repère de centrage, une forme comprenant une partie réfléchissante et une partie moins réfléchissante ou non réfléchissante. La forme de la partie réfléchissante et de la partie moins réfléchissante ou non réfléchissante contient des données qui peuvent être lues par un dispositif de lecture et utilisées pour créer un contenu créé par ordinateur qui est inclus dans une image augmentée.
PCT/US2010/043633 2008-08-12 2010-07-29 Repères de centrage destinés à la réalité augmentée WO2012015405A2 (fr)

Priority Applications (5)

Application Number Priority Date Filing Date Title
US13/058,831 US8434674B2 (en) 2008-08-12 2010-07-29 Fiducial markers for augmented reality
KR1020127028937A KR101399248B1 (ko) 2010-07-29 2010-07-29 증강 현실용 기준 마커
CN201080066854XA CN103329120A (zh) 2010-07-29 2010-07-29 用于增强现实的基准标记
JP2013516559A JP5635689B2 (ja) 2010-07-29 2010-07-29 拡張現実用の基準マーカー
PCT/US2010/043633 WO2012015405A2 (fr) 2010-07-29 2010-07-29 Repères de centrage destinés à la réalité augmentée

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2010/043633 WO2012015405A2 (fr) 2010-07-29 2010-07-29 Repères de centrage destinés à la réalité augmentée

Publications (2)

Publication Number Publication Date
WO2012015405A2 true WO2012015405A2 (fr) 2012-02-02
WO2012015405A3 WO2012015405A3 (fr) 2014-03-20

Family

ID=45530648

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2010/043633 WO2012015405A2 (fr) 2008-08-12 2010-07-29 Repères de centrage destinés à la réalité augmentée

Country Status (4)

Country Link
JP (1) JP5635689B2 (fr)
KR (1) KR101399248B1 (fr)
CN (1) CN103329120A (fr)
WO (1) WO2012015405A2 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017504796A (ja) * 2013-12-18 2017-02-09 ビーエーエスエフ ソシエタス・ヨーロピアＢａｓｆ Ｓｅ 対象物の光学的検出に使用するターゲットデバイス
CN113066099A (zh) * 2019-12-13 2021-07-02 视云融聚（广州）科技有限公司 一种基于球形坐标系的摄像机标签轨迹跟随方法

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9947140B2 (en) * 2015-09-15 2018-04-17 Sartorius Stedim Biotech Gmbh Connection method, visualization system and computer program product
CN106199216B (zh) * 2016-08-02 2019-05-03 海信集团有限公司 辐射值显示方法及装置
KR101997770B1 (ko) * 2017-12-06 2019-07-08 한국광기술원 증강현실 이미지 생성장치 및 방법
US10969600B2 (en) * 2018-03-08 2021-04-06 Apple Inc. Electronic devices with optical markers
KR102603254B1 (ko) 2018-12-13 2023-11-16 삼성전자주식회사 웹 콘텐츠를 ar모드에서 표시하는 전자 장치 및 방법

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6542083B1 (en) * 1999-11-23 2003-04-01 Xerox Corporation Electronic tag position detection using radio broadcast
US20060050929A1 (en) * 2004-09-09 2006-03-09 Rast Rodger H Visual vector display generation of very fast moving elements
US20060215147A1 (en) * 2003-05-07 2006-09-28 Scott Andrew M Dynamic optical reflector and interrogation system
US20070098234A1 (en) * 2005-10-31 2007-05-03 Mark Fiala Marker and method for detecting said marker
US20080138604A1 (en) * 2006-05-02 2008-06-12 John Kenney Authenticating and identifying objects using markings formed with correlated random patterns
US20080266323A1 (en) * 2007-04-25 2008-10-30 Board Of Trustees Of Michigan State University Augmented reality user interaction system
US20090065583A1 (en) * 2005-03-11 2009-03-12 Mcgrew Stephen P Retro-emissive markings

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
BR9807750A (pt) * 1997-02-24 2001-10-02 Thermo Information Solutions I Método e aparelho para operar a superposição de efeitos gerados pelo computador para posicionar-se sobre uma imagem viva
US20020183882A1 (en) * 2000-10-20 2002-12-05 Michael Dearing RF point of sale and delivery method and system using communication with remote computer and having features to read a large number of RF tags
GB2379295A (en) 2001-08-31 2003-03-05 Sony Uk Ltd A system for distributing audio/video material to a potential buyer
US7015492B2 (en) * 2003-08-15 2006-03-21 Asm International N.V. Method and apparatus for mapping of wafers located inside a closed wafer cassette
US7295220B2 (en) * 2004-05-28 2007-11-13 National University Of Singapore Interactive system and method
KR101522842B1 (ko) * 2008-07-10 2015-06-25 인텔렉추얼디스커버리 주식회사 이미지 및 문자를 인식하는 심플 프레임 마커를 구비하는 증강현실 시스템과 그 장치, 및 상기 시스템 또는 상기 장치를 이용한 증강현실 구현방법

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6542083B1 (en) * 1999-11-23 2003-04-01 Xerox Corporation Electronic tag position detection using radio broadcast
US20060215147A1 (en) * 2003-05-07 2006-09-28 Scott Andrew M Dynamic optical reflector and interrogation system
US20060050929A1 (en) * 2004-09-09 2006-03-09 Rast Rodger H Visual vector display generation of very fast moving elements
US20090065583A1 (en) * 2005-03-11 2009-03-12 Mcgrew Stephen P Retro-emissive markings
US20070098234A1 (en) * 2005-10-31 2007-05-03 Mark Fiala Marker and method for detecting said marker
US20080138604A1 (en) * 2006-05-02 2008-06-12 John Kenney Authenticating and identifying objects using markings formed with correlated random patterns
US20080266323A1 (en) * 2007-04-25 2008-10-30 Board Of Trustees Of Michigan State University Augmented reality user interaction system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017504796A (ja) * 2013-12-18 2017-02-09 ビーエーエスエフ ソシエタス・ヨーロピアＢａｓｆ Ｓｅ 対象物の光学的検出に使用するターゲットデバイス
CN113066099A (zh) * 2019-12-13 2021-07-02 视云融聚（广州）科技有限公司 一种基于球形坐标系的摄像机标签轨迹跟随方法
CN113066099B (zh) * 2019-12-13 2023-12-19 视云融聚（广州）科技有限公司 一种基于球形坐标系的摄像机标签轨迹跟随方法

Also Published As

Publication number Publication date
KR101399248B1 (ko) 2014-05-27
JP2013539088A (ja) 2013-10-17
CN103329120A (zh) 2013-09-25
JP5635689B2 (ja) 2014-12-03
KR20120135527A (ko) 2012-12-14
WO2012015405A3 (fr) 2014-03-20

Similar Documents

Publication Publication Date Title
US8434674B2 (en) Fiducial markers for augmented reality
WO2012015405A2 (fr) Repères de centrage destinés à la réalité augmentée
US7374103B2 (en) Object localization
US11003956B2 (en) System and method for training a neural network for visual localization based upon learning objects-of-interest dense match regression
Pintaric et al. Affordable infrared-optical pose-tracking for virtual and augmented reality
US7387393B2 (en) Methods for producing low-visibility retroreflective visual tags
US9245193B2 (en) Dynamic selection of surfaces in real world for projection of information thereon
KR101616591B1 (ko) 데이터의 공간의 주요 치수를 항해하기 위한 제어 시스템
JP6310101B2 (ja) 複数の３ｄコードのレーダベース解釈
US9471864B2 (en) Encoding data in depth patterns
KR20100049325A (ko) 물체의 특징 정보를 추출하기 위한 장치와 방법, 및 이를 이용한 특징 지도 생성 장치와 방법
CN104007817A (zh) 具有至少一个摄像机的可穿戴信息系统
CN109255749A (zh) 自主和非自主平台中的地图构建优化
JP2018538640A (ja) 画像および他のリモートセンシングデータを使用したターゲットからのデータ取得
CN110462337A (zh) 使用传感器可读标签自动生成地图地标
Chung et al. Pohang canal dataset: A multimodal maritime dataset for autonomous navigation in restricted waters
Grimm et al. VR/AR input devices and tracking
US20230306213A1 (en) Method, platform, and system of electromagnetic marking of objects and environments for augmented reality
CN107077196A (zh) 识别触敏表面上的对象
Agrawal et al. A review: Augmented reality and its working
Alaba et al. Multi-sensor fusion 3D object detection for autonomous driving
Buzzi et al. RFID sensors and artifact tracking
Taneski et al. Guided Direct Time-of-Flight Lidar Using Stereo Cameras for Enhanced Laser Power Efficiency
KR102634858B1 (ko) 증강현실을 이용한 공간 확장을 위한 방법
KR102634857B1 (ko) 증강현실을 이용한 공간 확장을 위한 방법

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 13058831

Country of ref document: US

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10855436

Country of ref document: EP

Kind code of ref document: A2

ENP Entry into the national phase

Ref document number: 20127028937

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2013516559

Country of ref document: JP

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 10855436

Country of ref document: EP

Kind code of ref document: A2