WO2013033641A1 - Procédés et appareil de localisation, de lecture et de réponse de code utilisant un imageur - Google Patents

Procédés et appareil de localisation, de lecture et de réponse de code utilisant un imageur Download PDF

Info

Publication number
WO2013033641A1
WO2013033641A1 PCT/US2012/053532 US2012053532W WO2013033641A1 WO 2013033641 A1 WO2013033641 A1 WO 2013033641A1 US 2012053532 W US2012053532 W US 2012053532W WO 2013033641 A1 WO2013033641 A1 WO 2013033641A1
Authority
WO
WIPO (PCT)
Prior art keywords
larcode
lar
venue
data
color
Prior art date
Application number
PCT/US2012/053532
Other languages
English (en)
Inventor
Leonard Reiffel
Original Assignee
Leonard Reiffel
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US13/317,547 external-priority patent/US20120274775A1/en
Application filed by Leonard Reiffel filed Critical Leonard Reiffel
Priority to EP12826969.3A priority Critical patent/EP2751994A4/fr
Publication of WO2013033641A1 publication Critical patent/WO2013033641A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201—Market modelling; Market analysis; Collecting market data
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
    • G01S13/74—Systems using reradiation of radio waves, e.g. secondary radar systems; Analogous systems
    • G01S13/82—Systems using reradiation of radio waves, e.g. secondary radar systems; Analogous systems wherein continuous-type signals are transmitted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0207—Discounts or incentives, e.g. coupons or rebates
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/08—Auctions

Definitions

  • Fig. 1 is a schematic representation of a multi-color code.
  • Fig. 2 is a top schematic view of an adapter and accessories for use with PDAs, smartphones & other devices.
  • Fig. 3 is a front plan view of the adapter and accessories of Fig. 2.
  • Fig. 4 is a schematic representation of adapters and accessories for use with cellphones, PDA & other devices.
  • Fig. 5 is a schematic representation of one form of an imager that can be used with the invention.
  • Fig. 6 is a schematic representation of another form of an imager that can be used with the invention.
  • Fig. 7 is a schematic representation of another form of a code that can be used with the invention.
  • Fig. 8 is a schematic representation of another form of a code that can be used with the invention.
  • Fig. 9 is a schematic representation of a compound code that can be used with the invention.
  • Fig. 10 is a schematic representation of another form of a code that can be used with the invention.
  • Fig. 11 is a schematic representation of a code formed in a graphic that can be used with the invention.
  • Fig. 12 is a schematic representation of a code that employs both obscuration and disclosure mechanisms.
  • Fig. 13 is a schematic representation of several examples of LARsponders in a given area.
  • Fig. 14 is a schematic representation of a several other examples of LARsponders in a given area.
  • Fig. 15 is a schematic representation of a several other examples of LARsponders in a given area.
  • Fig. 16 is a schematic representation of a several other examples of LARsponders in a given area.
  • Fig. 17 is a schematic representation of a one form of LARsponders in a given area
  • Fig. 18 is a schematic representation of several forms of 3-dimensional Larcodes & LARsponders in a given area.
  • Fig. 19 is a schematic representation of several forms of 2-dimensional LARsponders located on various items.
  • Fig. 20 is a schematic representation of several forms of 2-dimensional LARsponders located on various items.
  • Fig. 21 is a schematic representation of several forms of 3-dimensional items that include Larsponders.
  • Fig. 22 is a schematic representation of several forms of 2-dimensional LARsponders located on various items.
  • Fig. 23 is a schematic representation of several forms of two-sided LARsponders.
  • Fig. 24 is a perspective view of a stadium containing various LAR-Readers.
  • Fig. 25 is a schematic representation of LAR-Readers used in a variety of settings.
  • Fig. 26 is a schematic representation of several forms of LARsponders. Purely for purposes of introduction, a few examples of aspects of the novel disclosed Art used to create LAR- Systems are sketched below. These sketches are NOT intended as limiting or defining the Art to be disclosed in more detail in subsequent parts of this document:
  • Imaging methods and apparatus which adapt, accessorize, and enable use of a single imager to capture information for purposes of locating data sources in a venue, capturing and decoding, tracking, reading, and validating said source data which can be variable and which can convey relevant information based upon such data to LAR-Systems thereby eliciting appropriate responses or actions there-from, as well as to other systems, databases and/or to human users.
  • Multiple single imagers with different lines of sight (LOS) and fields of view (FOV) can be used in a given venue.
  • the imagers that can be adapted to the purposes described herein include (but are not limited to) those designed for commercial and consumer-level digital photography and videography.
  • the imagers and can be installed on fixed, portable, mobile, or other platforms including but not limited to aircraft, helicopters (manned or unmanned such as the recently announced AR video "toy” device by Parrot AC), loitering drones, and aerostats, etc.
  • Methods and apparatus enabling users to control, modify, or manipulate the physical properties, qualifications, validity, appearance, information content, time or spatial behavior etc. of such information sources as described above thereby enabling two-way, real-time data communication from human users to LAR-Systems as well as from LAR-Systems to human users.
  • Methods and apparatus which can provide any or all members of an audience (ranging from a single individual to crowds of 100's of thousands or more) with capabilities for simultaneous participative, responsive, or other types of interactions with LAR-Systems and each other on sub-second time-scales thereby enabling voting, opinion-collection, instant large-scale market research, competitive "mob play” etc. involving whole audiences, subgroups, individuals and/or combinations thereof. Data so collected can be salable to advertisers, media buyers, PR Agencies etc.
  • Venue activities can be based upon the moment-by-moment unrehearsed, even unscheduled live sports or other "live” happenings in a venue. Activities can employ additional material (replays, ads, instant contests, games, etc.) as presented on venue video screens and/or shared via individual displays. Out-of-venue “remote” participants can also be accommodated. Results can be rapidly known and can enhance emotional and/or competitive involvement in audiences of any size. Activities in venues equipped with LAR-Systems can have psychological appeal by facilitating spontaneous formation of "fans", "groups", or "community” atmospheres from among individuals located/seated relatively together or even among more distant participants with shared opinions, loyalties etc.
  • LAR-System-based activities can fill "down-time" in venue action (e.g. in an entire football game there are about 25 minutes of actual play) with new types of entertainment, contests, offers, thus benefiting venue owners, interested promoters/advertisers/media-buyers etc.
  • LAR-Systems can provide unique and versatile interactive capabilities and directed incentives to particular user types, qualifications, locations etc. and offer other opportunities to increase in-venue vendor sales including, for example, on-site automated auctions in venues such as Malls, large or small retail outlets etc in which bidders can participate conveniently and/on a pre-planned OR impulse basis. See Appendices for more details.
  • LAR-System use need NOT involve any charges whatever against user smart-phone "connectivity minutes” and does not require that participants have some particular Software Application installed or particular "device” skill..
  • Non-traditional participative and entertainment areas such as passenger aircraft, trains and buses, when equipped with LAR-Systems can become collective interactive environments for product or other promotions, "team” games and entertainment of the occupants.
  • Applicant's prior issued patents disclose among other concepts, codes in the form of passive generally planar entities carrying a group of pigmented regions such as colored Blocks or stripes or other simple shapes, each color being chosen from a specified repertoire. Data are encoded using combinations of regions in different colors and different positions on the code. Methods and apparatus are described, including, in particular and for example, regions that are retro-reflecting in the infra-red used as aids to locating and isolating coded ROIs (Regions of Interest).
  • a simple example of a typical code 10 is shown in figure 1.
  • a code 10 can include one or more LOCATE “Blocks" 12 or "regions" of retro-reflective (sometimes referred to, herein, as "RR") foil, or other RR material, which are next to or otherwise spatially-associated with color-coded "Block” portions or code “elements” 11 of the code 10.
  • RR retro-reflective
  • RRs 12 (shown are merely examples of many possible types/shapes) aid in locating and tracking the codes within a scene and can also define a "Reading" direction for the code 10.
  • two Retro- Reflective (RR) end-strips 12 add -0.75 inches to the overall length and each shaded Block 11 is one solid color.
  • Codes 10 can be much smaller or larger than in this example.
  • Images of a code color Block sequence and other information about the code 10, as acquired by suitable sensors, can be conveyed to information data processing systems.
  • the color Block 11 sequence so acquired by the information system can inform it as to which of many Application Software programs available to it each specific code's instantaneous position, size, pose, etc. is to be routed.
  • Each color Block 11 on a code 10 can be of significant (specific but non-critical) width and height relative to the overall code dimensions.
  • the code data conveyed by the code depends upon the overall configuration of the array of color areas.
  • LARcodes 10 can be properly READ even though not sharply focused because colors used in a region in an image of a LARcode can be determined despite blurring. For a given type of optics and sensor resolutions, this also allows their use over a markedly extended range of stand-off distances. This property is in contrast to the need to determine precise details of a variable set of relative widths of monochrome black lines and their spacing (thin to wide) when, for example, typical BARcodes are used.
  • LARcodes 10 can take many forms and can be as simple as pieces of printed paper or a plastic strips, or in similar form that can be adhered or otherwise fastened on an item of interest or made structurally part of it.
  • One type of Imager described in the Applicant's previous patents is comprised of two imagers ideally sharing common Lines of Sight (LOS) and Fields of View (FOV). These are accompanied by a closely co-located Illuminator which may, for example, be an IR source.
  • the first image can be an RGB color video camera (using one or more sensor elements intended for imaging in the visible spectrum or portions thereof.
  • the second in this example, can be a similar video camera selectively sensitive to IR.
  • the first Imager outputs traditional RGB color video of a scene.
  • the second Imager provides monochrome IR video imagery LOCATE data (precisely spatially registered with the color video and time-synchronized with it) which can be processed to show only the bright IR retro-reflections from the RRs on the LARcode.
  • This enables fast and computationally efficient isolation, analysis, and motion tracking of LARcode locations in the color video data and efficient Reading of the color-encoded data carried by such LARcodes.
  • a second and functionally equivalent LAR- Reader also disclosed in Applicant's prior patents consists of a pair of sensor arrays, one for the visible spectrum and one for IR (e.g. 2 CCD pixel arrays), which are combined in a single imager.
  • IR is not visible to the human eye
  • the presence and operation of LAR-Readers which use IR to execute RR LOCATE functions can, if necessary, remain covert, non-alerting, non-cueing and non-disturbing to occupants/users while the general environment's "normal" illumination is (or can be) arranged to provide sufficient visible light for the code Color imagers.
  • Part D some general examples of LAR-System installations having novel functionality and/or significant utility in commercial venues are described.
  • Part E a more specific discussion is presented regarding novel methods and apparatus for Automated Auctions & other Point-of-Purchase (POP) applications based upon LAR-System technology.
  • POP Point-of-Purchase
  • LARcode-Readers also called “LAR-Readers” here-in
  • LAR-Readers are capable of both LARcode LOCATE and LARcode READ functions as well as other tasks (See particularly PARTS C and D) in a variety of unique and commercially useful applications.
  • Novel illumination devices, data-processing system configurations, and software are also disclosed as are associated systems concepts employing one to many such imagers/Readers of the same or mixed types.
  • Custom production of specialized imaging devices specifically intended for service as LAR-Readers is certainly possible.
  • Such custom devices along with appropriate proprietary software, represent one way to provide the functionality needed in the applications and teachings taught herein.
  • the custom device production approach obviously ignores the huge number of imagers with many useful features and functional flexibility already being mass-produced and already in use world-wide as well as new devices destined to appear in the future.
  • LARCA LARCode Adapter
  • TYPE 1 devices are typical multi-function Smartphones, Feature-phones, Cellphones, PDAs etc. with camera capabilities.
  • TYPE 1 imagers when serving as LAR-Readers or otherwise generally move with and are under the control of the mobile user/owner. They feature bi-directional wireless connectivity, integrated displays, and versatile software capabilities. Tablet computers and Laptops with associated Webcams can also share such characteristics.
  • the PC in turn, can have a wide variety of hardware, LARcode-based System software and other applications software, as well as communications and/or other capabilities some which are in-built and others which can be provided by coupled custom accessories and/or versions of Power, Light and Control Modules (PLCMs) and Illumination Managers (IMs) as described in following portions of this disclosure.
  • Configurations of this general type can be especially well-suited to creating relatively small systems using a few to a few dozen Webcams. Multiples of such systems can cooperatively cover much larger spaces.
  • TYPE 2 imaging devices can be owned/controlled by a mobile user, but do not, at the time of this writing, typically feature built-in constant-on, bi-directional, high-speed wireless connectivity via 3G or 4G etc. service providers. This capability can however be added via "plug-in" image storage memory cards/media that include wireless adapters. Type 2 devices usually do not run a wide range of applications that are unrelated to original images captured and/or used by the device. LAR-Readers based upon adaptations of TYPE 2 imagers are more likely to be used within LARcode-based systems installed in venues of various types, or movable by persons or mechanisms associated with the venue rather than used by "free-roaming" individuals unaffiliated with the venue. TYPE 2 imaging devices can include:
  • Consumer-level cameras such as the Casio Exilim EX-FC100, Sony NEX-5 and NEX-3 etc. and higher-level “prosumer” devices as well as DSLR and "multi-function professional color digital cameras” many of which can offer versatile still-frame capability, rapid capture of still-frame sequences, video image capture, panoramic frame- stitching, anti-shake, ROI selection, wide dynamic range, high sensitivity, a powered "Hot-shoe” and numerous other features which are (or can be) software-defined and exploited for present purposes.
  • Hardware interface ports and compatible accessory devices designed for them can provide wireless connectivity and/or other additional hardware functionality, and can also accommodate new custom software/firmware implementing various methods disclosed herein.
  • Video Cameras Camcorders, and advanced types of Imagers such as “Dual” Video and Still-frame cameras (so-called “All-ln-One”) as well as video cameras with binocular 3D capabilities.
  • Machine-vision and special purpose cameras offering a wide-range of useful and special purpose capabilities such as very high frame speed, very high resolution, image intensification and multiple simultaneous ROI capabilities.
  • Such cameras can also offer software-based on-board image analysis capabilities notably for surveillance, inspection, QC, and/or robotic guidance etc.
  • Output is typically hardwire via Ethernet, Camera-link, GigE, various wireless adapters etc.
  • Certain types of the above-listed devices are purposely designed to have low IR sensitivity so as to improve visible image contrast and lens performance. This is usually achieved by including a built-in IR Blocking filter in the optical path. The filter can or cannot be removable. If IR (or Deep Red light) is to be used to capture LOCATE data from RRs associated with a LARcode, this presents several strategic and technology options for using devices with suppressed IR sensitivity as LAR-Readers:
  • Options (1) and (2) retain covert capability.
  • Option (3) is not covert, but can offer relatively low informal detection probability depending upon the other lighting in the environment. Methods using these three Options are specifically described in Section A.10.
  • a fourth Option namely using primarily visible wavelengths for both LOCATE and READ functions can be exploited in a variety of novel and useful ways which are presented later in PART A as well as elsewhere in this disclosure.
  • FIGS 2 and 3 schematically show features of an adapter and accessories for use with Type 1 devices, such as hand-held cellphones, PDAs, Smartphones, or similar mobile device functioning as a LARcod reader.
  • mobile device 21 includes lens 22 and can be coupled to LARcode adapter (LARCA) 23 having an integrated power/light control module (PLCM).
  • an external mount 26 can be used to couple LARCA 23 to mobile device 21.
  • Removable flash attenuator 27 can be coupled to LARCA 21 , such as through lamp 24.
  • a built in flash 28 can be included, such as coupled to mobile device 21.
  • a filter 29 can be provided and associated with built in flash 28 for RR excitation, while an attenuator 30 can be provided and associated with built in flash 28 for RR intensity.
  • An optional optical trigger 31 from flash 28 can be included along with a bi-directional data channel 32 that can couple mobile device 21 to LARCA 23.
  • mobile device 21 and LARCA 23 can be coupled to other devices, such as LARcode processing systems and databases, 3 rd party systems, local venue systems and displays etc. through a communication channel 33, such as wireless networks such as G3, G4, Wi-Fi, Wi-MAX, Eye-Fi links, etc.
  • a LARCA 23 can have a variety of roles and capabilities including imager control, bi-directional communication through the imager with other elements of a LARcode System, power supply/management and timing/control of Illuminators, processing of system-related or locally-acquired images etc. as needed to perform required or desirable LAR-Readers functions. See the Table below.
  • the LARCA 23 shown In Figures 2-3 is (optionally) physically- integrated with an associated on-board Power, Light & Control Module (PLCM).
  • PLCM Light & Control Module
  • TYPE 1 LAR-Reader Adapter + Power, Light & Control Module (LARCA + PLCM) LARCAs for TYPE 1 1magers can provide Data and Control Links (internally supported or via Smartphone) WI-FI or other wireless which can be employed simultaneously and/or used to provide redundancy) such as:
  • LARCAs can support bidirectional data links to other Imagers and software and/or hardware-defined associated "members" of groups and/or networks of Imagers and associated systems, software and/or data files of such members.
  • LARCAs can access and/or execute local LARCA-Resident Apps, Data Processing and Data-Bases for autonomous performance of LOCATE/READ(decode etc.) and other functions, and can activate and/or cause responses of other associated Systems.
  • LARCAs can call, cooperate with, access and/or execute local LARCA-Resident Apps, Data Processing and DBs in cooperation with Imager-Resident Apps, Data Processing and Data-Bases) for performance of
  • LOCATE/READ decode etc.
  • other functions and can activate and/or cause responses of other associated Systems.
  • PLCMs can provide Accessory Power (batteries, ULTRA-capacitors, solar trickle chargers, etc.), backup & inboard power management for Imager and for LARCA, Local on-board Illumination Lights and Power Control, PLCM Flash charging & readiness reporting to Imager, LARCA and other systems, Maintenance requests, Status & service diagnostics reports re LARCA and Imager systems etc.
  • Outboard PLCMs not mounted on Type 1 Imagers can be hard-wired for power & optionally also for some communication purposes.
  • Smart phones are multi-purpose and small. Weight and compactness in particular are important. Furthermore, Smartphones and similar mobile image-capture/display devices do not need to be always ready to perform the function of a LAR-Reader for their users.
  • the LARCA+PLCM and other add-ons therefore can be designed to be readily "clip-on" and demountable as shown.
  • FIG. 28 Another type of Smartphone etc. may not have built-in Flash capability therefore flash capability is shown as a model-dependent option 28, along with its associated removable Accessories 29 and 30. If a Smartphone has no built-in Flash, an RF signal from the Smartphone can be used to trigger a high-power IR or Deep Red Flash from one of the lamps in the PLCM with an appropriate member of the Filter set 25 flipped into place.
  • One of the flash sources in a PLCM multiple light array can be equipped with an accessory attenuator 27 and/or a color visible filter (if a colored visible Flash is intended).
  • an accessory attenuator 27 and/or a color visible filter if a colored visible Flash is intended.
  • the utility of a range of flash power levels and sequences of flashes from a PLCM equipped with multiple lamps (optionally with different color filters 25 will be detailed later in this disclosure.
  • PLCM lighting can be triggered by an electrical (or fiber-optical) signal via link 31 from the
  • the LARCA and PLMC can include schematic feature 26 allowing them to be displaced substantially from the line of sight ("LOS") of the Smartphone Imager.
  • the displacement is shown as horizontal, but can be otherwise, e.g. vertical (up or down) or detached for greater convenience.
  • any of the Camera/lmager types (such as 3-D camera 49, smart camera 50, video camera 51 , or CamCluster 52) on the right hand side of Figure 4 can be equipped and/or accessorized in the same manner as shown for any Imagers on the left (such as dSLR, point and shoot, and similar cameras 41 and 42), i.e. with PLCMs and light sources 43, 44, that are imager-mounted or associated 45, 46, 47) with out-board lighting etc.
  • PLCM power and/or for lighting can be wired or from on-board batteries depending upon the installation and mission details.
  • Mobile device 48 can be a Type 1 imager OR a Cell-phone or other wireless networked device which can or cannot have any on-board imaging capability. It can have a LARcode physically associated with it which is readable by other LAR-Readers. Mobile device 48 can be within a general scene within a field of view of imagers 41 and 42 that can include LAR-coded objects, LARsponders, Reference points, etc. 53.
  • the "CamCluster” imager 52 is a schematic representation of a LAR-Reader using multiple cameras of one or mixed types of imagers which are mounted together.
  • Their field of views (“FOVs") 54 can cover contiguous areas of a scene, particular areas, and/or can rover areas of a scene with different focal length lenses.
  • CamCluster image capture by members of a cluster 52 can be simultaneous, interleaved, sequenced or otherwise varied within the cluster 52. Some or all members of a CamCluster 52 can be equipped with filters for reasons to be discussed subsequently. Versions of CamClusters 52 need not be arranged as shown.
  • Their LOSs and/or FOVs can be oriented along arcs, cylinders, portions of spheres etc.
  • CamClusters 52 can be associated with complementary arrays of PLCMs and light sources implementing the Locate and READ etc methods and other system functions described herein.
  • LARCAs for TYPE 2 Imagers can provide Data and Control Links via any or all wireless and physical connections displayed in Figure 4. Links can be employed individually, sequentially and/or simultaneously/redundantly to any/or all elements inclusive of those listed above as TYPE 1 Features, Capabilities and Functions and others in addition:
  • LARCAs can access and/or execute local LARCA-Resident Apps, Data Processing and Data-Bases for autonomous performance of LOCATE/READ(decode etc.) and other functions and can activate and/or cause responses of other associated Systems.
  • LARCAs can call, cooperate with, access and/or execute local LARCA-Resident Apps, Data Processing and Data- Bases in cooperation with Imager-Resident Apps, Data Processing and DBs) for performance of
  • IM Immunotherapy Managers
  • LARCAs LARCAs
  • IM Immunotherapy Managers
  • PLCMs can provide Accessory Power (batteries, solar, etc.), backup & inboard power management for Imagers and for LARCAs, Local Lights and Power Control thereof, PLCM Flash status charging & readiness- reporting to Imager, LARCA and other systems, Maintenance requests, Status & service diagnostics reports re LARCA and Imager systems etc.
  • Outboard PLCMs if not attached to movable Imagers - e.g. controlling venue-mounted lights) can be hard-wired for power and communication etc.
  • Light sources controlled by or associated with PLCMs can deliver different types of illumination to serve different purposes, For example, they can control multiple lamps 44 and 47, some or all of which are filtered and which can be energized singly or in various combinations to deliver lighting with different spectral characteristics.
  • RR returns from LARcodes can be distinguished from other lights or bright spots in the sensor FOV, e.g. specular reflections from highly polished surfaces etc. because of their deeper modulation depth.
  • PLCMs can control high-brightness and/or fast-cycling flash units 43, 46.
  • PLCMs and/or LARCAs can control (P/T) Pan & Tilt or other mounts for LAR-Readers including motor-driven positioning or robotic mounts.
  • LARCA-equipped TYPE 1 or TYPE 2 Imaging devices can have novel and substantial image acquisition & image-processing & other data processing capabilities/methods available within the LARCA itself, in its associated imager devices, PLCMs, and/or via links to other data processors and data-bases.
  • LARCA equipped imagers and their associated systems/apparatus, software and data- bases can perform generic LOCATE and READ functions plus tracking of LARcodes within a scene using a variety of methods.
  • LOCATE flash intensities can be under PLCM or LARCA/IM system software control. Intensities from RRs can be intermittently and/or systematically attenuated or varied (e.g. ramped up from low levels) in a series of Imager frame exposures. The results so obtained can be analyzed with appropriate image-processing software to detect "bloom" and/or loss of details, sharp edges etc. caused by excessively high brightness LOCATE flashes or conversely by excessively low brightness of the LOCATE test flashes returned from specific LARcode RRs. Such test series can be inserted from time-to-time in the data stream at frequencies based upon history, code locations in a venue or other criteria.
  • Illumination used for LARcode READ functions can be similarly adjusted.
  • PLCMs can adaptively set intensities to optimum levels as a function of particular LARcode locations where particular RRs or Color Blocks etc. have shown marginally reliable readability. This condition can be identified, for example, by the presence of pixels with signal amplitudes marginally close to a defined minimum threshold.
  • Excessive brightness can be determined, for example, by the presence of a group or groups of saturated pixels that are larger than a predetermined minimum size relative to the overall code image.
  • LARcodes For fast, slow-moving or stationary LARcodes, software can also be adapted to dealing with/accounting-for changes in localized predicable or otherwise changing overall light levels caused by slowly moving shadows of structural features etc.
  • Local time of day data can be an input to the system. Data from dedicated accessory sensors monitoring changes in ambient light due to cloud cover, sunlight through windows etc. can be exploited as well.
  • PLCMs can use powerful general scene multi-spectral color Illuminators in burst sequences. These can help facilitate accurate color READs of several types of LARcodes disclosed herein such as mosaic types or those using subtly different colors to accommodate large amounts of information.
  • image SNR signal to noise ratio
  • image SNR signal to noise ratio
  • Code interpretation accuracy ratios can also be improved by real-time and/or post-processing stacking and averaging of data from multiple images of corresponding regions of a given code.
  • An adaptable number of such multiple images (size-adjusted, warped etc. as necessary) overlaid or "summed" sub-sample by sub-sample or pixel by pixel can be used.
  • the number of such averaged images can be software-controlled to meet defined minimal S/N acceptance thresholds or other criteria.
  • Multi-frame sequences similar to those described above for adjusting illumination to get best RR images and code-areas data for color ID can be complemented or used independently to optimize imager focus, FOV size etc. with priorities assigned by data contained in the code itself or, e.g. apparent image size etc.
  • Adaptive selection of LARcode RR LOCATE regions in accordance with apparent relative sizes within a scene can be used & can define ROI regions for zoom, decode READs, and/or track priorities etc.
  • Spurious RR or specular reflection sources can be surveyed during times when no responses are being requested by LAR-Data Servers which can log their behavior, shapes, etc. and eliminate them if they do not move unpredictably (e.g. they move due to the sun's movement) over some defined time interval or using some other criterion etc.
  • LARcode RRs and/or code regions images appear, and dependent or independent of their relative sizes if so specified
  • the nature and information conveyed by such images can be used by LARCA/IM/PLCM and associated systems to execute other actions such as adjusting the LAR-Reader focal length for optimum reading, or designating a LARcode as an ROI of "special interest” and applying image stabilization, altered or particular illumination parameter sequences or other special treatments and/or priorities.
  • Specific adaptive capabilities can be conferred by system software based upon recognizing the content particular LARcode or by cues from previously captured data on LARcode LOCATE RR size, shape, etc. For example, it can be conferred via a previous valid code-READ of the LARcode obtained earlier when the LARcode was closer and/or was being tracked as moving faster or slower than defined relative or absolute velocity thresholds.
  • a LARcode can also carry situation-dependent and/or application-dependent priority instructions allowing it, but not other LARcodes in the same scene, to be conferred over-riding "special" treatment of it.
  • LARcodes with particular pre-defined code features can be granted preferential frequency or relative priority of attention (but not exclusivity) as compared to others in a scene.
  • LARCAs can initiate transferring commands to other devices and/or a LARCA's own associated PLCM to, for example, interleave specific sequences of Flash spectra during multi-frame image acquisition by particular Imagers when certain defined types of codes appear in the scene. They can alter frame capture rates and/or Illumination schemes via IM or PLCM commands depending upon criteria such as that LARcode's movement velocities, frequency of partial READ failures of certain code types, etc.
  • PLCMS and their associated light sources can deliver individual flashes, flash sequences for multiple image capture exposures, or can be "ON" for extended intervals of any duration if continuous or near-continuous reading and/or tracking of RR LARcodes is necessary and adequate power is supplied. They can emit visible white light or otherwise, including IR &/or UV. They can use colored (and/or polarizing) filters on lights to aid in RR identification via the distinguishing color or polarization of the retro-reflected light there-from as contrasted to environmentally- caused specular reflections or other light sources.
  • Additional light sources close to a LAR-Reader but in somewhat off-set locations with respect to the LAR- Reader's LOS can be turned “on” or “off alternately, or in some other sequence including on-off periods of Illuminator sources whose purpose is to produce RR returns from LARcodes. per se. Regions that are bright with the latter sources off can be used to identify and ignore or mask unwanted other lights or bright spots in the LAR- Reader's FOV.
  • PLCMs can deliver white, colored, and/or multi-color sequences of light.
  • a multicolor sequence capability opens novel ways of using visible spectrum color light sources.
  • LAR-Readers based upon monochrome or color Cameras/lmagers (and with or without image intensifiers) can achieve enhanced capabilities for color determination, identification, and robustness in any type of color-code image via differential spectrally- dependent lighting and/or temporal modulation patterns in images of such codes.
  • the method can also be used with non-visible imagers/sensors (e.g. Night Vision Intensifiers-NVIs) together with non-visible illumination sources and coding materials whose reflectivity, luminescence, or phosphorescence is wavelength dependent in the IR or UV.
  • LARcodes can use coding methods employing pigments or other substances having different IR brightness levels under IR illumination from sources which can have various spectral profiles. It is noteworthy that NVIs are also now available which create detailed false-color visible output imagery based upon IR scene details including LARcodes designed to be read under IR illumination. Outputs from these NVIs can be directly optically coupled to the various types of visible imagers employed in LAR-Readers discussed herein.
  • the method exploits the time-dependence of pixel-by-pixel flicker and relative amplitude modulation (color brightness OR gray-scale levels) to acutely distinguish different "color" entities used for coding within a series of image captures during multi-color color excitation driven by the appropriately filtered PLCM lighting sequences.
  • Such collective data series enable use of a large color universe by being capable of detecting subtle color differences especially when there are steep changes in transmission at different wavelengths of the illumination light filters used.
  • Multiple data sets of the sort obtained by the methods disclosed herein also allow noise-reduction techniques to be applied by "stacking" (summing) corresponding pixel-by pixel signal levels as seen in images of a given LARcode.
  • Different weights can be given to data from a given pixel in an image under different illumination spectra. Those pixels with the best S/N ratios (brightest) can be given some prescribed preference.
  • Multiple color standards positioned in known locations within a scene, or within a LARcode itself, can be employed for matching and color ID if necessary and can be desirable especially in venues where the PLCM lighting must compete with bright ambient levels. They can have a capability to command dimming or ON-OFF control of sources of ambient light within their environment.
  • LAR-Readers any of the Illuminators, color identification techniques and novel types of LARcodes and LAR- System features etc. taught herein in the context of LAR-Reader concepts and methods employing a single device for both LOCATE and READ functions can also be advantageously applied to LAR-Readers using two cooperating but separate sensors.
  • one imager can be an IR sensitive camera or imaging array for the LOCATE function collaborating with a physically separate visible-light sensitive camera or imaging array.
  • One can be a filtered or intensified device, the other a high frame rate imager or one capable of executing ROI options.
  • These devices can share a single lens LOS &/or FOV via beam splitter optics or other functionally equivalent arrangements.
  • LOCATE and color Block data can be brought into sufficiently precise correspondence pixel- by-pixel for LOCATE, COLOR decode, LAR-code tracking for uses described in this document.
  • Image processing software known in the art for shape recognition, shape-warping, color boundary recognition etc can assist in this task.
  • This task can also be facilitated by using images containing BOTH fixed Reference Markers in pre-determined locations in a venue combined with a LARcode's apparent size in an image to determine a relatively precise off-set correction for combining and aligning corresponding pixels in the IR and visible sensor images.
  • the FujiFilm FinePix Real 3D W1 a TYPE 2 Imager
  • Each 3x zoom lens is equivalent to a 35 - 105mm lens on a 35mm camera, and has its own 10MP CCD sensor. These are coupled together with a new built-in image processor that Fujifilm calls the "RP" (for "Real Photo”).
  • the FinePix Real 3D W1 can take 3D as well as traditional 2D images. In addition to the usual scene modes and exposure controls, Fujifilm has added specific features to take advantage of the two complete lens/sensor arrays in the camera.
  • An available Dual Capture Shooting Mode allows simultaneous capture of two frames at different settings, one through each lens. Separate focal length, exposure, and color settings can be used for each.
  • different exposure modes can be used for the two photos— one for RR LOCATE data the other for Code READ data.
  • the device could then switch to devote one camera to shooting a wide-angle image while, at the same time, the other might be zoomed-in to capture an ROI portion of the image.
  • Methods and apparatus here disclosed enable a single as-built camera or other imager to function as a versatile LAR-Reader.
  • the method uses either the built-in flash (as supplied with the imager and assumed mounted near the LOS of the camera lens) or another light source such as shown in Figures 2-6.
  • a built-in flash source's normal brightness if not programmable by the device, can be attenuated (and optionally spectrally-filtered) by movable/removable elements, e.g. attenuator 30 and filter 29 respectively. These can be manually "press-on" mounted over the camera's built-in flash window.
  • the purpose of the attenuation of the visible flash from the built-in Flash unit is to insure that returns from RR images in the scene are at non-blooming brightness levels.
  • the unique spectrum of the flash-driven RR reflections (if a color filter is used) can be used to distinguish LARcode RR LOCATE signals from other (environmental) specular reflections and lighting. Not every captured frame must include RR LOCATE data, especially if LARcodes are quasi-stationary or moving slowly.
  • the low-brightness flash levels (which, in some embodiments can be made Adaptive via software or firmware as has been discussed above) make LARcode LOCATE RRs in any given frame easy to distinguish while avoiding blooming.
  • the required LOCATE flash levels need not interfere with reliable reading of non-retro-reflecting LARcode color regions which are captured simultaneously.
  • Software used for color-Reading can readily take full account of any slight shift in the overall ambient lighting incident on the LARcode due to effects of the RR LOCATE flash or scene fill light flashes. This is especially true when color reference standards are included on the LARcodes.
  • a camera's "exposure control" can typically be set for deliberate over-exposure of the general scene to compensate for the lower than "expected" scene brightness which would ordinarily have been delivered by an un- attenuated flash. This depends upon the circumstances and the other capabilities of the system that the Imager can be using such as outboard "slave” Flash sources.
  • a PLCM including a Flash unit, power-supply etc. can be removably attached to provide primary scene Illuminators and/or supplemental Flash source(s).
  • Mounting features can allow one or more of its lights to be sufficiently laterally displaced and/or rotated away from the Imager's LOS to avoid significant retro- reflected returns from the RRs in the scene while other lights in the PLCM produce optimal and non- blooming RR data. See, for example, feature 26 in Figure 3.
  • various options such as an in-plane 90 degree clock-wise rotation around lamp 24 are not shown.
  • the imager-mounted PLCM and/or other PLCMs in the venue can then supplement ambient scene lighting (e.g., in the manner of a "Fill-flash”) as necessary for LARcode READ functions without over-exposing RR regions.
  • direct signal access to the Imager's control software or via an "Application" which enables wireless (or even audio) timing signals from the imaging device to be conveyed to the PLCM can be used to time-synch and otherwise control PLCM flash operations and sequences.
  • the PLCM can also be controlled and triggered manually, electrically, wirelessly, or by means of an optical sensor in the PLCM whereby it detects low brightness or heavily attenuated flashes and/or flash sequences from a camera's unmodified built-in flash source if one exists.
  • the trigger light can be conveyed via an optical fiber or can activate a photo diode or similar sensor coupled to the PLCM.
  • Figure 5 schematically illustrates a typical mobile camera phone 500
  • Figure 6 schematically illustrates a generic TYPE 2 camera 600. (The latter is equipped for some form of communications capability such as WI-FI etc. if low system latency is required).
  • the accessorized imagers shown in figures 5-6 can be employed in applications where visible flash illumination can be used and where fully-covert or minimally-alerting image acquisition is NOT required.
  • general scene lighting can also include purposefully distracting visible light flashes or other dynamic lighting effects/changes which can disguise image acquisition flashes by LAR-Readers thereby effectively making them "semi-covert”. If covert (or minimally detectable) operation is required, other methods such as described in the following Section A.10 can be enlisted.
  • frame acquisition sequences using attenuated visible flashes from a camera's built-in Flash source such as blocked built-in flash 506, for LOCATE RR Excitation can be interspersed (e.g. once every 5+ frames etc. to allow for Flash re-charge time) within sequences of ambient illuminated general scene READ frames.
  • the predictable time of appearance of bright (optionally color- filtered) RR regions in certain frames and not in others can aid in efficient image processing procedures for LARcode LOCATE purposes.
  • LARcode READ frames can be captured using any kind of illumination sources provided that such sources are off-set from the imager LOS.
  • Such off-set sources can be pulsed or otherwise and depending on available ambient/environmental/effects lighting, can or cannot require activation of the "Scene Light” sources 504, 604 shown in Figures 5-6. This can be determined by the exposure control software in the camera itself which may, in turn, instruct out-board "Scene Light” power supplies.
  • the type 1 imager of Figure 5 can be a phone having a display 508 that can have a blocked built-in flash 506 and a flash sensor 510.
  • Accessory product 502 can be coupled to the phone and can include a power and control unit 512, RR light 514 and scene light 504.
  • the type 1 imager of Figure 6 can be a somewhat standard camera having a hot shoe 616.
  • Accessory product 602 can be coupled to the camera using hot shoe 616.
  • Accessory product 602 can include a scene light 604 and RR light 614.
  • the camera and accessory product 602 are communicably coupled to each other to allow control signals to pass from one to the other.
  • frames intended to serve as LOCATE frames are illuminated using one or more of the types of light sources shown in Figures 2-6 which are positioned near the Imager's LOS. These sources are equipped with NIR or Deep-Red Pass Filters (see 25 in Figs. 2-3) and capable of producing relatively high levels of IR or Deep Red output. This causes images of RRs associated with LARcodes to have significantly higher luminance levels than the other portions of such frames.
  • the method can be used with cameras with or without built-in IR Blocking filters.
  • the camera can (if necessary) be pre-set to
  • the NIR or Deep-Red excitation at a pre-determined and sufficiently high power level (but not high enough to create excessive "blooming of RRs), can be synced with the color camera's shutter. It can be triggered on almost every frame in certain applications, alternately, periodically or only on-cue in others. Deep Red short duration flashes, even if intense, tend to non-disturbing to the non-dark- adapted human eye, nevertheless, they can brightly reveal any RRs in an otherwise under-exposed image.
  • visible spectrum color READ frames can be captured with normal exposure settings (no Flash) using ambient light or other available non-alerting lighting. This can be controlled manually or by using Imager software/firmware features or custom software Apps.
  • Type 1 1magers equipped with a PLCM 23 also can provide NIR or Deep Red functionality using one light source 24 or several with appropriate filters.
  • Video sequences and/or single or multiple frame interleaved sets of both types of frames can be acquired using Imagers featuring suitable capabilities.
  • NIR or Deep Red flashes energized by an auxiliary power supply in a PLCM can offer additional LOCATE capture options.
  • the PLCM can deliver sufficient energy to capture a rapid series of NIR or Deep Red flash exposures at rates faster than a usually slower rate limited by a camera's internal power supply's re-charge time.
  • Fast sequences of scene-frames using ambient lighting can be acquired together with a series of synchronous inter-leaved high intensity NIR or Deep Red LOCATE flashes.
  • visible LOCATE flashes can also be used in non-covert or purposely disguised implementations.
  • NIR/Deep Red frames and "normal exposure" frames can be buffered to be available sequentially or simultaneously during down- stream image processing. Single pairs or other combinations of such images can be used for implementing several other concepts and systems some of which are set forth later in this document.
  • Applications include but are not limited to LARcode-implemented activities in semi-darkened theaters, bars, restaurants etc. or in outdoor evening entertainment events as well as novel methods of security monitoring,
  • Deep Red or NIR Illumination can also be used for LARcode READ as well as LOCATE functions, and also with codes other than LARcodes provided the codes are comprised of patterns and/or shapes discernible under IR or Deep Red illumination.
  • Substantially covert codes which have low probability of being detected, even with flashlight inspection of a venue, can be composed of visually black patterns, regions, shapes or strips, etc. which are opaque to NIR and which overlie a Retro-Reflective backing in combination with other regions that are visually black but which transmit NIR. The combined areas therefore appear black under normal visible lighting.
  • a code is designed for Deep Red Reading, its presence can be slightly compromised in richly reddish ambient.
  • subtle INDIRECT red illumination e.g. low level light scattered off a venue ceiling
  • the entire combined "black" code area can screened with Deep Red or IR transparent colored inks and/or pigments to create overlying or partial coverage made up of visibly colored dots, patterns, texts etc. which serve as camouflage or distracting forms. Codes of this type can be used, for example, as targets which are unknowingly occulted by intruders traversing sensitive areas thus causing some type of system response.
  • SWIR Short Red or NIR
  • LARcodes can be used along with, for example, InGaAS sensor-based imagers carrying out operationally-sensitive LOCATE, READ and TRACK functions.
  • Monochrome cameras (optionally including high-sensitivity and/or very high resolution types, optically-coupled Imager Intensifiers, ICCD and EMCCD sensor arrays or similar or equivalent features) here are used with PLCMs with one or preferably several light sources.
  • Each Scene/READ Illuminator lamp can be equipped with a different Gel filter or equivalent and each can emit light with a distinctive spectral distribution. See 23, 25, 44, 47 and 45 in Figures 2-4, the last listed being representative of a single lamp Illuminator using filters that are changed by mechanical means such as rotary steppers.
  • Red, Green, & Blue LEDs With the recent availability of Red, Green, & Blue LEDs, a triplet group of these can be configured as one Illuminator & various combinations of ON timing & drive currents of the different LEDs can be used.
  • Illuminators for LARcode READ and general scene illumination can be substantially offset from the camera LOS to avoid excitation of LARcode LOCATE RR's and also to avoid alerting to the camera's location. (Others can be closely mounted to the camera's LOS as discussed below.) Members of the group of Scene/READ Illuminators can deliver "Off-On-Off time-dependent lighting sequences of different spectra to the color-printed code regions of a LARcode and/or can produce spectrally varied returns from RRs if present
  • the different Gel transmission spectra produce distinctive gray-scale levels in the monochrome imager's output depending upon the combined effect of the spectral characteristics of each filtered Illuminator light when "ON", the colors on the LARcode and the wavelength dependent response of the Monochrome imager (and Intensifier, if used).
  • This provides multiple sets of luminance (gray-scale level) intensity patterns from a given LARcode which are time- dependent and in sync with the different scene Illuminator On-Off sequences.
  • multiple image data sets can be acquired which are uniquely dependent on the colors present in the LARcode and also in any sub-patterns if present. Subtle color differences in LARcode code regions can thereby be detected and quantified.
  • the availability of such multiple data sets also allows data noise to be reduced using known signal-processing techniques.
  • LOCATE RR Illuminators emitting IR or visible light can be positioned adjacent to the Camera LOS.
  • These LOCATE Illuminators can be "constant-on” or distinctively time-modulated in various interleaved fashions (Frame to Frame) with respect to the Scene/READ Illuminator sequences.
  • LOCATE images so obtained can be shape-analyzed etc. to distinguish LARcode RR's from specular reflections or other environmental light sources.
  • high intensity flash lamp sources can be used to drive color-filtered Scene/READ Illuminators.
  • the source of ambient light can be fitted with a polarizer to reduce its effective intensity as seen by an imager equipped for the opposite polarization.
  • the ambient lighting can be temporarily or momentarily dimmed while the system gathers LARcode data and/or LARsponder data. See PART 3 re LARsponders.
  • Scene/READ light sources can include one or more polarized pairs (used alternately or in some other sequence). Both members of a light source pair use the same type of color filter while the Imager is equipped to pass one OR the other type of polarization, but not both. Ratios of brightness levels and/or using normalized differences and other analytical procedures with pairs of images as reported from each Camera pixel for each the two polarizations can enable discrimination against the masking influence of bright un-polarized ambient light sources.
  • Polarized areas of codes can be caused to "flicker" under illumination by sequences of polarized light sources for tracking, ROI isolation and other processes. This technique can be useful in venues where potentially competing illumination levels from ambient (un-polarized) light sources can be controlled.
  • a Color Camera together with MULTI-COLOR illumination sequences is used to READ color LARcodes.
  • Some of the light sources can be displaced from the camera's LOS while others can be close to it and thus can excite RRs which can themselves optionally be colored or partially colored as discussed further in PART B.
  • the color camera's wavelength-dependent output response is the result of a combination of the color of a given LARcode Block (or RR) and the incident filter-modified transmission Illuminator spectrum weighted by the sensor's color response versus wavelength profiles (typically 3 RGB channels) rather than by a monochrome camera's single spectral sensitivity profile.
  • This method is similar to that described in sections A.11, A.12, and A.13, except that visible white light OR multi-color spectrum Illuminators can be positioned to be (effectively) close laterally to a Monochrome LAR-Reader's LOS so the READER efficiently receives both LOCATE AND Code data light from RR regions of a LARcode.
  • This type of LARcode is here termed an "RRLARcode”. Regions of an RRLARcode can include uniform code regions and/or patterns comprised of colored RRs and/or broad spectrum RRs with transparent color overlays thereon. This type of LARcode can also reduce the effects of ambient light in situations where multi-spectral LARcode methods and apparatus are used. PLEASE SEE VARIOUS SECTIONS OF PART B, notably B.08.
  • A.16 As in section A.15, but wherein the Camera can be a Color Imager.
  • an Illuminator is a line-scan device such as a laser or multiple lasers outputting different wavelengths.
  • an Illuminator for use with LARcodes can be a projection device (such as a projection TVs, arrays of spotlights, or similar devices which output lighting that can illuminate areas within a scene (in which LARcodes can be present) with time-variable and/or region-variable brightness and/or color spectra.
  • a projection device such as a projection TVs, arrays of spotlights, or similar devices which output lighting that can illuminate areas within a scene (in which LARcodes can be present) with time-variable and/or region-variable brightness and/or color spectra.
  • projected lighting can be fixed or adaptively-controlled as discussed earlier in this document and/or can be responsive to the code content or spatial behavior of Codes within the scene being illuminated.
  • LAR-Readers and associated or special system-related/controlled Illuminators can be placed near general environmental light sources in positions such as on ceilings, walls, lamp-posts, etc.
  • the primary FOV of a user of a LARcode system often need not include such system-related light source positions.
  • a LAR-Reader's FOV can include LARcodes which are excited by Illuminators that are relatively near the READER. Meanwhile, LARcodes manipulated by users themselves can generally be oriented or otherwise configured or positionedf posed" by them so as to be within the FOV and Readable by a LAR-Reader while the user's instantaneous LOS/FOV during such use need not include the Illuminators. For example, LARcode
  • Illuminators shining more or less downward from above and near Readers similarly oriented can be used with LARcodes facing more-or-less upward as they are held or manipulated by users using a horizontal or somewhat downward LOS.
  • Commonly-used lighting sources such as those used for providing ambient lighting in a venue and/or for special-effects lighting unrelated to LARcodes can be very unobtrusively supplemented by the special intermittent, pulsed, or otherwise-controlled LAR-System Illuminator lights. These can be specifically devoted to use by the systems disclosed herein or can have multiple or additional purposes. For surveillance or security purposes, they may, for example, be designed to appear unremarkable or "ordinary” such as being a part of an assembly or a row of flashing "marquee" lights. LAR-Readers can be built into or adjacent to these sources but sufficiently distant so that the non-system lights do not interfere with LARcode RR LOCATE functions.
  • novel LARcode apparatus forms, features, and methods of use that expand the types of physical apparatus which can comprise LARcodes per se and/or use LARcodes as components of novel devices and systems with new capabilities and applications.
  • the disclosed art can be used in a given LARcode or in combination with other types of LARcodes and/or other types of codes known in the general art and they can include one or more features facilitating use of LAR-Reader apparatus, accessories, methods and/or capabilities as disclosed in PART A. B.01 PRELIMINARY REMARKS ON COLOR REFERENCE BLOCKS, "WHITE BALANCE" TARGETS & LOCATIONAL REFERENCES
  • LARcodes are comprised of an assemblage of 10 encoding "Blocks", each Block being freely available for coding in a specific color selected from a pre-determined limited set of colors, in this case RGBCYM.
  • Blocks can typically be freely available for encoding purposes
  • several such elements, Blocks, or other forms can be reserved as predetermined fixed locations which are always assigned a known color, if desired for particular applications or situations, These can serve as Reference Standards used to aid color identification of other elements on the code which are created/printed by the same methods and pigments/inks etc. used to create the reference regions. If white and/or gray is added to the available color palette, these 'colors" can be used in any location(s) both as code elements AND also as References for "white balance" correction as in traditional television practice.
  • Reference colors or white balance targets intended for use with LARcodes in one or several known locations within the venue.
  • Such Reference targets can be completely separate from the LARcodes themselves. They can be simplified codes (e.g. RRs plus one, two or three colors) which are READ intermittently, or as required by system performance, to support reliable decoding. This, in turn, can make otherwise reserved locations on other LARcodes available for other purposes including data coding.
  • Locational Reference targets can also ID precisely known pre-measured physical entities within a venue whose images may, in turn, be used as local reference points by a LAR-System enabling it to provide very high precision location data of LARcodes imaged within the venue.
  • Blocks on a LARcode can be simple, often uniform "regions" or “elements” on a code which are uniquely identified by color or other optical properties using a LAR-Reader.
  • various more complex types which have certain particular and desirable capabilities or features.
  • the mixed color tile population represents a Block of mixed color defined by the relative proportion of tiles of the different colors present.
  • Other Blocks can contain Sub-Blocks and/or patterns and shapes created, mosaic fashion, by tiles OR by other methods.
  • Figure 7 shows a device having a LARcode that includes RR material 708 and various blocks 702, mosaic blocks, sub-blocks 712, tiles 710, sub-tiles 706 and simple shapes.
  • This technique uses geometrically/optically- mixed combinations of Reference Colors rather than printer/process-mixed colors to create encoding Blocks representing colors other than a Reference color.
  • Small sub-block tiles 706 of two or more primary colors which are also present as Reference Blocks can be used to create such encoding Blocks.
  • Non-primary mixed colorants can also be used but can yield less robust results if they are not included as a Reference on the LARcode or elsewhere in the scene under closely similar illumination.
  • LARcodes can be made/printed by various processes. In many instances using "office-type" printers, RGB or CMY colors are mixed to achieve colors other than the primaries and the mixing ratios can vary from one printer or process to another. Therefore, while RGB Reference Blocks on LARcodes can serve well to insure proper identification of any R, G, B Encoding Blocks, identification can be less reliable, e.g. in the case of mixed colorants such as a Cyan created by using Red mixed with Blue. Depending upon how the processes are set-up by the operator, a given printing process for cyan can use 60% of its red primary & 40% blue, while another can use 50% red & 50% blue etc. (Similar remarks can be made about CMYK-based processes, and Reference Blocks using selected CMY can be used in the same manner.) If necessary for a particular type of color code, these issues can be minimized by the following method:
  • the tiles if small enough, can be blurred together because they are below the resolution capabilities of the imager used. This creates/simulates the effect of a uniform mixed colorant composed solely of the Reference primaries on the same LARcode.
  • Mosaic Blocks can also be statistically or otherwise evenly sampled by LAR- Reader software used for determining the ID of simulated mixed colors.
  • Shown in Figure 7 is a portion of a LARcode in which the first Block uses a mosaic of colors (e.g. Green) and B (e.g. Blue) to synthesize a color that is 50% G and 50% B (hence cyan) when interpreted as a uniform Block in white light.
  • the individual tiles and sub-tiles shown in the first three Blocks can be much smaller and more numerous than shown. Furthermore, they need not be all of the same size.
  • a set of uniformly colored Reference Blocks is omitted from the drawing, but the fourth Block IS uniformly colored and could be identified as a Reference Block of color X if it is in a location so assigned by the system software.
  • CM Sub-Block patterns can be interleaved or divide their occupancy of a shared Block in a great multiplicity of ways and can differ with respect to the fraction of the total area of a given Block occupied by one sub-region spectral type vs other(s).
  • Tiles 710 in Blocks or sub-Blocks can be arranged in distinctive patterns including but not limited to forms which have immediate complex interpretive meaning to humans e.g. "pictures" and/or symbols.
  • LARcodes by design, possess unique features which can facilitate LOCATE and READ operations in visually complex scenes (possibly containing many and/or distant LARcodes). LARcodes can be read at long stand-off distances without requiring precisely detailed imagery. In contrast, Bar-codes, QR codes etc. typically require comparatively high resolution data obtained by close-up scanning or long focal length optics.
  • QR or Bar-codes physically large, e.g. on buildings, billboards, hence readable at long standoff distances, but this has disadvantages, esthetically and otherwise, especially when several codes are present. GPS-supported selective message activation also can be problematic as to sufficiently precise location accuracy (in crowded display windows) etc. and perhaps even basic availability in certain situations and geographic areas.
  • LARcodeNESTs 800 which include RR 806 and one or more (such as the six depicted) LARcode Color Encoding Blocks 802 within which are "nested” BAR-codes, QR codes 806, or other binary (Black/White) types of code containing substantial amounts of data.
  • the NESTs 800 are easily located and isolated in an image (e.g. using LOCATE RR's 806 in the LARcode).
  • Color-encoded data Blocks 802 in the LARcode convey "Top-Level", “headlined”, amended, updated etc. information relevant to the detailed data to be found in the QR codes, BARcodes, etc. which are nested in the Blocks 802.
  • the LARcode itself need not convey the detailed content in the nested codes nor in "Compound" codes to be described in the next section.
  • LARcode- color portions of the LARcodeNest 800 can use any of the Block 802 encoding methods herein described (including sub-Blocks or mosaics etc.) although more typically these can be simple uniform color areas. Color Block sizes can differ to accommodate different sizes of the detailed content codes nested within them.
  • An example of a LARcodeNest 800 using QR codes 804 is shown in Figure 8.
  • the various shaded and black patterns above represent different colors.
  • Six background color Blocks 802 are shown in this example, with six QR codes 804 - printed in colors different from their backgrounds superimposed on them. QR codes 804 can also be printed in black. Reference Color Blocks can be used in addition, but are not shown in the drawing.
  • the entire suite of QR (or other codes) including all the LARcode components can be retro-reflective as discussed previously or, as shown, can use separate RRs 806 of appropriate shapes and sizes of which the RR "T" shape 806 in the Figure is merely symbolic.
  • the LARcode functions in LOCATE mode and, in this example, also offers the six color background Blocks.
  • An encoding scheme using a choice of one uniform background color per Block provides an available code universe of -47,000 if the QR code areas are all printed in, e.g. black. If two "outboard" uniform color blocks with or without nested QR codes are added, the available coding population is -1.7 million. As shown (again merely symbolically) in the lower right Block 802 in Figure 8, the coding population can also be expanded using more than one background color in an individual Block and that background can feature more than one shape. Taken together, these and similar options provide an adequately large coding universe for conveying the "high-level" information.
  • Top-Level information from the LARcode can describe the much more detailed information available if the LARcode, with its Nested code content, were to be more closely approached or selected for more detailed reading by, e.g. using a zoom lens with image stabilization to bring up its nested QR content (or any other nested code types such as BARcodes., Semacodes, etc.) up to readable size.
  • the Top-Level Data can include a List of the Titles (or some other characterizing information) concerning the Nested Detail-Level Data.
  • Such lists or similar techniques e.g. icons
  • Top-Level data can also cause a suitably-equipped LAR-Reader to automatically react with tracking, zoom, or other capabilities to capture and process the detailed data (which can be either open or encrypted information) when or if such Detail-Level Data are present in nested codes.
  • HCCB High Capacity Color BARcodes etc.
  • LARcode COLOR BLOCK coding would then preferably be done in suitably-sized borders around the HCCB areas rather than inside the detailed code area itself. This method can also obviously be used with QR or other black/white codes if desired.
  • LARcodes featuring LARcodeNESTs offer a "Come closer-learn more" experience. This has both practical and psychological implications.
  • Their Top-Level data readable at a distance and even if posed sub-optimally for reading, can invite a user to walk down the aisle, divert to a display, cross a room, come down the street to a store window etc. It alerts that helpful detailed information on specific topics can be obtained "over there”. Getting that detail-level information does not necessarily require real-time wireless connectivity because the Nest data codes can be readable using software residing in the LAR-Reader device itself. This can be useful in areas where coverage or access is limited or under-developed.
  • a TYPE 1 LAR-Reader Given real-time connectivity, such as provided by a TYPE 1 LAR-Reader, data in nested LARcodes can automatically access local proprietary or remote Servers and/or other system data-bases to offer topics/features beyond those provided by the LARcode and/or its Nest. Top-Level data in the LARcode (decoded by a TYPE 1 LAR- Reader or equivalent) can be used to auto-access/activate updates and links provided within the nested detailed QR etc content codes. Furthermore, given connectivity/access via a LAR-Reader to data processors, applications, and other organized information about the specific user (e.g.
  • the Top Level LARcode itself can be tailored to select or substitute, add more detail, make announcements of time-dependent offers in the venue (down to the number of minutes allowed before expiration) and/or embed other special time- dependent personalized information, "here, now, and just for you” etc. directly within the more general detailed code level (e.g. in the content of one specific QR code in the nest). Thus I read about a 15 minute long burger deal while you read about fish sandwiches— from same Nest -so to speak.)
  • Information from a User's interaction with a particular LARcode and NEST in a venue can also be used to modify the data that will be read-out from of other LARcodes and NESTs in the same venue or in other places visited subsequently by the user of the LAR-Reader.
  • Very simple visible Symbols such as Arrows or a light etc. can indicate to potential users that a LARcodeNEST is down the block, and that they can retrieve information from it from a distance before approaching it to find more information, by reading the Top-Level LARcode.
  • a sign might indicate that "a LARcodeNEST is OVER HERE so check-out what it is all about from Over there' (e.g. across the street) by reading the Top-Level LARcode before you bother to come on over”.
  • Figure 9 illustrates a group of standard QR codes 904 coupled with a LARcode 906 to form a Compound Code 900, the LARcode portion of which can be Readily LOCATED, READ (and tracked in motion, if necessary) at long READER stand-off distances.
  • the LARcode 906 again conveys only selected or custom-coded "Top-Level" information about the more detailed or other content available in the associated QR codes, BARcodes, HCCB codes, etc. Compared to a LARcode of similar size, these are readable only in closer proximity or via zoom/telephoto and/or high resolution imagers/optics perhaps using precision image stabilization.
  • the last-named function can also be efficiently enabled using the optional RR's 908 on the QR code groups as guides. While six QR codes 904 are shown, obviously any number can be used.
  • the capabilities, features and concepts disclosed herein pertaining to LARcodeNESTs are equally applicable to the concept of Compound Codes.
  • LARcod 900 can include RR's 910.
  • FIG 10 shows a LARcodeNEST 1000 of six Color Encoding Blocks 1002. Each of these, in this case, contains a BARcode 1004 (which can be any other type of optically-readable code such as another LARcode).
  • the BARcode Blocks can or need not themselves be color-coded
  • another approach could employ a second LARcode (not shown) which carries in ITS code the identity of the Nest and/or other "TOP-Level" data about the Nest content but which does NOT serve as a Key.
  • the NEST in Figure 10 is "coupled” to a separately supplied and/or a conditionally-provided LARcode "KEY" 1006 (shown here below the BARcodes).
  • An acceptable image of the Key 1006 is needed to gain desired full access, functionality or other results dependent upon valid readings of the images of the codes which are coupled to the KEY.
  • the number and types of codes in a given assembly need not be a fixed parameter.
  • the Keyholder can be granted access to part or all of the encoded information in the NEST e.g. BOTH the basic Color Blocks of the NEST and/or in the BARcodes or QR codes etc. within those Color Blocks.
  • Such access can also convey other defined privileges to the user or can enable many other types of actions such as participation in voting, prize drawings, registering opinions etc.
  • the information that is unlocked to the user can be directly encoded within the NEST in plain or encrypted form. Additionally, the NEST can contain look-up information which is used to access the unlocked information from a central data base. These methods of encoding information into the NEST can allow more data than might otherwise fit in the NEST, and can prevent intruders from attempting to manually decode the NEST.
  • a Key can be provided upon fulfilling a particular condition or conditions: i.e. by purchasing, by being given as a premium, being won, being judged security-qualified, etc.
  • a Key can be easily changed, re-issued, deemed expired or replaced at any time the System operator chooses or requires.
  • a LARcode Key can associated with other means of ID, e.g. on a Pass or credit card. Its use can also require the presence of a pre-determined RFID code tag to permit opening of the data within a locked code or additional ID such as voiced or keyed pass-words, mid-air gestures in view of an imaging device capable of tracking LARcode motions or other ways of tracking & identifying body movements with precision, signature entry, biometric verification, face recognition etc.
  • RRLARcodes 1008 can be fabricated using transparent inks that are printed or otherwise laid down on receptive transparent films or coatings behind which are materials with retro- reflecting properties. They can also be fabricated using screen printing methods to transfer retro-reflective paints or pigments onto non-retro-reflective substrates.
  • RRLARcodes 1008 can use patterns of colored transparent inks printed on sheets of transparent plastic etc which are made receptive to the inks, cut to LARcode size and shape and then adhered to a retro-reflective substrate to complete the RRLARcode 1008.
  • Printing can be via ink-jet or other techniques. This and other methods can also be implemented using recently demonstrated nano-gratings as the reflectors.
  • LARcode elements also LARsponder as in Part C
  • another method can use strips, squares, or other shapes of different mono-colored transparent Gels (available in a VERY wide range of transmission spectra contours) which are assembled side by side to produce the functional RRLARcode (or in some cases over-lapped) and then overlaid, in total, on a retro- reflective backing.
  • RRLARcodes in which some or all regions are retro-reflective can (but need not) use separate LOCATE regions distinct from code regions.
  • Novel types of RR Regions can also be comprised of more than one type (e.g. two) of RR sub-structures, each with several different basic optical parameters-- such as incoming light acceptance angle of the incoming beam axis versus resultant return-beam intensity or color content or both (two mixed different refractive index and color of micro-spheres embedded in the same transparent binder matrix).
  • substructures in a given RR can be in the form of strips or "checkerboards" etc. with differing range or pose dependent optical parameters. This provides a basis for RR pose-angle determinations and/or range information derived from LAR- Readers (with known off-sets between their Illuminators and their LOSs) using methods based upon, e.g. observed intensities/color ratios from the different types of RR materials.
  • phosphors Materials are known in the art (phosphors) which can be induced to emit visible fluorescence and/or phosphorescent light under UV excitation. These materials can be used to fabricate LARcode Color Blocks which can be located and READ by conventional or high-sensitivity visible light imagers/cameras via emissions stimulated by UV excitation flashes. The wavelengths of such stimulated emissions are often sharply defined. Depending upon the materials used, the stimulated phosphorescence can be in different spectral regions.
  • the ultra-violet excitation can be extended in time or delivered in flash sequences and at levels/durations safe for humans.
  • the UV can originate from UV light sources that need not be positioned close to an Imager's LOS since retro-reflection is not involved.
  • Excitation sources can be close to LARcodes of this type. It can be delivered (e.g. by "searchlight” beams) from distant sources.
  • the excitation illumination can be delivered from behind occupants in the venue and/or from above thereby largely avoiding audience sight-lines.
  • Distinctive multi-spectral or mono-spectral UV-excited phosphorescent Blocks, sub-Blocks and patterns, such as mosaic-like tiling, can be used as LARcodes.
  • fluorescent and/or phosphorescent substances are known in the art which use Infra Red or visible sources rather than UV for Excitation.
  • LARcodes employing photo-luminescent elements with phosphorescent decay times of the order of seconds or more can use normal levels of ambient visible light to initially "charge” such elements. The venue light levels can then be briefly lowered for LOCATE AND CODE reading. During low lighting, momentary or otherwise, LARcode sensors using imagers with appropriately high light sensitivity and/or sequential multi-spectral selectivity can both LOCATE and READ excited fluorescent and/or phosphorescent LARcodes without depending upon RR's.
  • RR's are designed into (or are otherwise operationally associated with) LARcodes employing some form of phosphorescence
  • lighting sources positioned close to a high sensitivity LARsensor LOS can be used to locate LARcodes via continuous or intermittent retro-reflection of IR sources.
  • Brief visible retro-reflected LOCATE flashes of very modest intensity can be used, during or after which the ambient level can be dimmed to allow LAR code sensors to READ evanescent fluorescent/ phosphorescence from the pre-located excited code regions.
  • high-sensitivity monochrome or color visible light imagers and the various multi-spectral methods described in PART A can be used in dim venues.
  • Low- brightness multi-spectral visible light Illuminators working with (“all-over" retro-reflecting RRLARcodes as in B.08) can be employed to good effect in this regard.
  • read-out of color data by a monochrome imager can be accomplished by using differential and/or ratio brightness behavior as produced under known sequences of low-brightness (especially if spectrally-filtered RRs are used in code elements) illumination having different color spectral properties.
  • Such high sensitivity imaging devices can be used to implement many of the teachings herein at much lower than “typical" levels of ambient light, Illuminator power, RR LOCATE light levels, fluorescent/phosphorescent emission brightness etc.
  • they can operate with LARcodes at levels near or below the visibility threshold of the normal (or even dark-adapted) human eye. They can be readily intermixed and used alternatively or in combination with "traditional" visible and/or IR imagers/cameras to achieve desired effects and LAR-System operational goals.
  • a passive or active RFID chip "in” or physically associated with a LARcode, LARcodeNEST etc. enabling an RFID System monitoring a venue to communicate data to a cooperating LARcode facilitated System regarding the PRESENCE and types of LARcodes within the venue even if they are optically occulted and/or are located in approaches or proximal spaces which are not equipped with LAR-Readers or such Readers are not activated.
  • Such data can allow the LARcode system to account for or classify a Code as (1 ) being LOCATED, READ, and/ or TRACKED satisfactorily; or (2) being missed or subject to complete or partial occultation as presently viewed by all or particular LAR-Readers; or (3) being a candidate for assignment of other or reserve Readers and/or commanding Readers with adjustable LOS's and/or FOVs to assist in acquiring available
  • an RFID-tagged LARcode (passive or active) can signal to a monitoring LAR-System about its depa ngl approaching movement hence potential or current "presence" somewhere in a given or relevant proximal space
  • this method can be used to pre-activate/prioritize/direct a System using LAR-Readers to take certain actions relevant to that LARcode (even if not currently visible).
  • These actions may, for example, include implementing direct optical search for the RFID tagged LARcode or LARcodeNEST etc. redirection of a Reader LOS and altering its FOV.
  • Particular applications involving other venue equipment, commencement of alerting and response activities etc. can also be triggered.
  • an owner of a TYPE 1 Imager can have an RFID tag affixed to it (and optionally, a LARcode- pi ease see US Patent 7161581 referenced above). If desired, or as already registered in the system, the owner's Imager can be alerted to opt-in or can be auto-admitted to that system via the RFID code Reader(s). GPS, if available in the venue and if the imager is on-line, can also be similarly used but may not provide very precise location data or Imager LOS & FOV information.
  • a LARcode apparatus features and/or methods of use can include one or more of the following:
  • RR elements plus one or more passive code elements which can be comprised of one or more visible-light colored Blocks/regions, multi-color mosaics, patterns, shapes/sizes of various widths or lengths.
  • a given RR region or regions(s) can be comprised of two or more interleaved strips or other patterns of retro-reflective material having different angular brightness dependencies with respect to incident and/or viewing angle— for example, one useful for closer distances and wider incident angles etc. and the other for brighter returns at long distances and narrow angles.
  • B.13.3 As in B.13.1 , 1A, or 1 B, wherein some or any of the elements are 3 dimensional entities (e.g., spheres, disks, open or closed cylinders, skeleton, partially closed or closed polyhedrons, the last-named including STELLATED and CONVEX Classes or other complex shapes or portions thereof).
  • 3 dimensional entities e.g., spheres, disks, open or closed cylinders, skeleton, partially closed or closed polyhedrons, the last-named including STELLATED and CONVEX Classes or other complex shapes or portions thereof.
  • B.13.3A As in B.13.3, wherein the 3 dimensional entity or a portion or portions thereof are inflatable (such a Mylar balloon or other inflatable structure).
  • B.13.4 As in B.13.1 , 1A, 1 B, 2, 3, or 3A, with one or more LOCATE RRs having colored overlay regions such as colored filters, gels or other structures or types of printed or assembled transparent ink patterns having spectrally- selective properties.
  • LOCATE RRs having colored overlay regions such as colored filters, gels or other structures or types of printed or assembled transparent ink patterns having spectrally- selective properties.
  • the arrival or presence of a particular color of RR light in images captured by a LAR-Reader may be used to "Awaken" the LAR-System to full attention and trigger for example, the display or announcement of "Welcome” messages, instructions, etc.
  • B.13.5 As in B.13.4, wherein one, some, or ALL of a LARcode's CODE elements can be retro-reflective and can have the appearance of uniform Blocks/regions, multi-color mosaics, patterns, shapes/sizes of various widths or lengths comprised of spectrally-selective RR structures in combination with overlays such as Gels or comprised of other components with functionally equivalent optical properties which can include retro-reflective inks/pigments, or colored coatings/dyes on a retro-reflective base structure.
  • B.13.6 As in B.13.5, wherein one or more LOCATE or CODE elements can be actively illuminated by a light source(s) energized by a power source which is physically part of the LARcode, which power source can be free- running or on/off timed-controlled/modulated by an associated PLCM and/or wherein light from said light source(s) can be directly visible, can be inherently colored, and/or can back-light a spectrally-selective filter.
  • an active light-source or sources associated with a LARcode can be varied, controlled and/or responsive to commands delivered directly from exogenous sources of data including but not limited to data such as venue time, temperature, light-levels, on-board accelerometers, audio, touch sensors, GPS receivers etc.
  • active light source(s) are comprised of one or more LED sources or other light sources emitting UV, NIR or SWIR.
  • panel-type arrays of emitters capable of displaying patterns of light dynamically under exogenous control or UNDER control of the System employing the LARcode.
  • B.13.11 As in B13.10, wherein one or more actively powered light sources is comprised of a back-lit array(s) of pixels whose transmitted color distribution can be controlled exogenously or by the System employing the LARcode.
  • B.13.11A As in B13.11 through B.13.6 wherein the power source is used to activate and modulate variable electrochromic elements rather than produce light energy directly.
  • B.13.11B As in B.13.11A, wherein the active light source excites fluorescent emissions from LOCATE and/or CODE regions.
  • Transparent, transparently-colored, partially-colored, or colored regions which may, when viewed along a particular LOS overlap or obscure or partially overlap or obscure one or more other regions and/or when rotationally re-oriented at other angles with respect to an Imager's LOS can overlap or partially obscure other regions which can be opaquely colored, transparently or colored RRs or code regions so arranged such that at least one or more regions as viewed by an imager having such LOS is presented with colors indicating a specific angle of rotation in 3D space of the LARcode with respect to that imager's or another imager's LOS,
  • RR LOCATE regions or code Blocks can be specially colored or exhibit particular multi-spectral regions which DESIGNATE a special property or priority such that, e.g. if the code data itself was not be successfully read upon first location and attempt, it should be assigned and revisited by the system at high priority, frequency, zoom level etc.
  • one or more regions of a LARcode can include gratings, nano-gratings or other structures causing diffraction or wavelength effects on incident illumination, the resultant reflected/diffracted or retro-reflected/diffracted or otherwise altered light can be caused to angularly separate by wavelength or intensity and said light can be detected and/or imaged by one or more additional LAR- Readers whose Lines of Sight are displaced from a particular LAR-Reader's LOS while sharing at least a portion of that Reader's FOV.
  • one or more illumination sources in locations laterally displaced from the LAR-Reader can be used to excite diffracted light which can be detected and/or imaged at the first-named Reader's position.
  • the above properties and methods can be used to facilitate creation of LARcodes etc. which are difficult to counterfeit and/or whose validity can be readily verified by the system or by inspection.
  • One or more RR LOCATE regions associated with a LARcode can also serve a CLASSIFIER function based upon their RR color(s) or shape(s)— e.g. notifying the system that a particular code type is of a certain Class which should be read, ignored, or routed to one or more applications etc.
  • RR LOCATE elements other CODE elements, whether passively reflective, retro-reflective, or actively illuminated and in any format compatible with the LAR-System serving a given venue can also function as Classifiers.
  • Standardized data locations e.g. location of 2-3 Reference Blocks with respect to each other and /or LOCATE RR regions
  • LARcodes in stand-alone LARcodes or in Top-Level codes in Nests
  • Such options can include (but are not limited to) various types of adaptive choices/adjustments based upon sizes, shapes, colors, image quality of LOCATE regions which, in turn, activate serial auto-zoom, exposure bracketing, priority ROI definitions, or/and tracking speed functions etc.
  • LARcodes containing special or timed offers, "insider" contest information etc. can be tightly integrated with other imagery such as Logos, Ad copy, product-label typography and/or design elements so as to be colorful and artistically/esthetically attractive while delivering desired functionality.
  • the presence of codes can be very unobtrusive and subtle, if desired. This is in contrast to BARcodes and similar standardized formats. Not all labels need carry the same (or any) LARcode, thus inviting close attention.
  • FIG. 11 A very simple example of a code within an "artistic" graphic is shown in Figure 11.
  • the shaded figures 1102 are examples of color code elements.
  • the "wing-ding" pairs 1104 and 1106 are LOCATE elements. Backgrounds can be colored also.
  • LARcodes comprised of small detailed and/or sub-tiled areas can be used when labels can be closely approached to within e.g. a few feet in a store or viewed with zoom optics. Other LARcodes associated with the label code can be added. Small areas of RR color(s) or other regions can instruct LAR-Readers and the System employing them as to what encoding protocol/application is to be used etc.
  • LARcode apparatus and methods which can be adapted for "appearance" and aesthetic design purposes.
  • LARcodes which include aesthetic elements can be used not only to provide information to a user of a LAR-Reader but also can be "aesthetically-enhanced" components of LARsponders (as detailed in PART C) which are manipulated by a user to provide information from the user.
  • PART C LARsponders
  • Such coding methods include monochrome BARcodes, monochrome QR codes, Semacodes, Data Matrix codes and the like.
  • HCCB color code formats can also be advantageously employed and/or combined with the novel methods, apparatus, and features being disclosed herein.
  • the Methods and Apparatus disclosed thus far in this document have related primarily (but not exclusively) to the acquisition by LAR-Readers of fixed information represented by pre-defined and fixed data-coding features of LARcodes (or other code formats).
  • the LAR-Readers also are able to capture data regarding the locations and time/space trajectory behavior (i.e., they also provide data for tracking the 3D or 2D locations) of such LARcodes.
  • LARsponder technology can take a wide variety of forms. LARsponders can, in part, employ concepts related to LARcode ID and tracking technology per se, but they add unique and useful capabilities reaching far beyond those of fixed content LAR-codes as described in PART B.
  • LARsponders in general, DO NOT REQUIRE that users possess or employ any particular communication device, e.g. cell-phone, smart-phone, iPad, Blackberry, etc., nor be skilled with any specific "Application" package or use any particular service provider.
  • this permits users/audiences in the same venue to be very heterogeneous with respect to their "digital age” skills.
  • LARsponders enable masses of LARsponder users/owners to fully participate in venue “action” simply by manipulating their own personal LARsponders. Individually, or en mass, audiences using LARsponders can range from "no gadgets for me” technophobes to elaborately equipped sophisticates.
  • LARsponders can be used in conjunction with LARcodes to expand the menu of response mechanisms available in a given venue in which LAR-Readers are operating. For example, this can involve as simple a matter as physically placing a LARcode or some type of LARsponder ON a cell-phone, iPad etc. device as shown in PART A, Figure A2 (2-8).
  • LARsponders can be zero-power devices, simple enough to be distributed to users as "give-aways" and/or disposables. Supported by their companion technologies, as detailed in other sections of this document, they enable two-way, real-time, feature-rich, interactive communication between individual users and complex systems and open a wide range of novel commercially significant applications.
  • LARsponders can be manufactured at near zero cost. They often can be merely printed on paper, cardboard, or plastic sheeting etc. They can be used globally in any venue in which LARcode Reader Systems are either temporarily or permanently installed. Suitable venues can range from locales with highly developed and accessible general communications networks to under-developed countries/territories with almost none at all.
  • a few individuals or many tens of thousands can simultaneously participate in rap idly- paced activity using LARsponders in real-time without encountering traffic delays or long latency in system response.
  • LARsponder functions can be implemented using LARcodes or combinations of elements comprising parts of any types of LARcodes or entities associated with such LARcodes (or using other code forms or defined data sources such as BARcodes etc) as described earlier in this document.
  • LARsponder "action" and responses in a given venue can be imaged by one or multiple LAR-Readers.
  • the LARcode Readers are supported by apparatus, methods and systems as described in PART A and elsewhere in this document.
  • Responses/actions of individuals, groups, and/or massed crowds using LARsponders become immediately available in the form of qualitative and/or quantitative data representing choices, preferences, opinions etc.
  • Correct and timely LARsponder responses can require physical/temporal manipulations quite outside the capabilities of general purpose keypad-entry methods, touch screens, or proprietary game controllers etc.
  • a wide range of inexpensive LARsponders can be customized to deliver varied mental, observational and physical challenges.
  • LARsponders Data collected via LARsponders can be used to control subsequent result-adaptive and/or pre-determined sequences and/or iteration of follow-up cues, challenges which yield additional data and/or allow non-deterministic (i.e. unpredictable outcomes) to occur.
  • in-venue LARsponder data can be melded with (or compete with) other data amenable to being collected from out-of-venue sources, e.g. from persons remotely listening to, viewing, or otherwise following in-venue events.
  • out-of-venue data can be communicated to and collected by the System using known methods such as the Internet, WI-FI, cell-phone texting etc. Additionally, these last-named channels can also be used for certain forms of data amenable to collection from sources inside the venue but who do not belong to any LARsponder-user cohort.
  • LARsponder manipulations can be independently initiated/timed by a user, or can be cued in response to external events, stimuli, audio/visual or other prompts, situations, challenges or conditions.
  • Human users can be individuals, groups, and/or crowds of participants each equipped with one or more LARsponders of various types.
  • LARsponders can also be manipulated and/or activated by non-human "users” such as animals or by devices which are controlled or driven by external mechanical or environmental inputs. In this class of applications, they can optically-read by LARcode Readers and can function as transducers.
  • LARsponders can be reversible or irreversible (i.e. destructive as in tearing, scraping-off etc.) depending upon the objectives and the rules imposed on the use of a given type of LARsponder for a particular activity.
  • LARcodes with appropriately selected properties or sets of properties can function as LARsponders.
  • LARsponders can, if desired, incorporate and require timely presentation of a variety of novel "Validation” and “Qualification” features as will be described later in this document.
  • a rather simple LARcode 1200 can function as a LARsponder component employing several response mechanisms.
  • 1202 a generic LARcode which might ID a relevant event, contest, group, product etc and/or the application software to be used by a venue System for processing the LARsponder's input data.
  • the LARcode component shown is rudimentary but could equally well have employed many other features of LARcodes as described in PART B.
  • Feature 1204 illustrates a response recognizable by obscuring an RR 1210 which can or cannot be of a particular color depending on the data interpretation software in use.
  • Feature 1206 uses folding to disclose or obscure another coding element (again optionally an RR 1210 or merely a pigmented region).
  • Feature 1208 shows a "peel-able" or stick-on covering over another coding element.
  • elements of LARsponders/LARcodes can be partially or totally physically obscured at appropriate times (or for appropriate intervals) to signal specific responses.
  • Obscuration/occultation of elements such as RR and/or code areas can be caused by the user per se (e.g. covering by finger, moving behind an obscuring external object, manual rotation/movement of elements out of view) or by user manipulation/actuation of auxiliary mechanical features (e.g. sliding parts, hinging, folding or rotating parts, peel-off or adherent members, folding over, "dog-earing" different corners of a paper document, closing shutters etc. by user).
  • auxiliary mechanical features e.g. sliding parts, hinging, folding or rotating parts, peel-off or adherent members, folding over, "dog-earing" different corners of a paper document, closing shutters etc. by user.
  • the obscuration mechanism can also comprise the act of "blocking" a LARcode Reader's view of an entity or entities that are/were “associated” with a LARsponder itself by having been present and identified by the venue System in a image previously captured by a LARcode Reader.
  • methods such as positioning or affixing a furnished adherent ("Post-it Note” style) selector mask, frame or symbolic shape such as an arrow can be used. See Figure 13
  • a finger or cylinder etc (a pointer, a pencil, etc.) can also be used.
  • These designators or others with equivalent utility can, themselves, be equipped with 2-D or 3-D LARcodes of various types as discussed elsewhere in this document and/or other elements including but not limited to 2-D or 3-D RR regions.
  • Designators can also be used to occult an underlying region of a LARsponder (such as a uniform RR region) thereby assisting LARcode Readers in determining more precisely what point in a LARsponder image is being designated.
  • Figure 13 displays a few examples of LARsponders 1300, located within a given area 1320, using obscuration and/or designation. These examples also are representative of LARsponders 1300 capable of communicating quantitative opinions or choices etc.
  • the various types of shadings in above and elsewhere throughout this Disclosure are meant to represent different colors in the spectrum and can or cannot also be retro-reflective.
  • Areas marked 1304 are retro-reflective, and can also be colored retro-reflective or "white" retro-reflective across most of the light spectrum or otherwise.
  • 1306 items exemplify linear forms of LARsponder components.
  • 1308 designates regions which can be totally or centrally obscured to indicate a semi-qualitative response— e.g. upper, middle or lowest preference, two sections together partially obscured etc. Interpretation of patterns of obscuration can be more complex using accessory objects to perform occultation of the block or blocks.
  • 1318 can be an accessory attachment, a LARcode ID mounting site, a non-interfering place to grasp the LARsponder etc.
  • 1310 are isolated "choice" spots (here 7) signaled as chosen by being blocked by, e.g. a finger.
  • 1312 is a slider, or otherwise movable member, that can be set precisely to indicate a quantitative response that is measurable and/or accurate to a few percent using a reference scale 1314 along with optional colored and/or RR blocks 1316 which can (but need not) refer to different categories of responses.
  • LARsponders 1300 also can be used as multi-function mechanisms for communicating other or additional or simultaneously combined responses via variable "orientation" as discussed further below.
  • 1322, 1324, 1326, 1328, and 1330 relate to another example form of LARsponder in which a reference scale enables precise quantitative "analog value" responses.
  • scale-wheel 1322 is shown without its perimeter scale graduations and without details of its numbered and/or optional multi-color or RR blocks.
  • 1324 is a pinned rotatable member with features that allow its angular location with respect to 1322 to be precisely determined using LARcode Reader images.
  • 1326 is an orientation reference and 1328 is a LARcode that can be used for various purposes, such as user ID, event ID, product-line ID etc.
  • 1330 is another type of angular indicator. It is not fastened to the main LARsponder disk. It can be coded.
  • the indicator 1302 can be adhered to some point along 1308, 1310, 1314, or on perimeter 1302 to portray a quantitative response.
  • their backings can be coated with "peel-able” and/or re-positionable adhesives.
  • Change of gross position of the LARsponder and/or changes in a given LARcode Reader's LOS or FOV can also be used as a "response by disclosure" mechanism.
  • pa ial effects via masking or unmasking can be employed which rely on specifically defined changes of shape (e.g. square to triangle) or other parameters such as colors, patterns etc. of elements of LARcodes/LARsponders.
  • Static or dynamic "Solid body” 2-axis or 3-axis "pose” changes or choices (orientation, rotation, tilt etc.) of LARsponders are initiated by users upon cue or in anticipation of impending "response harvesting".
  • One class of LARsponders can include a component, a LARcode, and/or any additional assemblage of elements whose orientation with respect to some pre-defined internal reference element on the LARsponder can, upon a cue to "respond", be set by the user and detected by LARcode Readers.
  • LARsponders using orientation to signal responses can include specific "zero angle" design elements or reference features that are deliberately obvious to the LARsponder user. In other cases, user knowledge of the zero-angle reference direction on their LARsponder can be required to be discovered or "earned” in some fashion by the user.
  • a LARsponder's orientation (or change in orientation) as set by the user must typically be with respect to some specific orthogonal set of coordinates known to the user and detectable by LARcode Readers.
  • One suitable orthogonal reference system can be with respect to the user's personal coordinates (e.g. "up”, “down”, “my left”, “my right”, “toward me” or “away from me” etc.).
  • orientations can be with reference to a set of orthogonal axes with a major or principal axis being along an LOS aligned toward a distinctive landmark or toward an activity area such as a user selected place, person or other entity on a playing field or toward a large screen data display etc.
  • the principal axis of the coordinate system can become an "aiming" direction toward some moving target reference, graphic symbol, or object in the venue or on a dynamic display.
  • the LARsponder user sets (or attempts to set) orientations pointing at either zero or non-zero angles with respect to that (non-global and potentially variable) reference direction to indicate predictions, choices, wagers, or to "fire" imaginary paint-balls, etc.
  • LARsponder users can be informed that the major axis of the orthogonal coordinate system to be used is aligned along their LOS toward a specific LARcode Reader.
  • the LARcode Reader can be prominently marked, can be unique in the venue, and/or can be ground- mobile, in aerial survey fly-over platforms etc. Matters related to these types of uses of LARsponders are further discussed elsewhere in this disclosure.
  • Figure 14 shows an area 1400 containing a few examples from among many types of two-dimensional design elements that can serve as references that are clearly discernible to users of LARsponders as well as to LARcode Readers and usefully included in LARsponder designs.
  • LARcode READER is available whose line of sight (LOS) is not too obliquely orientated to the plane of the two- dimensional ("flat") example reference elements shown in Figure 13.
  • LOS line of sight
  • Element examples 1402, 1404, and 1406 facilitate determination of a principle reference axis, axis length and orientation direction data.
  • 1408 provides approximate axis direction data
  • 1410 features multiple color RR 1412 features useful for defining these parameters, differentiating groups etc. of LARcodes and LARsponders by their RR LOCATE region color combinations and is also adaptable to use with comparatively poorly focused imagery since the centers of Regions 1 and 2 can be rather precisely located using known image-processing techniques despite severe (but circularly symmetrical) blurring.
  • Elements 1414 and 1416 are universally intuitive orientation indicators (even for young children) which can incorporate LARcodes 1416 which can be colored and/or RRs as well.
  • Element 1418 is a compact design maximizing color block space while also providing orientation and direction of read information.
  • Element 1420 defines "up” by which color, the upper or lower block is higher in a LARcode READER image.
  • 1422 is equipped with a e.g. a peel-able and or re-useable "tail" that can be affixed to another entity for defining its orientation, enabling its use as a LARsponder or component thereof.
  • 1424 is an example of an "all RR" sticker or design element with both shape and color used to define a principle reference axis.
  • Figure 15 illustrates some examples of LARsponders in an area 1500 which can be fabricated as simple 2 dimensional printed cards. Reference Elements such as to some of those in Figure 14 can be employed. Both the graphics and the RR regions 1502 can be printed or screened or can be separately die-cut from sheets etc. and supplied as stickers to be adhered by the user.
  • Element 1504 is a LARsponder using an obvious reference axis 1506, two color code area C and C with space 1508 for other copy such as an Ad or for a LARcode that shows the LARsponder user/owner is a member of some particular group. Four very simple low precision orientations, as in 1510 are facilitated.
  • LARcode Readers serving for example as vote counters
  • each user responds (when cued) by showing his/her choice as in 1512 (up, down, left, right). If instructed that Readers are generally "observing” votes from above, users respond by choosing as exemplified in 1514, "my left” (and my forward, my back, my right).
  • the Color regions comprising part of the distinctive pair shown as Green and Red (G/R) can, of course, be varied (R/B, M/Y, C/R, etc.) and assigned various meanings such as indicating that the LARsponder's user/owner belongs to a particular group, or that the LARsponder is valid only for a particular day and time, event etc.
  • G/R Green and Red
  • 2D LARsponder designs including those shown in these examples (with the exception of example 1516) can be double-sided and can accommodate choices picked from among two sets of possibilities.
  • LARcode H which can encode for event data, user group member data or prize numbers etc. It can be affixed to an Event Program or other item. If the Program is held up and presented on cue in vertical orientation, it communicates a "yes" vote, horizontal orientation communicates a "no vote, etc.
  • 1520 offers four orientation choices, is the size of a postcard so it can be mailed or tipped in to a magazine etc., easily read by LARcode Readers and has space for Ads or areas that can obscured. It, like many other LARsponder designs, can be double-sided offering e.g. use in two different events or more options in one. To avoid confusion, one side or both can be supplied with e.g. peel-able overlay covers.
  • LARsponder 1522 is an eight choice LARsponder which can be used in orientation (or obscuration) mode with more choices than the other examples shown in FIG. 15. It accommodates choices signaled by orientations differing in angle by 45 degrees and by which color pairs lie on opposite diagonal, vertical and horizontal axes. These color pairs can be reflective or (not shown) retro-reflective.
  • the multiple data sets thus available can improve read accuracy and/or in some circumstances can be used in to indicate dual choices signaled by obscuring a particular color (A through H) using a finger while also orienting the LARsponder at a chosen angle.
  • LARsponders of this general type can provide a large number of choices: in this case, 8 possible orientations times 8 possible choices of obscured color allow 64 possible response choices.
  • a simpler version of 1522 obviously could offer e.g. four orientations and fewer, say two or four, color areas sized for convenient obscuration.
  • LARsponders can be as simple as solid-core rod-like "pointing sticks" of appropriate lengths and diameters for their intended purpose determined by considerations of the LARcode Reader capabilities (imager resolution, FOVs, etc) with which they are designed to be used. They can be of various types of cross-sections, circular, square, rectangular, polygonal, faceted and otherwise. They can be multi-colored and/or retro-reflective in certain regions etc. and comprise or bear LARcodes. They can be accessorized with other structures/features/accessories intended to aid LARcode Readers and associated system software in precisely determining a user's intended pointing direction or "pose" in 3-D space (or adjustments or variations thereof). See Figure 17 for certain specific examples of such accessory features, e.g. stellated items).
  • An ability to communicate personal responses via defining or moving/adjusting a pointing direction is useful for designating, selecting, voting for persons, physical objects, products, specific locations, and other in-motion or static entities in a 3-D venue space. It also facilitates one-way interactions with 2-D static "targets" such billboards, signs, posters, etc. as well as offering methods for dynamic, real-time, two-way communication with electronic data system via digital displays and/or video screens in LARcode Reader-equipped venues.
  • Figure 16 portrays certain principles and several examples of LARsponder apparatus, located in an area 1600, that reach beyond simple solid rod-like designs.
  • the suite of LARcode Readers deployed in a given venue can be augmented with additional LARcode Readers whose Lines-of-Sight (LOS) originate from locations proximal to targets or displays and whose Fields of View (FOV) include the users and their reporting LARsponders.
  • LOS Lines-of-Sight
  • FOV Fields of View
  • Figure 16 displays of several types of LARsponders intended for high precision tasks.
  • the first example is based on a cylindrical tube 1602, in this case of circular cross-section.
  • the exterior of the tube can also be of some distinctive color or colors and can carry 2-D LARcodes (not shown).
  • the examples here described use components with unvarying cross-sections (e.g. circular, square etc.) as a function of length along the component, this is not intended as a necessary attribute.
  • angular sensitivity and other attributes of these types of LARsponders can be tailored by employing components of greater area at their entrance ends than at their distal ends, featuring step-function changes or other variations in cross-section along their central axes and/or mixtures of cross-sectional shape/size in sub-elements in a single LARsponder assembly and various other ways that will be evident to those skilled in the relevant arts.
  • the tube can be internally lined 1604 with some particular color, e.g. Red.
  • the lining can preferably be retro- reflective (RR) material.
  • RR retro- reflective
  • the liner or portions of it—e.g. sections near the open end- can, in some embodiments, be patterned in bands, stripes, mosaics etc.
  • the tubular structure shields the internal RR from ambient venue lighting to a significant degree.
  • the distal end of the tube 1606 in this example is closed, although in other embodiments it can be partially open or penetrated by structures or devices (passive or active) to facilitate precise aiming.
  • the plane of the entrance end of the tube need not be orthogonal to the tube central axis.
  • the interior surface of closure 1606 is also a retro-reflector but preferably of a color distinctly different from that of the cylindrical liner. It also can be patterned.
  • Element 1608 represents a visual aiming aid for the user. It can also be one of the many types of three dimensional orientation-indicating LOCATE and/or encoding elements including but not limited to multi-colored, retro- reflective polyhedrons ( Figure 17) as described later.
  • the sequence of views of the front portion of the LARsponders 1610-1618 shows how the shape of the interior liner red RR region and of the green closure RR region (and also their ratios- which can serve as an additional and potentially robust pointing indicator) will vary with LARsponder pointing angle as seen along the LOS of one particular LARcode Reader when excited (e.g. flashed) by that Reader's associated light source(s).
  • Elements 1620, 1622, and 1624 illustrate that tube cross-sections other than circular can be used in this general class of LARsponders.
  • 1620 and 1622 offer additional RR and/or color-coding options on each of their interior and exterior faces and can be used in a 5-D mode which adds rotation angle around their longitudinal axis to their available response repertoires while largely shielding interior codes areas from ambient light.
  • Example 1624 with all faces available for coding in distinctive ways, also offers 5-D capabilities as well but its coding surfaces are more exposed to uncontrolled ambient light. 1620, 1622, and 1624 can be easily packaged in flattened form for distribution or mailing etc.
  • 1626 is a schematic representation of a blocking member which can obscure aiming information provided by the LARsponder until uncovered or triggered by the user.
  • Inverse actions which reveal an element to signify triggering a "shot” or enabling insertion of markings etc. on targeted images can also be used.
  • Other possible trigger mechanisms include, but are not limited to such actions as causing momentary gross collapse or distortion of a LARsponder structure (or sub-structures), for example, tubular component(s) with flexible-walls.
  • auxiliary aiming aids can range from traditional open "V" indices 1630 and/or cross-hairs 1632 to telescopic/optical sights 1634.
  • co-aligned active LED/laser devices can be used.
  • Items 1636 through 1642 depict LARsponders in the form of bundles of cylindrical members which each can have any or all of the structural and/or optical properties described for single tubes.
  • 1636 is a head-on axial view of a bundle using round cylinders. (Hex, square, rectangular cross-sections etc. can also be used and the size of individual bundle element can vary from individual element to element.)
  • bundles For a given overall size, bundles have a narrower range of on-target acceptance angles and can display patterns of interior RR wall colors of distal-end RRs providing additional distinctive coding options and data for the LARcode system software including, for example, rotational angle.
  • the visible exterior walls of the bundle can also differ in color and/or patterns.
  • Item 1638 shows a bundle with an angular cut entrance which widens the range of view angles over which the interior wall color patterns and RRs can be seen by a given LARcode Reader.
  • the shape of the entrance end of the bundle need not be planar. It can be also be pyramidal as in 1640 and/or other shapes with the result that individual cylinders in a given bundle can present different variations of appearance and dimensions at different angles with respect to a given LOS, a property providing additional flexibility of use.
  • 1642 portrays a LARsponder with accessory sighting aides which can have larger acceptance angles than the individual cylinders of the LARsponder itself.
  • 1644 is a precision-aimed LARsponder using "LARcode elements in one example of code elements in form of arrangements of individual spheres some or all of which may have retro- reflective surfaces and/or may be of different colors representing a LARcode.
  • LARsponders can, of course, have interior optics or can merely be collimator tubes.
  • the LARcode shown is one whose aspect/appearance varies sensitively with angle with respect to a given LAR-Reader LOS while also being minimally susceptible to complete occultation of all code elements.
  • This example can also be used in higher degrees of freedom applications, e.g. angle of rotation around the device's long- axis of symmetry by including code elements(s) and/or markers accessible to LAR-Readers.
  • users or groups/teams of users can be provided electronic feedback on their response locations relative to those targets or other imagery. This can be done for competitive purposes or otherwise. Such feedback can be accomplished via color-coded cursors and by/through other behaviors of graphics or other indices shown on the displays.
  • precision LARsponders such as those exemplified here can serve as “controllers” in computer games and the like. Trajectories of "aim points” and motions etc, whether controlled by individuals or collectively by groups or competing teams in the venue, can be smoothed and averaged by software to eliminate “erratic” appearance and/or small-scale position "jitter” due the unsteady aiming and/or other small-scale variations/motions along paths intended by individual LARsponders.
  • Software processing can also be used as the basis of new forms of responses somewhat analogous to swarm, flock and fish-schooling behavior wherein responses (direction of motion, velocities, selection points etc.) inputted by individuals belonging different groups or groups are aggregated to define graphical outputs or results to achieve defined goals. Please see also Sub-sections 3c-2, 5, 7, and 8 below in this regard.
  • Item 1650 depicts a Jumbotron, Diamond Vision, or other large mass audience direct-view or projection digital screen.
  • Perimeter-mounted LARcode Readers 1656 are shown. There can be a substantial number of these and they can be aimed along diverging lines of sight to cover user locations in the venue.
  • These perimeter-mounted units are supplemented, where necessary, by an array of miniature LARcode Reader source "heads" exemplified by 1652 and 1654. The latter are positioned in front of the display (either near its surface or at distance in front of it). Light weight and measuring less than a few square inches, these can, for example, be suspended by thin guy-wires which also can carry data and power etc. They can be easily retracted for servicing etc.
  • Flash Illuminators 1658 in the LARcode Reader heads are positioned to efficiently excite retro-reflections from LARsponder RRs including those, for example, on interior surfaces and on distal closures of tubular LARsponders.
  • the Reader heads will be unobtrusive if not essentially invisible.
  • one video field (e.g. -1/60 second or less) of a Jumbotron display can be "blanked" in the unlikely event that multi-color light originating from the display surface itself and which is coaxial with a Reader's direct LOS to a high precision LARsponder complicates or extends the time required for data analysis. Note that in smaller venues, only auxiliary Readers mounted on perimeters of venue displays should typically be required.
  • Figure 17 illustrates one version of LARsponder 1700, with several located in area 1702, offering similar functionality to that of a conventional 'Joy-Stick", in this instance also including two control buttons. Many other versions are possible. The principles incorporated in this example can be readily combined with or substituted by other LARcode and LARsponder concepts disclosed throughout this document.
  • Element 1704 can be a flat card with 2 diametrically opposite grasping points 1706 held between index fingers and thumbs of both hands.
  • the 1708 regions for example, can be monochrome or colored RR Locate regions.
  • 1710 can be color-codes. Additional LARcodes, designator codes, validation codes, etc. can be displayed/adhered on the cards.
  • 1712 can be a "signaling tab" (RR, colored, etc.) which is normally held by a hinge member in an obscured location relative to LAR-Reader sight-lines. While grasping the corners 1706, a user's middle finger can conveniently and momentarily "flick” or hold a tab such as 1714 into view by LAR-Readers thus communicating a "click” etc to the LAR-System.
  • the 1712 tab if exposed, can serve a different function or modify the meaning of the 1714 signal.
  • 1716 schematically suggests one of many ways and 3D structures, also disclosed herein, that can be included in Joy-Stick type Responders to enhance LAR-System "read accuracy or for other purposes.
  • 1701 is a top view and 1703 is a side view of 1700.
  • the well-known single player video game of steering competing racecars can be converted into a multiple player games.
  • crowd/team (“Mob Play") control of steering/driving of race-cars can use averaging and other real-time data smoothing processes etc.
  • Joy-Stick LARsponders can signal several variables at once, steering, braking, accelerator using various basic techniques such as described above since a "tab-out" signals need not simple "clicks” and/or additional tabs, finger-mounted codes etc can be employed.
  • Joy-Stick control of direction of motion, steering precision, velocities, selection points etc. inputs by many individuals belonging a group can be "real-time” aggregated (e.g. dynamically-weighted centroids of command "clouds” determined etc.) to define a given graphical control output as desired by an entire group as they try to achieve a defined goal.
  • the above aggregation types of processing or others can have dynamic capabilities and can apply adaptive criteria, e.g. users within a group who are shown to be "better” as the challenges, games etc. proceed can become more influential (i.e. they can become "stars" who can be later recognized/rewarded, selected for head-to-head 'battle” etc.) as compared to poorer players in the same winning group, crowd or mob. Please also see Paragraph 8 below.
  • LARsponders and/or associated apparatus e.g. LARcodes can include elements which can be twisted, transposed, bent, stretched, bulged, pinched, inflated, collapsed, turned inside/reverse-side out, or otherwise physically distorted to communicate a response to a LARcode Reader.
  • Single or multiple gestures performed with a LARsponder including but not limited to specifically shaped trajectories or vectored "waving" patterns in space (e.g. waving up and down VS side to side).
  • Motions can denote or indicate a desired result such as a change of 3D position of the LARsponder with respect to a defined reference point or by pointing (e.g. "over this way more") etc.
  • Responses can be singular, in short series, continuing, repeated until cued otherwise, or performed against fixed time-limits.
  • LARsponders can consist of several distinct sub-assemblies which can be conjoined, assembled, or disassembled to indicate different types of responses.
  • the sub-assemblies can include their own unique RR and code regions enabling their own independent response capabilities (or none) while apart and other or different response capabilities when assembled with one or more companions. See also the Response mechanisms described in following paragraph wherein the art disclosed therein can, as an option, be implemented using elements or entities which, themselves, constitute (or had constituted) sub-assemblies of a given type of LARsponder.
  • a LARsponder can signal a specific or particular type of response by being manipulated and/or positioned by its user to be in a pre-defined spatial association or relationship to or with another element or entity in a venue.
  • the "other" element or entity can be another LARcode or portion thereof or another reference entity or object as, for example, illustrated in Figure 13.
  • the other element or elements can be comprised of multiple objects. They can also be images on a display or displays within view of the user.
  • "Association" can mean touching, over-laying in an image obtained by an imager, approaching or being placed closer than a prescribed margin, being pointed toward or oriented with respect to another entity or entities in 3D space as viewed by a LARcode Reader.
  • Association or orienting can also mean (but is not limited to) the act of indicating or establishing some specific vector direction or distance with respect to an entity (as described, for example, in Figure C2) or groups of entities or references within the venue as viewed by the LARsponder user directly or as seen in images on a display or displays within view of the user. Associations of any type can be formed or instigated on cue, can be of some defined minimum duration or spacing, and can be periodic, adjustable, repetitive, or one-time opportunities.
  • Groups of users each user equipped with a LARsponder, can function as "teams” as described above (in 3c- 1 and 3c-2) and in other parts of this Disclosure can be used to gather data expressing collective judgments or group opinions using methods and apparatus other than Joy-Stick style emulation.
  • LARsponders of many kinds described herein can communicate a best choice among "n” choices, amounts, preferred motion, e.g. "go more to the left VS right etc., a direction, vector orientation, rotation etc.
  • Such data can be "collectivized” by appropriate criteria and used to compete collectively for prizes, premiums, winning bids, price discounts etc. and/or playing collective video or computer games etc.
  • order of finish e.g.
  • Response mechanisms can use various types of changes of optical properties of LARsponder regions visible to a LARcode Reader. Rather than obscuration, as described above, these mechanisms can, for example, alter the spectrum reflected from a single color element or sub-element by means of movable transparent or semi-transparent colored overlay filter masks or vice-versa, Polarizing and/or optical gratings, transparent retro-reflector layers, cylindrical or other lens arrays, temperature-sensitive liquid crystal filters etc. can be similarly employed.
  • LARsponders can use pressure variations on a fluid-filled reservoir bulb connected to one or more transparent chambers,, arrays of channels, or tubes etc. which are positioned to obscure or partially obscure a LARcode element or elements when fluid is forced into the chamber or chambers.
  • the user can signal off-on (binary) or analog proportional data depending on the detailed design.
  • a clamp or similar component can be used to hold the loaded fluid in place until data are read out by LARcode Readers.
  • the obscuring fluid can then be re-set to "clear” by any suitable mechanism such as compression of the occulting chambers or, preferably, compressing an "Erase” bulb which forces the fluid back into the original reservoir.
  • Section B.13.6 of PART B briefly discusses Active LARcodes which employ on-board powered light or color modulated sources to convey data.
  • Active LARcodes which employ on-board powered light or color modulated sources to convey data.
  • these can specifically include but nor limited to LEDs, multicolor LED assemblies, OLEDS, OLED arrays, electrochromic elements, and/or back-lit transmission color LCDs.
  • These can be used in LARcodes, and/or can be in part or in all elements of ACTIVE LARsponders. They enable response methods via any types of modulation of the light signals being emitted or reflected by the LARsponderfrom one or more of its component elements. Modulation types can include simple on-off, digital or analog data encoding etc.
  • the LARsponder user control interface can be of any convenient type known in the Art. Data communicated by the LARsponder via active and/or actively controlled light sources can be in addition to other data conveyed by reflected RR or other reflected light visible to LARcode
  • a LARsponder user's Smartphone or other device can possess orientation-sensing (e.g. with respect to the earth's magnetic field dip angle or magnetic North) and can be capable of angular display thereof. It can have capabilities for precise directional motion measurement e.g. using 3D MEMs accelerometers, GPS, enhanced GPS etc. In such instances, these assets can provide additional data or complimentary channels of response.
  • Various types of LARsponders and/or LARcodes can be mounted directly on Smartphones or MIDs or otherwise associated with them in non-interfering ways such that LARcode Readers can access them. (See, for example, PART A, item 48 of Figure 4).
  • the referenced Figure shows a LARcode which can confer acceptability (event-specific or otherwise) to an MID or other networked device as a data source.
  • Various forms of LARsponders can be similarly associated and used to validate such data sources.
  • Sub-groups or individuals within or outside of a venue who are without LARsponders but who are equipped with Smartphones, tablet PCs and/or other MIDs can be allowed to participate via appropriate Application software installed in the device.
  • Pre-qualification, device registration (event specific or otherwise), or other evidence such as transmission of a validated LARcode authorization sticker number etc. can be required to participate in the "action".
  • Such qualification and subsequent participation can also be based on transmitting, relaying or annotating etc. images captured by the phone or other MID, or by responses by voice, by keyboard entry, by display-touch or the like. Images can be of a portion of transmitted video coverage of venue activities, or of an AD running during such coverage.
  • Images can be of in-venue or other data added by third parties, and/or of local commercial displays, signage, or views of certain types of LARsponders validly belonging to others.
  • the venue LAR-System can allow "extra-venue” participants to 'team” with in-venue participants. Extra-venue participants may experience significant system delays, but can be granted “head-starts” or re-ordering of response times. Conversely, they can be assigned lower priorities and/or they can be offered differing "award opportunities" such as smaller or larger prizes etc. as compared to in-venue users of validated LARsponders.
  • LARcode Readers Users of privately-owned LARcode Readers can arrange to use their private devices to input LARsponder data via WIFI, 3G or4G etc. network systems to interact with distant venues employing LARcode Readers and Systems. Such Readers can be either Type I or Type II but more typically will be Type I. (See PART A of this document).
  • Venue-defined registration and authorization etc. can be required along with downloading of enabling Application software or use of specialized websites via standard web-browser applications. Such off-venue authorization can be for one-event, season long etc.
  • the Application download or specialized website can be tuned to working with one particular LARsponder type used in the venue or can accommodate a number of configurations.
  • the requisite LARsponders for a given event or events can be made available to prospective users by purchase or as premiums or prizes, as retail outlet "give-aways", as newspaper inserts or direct mail pieces and/or by any other promotional channel.
  • the user-owned LARcode Reader can display cues and other data originating from the venue system. It can directly view a local LARsponder in the user's possession as it is being manipulated according to activities occurring in the venue and which are transmitted from it to off-site displays (e.g. video feeds etc.) available to the private LARsponder user. Note that this method allows for many types of remote interactions which can be varied by features of inexpensive or free LARsponders and are not hardware or provider-bound to one particular type of ISP, cellular phone service, imager type, Smartphone model, etc.
  • Off-venue users having Webcam-equipped PCs or other computers with accessory PLCM and IM functionality as mentioned in PART A can participate/compete (using suitable installed software applications or using specialized websites via standard web-browsers) in in-venue events. Participation can be via one or more validated
  • LARsponders pre-supplied and registered by various means as described elsewhere herein. These LARsponders are viewed and manipulated by the user's Webcam(s).
  • Qualified off-venue LARsponders can offer all or only subsets of the response capabilities required by the "action" within the venue itself. Note that these capabilities can be uniquely customized to different audience segments, to the event or product promotion, to the large-screen ad being featured on the home as well as on the venue screens etc.
  • LARsponder users can employ camera-equipped smartphones, PCs and/or other computers, digital cameras or similar devices with wireless communications capabilities to capture certain images or portions of images prior to the user making use of a LARsponder.
  • the subjects captured in the image or images can be of (or portions of) physical objects, print graphics such as magazine/newspaper/catalog etc. advertisements etc., electronic images in any form including but not limited to video programming, internet Ads, electronic or simple printed billboards/signage etc.
  • the captured images can be images of any form of visible graphical data-code such as bar-codes and or other standard formats as well as LARcodes.
  • Specific subjects of interest in the images (and their relative "value" ⁇ can be selected and defined in accordance with pre-defined criteria, e.g.
  • a "Scavenger-hunt” style set of assignments This can incentivize a user to take closer note of existing ads, products etc.
  • An in-venue or remote participant's collection of such images can be submitted to a LAR-System supporting a given in-venue event or other happening to gain some competitive or reward advantage re participation in the event or activity.
  • Figure 18 presents a few out of a plethora of other 3-D forms/components which can be used to advantage across a wide spectrum of LARcode/LARsponder applications.
  • LARsponder/LARcode elements e.g., spheres, disks, open or closed cylinders, skeleton open, partially closed or closed polyhedrons etc.
  • 3-D polyhedra 1802 (a stellated dodecahedron) and 1804 (an icosidodecahedron) shown in Figure 18 represent merely two members of huge groups and classes of geometrically-defined entities, useful as coding and/or LOCATE components.
  • Some or all facets and/or surfaces can be both colored and retro-reflective.
  • facet region shapes and colors of a given type of polyhedron will vary substantially with orientation as suggested by 3-D polyhedras 1802 and 1804 that are located in area 1800.
  • stellated forms can show very pronounced color, facet appearance, and/or partial occultation of facets produced by only small "solid body” rotational changes around one or more of its internal axes and/or with respect to a given LARcode Reader's LOS.
  • the Hexahemioctacron can be noted as being representative of "spike-covered” entities.
  • Each "spike” of such a 3-D body for example, can function as, e.g., a tubular open or close-end sub-structural element as mentioned with regard to Figure 16.
  • any 3-D LARsponder or LARcode element can, of course, range widely depending upon the application ranging from small fractions of an inch to several feet and beyond.
  • a given form of 3-D element need not be employed only as a whole. It can be sliced, split, sectioned, segmented etc.
  • an icosidodecahedron 1804 can be split along an equator plane and conveniently mounted as a faceted hemisphere on a flat area of a LARsponder which also can carry planar code and/or RR regions.
  • topologically distinct classes also have useful properties such as LARcodes/LARsponders based upon color-coded and RR regions in such forms of trefoils or multiple interlocking non-coplanar rings etc. These forms facilitate precise determination of 6-D orientation/position data based upon their symmetries and imaged ratios of major dimensions (i.e. ring diameter) to minor "strand" diameter.
  • FIG. 18 The remaining items in Figure 18 are intended to show a few other aspects and uses of 3-D LARsponder design elements.
  • 1806 and 1808 are representative of un-faceted forms in general and also of forms amenable to being flexible, inflatable, and deformable.
  • Items 1810 and 1812 portray 3-D LARsponder components mountable singly or on multiples on limbs, e.g. 1814, fingers 1816, or on accessory devices such as exercise appliances, etc.
  • Items 1818, 1820 and 1822 are examples of hand-held 6 degree of freedom LARsponders with 1822 also illustrating a seventh degree of freedom (variable separation between two components) which can be used for analog control/data input or for "clicking/selecting".
  • Item 1824 represents a LARsponder in the form of a "ball", e.g. a baseball, with differently color-coded (and optionally retro-reflective) re-entrant regions and RR regions along its cover seams.
  • the ball can be padded and soft and can be internally weighted to a degree limited by appropriate safety considerations in home, playground, and/or school gymnasiums. In use, the ball can be held and its pitch/release merely simulated and tracked for spin, velocity, plane of motion etc. with computer calculated idealized release timing.
  • Item 1826 is a generalized illustration of a LARcode/LARsponder exemplifying the use of multiple copies of a single code (in this case angularly displaced from each other) with the intent of enabling one or several LARcode Readers on different Lines of Sight to combine their image data so as to achieve a reliable code "read” despite momentary or partial occultation of some of the multiple codes.
  • 3-D LARsponder element(s) such as stellated dodecahedron found on 1810, can also be worn on appendage 1824, and can also be part of duplicate/multiple codes on LARsponder 1826.
  • Item 1828 is a typical "baseball cap” to which LARcode elements have been added thereby converting it into a LARsponder.
  • the Cap is shown with an approximately planar (2-D) LARcode 1830 on its visor and might be used as illustrated with respect to item 1514 in Figure 15 (it invites responding by being worn on the user's head with its visor "jauntily” pointing forward, back, left, or right.)
  • LARsponder 1830 although based as it is on a "baseball cap”, is meant to be representative of the novel and much more general concept of converting almost any 2-D or 3-D "article of commerce" into a LARsponder.
  • LARsponders 1832 through 1838 portray code designs such as combinations/assemblages of colored and/or retro-reflective 3D shapes such as spheres as already mentioned with respect to 1650 of Figure 16. These are examples of relatively “self-occultation” resistant assemblies in that at least portions of each code and/or locate element can be seen by LAR-Readers using different lines of sight to view the codes even over a relatively wide range of LARsponder or LARcode spatial orientations. 1832 and 1833 show the code as it appears to two imagers one viewing from above and the other from the side view. An increased degree of "self-occultation” resistance can also be achieved using thin minimally obstructing support "pins" as in 1834.
  • This general type of LARcode structure can, in turn, be mounted on a thin rod etc to move it away from any other component of the LARsponder with which it is associated.
  • 1836 illustrates this in the form of a finger-mounted LARsponder using close-packed color and/or RR spheres (white or colored) as coding elements.
  • 1838 illustrates such an assembly off-set mounted of a pad 1840 which can be adhesive-backed or otherwise affixed to body parts, objects, structures or other item of interest to create LARsponders enabling LAR-Readers to provide data to a LAR-System regarding the LARsponder's identity, location, and movement in 3D space as well as its orientation with respect to its own “internal" coordinate axes. This is in contrast to, for example, data provided by typical motion capture technology.
  • Suitable "Articles of Commerce" objects or portions thereof as herein defined are intended to include any type or item of clothing or any accessories such as the cap 1828 and/or hats, shoes, gloves, purses, pins, jewelry, scarves, finger rings, hand-held banners, souvenirs, fan-loyalty and "novelty” items, signs, eyeglasses, masks, sports equipment, athletic shoes, helmets, gloves, clothes, sweatshirts, jackets, accessories, memorabilia, and similar accoutrements as well as other property such as Event Programs, books etc.
  • LARsponders or portions thereof can be based upon objects, positioned on objects or tethered thereto. They can include LARcode components positioned on containing, enveloping, bag-like, or wrapped elements or containers such as bottles, beverage cartons, Tetra-Paks and others.
  • LARcodes and other elements as previously described can also be affixed to or associated with "non-passive" communication devices cellphones, smartphones, eBooks, iPods, mobile/portable computers, portable radios, and similar devices (whether actively network-connected or not) enabling them to function as LARsponders with enhanced capabilities such as GPS, built-in compasses etc .
  • These combined entities can be manipulated as LARsponders as in Section C.3 and/or for other purposes such as indicating inclusion in a group comprised of geographically closely co-located members.
  • Personal items such as credentials, ID cards, badges etc. can be adapted to serve as LARsponders. Note that data relevant to the validity of these types of items can become readable and verifiable at substantial distances when the item bears or is modified by the addition of suitable LARcode elements.
  • Activation or validation after being accomplished, can be "permanent or “perishable” and/or can be withdrawn if further performance requirements or other conditions are not met.
  • LARcode System software causing it to openly accept and evaluate initial-response activation attempts by a LARsponder user such as gesture sequences captured in a series of frames by a LARcode Readers or responses via a series of "sign-in" choices performed in some designated manner etc.
  • activation or validation can use physical emplacement or positioning of "activators" with respect to other entities whose images can be captured by LARcode Readers.
  • Activation or validation procedures can be designed as team-joining actions, can be built around product purchases, can cause a LAR-System to provide information or take other actions, and/or include incentives such as enhanced prize-award chances etc. several versions of which will be described further below.
  • LARsponders can be constructed to be operating or decorative parts of objects. They can be configured so that they are not deemed (by LARcode Readers and supporting Data Systems and software) to be "Activated” or “Valid” (or are interpreted by the System in some alternative way) unless certain conditions are met.
  • One such a condition can involve affixing an additional component (or several) in pre-defined or quantifiable "designator” in a “coupled” relationship (e.g. within a required relative distance and/or in an approximate pose etc.) with respect to another specific or reference element of the LARsponder.
  • Such Reference elements can be products, product labels, or other graphic or object components(s) or other entities with which LARcodes or components thereof can be associated.
  • Designators can be 2-D or 3-D items and supplied in separately-packaged or purchased form. Designators can also take the form, for example, of "peel-able” adherent label-like entities which carry one or more RR Locate regions. Designators, as well as Reference elements, can display corporate logos, labels, or other graphics and can carry additional color codes and/or color retro-reflective regions.
  • LARsponder's "Affiliation" closely resembles validating and/or activating methods and procedures except that it is an option which LARsponder users can choose to invoke to "join” other users as team-members or groups with some pre-defined interest or characteristic in common. Affiliation is not necessarily mandatory to qualify a LARsponder as usable.
  • Figure 19 presents a few examples of Activation of LARsponders in the form of various 2-D entities such as Event tickets or other paper items located in area 1900.
  • 1902 is an Event admission ticket or a coupon, "tip-in” card, tear-out, etc.
  • a sticker (1904, 1906 and 1908 are a few examples) obtained by purchase, hand-out, or otherwise, is adhered to the ticker by its user thereby converting the ticket into a LARsponder.
  • the disk-like sticker 1906 can merely enable LARcode Readers to perform a LOCATE function and such gestures as "waving" or, if not displayed, then "no comment”.
  • the color-coded rings 1910 can identify a particular event or dictate the software the LARcode System should use when "reading' this type of LARcode.
  • the other two examples 1904 and 1908 enable orientation responses in addition to those enables by the disk-type, and a much-expanded universe of codes.
  • the "T" RR version 1912 in 1908 is merely one example of an available data space which is large enough to portray pre-printed volunteered, opt-in data about the user while capturing each response and location of each specific individual responder even in a large venue.
  • the ticket 1914 can contain LARcode data upon which personal challenges can be based to insure that a user is precisely who he/she purports to be such as: "Wave your
  • the LARsponder vertically when your birthday month comes up on the Jumbotron count-down screen.”
  • the LARcode 1916 with BARcode 1918 adhered on the Ticket 1914 might have been purchased for some "high-stakes" competition or drawing and can also be read to detect counterfeits and/or verify validity/credit-worthiness of a user at the entrance into the venue.
  • RFID tags in a LARcode e.g in a sticker, such as card 1916 including a magnetic stripe and/or other features such as RFID
  • appropriate detectors can also be similarly employed for verification purposes and counterfeit detection.
  • the 1920 is a simple Designator or Activator in the form of some specific color or patterned RR component 1924 which enables simple "LOCATE and read” function software.
  • the "window” 1922 can also direct a LARcode Reader to assess some aspect of the colors or other features/elements 1926 framed by the window 1922 or located near the tip 1928 of the RR arrow 1920.
  • Figure 20 depicts an area 2000 containing a number of LARcodes and illustrates Activation or Validation of a simple 2-D "Four choice" LARsponder 2002 by manually applying one (or more) LARcode or other elements 2004, 2006 and 2008 which can, for example, be supplied to or acquired by a user.
  • Item 2010 is a generic representation of a document such as an event program, brochure, magazine, catalog, book, or the like.
  • the Cover or some page 2012 or a "tip-in card” 2014 can carry a pre-printed LARcode 2022 or codes. These codes can or cannot be complete (in the sense of being only the non-retro-reflective graphics portion of the LARcode) depending upon the preferences of the provider of the document.
  • a code without RR elements 2018 can be activated by user placement of a separate user applied adhesive- backed RR sticker, such as 2016.
  • Activation/validation stickers can be of any form and /or type discussed herein and can be handed out, awarded, purchased, or mailed etc. to the prospective user.
  • LARcodes such as 2018 can also be separately and similarly supplied to a prospective user and can be fully assembled or require some user assembly such as placing RR element sticker 2016 on LARcode sticker 2018 and then affixing the whole to document 2010.
  • a BAR code 2020 etc can be scanned (for example, when Sticker 2018 is purchased) which IDs legitimate purchase/possession of the sticker etc. and also can register the LARcode/LARsponder to which it is properly applicable.
  • optional "peel-offs" overlays, "scratch-offs", etc. can be used to reveal or verify the code.
  • Figure 21 shows a few suggestive examples of 3-D articles of commerce (located within area 2100) such as can be used by audiences in event venues such as sports arenas and stadiums, music festivals and concerts, political rallies, block parties etc.
  • Item 2102 is a group of 3 RR adherent strips of different colors. The number of strips, their shapes and/or colors is merely illustrative and many types/patterns either RR or otherwise as disclosed herein can be used.
  • Items 2104 show beer bottles converted by its purchaser to a three choice LARsponder by affixing an RR strip 2106 supplied with the bottle to it.
  • the "posed" orientation responses are: 45 degree tilt left, vertical, and a 45 degree tilt right with the RR strip approximately facing some LARcode Reader LOS as shown. These can be posed upon a cue from venue audio or, as shown, on venue visual displays— "19 seconds". If the bottle in nearly empty or closed, more choices can be handled including right horizontal etc.
  • LARcode Readers of these types of LARsponders can record specific user locations within a venue. Video cameras can zoom in on randomly selected "winners” from among those who chose the correct, most popular, most accurate "next play” predictive response etc. Actual awards can be presented by ushers or roaming (in this example, beer) vendors.
  • 2108 illustrates LARcode and RR components as adherent or elastic bands
  • 2110 shows code components having larger data capacity
  • 2112 and 2114 show coupled "tag-type" personalized components that can be re-usable from event to event
  • 2116 portrays LARsponders with substantial data capacity and 6-degree- of-freedom response capability.
  • LARsponders and/or their associated code elements can appear on a given object in multiple repeated locations. If, for example, a rotation or orientation with respect to a given LAR-Reader's LOS presents only partial data to a given LAR-Reader, other partial views of data and/or multiple images of the same LARsponder can be captured by other LAR-Readers. These can enable the LAR-Data Server system to make a correct determination of the LARsponder's ID and its user's intended response.
  • Bottles have been used above merely as representative of drink container-type articles of commerce. Many venues such as stadiums only permit paper-cups or other disposables. Items 2118 through 2122 illustrate use of paper-cup folded paper handles with LARcodes (2119, 2121, 2123) allowing degree of handle rotation about a vertical axis to be interpreted as designating choices along with various auxiliary data.
  • Items 2124 through 2132 show the previously explained examples and concepts applied to paper-cups with LARcode components.
  • 2124 is a cup assembled into a LARsponder with a RR LARcode 2130 adhered by the user and pre-printed with RRs 2130 and/or assembled with RRs by the user.
  • 2126 can be pre-printed without RRs for an event or product to which a user can add an assembled LARcode 2130 or, e.g., an RR product logo 2132 valid for a special survey etc.
  • Figure 22 illustrates examples of how activation, validation and/or associative LARsponder methods and apparatus, located in an area 2200, also lend themselves to applications involving user ID for purposes such as conducting financial transactions, purchase commitments etc.
  • Credentials 2202, 2204, and 2206 such as badges or credit cards with physically associated/coupled LARcodes and/or LARcodeNESTS can be used, for example, in "reveal" response mode. They can also support additional or supplemental response requirements/challenges such as (but not limited to) validation by using gesture sequences and/or signatures "signed” in mid-air etc. Gesture- requirements can be altered frequently (e.g. in military operations) and only authorized users informed of the "gesture of the day” etc. Please see also Section C.13.
  • Figure 22 illustrates a few examples of LARsponders in combination with more traditional types of ID, specifically 2202 is an access badge, 2204 is a wallet credential with "click" capability by orientation sequence etc. (such as by sliding it out of an obscuring envelope, etc.) and 2206 is a Credit Card, ID, Pass, etc. whose coupled LARcode (or LARcodeNEST) can be verified as genuine prior to use in a given venue by a magnetic card reader coordinating with a LARcode Reader's data.
  • RR frames 2208 can be provided on any of credentials 2202, 2204, and 2206.
  • Access badge 2202 can include a number of defined-location occulation blocks(s) 2210 to indicate a "click" when something, such as foldable flap 2212, is opened from the closed position. Opening flap 2212 can also be used to allow a "read” of occulation blocks 2210. LARsponder, such as in the form of Credit card 2206, can be pre-verified by magnetic strip 2214 located on the credential.
  • LARsponders shown and similar ones can also allow pre-validated verification/confirmation and /or acceptance of bids, purchases, bets etc. without requiring prior or follow-up close physical approach to some type of pay-clerk or system interface as is usually necessary when using cash or charge-card payments based upon magnetic-stripe BARcode "slot” scanning or conventional RFID "near-proximity” chip reader technology.
  • LARsponder Apparatus which can utilize various types of packaging components to conduct product and/or taste-testing in venues ranging from stadiums to food markets or other Point- of Purchase localities equipped (permanently or temporarily) with LARcode Readers.
  • This type of LARsponder can feature one or more "sampler" compartments (e.g. plastic envelope/panels or channels etc). These can overlie LARsponder/LARcode RRs or color Blocks.
  • a given compartment can be associated with a proximal first LARcode which can be read by a LARcode Reader.
  • Each compartment can be pre-filled with a sample of a liquid or semi- liquid product— e.g. a lotion, or contain an edible sample of some sort such as granular material, a tablet, a cookie etc.
  • sampler compartments can be grouped in a single structure.
  • a sample is extracted from a compartment (identified, for example, by its location with respect to its proximal LARcode or by other spatial reference), and tasted (or otherwise evaluated), the process of extraction can reveal a second LARcode element or other discernible evidence establishing that the user opened that particular LARsponder sample compartment.
  • This change in a feature visible in subsequently -obtained LARcode Reader images is one method of activating/allowing the participant in the survey or test to communicate an opinion or rating.
  • the participant's specific "rating" of that sample can be communicated by, for instance, obscuring a color area or in other ways afforded by response features built into the primary LARsponder "sampler” structure or by using a companion LARsponder with appropriate capabilities supplied to members of opinion/taste-test panelists.
  • the timing and location for valid tests of a given type of sample can be "start-stop controlled" by cues to the user/users. Participants can be incentivized to participate by offers of prizes, discounts etc. Note that the exact location (e.g. stadium seat number) of a given user can be captured by the LARcode System if desired.
  • the sampling/survey LARsponders can be passed out separately to potential users or can be removably attached to an allied or co-marketed product being purchased by users.
  • LARsponders can specify a specific screen within a venue or the type of challenge the user wishes to confront.
  • occultation of a specific code Block or while using a LARsponder with its LARcode held vertically can pick a different screen and/or challenge than one held horizontally.
  • a few examples are sketched below:
  • LARsponders (which can or may not be “perishable” (for example, “useable only until 5PM EST”) can be "opted- in” by various procedures to access special features. These can include (but are not limited to) audio entry or key- entry of short codes or imaging the actual LARsponder /LARsponder using a user's network-connected Smartphone, Cell-phone, Net-Book, Tablet computer, etc. and then transmitting the image to the local LARcode support system or elsewhere. GPS also can confirm and register presence (potentially to high spatial precision if enhanced GPS is used) in a venue. Performing an opt-in and/or other particular LARsponder responses can be used to trigger delivery of, e.g., a text (plus Ads, marketing materials etc.
  • each LARsponder used in a venue can obviously be individually ID'd (although its user can remain anonymous). LARsponder users can individually opt-into groups as/if they wish.
  • TEAMS made up of persons known to each other or seated nearby or GROUPS (female "fans” anywhere in the venue who are from St Louis) and wishing to play by coordinating their responses during a venue event can be defined by various criteria and registered with the LARcode Reader System. Event team formation my also be coordinated using any type of Social Networking Application for Smartphones etc. with the necessary data defining the team thus formed can then provided to the LAR-Data System via mobile network(s).
  • Teams can be defined by Physical Blocks of seats, e.g. Section D, rows 1-12 or determined by all players within less than X distance from a particular venue Reference Marker which is visually labeled for the benefit of users, (e.g. "BLUE 27" etc.) and also precision-located/recorded in the LARcode Reader data-base).
  • LARcodes can be provided that are TEAM -loyal or GROUP loyal or both.
  • the LAR- Data System can propose an "opt-in” or “association” with another or multiple other LARsponders for "scoring", reward sharing, or other purposes. Such proposals can be posted on video signage or audio announcements, cell phone messages etc. Acceptance or rejection of such associations can be communicated using e.g., LARsponder gesture responses by the respective LARsponders involved or can be transmitted to users via their Smartphones etc.
  • any LAR-Data System serving the principal venue where an event is taking place can also be connected to and serve other "outlying" venues where video coverage of the event is being presented. If outlying venues are also equipped with LARcode Readers, their occupants can use their own LARsponders (with or without associated communications devices) to also participate “Live” in LARsponder-based activities occurring in the main event site.
  • any product of the graphic or decorative arts can carry LARcode data and if appropriately designed and constructed can serve as a basis for a LARsponder which can offer novel and useful functionality.
  • Versions of LARcodes and LARsponders can be essentially 2-D flat entities or, as previously described, can be or include 3-D elements of simple or quite complex forms. Depending upon their detailed design features, especially the latter can be manufactured using very wide spectrum of methods as discussed previously in PART B, Section B.08.
  • LARcode and/or LARsponder production methods It is impossible to exhaustively limit or pre-determine all LARcode and/or LARsponder production methods.
  • the present remarks seek only to briefly describe the spirit and intent of a few unique concepts/procedures largely relevant but not limited to LARcode or LARsponder components fabricated from planar or sheet-like materials.
  • Candidate materials include paper, cardboard, laminates, polymer sheet, matted, perforated, textured, or woven fabrics, leather, leather-like and other synthetic materials, metals, glass or any others which can be
  • Procedures can include any of those known in the graphics arts and the various processes and arts employed in the container and packaging industries.
  • Color-coded or other visually-patterned LARcode regions or components which need not be retro-reflective or possess special optical properties can be created by any appropriate graphics arts method. These include markers and plotters, stamping, ink-jet or laser printing, etch-and-fill or large scale graphic-arts production methods as used for newspapers, Ad-inserts, magazines, etc. Because these classes of components involve no special materials or technologies they can be expected to be quite inexpensive to produce.
  • Label and container printing methods as practiced on metal cans or foils can also be employed at somewhat increased cost.
  • Screen-printing methods for higher performance RR regions can use pigments in combination with sub- millimeter retro-reflective bodies, e.g. transparent spherical beads, micro-corner cubes, or under-lays/over-lays with reflective embossing, as exemplified by products offered by 3M Corporation and others.
  • sub- millimeter retro-reflective bodies e.g. transparent spherical beads, micro-corner cubes, or under-lays/over-lays with reflective embossing, as exemplified by products offered by 3M Corporation and others.
  • Simple retro-reflective RR LOCATE regions on LARcodes can be produced by applying shapes which have been pre-cut from various stock colors of adhesive-backed RR tapes and sheets.
  • Some types of more complex, e.g. multi-color and/or "mosaic" RR regions can be made by assembling transparent films carrying color patterns printed in transparent inks over a base of commercial "white" (optionally adhesive) RR sheet or tape.
  • Certain types of RRs can entail pre-fabrication of custom-made base sheets/tapes comprised of RR materials with more than one type of RR sub-structure each with different optical parameters (as disclosed in B.08).
  • Sheets of material coated/impregnated with special fluorescent or phosphorescent substances which can be used as LOCATE regions on LARcodes (as discussed elsewhere herein) can be handled in a similar way.
  • LARcodes and/or LARsponders can be used to avoid cost impacts on various standard graphic arts printing and assembly technologies by separate handling of some of the less common processes or substances which can be required in certain types of LARcode or LARsponder production.
  • Screen-printing or other special or low-speed production techniques for applying RR pigments on paper, fabrics, glass, plastics, metals or other surfaces to create RR LOCATE areas can be avoided as described in the following examples.
  • Retro-reflective or other commercially atypical components can be mass-produced be existing methods as coated bulk sheets or rolls with, e.g. peel-off adhesive backings. These can be p re-perforated for tear-off separation or die-cut to proper shape and size ready for affixing to LARcodes or LARsponder.
  • the two or more types of components LOCATE and CODE regions (the latter conventionally printed) of the LARcode can be optionally packaged in "Kit" form and then hand-assembled by the intended final user/owner (or by a "retail” kit vendor etc.) into a functional LARcode for use in a LAR-System-equipped venue.
  • needed RR etc. components can be supplied as separate "tip-ins" in, e.g. Event Programs in which the color regions of LARcodes have been pre-printed as graphics on Covers or in Advertisements etc. This converts the graphic into a LARsponder. Kits can also be distributed as premiums inserts or free hand-outs etc. "Prize" RRs for subsequently activating some type of "special" LARsponder or LARcode can be awarded based upon demonstrated skill or luck.
  • an individual desiring to use a LARcode or LARsponder manually positions the RRs appropriately on the graphic code component to complete its assembly thereby making it ready for use.
  • a user can, for example, obtain one of the two components as a free "hand-out" containing a set of RRs of particular design and/or shape intended to be added to a printed graphic in the Event program.
  • the graphic can carry only the color blocks of a LARcode.
  • the user then completes that LARcode or LARsponder, but must also acquire another LARcode, RR, "Kit," or other components via a product purchase or some other action such as a contribution to an in-venue charity drive.
  • the user merely assembles/positions the original and added components.
  • the products purchased for qualification and accompanied by components for the second Kit can range widely: cups of beverages, team caps, head bands, megaphones, banners, team pictures, "logo'd” playing cards, etc.
  • LAR-System Accurately communicating specific multi-digit numbers or an ordered multiplicity of selections from other rich symbol sets— e.g. alphabets, technical symbols etc. to a LAR-System can be a useful function of LARsponders. Passive and active LARsponder apparatus and methods for doing this are described in this Section. Uses of commercial and entertainment importance include ways by which guesses of the total attendance at a baseball game can be quickly and precisely entered by one, a few, or a massive crowd of individuals competing for "closest guess" awards. Mass participation in lottery-style awards for picking the winning random number string out of millions (or even billions) is also possible as are many other applications.
  • Area 2304 is merely for convenience, where a user can write his/her chosen number/symbol sequence for reference.
  • the desired sequence to be communicated by the LARsponder is designated by "marking" five areas in the matrix 2308.
  • the matrix is 10 rows 2306 (1 through 9+0) high in the vertical "Y” direction and five columns 2307 wide in the horizontal "X" direction.
  • Card 2310 in this illustrative example also has a LARcode 2314 with a reference RR 2316 associated with it.
  • This code can ID the event, the user, and/or convey special privileges, etc. which have been obtained by procedures such as described elsewhere herein.
  • items 2320 thru 2326 exemplify LARsponders which use a time-sequence of orientations to communicate a multi-member string of digits to LAR-Readers.
  • the LARsponders shown are two-sided, with LARsponders 2320 and 2324 showing opposite sides. Many of the LARsponders described in this document can be so designed to double the possible choices available.
  • the LARsponder has five digits (1 thru 5) on its front face 2320 and five (6 thru 0) on its obverse face 2324 .
  • the user is cued by the LAR-System via video, audio or otherwise to enter the first desired symbol in the string, say a "3".
  • the user orients the LARsponder so the "3' sector is vertical and in view of a LAR-Reader which captures the LARsponder's image. Then, the user is asked, upon a second cue from the system, to enter his/her second chosen symbol which may be, say, a "9". The user turns the LARsponder to its obverse side 2324 and orients the LARsponder so the 9 is vertical then holds the 2324 side facing a LAR-Reader. As depicted, 2320 indicates a cued response of "1 " and 2324 indicates a cued response of "6". If desired, one or both sides of the LARsponder can also carry a LARcode 2314 with user-specific or other data.
  • LARsponders can be used for entry of symbol strings. These can include, for example, multiple manually positionable rotating members (disks or wheels (as in mechanical odometers) with e.g. 0 to 9 numbered and distinctively color-coded RR regions around their periphery.
  • active LARsponders with wireless communications and/or RFID features can be employed in certain types of venues where the necessary infra-structures exist.
  • a LARsponder capable of only a "yes” or “no” (or merely a passive no indication “null” response) can be used to build a five digit number by signaling "yes” as digits for the first (the possible 10,000's place digits-0 to 9, then the 1000's place digits-0-9, etc. appear sequentially on displays, voiced on PA systems other channels in the venue.
  • the users can be cued to signal their first desired digit when it appears before it changes. Time remaining for choice before a given digit on the displays disappears and next digit appears can be indicated by a count-down clock. If 5 seconds per digit are allowed in which to make a choice and a five digit decimal number is to be specified, the total data collection time will be of the order of 50 seconds per digit.
  • the total time required/occupied during actual "choice-making" is ⁇ 5 minutes in this example and is essentially independent of crowd size.
  • RRs components or Kits can carry bar-codes or other features (covert or otherwise) on their fronts, backs, or borders and/or also can be uniquely-shaped. Upon inspection, they can thus be identifiable as valid for a particular time or event for Award or other special recognition purposes.
  • ⁇ Tactics such as "no release” within a venue or environs until near time/place of use of kits, add-on stickers, separate RR components of unique shapes and/or overlying color gels or other elements needed to complete valid codes and themselves valid for only a defined time after issuance (per coded data on the item).
  • ⁇ Steganographic methods can be used to hide verification data.
  • Spying on neighbor LARsponder user choices etc. can be made difficult (while providing users with a sense of privacy) by, e.g. randomizing the positions of choices or orientation directions signifying a particular response on the LARsponders involved and/or using, say, half a dozen different appearing LARsponders all equally valid as input devices for the LAR-System.
  • a LARcode associated with the LARsponder can communicate to the LAR-Data Server the exact type of LARsponder design/layout being used so the LAR-System handles the user's response appropriately.
  • LARcodes and LARcodeNESTs as in Figure 22 and as briefly noted earlier can serve as simple but secure ID cards and access control Badges. They can also offer unique and useful properties/capabilities that reach beyond typical "civilian access control applications.
  • a LARcode and particularly a LARcodeNEST ID being used under duress or by imposters can be quickly and safely detected with high probability as further explained below.
  • An associated valid KEY can be required in addition to the NEST itself and the KEY can be changed/re-issued/re- coded in a changing format etc. by appropriate authorities from time-to-time for security reasons.
  • the NEST and changeable Key can be kept separate from each other until needed for ID.
  • the KEY can include High-Level Data about the ID holder such as name, address, serial number etc.
  • a LARcodeNEST can serve as an encrypted Q&A Repository readable by LARcode Readers and which can contain a very substantial number of trivial, detailed and/or very innocuous personal and other biographical facts that can collectively be known only to the legitimate holder of the ID.
  • the data placed in the Q&A Repository can be a culled sub-set of brief words or phrases given as responses to an extensive but easy and non-threatening written questionnaire or answers given during structured verbal interviews of the ID applicant. Precautions can be taken to insure the Applicant is not able to record or copy his/her own responses to the questionnaire or interview so he, himself, cannot remember all questions he was asked and cannot recall/reveal them, e.g. even under torture.
  • the resulting Q&A Repository can thus contain a large amount of mundane, personal and culture-specific data such as names of childhood friends, old home addresses, parents, children ages and birthdays, most favored food, most favored drink, favorite book, movie star, teacher in first school, favorite city in home country, favorite sport, favorite sports star, favorite musical group, favorite song, mother maiden name, favorite cleric, names of deceased and distant relatives, names of present or past pets, etc. etc.
  • Different set of Q&A's from the original interview/questionnaire or from the Q&A Repository can obviously be chosen on different occasions.
  • Reader stations Before allowing a close approach to a Control Point, Secured Gate or Checkpoint etc. by individuals or vehicles (including driver and other passengers) moving toward or in waiting lines, persons can be required to present their IDs and Keys at one or several LAR-Reader stations variously positioned along their line of approach.
  • Such Reader stations can use any of the apparatus and methods previously disclosed. They can be based on simple low-cost (and only slightly modified) commercial "Point and Shoot" cameras.
  • Readers can be hand-held (if considered safe), can be carried on motion-stabilized mounts or mounted on aerostats, tethered balloons, helicopters, light aircraft, UAVs or drones, poles/walls/moveable/mobile and/or/robotic platforms etc.
  • Several Readers can be deployed at a given station and these can wirelessly deliver various views of a vehicle interior, its passengers and their IDs.
  • LARcode Readers can have telephoto and stabilized imaging capabilities, including among others, those based on the methods and apparatus described elsewhere herein which employ (or are assisted by) RRs on the targeted LARcodes/LARcodeNESTS containing the Q&A Repositories.
  • Reader stations can include voice-to-ground or other public address systems, two-way audio booths at unmanned query points (as in some Drive-In Restaurants) which can be used to converse with persons wishing to approach a Control Point.
  • the System can also include voice recognition and auto-translation capabilities to enable the interrogation techniques described below.
  • Challenges, interactive confirmations and/or authorizations can be conveyed not only by audio but by digital signage or via data delivered through networked devices such as smart- phones etc.
  • Control Point Person(s) approaching a Control Point can be required before moving any closer to a Control Point to present their IDs in a cooperative posture or "pose” facilitating reading by one or more suitably deployed LAR-Readers. (Approaching persons can also be challenged to give the visual "PASS-GESTURE" of the day while viewed by LAR- Readers.)
  • the High-Level Data KEY "reads" of a presented ID can be used by the System to access the Q&A Repository Data contained in the ID's LARcodeNEST and present it to the Control Point authority.
  • Q&A Repository data may already be available in a local database because of previous transits through the same Control Point.
  • answers to multiple challenge questions drawn from the Q&A Repository data as previously supplied by the legitimate ID holder can only be known unhesitatingly (or perhaps with brief thought) to the holder of that of the ID. Selections from the Q&A data are used to interrogate and/or challenge the ID holder's knowledge or legitimacy.
  • the ID Holder is an imposter, he/she will not know many, if any, correct answers, thus alerting the Security personnel. If answers to LARcode or NEST-based challenge questions are being coerced out of the ID holder, he/she can covertly alert the Control Point security personnel by deliberately providing a series of wrong answers. If a challenged person "panics" and forgets a correct answer as originally supplied, he/she can be quickly given several chances to answer alternative questions before taking "intercept or exclusion" actions etc.
  • Codes of the general types as described herein are passive and the data represented by a LARcode KEY can provide basic ID information such as name, rank, serial number, passport number, home address, etc. of the Holder which can be read at large stand-off distances compared to passive RFID tags.
  • LARcodeNEST can be encrypted so the ID holder/user CANNOT read it.
  • RFID tags can be stolen or counterfeited.
  • Photo-IDs can be disguised or counterfeited, passwords can be given up under threat or sold, eye Iris pattern and vein pattern-reads require one-on-one close-up interaction with sophisticated equipment, Magnetic stripes can be copied, fingerprint methods are subject to interference from dirt etc. No one is likely to have instant correct answers to random personal questions except the one person who knows all the answers inherently— the legitimate holder of the ID.
  • a LAR-System installation can be as simple and small as one inexpensive LAR-Reader covering a space measured in cubic inches, a desktop, or a portion of a room. It can use only one or a few LARcodes or
  • LARsponders At the other extreme, a LAR-System installation can involve hundreds of LAR-Readers, perhaps including some with special or diverse capabilities, working simultaneously with fens or even hundreds of thousands of LARsponders in a single venue.
  • a system can use LAR-Readers based on very advanced digital cameras with extreme resolution and pixel counts. Some can be mounted on aerial survey platforms. Still others in the same system can be man-mobile, equipped with adaptive optics and specialized ROI or other capabilities.
  • LARcodes serve primarily as one-way sources of fixed pre-defined encoded data content to be delivered to a LAR-System. If appropriate software is available in the LAR-System's Data-Servers, a LARcode's encoded content can be processed along with data on its 2-D or 3-D coordinates in image space. In some applications, the "pose" of the LARcode source being imaged by the LAR-Reader or Readers can also be determined.
  • LARsponders as described in PART C, when used with appropriate LAR-System software, add a wide range of 2-way response modes and other capabilities which include but reach beyond those offered by fixed code content LARcodes. For this reason, PART D will be focus on venues in which LARsponders might typically be used with the understanding that such systems also accommodate LARcodes. "Large" venues are emphasized in the following.
  • LAR-Systems can adapt to AND can drive sales and revenues for the owners and operators of almost any traditional type of collective audience and/or group activity space such as:
  • a LAR-Reader consists of one or more imagers with LARCA (LAR-code Adapter), IM-(lllumination Manager) and PLCM (Power & Light Control Module) with associated Illuminator lights sources.
  • LARCA LAR-code Adapter
  • IM-(lllumination Manager) IM-(lllumination Manager)
  • PLCM Power & Light Control Module
  • System Field-of-View (FOV) operational requirements for a given venue can be met in various ways. These include, but are not limited to mounting a number of fixed-location (but removable if/when desired) LAR-Readers in the venue. NOTE: Outboard PLCMs and Illuminators (if not attached to moveable Imagers) can be mounted similarly but, when desirable, inconspicuously positioned as explained in PART A.
  • Suitable "fixed" locations for LAR-Readers include:
  • participant/audience spaces e.g. grand-stands, other seating, race tracks, rinks, aisles, etc.
  • Clusters of "Omni-view" LAR-Readers can be suspended in fixed locations from venue ceilings or equivalent with Lines of Sight in 3-4 fixed directions or the LOS could mechanically rotate to cover 360 degrees
  • Multiple LAR-Readers can be mounted outward-looking on "n" spokes of a horizontal wheel to cover curved sections (e.g. stadium end-zone seating etc.)
  • LAR-Readers deployed on mobile, moveable, and/or man-portable mounts such as:
  • LAR-Readers mounted on helicopter, airship, or fixed-wing aircraft A version of this type of Reader can be based on "leased-for-the-event" digital aerial survey and mapping cameras to which demountable custom communications, PLCM, and IM accessory gear and high intensity Illuminator light sources.) can be added. Progress in unmanned recon micro-aircraft and drones can also enable their use as LAR-Reader platforms
  • One or more LAR-Readers can also be mounted on pre-existing (or purpose-installed) motorized wire-supported remotely-controlled video cameras as are currently used to isolate and follow wide-ranging goal-line to goal-line action on a playing field, e.g. football.
  • the LAR-Reader FOV can be aimed so as to collect a sequence of audience areas between plays on the field.
  • ⁇ LAR-Readers can be co-mounted on TV cameras covering an event and the Reader's FOV parameters and other settings automatically coordinated with the video or controlled manually by the TV camera operator.
  • the FOV of a LAR-Reader can include image relay mirrors (flat, spherical, etc.) optionally supported by image rectification processing by the LAR-System
  • Figure 24 is suggestive of a few typical locations in a very large sports venue where LAR-Readers have been installed.
  • the symbols are MUCH larger than the actual physical LAR-Readers would be. Examples of quantities etc. of LAR-Readers needed in large and small venues are discussed in later sections of PART D.
  • 2402 denotes LAR-Readers on the perimeter of a giant video display 2404 on which imagery can be displayed that offers interactive challenges to an entire audience of 80,000+ event attendees OR to subgroups as designated by on-screen information, audio etc.
  • 2406 shows a few examples of the LAR-Readers covering upper deck right-side seats.
  • 2408 shows a few mast-mounted LAR-Readers serving the Main or first level tiers of seats.
  • 2410 indicates a couple of man-mobile LAR-Readers while 2412 is a LAR-reader assembly mounted as a small accessory on the high speed mobile robot side-line video camera system typically used to enhance network and local video coverage.
  • Elevated LAR-Readers can view audience areas from the rear or from the front. Users simply may hold their LARsponders accordingly-upward and facing toward backward or backward. Look-down FOV LAR-Readers obviously can read LARsponders that are positioned "face-up”.
  • a given area of particular interest in the venue can be viewed by both fixed LAR-Readers and intermittently also by mobile LAR-Readers.
  • LAR-Readers can be GPS located and tracked. Such data can be used to provide alerting information or about the sun's relative position with respect to specific LAR-Reader sight-lines in order to avoid solar retro-reflections from certain LARsponders or temporarily block data from them.
  • the software generating warnings or blocking can reside in the Servers.
  • Reference Markers within the FOVs of one or some LAR- Readers in a venue can provide pre-determined and precise 3D coordinate reference data in imagery captured by LAR-Readers.
  • Some or all Reference Markers can be generic and referenced to the known fixed architectural features of a venue.
  • Some or all Reference Markers can carry optically-coded information readable by LAR-Readers which direct the system to their ID precise pre-calibrated 3D locations and other data or unique attributes. Since markers can be of known physical size and shape, their images, as captured by a given LAR-Reader, whether fixed or mobile, can also be used for scaling and estimating distances and pose (3D orientation) of LARsponder elements with respect to that LAR-Reader and its LOS. Markers can be coded (e.g. LARcodes) and cylindrical so they can used by multiple LAR-Readers having a variety of LOS's.
  • Reference Markers can also be located on or above stairwells, aisles, fences, masts etc and on fixed LAR-Readers in the FOV of other Fixed LAR-Readers. In addition, they can also be placed on backs of seats or on undersides of fold-up seats to use as geometric spatial references when in view.
  • Pre-calibrated Reference Marker data and/or data regarding the Line of Sight (LOS) and FOV of fixed-position LAR-Readers can be used to determine the exact seat number or the standing location of the person using a LARsponder in an image captured by a LAR-Reader. This can be accomplished by conventional computer-based geometric scaling of vector distances between available Reference Markers and that particular LARsponder of interest. In the case of fixed FOV LAR-Readers, portions of the required geometric calculations can be done in advance and held in LUTs (Look-Up Tables) or other accessible memory.
  • LUTs Look-Up Tables
  • LAR-Readers can also carry Reference Markers. These Markers can be optically coded to provide ID and the current location etc. of a given moveable LAR-Reader as viewed by other (e.g. fixed-position) LAR-Readers. Such data, in turn, enables computation of precise locations of LARsponders in the FOV of the moveable LAR-Readers.
  • Moveable LAR-Readers can also be equipped to use conventional tracking, transponders, tilt and rotation transducers, GPS and/or enhanced high precision GPS, and ranging methods etc. for determining and/or reporting relevant properties such as FOV, instantaneous LOS pose, 3D location etc. and can report internal software- controlled LAR-Reader internal parameters, e.g. current focal-length setting etc.
  • any/all specified "opt-in” members of any kind of sub-groups (i.e. teams) in a venue who meet defined criteria and/or who make “valid' responses or choices can be located. Such information can then be used to direct video coverage, generate announcements on the facility's digital sign banners, or make audio public address announcements etc. concerning those respondents ("winners" etc.).
  • Multi-spectral Illuminators, retro-reflective color-code regions, spectral modulation techniques etc. can be used to substantially reduce the assumed minimum pixel areas (64 or 100 pixels) needed for readable blocks. Such techniques potentially increase the total venue area coverage per LAR- Reader or conversely reduce the minimum size of LARsponders or LARcodes that can be used in a venue equipped with a fixed number and type of LAR-Readers.
  • the simplified examples and discussions presented in Sections D.5.1 and D.5.2 do not exploit these available options and techniques.
  • LAR-Reader Assume, for illustration, one mast-mounted or suspended LAR-Reader installed in a venue above seats in typical inclined-ramp fashion.
  • the LAR-Reader views the seats along a line-of-sight (LOS) orthogonal to the plane of the audience area.
  • LOS line-of-sight
  • the total FOV of a single 12 megapixel LAR-Reader frame contains 12x10 s /64 ⁇ 19x10 4 'features".
  • LARsponder or LAR-code Blocks or other elements of interest are, e.g. squares 1"x1" in actual physical size then the total physical area of FOV of the assumed resolution LAR-Reader encompasses 19x10 4 in 2 hence 1,319 ft 2 .
  • LAR-Readers can be mounted with lines of sight that are vertically down from above the seating, slanted upward from below the seat deck or slanted downward from above and behind the seat deck.
  • LARsponders should be positioned/presented, (i.e. hand-held etc.) so as to be roughly orthogonal to a particular LAR-Reader's line of sight whether fixed, mobile, or on an over-flying aerial platform of some sort. (The last-named would, of course, use imagers with much higher pixel counts.) Users can be alerted to perform this approximate alignment by a preliminary light-flash, or by audio, video, radio, digital signage, smart-phone signal or any other source of cues.
  • LAR-Reader can be installed with somewhat overlapped FOVs and somewhat convergent LOSs. These can be co-located as shown in PART A- Figure 4 "CamClusters" 52.
  • Such a LARsponder has an effective area of about 27 square inches (hence assume -20 square inches allowing for substantial angular foreshortening etc.).
  • Each of the four key “elements” (other than the RR strip) on the LARsponder is -5 square inches in area.
  • 100 pixels are required for reliable orientation and color code "Reads" of an element.
  • LAR-Readers that include motorized zoom lenses mounted on PZT (Pan, Zoom, Tilt) mechanisms to cover a venue or certain portions thereof. These can also incorporate f/stop control and other features. All such parameters can be pre-programmed and can include adaptive features/capabilities on a viewed region-by-viewed region basis. Control can be based on weather, time of day, environmental/ambient factors and/or can include data obtained by monitoring of margins of error and repeatability etc of LARcodes read by specific LAR-Readers and/or read accuracy behavior against standardized test targets positioned in various locations the system operating space.
  • LAR-Reader using associated LAR-Data Server/System software
  • capabilities of given LAR-Reader using associated LAR-Data Server/System software can, among others, include the following:
  • time series can be acquired re either one variable at a time or in series of adaptive combinations.
  • Image processing techniques can then be used to improve selected or general data detail and accuracy by combining data from some or all or a given set of such time series using scaling, de-blur, spatial correlations, color analysis, image stitching etc. These manipulations can be assisted by reference to known data re fixed Reference Markers or other unchanging elements in the varying FOV. Results of time series can be used iteratively to modify subsequent time series and the types ranges of parameters used to capture them.
  • the data so obtained can, as noted above, be referenced to fixed Reference Markers or other points of reference with pre-established known spatial locations as seen in the video FOV.
  • Computer-based image analysis and correlation across multiple frames can then be used to improve the read accuracy of any given frame or area of interest. For example, a particular LARcode image that is out of focus, partially occulted or underexposed etc in one frame can be tracked across several frames as LAR-Reader parameters that control focus, FOV, LOS etc. are altered and the collective data can then be used to interpretation accuracy of the original data set or future ones.
  • Non-traditional venues of interest can include "open" spaces that do not routinely host performances/events presented to seat-assigned audiences. Others can be unexploited simply for lack of suitable or affordable ideas for uses. Still others can be surplus areas embedded in larger active spaces only infrequently set up for special events.
  • Open spaces which are accessible to the public such as parks, beaches, sidewalks, hotel lobbies, transportation system waiting areas and terminals
  • DOOH Digital Out Of Home
  • Under-used, temporarily or permanently-closed venues such as dis-used motion picture theaters, meeting halls, amphitheaters etc. can be periodically re-opened to host special types of entertainments and/or revenue- producing "action".
  • venues such as dis-used motion picture theaters, meeting halls, amphitheaters etc.
  • action can be periodically re-opened to host special types of entertainments and/or revenue- producing "action”.
  • Individual audience members, and/or pre-formed or ad hoc groups in an equipped venue can compete with each others playing on-line games or in other activities using free LARsponders provided by mail from an event sponsor, with purchase of refreshments etc.
  • Venue-specific "banner” challenges running across bottom of the event display screen or displayed proprietary venue digital signage can be used.
  • Venues can be equipped for gambling using no digitally network-connected smartphones, computers or any other active personal devices whatever.
  • a completely passive LARsponder as a disposable card personally purchased by each gambler
  • ⁇ Incentives can be offered to audiences in a LAR-System equipped venue to act as FOCUS groups by using their LARsponders to register their opinions of advertisements, quality of products, packaging preferences etc. electronically displayed on venue displays OR on Smartphones etc. with NO particular or special apps being required to be installed/used in the devices providing the basic event images.
  • Substantial space in thrill-ride and theme park facilities and other large venues is devoted to audience preloading and crowd-control. Large numbers of people are often left with little to do except wait for "curtain time" or for exiting crowds to clear.
  • audience members can be equipped with LARsponders by give-aways or as premiums accompanying purchase of some revenue producing item such as refreshments or souvenirs.
  • LARsponder-based action using Video screens and LAR-Readers mounted along crowd-control pathways can be used for games to entertain and "pace" such crowds and reduce annoyance impatience.
  • Large-screen Home Theater Entertainment Centers typically are used with video games that accommodate one, two, or perhaps three ACTIVE participants while other persons, if any, can merely watch.
  • LAR-System technology installed in such a venue can accommodate game adaptations that can involve not only one or two but also 3 to dozens if desired, without requiring special hardware.
  • the additional participants can bet, predict, offer video-graphic and verbal advice etc. without necessarily requiring any modifications to the original game software or user interfaces etc. and, in some instances, actually play as "collectives" or teams. This can be done, e.g. by averaging or otherwise combining multiple individual inputs/actions etc into single team input that can be accepted by the original game software.
  • two-way feedback to a user or users can be accomplished via dynamically up-dated venue video and/or other digital displays.
  • venue video and/or other digital displays can be large screens viewed by thousands, poster size, or small screens at counters or tables, seat video for passengers etc.
  • Alphanumeric by methods such as venue audio, lighting effects etc.
  • all of these "open" methods can be scaled to handle single, a few, or very large numbers of venue users via the fast local processing and response capabilities of the venue LAR-System.
  • LARsponders incorporating commercial network-enabled devices (MIDs, Cellphones, Tablets etc.) as component elements have also been disclosed in this document. These can provide users with private input and feed-back capabilities from the LAR-System.
  • LAR-Systems and LARsponders can be useful but dataflow such as specific information, feed-back, order size confirmations/changes, or acknowledgments to individual LARsponder users is desired or essential, but no suitable "small audience" or 'private" coverage displays are available and other methods e.g. audio or PA channels can be inappropriate or can compromise privacy.
  • local short-range low bit-rate wireless channels can be used to communicate to and from individually addressable actively-powered (e.g. battery, photovoltaic, etc.) user-carried LARsponder Accessories.
  • Accessories with the required types of active capabilities can be inexpensive.
  • Well-known technologies are available to handle all communications, display and data input-output functions required. They can be given, loaned, purchased, or otherwise provided to LARsponder users and can take several forms.
  • the active accessory can be a small credit card-sized device.
  • a simple version can use a number of small LEDs which flash and or light in various combinations etc. to signify acknowledgment, or other simple quantitative or qualitative data sent to or received from the LAR-System.
  • Well-developed technologies based upon LCD, OLED, eINK, and similar thin and small displays suited to card format as well as others are available to support more sophisticated two-way alpha-numeric information exchanges. Touch and alpha-numeric key input areas can be provided on the active device.
  • the active accessory need not be in card format. However, one preferred embodiment combines the active accessory with LARsponder features as illustrated in Figure 22 of Part C.06 showing integration with IDs, Charge- Cards, and LARcodes.
  • any of the above described active accessory capabilities can be designed and configured to be independently acquired and used as a complement to a range of types of LARsponders. Alternatively, they can be attachable, "snap on” or tightly integrated and combined with a given LARsponder's physical structure and mode of use.
  • An active accessory can also include a capability to automatically (or upon the user's request) alert a LAR- System and/or user that it is within that LAR-System's venue service range.
  • LARCAs, PLCMs, IMs See PART A
  • Illuminator Assembly 150.00 Power Supply Sub-system 100.00 Wiring, etc. 50.00 Mtg Hdwr (wall or ceiling suspension). 50.00
  • Additional costs typically can include items such as:
  • Example I A 100 seat "ramp-style” Lecture Hall equipped for multiple choice or similar types of LARsponders One 12 Megapixel LAR-Reader $350.00
  • Illuminator Assembly Sub-system (hard-wired for power) 100.00
  • Example II A long-haul Bus or Rail-Road Passenger car designed for "2 seats-aisle-2 seats” per row and 20 rows hence 80 passengers (no standing passengers). Two fixed FOV and LOS LAR-Readers per row. Each LAR-Reader (mounted over seat pair) comprises:
  • LAR-Readers to implement "home-scale" LAR-Systems such as those that might cover areas or venues such as a desk-top, a family room, a child's play area or any other location where a TV or other display is also available.
  • An "Easy-Mount" LAR-Reader can be comprised of a small digital camera, or a Webcam or equivalent with support apparatus as described in PART A.
  • One or more such LAR-Reader assemblies, each mounted on an individual adjustable tilt and rotate member, can simply be screwed into standard desk or reading lights, floor-lamps, ceiling fixture lamp sockets and/or clamp-on work lights etc.
  • Commonly available dual-light socket adapters can be used to also accommodate the original lamp-bulb if desired.
  • other methods of "home-style" or temporary hanging or mounting can be used.
  • a given LAR-Reader can be powered by the existing venue electrical system or can use on-board photo-voltaic or separately charged batteries.
  • the USB port built into the camera or in its plug-in data storage card can provide a wireless data and control channel to the venue computer supporting the LAR-System. (Data transfer over venue power wiring could also be used.)
  • Figure 25 schematically displays examples of some salient features of methods and apparatus useful for implementing and/or conducting novel "Automated Auctions” or other "live-action” purchasing activities.
  • Particular versions of the apparatus and system can be aptly described as 'Automated Auction Stations" or "Auctions in a Box”.
  • a typical LAR-Reader 2502 (See also PART A of this disclosure) is connected to a LAR-System or Systems serving a venue in which automated auctions and other types of merchandizing events or activities, contests etc. take place.
  • LAR-Readers together with supporting apparatus, e.g. PLCMs, Illuminators and software etc., can be operating in the venue and can also be installed in associated approaches or environs.
  • Participation in venue-based events can require that participants use LARsponders/LARcodes of particular types which can be obtained or acquired in conformance with criteria defined by the LAR-System operator/owner or event sponsor.
  • LARsponders intended for use in a particular venue or at a particular event can be distributed via direct mail, newspaper inserts, tip-in Ads, on-site handouts etc. and can be disposable or re-useable. They can be "card-like" 2D or other forms of LARsponders. They can be fully or partially coded and/or can optionally require further validation. Validation for example, may a pre-printed, uniquely coded LAR-sticker (which can include Locate regions such as retro-reflective areas) which the Venue Operator issues to a Bidder at "check-in".
  • This LAR-sticker can be adhered to the Customer/Bidder's LARsponder Card which (along with a pre-printed Base Code on the LARsponder if desired) renders the LARsponder operational.
  • the LAR-System can, for example, require that all data Blocks in both the Base Code and Sticker Code must be in view and/or in proper relative spatial relationship to each other.
  • Each validated LARsponder can be assigned a unique identifier number ("Paddle Number") and the
  • LARsponder becomes the participant's Bidder's Paddle in the traditional jargon of auctions.
  • a user's Paddle Number can reference the LAR-System Data base for the user's identity, address, credit limits, demographics, date and time limits etc. or other restrictions on its validity as approved by the Event or Venue Operator. Using these general types of data, each attempt to signal a bid to a LAR-Reader can be instantly accepted or rejected by the LAR-System.
  • the LAR-System data processing software can require that some additional qualifying action on the part of the user is needed to produce a firm bid interpretable and/or acceptable by the System. For example, to avoid an "inadvertent bid" offering, a valid bid can (but optionally need not) also require a follow-up wave, gesture movement or other confirmation action executed by the bidder. Similarly, the LAR-System software can require motions such as waving and holding up the Paddle until the bid is acknowledged by the LAR-System. This can also minimize paddle occultation issues. In addition and in some circumstances, e.g. crowded venues, LARsponders can also be designed to be mounted on stick-like extension handles for presentation to LAR-Readers.
  • LARsponders used as Paddles can typically be passive devices, but actively-powered response devices and combinations of both active and passive apparatus can also serve as Bidder Paddles if desired by the venue operator.
  • Such active devices can be Smart-phones, Tablets, and similar mobile devices (MIDs) with networked and bi-directional communications data-exchange capabilities as described in earlier Sections of this disclosure.
  • MIDs mobile devices
  • These can be adapted for use as Bidder Paddles by installation of LARsponder software and physical LARsponder features and/or LARcodes. These physical features (RRs, aiming directions, etc.) allow LAR-Readers in the venue to collect user inputs via images of the Paddle orientation, motions etc. without necessarily relying on fast, high-quality third party communications provider support.
  • An installed "AuctionApp” software (or similar versions which can have additional non-auction uses as well) can accommodate entering timely Bids using system-assigned Paddle numbers.
  • the wireless network can be monitored by the LAR-System to insure data handling has sufficiently low latency required for fast-changing bidding.
  • Network-based Paddle users working with bi-directional and personal links can enable LAR- Systems to send and exchange many other types of useful data, e.g. newly added auction items tailored to a user's interests, individualized, special time-dependent buying opportunities available elsewhere in the venue etc.
  • 2504 is a generic representative of Illuminators which can facilitate LAR-Reader data acquisition operations and which can be mounted in locations laterally displaced from a given LAR-Reader's LOS.
  • a “Topping" bid Raise in this illustrative case, can be an increment chosen from among, say, four choices— $1 , 3, 5, or 10 dollars. In this illustration, a bid raise can be signaled by a LARsponder user who timely "presents” a Raise choice of A, B, C, or D to a LAR-Reader.
  • Timing remaining before "hammer” can be counted-down both on Venue display screens and by voice audio in appropriate areas.
  • the number and the size of permissible increments can vary with the item being auctioned and can be scaled to the price estimate of the item.
  • Acceptable increments of bidding can vary dynamically during the bidding process and can take into account a public minimum acceptable price and/or an "unseen reserve price" for each item being auctioned.
  • LARsponders and a venue's LAR-System can also enable other types of bidding, interactive and responsive actions using various methods and apparatus described herein.
  • Automated Auction Stations can be located in store windows, corridors, aisles, entry-ways etc.
  • Additional video displays and arrays of video picture frames 2520 can show on-auction items to potential bidders who are not in the immediate vicinity of a Station.
  • 2530 illustrates a LAR-Reader and Illuminator mounted separately from a display (not shown). Such assemblies can be associated with other venue light sources for aesthetic or other reasons.
  • LAR-System controlled flashing tag-lights Items not located at an Auction Station but nevertheless going "on the block” can be high-lighted by LAR- System controlled flashing tag-lights. They can, for example, be placed on hangers 2550; on objects; on tables 2560 and shelves. These can be battery- powered and wirelessly connected to the LAR-System. Such powered lighted tags can carry LARcodes or themselves be in the form of LARcodes comprised of illuminated color-coded regions interpretable by LAR-Readers.
  • Digital displays or highlighted photos of an item on auction can be positioned within view of potential bidders 2570 who are not near a Station. Their LARsponder Bids can be read by LAR-Reader Module assemblies such as in 2530, 2540, and 2570.
  • LAR-Reader Modules e.g. mounted as in 2540
  • Auction participants/bidders and their LARsponder can be indicated via signs, floor stripes, lighting etc.
  • Start of periodic or "surprise” AUCTION ACTION in a venue can be signaled by flashing signs, sound and light effects, PA announcements etc.
  • auction current high-bidder holders and/or final winners can be high-lighted by servo-aimed lights or other methods since the physical location of any winner is available to the LAR-System from the LAR-Reader(s) viewing the winner's LARsponder.
  • Venue LAR-System software can offer numerous other features, attractions, and "entertaining" functions including but not limited to item, event, or user-tailored capabilities such as:
  • ⁇ ⁇ ⁇ Synthetic voices of auctioneers can be available to audiences via PA, wireless earphones, smart-phone apps etc.
  • ⁇ ⁇ ⁇ Animated images and/or computer-synthesized auctioneer "characters" or human surrogates can be displayed on Auction display screens
  • ⁇ ⁇ ⁇ Display and simultaneous participation in in-process auctions taking place elsewhere in the venue or in another venue) can be accommodated while a user is waiting in demarcated area for a different impending Auction to begin.
  • ⁇ ⁇ ⁇ A given LAR-Reader can be multiplexed to route an appropriately-coded Paddle's Bid signals to more than one auction.
  • ⁇ ⁇ ⁇ Real-time Bid status cues to 'bid NOW" etc. can be wirelessly relayed to a Paddle user via wireless local and/or personal audio channels assigned by the venue or can be conveyed via registered cellphones etc.
  • suggestions, guidance, and/or specific directions to closely-related items which can be found in-store or elsewhere can be conveyed to losing bidders. These suggestions can also include items scheduled to be auctioned subsequently or at some specific time in the future.
  • LOCATE elements in LARsponder and/or LARcodes can, themselves, convey responses via user manipulation of the Element's "pose" in 3D-space and time.
  • LOCATE elements are Elements 1402, 1406, 1404 in Figure 14, Element 1520 in Figure 15, and Element 2016 in Figure 20.
  • One prominent or principal vector direction axis is typically very apparent in these types of Elements or can be made so by adding graphic or structural features. Orienting such a Locate Element with a principal vector axis posed up/down, left/right, at an angle etc. and/or the user causing motions or position displacements of a principal axis or other axes comprises a considerable repertoire of response behaviors.
  • While the emphasis here is on Locate Elements typified by the examples listed above, triads of vector directions (as in 3 axis rectilinear coordinate systems) can provide more extensive repertoires of response signaling options as discussed elsewhere herein.
  • accompanying color code data may be minimal or may not be required.
  • the "scene-ambient brightness levels" i.e., areas not at retro-reflective brightness"
  • This can enable retro-reflective areas to be relatively larger for a given overall size of LARsponder.
  • This in turn, can permit a significantly larger area venue and audience size to be serviced by a single LAR-Reader with a given image resolution.
  • several thousand venue seats can be covered per Reader compared to several hundred seats per Reader as in the illustrative example presented in Section D.05.5.
  • Retro-reflective coded areas can be used as components of LARsponders and/or LARcodes.
  • LARsponders using RR "LOCATE" shapes, graphics, or other design features have been described earlier.
  • methods and apparatus are disclosed which retain the general repertoire of response modes described above in F.01 , but which, in addition, can optionally provide other capabilities, notably the binary encoding of data such as User IDs, user special privileges, Responder validity limitations, etc. all of which can be carried on the LARsponder and all of which can be located and read by LAR-Readers at long stand-offs.
  • Figure 26 shows several LARsponders in an area 2600.
  • 2610 illustrates an example of a binary-coded LARsponder according to the teachings herein. Note the inherent shape-defined principal vector of the paddle-like LARsponder. Other principal vector shapes, among many, have already been mentioned.
  • the LARsponder shown can be a surface that is entirely retro-reflective. The surface can carry an array of blacked-out blocks making up, for example, the binary code for the ID number 872,749.
  • the black block "1 's" can be laser-printed using ordinary black or other opaque pigment toner that adheres to and covers/obscures the glass micro-bead reflectors. (Typical ink-jet inks do not adhere.).
  • Certain RR microsphere (and/or micro-prism type RR) sheets and tapes are supplied faced with a transparent film that is bonded to the RR layer 2612 in such a way (e.g. not in intimate contact with the microspheres) that their RR properties are not significantly degraded.
  • Roadstar Reflective Material Co.,Ltd. is one source of such materials.
  • These particular types of RR's can be coded by applying pigments or inks for which the overlying layer is (or can be made) what the art terms "receptive" (to color).
  • 2620 shows an alternative method of binary block coding offering certain aesthetic and novel security advantages can be used to encode data on retro-reflectors that are fabricated by allowing micro-spheres to partially protrude out of the retro-reflective surface.
  • 3M RR sheet and tapes Type 8830 are examples of this type of material.
  • overprinting code blocks (or other graphics) on the RR surface 2622 can be done with a clear pigment carrier (such as used for laser pigments but without the pigment particles). In 2620, this is represented by the lightly dotted patterns. Other graphical features, art, etc. can be printed in a similar manner.
  • any adherent clear over-coatings with indices of refraction high enough to severely alter the normally desired microsphere glass/air refraction effects can be used. Any such over-coated areas will appear very dark and easily readable by an imager dependent upon receiving retro-reflected light but will appear as clear un-coded areas under general ambient illumination.
  • Another useful capability of the coding method just described is its ability to allow another and non-retro- reflective color code to occupy the same area as the over-printed RR code.
  • the former is encoded using transparent color gels, dyes or inks on a thin transparent layer overlying the RR but not in intimate contact with it thus allowing the air/microsphere refraction effects to be maintained
  • 2630 portrays another example of a Reflective LARsponder shape with an obvious principal vector axis 2634.
  • the binary code blocks are positioned to make efficient use of the available LARsponder RR area 2632.
  • the RR shape and its fabrication method shown cuts, along separator or cut lines 2636, the LARsponders from a roll of RR tape material 2632 with near-zero waste. Both opaque pigment (represented in black) and clear over-print coding examples are shown.
  • 2640 shows a production method using printing (e.g. laser) on an RR tape 2642 where, in the three left-hand examples shown, the principal vector axes 2644 are made evident by black (or other opaque) pigment coated areas plus (optionally) code element arrays "stacked" in triangular patterns. The latter allow inference of a vector axis direction for both participating users and for the system's image analysis/decoding software.
  • the two right-hand examples in 2640 show the use of straight "Guillotine" cut lines 2646 which are simple to automate and very effective in conserving RR material. Use of clear-overprinting which is nearly invisible to a casual observer defines a vector axis in RR light.
  • Such areas can display color texts, color codes, Ads and/or other graphics if these are printed on a carrier film arranged to be slightly air-spaced off of the RR micro-spheres, micro-prisms etc. Two typical examples of ordinary opaque overprinted arrows 2648 for user guidance are also shown.
  • any of the above described methods adapt well to high-speed printing. Furthermore, they can exploit existing high speed product labeling technologies and can easily accommodate changes of active RR shapes etc which can be read by imagers and used for a variety of purposes (e.g. distinguishing different groups of users in a single venue or otherwise and/or for conveying other information such as expiration dates, limitations on use, event types etc.
  • silk-screening technologies may be a method of choice for production of the above- described and for other forms/features of LARsponders mentioned previously in other Sections of this Disclosure
  • Add-on methods using RR stickers and/or decals can also be used to carry information in the forms described and can be a method of choice notably in comparatively short-run production of RRLARsponders.
  • the methods and apparatus described above can assign codes to individual LARsponders that are unique to the individual users thereof and/or can signal membership in defined groups, teams or other criteria/qualifications for association and/or for participation in a given event or events. These codes can be read along with the
  • Selective live-feeds of the challenges, predictions, results, answers, choices, etc. made by or to the primary live-venue audience using Responders can also be electronically reported, e.g. via internet, WiFi , video, etc. to other venues including Stadiums, theaters, Casinos, Sports-Bars, etc.
  • These remote venues can also be equipped with LAR-Readers and the audiences in such venues can be provided with Responders.
  • Responders can participate realtime and on almost equal footing in the happenings taking place in the primary originating site.
  • Multiple remote audiences can observe and timely engage in and respond to the same challenges seen by the primary in-venue live audience and/or other participating remote sites. This enables unique forms of real-time Crowd against Crowds competitions and other modes of direct event participation and input to distant events.
  • network or other transmission delays from the originating site to the remote sites are significant to some forms of inter-venue competitions, e.g. first to chose correctly, time-limits on picking an answer, predicting a race winner etc., these can be compensated by time-stamping the incoming challenges etc. to the remote sites, the timing of any cues or limits they are given to respond to such inputs and their subsequent response times.
  • time-stamping can be based upon widely available precision time signals broadcast by government agencies and other sources.
  • Real-time media coverage (Broadcast TV, Cable, Net-Casting, WI/FI, Smartphone Feeds/Apps, etc.) of the event is being provided to national or even international audiences among which are audiences who are gathered and watching in venues other than at the event site itself. These can be what otherwise might be "dark" stadiums, theaters, concert halls, city squares, etc.
  • the total capacity involved could be 10X or much more than the size of the originating venue.
  • Responders e.g. disposable versions
  • the Responders allow them to input massed opinions, answers etc. in the same sub-second (effectively instantaneous) manner that is available to the originating venue's Responder-equipped members of the "live" audience. Both live and remote audience inputs/choices can be instantly available for incorporation in the originating live coverage itself.
  • Another novel aspect of the above described methods and apparatus is an ability to organize and operate COMPETITIONS between venues.
  • Collective responses to questions, making choices from among options, choosing right answers among wrong answers, and signaling predictions, e.g. "who will score the most points in the last 3 minutes of the third quarter of the basketball game now going on in Miami?" etc. are all possible to answer en mass and can be quickly communicated using Responders.
  • Venues can be divided into teams and/or an entire venue population can be a team competing against another entire venue. Many forms of real-time contests can be implemented as entertainment.
  • Venue data and video displays as well as audio systems, real objects as moving targets etc. and various board-game moves etc. can present and/or be the basis of the competitions.
  • Responders of various types can carry code numbers that are unique to the specific user/owner. See 2610, for an example of this general class of Responders.
  • codes in binary as shown, or in other formats
  • the coded Responder can also qualify the user, e.g. signify pre-set credit limits, pre-determined bet sizes, etc. They can provide a basis for novel and exciting high-speed (essentially instantaneous) "High-Frequency” betting which can take place "on-cue” during many types of events.
  • Responders can be up-dated and coded with added Stickers giving access to specific transaction types/events/credit limits, validity dates etc.
  • HF Betting now open cues can take many forms: Flashing lights, video clocks, voice announcements, sirens etc. which can prompt bidding and/or wagering and similar actions by Responder users during an event.
  • a p re-registered audience member in a LAR-System-equipped venue can signal a pre-agreed size bet on, say, one of four different horses.
  • High Frequency (HF) Bets can be placed on a horse race ALREADY in progress as distinct from (and/or in addition to) the traditional bets laid down before the race starts. This can be done by presenting one of four orientations of the (e.g.) Responder type 2610 to a venue LAR-Reader on cue and holding it until e.g. a bright flash etc. signals "all bets acquired betting closed". (The bright flash can be the LAR-Reader's RR illuminator capturing an image showing the location and "pose" of the Responders held by participating users.)
  • the window open cues can be understood by bettors to mean that HF betting is now open for, e.g., four seconds, and will be triggered just as the lead horse passes the quarter pole.
  • HF Betting 'windows can be similarly opened again at several pre-announced later points in the same race, such as at the half and the three quarter poles.
  • HF Betting windows can be opened at various times and/or for appropriate durations and especially at times when the games become particularly exciting, e.g. the last quarter of a basketball game or the last 36 laps of the Indy 500 etc.
  • HF Betting "action" does not require that the pre-qualified bettors be physically at the event.
  • Video or other types of coverage can be used to implement HF Betting in Casinos, SportsBars, etc. equipped with LAR-Readers.
  • LAR-System equipped venues can offer opportunities for private personalized fan VS fan or group VS group betting and interactions even if the fans are not seated in close proximity.
  • Seat 36C can bet against Seat 127G or the DELTA Frat can bet against the ALPHA Frat and records of results reported by the local Venue System post-facto. It would seem possible that private bets/wagers of this type may not require making use of typical government-regulated communications channels.

Landscapes

  • Business, Economics & Management (AREA)
  • Engineering & Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Theoretical Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Game Theory and Decision Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Image Processing (AREA)

Abstract

Dans un mode et une forme de réalisation, l'invention concerne un procédé et un appareil de participation d'audience permettant à des membres d'une audience de masse qui sont physiquement présents dans un lieu de réunion de transmettre, lorsqu'ils y sont invités, des données quantitatives quant à leurs préférences, choix et opinions personnels, individuels et collectifs en temps réel, ainsi que d'autres réponses personnelles concernant des événements se tenant dans le lieu de réunion ou d'une autre manière, à des systèmes de traitement de données d'images numériques, à des bases de données et à des moyens de transmission de données, en montrant des dispositifs passifs de sources de données personnelles manipulés par l'utilisateur. Une multiplicité de tels dispositifs sont visibles dans le champ de visée d'un ou de plusieurs imageurs numériques associé(s) au lieu de réunion, lesquels permettent de collecter des images des dispositifs et de transmettre ces images à des programmes d'analyse d'image; les résultats d'analyse sont mis dans les plus brefs délais à la disposition d'autres systèmes du lieu de réunion, tels que ceux utilisés pour des annonces et des affichages destinés à des audiences du lieu de réunion, et peuvent aussi éventuellement être mis à la disposition de systèmes d'information destinés à des audiences ne se situant pas dans le lieu de réunion.
PCT/US2012/053532 2011-08-31 2012-08-31 Procédés et appareil de localisation, de lecture et de réponse de code utilisant un imageur WO2013033641A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP12826969.3A EP2751994A4 (fr) 2011-08-31 2012-08-31 Procédés et appareil de localisation, de lecture et de réponse de code utilisant un imageur

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201161575938P 2011-08-31 2011-08-31
US61/575,938 2011-08-31
US13/317,547 2011-10-20
US13/317,547 US20120274775A1 (en) 2010-10-20 2011-10-20 Imager-based code-locating, reading and response methods and apparatus

Publications (1)

Publication Number Publication Date
WO2013033641A1 true WO2013033641A1 (fr) 2013-03-07

Family

ID=47756931

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2012/053532 WO2013033641A1 (fr) 2011-08-31 2012-08-31 Procédés et appareil de localisation, de lecture et de réponse de code utilisant un imageur

Country Status (2)

Country Link
EP (1) EP2751994A4 (fr)
WO (1) WO2013033641A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111274834A (zh) * 2018-12-04 2020-06-12 西克股份公司 光学代码的读取
CN112804795A (zh) * 2019-11-14 2021-05-14 手持产品公司 用于闪烁控制的装置和方法
CN113242087A (zh) * 2021-05-28 2021-08-10 天津大学 一种基于复合码的测距与通信融合传输方法

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5210604A (en) * 1991-12-10 1993-05-11 Carpenter Loren C Method and apparatus for audience participation by electronic imaging
US20070117576A1 (en) * 2005-07-14 2007-05-24 Huston Charles D GPS Based Friend Location and Identification System and Method
US7593687B2 (en) * 2003-10-07 2009-09-22 Immersion Entertainment, Llc System and method for providing event spectators with audio/video signals pertaining to remote events
US20100153189A1 (en) * 2008-12-17 2010-06-17 Noah Labe Dudley Method and apparatus for processing responses from a remote, live audience

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5210604A (en) * 1991-12-10 1993-05-11 Carpenter Loren C Method and apparatus for audience participation by electronic imaging
US7593687B2 (en) * 2003-10-07 2009-09-22 Immersion Entertainment, Llc System and method for providing event spectators with audio/video signals pertaining to remote events
US20070117576A1 (en) * 2005-07-14 2007-05-24 Huston Charles D GPS Based Friend Location and Identification System and Method
US20100153189A1 (en) * 2008-12-17 2010-06-17 Noah Labe Dudley Method and apparatus for processing responses from a remote, live audience

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
MAYNES-AMINZADE ET AL.: "Techniques for Interactive Audience Participation.", PROCEEDINGS OF THE 4TH IEEE INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES, 2002, XP010624286, Retrieved from the Internet <URL:http://www.monzy.org/audience/ICMI-2002-finalpub.pdf> [retrieved on 20121220] *
MAYNES-AMINZADE.: "Techniques for Interactive Audience Participation.", PROCEEDINGS OF THE 4TH IEEE INTERNATIONAL CONFERENCE ON MULTIMODAL INTERFACES, 2002, XP010624286, Retrieved from the Internet <URL:http://dl.acm.org/citation.cfm?id=847725> [retrieved on 20121220] *
See also references of EP2751994A4 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111274834A (zh) * 2018-12-04 2020-06-12 西克股份公司 光学代码的读取
CN111274834B (zh) * 2018-12-04 2023-04-14 西克股份公司 光学代码的读取
CN112804795A (zh) * 2019-11-14 2021-05-14 手持产品公司 用于闪烁控制的装置和方法
CN112804795B (zh) * 2019-11-14 2024-01-05 手持产品公司 用于闪烁控制的装置和方法
CN113242087A (zh) * 2021-05-28 2021-08-10 天津大学 一种基于复合码的测距与通信融合传输方法
CN113242087B (zh) * 2021-05-28 2022-10-14 天津大学 一种基于复合码的测距与通信融合传输方法

Also Published As

Publication number Publication date
EP2751994A4 (fr) 2015-01-28
EP2751994A1 (fr) 2014-07-09

Similar Documents

Publication Publication Date Title
US20120274775A1 (en) Imager-based code-locating, reading and response methods and apparatus
US11648465B1 (en) Gaming device for controllably viewing secret messages
US11224796B1 (en) Physical-virtual game board and content delivery system
Smith et al. Experiential marketing: Secrets, strategies, and success stories from the World's greatest brands
JP7382617B2 (ja) 光ナローキャスティングを用いたソーシャルメディア
US11983975B2 (en) System and method for tracking users or objects and providing associated data or features corresponding thereto
US10613699B2 (en) Multi-view display cueing, prompting, and previewing
CN108474929A (zh) 光学窄播
US9338622B2 (en) Contextually intelligent communication systems and processes
US20180357981A1 (en) Coordinated multi-view display experiences
Schroeder Startup rising: The entrepreneurial revolution remaking the Middle East
US20180329511A1 (en) Interactive Object Tracking Mirror-Display and Entertainment System
CN107343392A (zh) 显示方法以及显示装置
CN103946732A (zh) 基于对透视、近眼显示器的传感器输入的视频显示修改
JP7092360B2 (ja) ゲームシステムおよび光ナローキャスティングを使用する方法
CN106850528A (zh) 媒体系统与方法
EP2556483A1 (fr) Système de service et de gestion de restaurant
US20060258457A1 (en) Enhancement of collective experience
US20180256980A1 (en) Media system and method
US20200410540A1 (en) Hovering promotional advertisement apparatuses, systems, and methods of use thereof
CN110011731A (zh) 用于平铺自由空间光学传输的系统和方法
JP5360340B2 (ja) 空間情報関連物を携えた「平面画像情報が、目前に迫る５感覚立体化情報処理関連物生成方法」
WO2013033641A1 (fr) Procédés et appareil de localisation, de lecture et de réponse de code utilisant un imageur
Priestnall et al. Understanding visitor interaction with a projection augmented relief model display: insights from an in-the-wild study in the English Lake District
KR20170012839A (ko) Ict 기술을 연동한 사용자 체험 기반 디지털 융복합 테마파크 운영시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12826969

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2012826969

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2012826969

Country of ref document: EP