WO2013120064A1 - System and method for sending messages to a user in a capture environment - Google Patents

System and method for sending messages to a user in a capture environment Download PDF

Info

Publication number
WO2013120064A1
WO2013120064A1 PCT/US2013/025550 US2013025550W WO2013120064A1 WO 2013120064 A1 WO2013120064 A1 WO 2013120064A1 US 2013025550 W US2013025550 W US 2013025550W WO 2013120064 A1 WO2013120064 A1 WO 2013120064A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
code
data
information
ctis
Prior art date
Application number
PCT/US2013/025550
Other languages
French (fr)
Inventor
Nathaniel T. BRADLEY
Jim G. CRAWFORD
Joshua S. PAUGH
Douglas F. Bender
Original Assignee
Augme Technologies Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US201261597405P priority Critical
Priority to US61/597,405 priority
Application filed by Augme Technologies Inc. filed Critical Augme Technologies Inc.
Publication of WO2013120064A1 publication Critical patent/WO2013120064A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/00624Recognising scenes, i.e. recognition of a whole field of perception; recognising scene-specific objects
    • G06K9/00664Recognising scenes such as could be captured by a camera operated by a pedestrian or robot, including objects at substantially different ranges from the camera
    • G06K9/00671Recognising scenes such as could be captured by a camera operated by a pedestrian or robot, including objects at substantially different ranges from the camera for providing information about objects in the scene to a user, e.g. as in augmented reality applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/10Office automation, e.g. computer aided management of electronic mail or groupware; Time management, e.g. calendars, reminders, meetings or time accounting

Abstract

The system and method for sending a confirmation of a user action that occurs in a capture environment, which provides a way for users to receive information from capture environments. The methods and systems allow users to interact with artifacts in capture environments, and receive information about these artifacts. The capture environment can be a 3-D environment, a 3-D virtual reality environment, or a 2-D environment. A user can interact with a capture environment using their digital device, and then capture data from artifacts of interest within the capture environment. This data is then communicated to a data repository or server, which acts upon the captured data, and returns a reply response to the user's digital device.

Description

Title:

[001] SYSTEM AND METHOD FOR SENDING MESSAGES TO A USER IN A CAPTURE ENVIRONMENT

Background of the Invention

[002] The present invention relates generally to systems and method for sending messages or information to user and more specifically, the present invention relates to sending messages or information to user in a 2-D or 3-D environment.

[003] 2-D environments are the computer-based generation of digital images— mostly from two-dimensional models (such as 2D geometric models, text, and digital images). Virtual reality is a computer-simulated environment that can simulate physical presence in places in the real world, as well as in imaginary worlds. Most current virtual reality environments are primarily visual experiences, displayed either on a computer screen or through special stereoscopic displays, but some simulations include additional sensory information, such as sound through speakers or headphones. Some advanced, haptic systems now include tactile information, generally known as force feedback, in medical and gaming applications.

[004] The simplest form of virtual reality is a 3-D image that can be explored interactively at a personal computer, televisions, or digital device, usually by manipulating keys or the mouse so that the content of the image moves in some direction or zooms in or out. More sophisticated efforts involve such approaches as wrap-around display screens, actual rooms augmented with wearable computers, and haptics devices that let you feel the display images.

[005] Virtual reality can be divided into: (1) The simulation of a real environment for training and education; and (2) the development of an imagined environment for a game or interactive story. Popular products for creating virtual reality effects on personal computers include Bryce, Extreme 3D, Ray Dream Studio, trueSpace, 3D Studio MAX, and Visual Reality. The Virtual Reality Modelling Language (VRML) allows the creator to specify images and the rules for their display and interaction using textual language statements.

[006] Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data. It is related to a more general concept called mediated reality, in which a view of reality is modified (possibly even diminished rather than augmented) by a computer. As a result, the technology functions by enhancing one's current perception of reality. Hardware components for augmented reality are: processor, display, sensors and input devices. Modern mobile computing devices like smartphones and tablet computers contain these elements which often include a camera and MEMS sensors such as accelerometer, GPS, and solid state compass, making them suitable AR platforms

[007] While products and services may be displayed in virtual environments, 3D environments, or 2D environments, users do not have the ability to receive information on the products or services displayed in the virtual environments, 3D environments, or 2D environments. The present invention attempts to solve these problems as well as others.

Summary of the Invention

[008] Methods and systems are provided herein for sending a confirmation of a user action that occurs in a capture environment. This provides a novel way for users to receive information from capture environments. The methods and systems allow users to interact with artifacts in capture environments, and receive information about these artifacts. The capture environment can be a 3- D environment, a 3-D virtual reality environment, or a 2-D environment. A user can interact with a capture environment using their digital device, and then capture data from artifacts of interest within the capture environment. This data is then communicated to a data repository or server, which acts upon the captured data, and returns a reply response to the user's digital device.

[009] A data capture system allows users to engage ("scan") artifacts in the capture

environment. In some embodiments, the data capture system is a multi-modal image recognition application. This application allows for the capture of data about artifacts within the

environment. The captured data can be representative of a sensory input, or be digitally encoded information. The digitally encoded data could represent a barcode, a 2D code, a matrix code, a data matrix, a QR code, or other such symbologies. Captured data may alternatively be representative of a pure image, the selection of an internet link by the user, detection of an RFID tag, an NFC tag, a software input, or the like.

[010] In some embodiments, the captured data is coupled with a variety of other information prior to communication to a data repository. This information may include, without limitation, a user ID, a hardware ID, a geocode, a timestamp, a subject code, a source code, a content code, and/or a capture environment code. A user ID may uniquely identify the user within the data repository, and relate to a user-created profile within the repository. The user's digital device may also provide a hardware ID, which would identify the capabilities and nature of the digital device to the repository. The digital device may further be capable of generating or connecting a geocode with the captured data. The geocode could be based upon location information collected from a variety of sources. The digital device could include a GPS system, capable of outputting the user's current and/or past physical location. Alternatively, in some embodiments where the digital device is a smartphone, a connected wireless network may allow triangulation of the user's current and/or past location(s). Similarly a timestamp may be associated with captured data. Code components may also be connected to the captured data, providing a subject code supplying context for the captured data, a source code indicating where the captured data was located, and/or a content code indicating any particular response that the user desires. An environment code may also be attached to the captured data, indicating the type of capture environment, which may impact the response generated by the data repository.

[Oil] The captured data is then communicated to a data repository. The data repository receives and processes the captured data. In some embodiments, the data repository is a code triggered information server ("CTIS") database. The CTIS database may, depending on the particular implementation of the embodiments, communicate with a third party provider's server or database. Through processing, the repository interprets the communicated data and compares it against the database. After analysis and comparison, the repository generates a response that addresses the communicated data. This response is then communicated from the repository to the user's digital device. The response is then available for utilization by the user.

[012] There exist numerous methods through which data may be communicated between the user's digital device and the data repository. In some embodiments, communication is achieved through the Short Messaging Service ("SMS") protocol. Alternatively, without limitation, communication could be achieved by Multimedia Messaging Service ("MMS") protocol, instant messaging, web browser based messaging, email, Enhanced Messaging System ("EMS"), TCP/IP, WAP, and/or the like. The communication protocol employed will depend on the particular elements and purposes of the relevant embodiments.

[013] In one embodiment, a user is at Starbucks and uses their smartphone to interact with a specially featured Starbucks coffee cup. Pointing their smartphone at the coffee cup, a 3-D image of the coffee cup registers in a 3-D capture environment. Through a supported multi-modal image recognition application, the user engages with the 3-D image. This engagement generates a Scan Message, which is sent to a CTIS, via the smartphone's wireless data connection. The CTIS receives and recognizes the Scan Message, and compares the content of the message with the appropriate user profile to determine the relevant Reply Message. In this instance, the CTIS communicates with a 3rd party server, and selects an available coupon to send to the user. The coupon, either as a link or a downloadable artifact, is communicated to the user. The coupon or discount code could be used by a mobile payment system on the digital device. This

communication is preferably via SMS or MMS protocols, depending on the nature of the coupon. The user's smartphone receives the coupon, which the user then uses as payment for a free cup of coffee. In alternative embodiments, different artifacts of interest to the user could generate different response messages from the CTIS. For example, engaging with the image of a compact disc in the capture environment could generate a multimedia response giving the user access to an audio or video sample related to the compact disc.

[014] As used herein the terms "SMS" or "Ads" are intended to broadly include any type of information contained within a Reply Message (described hereinafter) that either prompts a user to take an action, or for a disposition on information provided, and/or provides information to a user relevant to the artifact or alternatives to the artifact.

[015] As used herein the term "artifact" is intended to include, without limitation, products, activities, services, print, visual, electronic or audible media, barcodes, brand names, product configurations, including, for example, packaging or container configurations, shapes or color combinations for products (e.g., pharmaceutical capsule color coding or pill shapes), video, body movements or gestures, olfactory scents, haptic or tactile stimuli, sound stimuli, and gustatory or taste stimuli.

Brief Description of the Drawings

[© ] The accompanying appendices and/or drawings illustrate various non-limiting, example, inventive aspects in accordance with the present disclosure:

[917] FIGS, la~c show combined logic and data flow block diagrams illustrating a general overview of embodiments of a Code Triggered Information Server (CTIS) for delivering

Reply/SMS messages;

[8 ] FIG, 2A shows a particular, exemplar}' embodiment of the GCSI/CTIS, wherein contextual information and a coupon is served to the user related to a coffee cup; FIG, 2B shows a particular, exemplary embodiment of the GCSI/CTIS, wherein contextual information is served to the user related to a finance and investment; [019] FIG, 3A shows user trajectories through a network of 3' party provider zones, and FIG. 3B shows user/avatar trajectories through a 3-D VR environment and 3rd party provider zones;

[020] FIG. 4 sho ws an embodiment of the web interface for user registration;

[1121] FIG. 5a shows different types of 2D barcodes that may be employed within the CTIS; FIGS. 5b-c show an implementation of logic flow for code enhancement in one embodiment of CTIS operation; FIG. 5d shows an implementation of logic flow for customized repair and/or decoding of obscure or ambiguous scanned codes;

{022] FIG. 6 shows an il lustration of one embodiment of the Scan Message data structure;

[023] FIG. 7a shows an illustration of one embodiment of a user profile data structure; and FIG. 7b shows an implementation of a user profile user interface in one embodiment of

GCSI/CTIS operation;

[824] FIG. 8 shows an il lustration of one embodiment of the Information Base data structure;

[025] FIG. 9 shows a logic flow diagram of one embodiment of the user profile query heuristic;

[026] FIG, 1(1 shows an exemplar}' histogram of 3rd party provider zone breaches;

[027] FIGS, lla-d show some embodiments of systems for selecting non-triggered information to serve to users;

[028] FIGS. 12a-b show examples of coupons provided by the CTIS;

[029] FIG, 13 shows a combined logic and data flow block diagram for an embodiment of the CTIS wherein contextual Reply/S S Message or Ads are replaced by Reply/SMS Message or Ads based on ambient conditions;

[030] FIG. J 4 shows a combined logic and data flow block diagram for a particular exemplary embodiment of the CTIS in which allergy medication Reply/SMS Message or Ads are served in response to a high pollen count;

[031] FIG, 15 shows a combined logic and data flow block diagram for a particular exemplary embodiment of the CTIS in which sunscreen Reply/SMS Message or Ads are served in response to heat and high UV levels;

[032] FIG, 16 shows a combined logic and data flow block diagram for an embodiment of the CTIS wherein the selection of contextual Reply/SMS Message or Ads is influenced by ambient conditions;

[033] FIG. J 7 shows a combined logic and data flow block diagram for a particular exemplary embodiment of the CTIS in which a Reply/SMS Message or Ad for a luxury convertible is served based on warm weather conditions, a scanned code, and the user profile;

[934] FIG, 18 shows a combined logic and data flow block diagram for a particular exemplary embodiment of the CTIS in which a Reply/SMS Message or Ad for Florida travel is served based on cold/rainy weather conditions, a sca ned code, and the user profile;

[035] FIG, 19 shows a combined logic and data flow block diagram for a particular exemplar}' embodiment of the CTIS in which a Reply/SMS Message or Ad for an ice cream shop is served based on warm weather conditions, a scanned code, and the user profile;

[036] FIG. 20 shows a combined logic and data flow block diagram for a particular exemplary embodiment of the CTIS in which a Reply/SMS Message or Ad for ponchos and umbrellas is served based on rainy weather conditions, a scanned code, and the user profile;

[037] FIG, 21 shows a combined logic and data flow block diagram for an embodiment of the CTIS wherein Reply/SMS Message or Ads are served to a User Agent device;

[038] FIG. 22 shows a combined logic and data flow block diagram for a particular exemplary embodiment of the CTIS in which a Reply/S S Message or Ad for a sports team's season tickets is served along with a pay-per-view event supplied directly to a user's cable box;

[939] FIG, 23 shows a combined logic and data flow block diagram for a particular exemplary embodiment of the CITS in which an Reply/S MS Message or Ad for virus scan subscription software is served;

[04Θ] FIG, 24 shows a computer systemization of the CTIS;

[041] FIG, 25 shows an implementation of a user interface manifesting GCSI/CTIS

functionality on a portable electronic device in one embodiment of GCSI/CTIS operation;

[1142] FIG. 26 shows an implementation of a user interface manifesting GCSI/CTIS

functionality on digital paper in one embodiment of GCSI/CTIS operation;

[043] FIG, 27 shows an implementation of a user interface manifesting GCSI functionality on a digital billboard in one embodiment of GCSI/CTIS operation;

[044] FIG. 28 shows a computer systemization of the GCSI/CTIS;

[045] FIG. 29 shows an implementation of a user interface manifesting GCSI CTIS

functionality on a portable electronic device in one embodiment of GCSI/CTIS operation;

[046] FIG, 30 shows an implementation of a user interface manifesting GCSI/CTIS

functionality on digital paper in one embodiment of GCSI/CTI S operation;

[1N7] FIG. 31 shows an illustration of media sampling and full media acquisition in one embodiment of GCSI/CTIS operation;

[948] FIGS, 32a~I> show an implementation of logic flow for code scan monetization in one embodiment of GCSI/CTIS operation;

[1149] FIGS, 33a-e show aspects of implementations of JagTag encoding and codes in some embodiments of GCS I/CTIS operation;

[050] FIG, 34 shows an implementation of a user i terface manifesting GCSI/CTIS

functionality on a portable communication device in one embodiment of GCS I/CTIS operation;

FIG. 35 shows a combined logic and data flow block diagram for a particular exemplary embodiment of the CTIS in which a Reply/SMS Message or Ad is served from a virtual help desk by user interaction in a 3D-VR environment; and

[052] FIG, 36a is a block diagram illustrating a CTIS configured to assign users havi g similar interests and situation information into dynamic groups according to an embodiment; and FIG, 36b is a block diagram illustrating a CTIS configured to identify profile elements that are related to specific content according to an embodiment.

DETAILED DESCRIPTION OF THE INVENTION DEFINITIONS & TERMINOLOGY

Servers, computers, clients, networks, routers

[053] Typically, users, which may be people and/or other systems, engage information technology systems (e.g., commonly computers) to facilitate information processing. In turn, computers employ processors to process information; such processors are often referred to as central processing units (CPU). A common form of processor is referred to as a microprocessor. CPUs use communicative signals to enable various operations. Such communicative signals may be stored and/or transmitted in batches as program and/or data components facilitate desired operations. These stored instruction code signals may engage the CPU circuit components to perform desired operations. A common type of program is a computer operating system, which, commonly, is executed by CPU on a computer; the operating system enables and facilitates users to access and operate computer information technology and resources. Common resources employed in information technology systems include: input and output mechanisms through which data may pass into and out of a computer; memory storage into which data may be saved; and processors by which information may be processed. Often information technology systems are used to collect data for later retrieval, analysis, and manipulation, commonly, which is facilitated through a database program. Information technology systems provide interfaces that allow users to access and operate various system components.

[054] In one embodiment, the code triggered information server controller 3401 may be connected to and/or communicate with entities such as, but not limited to: one or more users from user input devices 341 1 ; peripheral devices 3412; a cryptographic processor device 3428; and/or a communications network 3413, as shown in FIG. 34.

[055] Networks are commonly thought to comprise the interconnection and interoperation of clients, servers, and intermediary nodes in a graph topology. It should be noted that the term "server" as used throughout this disclosure refers generally to a computer, other device, program, or combination thereof that processes and responds to the requests of remote users across a communications network. Servers serve their information to requesting "clients." The term "client" as used herein refers generally to a computer, other device, program, or combination thereof that is capable of processing and making requests and obtaining and processing any responses from servers across a communications network. A computer, other device, program, or combination thereof that facilitates, processes information and requests, and/or furthers the passage of information from a source user to a destination user is commonly referred to as a "node." Networks are generally thought to facilitate the transfer of information from source points to destinations. A node specifically tasked with furthering the passage of information from a source to a destination is commonly called a "router." There are many forms of networks such as Local Area Networks (LANs), Pico networks, Wide Area Networks (WANs), Wireless Networks (WLANs), etc. For example, the Internet is generally accepted as being an

interconnection of a multitude of networks whereby remote clients and servers may access and interoperate with one another.

[056] The code triggered information server controller 3401 may be based on common computer systems that may comprise, but are not limited to, components such as: a computer systemization 3402 connected to memory 3429.

Computer Systemization

[057] A computer systemization 3402 may comprise a clock 3430, central processing unit (CPU) 3403, a read only memory (ROM) 3406, a random access memory (RAM) 3405, and/or an interface bus 3407, and most frequently, although not necessarily, are all interconnected and/or communicating through a system bus 3404, as shown in FIG. 34. Optionally, the computer systemization may be connected to an internal power source 3486. Optionally, a cryptographic processor 3426 may be connected to the system bus. The system clock typically has a crystal oscillator and provides a base signal. The clock is typically coupled to the system bus and various clock multipliers that will increase or decrease the base operating frequency for other components interconnected in the computer systemization. The clock and various components in a computer systemization drive signals embodying information throughout the system. Such transmission and reception of signals embodying information throughout a computer systemization may be commonly referred to as communications. These communicative signals may further be transmitted, received, and the cause of return and/or reply signal communications beyond the instant computer systemization to: communications networks, input devices, other computer systemizations, peripheral devices, and/or the like. Of course, any of the above components may be connected directly to one another, connected to the CPU, and/or organized in numerous variations employed as exemplified by various computer systems.

[058] The CPU comprises at least one high-speed data processor adequate to execute program components for executing user and/or system-generated requests. The CPU may be a

microprocessor such as AMD's Athlon, Duron and/or Opteron; IBM and/or Motorola's PowerPC; IBM's and Sony's Cell processor; Intel's Celeron, Itanium, Pentium, Xeon, and/or XScale; and/or the like processor(s). The CPU interacts with memory through signal passing through conductive conduits to execute stored signal program code according to conventional data processing techniques. Such signal passing facilitates communication within the code triggered information server controller and beyond through various interfaces. Should processing requirements dictate a greater amount speed, parallel, mainframe and/or super-computer architectures may similarly be employed. Alternatively, should deployment requirements dictate greater portability, smaller Personal Digital Assistants (PDAs) may be employed.

Power Source

[059] The power source 3486 may be of any standard form for powering small electronic circuit board devices such as the following power cells: alkaline, lithium hydride, lithium ion, lithium polymer, nickel cadmium, solar cells, and/or the like, as shown in FIG. 34. Other types of AC or DC power sources may be used as well. In the case of solar cells, in one embodiment, the case provides an aperture through which the solar cell may capture photonic energy. The power cell 3486 is connected to at least one of the interconnected subsequent components of the code triggered information server thereby providing an electric current to all subsequent components. In one example, the power source 3486 is connected to the system bus component 3404. In an alternative embodiment, an outside power source 3486 is provided through a connection across the I/O interface 3408. For example, a USB and/or IEEE 1394 connection carries both data and power across the connection and is therefore a suitable source of power.

Interface Adapters

[060] Interface bus(ses) 3407 may accept, connect, and/or communicate to a number of interface adapters, conventionally although not necessarily in the form of adapter cards, such as but not limited to: input output interfaces (I/O) 3408, storage interfaces 3409, network interfaces 3410, and/or the like, as shown in FIG. 34. Optionally, cryptographic processor interfaces 3427 similarly may be connected to the interface bus. The interface bus provides for the

communications of interface adapters with one another as well as with other components of the computer systemization. Interface adapters are adapted for a compatible interface bus. Interface adapters conventionally connect to the interface bus via a slot architecture. Conventional slot architectures may be employed, such as, but not limited to: Accelerated Graphics Port (AGP), Card Bus, (Extended) Industry Standard Architecture ((E)ISA), Micro Channel Architecture (MCA), NuBus, Peripheral Component Interconnect (Extended) (PCI(X)), PCI Express, Personal Computer Memory Card International Association (PCMCIA), and/or the like.

[061] Storage interfaces 3409 may accept, communicate, and/or connect to a number of storage devices such as, but not limited to: storage devices 3414, removable disc devices, and/or the like. Storage interfaces may employ connection protocols such as, but not limited to: (Ultra) (Serial) Advanced Technology Attachment (Packet Interface) ((Ultra) (Serial) ATA(PI)), (Enhanced) Integrated Drive Electronics ((E)IDE), Institute of Electrical and Electronics Engineers (IEEE) 1394, fiber channel, Small Computer Systems Interface (SCSI), Universal Serial Bus (USB), and/or the like.

[062] Network interfaces 3410 may accept, communicate, and/or connect to a communications network 3413. Through a communications network 3413, the code triggered information server controller is accessible through remote clients 3433b (e.g., computers with web browsers) by users 3433a. Network interfaces may employ connection protocols such as, but not limited to: direct connect, Ethernet (thick, thin, twisted pair 10/100/1000 Base T, and/or the like), Token Ring, wireless connection such as IEEE 802.1 la-x, and/or the like. A communications network may be any one and/or the combination of the following: a direct interconnection; the Internet; a Local Area Network (LAN); a Metropolitan Area Network (MAN); an Operating Missions as Nodes on the Internet (OMNI); a secured custom connection; a Wide Area Network (WAN); a wireless network (e.g., employing protocols such as, but not limited to a Wireless Application Protocol (WAP), I-mode, and/or the like); and/or the like. A network interface may be regarded as a specialized form of an input output interface. Further, multiple network interfaces 3410 may be used to engage with various communications network types 3413. For example, multiple network interfaces may be employed to allow for the communication over broadcast, multicast, and/or unicast networks.

[063] Input Output interfaces (I/O) 3408 may accept, communicate, and/or connect to user input devices 3411, peripheral devices 3412, cryptographic processor devices 3428, and/or the like. I/O may employ connection protocols such as, but not limited to: Apple Desktop Bus (ADB); Apple Desktop Connector (ADC); audio: analog, digital, monaural, RCA, stereo, and/or the like; IEEE 1394a-b; infrared; joystick; keyboard; midi; optical; PC AT; PS/2; parallel; radio; serial; USB; video interface: BNC, coaxial, composite, digital, Digital Visual Interface (DVI), RCA, RF antennae, S-Video, VGA, and/or the like; wireless; and/or the like. A common output device is a television set, which accepts signals from a video interface. Also, a video display, which typically comprises a Cathode Ray Tube (CRT) or Liquid Crystal Display (LCD) based monitor with an interface (e.g., DVI circuitry and cable) that accepts signals from a video interface, may be used. The video interface composites information generated by a computer systemization and generates video signals based on the composited information in a video memory frame. Typically, the video interface provides the composited video information through a video connection interface that accepts a video display interface (e.g., an RCA composite video connector accepting an RCA composite video cable; a DVI connector accepting a DVI display cable, etc.).

[064] User input devices 3411 may be card readers, dongles, finger print readers, gloves, graphics tablets, joysticks, keyboards, mouse (mice), remote controls, retina readers, trackballs, trackpads, and/or the like.

[065] Peripheral devices 3412 may be connected and/or communicate to I/O and/or other facilities of the like such as network interfaces, storage interfaces, and/or the like. Peripheral devices may be audio devices, cameras, dongles (e.g., for copy protection, ensuring secure transactions with a digital signature, and/or the like), external processors (for added

functionality), goggles, microphones, monitors, network interfaces, printers, scanners, storage devices, video devices, video sources, visors, and/or the like.

[066] It should be noted that although user input devices and peripheral devices may be employed, the code triggered information server controller may be embodied as an embedded, dedicated, and/or monitor-less (i.e., headless) device, wherein access would be provided over a network interface connection.

[067] Cryptographic units such as, but not limited to, microcontrollers, processors 3426, interfaces 3427, and/or devices 3428 may be attached to, and/or communicate with the code triggered information server controller. A MC68HC16 microcontroller, commonly manufactured by Motorola Inc., may be used for and/or within cryptographic units. Equivalent microcontrollers and/or processors may also be used. The MC68HC16 microcontroller utilizes a 16-bit multiply- and-accumulate instruction in the 16 MHz configuration and requires less than one second to perform a 512-bit RSA private key operation. Cryptographic units support the authentication of communications from interacting agents, as well as allowing for anonymous transactions.

Cryptographic units may also be configured as part of CPU. Other commercially available specialized cryptographic processors include VLSI Technology's 33 MHz 6868 or Semaphore Communications' 40 MHz Roadrunner 184.

Memory

[068] Generally, any mechanization and/or embodiment allowing a processor to affect the storage and/or retrieval of information is regarded as memory 3429, as shown in FIG. 34.

However, memory is a fungible technology and resource, thus, any number of memory embodiments may be employed in lieu of or in concert with one another. It is to be understood that the code triggered information server controller and/or a computer systemization may employ various forms of memory 3429. For example, a computer systemization may be configured wherein the functionality of on-chip CPU memory (e.g., registers), RAM, ROM, and any other storage devices are provided by a paper punch tape or paper punch card mechanism; of course such an embodiment would result in an extremely slow rate of operation. In a typical configuration, memory 3429 will include ROM 3406, RAM 3405, and a storage device 3414. A storage device 3414 may be any conventional computer system storage. Storage devices may include a drum; a (fixed and/or removable) magnetic disk drive; a magneto-optical drive; an optical drive (i.e., CD ROM/RAM/Recordable (R), Rewritable (RW), DVD R/RW, etc.); an array of devices (e.g., Redundant Array of Independent Disks (RAID)); and/or other devices of the like. Thus, a computer systemization generally requires and makes use of memory.

Component Collection

[069] The memory 3429 may contain a collection of program and/or database components and/or data such as, but not limited to: operating system component(s) 3415 (operating system); information server component(s) 3416 (information server); user interface component(s) 3417 (user interface); Web browser component(s) 3418 (Web browser); database(s) 3419; mail server component(s) 3421 ; mail client component(s) 3422; cryptographic server component(s) 3420

(cryptographic server); the code triggered information server component(s) 3435; and/or the like (i.e., collectively a component collection), as shown in FIG. 34. These components may be stored and accessed from the storage devices and/or from storage devices accessible through an interface bus. Although non-conventional program components such as those in the component collection, typically, are stored in a local storage device 3414, they may also be loaded and/or stored in memory such as: peripheral devices, RAM, remote storage facilities through a communications network, ROM, various forms of memory, and/or the like.

Operating System

[070] The operating system component 3415 is an executable program component facilitating the operation of the code triggered information server controller, as shown in FIG. 34. Typically, the operating system facilitates access of I/O, network interfaces, peripheral devices, storage devices, and/or the like. The operating system may be a highly fault tolerant, scalable, and secure system such as Apple Macintosh OS X (Server), AT&T Plan 9, Be OS, Linux, Unix, and/or the like operating systems. However, more limited and/or less secure operating systems also may be employed such as Apple Macintosh OS, Microsoft DOS, Microsoft Windows

2000/2003/3. l/95/98/CE/Millenium/NTA^ista/XP (Server), Palm OS, and/or the like. An operating system may communicate to and/or with other components in a component collection, including itself, and/or the like. Most frequently, the operating system communicates with other program components, user interfaces, and/or the like. For example, the operating system may contain, communicate, generate, obtain, and/or provide program component, system, user, and/or data communications, requests, and/or responses. The operating system, once executed by the CPU, may enable the interaction with communications networks, data, I/O, peripheral devices, program components, memory, user input devices, and/or the like. The operating system may provide communications protocols that allow the code triggered information server controller to communicate with other entities through a communications network 3413. Various

communication protocols may be used by the code triggered information server system controller as a subcarrier transport mechanism for interaction, such as, but not limited to: multicast, TCP/IP, UDP, unicast, and/or the like.

[071] The operating system component 3415 may also be a mobile operating system, mobile OS, such as iOS (Apple), ANDROID, WINDOWS PHONE (Microsoft), WINDOWS PHONE 7 (Microsoft), BLACKBERRY OS (RIM), WebOS (Hewlett-Packard) , MEEGO or SYMBIAN, for example. The mobile OS may be a manufacture-built proprietary operating system, a third party proprietary, or an open source operating system. Mobile OS's are employed on a wide variety of mobile devices useful with the embodiments disclosed herein, such as smartphones and tablet computers, and the like.

Information Server

[072] An information server component 3416 is a stored program component that is executed by a CPU, as shown in FIG. 34. The information server may be a conventional Internet information server such as, but not limited to Apache Software Foundation's Apache, Microsoft's Internet Information Server, and/or the. The information server may allow for the execution of program components through facilities such as Active Server Page (ASP), ActiveX, (ANSI) (Objective-) C (++), C#, Common Gateway Interface (CGI) scripts, Java, JavaScript, Practical Extraction Report Language (PERL), Python, WebObjects, and/or the like. The information server may support secure communications protocols such as, but not limited to, File Transfer Protocol (FTP); HyperText Transfer Protocol (HTTP); Secure Hypertext Transfer Protocol (HTTPS), Secure Socket Layer (SSL), and/or the like. The information server provides results in the form of Web pages to Web browsers, and allows for the manipulated generation of the Web pages through interaction with other program components. After a Domain Name System (DNS) resolution portion of an HTTP request is resolved to a particular information server, the information server resolves requests for information at specified locations on the code triggered information server controller based on the remainder of the HTTP request. For example, a request such as http://123.124.125.126/myInformation.html might have the IP portion of the request "123.124.125.126" resolved by a DNS server to an information server at that IP address; that information server might in turn further parse the http request for the "/mylnformation.html" portion of the request and resolve it to a location in memory containing the information

"mylnformation.html." Additionally, other information serving protocols may be employed across various ports, e.g., FTP communications across port 21, and/or the like. An information server may communicate to and/or with other components in a component collection, including itself, and/or facilities of the like. Most frequently, the information server communicates with the code triggered information server database 3419, operating systems, other program components, user interfaces, Web browsers, and/or the like.

[073] Access to the code triggered information server database may be achieved through a number of database bridge mechanisms such as through scripting languages as enumerated below (e.g., CGI) and through inter-application communication channels as enumerated below (e.g., CORBA, WebObjects, etc.). Any data requests through a Web browser are parsed through the bridge mechanism into appropriate grammars as required by the code triggered information server. In one embodiment, the information server would provide a Web form accessible by a Web browser. Entries made into supplied fields in the Web form are tagged as having been entered into the particular fields, and parsed as such. The entered terms are then passed along with the field tags, which act to instruct the parser to generate queries directed to appropriate tables and/or fields. In one embodiment, the parser may generate queries in standard SQL by instantiating a search string with the proper join/select commands based on the tagged text entries, wherein the resulting command is provided over the bridge mechanism to the code triggered information server as a query. Upon generating query results from the query, the results are passed over the bridge mechanism, and may be parsed for formatting and generation of a new results Web page by the bridge mechanism. Such a new results Web page is then provided to the information server, which may supply it to the requesting Web browser.

[074] Also, an information server may contain, communicate, generate, obtain, and/or provide program component, system, user, and/or data communications, requests, and/or responses.

User Interface

[075] The function of computer interfaces in some respects is similar to automobile operation interfaces. Automobile operation interface elements such as steering wheels, gearshifts, and speedometers facilitate the access, operation, and display of automobile resources, functionality, and status. Computer interaction interface elements such as check boxes, cursors, menus, scrollers, and windows (collectively and commonly referred to as widgets) similarly facilitate the access, operation, and display of data and computer hardware and operating system resources, functionality, and status. Operation interfaces are commonly called user interfaces. Graphical user interfaces (GUIs) such as the Apple Macintosh Operating System's Aqua or Lion,

Microsoft's Windows XP, Windows 7 or Unix's X- Windows provide a baseline and means of accessing and displaying information graphically to users. Mobile OS's, discussed above, also typically employ GUIs, but may also be text-based, and provide user interfaces to mobile devices.

[076] A user interface component 3417, whether on a desktop or laptop computing device or a mobile device, is a stored program component that is executed by a CPU, as shown in FIG. 34. The user interface may be a conventional graphic user interface as provided by, with, and/or atop operating systems and/or operating environments such as those operating systems discussed above, and/or the like. The user interface may allow for the display, execution, interaction, manipulation, and/or operation of program components and/or system facilities through textual and/or graphical facilities. The user interface provides a facility through which users may affect, interact, and/or operate a computer system. A user interface may communicate to and/or with other components in a component collection, including itself, and/or facilities of the like. Most frequently, the user interface communicates with operating systems, other program components, and/or the like. The user interface may contain, communicate, generate, obtain, and/or provide program component, system, user, and/or data communications, requests, and/or responses.

Web Browser

[077] A Web browser component 3418 is a stored program component that is executed by a CPU, as shown in FIG. 34. The Web browser may be a conventional hypertext viewing application such as Microsoft Internet Explorer or Netscape Navigator. Secure Web browsing may be supplied with 128-bit (or greater) encryption by way of HTTPS, SSL, and/or the like. Some Web browsers allow for the execution of program components through facilities such as Java, JavaScript, ActiveX, and/or the like. Web browsers and like information access tools may be integrated into PDAs, cellular telephones, and/or other mobile devices. A Web browser may communicate to and/or with other components in a component collection, including itself, and/or facilities of the like. Most frequently, the Web browser communicates with information servers, operating systems, integrated program components (e.g., plug-ins), and/or the like; e.g., it may contain, communicate, generate, obtain, and/or provide program component, system, user, and/or data communications, requests, and/or responses. Of course, in place of a Web browser and information server, a combined application may be developed to perform similar functions of both. The combined application would similarly affect the obtaining and the provision of information to users, user agents, and/or the like from the code triggered information server enabled nodes. The combined application may be nugatory on systems employing standard Web browsers.

Mail Server

[078] A mail server component 3421 is a stored program component that is executed by a CPU 3403, as shown in FIG. 34. The mail server may be a conventional Internet mail server such as, but not limited to sendmail, Microsoft Exchange, and/or the like. The mail server may allow for the execution of program components through facilities such as ASP, ActiveX, (ANSI)

(Objective-) C (++), CGI scripts, Java, JavaScript, PERL, pipes, Python, WebObjects, and/or the like. The mail server may support communications protocols such as, but not limited to: Internet message access protocol (IMAP), Microsoft Exchange, post office protocol (POP3), simple mail transfer protocol (SMTP), and/or the like. The mail server can route, forward, and process incoming and outgoing mail messages that have been sent, relayed and/or otherwise traversing through and/or to the code triggered information server.

[079] Access to the code triggered information server mail may be achieved through a number of APIs offered by the individual Web server components and/or the operating system.

[080] Also, a mail server may contain, communicate, generate, obtain, and/or provide program component, system, user, and/or data communications, requests, information, and/or responses.

Mail Client

[081] A mail client component 3422 is a stored program component that is executed by a CPU 3403 or a web-based mail client, as shown in FIG. 34. The mail client may be a conventional mail viewing application such as Apple Mail, Microsoft Entourage, Microsoft Outlook,

Microsoft Outlook Express, Mozilla Thunderbird, Gmail, Hotmail and/or the like. Mail clients may support a number of transfer protocols, such as: IMAP, Microsoft Exchange, POP3, SMTP, and/or the like. A mail client may communicate to and/or with other components in a component collection, including itself, and/or facilities of the like. Most frequently, the mail client communicates with mail servers, operating systems, other mail clients, and/or the like; e.g., it may contain, communicate, generate, obtain, and/or provide program component, system, user, and/or data communications, requests, information, and/or responses. Generally, the mail client provides a facility to compose and transmit electronic mail messages.

Cryptographic Server

[082] A cryptographic server component 3420 is a stored program component that is executed by a CPU 3403, cryptographic processor 3426, cryptographic processor interface 3427, cryptographic processor device 3428, and/or the like, as shown in FIG. 34. Cryptographic processor interfaces will allow for expedition of encryption and/or decryption requests by the cryptographic component; however, the cryptographic component, alternatively, may run on a conventional CPU. The cryptographic component allows for the encryption and/or decryption of provided data. The cryptographic component allows for both symmetric and asymmetric (e.g., Pretty Good Protection (PGP)) encryption and/or decryption. The cryptographic component may employ cryptographic techniques such as, but not limited to: digital certificates (e.g., X.509 authentication framework), digital signatures, dual signatures, enveloping, password access protection, public key management, and/or the like. The cryptographic component will facilitate numerous (encryption and/or decryption) security protocols such as, but not limited to:

checksum, Data Encryption Standard (DES), Elliptical Curve Encryption (ECC), International Data Encryption Algorithm (IDEA), Message Digest 5 (MD5, which is a one way hash function), passwords, Rivest Cipher (RC5), Rijndael, RSA (which is an Internet encryption and authentication system that uses an algorithm developed in 1977 by Ron Rivest, Adi Shamir, and Leonard Adleman), Secure Hash Algorithm (SHA), Secure Socket Layer (SSL), Secure

Hypertext Transfer Protocol (HTTPS), and/or the like. Employing such encryption security protocols, the code triggered information server may encrypt all incoming and/or outgoing communications and may serve as node within a virtual private network (VPN) with a wider communications network. The cryptographic component facilitates the process of "security authorization" whereby access to a resource is inhibited by a security protocol wherein the cryptographic component effects authorized access to the secured resource. In addition, the cryptographic component may provide unique identifiers of content, e.g., employing an MD5 hash to obtain a unique signature for a digital audio file. A cryptographic component may communicate to and/or with other components in a component collection, including itself, and/or facilities of the like. The cryptographic component supports encryption schemes allowing for the secure transmission of information across a communications network to enable the code triggered information server component to engage in secure transactions if so desired. The cryptographic component facilitates the secure accessing of resources on the code triggered information server and facilitates the access of secured resources on remote systems; i.e., it may act as a client and/or server of secured resources. Most frequently, the cryptographic component communicates with information servers, operating systems, other program components, and/or the like. The cryptographic component may contain, communicate, generate, obtain, and/or provide program component, system, user, and/or data communications, requests, and/or responses.

The Code Triggered Information Server Database

[083] The code triggered information server database component 3419 may be embodied in a database and its stored data, as shown in FIG. 34. The database is a stored program component, which is executed by the CPU; the stored program component portion configuring the CPU to process the stored data. The database may be a conventional, fault tolerant, relational, scalable, secure database such as Oracle or Sybase. Relational databases are an extension of a flat file.

Relational databases consist of a series of related tables. The tables are interconnected via a key field. Use of the key field allows the combination of the tables by indexing against the key field; i.e., the key fields act as dimensional pivot points for combining information from various tables. Relationships generally identify links maintained between tables by matching primary keys.

Primary keys represent fields that uniquely identify the rows of a table in a relational database.

More precisely, they uniquely identify rows of a table on the "one" side of a one -to-many relationship.

[084] Alternatively, the code triggered information server database may be implemented using various standard data-structures, such as an array, hash, (linked) list, struct, structured text file (e.g., XML), table, and/or the like. Such data-structures may be stored in memory and/or in (structured) files. In another alternative, an object-oriented database may be used, such as Frontier, ObjectStore, Poet, Zope, and/or the like. Object databases can include a number of object collections that are grouped and/or linked together by common attributes; they may be related to other object collections by some common attributes. Object-oriented databases perform similarly to relational databases with the exception that objects are not just pieces of data but may have other types of functionality encapsulated within a given object. If the code triggered information server database is implemented as a data-structure, the use of the code triggered information server database 3419 may be integrated into another component such as the code triggered information server component 3435. Also, the database may be implemented as a mix of data structures, objects, and relational structures. Databases may be consolidated and/or distributed in countless variations through standard data processing techniques. Portions of databases, e.g., tables, may be exported and/or imported and thus decentralized and/or integrated.

[085] In one embodiment, the database component 3419 includes several tables 3419a,b. A user profile table 3419a includes fields such as, but not limited to: a user ID, name, email address, address, demographic profile, hardware ID, scan history record, scan statistics, and/or the like. The user profile table may support and/or track multiple entity accounts on a code triggered information server. An Information Base table 3419b includes fields such as, but not limited to: 3rd party provider ID, 3rd party ID, 3rd party preference content, preference labels, geographic tags, temporal tags, subject tags, preference ratings, preference statistics, and/or the like.

[086] In one embodiment, the code triggered information server database may interact with other database systems. For example, employing a distributed database system, queries and data access by OLBS modules may treat the combination of the code triggered information server database, an integrated data security layer database as a single database entity.

[087] In one embodiment, user programs may contain various user interface primitives, which may serve to update the code triggered information server. Also, various accounts may require custom database tables depending upon the environments and the types of clients the code triggered information server may need to serve. It should be noted that any unique fields may be designated as a key field throughout. In an alternative embodiment, these tables have been decentralized into their own databases and their respective database controllers (i.e., individual database controllers for each of the above tables). Employing standard data processing techniques, one may further distribute the databases over several computer systemizations and/or storage devices. Similarly, configurations of the decentralized database controllers may be varied by consolidating and/or distributing the various database components 3419a,b. The code triggered information server may be configured to keep track of various settings, inputs, and parameters via database controllers.

[088] The code triggered information server database may communicate to and/or with other components in a component collection, including itself, and/or facilities of the like. Most frequently, the code triggered information server database communicates with the code triggered information server component, other program components, and/or the like. The database may contain, retain, and provide information regarding other nodes and data.

The Code Triggered Information Server

[089] The code triggered information server component 3435 is a stored program component that is executed by a CPU, as shown in FIG. 34. The code triggered information server affects accessing, obtaining and the provision of information, preferences, services, transactions, and/or the like across various communications networks.

[090] The code triggered information server component enables the identification, generation, and aggregation of Scan Messages and Reply/SMS Messages.

[091] The code triggered information server component enabling access of information between nodes may be developed by employing standard development tools such as, but not limited to: (ANSI) (Objective-) C (++), Apache components, binary executables, database adapters, Java, JavaScript, mapping tools, procedural and object oriented development tools, PERL, Python, shell scripts, SQL commands, web application server extensions, WebObjects, and/or the like. In one embodiment, the code triggered information server employs a

cryptographic server to encrypt and decrypt communications. The code triggered information server component may communicate to and/or with other components in a component collection, including itself, and/or facilities of the like. Most frequently, the code triggered information server component communicates with the code triggered information server database, operating systems, other program components, and/or the like. The code triggered information server may contain, communicate, generate, obtain, and/or provide program component, system, user, and/or data communications, requests, preferences, and/or responses.

Distributed Code Triggered Information Server

[092] The structure and/or operation of any of the code triggered information server node controller components may be combined, consolidated, and/or distributed in any number of ways to facilitate development and/or deployment. Similarly, the component collection may be combined in any number of ways to facilitate deployment and/or development. To accomplish this, one may integrate the components into a common code base or in a facility that can dynamically load the components on demand in an integrated fashion. [093] The component collection may be consolidated and/or distributed in countless variations through standard data processing and/or development techniques. Multiple instances of any one of the program components in the program component collection may be instantiated on a single node, and/or across numerous nodes to improve performance through load-balancing and/or data-processing techniques. Furthermore, single instances may also be distributed across multiple controllers and/or storage devices; e.g., databases. All program component instances and controllers working in concert may do so through standard data processing communication techniques.

[094] The configuration of the code triggered information server controller will depend on the context of system deployment. Factors such as, but not limited to, the budget, capacity, location, and/or use of the underlying hardware resources may affect deployment requirements and configuration. Regardless of if the configuration results in more consolidated and/or integrated program components, results in a more distributed series of program components, and/or results in some combination between a consolidated and distributed configuration, data may be communicated, obtained, and/or provided. Instances of components consolidated into a common code base from the program component collection may communicate, obtain, and/or provide data. This may be accomplished through intra-application data processing communication techniques such as, but not limited to: data referencing (e.g., pointers), internal messaging, object instance variable communication, shared memory space, variable passing, and/or the like.

[095] If component collection components are discrete, separate, and/or external to one another, then communicating, obtaining, and/or providing data with and/or to other component components may be accomplished through inter-application data processing communication techniques such as, but not limited to: Application Program Interfaces (API) information passage; (distributed) Component Object Model ((D)COM), (Distributed) Object Linking and Embedding ((D)OLE), and/or the like), Common Object Request Broker Architecture (CORBA), process pipes, shared files, and/or the like. Messages sent between discrete component components for inter-application communication or within memory spaces of a singular component for intra-application communication may be facilitated through the creation and parsing of a grammar. A grammar may be developed by using standard development tools such as lex, yacc, XML, and/or the like, which allow for grammar generation and parsing

functionality, which in turn may form the basis of communication messages within and between components. Again, the configuration will depend upon the context of system deployment.

Code Triggered Information Server Controller

[096] FIG. 34 of the present disclosure illustrates inventive aspects of a code triggered information server controller 3401 in a block diagram. In this embodiment, the code triggered information server controller 3401 may serve to aggregate, process, store, search, serve, identify, instruct, generate, match, and/or update Scan Messages, Reply/SMS Messages, Ads, user profiles, and/or other related data.

SCAN AND REPLY/SMS MESSAGES

[097] In one embodiment, a code triggered information server ("CTIS") employs two basic actors: (i) a user (100a) capable of registering interest in an activity, product, or service in a 2-D, 3-D or a 3-D Virtual Reality (VR) environment or any capture environment, capturing, transmitting, and receiving data, and displaying information; and (ii) a server (101) capable of communicating with the user and/or 3rd party providers, storing/updating user profiles, and selecting information to serve to the user, as shown in FIG. la. In addition to the two basic actors, the CTIS enables the creation of two types of transactional articles: i) Scan Messages (115) and ii) Reply/SMS Messages (140). Scan Messages 115 can send to the server data captured by the user, activity of the user, or a product or service of interest to the user. The CTIS provides context-specific Reply/SMS Messages in response to Scan Messages, which are prepared in response to the registration of activity interest by the user and the Scan Message, in order to supply information and/or advertising to the user. The CTIS generates Reply/SMS

Messages by processing Scan Message content with user profile information, containing basic profiling data as well as a history of Scan Messages supplied by a given user. As such,

Reply/SMS Messages are transactional articles that heighten a 3rd party provider's opportunity to supply relevant and targeted information and/or advertising to the user that is both context and user specific. Without loss of generality, we will heretofore refer to the information and/or content as Reply/SMS Messages. The CTIS may also elect to send context and user-specific Reply/SMS Messages based solely on the user profile, without the user having recently registered activity interest, if it is determined from the user's profile, particularly the history of Scan Messages, that a particular Reply/SMS is appropriate. The Reply/SMS Message or Ad or Reply/SMS Message may include a SMS response, a URL to a mobile site, a coupon, and/a multi-media clip, a discount code, and/or the like, as further detailed below. The user may engage directly in a capture environment, where the capture environment may be any 2-D, 3-D, or 3-D VR environment to express interest, or the user may express interest on a system that is coupled to a 2-D, 3-D, or 3-D VR environment, or user may engage in a 2-D, 3-D, or 3-D VR environment on a digital device to express interest.

[098] The Reply/SMS message may be enabled by a mobile payment system. The mobile payment system may be Premium SMS based transactional payments, Direct Mobile Billing, Mobile web payments (WAP), or Contactless NFC (Near Field Communication). SMS based transactional payments are when the user sends a payment request via an SMS text message or an USSD to a short code and a premium charge is applied to their phone bill or their online wallet. The merchant involved is informed of the payment success and can then release the paid for goods. A Multimedia Messaging Service can also deliver barcodes which can then be scanned for confirmation of payment by a merchant. This is used as an electronic ticket for access to cinemas and events or to collect hard goods. Mobile web payments may use Direct operator billing, credit card, eWallets, SmartWallet, or online wallets. "Digital wallet" (also known as an e-wallet) is also increasingly being used to describe mobile phones, especially smartphones, that store an individual's credentials and utilize wireless technologies such as near field communication (NFC) to carry out financial transactions. Online wallets include PayPal, Amazon Payments and Google Checkout also has mobile options. NFC employs a special mobile phone equipped with a smartcard that is waved near a reader module. Most transactions do not require authentication, but some require authentication using PIN, before transaction is completed. The payment could be deducted from a pre-paid account or charged to a mobile or bank account directly. NFC may be employed by Google Wallet, Visa DPS, and the like.

[099] The data captured may be single mode or multi-modal data, and may consist, for example of any sensory-type input, e.g., visual, auditory, olfactory, haptics or gustatory. Visual inputs may consist of image capture, pattern recognition, text recognition, bar codes, such as UPC or QR codes, hand gestures, or the like. Auditory inputs may consist of music, sound recognition, sound pattern recognition, spoken word recognition, or the like. Olfactory inputs may consist of inputs from artificial noses, such as that described by Stitzel, S.E., et al. in Artificial Noses, Ann. Rev. Biomed. Eng. Vol. 13, 1-25 (Aug. 2011) or in U.S. Patent No. 7,261,857, gas

chromatographs or other instruments for detecting the presence of airborne elements. Tactile inputs may consist of data acquired by virtue of surface roughness measurements, such as by atomic force microscopy, by a tactile-sensing system such as that described by Decherchi, S., et al, IEEE Transactions on Robotics, 27(3), 635-639, June, 2011, or by tactile sensors as described in U.S. Patent No. 7,823,467, each of which is expressly incorporated by reference. Finally, gustatory, or the taste inputs, may be obtained by employing a taste sensor, such as that described in U.S. Patent No. 7,858,036 or the taste sensor data system described in U.S. Patent Application Publication No. 20040107053, each of which is expressly incorporated by reference. Thus, the data capture device 100b may be any device suitable for capturing sensory data from an artifact in which the user has interest and communicating captured sensory data to a computing device or server.

[0100] In one embodiment, the data capture device 100b may be in the proximity contact with the product of interest, such as Near Field Communications (NFC), Radio Frequency

Identification (RFID), Bluetooth, Infrared, Wireless communication, Automatic Identification and Data Capture (AIDC), and other short range communications and the like. AIDC refers to the methods of automatically identifying objects, collecting data about them, and entering that data directly into computer systems (i.e. without human involvement). Technologies typically considered as part of AIDC include bar codes, Radio Frequency Identification (RFID), biometrics, magnetic stripes, Optical Character Recognition (OCR), smart cards, and voice recognition. AIDC is the process or means of obtaining external data, particularly through analysis of images, sounds or videos. To capture data, a transducer is employed which converts the actual image or a sound into a digital file. The file is then stored and at a later time it can be analyzed by a computer, or compared with other files in a database to verify identity or to provide authorization to enter a secured system. Capturing of data can be done in various ways; the best method depends on application. AIDC also refers to the methods of recognizing objects, getting information about them and entering that data or feeding it directly into computer systems without any human involvement. Automatic identification and data capture technologies include barcodes, RFID, bokodes, OCR, magnetic stripes, smart cards and biometrics (like iris and facial recognition system).

SMS

[0101] In one implementation, the Scan Message and/or data captured from the artifact may be sent to the server (101) by a Short Messaging Service (SMS) protocol. In other implementations, a wide variety of other communication protocols may be employed for the Scan Message, including but not limited to: Multimedia Messaging Service (MMS), instant messaging, web browser based messaging, email, Enhanced Messaging System (EMS), TCP/IP, WAP, and/or the like. Similarly, the Reply/SMS Message may be sent from the server to the user's digital device by a SMS protocol, or in other implementations a wide variety of other communications protocols.

[0102] For illustration, Fig. 2A is a particular, exemplary embodiment: providing targeted and contextual information and/or advertising to the user related to a coffee coupon. Here, a user (200a) employs a digital device (200b) to engage in a 3-D environment (205). By pointing the digital device at a coffee cup (203), the coffee cup registers as a 3-D image in the 3-D

environment via a supported multi-modal image recognition application (206). The user then expresses interest in the image of the coffee cup in the 3-D environment, by "picking" the image (211). A Scan Message is composed and sent (220) from the digital device to the server (201), via the digital device's data connection. The Scan Message may include, without limitation, a user ID, a hardware ID, a geocode, a timestamp, a subject code, a source code, a content code, and/or the like. The server receives/recognizes the Scan Message (225), and queries a database of user profiles (230) based on the supplied user ID to update the appropriate user profile with the content of the current Scan Message and to determine what, if any, information in the user profile may be relevant to the preparation of the current Reply/SMS Message (235). In one embodiment, the user can supply a list of interests to be considered in addition to those culled from their scan history. The server selects the appropriate Reply/SMS Message or Ad content to include in the Reply/SMS Message, comprised in the exemplary embodiment of a contextual coupon (either a link or a downloadable artifact) for a free cup of coffee (236). The Reply/SMS Message or Ad content may be stored either on the media company or a 3rd party server. The server then prepares and sends (245) the Reply/SMS Message (240), which here includes a coupon for activation by the user, but could, without limitation, include text, URLs to mobile sites where the item of interest is featured, video clips of the item of interest, other multimedia content, software, downloadable artifacts, a phone number, a phone number automatically called by the user's digital device (when coupled to the user's call mechanism, etc.), any artifact which can be "picked" within the 3-D environment, and/or the like. The Reply/SMS Message is received and displayed (or other appropriate action is taken) by the user's digital device (250). Here, a coupon for a free cup of coffee is made available (either by downloadable artifact or link to the coupon), which the user then uses as payment for a cup of coffee (251). The coupon may be an electronic coupon or a coupon that is employed with a mobile payment system, such as Google Wallet and the like. In an alternative embodiment, user actions and responses take place in a 3-D VR environment. In the 3-D VR environment embodiment, the Reply/SMS Message may also include Reply/SMS Message or Ad content relevant to the physical location of the user, depending on the product or service of interest in the 3-D VR environment.

"REGISTERING" INTEREST (SCANNING)

[0103] In one embodiment, users of the CTIS scan codes to register interest and the CTIS acts as a portal for consumers to access information supplemental to the context in which the codes are found. Users may scan codes found in media publications, on billboards or signs, on consumer products or packages, on websites or television screens, within 2-D, 3-D, or 3-D virtual worlds, and/or the like. In doing so, the users may identify themselves via an identification code specific to the digital device and service account with which the scan is made. At the same time, the scanned code can be recorded, as well as the time of day and user location; such information may form the basis of consumer profiles that may be saved by the CTIS. As these scans are indicative of interest in various subjects, goods, and/or services, they may serve as a basis for an individual customer tracking system. As such, advertisers or 3rd party providers can finely tune and efficiently tailor their efforts towards achieving maximum return on the advertising expenditure.

[0104] Alternatively, users may engage directly in a 3-D environment on a computer, digital device, television, and the like. Various digital devices are now equipped with 3-D capabilities to display 3-D images. Alternatively, users may register their interest within a 3-D VR environment with an avatar or the like. The user may click or engage an artifact or product of interest. For example, a player in The Sims Online who frequently acquires new furniture for his/her virtual apartment and has a stated interest in modern art may be served advertisements for an actual furniture store that sells modern furniture and is near the user's geographic location following one such virtual furniture acquisition. In another example, a user in Second Life that likes modern clothing for his/her character may be presented with Reply/SMS Message or Ads on virtual billboards from advertisers of virtual in-game clothing stores that are nearby the user's virtual position (or offer a virtual transportation link that will instantly move the user's avatar to the virtual in-game store).

[0105] In another embodiment, users may engage in a capture environment that represents an augmented reality environment. One example would be Google's Project Glass, which is a wearable device that presents an augmented reality to users. In this embodiment, the capture environment is the AR environment, where physical objects are overlaid with additional content or information, and a user may interact with the augmented images.

[0106] Alternatively, users may express interest for a product or artifact on a system that coupled to a 3-D VR environment. For example, a user may register interest in a product or artifact on a social network site that is coupled to a 3-D VR environment. The 3-D VR environment may then receive the product or artifact of interest from the User as the Scan Message and then generate the Reply/SMS Message from the CTIS.

[0107] For illustration, Fig. 35 is a particular, exemplary embodiment in which a Reply Message or Ad is served from a virtual help desk by user interaction in a 3D-VR environment. Here, a user (3700a) employs a digital device (3700b) to engage in a 3-D VR environment (3705).

Within the 3-D VR environment, the user may express interest in an element 3710, such as by interacting with a virtual representation of a help desk having a virtual telephone (3712) by picking up the virtual telephone. A Scan Message (3715) is composed and sent (3720) from the digital device to the server (3701), via the digital device's data connection. The Scan Message may include, without limitation, a user ID, a hardware ID, a geocode, a timestamp, a subject code, a source code, a content code, and/or the like. The server receives/recognizes the Scan Message (3725), and queries a database of user profiles (3730) based on the supplied user ID to update the appropriate user profile with the content of the current Scan Message and to determine what, if any, information in the user profile may be relevant to the preparation of the current Reply Message (3735). In one embodiment, the user can supply a list of interests to be considered in addition to those culled from their scan history. The server selects the appropriate Reply Message or Ad content to include in the Reply Message, comprised in the exemplary embodiment of contact information for the real world help desk virtually represented in the 3-D VR environment (3736). The Reply Message or Ad content may be stored either on the media company or a 3rd party server. The server then prepares and sends (3745) the Reply Message (3740), which here includes the contact information for the real world help desk virtually represented in the 3-D VR environment, but could, without limitation, include text, URLs to mobile sites where the item of interest is featured, video clips of the item of interest, other multimedia content, software, downloadable artifacts, a phone number, a phone number automatically called by the user's digital device (when coupled to the user's call mechanism, etc.), any artifact which can be "picked" within the 3-D environment, and/or the like. The Reply Message is received and displayed (or other appropriate action is taken) by the user's digital device (3750). Here, the contact information for the help desk is received by the user, who may then easily call the help desk. In an alternative embodiment, the Reply Message could include a phone number automatically called by the user's digital device (when coupled to the user's call mechanism), obviating the need for the user to input the help desk contact information.

[0108] The user registering interest by artifacts capable of being capture include, among other things, 3D barcodes that are have regions of differing heights, with the regions, their patterns and their relative heights being representative of data. In accordance with one embodiment, the three dimensional nature of artifacts, including barcodes, may be used advantageously for allowing sight or hearing impaired individuals to capture data from artifacts with 3D codes, whether 3D barcodes per se, or other 3D surfaces capable of acting as data sources, and have that data captured, processed and provided to such individuals in a form that makes the information encoded by the 3D data more available to the user. In one particular embodiment, sight impaired individuals often employ their haptic senses to, for example, read using braille, to scan products to identify container shapes or features or the like. These skills are, of course, learned and require considerable effort on the part of the individual. The embodiments disclosed herein may be used with sight impaired individuals to capture sensory data otherwise unavailable or difficult to access to such individuals and convert the sensory data into a usable form, e.g., sounds.

Similarly, in accordance with another embodiment, a hearing impaired individual may use the embodiments disclosed herein to capture audible sensory data, e.g., music, street sounds, warning sounds or the like, and covert such unavailable or difficult to access sensory data in a form, e.g., visual, that renders such audible sensory data more available and meaningful to a hearing impaired individual. In this manner, the embodiments disclosed herein may be employed to simply capture and convert data existent in one sensory form to another sensory form that is more useful or available to a user having a particular disability or impairment.

Code Triggered Information Server Basic Overview

[0109] FIG. la shows a combined logic and data flow block diagram illustrating a general overview of the CTIS in one embodiment. The CTIS may be configured so that a user (100a) may engage in a capture environment (105) with a digital device (100b), as for example by using a cell phone camera to register a 2-D, 3-D, or 3-D VR image by a scan and/or take a picture of a barcode, 2d code, 3D code, matrix code, data matrix, QR code, NFC, or other such symbology. An example of a mobile device and software capable of such code capture is the Nokia 6600 cellular telephone equipped with ConnexTo software. Alternatively, the CTIS may be triggered by the user selecting an internet link (such as on an internet enabled mobile device), by making decisions within a virtual world (such as a massively multiplayer online game), and/or the like. Without loss of generality, all such forms of interest-registering CTIS triggering will be referred to as "code scanning." The user may then express interest in a product, element, image, artifact, or the like represented in the capture environment (110). The time and location (as determined by GPS, GPRS, or other such geo-positioning technologies) of the digital device may be

determined, and a Scan Message (115) is generated containing a user identification (ID), a hardware ID that identifies the type of mobile device being used, a geocode (location of the device), a timestamp, and the scanned code (see FIG. 4 and discussion of Scan Message below). Within virtual worlds, the geocode and timestamp may be virtual world geographic and temporal information. Additional user-input information may also be supplied at this point. The Scan

Message is packaged and sent (120) to a server (101) that receives and recognizes it (125). The user's profile, specific to the supplied user ID, is updated with the new Scan Message (i.e., it is added as a transaction to their profile transaction history) and queried (130) for information to use in the preparation of a Reply/SMS Message (140) that is also based on the content of the current Scan Message. The user's profile may be the profile of the physical user him/herself, and/or the profile of the user's virtual avatar in a 3-D VR environment. The server selects (135) the Reply/SMS content (see FIG. 6) of the Reply/SMS Message (140) from an Information Base and sends it to the user's mobile display device (145), which displays the pertinent content to the user (150).

[0110] In a particular embodiment, illustrated in FIG. lc, the object of interest is a near field communication tag. The user 100a may engage in a capture environment 105 via the digital device 100b, and point the digital device at a NFC tag 106. The NFC tag may be registered as a selectable element or artifact in the capture environment 107. The capture environment may be 2-D, 3-D, 3-D VR, or the like, and the selectable artifact or element may be 2-D, 3-D, 3-D VR, or the like. The user may then express interest in the selectable artifact in the capture

environment 110, such as by selecting the artifact 111. In this embodiment, the NFC tag may be coupled to an advertisement for a digital download of a song. The advertisement may state that the user may interact with the NFC tag to purchase the digital download of the song. A Scan Message (115) is generated containing a user identification (ID), a hardware ID that identifies the type of mobile device being used, a geocode (location of the device), a timestamp, and the scanned code (see FIG. 4 and discussion of Scan Message below). Within virtual worlds, the geocode and timestamp may be virtual world geographic and temporal information. Additional user-input information may also be supplied at this point. The Scan Message is packaged and sent (120) to a server (101) that receives and recognizes it (125). The user's profile, specific to the supplied user ID, is updated with the new Scan Message (i.e., it is added as a transaction to their profile transaction history) and queried (130) for information to use in the preparation of a Reply/SMS Message (140) that is also based on the content of the current Scan Message. In this embodiment, the NFC tag prompts the server to retrieve purchasing information, in this instance the relevant information being the user's digital payment account, such as Google wallet (136). The user's Google wallet account information is retrieved and sent to the user's digital device, which may then prompt the user to use the Google wallet account to purchase the digital download of the song (151).

[0111] In another embodiment, the capture environment may be an augmented reality environment. The user may interact with artifacts in the AR environment, thus expressing interest in particular artifacts. Based on the interacted with artifact, reply messages may be prepared that further supplement or expand upon the artifact in the AR environment.

MMS

[0112] In one implementation, the Scan Message and/or scanned code may be sent to the server (101) by a Multimedia Messaging Service (MMS) protocol. In other implementations, a wide variety of other communication protocols may be employed, including but not limited to: Short Messaging Service (SMS), instant messaging, web browser based messaging, email, Enhanced Messaging System (EMS), TCP/IP, WAP, and/or the like.

SHORT CODE

[0113] In one implementation, the server (101) may be addressed by a short code, short numbers, Common Short Code (CSC), and/or the like for sending the Scan Message and/or scanned code. For example, a short code may appear alongside a code in a print publication, and a user may be informed that the scanned code should be sent to the indicated short code number in order to retrieve a Reply/SMS Message, advertisement, coupon, and/or the like. In other implementations, other addressing means may be employed, such as an ordinary telephone number, an email address, a universal resource locater (URL), and/or the like. In another implementation, the short code and/or other server address may be encoded within part of the code itself. When the user scans the code with his or her mobile device, the code may be partially decoded by the client device to extract the address and automatically send the rest of the code thereto.

SCANNING

[0114] FIG. lb shows an implementation of combined logic and data flow in another embodiment of CTIS operation. A 2-D, 3-D, or 3-D VR code (155) is scanned by a camera phone (156), and the resulting image content is converted to an MMS format to be sent via short code (157) through a gateway provider (158) to the CTIS (159) server. Alternatively, the user may interact directly in a 3D or 3D VR environment via an avatar to select product or service that includes the code (155), or the user may register a 2D or 3D image that includes the code (155). At the server, the 2-D, 3-D, or 3-D VR image information may be enhanced, manipulated, and/or otherwise processed (160) so as to aid in determining the appropriate content to serve in response. After enhancement, the image content is read (161) and the content and format for the appropriate response is determined (162) (see, e.g., FIGS. 9-11). A response message is formed in MMS format (163) and is sent (164) back to a gateway provider (158) to be served to the user's camera phone (156).

[0115] In an alternative implementation, the scanned code may be directly decoded on the client mobile device instead of on the server. The decoded content may then be converted to MMS format and sent via short code to the server in order to retrieve the appropriate content associated with the code. That content may be returned from the server to the client mobile device by means of an MMS protocol as well.

CTIS SERVER

[0116] For illustration, the CTIS is shown in FIG. 2B for a particular, exemplary embodiment: providing targeted and contextual information and SMS messages to the user related to a news article. Here, a user employs a cell phone to scan a code associated with an article in the

Business section of a media publication (207), such as by using the phone's built in camera to photograph a 2D matrix code (e.g., QR code). The location of the scan (San Francisco, Calif.) is determined by the phone's built in GPS receiver (212), and this location is incorporated as a geocode, along with the user ID, the hardware ID of the particular type of device (e.g., cell phone) used, the time, and the code content, into a Scan Message. This is sent to a server via the cell phone's data connection (e.g., wireless internet systems such as lxEV-DO), and the server queries a database of user profiles based on the supplied user ID in order to update the appropriate user profile with the content of the current Scan Message and to determine what, if any, information in the user profile may be relevant to the preparation of the current Reply/SMS Message. Here, the server recognizes that the user is 55 years of age and has recently been scanning articles and/orReply/SMS Message or Ads related to investments and retirement planning (232). In one embodiment, the user can supply a list of interests to be considered in addition to those culled from their scan history. The server selects the appropriate Reply/SMS message content to include in the Reply/SMS Message, comprised in this case of links to Finance headlines, quick links to saved stock quotes (237), and a contextual brokerage advertisement (238), including information on branch locations in San Francisco (212) near the user. This reply is sent by the server to the user's mobile device which displays the appropriate message content.

SPACE-TIME TRAJECTORIES - NO SCAN

[0117] In one embodiment, the CTIS can serve information to the user based on the collected knowledge of user space-time trajectories contained in the user profile, without the need for any initiating code scan. This embodiment is best illustrated by example, as drawn in FIG. 3A. Here, a user rides a bus from home (300) to work (310) on four of the last five days, and takes a different bus to his doctor's office (330) on the remaining day. The space-time trajectories for the four work trips (305) and the one doctor trip (325) are determined by codes that the user scans with his cell phone from a newspaper during the bus rides. In this example, the user is assumed to scan a code every ten minutes starting at 7:30 AM until the destination is reached, and the geographic location of each scan is indicated by the position of the timestamp along each trajectory. In one embodiment, tracking occurs without scanning, simply by having the device send geocodes and timestamps by itself. Along the way to his destinations, the user passes a number of 3rd party providers (marked with X's) with Reply/SMS content in the CTIS

Information Base, with dotted circles indicating the locus of points that are a distance of two miles from each provider. One Reply/SMS Message or Ad provider in particular (315), a gourmet coffee shop, is within two miles (320) of the user's space-time trajectory at 7:50 AM in four of the last five days. The user's profile also lists "coffee" as an interest, both based on user specifications during registration and on the user's advertisement and article scan record.

Consequently, on the sixth day, the server supplies the user with an advertisement for the coffee shop (315) at 7:45 AM.

[0118] In another embodiment, the CTIS can serve information to the user based on the collected knowledge of user's virtual space-time trajectories contained in the user profile (or avatar), without the need for any initiating code scan. This embodiment is best illustrated by example, as drawn in Fig. 3b. Here a user's avatar in a 3-D or 3-D VR environment has travelled from VR location A (301) to VR location B (31 1) on four of the last five sessions in the environment, and took a different route from VR location A (301) to VR location C (331) in the fifth session. The trajectories are determined by logs of the avatar's virtual geographic and temporal location, and/or the avatar's interactions with virtual artifacts. When the avatar breaches certain 3rd party provider zones, the CTIS server sends a Reply/SMS message to the user for an appropriate Reply/SMS message of the 3rd party or Reply/SMS Message or Ad provider.

Code Triggered Information Server (CTIS) Detailed Overview

User and Reply/SMS Message or Ad Provider Participation

[0119] The CTIS may be enabled by the participation of Reply/SMS Message or Ad 3rd party providers and users. In one embodiment, Reply/SMS Message or Ad providers supply

Reply/SMS Message or Ads for storage on the CTIS server. In an alternative embodiment, the Reply/SMS Message or Ads are stored on third party servers that are referenced by the CTIS server. The user experience may be enhanced by the incorporation of personal preferences and demographic information to optimize the targeting of Reply/SMS Message or Ad content.

Consequently, one embodiment would incorporate a user registration procedure. Users may register for the CTIS via the internet, telephone, postal mail, and/or the like. If a particular embodiment of the CTIS requires client software for the user to install, this could be supplied upon successful user registration. FIG. 4 shows an exemplary embodiment of a user registration interface 400, wherein a user can input Basic Info 405 (e.g., member ID, password, secret question/answer, e-mail address, etc.), Device Info 410 (e.g., mobile phone carrier, phone manufacturer & model, operating system, etc.), Demographics 415 (e.g., gender, year of birth, zip code, country of residence, household income, job title, industry, etc.), and Content Preferences 420 (e.g., interests, subscriptions, content delivery options, personal history options, cache options, geo-tracking options, Reply/SMS Message or Ad delivery options, etc.) in a plurality of fields 425. In an alternative embodiment, a basic user identification packet (e.g., a "cookie") is sent with a user's first code scan, thus establishing a basic user profile that can be filled in with greater detail at a later time. In virtual world embodiments, the user information may alternatively be built around the user's virtual avatar, which may or may not differ from the physical user.

Code Capture (105)

[0120] Scannable codes may be found in a variety of locations, including but not limited to newspaper and magazine articles, signs and billboards, flyers, store locations and kiosks, consumer products, packages, clothing, stickers, websites, software displays, television broadcasts, virtual worlds, and/or the like. The nature of the code and associated method with which the code can be scanned will depend to some extent on where the code is found, but among the possible types of codes are standard barcodes (e.g., UPC, EAN, Code 128, etc.), 2D matrix codes (e.g., QR code, Semacode, Data Glyphs, mCodes, etc.), user-input codes (e.g., text messages), RFID tags, NFC tags, pure images (e.g., an image of a sign to be analyzed by optical character recognition), website links, software inputs, and/or the like. These codes may be located on any medium (e.g., on newspapers, magazines, books, video content, computer screens, embedded in objects (e.g., RFID tags on clothes, etc.), and/or the like). In virtual worlds, the "code" may be the virtual artifact/object within the 3-D VR environment. One embodiment employs 2D matrix codes, examples of which are provided in FIG. 5a, due to their large data capacity, ease of scanning, and resilience to damage or error. These examples include QR codes 500, Mcodes 505, Semacodes 510, and/or the like.

Code Enhancement

[0121] In scanning a code, the code image may not always be recorded faithfully and/or in an ideal and/or suitable condition for decoding and/or matching to associated content.

Consequently, the CTIS may be configured to enhance and/or otherwise process a code image in order to better recognize the code. FIGS. 5b-c show implementations of logic flow for processing and/or managing non-ideal code scans in embodiments of CTIS operation. In FIG. 5b, a scanned code is received at the CTIS server (513) and a first attempt is made to decode a received code scan (515). In one implementation, a received code scan may take the form of a bitmap image and/or a compressed bitmap image. If the decoding is successful (520), then the code is matched to associated content (525) that is ultimately destined to be served to a user. Otherwise, a determination is made as to whether enhancement should be applied to the scanned code (530). If not, then an error message and/or suggestions on how to improve the quality of the scanned code may be returned to the user (535). The CTIS may decide not to apply

enhancement, for example, if enhancement has already been applied unsuccessfully to the same image before or if the quality of the image is so poor as to be clearly beyond improvement. If enhancement is to be applied, then the CTIS determines the appropriate enhancement type (540) based, for example, on the quality and character of the scanned code image and subsequently applies the enhancement (545), after which a new attempt is made to decode the scanned code.

[0122] In some implementations, multiple enhancement processes may be applied against a scanned code and the results compared in order to determine the encoded content. Prior to enhancement, the image may be downsized if necessary for speed of processing in applying multiple enhancements against the image. Image quality may also be increased if necessary in order to more successfully apply enhancements. For code images having extraneous information and/or noise, an enhancement process may be applied to remove all extraneous information, despeckle, and/or the like. For code images having shades of gray and/or shadows obscuring the encoded content, an enhancement process may be applied to manipulate the contrast and/or brightness of the image in order to create a pure black and white image for cleaner decoding. For code images that are tilted and/or not taken flat in a plane, an enhancement process may be applied to tilt the plane of the code to create a flat plane to aid in successful decoding. For code images that are rotated or skewed, an enhancement process may be applied to de-rotate, deskew, and/or otherwise recreate proper rectangular pixel groupings that can be decoded. For code images that are taken out of focus, an enhancement process may be applied to sharpen the image into recognizable pixel groupings. Additionally, the CTIS may apply edge recognition processes to the code image to create a set of potential code images that can be processed and compared to records in a code database.

Partial Decoding

[0123] In some cases in which full decoding of a scanned code image is impossible, a partial decoding may be accomplished and serving of content achieved on that basis. A partial decoding may, for example, result in a probabilistic code match without ever successfully decoding the complete code. FIG. 5c shows an implementation of logic flow for partial decoding in one embodiment of CTIS operation. A scanned code image is received (548), partially decoded (550), and the partially decoded content used to query a code database to find matching codes (555). A determination is made if any matches exist (560) and, if not, then the CTIS may return an error message to the user and/or make suggestions about how to improve the image of the scanned code (565). If a match is found, however, then a determination is made as to whether there are multiple matches (570). If so, then the CTIS may consider ancillary factors (575) in attempting to isolate a single code as the most likely match to the received code. Such ancillary factors may include, but are not limited to: the incoming phone number, the carrier, the time of day, current code traffic, the source of the code, the context of the code, the user ID, the hardware ID, the user behavioral history, the user location, the current 3-D VR environment, and/or the like. In considering ancillary factors, the CTIS is thus capable of predicting the true code based on knowledge of the user scanning the code, the context of the code, ambient factors, and/or the like. Once a unique code has been identified, this is designated as the matching code (580) and the CTIS proceeds with determining the appropriate associated content to serve to the user.

[0124] In an illustrative example of partial decoding, a given matrix code may encode the string

ABC123. In multiple processes, it may be determined that the code contains A 1 3 (where the blanks represent unknown values), _C1_, and AB_. Through these multiple processes, the CTIS system now knows that the code contains ABC 1 3 and may check this against codes in a code database to determine how many matches exist. If it finds two matching codes (e.g., ABC 123 and ABC 143), it may consider ancillary factors. For example, ABC 123 may correspond to an advertisement for a new action movie while ABC 143 corresponds to a coupon for women's cosmetics. If the user supplying the code is determined, based on a supplied user ID, to be a man with a history of scanning movie-related codes, then the CTIS system may infer that ABC 123 is the matching code and serve the corresponding content. In one implementation, the CTIS server may further supply a confirmation request for partially matched codes, requesting the user to affirm or deny that the supplied content is, in fact, the content that he or she was seeking.

Scan Message Data Structure (115)

[0125] The Scan Message generated by the CTIS is, itself, a novel data structure. In one embodiment that is illustrated in FIG. 6, it contains an identification field (605) comprising a unique user ID (605a) and a hardware ID (605b), both automatically supplied by the device used to scan and transmit the scanned code; a coordinate field (610) comprising the location geocode (610a) (e.g., GPS coordinate, latitude and longitude, city and state, etc.) and timestamp (610b) of the scan; and a code field (615) supplying the specific content of the scanned code, which may include a subject code (615a) for the code context, a source code (615b) indicating where the code was located, and a content code (615 c) indicating the specific information, if any, to be supplied in response to a scan of that code. In 3-D VR environment embodiments, the location geocode and/or timestamp may be virtual world geographic and/or temporal information (620).

[0126] In one embodiment, the XML for the Scan Message takes the following form:

<Scan_Message>

<ID>

<User ID> 012345 </User ID>

<Hardware ID> Nokia 660 </Hardware ID>

</ID>

<Coordinates>

<Geocode> GPS 40 46.516 -73 57.98 </Geocode>

<Timestamp> 08/21/2006 13:45:28 </Timestamp>

</Coordinates>

<Code>

<Subject> entertainment; movies; comedy </Subject>

<Source> New York Times </Source>

<Content> Showtimes for latest popular comedy movie </Content>

</Code>

</Scan_Message>

Data Transmission (120, 125, 145, 150)

[0127] In one embodiment, sending and receiving the Scan Message and Reply/SMS Message will employ standard data transmission techniques to ensure successful transmission and to preserve data integrity (e.g., TCP/IP, lxEV-DO, etc.). This is relevant for the Scan Message, which will contain the coded information scanned by the user. Such techniques may include but are not limited to the use of standard transmission protocols, "handshaking," data compression, data encryption, and/or error correction. User Profile Structure (130)

[0128] The content of the user profile generated by the CTIS is itself a novel data structure. In one embodiment illustrated in FIG. 7a, the profile (700), which is uniquely specified by the user ID, will contain a category of quasi-static user information (705) that is generally fixed over time and one of dynamic user information (730) that is updated with each successive Scan Message that the user submits. The user profile may exist along the 3-D VR environment or coupled to the 3-D VR environment. The quasi-static info (the "quasi" qualifier indicates that this information may be updated, for example if a user changes their mobile device, however it does not change with each successive code scan) may include a hardware ID (710); "census" info (715) such as name, address, phone number, e-mail address, age, sex, race, marital status, number and age of children, job title, annual income, etc.; subjects of interest specified by the user (720); and information regarding allowed methods to contact the user (725). In one embodiment, this information could be supplied by the user when registering for the CTIS service as, for example, on a website. The dynamic info in the profile may include a scan record (735), comprising the time (740), location (745), and scan code (750) (including subject (750a), source (750b) and content (750c)); the capture environment (760); and statistics related to the scan or capture history (755). Such statistics may include but are not limited to the most popular scan subjects, most popular scan sources, user space-time trajectories, avatar space-time trajectories, etc. The capture environment 760 may be a 2-D (760a), a 3-D (760b), or 3-D VR (760c) environment. In one embodiment, the profile contains a series of identifying codes distilled from the profile content (e.g., demographic category code based on census info, subject codes, source codes, etc.) that can be compared with similar codes in the Scan Message to determine the appropriate Reply/SMS content to include in the Reply/SMS Message. In an alternative embodiment, the profile contains identifying keywords or "tags" based on the profile content that can be compared with similar tags in the Scan Message to determine the appropriate content to include in the

Reply/SMS Message. In both cases, the identifying labels for the user profiles may be input by CTIS administrators or automatically generated by an appropriate computer algorithm such as stripping header labels from Reply/SMS Message or Ad descriptions (e.g., for example, stripping the header tags from an HTML ad).

[0129] In one embodiment, the XML for the User Profile may take the following form:

<User> <Quasi-static info>

<User_ID>123-45-6789</User_ID>

<Hardware ID> Nokia 660 </Hardware ID>

<Census info> John Smith; 123 Maple Dr., Smalltown, CA 92676; (123)456-7890;

jsmith@email.com; 55 years; male; white; married; 2 children; etc.

</Census info>

<Interests> camping; fishing; classic cars; movies; etc. </Interests>

<Contact restrictions> Weekdays 8 AM - 7 PM only </Contact restrictions>

</Quasi-static info>

<Dynamic info>

<Scan record>

<Scan_#l>

<Time> 08/21/2006 13:45:28 </Time>

<Geocode> GPS 40 46.516 -73 57.98 </Geocode>

<Code>

<Subject> entertainment; movies; comedy </Subject>

<Source> New York Times </Source>

<Content> Showtimes for latest popular comedy movie </Content>

</Code>

</Scan_#l>

<Scan_#2>

etc...

</Scan_#2>

etc...

</Scan record>

<Scan statistics>

<Popular subjects> entertainment; cars; travel; etc. </Popular subjects>

<Popular sources> New York Times; Car and Driver; CNN.com; etc. </Popular sources> <Trajectories> Data files listing time and geocode coordinates, computed average trajectories, likely locations, etc. </Trajectories>

etc... </Scan statistics>

</Dynamic info>

<Code>

<Subject> entertainment; movies; comedy </Subject>

<Source> New York Times </Source>

<Content> Showtimes for latest popular comedy movie </Content>

</Code>

</User>

[0130] In one embodiment, data accumulated in a plurality of user profiles may be analyzed to extract information about codes that are scanned. For example, the frequency with which a particular code is scanned may be extracted from user profiles and parsed by geographic, temporal, and/or demographic criteria to yield code profiling information. This information may be stored in a code and/or SMS profile. In an alternative embodiment, the code/ Ad profile may be constructed and/or updated by the CTIS immediately upon the receipt of a Scan Message rather than being extracted from user profiles.

Information Base (135)

Ads/SMS and Labels - searching

[0131] The Information Base contains the content that may be included in the Reply/SMS Message or Ad sent to the user and may be stored on the CTIS central server or on third party servers accessed by the CTIS. In one embodiment, each Reply/SMS message or Ad is associated with searchable labels. The Reply/SMS Message or Ad content together with its labels, collectively referred to here as an Ad, forms a novel data structure. In one embodiment illustrated in FIG. 8, the Reply/SMS Message or Ad (800) is comprised of the specific

Reply/SMS Message or Ad content (805) (e.g., text, images, video, etc.) and a set of identifiers (810) including subject tags (815), information characterizing the temporal character of the Reply/SMS Message or Ad based on which the Reply/SMS Message or Ad may be triggered (820) (e.g., 6 to 10 AM for a breakfast Ad), information characterizing the geographic specificity of the Reply/SMS Message or Ad based on which the Reply/SMS Message or Ad may be triggered (825), demographic specificity of the Reply/SMS Message or Ad (830) (e.g., a Reply/SMS Message or Ad for family vacations), and the hardware requirements of the

Reply/SMS Message or Ad (835) (e.g., hardware IDs of devices capable of displaying the content of a particular Ad). In one embodiment, the Reply/SMS Message or Ad would also contain information identifying the source in which the Reply/SMS Message or Ad code is to appear. In another embodiment, the Reply/SMS Message or Ad would also contain code/ Ad profile data, describing the history and/or statistics of scans related to the Ad.

[0132] In one embodiment, the XML for a Reply/SMS message may be in the following form: <SMS message>

<SMS message_ID>123</SMS message_ID>

<SMS message content>

textual movie showtime listings ( or images, audio, video, URLs, etc.)

</SMS message content>

<Identifiers>

<Subject> entertainment; movies; comedy </Subject>

<Temporal> 08/21/2006; 12:00:00 to 14:00:00 </Temporal>

<Geographic> Smalltown, CA 92676 </Geographic>

<Demographic> 17 years and older </Demographic>

<Hardware> any (text only) </Hardware>

</Identifiers>

</SMS message>

User Profile Query (130)

STATIC CONTENT AND DYNAMIC CONTENT IN REPLY

[0133] The CTIS queries the user profile to determine which Reply/SMS Message or Ads to include from the Information Base in the Reply/SMS Message in order to tailor those

Reply/SMS Message or Ads to the user's profile characteristics, interests, and trajectories. In one embodiment, a scanned code will yield two components in the Reply/SMS Message content: i) static content that is the same for every user who scans the code, and ii) dynamic content that depends on the context of the user and the user profile. The static content (i) is determined from the scan code, while the dynamic content (ii) is determined by a combination of the scan code and the user profile, requiring a dynamic content generation heuristic to combine their respective influences. While a variety of such heuristic are possible and contemplated as being within the scope of this disclosure, and the specific heuristic employed in a given realization will likely depend on the precise application and intention, we discuss one embodiment of this heuristic here for illustrative purposes with reference to FIG. 9. An example of one embodiment of heuristic useful with the embodiments disclosed herein is found in commonly owned U.S.

Published Application No. US20110264527A, which is hereby incorporated by reference. Some other possible methods may include alternative ordering of filters, addition or removal of filters, weighted filtering, complex conditional trees, and/or the like. In one embodiment, the scan code and user profile is labeled with keywords or "tags" that identify the subject content of each. In an alternative embodiment, the scan code, user profile, and Reply/SMS Messages or Ads are labeled with identifying codes. In either case, the heuristic exhibited in FIG. 9 first filters all Reply/SMS Messages or Ads in the Information Base by the subject code or tag of the scanned code (900). The Reply/SMS Messages or Ads from 900 are filtered by the hardware ID (905) to ensure that the Reply/SMS Message or Ad content can be successfully acquired and displayed by the user. The hardware ID encompasses 3-D and 3-D VR capabilities. The Reply/SMS Messages or Ads from 905 are filtered into separate categories by scan location (910al), user address (910a2), user specified subject interests (910bl), user scan subject history (910b2), scan time (910c), or user demographic category (9 lOd). Reply/SMS Message or Ads in each of these filtered categories are compared to determine which occur most commonly across 910a, b, c, & d (915). The server determines if 915 has yielded a single Reply/SMS Message or Ad (920), and if so, it incorporates the SMS message's or Ad's content into the Reply/SMS Message (930). Otherwise, it chooses one Reply/SMS Message or Ad at random from the remaining Reply/SMS Message or Ads (925) for incorporation. It must be emphasized again that this is but a single, specific embodiment of the user profile query heuristic intended for illustrative purposes. The heuristic is highly flexible and can be finely tuned for the specific application at hand. Some other possible methods may include alternative ordering of filters, addition or removal of filters, weighted filtering, complex conditional trees, and/or the like.

Heuristics - Filtering - Weighting

[0134] As an exemplary implementation of this embodiment of the Reply/SMS Message or Ad filtering heuristic, we consider the situation discussed above with reference to FIG. 2B. Here, the user scans a code from an article on finance and investment in the business section of a media publication. Keywords associated with this code may include Business, Finance, Investment, etc. Consequently, only those Reply/SMS Message or Ads possessing these identifying keywords are passed at 800. In an alternative embodiment, the keywords may be ranked in order or relevance and the Reply/SMS Message or Ads filtered accordingly. The Reply/SMS Message or Ads from 900 are filtered by Hardware ID; we presently assume that the user's mobile device is equipped with advanced capabilities (text, image, audio, video, internet, etc.), so that all Reply/SMS Message or Ads are passed at 905. In an alternative embodiment, the Reply/SMS Message or Ad filter may preferentially choose those Reply/SMS Message or Ads that take fullest advantage of the user device's display capabilities. Of the remaining Ads, there is one for a brokerage firm that is tagged with a location code corresponding to the user's address (San Francisco, Calif), the user's specified subject interests (investing, retirement), and a portion of the user's demographic profile (age 55 or older). The three tag matches (location, subject, and

demographic) distinguish this Reply/SMS Message or Ad from the others in the Information Base, which, in this example, all have two or fewer tag matches; so this unique Ad, a brokerage firm located in San Francisco, Calif, with retirement services, is chosen to be served to the user's mobile device.

RELEVANCE RATING

[0135] In one embodiment, the user may respond to the Reply/SMS Message with a relevance rating. This rating may then be stored in the user profile and/or employed to refine the criteria for tailoring future Reply/SMS Messages to that user.

[0136] In one embodiment, the Reply/SMS Message or Ads would not be filtered by hardware ID at 905. Rather, when a final Reply/SMS Message or Ad has been selected for inclusion in the Reply/SMS Message following filtration under the other relevant criteria, the server will determine whether that Reply/SMS Message or Ad is properly formatted for the device specified by the hardware ID. If so, then the Reply/SMS Message or Ad will be included in the

Reply/SMS Message as is. Otherwise, it will be converted into the required format appropriate to the user's mobile device. For example, if the selected Reply/SMS Message or Ad contains color images but the server determines that the user's hardware device is an early model BlackBerry that only accommodates monochromatic text, the server will implement a peripheral application to strip the text content from the Reply/SMS Message or Ad and incorporate only that in the Reply/SMS Message.

Non-Triggered Reply/SMS Message or Ad Serving

[0137] Though Reply/SMS messages served by the CTIS are determined by codes scanned at some time in the past, it is possible for the CTIS to serve Reply/SMS messages without any immediately contiguous, causal code scan. A general illustration of this capability was given above in FIG. 3A, where each 3rd party provider has specific geographic locations of operation. These are assumed to be stores/restaurants for the present purposes of illustration in this disclosure, but they may have different character for different embodiments and applications, including but not limited to kiosks, signs and billboards, offices, hospitals, real estate, shelters, emergency service providers, traffic monitors, individuals, websites, virtual world locations, and/or the like. A chosen distance surrounding each 3rd party provider location defines a

"provider zone," where the metric by which "distance" is gauged may be generalized in the case of cyberspace/virtual world locations. A provider zone breach occurs when a user scans a code within a provider zone. This may be regardless of the content of the scanned code, for in this example the goal is to record the user's space-time position. In an alternative embodiment, a provider zone breach can be registered even if a user does not scan a code within the provider zone, if the CTIS can infer a breach from two or more code scans outside the provider zone through interpolation. When such a provider zone breach occurs, a special note may be incorporated into the user profile, such as in the Scan statistics module (755), indicating the time and the particular Reply/SMS Message or Ad provider.

[0138] In an alternative implementation, the CTIS may be configured to automatically query a user position without scanned codes. For example, a user's mobile device may be configured to periodically register its GPS location with the CTIS system. In another implementation, the CTIS may be able to continuously monitor the position of a client mobile device based on the cell site or tower to which the device is communicatively coupled. Cell site based user location may also be registered when a user scans a code.

[0139] Alternatively, a user employing an avatar in a 3-D VR environment could receive the message or coupon just be interacting with a product or service in a "virtual provider zone", and not necessarily requesting or scanning info on the product or service, as shown in FIG. 3B.

[0140] From an accumulated record of these breaches, data of the form of FIG. 10 can be determined. FIG. 10 shows a histogram (1000) of provider zone breaches in 20 minute intervals for a particular user over a chosen time scale, which we will take to be two months in this example. In one embodiment, such histograms will correspond to breaches of specific

Reply/SMS Message or Ad provider locations; while in an alternative embodiment, they will correspond to breaches of any of a plurality of locations corresponding to a specific Reply/SMS Message or Ad provider; while in still another embodiment, they will correspond to breaches of different locations of related but different Reply/SMS Message or Ad providers, chosen to target a specific collective user demographic. In this exemplary histogram, the significant provider zone breaches (those exceeding the threshold) are clustered around two times: one approximately centered at 9 AM (1005), and the other at 6 PM (1010). This may represent, for example, a user scanning codes as he passes the same Reply/SMS Message or Ad provider location while riding a bus to and from work. In one embodiment, a threshold breach level (1015), indicated in FIG. 10 by a horizontal dotted line, is specified such that all breaches below this threshold number are ignored. This threshold level should be specified with respect to the time scale of the histogram; in the present example, the threshold is 3 breaches per two month period. The average peak times (1020, 1025) of the breach clusters that exceed this threshold are computed (marked by X's in FIG. 10), and a time is chosen prior to those averages (1030, 1035) to serve an appropriate Reply/SMS Message or Ad to the user. In one embodiment, provider zone breaches could be sorted by scan subject, so that a histogram of the form of FIG. 10 could be constructed for a specific category of scans in order to further tailor the supplied Reply/SMS Message or Ad content.

TRAJECTORIES IN CYBERSPACE-TIME

[0141] In another embodiment, the system may be generalized to analyze trajectories in

"cyberspace-time." In this embodiment, a record of trajectories is kept of the user's activity on the world wide web as browsed, for example, on the user's internet enabled mobile device. A generalized concept of "distance" may be incorporated, for example reflecting an average number of links needed to get from one website to another. Provider locations become websites in this embodiment, and a zone breach may be registered when the user is a specified number of links away from the provider's website. Then, just as before, the CTIS can anticipate user cyberspace-time trajectories and supply Ads, coupons, pop-ups, etc. related to websites that the user is approaching. For example, the CTIS may track that a user visits web site A at 9:00 AM and web site B at 9:20 AM every day. The CTIS may then provide Reply/SMS Message or Ads to website A at 8:50 AM and to website B at 9: 10 that are targeted to that user. In an alternative embodiment, the CTIS may provide this targeting information to existing Reply/SMS Message or Ad serving systems, which in turn may use the targeting information for timely placement of ads. The aggregation of such targeting information, in particular, may be useful to advertisers and website owners. For example, reports may be run on user profiles sorted by location (e.g., websites) and time of visit. This information may be supplied, along with user profile IDs, which may then be used by the advertising servers and/or websites to pre-cache Reply/SMS Message or Ads that are relevant to the users' interest just prior to their anticipated visits to the website. As such, the CTIS works in conjunction with certain websites to supply user-specific Reply/SMS Message or Ads on those sites. As a result, the content of the user profile within the CTIS may be used to select Reply/SMS Message or Ads that the user browses using their mobile device. In an alternative embodiment, web-based Reply/SMS Message or Ads may be specific to the trajectories of users in geographic space-time, since that information is included in the user profile. For example, if a user is known to be passing by a coffee shop at a specific location and time every day (e.g., a coffee shop on 123 Main Street, NY, N.Y. at 9:00 AM), and is also know to visit a specific website at that time (e.g., at 9:00 AM the user visits website C reading the daily news on their walk to work), then the system may provide the user with Reply/SMS Message or Ads directly to their PDA or embedded in website C (because it was pre-loaded as already discussed) for the coffee shop. As such, the CTIS provides a mechanism to provide

geographically relevant Reply/SMS Message or Ads to traditional websites. In yet another embodiment, the total content of the websites browsed by a user on their mobile device may be modified by the content of the user profile within the CTIS. For example, a news website may select articles for a user that are specific to the user profile, including their interests,

demographics, current time and location, etc.

VIRTUAL SPACE

[0142] In another embodiment, the CTIS may analyze the user trajectories in "virtual worlds" or "synthetic realities" and serve Reply/SMS Message or Ads accordingly. An example of a virtual world is a massively multiplayer online game, such as The Sims Online, EverQuest, World of Warcraft, Second Life, and/or the like. In such a virtual environment, a code scan may be comprised of a particular user action or decision such as initiating or completing a game mission, clicking on an icon or other digital image, saving a game, etc. In such virtual worlds, geographies and virtual locations may be used in employing trajectories. The history of user activity within the virtual world may then be incorporated into the user profile and used by the CTIS to serve Reply/SMS Message or Ads within the context of the virtual world or elsewhere. For example, in games like Second Life, virtual televisions, billboards, kiosks, clothing, etc. may be used as advertising delivery mechanisms.

SELECTING REPLY/SMS MESSAGES OR ADS

[0143] Selecting the proper Reply/SMS message to serve to the user in the non-triggered serving embodiment of the CTIS may be accomplished using a variety of heuristics that are best tailored to suit the specific use or application. Nevertheless, we present an example of a specific embodiment in FIG. 11a for illustrative purposes. In this embodiment, a weighting system may be employed to select among the Reply/SMS Message or Ads of a specific Reply/SMS Message or Ad provider once it is established that a Reply/SMS Message or Ad from this provider is to be served to the user based on the analysis of FIG. 10. This weighting system begins by assigning a score of 1 (1100) to all Reply/SMS Message or Ads in the Information Base corresponding to the provider. This score is multiplied by a subject coefficient (1105) for every match between the Reply/SMS Message or Ad subject and the user specified subject interest or scan subject history. That coefficient is 2 in the present example, so N matches would yield a weighting factor of 2N. The Reply/SMS Message or Ad score may also be multiplied by a time coefficient (1110) if the serving time (1030 or 1035) falls within a time range specified for a particular Ad. In the present example, the time coefficient is 4, expressing the greater importance of this factor compared to a single subject match. Finally, the Reply/SMS Message or Ad score may be multiplied by a demographic coefficient (1115) for every match between the Reply/SMS Message or Ad demographic category and that of the user. That coefficient is 1.5 in the present example, reflecting the diminished importance of this factor compared to the time and subject

considerations. M demographic category matches will yield a weighting factor of 1.5M. Once all of the 3rd party or Ad provider's Reply/SMS Message or Ads are scored in this fashion, those Reply/SMS Message or Ads with the highest scores for that provider may be selected over the rest (1120). Similarly, the highest scoring Reply/SMS Message or Ads from other providers are selected and the highest scoring Reply/SMS Message or Ads over all providers can be selected to serve for a particular time interval (1125). Finally, the proper time to serve the Reply/SMS Message or Ad (e.g., 30 minutes prior to the expected average provider zone breach time) is established (1130) and, if there is no further ambiguity (1135), the proper Reply/SMS Message or Ad is served at that time (1145). Any residual ambiguity may be resolved by selecting randomly from the remaining Ads (1140).

[0144] As a specific example of how this might work, we assume that the histogram (1000) of FIG. 10 represents provider zone breaches for a fast- food restaurant that a user passes on his way to and from work. A Reply/SMS Message or Ad in the restaurant's base of provided Reply/SMS Message or Ads matches the user's stated interest in gourmet coffee, and this Reply/SMS Message or Ad is further labeled by a time identifier indicating that it is best served between 8 AM and 10 AM. Consequently, at 30 minutes before the user's average breach time of the provider's zone, the server supplies the Reply/SMS Message or Ad to the user's mobile device, touting this restaurant's new line of gourmet coffee drinks Alternatively, the user's profile may specify that he is married with two children. This matches the demographic category of an Reply/SMS Message or Ad in the provider's base which is also labeled by a time identifier indicating that it is best served between 5 PM and 8 PM. As a result, 30 minutes before the user breaches the provider's zone on his way home from work, the server supplies the Reply/SMS Message or Ad to the user's mobile device, touting their family-pack of hamburgers.

MARKETING RULES

[0145] In an alternative embodiment, the CTIS may be configured to receive and implement marketer rules for serving Ads. FIG. lib shows a schematic illustration of data structures related to establishment of a marketer rule for Reply/SMS Message or Ad serving in one embodiment of CTIS operation. A user profile data set (1147) may include a variety of data fields related to user activities, interests, characteristics, and/or the like, such as but not limited to: geographic visits (1149), as may be recorded by code scans; time (1151) associated with code scans; interest contacts (1153), such as may be reflect the user's interests and may be based on the context and/or associated content of scanned codes; gender, age, demographic, and/or other personal information (1155); peer groups and user preferences for the peer groups (1157) and/or the like. Server data pulls (1158) may reference one or more data feeds to which the CTIS server has access in order to draw information that may be pertinent to marketer rules and/or Reply/SMS Message or Ad serving procedures. A wide variety of different types of feeds may be accessible, including but not limited to: global newsfeeds (1159), such as associated press wire services, weather information, sports scores, political and social events, financial market data, and/or the like; category sector feeds (1161), such as more specific and/or special interest news feeds; marketer specified feeds (1163); Reply/SMS Message or Ad messages (1164) and/or the like. A marketer rule (1165) may be established by selecting one or more fields (1167) from the user profile data sets (1147) and/or the server data pulls (1158) and supplying associated parameters (1165) and/or parameter values associated with those fields. In the illustrated implementation, the rule associates a Petroleum Gazette field (1169) with a parameter specifying more than three oil articles read per day (1175). In addition, the rule associates a gas station visitation field (1171) with a parameter specifying more than three visits per week (1177). If both of these conditions are deemed true for a given CTIS user, then the CTIS may serve one or more

Reply/SMS Message or Ads selected for and/or associated with the marketer rule. A price-per- impression (1179) may be charged for each time that the Reply/SMS Message or Ad is served to a user under the circumstances specified by the rule. In one implementation, a marketer may propose a price-per-impression when he or she creates the rule, which is then submitted to the CTIS and/or a CTIS administrator for approval. In another implementation, the CTIS may automatically generate a price-per-impression based on the rule and/or the marketer. For example, a fixed charge may be applied for each additional field and associated parameter added to the rule, as this refines the specificity with which the associated Reply/SMS Message or Ads will be served and increases the likelihood of transactional consummation. Once a rule is complete, it may be entered for storage and subsequent use in a marketer rules database (1181). It should be understood that the functionality described for this embodiment of the CTIS may be integrated or employed within any of the other CTIS embodiments described herein.

[0146] In one embodiment, the XML for the above marketer rule may take a form similar to the following:

<Rule>

<Rule_ID> 123</Rule_ID>

<Rule_name> Oil Rule </Rule_name>

<Rule_owner>Reply/SMS Message or Ads R Us </Rule_owner>

<Conditionl>

<Fieldl> Petroleum Gazette </Fieldl>

<Parameterl> 4 or more oil articles/day </Parameterl>

</Conditionl>

<Condition2>

<Field2> Gas Station </Field2>

<Parameter2> 4 or more visits per week </Parameter2>

</Condition2> <Ad_database> Hybrid car Reply/SMS Message or Ads </Ad_database>

<Price>

<Amount> $1.00 </Amount>

<Contingency> Impression </Contingency>

</Price>

</Rule>

[0147] In one implementation, the elements of FIG. lib may form the basis of a user interface for marketer rule generation. A marketer and/or other CTIS user may be presented with lists of user profile data sets (1147) and server data pulls (1158) that may be dragged and dropped to the marketer rule box (1 165) to generate a marketer rule. When the parameter values have been specified and the rule is complete, the user may click OK to submit the rule and/or drag and drop the rule to a marketer rules database icon (1181).

[0148] FIG. 11c shows an implementation of logic flow for generating a rule queue in one embodiment of CTIS operation. A rule is instantiated (1182), and the CTIS server checks parameter quanta associated with the rule (1183). A runtime quantum is discerned for the rule (1184) to determine the timing for applying the rule. The rule is subsequently parsed to generate the appropriate query structure (1185), and the cron schedule for the rule is established based on the runtime quantum (1186). The rule may then be pushed to the cron schedule queue (1187), and a determination made as to whether there are any additional new rules to process (1188).

[0149] FIG. lid shows an implementation of logic flow for cron job queue management in one embodiment of CTIS operation. The CTIS may monitor the cron job queue and, for each queued cron job associated with a rule that is next in the queue (1189), the CTIS may determine whether or not it is time for that particular cron job to run (1190). If not, then the CTIS passes to the next cron job in the queue (1191). On the other hand, if it is time to run, then the appropriate databases specified in the rule are queried, and the particular cron job is dequeued (1192). If the results of the database query match the rule criteria so as to require serving a Reply/SMS Message or Ad impression to a user, then that match indication may be passed to Reply/SMS Message or Ad selection modules in order to choose a Reply/SMS Message or Ad to supply to the user. In one implementation, the marketer rule itself may uniquely determine a Reply/SMS Message or Ad to serve. In another implementation, the marketer rule may determine a set or class of Reply/SMS Message or Ads to serve, from which a unique Reply/SMS Message or Ad may then be randomly selected. In yet another implementation, as Reply/SMS Message or Ad may be selected from the marketer rule determined set or class of Reply/SMS Message or Ads based on a user profile.

[0150] It must be emphasized again that this is but a single, specific embodiment of the non- triggered Reply/SMS Message or Ad serving procedure intended for illustrative purposes. The procedure is highly flexible and can be finely tuned for the specific application at hand. Some other possible methods may include different relative weighting factors, alternative weighting considerations, categorical filtering, consideration of the number of provider zone breaches above the threshold level, graduated consideration of the distance from the provider location, modified provider zone shapes, pattern recognition algorithms, artificial intelligence facilitation, and/or the like.

COORDINATING PERSONNEL BASED ON PROFILES

[0151] In an embodiment, personnel directives may be served that are targeted based on characteristic profiles, behavioral patterns, and/or contextual surroundings and situations. A project manager may deliver personnel directives based on user activities, such as may be registered by codes scanned by mobile devices, as well as user characteristics and an

accumulated history of user activities (e.g., code scans). The scans, together with geographic, temporal, and user-specific information, are obtained by the server that receives, processes, and records the message. Based on these messages and a user profile—which may include

continuously updated user-specific behavior information, situational and ambient information, an accumulated history of scanned code messages, and integration with outside database

information—the server selects information to serve to the users' mobile devices from an information base. For example, a user who scans a barcode for a house-building project with his/her cell phone and whose profile lists his/her role as "mason" may be directed to begin mixing mortar. When he/she is finished, he/she may scan a completion barcode to receive the next directive (e.g., to begin laying bricks). In one embodiment, the code triggered information server allows managers to supply product information and/or personnel directives to users by selecting content based on a combination of the context of the code that the user scanned, the user's status and/or employment position as recorded in his or her user profile, the user's demographic profile, situational information, and a record of scanned codes. These factors can be analyzed and employed by the CTIS for both user tracking and behavioral profiling/targeting. In another embodiment, the code triggered information server may supply personnel directives solely based on user profiles with no immediately contiguous code scans. For example, the system may predict user trajectories based on the collected history of code scans, including the locations where the scans occurred. Then, based on these predicted trajectories, it may direct all users with "emergency service personnel" in their profiles who are projected to be in the vicinity of an emergency situation to report for duty. It may even provide more detailed directives to each specific type of emergency service personnel based on the title and experience level listed in each user's profile, and on the specific location of the user with respect to the emergency situation.

[0152] In an embodiment, the CTIS allows managers to obtain better operational success rates by supplying personnel directives to users that are specific to the users' current geographic locations at specific times of the day. In another embodiment, the CTIS provides rapid and evolving geographic and historical statistical profiling of user progress and behavior. In another embodiment, the CTIS provides an expanded platform to supply large quantities of information and/or personnel directives with a minimal amount of publication space.

[0153] From the user point of view, the CTIS provides a mechanism by which, in exchange for scanning a code and providing basic information, he/she can receive the most targeted information and/or personnel directives relevant to his/her role in the collective operation. At the same time the system grants a manager a powerful tracking tool, to monitor roles,

accomplishments, failures, and behavioral patterns of users on individual, demographic, temporal, and geographic scales. This allows, among other things, the deployment of anticipatory information/personnel directives that are served to users in anticipation of their locations and/or operational progress based on an accumulated history of user tracking data.

[0154] Managers participate by contributing content to an Information Base that categorizes and labels that content under a number of considerations, such as subject matter, geographic and temporal identity, status/role specificity, demographic specificity, and/or the like. Elements of the Information Base can then be compared via these labels with comparable labels found in a database of user profiles in order to match content with users via subject, location, time, demographic category, and/or the like. As such, the CTIS efficiently facilitates project management by providing personnel directives to users with highly tailored specificity.

CODES TO EMPLOYEES [0155] In another embodiment, the CTIS provides a mechanism of instituting plans for large- scale coordination of personnel using a single coded broadcast. High-level officials could determine which of a number of coordination plans to institute, each being associated with a unique 2D matrix code, 3D matrix code, or 3D-VR matrix code. When a plan is decided upon, the code is broadcast (such as over television or the internet) and lower-level employees scan the code to obtain instructions, diagrams, maps, etc. that are tailored to the employees' specific profile contents (i.e., job, skills, location, etc.). There may also be authorization information included in the employee profiles that determines whether they are allowed to decode the broadcast. As each employee progresses in their role within the plan, additional codes could be provided to the employee to scan, both to update their tasks and to track their progress, space- time trajectories, etc.

EMPLOYEE TRACKING

[0156] In another embodiment, the CTIS provides a means of employee tracking in a 2-D or 3-D environment. For example, tasks are supplied to employees in the form of 2D matrix codes. When a code is scanned by a given employee, the scan is recorded in the employee's profile and the employee is provided with instructions specific to that task and their position within the organization. When the task is completed, the employee is provided with a completion code that, when scanned, records the employee's successful completion of that task and provides instructions for the next task and/or reward information. In this manner, a record of employee accomplishments is kept as well as information regarding the time taken by the employee to accomplish various tasks. A statistical record of an employee's experience by subject matter may also be generated and included in his/her profile using the CTIS.

VIRTUAL WORLD EMBODIMENTS

[0157] In embodiments, a user profile is used to provide information querying and serving in a virtual world. Such virtual worlds may include, for example, massively multiplayer online games like The Sims Online, Everquest, World of Warcraft, Second Life, and/or the like. Information and/or advertisement providers may use a code triggered information server to serve context, demographic, and behavior targeted information to users in a virtual world. Users, in turn, trigger the provision of information by scanning or observing codes or information, or by making decisions within a virtual world such as attempting a mission within a game, and/or the like. The triggers, together with virtual world geographic, temporal, and user-specific information, are obtained by the server that receives, processes, and records the message. Based on these messages and a user profile—which may include continuously updated user-specific behavior information, situational and ambient information, an accumulated history of triggers, and integration with outside database information—the server selects information to serve to the user in a virtual world from an information base. For example, a user in Second Life who likes modern clothing for his/her avatar may be presented with Reply/SMS Message or Ads on virtual billboards from advertisers of virtual in-game clothing stores that are near his/her virtual position. In another example, an advertisement tailored to a user's particular interests or behavioral patterns may be placed at a location within a virtual world that the user is known to routinely pass.

[0158] In one embodiment, the CTIS allows advertisers to supply product information in a virtual world to the consumers who would be most interested in such ads or Reply/SMS messges; this may be achieved by the CTIS selecting advertising content based on a combination of the context of the code that the consumer scanned, the consumer's stated interests as recorded in his/her user profile, the consumer's demographic profile, a decision made within a virtual world, situational information, and a record of scanned codes and/or virtual world decisions; these factors can be analyzed and employed by the CTIS for both user tracking and behavioral profiling/targeting. For example, a player in The Sims Online who frequently acquires new furniture for his/her virtual apartment and has a stated interest in modern art may be served advertisements for an actual furniture store that sells modern furniture and is near the user's geographic location following one such virtual furniture acquisition. In another example, a user in Second Life that likes modern clothing for his/her character may be presented with

Reply/SMS Message or Ads on virtual billboards from advertisers of virtual in-game clothing stores that are nearby the user's virtual position (or offer a virtual transportation link that will instantly move the user's avatar to the virtual in-game store).

[0159] The CTIS delivers targeted Reply/SMS Message or Ads to users in a virtual world while simultaneously providing detailed customer tracking information to Reply/SMS Message or Ad providers. The CTIS supplies Reply/SMS Message or Ad providers with greater precision and focus to provide consumers with the information that is most relevant to their interests, behavioral patterns, and space-time and/or virtual world trajectories to maximize the possibility of consummating a transaction. In one embodiment, the CTIS is designed to allow advertisers to place Reply/SMS Message or Ads at virtual world locations at specific times of the day such as to increase the likelihood of garnering the attention of prospective customers. In another embodiment, the CTIS yields time and virtual world location resolved records of scans for the determination of coded advertisement visibility. In another embodiment, the CTIS provides rapid and evolving virtual world geographic and historical statistical profiling of user interest and coded advertisement quality. In another embodiment, the CTIS provides an expanded platform to supply large quantities of information and content with a minimal amount of publication space.

[0160] From the user point of view, the CTIS provides a mechanism by which, in exchange for officially registering interest and providing basic information, he/she can receive the most targeted solicitations, enhanced content, sales offers/coupons, and/or the like within a virtual world. User benefits include: relevant and targeted advertising; mobile context specific information; contiguous location and/or immediate event information; coupons and/or offers for many types of goods and services; and/or the like.

[0161] At the same time, the system grants the advertiser a powerful tracking tool, to monitor behavioral patterns of consumers on individual, demographic, temporal, and virtual world geographic scales. This allows, among other things, the deployment of anticipatory advertising: serving advertisements to users in anticipation of their locations and/or potential interests based on an accumulated history of user tracking data. Other Reply/SMS Message or Ad provider benefits include: compilation of highly specific customer tracking information, including customer virtual world trajectories; virtual world location and/or time specific advertising; highly flexible coded advertising placement; quick and updated determination of coded advertisement visibility; and/or the like.

[0162] Of benefit to both users and Reply/SMS Message or Ad providers is the fact that users improve the specificity of their Reply/SMS Messages with each successive scan, since each scan further refines the contents of the user profile. Users thus have a motivation to scan as many codes as possible related to subjects of interest and will thereby be exposed to more

advertisements than in more traditional, passive advertising and marketing schemes.

[0163] Ad providers participate by contributing content to an Information Base that categorizes and labels that content under a number of considerations, such as subject matter, virtual world geographic and temporal identity, demographic specificity, and/or the like. Elements of the Information Base can then be compared via these labels with comparable labels found in a database of user profiles in order to match content with users via subject, virtual world location, time, demographic category, and/or the like. As such, the CTIS efficiently facilitates commerce by providing advertising to consumers with highly tailored specificity.

QUERYING AND SERVING INFORMATION ON THE INTERNET

[0164] In an embodiment, the CITS delivers information on the internet based on user activities, such as may be registered by codes scanned by mobile devices or website links selected on a computer, as well as user characteristics and an accumulated history of user activities. For example, information and/or advertisement providers may use CTIS to serve context, demographic, and behavior targeted information to users on the internet. In particular, information and/or advertisements are served on the internet that is targeted to the individual based on the individual's characteristic profile, behavioral patterns, and present contextual surroundings, either in real space of cyberspace. For example, a web-based advertisement may be provided on an internet enabled mobile device for goods and services located near a mobile user, which advertisement is selected based on the user's behavioral patterns and stated interests.

[0165] In one embodiment, the CTIS allows advertisers to supply product information on websites to the consumers who would be most interested in such ads; this may be achieved by the CTIS selecting advertising content based on a combination of the context of the code that the consumer scanned or the web link that the user selected, the consumer's stated interests as recorded in his or her user profile, the consumer's demographic profile, situational information, and a record of scanned codes or web links; these factors can be analyzed and employed by the CTIS for both user tracking and behavioral profiling/targeting. For example, a user with a stated interest in running and a recent pattern of scanning codes related to shoes may be served a web- based advertisement on his/her internet-enabled mobile device for a new running shoe being sold at a nearby shoe store. In another example, a user profiled to be a teenager and having a pattern of browsing websites related to comic books may be served a web-based Reply/SMS Message or Ad for the newest comic book themed movie when he/she visits a movie-listings website

[0166] Users, in turn, trigger the provision of information by scanning or observing codes or information, or by selecting web links. The triggers, together with geographic, temporal, and user-specific information, are obtained by the server that receives, processes, and records the message. Based on these messages and a user profile—which may include continuously updated user-specific behavior information, situational and ambient information, an accumulated history of trigger messages, and integration with outside database information—the server selects information to serve to a user on the internet from an information base.

[0167] For example, a user with a recorded history of interest in coffee products may be served an advertisement for a nearby coffee shop while browsing the web on his/her PDA. In one embodiment, information may also be served to users on the internet based solely on the user profiles, and without any initiating trigger. This is based on user trajectories or web-surfing habits deduced from the accumulated history of triggers. For example, a user known to routinely visit a music vendor website near the same time each day may be served an advertisement for the latest top-selling CD shortly before that time.

COUPON AND CONTENT SHARING

[0168] In another embodiment, the CTIS provides targeted coupons to consumers. By scanning a code in an article or advertisement of interest or registering interest in a 2D, 3D, or 3D VR environment, a user may be provided with a coupon code for a store or establishment near the location where the scan took place, thereby increasing the likelihood that the coupon would be used. Choosing the coupon based on the contents of the user profile may further increase the likelihood of a consummated transaction.

[0169] FIGS. 12a-b show two examples wherein the CTIS supplies coupons and/or discount info to a user. FIG. 12a shows an advertisement 1205 for hay fever medication that contains a scan code, which may be embedded in a 2D, 3D, or 3D-VR environment. Upon scanning or clicking the code, the user's cell phone is supplied with a coupon 1210 for 25% off the advertised medication, along with a nearby store at which to redeem the coupon. FIG. 12b shows an article related to events and nightlife in New York City 1215 that contains a scan code, which may be embedded in a 2D, 3D, or 3D-VR environment. Upon scanning or clicking the code to obtain additional content, the user may also be provided with a contextual SMS message or

advertisement for a local bar 1220, including an announcement of happy hour discount prices based on the time of the scan. In an alternative embodiment, the coupon could be provided to the user based on an anticipated provider zone breach rather than a contiguous, causal code scan. AMBIENT CONDITIONS AND IMPACTS

[0170] In embodiments, ambient and/or other situational conditions that may be considered in selecting and targeting information include temperature, weather, light levels, UV levels, pollen count, humidity, air quality, prices of commodities and/or consumer goods, stock and/or financial index prices, global and/or local news events, internet activities, sports scores, entertainment news, security warnings, and/or the like. As such, the code triggered information server (CTIS) delivers information based on user activities, such as may be registered by codes scanned by mobile devices, which may be embedded in a 2D, 3D, or 3D-VR environment, as well as user characteristics, an accumulated history of user activities (e.g., code scans), and ambient conditions. For example, a user in the midst of high ambient temperatures who is profiled as a teenager who enjoys sweets and has a recorded history of scanning codes pertaining to fast food restaurants may be served an advertisement for the newest ice cream sundae product at a fast food restaurant near the user.

[0171] The user's code scans, together with geographic, temporal, and user-specific information, are obtained by the server that receives, processes, and records the message. Based on these messages and a user profile—which may include continuously updated user-specific behavior information, situational and ambient information, an accumulated history of scanned code messages, and/or integration with outside database information—the server selects information to serve to the users' mobile devices from an information base. In one embodiment, the code triggered information server allows advertisers to supply product information to the consumers who would be most interested in such ads; this may be achieved by the CTIS selecting advertising content based on a combination of the context of the code that the consumer scanned, the consumer's stated interests as recorded in his or her user profile, the consumer's demographic profile, situational information, and a record of scanned codes; these factors can be analyzed and employed by the CTIS for both user tracking and behavioral profiling/targeting.

[0172] In another embodiment, the CTIS may serve Reply/SMS Message or Ads based on prevailing ambient conditions or climate at users' space-time positions when the user engages in the capture environment. For example, this may occur when the relevance score for contextual Reply/SMS Message or Ads is low. An illustration of the logic and data flow in this embodiment is provided in FIG. 13, wherein the contextual Reply/SMS Message or Ads selected from the Information Base on the basis of code scan and user profile are supplanted in favor of

Reply/SMS Message or Ads chosen on the basis of prevailing ambient conditions at 1340.

Exemplary embodiments are provided in FIGS. 14-15. In FIG. 14, a Reply/SMS Message or Ad for allergy medication is provided 1447 in lieu of weak contextual Reply/SMS Message or Ad options 1442 in response to a code scan from the weather section of a media publication 1407 in conjunction with ambient weather information, including pollen count, queried at the server 1412. In FIG. 15, an Reply/SMS Message or Ad for sunscreen is provided 1547 in lieu of weak contextual Reply/SMS Message or Ad options 1542 in response to a code scan from the front page section of a media publication 1507 in conjunction with ambient weather information, including humidity and UV index, queried directly by the user's mobile device 1512. In various embodiments, certain ambient conditions such as UV levels, humidity, download/upload speeds, and/or the like may be detected by the user's mobile device itself, while in other embodiments, ambient conditions are separately supplied to a database used in conjunction with the CTIS.

[0173] In another embodiment, the CTIS may serve contextual Reply/SMS Message or Ads with content enhanced by reference to prevailing ambient conditions. An illustration of the logic and data flow in this embodiment is provided in FIG. 16 wherein the contextual Reply/SMS

Message or Ads selected from the information base at 1635 are further refined by the ambient condition information at 1640. Exemplary embodiments are provided in FIGS. 17-20. In FIG. 17, a code is scanned from the Business section of a media publication 1707 and the CTIS selects luxury car Reply/SMS Message or Ads for display 1739 based on the scanned code, user location, and user profile 1732, and these Reply/SMS Message or Ads are further refined based on the ambient weather conditions provided to the server at 1712. In this case, warm and sunny weather provides further context to cause the CTIS to serve a Reply/SMS Message or Ad for a luxury convertible 1747. In FIG. 18, a code is scanned from the Travel section of a media publication 1807 and the CTIS selects travel Reply/SMS Message or Ads for display 1839 based on the scanned code and user profile 1832, which includes recent scan code transactions pertaining to travel and Miami sports scores. The CTIS consequently queries the prevailing ambient weather conditions, comprised of cold and rainy weather, and supplies a Reply/SMS Message or Ad for Miami travel opportunities. In FIG. 19, a code is scanned from the Weekend section of a media publication 1907 and the CTIS selects a contextual Reply/SMS Message or Ad for eating out 1939 from the Information base 1935 to serve based on the scanned code and the prevailing ambient weather conditions, which are hot and sunny 1912. This Reply/SMS Message or Ad is further refined by the user profile contents 1932 indicating a college student interested in comics and entertainment, and a Reply/SMS Message or Ad for an ice cream shop is finally supplied 1947. In FIG. 20, a code is scanned from a baseball team schedule within a media publication 2007. Based on the prevailing ambient weather conditions, including scattered showers 2012, the scanned code, and the recent activity in the user profile 2032, a Reply/SMS Message or Ad is supplied for ponchos and golf umbrellas 2042.

[0174] In various embodiments, the CTIS may serve Reply/SMS Message or Ads based on a wide variety of different ambient and/or situational conditions that may be detected by the client mobile device, provided by internal or third party databases or information feeds, and/or the like. Some non-limiting examples of potential ambient and/or situational conditions that may be considered and/or employed in selecting information to serve are temperature, weather, light levels, UV levels, pollen count, humidity, air quality, prices of commodities and/or consumer goods, stock and/or financial index prices, global and/or local news events, internet activities, sports scores, entertainment news, security warnings, and/or the like. Consideration of such factors, by themselves or in conjunction with knowledge of a user such as may be gleaned from a user profile, may form the basis of information serving rules that have great specificity of targeting. For example, a marketer rule within the CTIS may specify that a Reply/SMS Message or Ad for participating bars that includes a coupon for a particular brand of beer be served to all male users between the ages of 21 and 40 with a history of scanning baseball-related codes within three hours of any time that the local baseball team wins a game. In another example, a marketer rule within the CTIS may specify that a Reply/SMS Message or Ad for hybrid vehicles be served to all mothers with young children who have a history of scanning codes in Time magazine whenever the local price of gasoline is greater than $2.50/gallon and they scan a code in an issue of Time that contains articles on both global warming and the Iraq War. Such hyper- targeted information serving, enabled by the CTIS, may prove very valuable to marketers and, in fact, to a wide variety of information dissemination applications. Advertisers may be able to purchase Reply/SMS Message or Ad time and/or impressions that are conditional on events, people, time, place, ambient conditions, and/or combinations thereof, and/or the like.

Consequently, a premium may be charged to advertisers for each Reply/SMS Message or Ad served, and that premium may increase with the number of factors considered in serving the Reply/SMS Message or Ad (i.e., the degree to which the Reply/SMS Message or Ad serving is targeted). In another implementation, a different price may be charged per impression depending on the characteristics of the individual to which the Reply/SMS Message or Ad is served. For example, the hybrid car Reply/SMS Message or Ad described above may cost an advertiser

$0.75 for an impression to a mom with adult children but $1.00 for an impression to a mom with young children. Such graded pricing schemes may be specified within a marketing rule data structure.

INTERNET CLIMATE

[0175] In another embodiment, Reply/SMS Message or Ads may be served based on internet "climate," such as serving Reply/SMS Message or Ads for virus detection software during an outbreak or serving Reply/SMS Message or Ads for high-speed broadband internet service on days of high internet traffic. Conditions for specific websites (i.e., cyberspace-time positions) could even be taken into account. For example, a Reply/SMS Message or Ad for high-speed broadband internet service could be supplied to visitors of a website experiencing particularly high traffic.

[0176] In another embodiment, the CTIS may interface with various customer information databases, customer relationship management databases, and/or any other third party data sources in order to extract information that may be used to further target and/or refine

Reply/SMS Message or Ad selection for a given user. In one implementation, a marketer may supply the CTIS with access to a given marketer-specific database and/or data feed, in order to allow the CTIS to access the information therein during Reply/SMS Message or Ad selection processes. It should be understood that the functionality described for this embodiment of the CTIS may be integrated or employed within any of the other CTIS embodiments described herein.

INFORMATION QUERYING AND SERVING ON MOBILE DEVICES BASED ON PROFILES

[0177] In an embodiment, information querying and serving are triggered by codes that are scanned by a user. The information is selected based on the profile of the user. In an illustrative example, a user who is profiled as a teenager with a stated interest in comic books and a record of scanning codes related to movies may be served an advertisement for the latest comic book themed movie playing in the next hour near his/her present geographic position the next time he/she scans a code from the entertainment section of the newspaper.

ANTICIPATORY INFORMATION QUERYING AND SERVING ON MOBILE

DEVICES BASED ON PROFILES

[0178] In one embodiment, information may also be served to users based solely on the user profiles, and without any initiating code scan. This may be based on predicted space-time trajectories derived from the accumulated history of scanned codes.

[0179] The CTIS delivers information based on user activities, such as may be registered by codes scanned by mobile devices, as well as user characteristics and an accumulated history of user activities (e.g., code scans). The scans, together with geographic, temporal, and user- specific information, are obtained by the server that receives, processes, and records the message. Based on these messages and a user profile—which may include continuously updated user-specific behavior information, situational and ambient information, an accumulated history of scanned code messages, and integration with outside database information—the server selects information to serve to the users' mobile devices from an information base. In one embodiment, the code triggered information server allows advertisers to supply product information to the consumers who would be most interested in such ads; this may be achieved by the CTIS selecting advertising content based on a combination of the context of the code that the consumer scanned, the consumer's stated interests as recorded in his or her user profile, the consumer's demographic profile, situational information, and a record of scanned codes. These factors may be analyzed and employed by the CTIS for both user tracking and behavioral profiling/targeting. This information can then be supplied to a user based on anticipated user trajectories and/or interests, as may be determined from the record of scanned codes.

[0180] For example, the space-time trajectories of a user who has scanned barcodes in magazines using his/her cell phone over a period of time may be determined, and future likely trajectories determined. Then, advertisements could be served to the user based on where the user is expected to be at a given time, his/her demographic profile, his/her stated interests, and the types of advertisements or articles from which he/she has scanned codes in the past. As an illustrative example, a user may have a history of scanning codes related to fast food, a stated interest in sweets, and a project path passing near a particular fast food restaurant at a particular time. This user may be served an advertisement for the latest dessert product at that restaurant on his/her cell phone shortly before he/she is expected to pass the restaurant.

DETERMINING AND ANNOUNCING PROXIMITY BETWEEN TRAJECTORIES

[0181] The present disclosure is directed to apparatuses, methods and systems for determining and announcing proximity between trajectories. Existing schemes fail to take full advantage of the tracking and context targeting possibilities enabled by the present disclosure. In particular, they do not allow tracking and proximity notification that is targeted to the individual consumer's characteristic profile, behavioral patterns, and present contextual surroundings. As such, this disclosure details a code triggered information server (CTIS) that tracks users and notifies them of proximity with other users based on user activities, such as may be registered by codes scanned by mobile devices, web links selected on a computer, or decisions made in a virtual world. For example, a recorded history of scanned barcodes, as well as the time and location of each scan, may be analyzed to determine where a user has been and what they were interested in scanning at the time. Based on such a record, a prediction of a user's likely location may be made. Then, intersections or near-misses for such predicted trajectories between different users may be determined and reported. The CTIS may also incorporate user characteristics and interests.

[0182] As the first proximity notification system with geographic, context, and behavioral specificity based on user profiles, the CTIS is designed to analyze user behavioral patterns in order to statistically derive user trajectories and tracking information. In one embodiment, the CTIS is designed to compare expected user space-time trajectories to determine when two or more users are likely to be within a specified distance of each other at a given time. In another embodiment, the CTIS is designed to compare expected user web-surfing habits to determine when two or more users are likely to be on the same website, or within a specified number of links from each other, at a given time. In another embodiment, the CTIS is designed to compare expected user trajectories within a virtual world to determine when two or more users are likely to be within a specified virtual distance from each other within the virtual world. In another embodiment, the CTIS provides rapid and evolving geographic and historical statistical profiling of user activity.

DEVICE OPTIMIZED ADS OR SMS MESSAGES

[0183] In another embodiment, the CTIS can interface with and optimize Reply/SMS Message or Ads for various User Agent devices, which may include PCs, laptops, PDAs, DVRs, cable boxes, internet-coupled media devices, and generally with programmable electronic devices, which may be employ a 2D, 3D, or 3D-VR environment possessing external data transfer capabilities and/or the like. FIG. 21 provides an illustration of the logic and data flow in one embodiment. At 2115, the Scan Message content further incorporates an optional Send to Device info, which specifies the destination User Agent device for a particular Ad. Then, at 2150, the Reply/SMS Message or Ad content selected by the CTIS is configured and/or optimized for the User Agent device. Exemplary embodiments are provided in FIGS. 22-23. In FIG. 22, a code from a sports publication is scanned by a cell phone 2207, and a set-top-box/cable box/DVR User Agent device is specified in the optional Send to Device information of the Scan Message 2217. Consequently, in addition to contextual Reply/SMS Message or Ads supplied to the user's cell phone containing article/video links 2237 and season ticket offers 2239, additional content is configured and sent to the User Agent device, such as authorization to descramble a pay-per- view sporting event. In one embodiment, the user's mobile device would provide a signal to the User Agent device to cause it to send a Request for Info to the CTIS. In another embodiment, the CTIS could send an appropriately configured signal to the User Agent device without the need for a Request for Info signal. In FIG. 23, a code is scanned from the Technology section of a media publication using a cell phone 2307, and the optional Send to Device info in the Scan Message specifies to send to a PC laptop 2317. In accordance with the ambient conditions embodiment discussed previously, the CTIS gauges the ambient conditions 2320 associated with the device and determines that there has been a recent outbreak of a particular computer virus over the internet 2322. Consequently, the CTIS supplies an offer for Virus Scan software subscriptions 2344, and may send Virus Scan software directly to the specified PC laptop based on user response.

A GRAPHICAL CODE-SERVING INTERFACE

[0184] In an embodiment, information is displayed in an electronic system by displaying a first visual token and animating the first visual token to reveal a second visual token comprising a coded symbol, which may be in a 2D, 3D, or 3D-VR environment. The animation of the first visual token may be in response to a user action. In an embodiment, the user action is a selection response that uses a user pointer. The animation may include, for example rotating the first visual token to reveal a coding symbol on a proximate side of the first visual token.

[0185] The encoding symbologies for example, matrix codes, may be placed proximate to graphical elements in a wide variety of digital display contexts and media, including portable display devices, mp3 players, cell phones, digital paper, animated billboards, websites, internet or television broadcasts, software interfaces, and/or the like. Users may capture images of information encoding symbologies from such displays, for example using a cell phone camera, and decode them with software applets to receive additional information, multimedia content, offers, coupons, notifications, and/or the like. [0186] Serving codes to users may be accomplished by a variety of different means and in a variety of different contexts. FIGS. 24-26 illustrate some implementations of graphical code serving interfaces (GCSIs) in embodiments of the GCSI/CTIS system. In these implementations, a graphical display and/or interface initially presents a first visual token for display. This first visual token may comprise virtually any image, picture, drawing, emblem, icon, logo, animation, and/or the like. This first visual token may then be animated to reveal a second visual token comprising encoded information, such as a QR code, matrix code, bar code, and/or the like. Animation of the first visual token may, for example, comprise rotation of the first visual token to reveal the second visual token on a proximate side of the first visual token. For example, a two-dimensional picture in the graphical display may rotate in the third dimension to reveal a matrix code on the back of the picture. Other forms of animation may also be employed within different implementations. For example, the first visual token may dissolve, morph, disassemble and reassemble, and/or the like to reveal the second visual token. In some implementations, the animation of the first visual token to reveal the second visual token may occur only in response to some user interaction with the first visual token. For example, a computer screen may display a first visual token persistently until a user clicks on the first visual token with a mouse pointer, at which time the first visual token may rotate to reveal the second visual token on its back. In another example, an electronic billboard may persistently show an advertisement until a motion sensor detects someone walking by, at which time the advertisement dissolves to reveal a matrix code underneath. In still another example, an electronic sign may display a particular image until a detector coupled to the sign detects a signal and/or an authorization code from a compatible, portable electronic device near the detector, at which time the image may morph into a barcode. In still another example, the first visual token displayed on a touch-sensitive display may flip over to reveal a code when a user touches it with a finger or runs a finger over it to simulate a flipping motion.

[0187] FIG. 24 shows an implementation of a user interface manifesting GCSI/CTIS

functionality on a portable electronic device in one embodiment of GCSI/CTIS operation. A wide variety of different portable devices may execute and/or coordinate with GCSI/CTIS functionality, such as but not limited to portable media players, cellular telephones,

BlackBerries, PDAs, and/or the like. In the illustrated implementation, a portable media player displays album information, including an image of the album cover, on a graphical display, where the displayed information corresponds to music being played on the player 2401. A user may click on or otherwise select the album cover image, causing it to increase in size 2405 and rotate 2410-2415 to reveal a matrix code on the image 2420.

[0188] FIG. 25 shows an implementation of a user interface manifesting GCSI/CTIS

functionality on digital paper in one embodiment of GCSI/CTIS operation. Here, an image is included in one area of an article displayed on the paper 2501. Either by itself or in response to some user action, the image flips 2505 to reveal the code on its other side 2510.

[0189] FIG. 26 shows an implementation of a user interface manifesting GCSI functionality on a digital billboard in one embodiment of GCSI/CTIS operation. A public, electronic billboard display shows an advertisement comprising a product logo 2601. The product logo rotates 2605 to reveal a matrix code on its opposite side 2610. Flipping of the logo may occur periodically or aperiodically, upon detection of a nearby viewer, upon detection of a portable device capable of decoding the matrix code, and/or the like.

CODE-MEDIATED CONTENT DELIVERY PLATFORM

[0190] Embodiments are directed to apparatuses, methods, and systems for a code-mediated content delivery platform comprising a Graphical Code-Serving Interface and a Code Triggered Information Server ("GCSI/CTIS"). The GCSI/CTIS connects information encoding

symbologies, and by proxy the underlying information content, to graphical display elements, to graphical interface elements and facilitates generation of encoding symbologies, error-correction, media sampling and purchasing, social networking, and sales promotion programs.

[0191] In an embodiment, active display elements provide access to information, particularly information that is targeted to an individual's profile, interests, and/or contextual surroundings and that is portable and/or made available in unexpected physical locations. The active display elements facilitate the serving of such information via placement of information encoding symbologies, such as matrix codes, proximate to graphical elements in a wide variety of digital display contexts and media, including portable display devices, mp3 players, cell phones, digital paper, animated billboards, websites, internet or television broadcasts, software interfaces, and/or the like. Users may capture images of information encoding symbologies from such displays, for example using a cell phone camera, and decode them with software applets to receive additional information, multimedia content, offers, coupons, notifications, and/or the like.

[0192] In one embodiment, a code sent via a communications network from a mobile communications device from a user is received. The code is based on a scan of an optically- readable coding symbol. A code database is queried to discern a multimedia content data identifier corresponding to the received code. Multimedia content data is retrieved from a multimedia database based on the multimedia content data identifier. A sample of the multimedia content data is sent to the mobile communications device via a communications network. A sample acceptability message is received from the user. The multimedia content data is sent to a data repository associated with the user provided that the sample acceptability message indicates that the user wishes to receive the multimedia content data.

[0193] In another embodiment, an alphanumeric string comprising a plurality of characters and representing a location of multimedia content data is received from a first data source. Each of the plurality of characters of the alphanumeric string is converted into a corresponding binary number to yield a plurality of binary numbers based on a character correspondence table. The plurality of binary numbers are concatenated to yield a bitwise array. An optically-readable encoding symbol comprising a plurality of disconnected solid shapes is drawn in which the presence of a solid shape at a position in the symbol indicates presence of a 1 in a corresponding position of the bitwise array.

[0194] In another embodiment, an incomplete code associated with an optically-readable encoding symbol is received. A code database is queried based on the incomplete code to determine a plurality of possible matching codes. The code records associated with the plurality of possible matching codes are queried to retrieve code presentation conditions associated with each of the plurality of possible matching codes. A plurality of code repair schemes are retrieved from a code repair database based on code presentation conditions. Each of the plurality of code repair schemes are applied to the incomplete code to yield a plurality of repaired codes. A repaired code is selected from the plurality of repaired codes based on at least one pre-designated code fidelity rule. The repaired code is designated as a correct code corresponding to the optically-readable encoding symbol.

[0195] In another embodiment, a scan indicator comprising an indication that a user has scanned an optically-readable encoding symbol with a mobile scanning device is received. The optically- readable encoding symbol is associated with a good or service. A retailer at which the user scanned the optically-readable encoding symbol is identified. A retailer record is queried to determine whether the retailer is subscribed to a sales promotion program. The retailer is charged a first retailer fee based on the received scan indicator if the retailer is subscribed.

[0196] In another embodiment, an online social network is provided. A user identifier is received and stored. User profile information is received and stored in association with the user identifier. A plurality of user scan indicators indicating that a user has scanned a plurality of optically- readable encoding symbols are received. The plurality of user scan indicators are stored in association with the user identifier. At least one friend designation indicating an association with at least one other user is received and stored in association with the user profile.

[0197] Users may scan codes found in media publications, on billboards or signs, on consumer products or packages, on websites or television screens, on movie screens, on clothing or accessories, on mobile device displays, and/or the like.

[0198] In an alternative implementation, content associated with a captured code or other user interest registration may be sent to a data repository other than a user's mobile device. For example, a user may scan a code corresponding to media content. Rather than triggering the GCSI/CTIS to send the media content to the mobile device with which the code was scanned, the code scan may trigger the GCSI/CTIS to send the media content to a user's computer, an online data repository, and/or the like for storage and later retrieval by the user. For example, the GCSI/CTIS may discern a user identity from the Scan Message (1 15), query user access and/or authorization information, and use that access and/or authorization information to access an online data repository corresponding to the user to store requested media content thereon for later retrieval and/or use by the user.

[0199] FIG. 5d shows an implementation of logic flow for customized repair and/or decoding of obscure or ambiguous scanned codes. An ambiguous code may be received at a GCSI/CTIS system at 581 , such as may be sent via a communications network from a user's mobile scanning device. In one implementation, a scanned code may be qualified as an ambiguous code if an attempt to decode the code does not yield a single result. In one implementation, the system may also receive code scanning conditions 582 describing any of a variety of circumstances of the code scan which may affect the quality and/or fidelity of the scanned code. For example, some relevant circumstances may include the time of day, light levels, use of flash, mobile scanning device type and/or characteristics, code size, contrast, brightness, sharpness, skew, rotation, and/or the like. The ambiguous code and scan conditions may then be passed to a repair queue 583, whereby the system may analyze the ambiguous code and attempt to discern the correct decoded content. A plurality of possible matching codes are determined at 584, and a code database is queried at 585 to extract code presentation conditions corresponding to each of the plurality of matching codes. Code presentation conditions may describe how and where the code was displayed and may comprise a wide variety of factors, such as but not limited to medium (e.g., newspaper, glossy paper, product packaging, television display, website, billboard, and/or the like), likely obscuring factors (e.g., glass covering, tears, distance, and/or the like), and/or the like. The GCSI/CTIS system may then generate a code repair database query based on the presentation conditions and/or scan conditions 586 and query the repair database to extract repair schemes corresponding to the particular presentation and/or scan conditions. For example, a particular code repair scheme may be tailored for and/or correspond to codes displayed on billboards that are scanned after dark by Nokia mobile phones. Extracted repair schemes corresponding to each of the possible matching codes are applied to the ambiguous code at 588, and a determination is made at 589 as to whether any one of the possible matches is now more likely to be correct than the others. This determination may be made, for example, by measuring the fidelity of codes with various repair schemes applied and selecting as the correct code that which has the highest resulting fidelity. If no remaining ambiguity exists as to the correct code, then the favored code is registered with the GCSI/CTIS system at 592. Otherwise, the

GCSI/CTIS may generate a custom recommendation message 590 and send the message to a user and/or a user's mobile device 591. The custom message may, for example, provide tailored recommendations on how the user may improve the fidelity of the code scan based on the possible matching codes and the associated presentation conditions and/or scan conditions.

Tailored recommendations, as well as the repair schemes themselves, may be adjusted based on feedback received from users about which codes they were actually trying to scan. In one implementation, the GCSI/CTIS may provide a query message to a user presenting a summary of content associated with alternative matching codes in order to determine which content the user was actually trying to access. It should be noted that code analysis and/or repair may be undertaken on a code image level, alphanumeric string level, binary string level, and/or the like basis. Combinations of such bases may also be undertaken, such as by first analyzing the ambiguous code in its alphanumeric string form and then, if ambiguity remains, analyzing the code in its binary form. Further discussion on such an analysis is provided below.

[0200] In an illustrative example of partial decoding, a given matrix code may encode the string ABC123. In multiple processes, it may be determined that the code contains A 1 3 (where the blanks represent unknown values), _C1_, and AB_.

[0201] Through these multiple processes, the GCSI/CTIS system now knows that the code contains ABC1 3 and may check this against codes in a code database to determine how many matches exist. If it finds two matching codes (e.g., ABC 123 and ABC 143), it may consider ancillary factors, including code presentation and/or code scan conditions, user profile information, and/or the like. For example, ABC 123 may correspond to an advertisement for a new action movie while ABC143 corresponds to a coupon for women's cosmetics. If the user supplying the code is determined, based on a supplied user ID, to be a man with a history of scanning movie-related codes, then the GCSI/CTIS system may infer that ABC 123 is the matching code and serve the corresponding content. In one implementation, the GCSI/CTIS server may further supply a confirmation request for partially matched codes, requesting the user to affirm or deny that the supplied content is, in fact, the content that he/she was seeking.

[0202] In one implementation, analysis of ambiguous codes may comprise a two-stage process. In a first stage, an encoded string comprising a number of alphanumeric characters, one or more of which may be unclear, may be compared to a database of alphanumeric strings to determine which, if any, match. In one implementation, a Levenshtein distance metric may be employed to determine the similarity of an input string to strings existing in the database. In one

implementation, the input string may only be compared against "live" strings in the database (i.e., strings that are currently engaged in active use and/or tied to actual content). If ambiguity remains about which code has been scanned after this character-based analysis, a GCSI/CTIS system may apply a second stage of analysis, whereby the input alphanumeric string is converted into a corresponding binary bitset array (see, e.g., FIGS. 33a-b and associated discussion below) and a comparison is performed between binary values of the input string and the strings stored in the code database. The most significant bits come first in the bitset array while the least significant bits come last, so priority weighting may be applied against potential value matches based on which bits match between the input and stored strings.

User Interface

[0203] FIG. 7b shows an implementation of a user profile user interface in one embodiment of GCSI/CTIS operation. The profile page 761 may include a display of basic user information 763 and/or a user picture 766, and may provide a wide variety of other user information, including demographic information, interests, media libraries, friend lists, code scanning activities, and/or the like. The displayed implementation further includes a plurality of tabs 769 allowing the user to view profile information, edit his or her profile, view photos, groups to which the user may belong, and/or edit settings, including sharing and/or privacy settings 772. Privacy settings may, for example, control access of other individuals to a user's personal information, code scanning activity, and/or the like. In some implementations, certain information about a user, in particular regarding codes that a user has scanned and/or the content associated with those scans, may be shared with other users. For example, a user may be able to inquire, via a GCSI/CTIS affiliated system, as to what codes have been recently scanned by other users that are within a particular geographic radius of the user. In another example, a user scanning a code to receive a song may also be provided with information about the code scanning activities of other users whose codes also corresponded to songs.

[0204] In one implementation, a user may be allowed to restrict which information of theirs is sent to other users and/or to restrict which information of other users is sent to them. For example, a user may have a "friends" list that has a different level of access than the general public.

[0205] In one implementation, a user may have a personal code that is associated with the user and/or a user profile. In one implementation, other users can scan the personal code to automatically join the first user's friend list. In another implementation, a personal code my comprise a short- link to the user's profile 761 , and/or to other profile pages or webpages associated with the user, such as a Facebook page, Myspace page, and/or the like. In one implementation, the user can set a forwarding instruction on his or her GCSI/CTIS page to forward inquiries corresponding to scans of the user's personal code to another page. In another implementation, the user may provide the personal code on other pages as a link back to the user's GCSI/CTIS profile page.

[0206] In one implementation, a user may be provided recommendations in response to a code scan. For example, the user may scan a code corresponding to a particular song by a particular musical artist. The user may then be provided a listing of other songs, artists, and/or the like having codes recently scanned by the members of the user's friends list and/or that may be further related to the song and/or artist whose code the user scanned.

[0207] In one implementation, a user's code scans may be integrated with an instant messaging, blogging, micro-blogging, and/or the like service, whereby the user's code scans are automatically rendered as descriptive summaries and displayed to other users, such as on a webpage, via SMS text messages, emails, and/or the like. For example, each code scan may have a pre-set text description associated therewith that, upon scanning of the code, is displayed on a user's Twitter.com page. In one implementation, a user may receive an incentive payment for particular types of content that are provided to the user's friends, associates, blog subscribers, and/or the like as a result of the user's code scans. For example, a reward may be provided to the user every time the user scans a code corresponding to a particular brand of products and a message associated with those products is supplied to subscribers to the user's profile and/or blog. A further reward may be provided to the user if it can be determined that one of the user's associates made a purchase based on the provided message.

[0208] The privacy settings in the displayed implementation include permissions for displaying "twitters," songs, videos, and purchases 775 associated with the user's code scans to various security levels for other people 778, including the general public, private/friends, and "snaps" (i.e., those who may have scanned a user's personal code and/or a code corresponding to the user's profile). Selection of a particular privacy setting may generate a sharing rule that is stored in association with the user and consulted each time a user scans a code corresponding to one of the categories shown at 775 to determine whether or not code-associated information should be provided and/or sent to any of the categories of people shown at 778.

[0209] The profile page 761 further includes a field 779 wherein a user may specify the location of a data storage facility to which some or all media and/or other content that the user acquires via code scans are to be sent and/or stored. For example, the user may specify an online storage facility (e.g., Apple's iDisk service) in which the user's code scan-acquired content is to be stored.

[0210] The profile page 761 further includes interface components configured to generate a personal code, in this case a JagTag 780. Selection of the button at 780 causes the GCSI/CTIS system to associate a code with the user and/or the user's profile and generate a corresponding code, which is displayed for the user. The user may then elect to save an image of the code to his or her computer desktop, send the code in an email, send the code in an MMS message, and/or the like via the interface elements at 781.

[0211] In one implementation, coupons may be supplied to a user's mobile device with digital rights management (DRM) software included to prevent or discourage coupon copying, sharing, and/or the like. In another implementation, no DRM software is included with the coupon.

[0212] In one implementation, a GCSI/CTIS server may query, store, and/or consider data pertaining to media demographics associated with a particular medium in which a code is published; the subject content associated with a code; the type of information requested by scanning a code; and/or the like. For example, a user scanning a code associated with a product review for a hybrid sports utility vehicle (SUV) in a men's magazine may trigger a GCSI/CTIS system to draw and/or analyze data pertaining to media demographics associated with the men's magazine, subject content associated with hybrid vehicles (i.e., environmentally conscious consumers), subject content associated with SUVs (i.e., outdoor activity or families), and product reviews. Thus, the GCSI/CTIS may be configured to consider both the subject of a user's inquiry, the source of the inquiry, the type of inquiry, and/or the like.

[0213] In another embodiment, the GCSI/CTIS may allow users to instantly subscribe to and/or enroll in services, loyalty programs, discount programs, and/or the like by scanning codes associated therewith. For example, a user may subscribe to receive weather updates by scanning a weather-linked code. In another example, a user may enroll in a brand-affiliated coupon program by scanning a code associated with that program. Selection of a subscription and/or enrollment code may cause the GCSI/CTIS to submit a user's personal information to an integrated subsystem and/or third-party system for subscription registration. In some

implementations, the GCSI/CTIS may require verification from the user, separate from the code scan itself that the user wishes to enroll and/or subscribe to the associated service. In some implementations, a user may submit trigger specifications and/or conditions for enrolled service notifications. For example, a user may specify that he or she only wishes to receive weather updates associated with heavy rain or thunderstorms. In another example, a user may specify that he or she only wishes to receive coupons for products from a particular grocery store and not from other grocery stores. Scanning of a code associated with a subscription program wherein specification of triggers and/or conditions is permitted may cause a GCSI/CTIS system to retrieve and display a user interface screen to the user that is tailored to the particular

subscription and/or enrollment service and configured to receive trigger and/or condition specifications.

[0214] In another embodiment, the GCSI/CTIS may be configured to track and/or implement a rewards program. For example, in a single-tiered rewards program implementation, a user may scan a code every time he or she purchases a particular item (e.g., a sandwich from the local sandwich shop) in order to register each purchase and store a record thereof in association with the user. The user may then receive a discount, free item, and/or the like after a pre-designated number of purchases and associated scans are registered, after which the record of scans is reset to start anew. In another example, in a multi-tiered rewards program implementation, a user may continue to register additional purchases and associated code scans to receive larger and/or more significant benefits, discounts, and/or the like.

[0215] In another embodiment, the GCSI/CTIS may be configured to implement contests and/or prize awards. For example, a user may enroll in a contest by scanning a code associated with the contest, causing personal information, user identifiers, and/or the like to be submitted to a contest subsystem. Such contests may comprise instant- win and/or other types of lotteries, auctions, raffles, and/or the like and/or may enroll the user in a contest program through which they may receive further instructions, possibly including additional codes for scanning, in the future.

[0216] In another embodiment, the GCSI/CTIS may be configured as a voting facility. A user may register a vote for a particular candidate, ballot initiative, viewpoint, survey result, and/or anything else for which a vote may be registered by scanning a code associated with the user's choice. In one implementation, a user identifier may be discerned and submitted with the vote in order to prevent repeat voting, to correlate with voter registration, and/or the like. In one implementation, voter identifying information may be stripped from a scan message prior to the message being provided to particular agencies or individuals, in order to preserve a secret-ballot style of voting.

[0217] In another embodiment, the GCSI/CTIS may be configured as a facility to effectuate purchases of goods and/or services. By scanning a code associated with a particular good or service, a message may be sent to a GCSI/CTIS system identifying the good or service associated with the code as well as identifying the user, such as based on a mobile device identifier. The GCSI/CTIS system may then automatically generate a bill for the user, charge a specified credit account, deduct a payment from a debit account, and/or the like to effectuate payment for the good or service. In one implementation, the GCSI/CTIS may return a payment confirmation, such as to the user's mobile device and/or a retailer's point-of-sale device to confirm that the user has provided adequate payment. [0218] In another embodiment, the GCSI/CTIS may be configured to facilitate communications. For example, a code may correspond to a particular telephone number, IP address, and/or the like. Scanning of the code by a communications-enabled mobile device may cause the mobile device to automatically establish a connection with the address to which the code corresponds. In one implementation, the connection may be established directly by an on-board applet loaded on the mobile device. In another implementation, the connection may be established by an instruction sent to the mobile device by a GCSI/CTIS subsystem in response to a received code scan.

[0219] FIG. 27 shows an implementation of a user interface manifesting GCSI/CTIS

functionality for serving an SMS text message prompt in one embodiment of GCSI/CTIS operation. A first visual token 2701 shows an image and text, such as may correspond to an advertisement, logo, and/or the like. The token may appear in a wide variety of contexts, such as on a website, in a virtual world, on a cell phone or other portable communications and/or media device (e.g., BlackBerry, iPhone, iPod, and/or the like), on an electronic billboard, on broadcast television or recorded video content, and/or the like. The first visual token may be animated, such as by flipping, rotating, revolving, and/or the like (2705, 2710), to reveal encoded content on a proximate side thereof. In the implementation illustrated in FIG. 27, a message appears along with an SMS code that a user may key in to an SMS enabled communication device to receive associated content. In alternative implementations, other types of codes and/or code communication protocols may be displayed and/or employed for communication with

GCSI/CTIS systems, such as but not limited to: MMS, instant messaging, web browser based messaging, email, Enhanced Messaging System (EMS), TCP/IP, WAP, and/or the like. For example, a first visual token may be animated to reveal an email address, website address, instant message nickname, and/or the like on a proximate side to enable a user to connect to and/or communicate with a GCSI/CTIS system and/or affiliated entity for the receipt of information, coupons, offers, advertisements, media, and/or the like.

[0220] FIG. 28 shows an implementation of a user interface manifesting GCSI/CTIS

functionality on a mobile phone 2801 in one embodiment of GCSI/CTIS operation. A first visual token comprising an image, advertisement, logo, and/or the like 2805 is displayed on a mobile phone display screen. The first visual token may be animated 2810, such as in response to a user interaction (e.g., pressing a button on the mobile telephone, clicking on the first visual token with a pointer widget, and/or the like). In an alternative implementation, the first visual token may be automatically animated and/or animate without the need for any user interaction. In the illustrated implementation, the animated first visual token flips to reveal a second visual token comprising a message and an SMS text message prompt on a proximate side 2815. In one implementation, the user may manually key in the text message and/or destination address to receive the associated content. In another implementation, the GCSI/CTIS interface may supply a selectable link that, when selected, will automatically generate an SMS text message to retrieve the associated content. In still another implementation, such as the example illustrated at 2815, the user may be allowed to automatically generate and/or send the SMS text message from the second visual token by pressing a "Send" button on the mobile phone, clicking and/or otherwise interacting with the second visual token, and/or the like.

[0221] In one implementation, a user may receive a coupon and/or coupon code in response to an interaction with the second visual token, sending of an SMS text and/or other message in response to the second visual token, and/or the like. For example, in one implementation, a user may receive a numerical coupon code in response to a sent SMS text message, wherein the numerical coupon code may be presented to a retailer, entered into a website, and/or the like to receive discounts, free items, special offers, and/or the like. In another implementation, the user may receive a scannable code, such as a QR code, matrix code, and/or the like in response to a sent SMS text message, wherein the scannable code may be scanned by a retailer in order for the user to receive the associated benefits, discounts, and/or the like. For example, the scannable code may appear on a user's mobile phone display screen and may be scannable therefrom to provide the user with the benefits associated thereto. In another implementation, the user may receive an e-mail message in response to interaction with a graphical code-serving interface, the message containing requested content and/or links thereto, scannable codes, coupon codes, and/or the like.

[0222] In another implementation, a first visual token may comprise a "poster" image corresponding to a full-length movie, movie preview, video clip, television show, and/or the like. The second visual token revealed on a proximate side of the first visual token may then enable a user to retrieve the full video content associated with the poster image. For example, a user may scroll through a series of poster images corresponding to a series of full-length movies. When the user finds a movie he or she desires to retrieve, watch, download, and/or the like, he or she may select the corresponding poster image, which may then be animated to reveal a second visual token, such as an SMS instruction, message, delivery address, phone number, and/or the like, whereby the user may interact with a GCSI/CTIS system and/or affiliated entity to retrieve the desired movie content.

[0223] In one implementation, a series of first visual tokens may be displayed as scrollable thumbnails, within a cinematic presentation, as an immersive slideshow, and/or the like.

[0224] FIG. 29 shows an implementation of a user interface manifesting GCSI/CTIS

functionality on a portable communication device in one embodiment of GCSI/CTIS operation. The portable communication device 2901 shown in the illustrated implementation may represent a BlackBerry, iPhone, PDA, and/or the like. A first visual token 2905 is animated 2910 to reveal a message and a selectable hyperlink on a proximate side 2915, in this case a URL connecting to content, information, offers, coupons, and/or the like. In one implementation, a user may be permitted to directly select the hyperlink from the displayed image using interface elements of the device in order to retrieve content, view a webpage, interact with a GCSI/CTIS and/or affiliated system, and/or the like.

[0225] A variety of operational models may be employed to provide code-serving interface capabilities to users and content providers alike in accordance with the embodiments and/or implementations described herein. In one implementation, a central GCSI/CTIS server may enable content providers to supply first and/or second visual tokens, associated SMS and/or MMS codes, and/or any other information necessary to connect users to supplied content. The central GCSI/CTIS server may then outfit the supplied tokens and/or other information with HTML markup information allowing the code-serving interface to be embedded in any webpage or other display media. In one implementation, the HTML markup information may further include a link to one or more downloadable applets that may be required to enable a user to view and/or interact with the code-serving interface. Having provided the data corresponding to a first and/or second visual token, SMS and/or MMS code, and/or other information, a content provider may be provided with an embeddable link, URL, and/or the like that may be cut and pasted into a web page HTML to embed the code-serving interface therein.

[0226] In another implementation, a content provider may submit just a first visual token and response content and/or a means of addressing said content, and a GCSI/CTIS server may generate a corresponding code-serving interface, a dial-in code and/or SMS and/or MMS address, hyperlink, and/or the like to allow users to interact with the first visual token to receive the response content. In one implementation, the generated code-serving interface may include HTML markup information enabling it to be embeddable on any webpage. A fee may be charged to the content provider, such as on a pay-per-click basis, for user interactions with the generated code-serving interface.

[0227] In still another implementation, a webpage or other display area may include a generic placeholder for code-serving interfaces that may be filled by code-serving interfaces and/or associated content supplied from one or more advertisement servers and/or GCSI/CTIS servers. The supplied code-serving interfaces may be selected based on webpage content, contextual cues, and/or the like and/or based on the goals of content providers and/or code-serving interface creators. For example, an advertiser may wish to place a particular code-serving interface associated with a new action movie on any webpage having a generic placeholder that mentions extreme sports. A fee may be charged to an advertiser for such targeted and/or contextual placement, such as on a bid-per-keyword basis. Fees may also be charged on a pay-per-click basis (i.e., levying a charge whenever a user clicks a code-serving interface to reveal the code, communication address, and/or the like on a proximate side).

GCSI/CTIS Media Acquisition Example

[0228] In some embodiments, the GCSI/CTIS may be configured to supply media content, music, images, video, and/or the like to users based on the scanning of codes as described above. Acquisition of full media content may, in some implementations, be preceded by acquisition of media samples that may be reviewed by an acquiring user to determine whether or not to proceed with acquisition of the full content. For example, a billboard may display the Billboard Top 20 songs with a separate code for each song on the list. Consumers, in this example, may scan codes corresponding to each song in the list for which they have interest using a mobile scanning device and receive a sample of each song. In one implementation, a sampling user may further be provided with an opportunity to purchase and/or otherwise acquire the full media content once the sample has been received and/or reviewed. In one implementation, media may be acquired by a user via MMS messaging, while in another implementation, media may be acquired by means of an integrated media service (IMS). The IMS may, in one implementation, comprise an on- demand media service wherein users may maintain accounts, sample and/or purchase media, download and/or upload media, and/or the like. An example of an IMS is Apple's iTunes Store. FIG. 30 shows an implementation of logic flow for media sampling and full media acquisition in one embodiment of GCSI/CTIS operation. A code may be scanned by a user 3001 , such as via a mobile device. The scanned code information, as well as hardware information identifying the device, the user, and/or the like may then be received by GCSI/CTIS from the mobile device, such as via a communications network. The GCSI/CTIS may then make a determination, such as may be based on the hardware information, user information, a user profile, and/or the like, as to whether the mobile device is configured with an IMS 3005. If the mobile device is configured with an IMS, the GCSI/CTIS may issue an instruction to the mobile device to connect to the IMS 3010, allowing the user to engage IMS functionality such as the sampling, purchasing, downloading, viewing/playing, and/or the like of media files 3015.

[0229] If the user's mobile device is not configured with an IMS, the GCSI/CTIS may send a message to the device, such as an SMS text message 3020, to determine if the user desires to receive a sample of the requested media 3025. In one implementation, the GCSI/CTIS may first interact with a media service to determine if a sample is available before offering the sample to the user. If a sample is desired, the GCSI/CTIS may send a media sample to the user's mobile device, such as in the form of an MMS message. The sample may, in various implementations, comprise a clipped and/or low-quality version of an audio file, image file, video file, publication, and/or the like. In one implementation, the GCSI/CTIS may first acquire the sample from a music service in order to provide it to the user's mobile device. In an alternative implementation, the GCSI/CTIS may itself generate a sample from an original copy of a media file, such as may be acquired from a media service.

[0230] The GCSI/CTIS may then generate and send a query, such as via SMS text message 3035, to determine if the user would like to purchase the media associated with the scanned code 3040. If not, the GCSI/CTIS may exit the routine associated with the acquisition of the current media file, present alternative and/or related media files for user consideration, and/or the like 3045. If, on the other hand, the user indicates a desire to purchase the media file in question, the GCSI/CTIS may query the user, such as via an SMS text message, as to which of a selection of pricing and/or download options the user would like to pursue 3050. For example, in various implementations, the user may be provided with options as to the quality and/or format of media files acquired, the method of acquisition, accessibility and/or rental options, and/or the like. In the illustrated implementation, the user may be presented with an option as to the method of media acquisition. Specifically, a determination may be made as to whether or not the media is to be acquired directly by the user's mobile device 3055. In the illustrated implementation, the determination is based on a user preference. However in alternative implementations, the determination may be made, in whole or in part, based on a variety of other factors, such as detected capabilities of the user's mobile device, available network bandwidth, pre-set profile settings, and/or the like. If the user selects for the media to be directly provided to his or her mobile device, then a corresponding fee may be charged and the media may be streamed, downloaded, and/or the like directly to the user's mobile device 3060. Alternatively, if the user does not desire to acquire the media directly to his or her mobile device, then the GCSI/CTIS may charge a price corresponding to an indirect delivery mode and conduct the media file to an intermediary storage facility for later retrieval 3065. For example, the GCSI/CTIS may instruct a media service to allocate the media file to a user account for later retrieval by the user. In another example, the GCSI/CTIS may acquire the media file and/or email the file to a user email account for later retrieval. When the user is ready, he or she may obtain the media file from the intermediary storage facility, transfer the file to a mobile device, and/or the like.

[0231] The charging of a fee for acquired media may proceed in a variety of different manners within various embodiments of the GCSI/CTIS. For example, in one implementation, a user may be directly requested to enter payment information (e.g., credit card number, checking account number, etc.) at the time of purchase. The entered information may be verified before the media is made available to the user and/or the user's mobile device. In another implementation, a user may enter payment information into a user profile and have a corresponding account

automatically charged when the user directs the GCSI/CTIS to acquire media.

[0232] FIG. 31 shows an illustration of media acquisition in one embodiment of GCSI/CTIS operation. In the illustrated implementation, a printed publication 3101 displays an advertisement for a new release by a recording artist 3105, the advertisement including a scannable matrix code that facilitates the acquisition of media associated with the new release by a user. In an alternative implementation, an animated user interface may present a scannable code on a proximate side of a first image, such as on a video billboard, website, television program, and/or the like. The media may, for example, comprise an entire album, a single, a ringtone, a video, an image, and/or the like. In one implementation, the media provided may depend on the scanned code in conjunction with a user profile containing user preferences, a history of user behavior and/or prior scanned codes, and/or the like. The user may engage the media content by scanning the code with his or her mobile device 3110, after which the GCSI/CTIS may query the user, such as via an SMS text message, as to whether or not he or she wishes to sample and/or purchase the requested media 3115. The user may respond, in one implementation, by sending a reply text message to be relayed to the GCSI/CTIS. In one implementation, the GCSI/CTIS may subsequently provide, stream, upload, and/or the like the requested media directly to the user's mobile device for storage and/or playback 3120. In another implementation, the GCSI/CTIS may provide the requested media to an intermediary storage facility, such as a user's media service account, an email server, an ftp server, and/or the like. The user may then subsequently procure the media from the intermediary storage facility, transfer the media to a mobile device, and/or the like 3125 at a later time.

[0233] FIGS. 32a-b show an implementation of logic flow for code scan monetization in one embodiment of GCSI/CTIS operation. In FIG. 32a, a code is scanned at 3201. In the illustrated implementation, the code may be found on a physical item that is subject to purchase and may be found in a retail establishment. For example, a compact disc (CD) in a music store may be embellished with a scannable code that, when scanned, may provide a sample of the music stored on the CD, deliver a ringtone to the user's mobile scanning device, provide artist information, images, concert dates, a coupon, and/or the like. In another implementation, the item for purchase may not be physical but rather may be provided online, such as on a website, and an associated code may be provided on the page on which the item is offered for purchase. Once the code is scanned 3201, a determination may be made as to whether the retailer providing the item is subscribed to a GCSI/CTIS service 3205. In one implementation, the retailer may be discerned based on a geographic position provided to the GCSI/CTIS by a code message sent from the user's mobile device that may, for example, be compared to records of retailer locations. The geographic position may be determined, for example, by an on-board GPS unit on the user's mobile device or based on geographic information contained in the scanned code. Subscription to the service may, for example, entail licensing to embellish items with GCSI/CTIS affiliated codes in exchange for a fee, such as a one-time or periodic fee and/or a per-scan fee, such as illustrated in the implementation shown in FIG. 32. If the retailer is determined at 3205 to be a subscriber, then the GCSI/CTIS may register a retailer payment 3210. For example, in one implementation, registering payment may comprise noting the fee in a fee record. In an alternative implementation, the GCSI/CTIS may automatically deduct the fee from a pre- designated account. A determination may also be made as to whether the manufacturer, publisher, distributor, and/or the like of the item in question is a subscriber 3215. For example, for the case of the CD discussed above, the "manufacturer" may comprise a record label. If the manufacturer is determined to be a subscriber, then a manufacturer payment is registered at 3220.

[0234] Discernment of retailer, competitor, and/or manufacturer identities may be accomplished by a variety of different schemes in various implementations and/or embodiments of GCSI/CTIS operation. For example, a unique subset of codes may be reserved for a particular manufacturer, retailer, and/or the like, such that a scan message corresponding to any code of the unique subset may be associated by a GCSI/CTIS system with the particular manufacturer, retailer, and/or the like. In another implementation, retailers associated with a given scanned code may be discerned based on a geoposition of the mobile scanning device at the time of code scanning. FIG. 32b provides an illustration of an implementation of logic flow for discerning retailers in one embodiment of GCSI/CTIS operation. A determination is made at 3267 as to whether the mobile scanning device used to scan a code is position sensitive. Position sensitivity of a mobile device may be facilitated, for example, by an on-board GPS unit, mobile device and/or cellular tower triangulation, trilateration, multilateration, and/or the like. If the device includes one or more position sensitive facilities, the GCSI/CTIS may discern the position of the mobile device 3270. Position discernment by the mobile device and/or the GCSI/CTIS may include drawing raw geographic position data from one of the facilities described above using, for example, mobile device software development kit (SDK) tools, an example of which are those associated with the iPhone SDK toolkit. The GCSI/CTIS system may then query position records based on the position discerned at 3270 to seek retailers matching that position 3273. A determination is made at 3276 as to whether any matching retailers are found. If no retailers match the discerned mobile device position, or if the mobile device lacks position sensitivity at 3267, the GCSI/CTIS system may query code records based on the scanned code received from the mobile device to seek retailers matching the scanned code 3279. A determination is made at 3282 if any retailers are code discernible and, if not, then the GCSI/CTIS may return an error message and/or record that no matching retailer was found 3285. If any matches are found either by position or code discernment, then a determination may be made as to whether there exist multiple retailer matches 3288. If not, then the unique matching retailer may be recorded, provided to facilitate subsequent code scan monetization, and/or the like 3294. If multiple retailer matches exist, the GCSI/CTIS system may apply one or more retailer ambiguity resolution schemes 3291 in order to narrow down the results to a unique retailer match. A wide variety of ambiguity resolution schemes may be employed within different implementations and/or embodiments of GCSI/CTIS operation. For example, in one implementation, a GCSI/CTIS system may consult a user profile associated with the user who's mobile device issued the code scan to determine whether the user's code scan history indicates a preference for a particular retailer, retailer type, and/or the like which may assist in further discerning the unique retailer associated with the current code scan. In another implementation, the GCSI/CTIS system may provide a plurality of possible retailer matches in a message (e.g., an SMS message) to a user's mobile device and request feedback as to which retailer is the correct one in whose establishment the code was scanned.

[0235] A determination may then be made as to whether a conversion has taken place whereby the user has actually purchased the item associated with the scanned code. In one

implementation, the GCSI/CTIS may monitor activity on a credit card associated with a user account once that user has registered a code scan. A subsequent purchase using the associated credit card may then register a conversion with the GCSI/CTIS. If no conversion is detected, such as within a pre-designated period of time, then the code scan monetization is complete for the particular code scan 3230. If, on the other hand, a conversion is registered, a determination may be made as to whether the manufacturer is subscribed to pay further fees upon item conversion 3235. If so, then the additional manufacturer payment for conversion is registered at 3240.

[0236] A determination may be made as to whether the conversion, i.e., the purchase of the code-associated item, was made at the retailer at which the code was scanned 3245. If so, then a determination may be made as to whether the retailer is subscribed to pay an additional fee associated with item conversion 3250. If so, that payment is registered at 3255. If the conversion occurs at a competitor retailer different than the original retailer at which the item-associated code was scanned (e.g., another brick-and-mortar retailer, another website, etc.), a determination may be made as to whether the competitor retailer is subscribed to pay a fee for item conversion 3260. If so, then the competitor payment may be registered at 3265. In one implementation, a competitor may be permitted to supply a message (e.g., an SMS text message, and/or the like) to a user's mobile device when the user scans codes associated with particular items at particular retail locations in order to entice the user to purchase the item from the competitor instead of at the particular retail location in which the code was scanned. The competitor message may, for example, include a coupon and/or other discount on the sale price of the code-associated item. In one implementation, the competitor may be charged a separate fee for being allowed to supply such messages, such as a per-message fee, a one-time or periodic fee, and/or the like.

[0237] In some implementations, fees charged to manufacturers, retailers, and/or competitors may be substantially the same. In alternative implementations, different fees may be charged to manufacturers, retailers, and/or competitors.

[0238] FIGS. 33a-e show aspects of implementations of JagTag encoding and codes in some embodiments of GCSI/CTIS operation. FIG. 33a shows an implementation of logic flow for JagTag encoding in one embodiment of GCSI/CTIS operation. An alphanumeric string may be associated with content to which a JagTag code is ultimately to be associated 3301. In one implementation, a five character string is employed. Each character of the alphanumeric string may then be converted into a corresponding integer, such as may be based on a correspondence table 3302. FIG. 33b shows an implementation of such a corresponding table relating decoded characters, including lowercase letters 3313, numbers 3314, and uppercase letters 3315, to encoded values 3316 comprising integers between 0 and 62. To convert the alphanumeric string into a JagTag code, each character in the string is converted into a corresponding integer between 0 and 62 using the table in FIG. 33b. A determination may then be made as to whether any of the characters comprise punctuation marks or other unrecognizable or uncovertable characters 3303. If so, those characters are set to blanks or zeros in the resulting string of integers 3304. A determination may also be made as to whether the number of characters in the alphanumeric string exceeds a pre-designated maximum number 3305 (e.g., 5 characters). If so, additional characters are ignored 3306.

[0239] Each resulting integer may then be converted to a corresponding binary value 3307, and a determination may be made as to whether there are a sufficient number of "on" bits (i.e., bits equal to 1) 3308. For example, the GCSI/CTIS may require the existence of at least some minimum number (e.g., 9) of on bits. If not, then the system may return an error message and/or recommend that the user try a different initial alphanumeric string 3309. Otherwise, the

GCSI/CTIS system may concatenate the string of binary numbers to yield a single 32-bit long bitset array 3310. The system may then generate a JagTag bit representation 331 1 , as described below, and output the resulting JagTag to a physical display and/or storage (e.g., storing an image formatted JagTag in a database, printing the JagTag, displaying the JagTag on a display screen, and/or the like) 3312.

[0240] The first bit of the bitset array may be considered a most-significant bit and the last bit of the bitset array may be considered a least-significant bit. Once complete, the 32-bit binary bitset array may be converted into a JagTag code representation. FIG. 33c further illustrates JagTag encoding in one implementation. The JagTag may include an L-shaped component 3318 that may, in one implementation, promote orientational and/or size discrimination of the JagTag, such as by a scanning or analyzing device. The JagTag may further include four circular elements 3319 that may also serve to promote orientational and/or size discrimination. The most significant bit of the bitset array may be encoded as a circle at the position indicated by the crossed circle at 3320, with a white circle (owing to the dark background of the L-shaped component 3318) indicating a 1 and no circle indicating a 0. The next most significant bit of the bitset array, then, may be encoded as a circle at the position indicated by the crossed circle at 3325. The numbering scheme indicated at 3330 shows how the circles (or lack of circles) at positions numbered from 0 to 31 correspond to the bits in the 32-bit bitset array, with 0 the most significant bit and 31 the least significant bit. If the bit falls on the L-shaped component 3318, a white circle is drawn for a bit value of 1 , and otherwise a dark circle is drawn for a bit value of 1.

[0241] In one implementation, a shell script may be configured to accept an alphanumeric string comprising characters to be encoded and to return a JagTag in an image format, such as a PNG, JPG, GIF, BMP, and/or the like file format. In one implementation, the shell script may be further configured to receive a color specification (e.g., an HTML-style RGB triplet).

[0242] Configuring a JagTag for optimal recognition may be accomplished in a variety of different ways within different implementations. For example, a color for the JagTag code may be selected to as to have high contrast with the background color. A high number of "on" bits (i.e., bits equal to 1) may also improve code recognition, as discussed above. Accordingly, in one implementation, resulting JagTag codes having fewer than a minimum number of on bits may be rejected. Other measures that may be taken in various implementations to improve JagTag recognition may include maximizing code dimensions, ensuring that the code is surrounded by a substantial margin (e.g., at least 25% of the code's width and height), and ensuring fidelity of the code by eliminating any obscuring interferences. JagTag codes may be configured for a wide variety of physical manifestations, including printing on magazine pages, billboards, newspapers, and/or the like, displaying on video display screens, television broadcasts, websites, and/or the like. JagTags may also be configured into different shapes or display configurations in various implementations.

[0243] FIG. 33d shows one non-limiting embodiment of data loss resilient codes 3331, with characteristics that include: reducing errors based on "bleeding" of encoded data points by using circles/dots rather than squares that touch each other (this combats fuzziness of image as well as reduced light conditions); using a stronger identifier to discover processing directionality

(rotation, skew, slant)—this is the black line with white dots shown in the figure; including data points within the identifier in order to maximize encoded data as well as allow for reduction in size of code; using equidistant lengths on identifier to process for skew and slant; using constant data points within the directional identifier to process for skew and slant—this may be top left, bottom right and bottom left white dots (not indicated in FIG. 33d); reducing the amount of data encoded in the code—most likely 5-8 characters—in order to allow for size reduction of the code; developing code characteristics so partial decoding allows for matching code to correct data on the server— for example, if only 70% of the characters from a code are discernible, the

GCSI/CTIS can use server logic to extrapolate what the code is as well as the campaign/client it is associated with, i.e., information about the exact publication the code is in may be lost, but the GCSI/CTIS system can figure out the campaign and return an appropriate message; with regard to partial decode matching, server side and database logic focuses both on creating codes for clients and campaigns that are unique sets in order to enable partial decode matching as well as providing a set of rules around time, mobile number, and likelihood in order to determine the best potential match for partial decodes.

[0244] In the embodiment of the basic codes 3331 shown in FIG. 33d, design wrapped around the code does not impact the effectiveness of the decoding. High tone color differentials are allowed, so rather than black, dark blue or red could be used. The white dots in the identifiers are less likely to allow for color changes although a very light yellow or gray may be allowed.

[0245] In a further embodiment, the dots most likely to be lost in an image may be assessed and the least useful information encoded appropriately based on that assessment. An interesting opportunity for this code is that it allows for some logos to potentially replace the dots. For example, an Alltel logo can be used nearly as well as the dots, or a Nike logo is decodable with some server side code modifications.

[0246] The codes have an additional benefit in that they are in and of themselves, aesthetically pleasing, and as such offer significant advantages over previous codes. The ability in one embodiment, to vary the colors of the code, allows it to better integrate and look better in marketing contexts.

[0247] FIG. 33e shows some implementations of alternative JagTag display configurations, including circular 3335, triangular 3340, modified squares (3345, 3350, 3365), rectangular 3370, letter shaped (J shapes shown at 3355 and 3360), and/or the like. JagTags may also be displayed in proximity to and/or integrated with other codes, logos, insignias, and/or the like, such as shown at 3375.

AMBIGUOUS CODES

[0248] In an embodiment, a processor-implemented method is disclosed for processing and responding to ambiguous content requests. A scanned code image and a user ID are received and analyzed to determine if the information encoded therein is fully decodable. A scanned code disambiguation process is selected and applied to the ambiguous scanned code images to determine a most likely code. Accumulated user information in a user profile associated with the user ID is queried. A content database is queried to extract requested content based on the most likely code and the accumulated user information. The requested content is sent to the user. CONNECTING USERS

Forming Groups

[0249] In another embodiment, the CTIS is configured to connect users based on user profiles. For example, in analogy to the "provider zone" breaches discussed above, the CTIS may also track the intersection of user space-time trajectories. In particular, if one user is within a specified distance of the projected space-time trajectory of another user with whom the first user is associated, a message may be sent to one or both users notifying them of their potential proximity. Further consideration of user profiles may also be utilized in such notifications.

[0250] As previously described and illustrated in FIG. 7b, a user program interface provides a user to access semi-static profile information and add new information or edit existing information. The user may also establish a friends list and regulate which elements of the semi- static and dynamic portions of the user profile may be shared with "friends." [0251] FIG. 36A is a block diagram illustrating a CTIS configured to assign users having similar interests and situational information into dynamic groups according to an embodiment.

[0252] In an embodiment, the semi-static elements (3604) and the dynamic elements (3606) in a profile datastore (3602) are accessed by a dynamic group algorithm (3610) operating on a CTIS. The dynamic group algorithm (3610) identifies groups appropriate for a particular user of the CTIS. An invitation to join a group is issued to the particular user (3612). A determination is made whether the particular user accepts the invitation to join a particular group (3614). If the user declines the invitation, that is, the result of 3614 is "NO," the process ends (3616). If the user accepts the invitation, that is, the result of 3614 is "YES," the user is assigned to a group (3620a, 3620b, . .. , 3620n) and a record is made in a group directory (3618). By way of illustration and not by way of limitation, a user may accept and invitation to join Group A but not Group B, may join both Group A and Group B, or reject the invitation to join any of the Groups identified by the dynamic group algorithm (3610).

[0253] In an embodiment, the logic of 3614 is reversed. That is, the user must affirmatively opt- out of the group assignment made by the CTIS.

[0254] As illustrated in FIG. 36A, the dynamic group algorithm (3610) evaluates both semi- static elements (3604) and dynamic elements (3606) of a user profile to determine what groups are appropriate for a particular user. The dynamic profile elements (3606) may include situational information (3608). Situation information may include a location of a user and a trajectory of a user. Using this information, the dynamic group algorithm may group users of the CTIS with similar profiles who are in geographic proximity to each. The geographic proximity may be as large as a city and as small as a bar, a trade show, and a concert venue.

[0255] Group members typically share core information, such as a user name. In an embodiment, a group member may specify the personal information he or she is will to share with other group members. A group member may also specify which group members it prefers to be "invisible" to. In an embodiment, the sharing of the user name allows the group members to communicate via the CTIS but does not provide direct communication to between group members. Thus, the CTIS operates a communication proxy to allow group member to be restrict communications from particular members of the group or all members of the group.

[0256] In an embodiment, the core information for a particular group may be determined by the group's purpose. The group purpose may also be associated with a particular rule set that determines how the core personal information is shared. For example, in group whose purpose is facilitate social interactions, age, religious preferences, music preferences and other personal interest details may be part of the core information. In a group whose purpose is to facilitate business interactions, the core information may be limited to professional information and information relating to products and services.

[0257] In another embodiment, the situational information (3608) may identify users the CTIS with similar profiles who are participating in a common virtual world. Users with these attributes may be assigned to a group for that particular virtual world. In this example, the core information may be specific to the virtual world and the particular user's historical interaction with that world.

[0258] Users of the CTIS with similar profiles, who are skiing, albeit in different locations, may be assigned to yet another group that utilizes a core information rule set that is specific to skiing. Users at the same ski resort may be assigned to a group specific to that resort. The shared information rule set for this group may include an option that allows members to provide indentifying information to facilitate in-person meetings.

[0259] The membership of a group may be constantly in flux as the situational information (3608) of the group members changes. In an embodiment, members of a dynamic group may make the group permanent by adding some or all of the members to a friends list associated with a group name.

[0260] FIG. 36B is a block diagram illustrating a CTIS configured to identify profile elements that are related to specific content according to an embodiment.

[0261] As previously described, users with substantially similar semi-static profile elements (3604) who scan a particular code may receive different content based on differences in their dynamic profile elements (3606).

[0262] In an embodiment, a second user who has not received particular content may request the CTIS to compare the profile of the first user with the profile of the second user to determine what factors in the dynamic elements of the first user's profile caused the content to be served to the first user but not the second user. A content analyzer (3622) receives content or a content identifier that was received by a first user of the CTIS. The content analyzer also receives the semi-static profile elements (3604) the dynamic profile elements (3606) of a second user of the CTIS from the profile datastore (3602). The content analyzer (3622) evaluates the served content and the profile data to determine what profile elements could be added to the second user's profile for the second user to receive the served content. The content analyzer generates a profile report (3626).

[0263] For example, a first user may receive a coupon for a free beverage from a vendor in response to the user passing the vendor's physical location or browsing to the vendor's website. In order to obtain the coupon, the second user may be required to travel to the physical site or navigate to the vendor's website. Note that this process differs from embodiments in which a coupon may be shared, in that the second user is compelled to engage the vendor at some level to obtain the coupon. From the vendor's perspective, the value of the coupon is used to incentivize the second user to engage the vendor.

[0264] In many cases, the reasons for serving the content to the first user may be more complex than suggested in the example. For example, a coupon may have been served to the first user based on the first user's history of interest in beverages and purchases made from the vendor or establishments similar to the vendor. Even if the second user were to visit the physical or virtual location of the vendor, the second user may not meet the requirements for receiving the coupon.

[0265] In an embodiment, the CTIS may optionally offer to supplement the second user's profile to include elements that would qualify the second user for the served content (3628). If the CTIS does not make an offer to supplement the second user's profile, that is, if the result of 3628 is "NO," the process ends (3630). If the CTIS makes an offer to supplement the second user's profile, that is, the result of 3630 is "YES," then a determination is made whether the second user accepts the offer (3632). If the second user rejects the offer, that is, the result of 3632 is "NO," the process ends (3630). If the second user accepts the offer, that is, the result of 3632 is "YES," the second user's profile is assigned supplemental profile elements (3634). The "supplemental" profile elements may be stored separately from other elements and may be temporary with a defined "time-to-live" or may be permanently stored in association with the user's identifier. The served content is acquired using the supplemental profile elements (3636).

[0266] In an embodiment, a code or token may be provided to the second user that could be presented by the second user to the physical or virtual location of the vendor that would cause the coupon to be served to the second user without regard to the second user's profile. In an embodiment, the token or code may be provided only with the vendor's consent.

PRODUCT INFORMATION [0267] In another embodiment, the CTIS can be used to provide information regarding consumer products that cannot be included on the product packaging. By scanning a code printed on a consumer product package, the user could be provided with nutritional information, ingredients, website links, coupons, etc. Additional advertisements could also be served based on the nature of the product scanned and the user profile. For example, a user who scans a container of mustard and has "grilling" listed among his/her interests may be served an advertisement and/or coupon for hot dogs in addition to the mustard information.

[0268] The CTIS provides a targeted information serving system that may be applied to a wide variety of marketing and information dispensation applications. In one embodiment, the CTIS creates enhanced Reply/SMS Message or Ads with content that cannot be included in a print ad. For example, a user who scans a code related to an automobile Reply/SMS Message or Ad is provided additional content pertaining to the automobile such as detailed images, video, audio, reviews, and links to additional information. Based on the geocode provided in the Scan

Message, the CTIS may provide a list of local dealerships and pricing. Based on the user profile, the CTIS may suggest other automobiles by the same manufacturer that are popular with customers that share the same income bracket, geographic address, number of children, etc. as the user.

EMERGENCY

[0269] In another embodiment, the CTIS provides a means of disseminating targeted information over a large scale. For example, during a widespread emergency, a single 2D matrix code could be broadcast on television. When users scan the code, they are supplied with regional information/instructions, shelter locations, maps, etc. Certain users may be provided even more specific instructions if, for example, their profile lists their occupation as some form of emergency personnel. In an alternative embodiment, the CTIS can provide targeted information to any or all users expected to be in the vicinity of a particular area or event based on their history of space-time trajectories. For example, if a chemical spill occurs and users are projected to be in the vicinity of it, a prior warning to avoid the area can be broadcast to the users' mobile devices. In an alternative embodiment, traffic alerts can be broadcast to the mobile devices of users projected to be in the vicinity of a high-traffic area before they are stuck there. The CTIS may supply targeted Ads, including coupons, for nearby businesses, restaurants, coffee shops, etc. to these users for them to solicit while they wait for traffic to disperse. In general, just as the CTIS can provide information to users about where they should go (e.g., Reply/SMS Message or Ad provider locations), it can also warn them to stay out of areas that they should not go, all based on the projected user trajectories.

REAL ESTATE LISTINGS

[0270] In another embodiment, the CTIS provides an efficient mechanism of serving real estate listings. For example, when a user scans a code related to real estate listings, the CTIS supplies him/her with advertisements and/or listings that are close to their geographic location and appropriate to their demographic profile (i.e., income, marital status, number of children, etc.). In addition, the CTIS may provide additional listings to the user based on projected breaches of zones corresponding to available homes or apartments that suit the user's profile.

[0271] In another embodiment, the CTIS expedites software downloads to a user's mobile device. For example, by scanning a 2D matrix code in a Reply/SMS Message or Ad for a cell phone ringtone version of a popular song, the user can automatically download the ringtone to the cell phone with which they scan the code. The transaction is recorded in the user profile and may result in the display of an advertisement related to the latest album by the artist who recorded the ringtone song, or an album by a related artist, at some future time.

REDUCED PRINTING

[0272] In another embodiment, the CTIS allows for reduced use of printed space in media publications. For example, an ordinary printed article or advertisement may be supplanted by a 2D matrix code that supplies the content directly to the user's mobile display device.

Furthermore, the supplied content may be dressed with additional content that is specifically chosen for the user based on his/her profile or current location, thus increasing the value and utility of the content while still utilizing significantly reduced print space. This increased content value, coupled with the reduction in print space, may translate to significantly increase advertising revenue for media publications. In another embodiment, scan codes may be placed in web-based Reply/SMS Message or Ads so that users may scan those Reply/SMS Message or Ads with their mobile device. In another embodiment, scan codes may be placed in television- based ads.

NEWS

[0273] In another embodiment, the CTIS provides a means to supply urgent or breaking information. For example, a breaking news story that arrives too late to be included as a printed article can still be incorporated into a publication via a 2D matrix code. Publications could even have a permanent code in each issue that users can scan in order to access timely breaking and/or supplemental news for which there was a lack of space or time to include in the printed publication.

Domains of Interest

[0274] In another embodiment of the present invention, a method of acquiring product information comprises the steps of: receiving an instruction indicating a domain of interest, wherein the domain of interest identifies the type of product information requested; receiving a data capture from the capture environment, the data capture containing at least one identifying artifact; identifying at least one product associated with the at least one identifying artifact;

retrieving product information associated with the at least one identified product and the domain of interest requested; retrieving user information associated with the domain of interest or type of product information requested; composing a message including the retrieved product information and the retrieved user information; and sending the message to the user. The capture

environment comprises one of a 2-D environment, a 3-D environment, or a 3-D virtual reality environment.

[0275] In another embodiment of the present invention, there is disclosed a method of predictively responding to a user in a capture environment, comprising the steps of: retrieving user information associated with a user's historical activity within the capture environment; retrieving information associated with the user's current activity within the capture environment; identifying at least one domain of interest to the user, based on retrieved user information;

identifying at least one product and/or service associated with the at least one domain of interest; retrieving product and/or service information associated with the at least one identified product and/or service and the at least one domain of interest; composing a message including the retrieved product and/or service information and the retrieved user information; and

communicating the message to the user outside of the capture environment. The capture environment comprises one of a 2-D environment, a 3-D environment, or a 3-D virtual reality environment. In some embodiments, the user information is related to a virtual avatar.

[0276] In another embodiment of the present invention, there is disclosed a method of structuring and interfacing to a database wherein data captured from a capture environment by a digital device is transmitted as a structured query to a database which returns a response to the digital device comprising the steps of: capturing data corresponding to an element/artifact of interest to a user; processing the captured data and formulating a first communication containing at least some of the captured data with a data repository; and receiving a response from the data repository, the response containing at least some data corresponding to or relevant to the element/artifact of interest to the user. The capture environment comprises one of a 2-D environment, a 3-D environment, or a 3-D virtual reality environment. In some embodiments, the captured data comprises data being representative of at least one sensory input of visual, auditory, haptics, olfactory, or gustatory. In some embodiments, the captured data comprises data that is digitally encoded. In some embodiments, the captured data comprises data that is representative of a barcode, 2D code, matrix code, data matrix, QR code, Near Field

Communications (NFC) tag, Radio Frequency Identification (RFID) tag, Bluetooth, Infrared, Wireless communication, and/or the like. In some embodiments, the captured data comprises data that is representative of a pure image, the selection of an internet link, RFID tags, NFC tags, or software inputs. In some embodiments, the data repository comprises a code triggered information server database. In some further embodiments, the code triggered information server database communicates with a third party provider.

[0277] A system for communicating with a user in response to actions in a capture environment, comprises: a digital device; a data capture system; a communication circuit capable of communicating the captured data; a data repository containing data corresponding to product and/or service descriptors; and display system capable of displaying information corresponding to the captured data and data received from the data repository. The capture environment may comprise one of a 2-D environment, a 3-D environment, or a 3-D virtual reality environment.

[0278] The data capture system may comprise a supported multi-modal image recognition application. The data capture system captures data being representative of at least one sensory input of visual, auditory, haptics, olfactory, or gustatory. The data capture system may comprise captures data that is digitally encoded. The captured data may comprise data that is

representative of a barcode, 2D code, matrix code, data matrix, QR code, Near Field

Communications (NFC) tag, Radio Frequency Identification (RFID) tag, Bluetooth, Infrared, or Wireless communication. The capturing data step may comprise data that is representative of a pure image, the selection of an internet link, RFID tags, or software inputs. The captured data is communicated to the data repository by SMS protocol, MMS protocol, instant messaging, web browser based messaging, email, Enhanced Messaging System, TCP/IP, or WAP. The data repository may comprise a code triggered information server database. The code triggered information server database communicates with a third party provider. The data received from the data repository may comprise a SMS or MMS message. The data received from the data repository may comprise product or service information, a URL link, a coupon, a multimedia clip, and/or Reply/SMS Message or Ad content.

[0279] A method of predictively responding to a user in a capture environment, comprises: Retrieving user information associated with a user's historical activity within the capture environment; retrieving information associated with the user's current activity within the capture environment; identifying at least one domain of interest to the user, based on retrieved user information; identifying at least one product and/or service associated with the at least one domain of interest; retrieving product and/or service information associated with the at least one identified product and/or service and the at least one domain of interest; composing a message including the retrieved product and/or service information and the retrieved user information; and communicating the message to the user outside of the capture environment. The capture environment may comprise one of a 2-D environment, a 3-D environment, or a 3-D virtual reality environment. The user information may be related to a virtual avatar.

Claims

Claims What is claimed is:
1. A method of responding to user actions in a capture environment, using a digital device and a data capture system, comprising:
a. Targeting an element/artifact of interest in the capture environment with the data capture system;
b. Capturing data from the element/artifact of interest,
c. Communicating at least some of the captured data to a data repository;
d. Comparing the communicated data with the data repository; and
e. Returning at least one response from the data repository to the digital device based upon the communicated data.
2. The method of Claim 1, wherein the capture environment comprises one of a 2-D
environment, a 3-D environment, or a 3-D virtual reality environment.
3. The method of Claim 1, wherein the data capture system comprises a supported multi-modal image recognition application.
4. The method of Claim 1, wherein the capturing data step comprises data being representative of at least one sensory input of visual, auditory, haptics, olfactory, or gustatory.
5. The method of Claim 1, wherein the capturing data step comprises data that is digitally encoded.
6. The method of Claim 1, wherein the capturing data step comprises data that is representative of a barcode, 2D code, matrix code, data matrix, QR code, Near Field Communications (NFC) tag, Radio Frequency Identification (RFID) tag, Bluetooth, Infrared, or Wireless communication.
7. The method of Claim 1, wherein the capturing data step comprises data that is representative of a pure image, the selection of an internet link, RFID tags, or software inputs.
8. The method of Claim 1, wherein the at least some captured data is communicated to the data repository by SMS protocol, MMS protocol, instant messaging, web browser based messaging, email, Enhanced Messaging System, TCP/IP, or WAP.
9. The method of Claim 1, wherein the data repository comprises a code triggered information server database.
10. The method of Claim 9, wherein the code triggered information server database
communicates with a third party provider.
11. The method of Claim 1 , wherein the at least one response from the data repository comprises product or service information, a URL link, a coupon, a multimedia clip, and/or Reply/SMS Message or Ad content.
12. A method of structuring and interfacing to a database wherein data captured from a capture environment by a digital device is transmitted as a structured query to a database which returns a response to the digital device comprising:
a. Capturing data corresponding to an element/artifact of interest to a user;
b. Processing the captured data and formulating a first communication containing at least some of the captured data with a data repository; and
c. Receiving a response from the data repository, the response containing at least some data corresponding to or relevant to the element/artifact of interest to the user.
13. The method of Claim 12, wherein the capture environment comprises one of a 2-D environment, a 3-D environment, or a 3-D virtual reality environment.
14. The method of Claim 12, wherein the capturing data step comprises data being
representative of at least one sensory input of visual, auditory, haptics, olfactory, or gustatory.
15. The method of Claim 12, wherein the capturing data step comprises data that is digitally encoded.
16. The method of Claim 12, wherein the captured data comprises data that is representative of a barcode, 2D code, matrix code, data matrix, QR code, Near Field Communications (NFC) tag,
Radio Frequency Identification (RFID) tag, Bluetooth, Infrared, or Wireless communication.
17. The method of Claim 12, wherein the captured data comprises data that is representative of a pure image, the selection of an internet link, RFID tags, NFC tags, or software inputs.
18. The method of Claim 12, wherein the data repository comprises a code triggered
information server database.
19. A method of acquiring product information from within a capture environment, comprising: a. receiving an instruction indicating a domain of interest;
b. identifying the type of product information requested;
c. receiving a data capture containing at least one identifying artifact;
d. identifying at least one product associated with the at least one identifying artifact; e. retrieving product information associated with the at least one identified product and the type of product information requested;
f. retrieving user information associated with the type of product information requested; g. composing a message including the retrieved product information and the retrieved user information; and
h. communicating the message to a user outside of the capture environment.
20. The method of Claim 19, wherein the capture environment comprises one of a 2-D
environment, a 3-D environment, or a 3-D virtual reality environment.
PCT/US2013/025550 2012-02-10 2013-02-11 System and method for sending messages to a user in a capture environment WO2013120064A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US201261597405P true 2012-02-10 2012-02-10
US61/597,405 2012-02-10

Publications (1)

Publication Number Publication Date
WO2013120064A1 true WO2013120064A1 (en) 2013-08-15

Family

ID=48948090

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2013/025550 WO2013120064A1 (en) 2012-02-10 2013-02-11 System and method for sending messages to a user in a capture environment

Country Status (1)

Country Link
WO (1) WO2013120064A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050261990A1 (en) * 2004-04-16 2005-11-24 Russell Gocht Mobile query system and method based on visual cues
US20070226321A1 (en) * 2006-03-23 2007-09-27 R R Donnelley & Sons Company Image based document access and related systems, methods, and devices
US20090125510A1 (en) * 2006-07-31 2009-05-14 Jamey Graham Dynamic presentation of targeted information in a mixed media reality recognition system
US20100002941A1 (en) * 2006-11-14 2010-01-07 Koninklijke Philips Electronics N.V. Method and apparatus for identifying an object captured by a digital image
US20110320317A1 (en) * 2008-06-20 2011-12-29 Google Inc., A Delaware Corporation Image capture for purchases

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050261990A1 (en) * 2004-04-16 2005-11-24 Russell Gocht Mobile query system and method based on visual cues
US20070226321A1 (en) * 2006-03-23 2007-09-27 R R Donnelley & Sons Company Image based document access and related systems, methods, and devices
US20090125510A1 (en) * 2006-07-31 2009-05-14 Jamey Graham Dynamic presentation of targeted information in a mixed media reality recognition system
US20100002941A1 (en) * 2006-11-14 2010-01-07 Koninklijke Philips Electronics N.V. Method and apparatus for identifying an object captured by a digital image
US20110320317A1 (en) * 2008-06-20 2011-12-29 Google Inc., A Delaware Corporation Image capture for purchases

Similar Documents

Publication Publication Date Title
US5794210A (en) Attention brokerage
AU2010204767B2 (en) Conditional incentive presentation, tracking and redemption
US9129333B2 (en) Method and apparatus for managing location-based transactions
US8909771B2 (en) System and method for using global location information, 2D and 3D mapping, social media, and user behavior and information for a consumer feedback social media analytics platform for providing analytic measurements data of online consumer feedback for global brand products or services of past, present or future customers, users, and/or target markets
US9741057B2 (en) System and methods for providing user generated video reviews
US8892460B2 (en) Cell-allocation in location-selective information provision systems
Turow The daily you: How the new advertising industry is defining your identity and your worth
KR101766515B1 (en) Modification of content representation by a brand engine in a social network
US9576295B2 (en) Adjusting a process for visit detection based on location data
JP6401174B2 (en) Virtual planogram management, system and method
US20090271289A1 (en) System and method for propagating endorsements
US20080126476A1 (en) Method and System for the Creating, Managing, and Delivery of Enhanced Feed Formatted Content
US10140620B2 (en) Mobile device system and method providing combined delivery system using 3D geo-target location-based mobile commerce searching/purchases, discounts/coupons products, goods, and services, or service providers-geomapping-company/local and socially-conscious information/social networking (“PS-GM-C/LandSC/I-SN”)
US20120030032A1 (en) Systems and methods used for publishing and aggregating real world and online purchases via standardized product information
US20180032997A1 (en) System, method, and computer program product for determining whether to prompt an action by a platform in connection with a mobile device
CA2830268C (en) Advertisement service
US20140019264A1 (en) Framework for product promotion and advertising using social networking services
US9760896B2 (en) Acquiring customer insight in a retail environment
US9299077B2 (en) Method and apparatus for obtaining revenue from the distribution of hyper-relevant advertising through permissive mind reading, proximity encounters, and database aggregation
US8028905B2 (en) System and method for tracking individuals via remote transmitters attached to personal items
JP2010537323A (en) Targeting ads on social networks
JP2011503701A (en) Social advertising and other informational messages on social networking websites and their advertising models
US20120129590A1 (en) System and Method for Interactive Location-Based Gameplay
US20160253710A1 (en) Providing targeted content based on a user&#39;s moral values
US20130073473A1 (en) System and method for social networking interactions using online consumer browsing behavior, buying patterns, advertisements and affiliate advertising, for promotions, online coupons, mobile services, products, goods &amp; services, entertainment and auctions, with geospatial mapping technology

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13746369

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 17/10/2014)

122 Ep: pct app. not ent. europ. phase

Ref document number: 13746369

Country of ref document: EP

Kind code of ref document: A1