WO2014144062A1

WO2014144062A1 - Creating clickable advertisements within user-generated content

Info

Publication number: WO2014144062A1
Application number: PCT/US2014/028313
Authority: WO
Inventors: Maryse THOMAS
Original assignee: Relevad Media Group, Inc.
Priority date: 2013-03-15
Filing date: 2014-03-14
Publication date: 2014-09-18

Abstract

Various systems and methods for creating clickable advertisements within user-generated content are described herein. In some embodiments, a content creator may create an image or video including a product and/or service in a scene. The content creator may upload the image or video to a processing service. The processing service may identify the products and/5 or services in the image or video, and may embed uniform resource identifiers (URIs) into one or more areas of the image or video containing the identified products and/or services. The image or video may then be shared. If an area of the image or video containing an embedded URI is clicked by a user, the clicked URI may 10 direct the user to a web site of a vendor or merchant who may offer for sale the products and/or services, and the content creator may receive remuneration from the advertiser and/or merchant of the product(s) and/or service(s).

Description

CREATING CLICKABLE ADVERTISEMENTS WITHIN USER- GENERATED CONTENT

CLAIM OF PRIORITY

[0001] This patent application claims the benefit of priority to U.S.

Provisional Patent Application Serial Number 61/798,387, filed on March 15, 2013, which is hereby incorporated by reference herein in its entirety. TECHNICAL FIELD

[0002] The present invention pertains generally to displaying information, and in particular, to methods and systems for creating clickable advertisements within user-generated content. BACKGROUND

[0003] In recent years, image and video content has proliferated on the Internet, due partially to the popularity of sites such as Picasa, Tumblr, and YouTube. Sites such as these provide advertising revenue for professionally created images and videos.

BRIEF DESCRIPTION OF THE DRAWINGS

[0004] In the drawings, which are not necessarily drawn to scale, like numerals may describe similar components in different views. Like numerals having different letter suffixes may represent different instances of similar components. Some embodiments are illustrated by way of example, and not limitation, in the figures of the accompanying drawings, in which:

[0005] FIG. 1 is a schematic diagram illustrating a system for creating clickable advertisements within user-generated content, in accordance with some embodiments;

[0006] FIG. 2 is a flowchart illustrating a method for creating clickable advertisements within user-generated content, in accordance with some embodiments; [0007] FIG. 3 is a flowchart illustrating a method for creating clickable advertisements within user-generated content, in accordance with some embodiments;

[0008] FIG. 4 is a block diagram illustrating a mobile device in accordance with some embodiments;

[0009] FIG. 5 is a block diagram illustrating a network-based system for delivering clickable advertisements within user-generated content to viewers, and for providing payments to merchants, advertisers, vendors, content hosts, content creators, or content owners, in accordance with some embodiments; and

[0010] FIG. 6 illustrates a functional block diagram of an example machine, in accordance with some embodiments, upon which any one or more of the techniques (e.g., methodologies) discussed herein can perform.

DESCRIPTION OF EMBODIMENTS

[0011] The following description and the drawings sufficiently illustrate specific embodiments to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. Portions and features of some embodiments may be included in, or substituted for, those of other embodiments.

[0012] As described below in detail, embodiments provide systems and methods of using, in particular but without limitation, user-generated content as a medium for selling products or services over the Internet. Using these systems and methods, for example, a user may create an image or a video, and upload the image or video to a server. The image or video may be modified to include a "hotspot" or "tag" for each product and/or service identified in the image or video. Each hotspot contains an embedded, clickable uniform resource identifier (URI), which, when clicked, may direct a user to a web site of one or more vendors or merchants, who may offer for sale the product and/or service associated with the hotspot. Distributing the modified image or video to social media sites or over the Internet in general may thus allow the use of user- generated content to advertise goods or services efficiently. [0013] Using these systems and methods, for example, items used for props, clothing, or settings of a scene in a user-generated image or video are made electronically identifiable to a viewer of the image or video, and thereby enabling a viewer to determine the source or location of the goods or setting or other thing for sale, on the computing device, which the viewer used to view the image or video.

[0014] Using these systems and methods, for example, a user viewing a video created by a soap opera actress is able to click on a hotspot to a dress or item of jewelry worn by the actress, thereby selecting the dress or jewelry. In turn, the user is taken to a web site that offers the dress or item of jewelry for sale. This concept can also be used to find, for example but without limitation, travel packages to a locale featured in an image or video, or the names of hotels or lodging nearby.

[0015] Using these systems and methods, user-generated images or videos, typically captured on a mobile device such as a smartphone or tablet computer, can be efficiently used to indirectly advertise goods or services and offer them for sale on-line.

[0016] FIG. 1 is a schematic diagram illustrating a system 100 for creating clickable advertisements within user-generated content, in accordance with some embodiments. The system 100 includes a user 102, a computing device 104 of user 102, and a server 106 interconnected via at least one network 108. The system 100 may optionally include one or more social media sites 110. The system 100 may include an app distribution server 112, a viewer 114 of user- generated content, a vendor/merchant web site 116, and an accounting system 118.

[0017] In some embodiments, a user 102 of the system 100 for creating clickable advertisements within user-generated content may be a "general public" user (e.g., neither a celebrity nor a public figure). In some embodiments, a user 102 of the system 100 for creating clickable advertisements within user- generated content may be an amateur, novice, or otherwise non-professional photographer or videographer. [0018] The computing device 104 may include, but is not limited to, devices such as a smartphone, cellular telephone, mobile phone, laptop computer, tablet computer, desktop computer, server, computer station, or computer kiosk.

[0019] Although the server 106 is illustrated in FIG. 1 as a single machine, in some embodiments that include a server 106 interconnected via a network 108, the server 106 may comprise multiple servers working together as a co-located, distributed, or cloud-based system.

[0020] The social media sites 110 may include, but are not limited to, Facebook, Twitter, Linkedln, Google+, Pinterest, etc.

[0021] In some embodiments, app distribution server 112 may allow users 102 to download and install onto a computing device 104 a customized app for creating clickable advertisements within user-generated content. In some embodiments, app distribution server 112 may include, but is not limited to, Apple's App Store, Google's Google Play store, Amazon.com' s Appstore, etc.

[0022] In some embodiments, a viewer 114 is a person who views user- generated content. A viewer 114 may be a "general public" viewer (e.g., neither a celebrity nor a public figure) or may be a public figure or celebrity.

[0023] In some embodiments, a vendor/merchant web site 116 is either at least one web site of a vendor who may produce the products and/or services that may be identified in an image or video, or at least one web site of a merchant who may offer for sale the products and/or services.

[0024] In some embodiments, an accounting system 118 may be one or more computer systems that track information regarding clickable advertisements within user-generated content. For example, in some embodiments, an accounting system 118 may track, for each clickable advertisement within user- generated content, the number of times each advertisement is clicked by a viewer 114.

[0025] In some embodiments, the user 102 may create an image or video comprising at least one element in at least one scene of the image or video. In some embodiments, the user 102 may create the image or video with computing device 104. In other embodiments, the user 102 may create the image or video with a different device. [0026] In some embodiments, the element may be an item of clothing worn by a person in a scene of the image or video, such as an item of jewelry, a garment, or an accessory. In some embodiments, the element may be a hairstyle, a hairpiece, or a cosmetic worn by a person in a scene of the image or video. In some embodiments, the element may be a prop in the image or video, such as a home furnishing, home decoration, fixture, or appliance. In some embodiments, the element may be a location, such as a city, a country, a mountain, a beach, a restaurant, a hotel, etc. In some embodiments, the element may be a device in the image or video, such as an automobile, a household appliance, a tool, or a consumer product.

[0027] In some embodiments, computing device 104 is a mobile device with a camera, such as a smartphone, a tablet computer, or a laptop computer. In such embodiments, the user 102 may create the image or video using a mobile application, or "app," executing on the computing device 104. The app may allow the user 102 to create images or videos using the camera of the computing device 104.

[0028] In some embodiments, the user 102 may upload the created image or video from computing device 104 to server 106 via the network 108. If computing device 104 is a mobile device, the user 102 may select and upload the image or video using an app executing on the mobile device, or using a web browser executing on the mobile device.

[0029] Server 106 may receive the uploaded image or video, and may begin the process of identifying elements representing products and/or services within the image or video. In some embodiments, the process of identifying elements within the image or video may be an automated process, executed by the server 106 without human intervention or assistance. For example, the uploaded image or video may be analyzed using object recognition systems to identify the products and/or services. The object recognition systems may use one or more object recognition algorithms, such as content-based retrieval, pose estimation, optical character recognition (OCR), barcode reading, 2D barcode reading, or facial recognition. Algorithms based on content retrieval may attempt to recognize products and/or services in the image or video by comparing the element representing the product and/or service to products/services stored in a database. The database may be populated with images of products/services; the images may be provided by vendors, manufacturers, merchants, advertisers, content creators, or some combination thereof.

[0030] In some embodiments, the process of identifying elements within the image or video may involve human intervention or assistance. In some embodiments, this may involve one or more people reviewing the image or video to identify the products and/or services in the image or video, or to confirm the automated process correctly identified the products and/or services in the image or video.

[0031] In some embodiments, the server 106 may modify the image or video to create hotspots over the identified products and/or services. A hotspot may include a bounding shape that bounds all or a portion of the element containing a product or service. The server 106 may embed into each hotspot a URI to a web site 116 of at least one vendor/merchant who may offer the product and/or service identified in the hotspot.

[0032] In some embodiments, advertisers on an ad-exchange may reserve areas for search within the image or video. In such embodiments, a reserved area is embedded with a URI specified by the advertiser. The URI may contain search terms and a URL for a search engine.

[0033] In some embodiments, after the modification of the image or video is complete, the server 106 may then transmit the image or video to the computing device 104. An app executing on computing device 104 may allow a viewer to view modified images and/or videos that contain hotspots, and may allow the viewer to click or otherwise activate the hotspot to invoke a provider for procuring the product or service bounded by the hotspot. In some embodiments, a provider is a vendor, merchant, or advertiser of the product or service advertised in a hotspot. The user 102 may then share the modified image or video with others by emailing, messaging, tweeting, or otherwise posting the image or video, such as posting to one or more social media sites 110.

[0034] In some embodiments, after the modification of the image or video is complete, the server 106 may then transmit the image or video to one or more social media sites 110. Particular social media sites 110 may have been selected by the user 102 for distribution of the image or video, or a default set of social media sites 110 are used for distribution of the image or video. In some embodiments, the modified image or video is sent to the computing device 104 of user 102 and is also sent to one or more social media sites 110.

[0035] In some embodiments, an accounting system 118 may track information regarding clickable advertisements within user-generated content. For example, in some embodiments, an accounting system 118 may track, for each clickable advertisement within user-generated content, the number of times each advertisement is clicked by a viewer 114. For each advertisement clicked by a viewer 114, the accounting system 118 may credit one or more accounts of the advertiser of the clicked advertisement (e.g., the vendor of the products and/or services within the clicked advertisement), the content creator (e.g., user 102), the merchant offering for sale the products and/or services within the clicked advertisement, the host of the clicked advertisement (e.g., social media site 110), the manufacturer of the product and/or services, or some combination thereof. In some embodiments, the value credited may be based on a number of times the hotspot is clicked.

[0036] FIG. 2 is a flowchart illustrating a method 200 for creating clickable advertisements within user-generated content, in accordance with some embodiments. At 202, optionally, an app is launched on a mobile device. In some embodiments, the app is customized for the process of creating clickable advertisements in user-generated content.

[0037] At 204, an image or video is captured with the mobile device or is retrieved using the mobile device. In some embodiments, an app customized for the process of creating clickable advertisements in user-generated content is used to capture the image or video. In other embodiments, a general app for creating images and/or video is used to create the image or video, and a web browser is used to retrieve the created image or video, which may reside on the mobile device or on another device. In some embodiments, an app customized for the process of creating clickable advertisements in user-generated content is used to retrieve an existing image or video. [0038] At 206, the image or video is uploaded to server 106. In some embodiments, an app customized for the process of creating clickable advertisements in user-generated content is used to upload the image or video to server 106. In other embodiments, a web browser is used to upload the image or video to server 106.

[0039] At 208 , a notification is received that the image/video has been modified to contain hotspots with embedded URIs proximate to the product(s) and/or service(s) in the image or video. In some embodiments, the notification may be received by an app customized for the process of creating clickable advertisements in user-generated content, the notification received via email, Short Message Service (SMS), or some combination thereof. In some embodiments, other methods of notification and combinations of methods of notification are possible.

[0040] In some embodiments, the user 102 may select the default notification method(s), by which the user 102 wishes to be notified of the availability of a modified image or video. In some embodiments, the user 102 may use an app customized for the process of creating clickable advertisements in user-generated content to select the notification method(s) to be used for a particular image or video.

[0041] At 210, the modified image or video is shared with selected destinations. In some embodiments, the image or video may be shared using an app customized for the process of creating clickable advertisements in user- generated content. In such embodiments, the destinations available may include, but are not limited to, email, SMS, Twitter, Facebook, Instagram, Pinterest, Google+, Tumbler, or a blog or web service. The custom app may allow the user 102 to program the account credentials for each of the available

destinations, so that the user 102 may not be required to reenter the account credentials for each destination selected, nor for each image or video shared.

[0042] FIG. 3 is a flowchart illustrating a method 300 for creating clickable advertisements within user-generated content, in accordance with some embodiments. At 302, an image or video is received from a computing device 104. In some embodiments, the computing device 104 may be a mobile device. In some embodiments, the mobile device may have used an app customized for the process of creating clickable advertisements in user-generated content to upload the image or video. In other embodiments, the mobile device may have used a web browser to upload the image or video.

[0043] At 304, elements in the image or video that may contain products and/or services are recognized.

[0044] At 305 , products and/or services in the recognized elements are identified. In some embodiments, the process of recognizing products and/or services within the image or video may be an automated process, executed by the server 106 without human intervention or assistance. For example, the uploaded image or video may be analyzed using object recognition systems to identify the products and/or services. The object recognition systems may use one or more object recognition algorithms, such as content-based retrieval, pose estimation, optical character recognition (OCR), barcode reading, 2D barcode reading, or facial recognition. Algorithms based on content retrieval may attempt to recognize products and/or services in the image or video by comparing the element representing the product and/or service to

products/services stored in a database. The database may be populated with images of products/services; the images may be provided by vendors, manufacturers, advertisers, content creators, or some combination thereof.

[0045] In some embodiments, the process of identifying elements within the image or video may involve human intervention or assistance. In some embodiments, this may involve one or more people reviewing the image or video to identify the products and/or services in the image or video, or to confirm the automated process correctly identified the products and/or services in the image or video.

[0046] At 306, the image or video is modified to contain hotspots proximate to the products and/or services in the image or video.

[0047] At 308, each hotspot of the image or video is embedded with a URI to a web site 116 of at least one vendor/merchant who may offer the product and/or service identified in the hotspot. [0048] At 310, the user 102 is notified of the availability of the modified image or video. In some embodiments, the notification may be sent to the user 102 via a custom app executing on a computing device 104 of user 102, via email, Short Message Service (SMS), or some combination thereof. In some embodiments, other methods of notification and combinations of methods of notification are possible.

[0049] In some embodiments, a default notification method(s), by which the user 102 is to be notified of the availability of a modified image or video, may have been selected for user 102. In some embodiments, the receipt 302 of the image or video may have included notification method(s) to be used for that image or video.

[0050] At 312, optionally, the modified image or video is sent to the mobile device.

[0051] At 314, optionally, the modified image or video is sent to preselected destinations. In some embodiments, the destinations available may include, but are not limited to, email, SMS, Twitter, Facebook, Instagram, Pinterest, Google+, Tumbler, or a blog or web service. The service for creating clickable advertisements in user-generated content, which may run on server 106, may allow the user 102 to program the account credentials for each of the available destinations, so that the user 102 may not be required to reenter the account credentials for each destination selected, nor for each image or video shared.

[0052] FIG. 4 is a block diagram illustrating a mobile device 400 in accordance with some embodiments. The device 400 may include a processor 410. The processor 410 may be any of a variety of different types of commercially available processors suitable for mobile devices, for example, an XScale architecture microprocessor, a Microprocessor without Interlocked Pipeline Stages (MIPS) architecture processor, or another type of processor. A memory 420, such as a Random Access Memory (RAM), a Flash memory, or other type of memory, is typically accessible to the processor. The memory 420 may be adapted to store an operating system (OS) 430 , as well as application programs 440, such as a mobile location enabled application that may provide LBS's to a user. The processor 410 may be coupled, either directly or via appropriate intermediary hardware, to a display 450 and to one or more input/output (I/O) devices 460, such as a keypad, a touch panel sensor, a microphone, etc. Similarly, in some embodiments, the processor 410 may be coupled to a transceiver 470 that interfaces with an antenna 490. The transceiver 470 may be configured to both transmit and receive cellular network signals, wireless data signals, or other types of signals via the antenna 490, depending on the nature of the device 400. In this manner, the connection 410 with the communication network 420 may be established. Further, in some

configurations, a GPS receiver 480 may also make use of the antenna 490 to receive GPS signals.

[0053] FIG. 5 is a block diagram illustrating a network-based system 500 for delivering clickable advertisements within user-generated content to viewers, and for providing payments to merchants, advertisers, vendors, content hosts, content creators, or content owners, in accordance with some embodiments;

[0054] In an embodiment, the system operates in real time or near real-time. The block diagram depicting a client-server system 500, within which an example embodiment can be deployed is described. A networked system 502, in the example, forms a network-based system for creating and distributing clickable advertisements within user-generated content, and provides server-side functionality via a network 504 (e.g., the Internet or Wide Area Network

(WAN)) to one or more clients 510, 512. FIG. 5 illustrates, for example, a web client 506 (e.g., a browser, such as the Internet Explorer browser developed by Microsoft Corporation of Redmond, WA), and a programmatic client 508 (e.g., WHERE smartphone application from Where, Inc. of Boston, MA) executing on respective client machines 510 and 512. In an example, the client machines 510 and 512 can be in the form of a mobile device, such as mobile device 400.

[0055] An Application Programming Interface (API) server 514 and a web server 516 are coupled to, and provide programmatic and web interfaces respectively to, one or more application servers 518. The application servers 518 host one or more publication applications 520 (in certain examples these can also include commerce applications, advertising applications, and marketplace applications, to name a few), payment applications 522, and an advertisement tracking sub-system 532. The application servers 518 are, in turn, shown to be coupled to one or more database servers 524 that facilitate access to one or more databases 526. In some examples, the application server 518 can access the databases 526 directly without the need for a database server 524.

[0056] The publication applications 520 may provide a number of publication functions and services to users that access the networked system 502. The payment applications 522 may likewise provide a number of payment services and functions to users. The payment applications 522 may allow users to accumulate value (e.g., in a government- issued currency, such as the U.S. dollar, or a proprietary currency, such as "points") in accounts, and then later to redeem the accumulated value for currency, goods, or services. In some embodiments, the goods or services are advertised or made available via the various publication applications 520. The payment application 522 may also be configured to present vendor/merchant promotions and/or recommendations, generated by the customer valuation and vendor/merchant bidding sub-system 532, to a user during checkout. The advertisement tracking sub-system 532 may provide realtime advertisement tracking to users of the networked system 502. The advertisement tracking sub-system 532 can be configured to use all of the various communication mechanisms provided by the networked system 502 to track clicked advertisements within user-generated content and provide remuneration to users, vendors, merchants, manufacturers, advertisers, hosts, or some combination thereof. Although the publication applications 520, payment applications 522, and advertisement tracking sub-system 532 are shown in FIG. 5 to all form part of the networked system 502, it will be appreciated that, in alternative embodiments, the payment applications 522 may form part of a payment service that is separate and distinct from the networked system 502.

[0057] Further, while the system 500 shown in FIG. 5 employs a client-server architecture, some embodiments are not limited to such an architecture, and could equally well find application in a distributed, or peer-to-peer, architecture system, for example.

[0058] The web client 506 accesses the various publication applications 520, payment applications 522, and advertisement tracking 532 via the web interface supported by the web server 516. Similarly, the programmatic client 508 accesses the various services and functions provided by the publication applications, payment applications, and valuation/bidding servers 520, 522 and 532 via the programmatic interface provided by the API server 514. The programmatic client 508 may, for example, be a local recommendation smartphone application (e.g., the WHERE application developed by Where, Inc., of Boston, MA) to enable users to generate, distribute, or receive clickable advertisements within user-generated content on their smartphones, and may leverage user profile data and current location information provided by the smartphone.

[0059] FIG. 5 also illustrates a third party application 528, executing on a third party server machine 540, as having programmatic access to the networked system 502 via the programmatic interface provided by the API server 514. For example, the third party application 528 may, utilizing information retrieved from the networked system 502, support one or more features or functions on a web site hosted by a third party. The third party web site may, for example, provide one or more promotional, marketplace, or payment functions that are supported by the relevant applications of the networked system 502.

Additionally, the third party web site may provide vendor/merchant promotions for items or services available on the networked system 502 through the advertisement tracking sub-system 532. Additionally, the application server 518 may access advertisement data via a third party system, such as the third party server 540.

[0060] FIG. 6 illustrates a functional block diagram of an example machine 600, in accordance with some embodiments, upon which any one or more of the techniques (e.g., methodologies) discussed herein can perform. In alternative embodiments, the machine 600 can operate as a standalone device or can be connected (e.g., networked) to other machines. In a networked deployment, the machine 600 can operate in the capacity of a server machine, a client machine, or both in server-client network environments. In an example, the machine 600 can act as a peer machine in peer-to-peer (P2P) (or other distributed) network environment. The machine 600 can be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a mobile telephone, a web appliance, a network router, switch or bridge, or any machine capable of executing instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, although only a single machine is illustrated, the term "machine" shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein, such as cloud computing, software as a service (SaaS), other computer cluster configurations.

[0061] Examples, as described herein, can include, or can operate on, logic or a number of components, modules, or mechanisms. Modules are tangible entities capable of performing specified operations and can be configured or arranged in a certain manner. In an example, circuits can be arranged (e.g., internally or with respect to external entities such as other circuits) in a specified manner as a module. In an example, the whole or part of one or more computer systems (e.g., a standalone, client or server computer system) or one or more hardware processors can be configured by firmware or software (e.g., instructions, an application portion, or an application) as a module that operates to perform specified operations. In an example, the software can reside (1) on a non-transitory machine-readable medium or (2) in a transmission signal. In an example, the software, when executed by the underlying hardware of the module, causes the hardware to perform the specified operations.

[0062] Accordingly, the term "module" is understood to encompass a tangible entity, be that an entity that is physically constructed, specifically configured (e.g., hardwired), or temporarily (e.g., transitorily) configured (e.g., programmed) to operate in a specified manner or to perform part or all of any operation described herein. Considering examples in which modules are temporarily configured, each of the modules need not be instantiated at any one moment in time. For example, where the modules comprise a general-purpose hardware processor configured using software, the general-purpose hardware processor can be configured as respective different modules at different times. Software can accordingly configure a hardware processor, for example, to constitute a particular module at one instance of time and to constitute a different module at a different instance of time.

[0063] Machine (e.g., computer system) 600 can include a hardware processor 602 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), a hardware processor core, or any combination thereof), a main memory 604 and a static memory 606, some or all of which can communicate with each other via a link 608. The machine 600 can further include a display unit 610, an alphanumeric input device 612 (e.g., a keyboard), and a user interface (UI) navigation device 614 (e.g., a mouse). In an example, the display unit 610, input device 612 and UI navigation device 614 can be a touch screen display. The machine 600 can additionally include a storage device (e.g., drive unit) 616, a signal generation device 618 (e.g., a speaker), a network interface device 620, and one or more sensors 621 , such as a global positioning system (GPS) sensor, compass, accelerometer, or other sensor. The machine 600 can include an output controller 628, such as a serial (e.g., universal serial bus (USB), parallel, or other wired or wireless (e.g., infrared (I )) connection to communicate or control one or more peripheral devices (e.g., a printer, card reader, etc.)

[0064] The storage device 616 can include a machine-readable medium 622 on which is stored one or more sets of data structures or instructions 624 (e.g., software) embodying or utilized by any one or more of the techniques or functions described herein. The instructions 624 can also reside, completely or at least partially, within the main memory 604, within static memory 606, or within the hardware processor 602 during execution thereof by the machine 600. In an example, one or any combination of the hardware processor 602, the main memory 604, the static memory 606, or the storage device 616 can constitute machine-readable media.

[0065] Although the machine-readable medium 622 is illustrated as a single medium, the term "machine-readable medium" can include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that configured to store the one or more instructions 624.

[0066] The term "machine-readable medium" can include any tangible medium that is capable of storing, encoding, or carrying instructions for execution by the machine 600 and that cause the machine 600 to perform any one or more of the techniques of the present disclosure, or that is capable of storing, encoding or carrying data structures used by or associated with such instructions. Non-limiting machine-readable medium examples can include solid-state memories, and optical and magnetic media. Specific examples of machine-readable media can include non-volatile memory, such as

semiconductor memory devices (e.g., Electrically Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM)) and flash memory devices; magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and CD-ROM and DVD- ROM disks.

[0067] The instructions 624 can further be transmitted or received over a communications network 626 using a transmission medium via the network interface device 620 utilizing any one of a number of transfer protocols (e.g., frame relay, internet protocol (IP), transmission control protocol (TCP), user datagram protocol (UDP), hypertext transfer protocol (HTTP), etc.). Example communication networks can include a local area network (LAN), a wide area network (WAN), a packet data network (e.g., the Internet), mobile telephone networks (e.g., cellular networks), Plain Old Telephone (POTS) networks, and wireless data networks (e.g., Institute of Electrical and Electronics Engineers (IEEE) 802.11 family of standards known as Wi-Fi®, IEEE 802.16 family of standards known as WiMax®), peer-to-peer (P2P) networks, among others. In an example, the network interface device 620 can include one or more physical jacks (e.g., Ethernet, coaxial, or phone jacks) or one or more antennas to connect to the communications network 626. In an example, the network interface device 620 can include a plurality of antennas to communicate wirelessly using at least one of single-input multiple-output (SIMO), multiple-input multiple- output (MIMO), or multiple-input single-output (MISO) techniques. The term "transmission medium" shall be taken to include any intangible medium that is capable of storing, encoding or carrying instructions for execution by the machine 600, and includes digital or analog communications signals or other intangible medium to facilitate communication of such software. [0068] Although example machine 600 is illustrated as having several separate functional elements, one or more of the functional elements may be combined and may be implemented by combinations of software-configured elements, such as processing elements including digital signal processors (DSPs), and/or other hardware elements. For example, some elements may comprise one or more microprocessors, DSPs, application specific integrated circuits (ASICs), radio -frequency integrated circuits (RFICs) and combinations of various hardware and logic circuitry for performing at least the functions described herein. In some embodiments, the functional elements of system 600 may refer to one or more processes operating on one or more processing elements.

[0069] Embodiments may be implemented in one or a combination of hardware, firmware and software. Embodiments may also be implemented as instructions stored on a computer-readable storage device, which may be read and executed by at least one processor to perform the operations described herein. A computer-readable storage device may include any non-transitory mechanism for storing information in a form readable by a machine (e.g., a computer). For example, a computer-readable storage device may include readonly memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash-memory devices, and other storage devices and media. In some embodiments, system 600 may include one or more processors and may be configured with instructions stored on a computer- readable storage device.

[0070] Additional Examples

[0071] The following examples pertain to further embodiments.

[0072] Example 1 may include subject matter (such as a network-based system, apparatus, or device) for delivering clickable advertisements within user- generated content, the system comprising: a reception component to receive, from a mobile computing device, a user-generated image, the image comprising an element in a scene; an identification component to identify the element as a product or service; a modification component to modify the image by embedding a hotspot, the hotspot including a bounding shape and an action, the bounding shape corresponding to the element, the action being activated when a viewer interacts with the element, the action invoking a provider for procuring the product or service; and a transmission component to transmit the modified image to the mobile computing device.

[0073] In Example 2, the subject matter of Example 1 may optionally include, wherein the mobile computing device is a smartphone or a tablet computer.

[0074] In Example 3, the subject matter of any of Examples 1-2 may optionally include an advertisement tracking component to track activated hotspots within user-generated content; and an accounting system to credit, based on an activated hotspot, a value to an account associated with at least one of: an advertiser of the product or service advertised in the hotspot; a vendor of the product or service advertised in the hotspot; a creator of the user-generated content containing the hotspot; or a host of the user-generated content containing the hotspot.

[0075] In Example 4, the subject matter of any of Examples 1-3 may optionally include, wherein the value credited is based on a number of times the hotspot is activated.

[0076] In Example 5, the subject matter of any of Examples 1-4 may optionally include, wherein the credited value is in units of a government-issued currency.

[0077] In Example 6, the subject matter of any of Examples 1-5 may optionally include, wherein the credited value is in units of a proprietary currency.

[0078] In Example 7, the subject matter of any of Examples 1-6 may optionally include a redemption component to allow a user to redeem a value accumulated by the user, wherein the redemption is for at least one of currency, products, or services.

[0079] In Example 8, the subject matter of any of Examples 1-7 may optionally include, wherein to identify the product or service includes the identification component to use at least one of: content-based retrieval, wherein the system searches a database for the product or service within the element; pose estimation on an object within the element; optical character recognition (OCR) on text within the element; barcode reading on a one-dimensional barcode or a two-dimensional barcode within the element; or facial recognition on a face within the element.

[0080] In Example 9, the subject matter of any of Examples 1-8 may optionally include an app on the mobile computing device to transmit the image to the reception component, the app arranged to present the modified image and implement hotspot interactions.

[0081] Example 10 includes, or may optionally be combined with all or portions of the subject matter of one or any combination of Examples 1 -9, to embody subject matter (e.g., a method, machine-readable medium, or operations arranged or configured from an apparatus or machine) of instructions for receiving, from a remote mobile computing device, a user-generated image, the image comprising an element in a scene; identifying the element as a product or service; modifying the image by embedding a hotspot, the hotspot including a bounding shape and an action, the bounding shape corresponding to the element, the action being activated when a viewer interacts with the element, the action invoking a provider for procuring the product or service; and transmitting the modified image to the mobile computing device.

[0082] In Example 11, the subject matter of Example 10 may optionally include, wherein the mobile computing device is a smartphone or a tablet computer.

[0083] In Example 12, the subject matter of any one or more of Examples 10 to 11 may optionally include, wherein the operations further comprise: tracking activated hotspots within user-generated content; and crediting, based on an activated hotspot, a value to an account associated with at least one of: an advertiser of the product or service advertised in the hotspot; a vendor of the product or service advertised in the hotspot; a creator of the user-generated content containing the hotspot; or a host of the user-generated content containing the hotspot.

[0084] In Example 13, the subject matter of any one or more of Examples 10 to 12 may optionally include, wherein the value credited is based on a number of times the hotspot is activated. [0085] In Example 14, the subject matter of any one or more of Examples 10 to 13 may optionally include, wherein the credited value is in units of a government-issued currency.

[0086] In Example 15 the subject matter of any one or more of Examples 10 to 14 may optionally include, wherein the credited value is in units of a proprietary currency.

[0087] In Example 16 the subject matter of any one or more of Examples 10 to 15 may optionally include, wherein the operations further comprise allowing a user to redeem a value accumulated by the user, wherein the redemption is for at least one of currency, products, or services.

[0088] In Example 17 the subject matter of any one or more of Examples 10 to 16 may optionally include, wherein identifying the product or service within the element includes at least one of: searching a database for the product or service within the element; estimating a pose of an object within the element; performing optical character recognition (OCR) on text within the element; reading a one-dimensional barcode or a two-dimensional barcode within the element; or performing facial recognition on a face within the element.

[0089] In Example 18 the subject matter of any one or more of Examples 10 to 17 may optionally include, wherein the user-generated image is transmitted by an app on the mobile computing device, the app arranged to present the modified image and implement hotspot interactions.

[0090] Example 19 includes, or may optionally be combined with all or portions of the subject matter of one or any combination of Examples 1-18, to embody subject matter (e.g., a method, machine-readable medium, or operations arranged or configured from an apparatus or machine) for receiving, from a remote mobile computing device, a user-generated image, the image comprising an element in a scene; identifying the element as a product or service; modifying the image by embedding a hotspot, the hotspot including a bounding shape and an action, the bounding shape corresponding to the element, the action being activated when a viewer interacts with the element, the action invoking a provider for procuring the product or service; and transmitting the modified image to the mobile computing device. [0091] In Example 20, the subject matter of Example 19 may optionally include, wherein the mobile computing device is a smartphone or a tablet computer.

[0092] In Example 21, the subject matter of any one or more of Examples 19 to 20 may optionally include tracking activated hotspots within user-generated content; and crediting, based on an activated hotspot, a value to an account associated with at least one of: an advertiser of the product or service advertised in the hotspot; a vendor of the product or service advertised in the hotspot; a creator of the user-generated content containing the hotspot; or a host of the user-generated content containing the hotspot.

[0093] In Example 22, the subject matter of any one or more of Examples 19 to 21 may optionally include, wherein the value credited is based on a number of times the hotspot is activated.

[0094] In Example 23, the subject matter of any one or more of Examples 19 to 22 may optionally include, wherein the credited value is in units of a government-issued currency.

[0095] In Example 24, the subject matter of any one or more of Examples 19 to 23 may optionally include, wherein the credited value is in units of a proprietary currency.

[0096] In Example 25, the subject matter of any one or more of Examples 19 to 24 may optionally include allowing a user to redeem a value accumulated by the user, wherein the redemption is for at least one of currency, products, or services.

[0097] In Example 26, the subject matter of any one or more of Examples 19 to 25 may optionally include, wherein identifying the product or service within the element includes at least one of: searching a database for the product or service within the element; estimating a pose of an object within the element; performing optical character recognition (OCR) on text within the element; reading a one-dimensional barcode or a two-dimensional barcode within the element; or performing facial recognition on a face within the element.

[0098] In Example 27, the subject matter of any one or more of Examples 19 to 26 may optionally include, wherein the user-generated image is transmitted by an app on the mobile computing device, the app arranged to present the modified image and implement hotspot interactions.

[0099] The Abstract is provided to comply with 37 C.F.R. Section 1.72(b) requiring an abstract that will allow the reader to ascertain the nature and gist of the technical disclosure. It is submitted with the understanding that it will not be used to limit or interpret the scope or meaning of the claims. The following claims are hereby incorporated into the detailed description, with each claim standing on its own as a separate embodiment.

Claims

CLAIMS What is claimed is:

1. A network-based system for delivering clickable advertisements within user-generated content, the system comprising:

a reception component to receive, from a mobile computing device, a user-generated image, the image comprising an element in a scene;

an identification component to identify the element as a product or service;

a modification component to modify the image by embedding a hotspot, the hotspot including a bounding shape and an action, the bounding shape corresponding to the element, the action being activated when a viewer interacts with the element, the action invoking a provider for procuring the product or service; and

a transmission component to transmit the modified image to the mobile computing device.

2. The system of claim 1 , wherein the mobile computing device is a smartphone or a tablet computer.

3. The system of claim 1 , further comprising:

an advertisement tracking component to track activated hotspots within user-generated content; and

an accounting system to credit, based on an activated hotspot, a value to an account associated with at least one of:

an advertiser of the product or service advertised in the hotspot; a vendor of the product or service advertised in the hotspot; a creator of the user-generated content containing the hotspot; or a host of the user-generated content containing the hotspot.

4. The system of claim 3, wherein the value credited is based on a number of times the hotspot is activated.

5. The system of claim 3, wherein the credited value is in units of a government-issued currency.

6. The system of claim 3, wherein the credited value is in units of a proprietary currency.

7. The system of claim 3, further comprising a redemption component to allow a user to redeem a value accumulated by the user, wherein the redemption is for at least one of currency, products, or services.

8. The system of claim 1 , wherein to identify the product or service includes the identification component to use at least one of:

content-based retrieval, wherein the system searches a database for the product or service within the element;

pose estimation on an object within the element;

optical character recognition (OCR) on text within the element;

barcode reading on a one-dimensional barcode or a two-dimensional barcode within the element; or

facial recognition on a face within the element.

9. The system of claim 1 , further comprising an app on the mobile computing device to transmit the image to the reception component, the app arranged to present the modified image and implement hotspot interactions.

10. A machine-readable medium including instructions for delivering clickable advertisements within user-generated content, the instructions that, when executed by a machine, cause the machine to perform operations including:

receiving, from a remote mobile computing device, a user-generated image, the image comprising an element in a scene;

identifying the element as a product or service; modifying the image by embedding a hotspot, the hotspot including a bounding shape and an action, the bounding shape corresponding to the element, the action being activated when a viewer interacts with the element, the action invoking a provider for procuring the product or service; and

transmitting the modified image to the mobile computing device.

11. The machine-readable medium of claim 10, wherein the mobile computing device is a smartphone or a tablet computer.

12. The machine-readable medium of claim 10, wherein the operations further comprise:

tracking activated hotspots within user-generated content; and crediting, based on an activated hotspot, a value to an account associated with at least one of:

13. The machine-readable medium of claim 12, wherein the value credited is based on a number of times the hotspot is activated.

14. The machine-readable medium of claim 12, wherein the credited value is in units of a government-issued currency.

15. The machine-readable medium of claim 12, wherein the credited value is in units of a proprietary currency.

16. The machine-readable medium of claim 12, wherein the operations further comprise allowing a user to redeem a value accumulated by the user, wherein the redemption is for at least one of currency, products, or services.

17. The machine-readable medium of claim 10, wherein identifying the product or service within the element includes at least one of:

searching a database for the product or service within the element;

estimating a pose of an object within the element;

performing optical character recognition (OCR) on text within the element;

reading a one-dimensional barcode or a two-dimensional barcode within the element; or

performing facial recognition on a face within the element.

18. The machine-readable medium of claim 10, wherein the user-generated image is transmitted by an app on the mobile computing device, the app arranged to present the modified image and implement hotspot interactions.

19. A method for delivering clickable advertisements within user-generated content, the method comprising:

identifying the element as a product or service;

modifying the image by embedding a hotspot, the hotspot including a bounding shape and an action, the bounding shape corresponding to the element, the action being activated when a viewer interacts with the element, the action invoking a provider for procuring the product or service; and

transmitting the modified image to the mobile computing device.

20. The method of claim 19, wherein the mobile computing device is a smartphone or a tablet computer.

21. The method of claim 19, further comprising:

tracking activated hotspots within user-generated content; and crediting, based on an activated hotspot, a value to an account associated with at least one of: an advertiser of the product or service advertised in the hotspot; a vendor of the product or service advertised in the hotspot; a creator of the user-generated content containing the hotspot; or a host of the user-generated content containing the hotspot.

22. The method of claim 21, wherein the value credited is based on a number of times the hotspot is activated.

23. The method of claim 21, wherein the credited value is in units of a government-issued currency.

24. The method of claim 21 , wherein the credited value is in units of a proprietary currency.

25. The method of claim 21 , further comprising allowing a user to redeem a value accumulated by the user, wherein the redemption is for at least one of currency, products, or services.

26. The method of claim 25, wherein identifying the product or service within the element includes at least one of:

searching a database for the product or service within the element;

estimating a pose of an object within the element;

performing optical character recognition (OCR) on text within the element;

performing facial recognition on a face within the element.

27. The method of claim 19, wherein the user-generated image is transmitted by an app on the mobile computing device, the app arranged to present the modified image and implement hotspot interactions.