US20170116644A1 - Providing advertisements in an augmented reality environment - Google Patents
Providing advertisements in an augmented reality environment Download PDFInfo
- Publication number
- US20170116644A1 US20170116644A1 US15/397,282 US201715397282A US2017116644A1 US 20170116644 A1 US20170116644 A1 US 20170116644A1 US 201715397282 A US201715397282 A US 201715397282A US 2017116644 A1 US2017116644 A1 US 2017116644A1
- Authority
- US
- United States
- Prior art keywords
- digital content
- mobile device
- dynamic digital
- marker
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000003190 augmentative Effects 0.000 title claims abstract description 48
- 239000003550 marker Substances 0.000 claims abstract description 51
- 230000003993 interaction Effects 0.000 claims abstract description 26
- 230000000875 corresponding Effects 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 8
- 230000002452 interceptive Effects 0.000 description 6
- 230000004044 response Effects 0.000 description 5
- 238000000034 method Methods 0.000 description 4
- 230000002085 persistent Effects 0.000 description 3
- 235000006719 Cassia obtusifolia Nutrition 0.000 description 2
- 235000014552 Cassia tora Nutrition 0.000 description 2
- 244000201986 Cassia tora Species 0.000 description 2
- 230000001413 cellular Effects 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 230000002708 enhancing Effects 0.000 description 2
- -1 managers Substances 0.000 description 2
- 230000003287 optical Effects 0.000 description 2
- 241000272519 Aix Species 0.000 description 1
- RYGMFSIKBFXOCR-UHFFFAOYSA-N copper Chemical compound data:image/svg+xml;base64,PD94bWwgdmVyc2lvbj0nMS4wJyBlbmNvZGluZz0naXNvLTg4NTktMSc/Pgo8c3ZnIHZlcnNpb249JzEuMScgYmFzZVByb2ZpbGU9J2Z1bGwnCiAgICAgICAgICAgICAgeG1sbnM9J2h0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnJwogICAgICAgICAgICAgICAgICAgICAgeG1sbnM6cmRraXQ9J2h0dHA6Ly93d3cucmRraXQub3JnL3htbCcKICAgICAgICAgICAgICAgICAgICAgIHhtbG5zOnhsaW5rPSdodHRwOi8vd3d3LnczLm9yZy8xOTk5L3hsaW5rJwogICAgICAgICAgICAgICAgICB4bWw6c3BhY2U9J3ByZXNlcnZlJwp3aWR0aD0nMzAwcHgnIGhlaWdodD0nMzAwcHgnIHZpZXdCb3g9JzAgMCAzMDAgMzAwJz4KPCEtLSBFTkQgT0YgSEVBREVSIC0tPgo8cmVjdCBzdHlsZT0nb3BhY2l0eToxLjA7ZmlsbDojRkZGRkZGO3N0cm9rZTpub25lJyB3aWR0aD0nMzAwLjAnIGhlaWdodD0nMzAwLjAnIHg9JzAuMCcgeT0nMC4wJz4gPC9yZWN0Pgo8dGV4dCB4PScxMzguMCcgeT0nMTcwLjAnIGNsYXNzPSdhdG9tLTAnIHN0eWxlPSdmb250LXNpemU6NDBweDtmb250LXN0eWxlOm5vcm1hbDtmb250LXdlaWdodDpub3JtYWw7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOm5vbmU7Zm9udC1mYW1pbHk6c2Fucy1zZXJpZjt0ZXh0LWFuY2hvcjpzdGFydDtmaWxsOiMzQjQxNDMnID5DPC90ZXh0Pgo8dGV4dCB4PScxNjUuNicgeT0nMTcwLjAnIGNsYXNzPSdhdG9tLTAnIHN0eWxlPSdmb250LXNpemU6NDBweDtmb250LXN0eWxlOm5vcm1hbDtmb250LXdlaWdodDpub3JtYWw7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOm5vbmU7Zm9udC1mYW1pbHk6c2Fucy1zZXJpZjt0ZXh0LWFuY2hvcjpzdGFydDtmaWxsOiMzQjQxNDMnID51PC90ZXh0Pgo8cGF0aCBkPSdNIDE4OC40LDE1MC4wIEwgMTg4LjQsMTQ5LjggTCAxODguNCwxNDkuNyBMIDE4OC40LDE0OS41IEwgMTg4LjMsMTQ5LjMgTCAxODguMywxNDkuMiBMIDE4OC4yLDE0OS4wIEwgMTg4LjEsMTQ4LjkgTCAxODguMCwxNDguNyBMIDE4Ny45LDE0OC42IEwgMTg3LjcsMTQ4LjUgTCAxODcuNiwxNDguNCBMIDE4Ny41LDE0OC4zIEwgMTg3LjMsMTQ4LjIgTCAxODcuMiwxNDguMSBMIDE4Ny4wLDE0OC4xIEwgMTg2LjgsMTQ4LjAgTCAxODYuNywxNDguMCBMIDE4Ni41LDE0OC4wIEwgMTg2LjMsMTQ4LjAgTCAxODYuMSwxNDguMCBMIDE4Ni4wLDE0OC4xIEwgMTg1LjgsMTQ4LjEgTCAxODUuNiwxNDguMiBMIDE4NS41LDE0OC4yIEwgMTg1LjMsMTQ4LjMgTCAxODUuMiwxNDguNCBMIDE4NS4xLDE0OC41IEwgMTg0LjksMTQ4LjcgTCAxODQuOCwxNDguOCBMIDE4NC43LDE0OC45IEwgMTg0LjcsMTQ5LjEgTCAxODQuNiwxNDkuMiBMIDE4NC41LDE0OS40IEwgMTg0LjUsMTQ5LjYgTCAxODQuNSwxNDkuNyBMIDE4NC40LDE0OS45IEwgMTg0LjQsMTUwLjEgTCAxODQuNSwxNTAuMyBMIDE4NC41LDE1MC40IEwgMTg0LjUsMTUwLjYgTCAxODQuNiwxNTAuOCBMIDE4NC43LDE1MC45IEwgMTg0LjcsMTUxLjEgTCAxODQuOCwxNTEuMiBMIDE4NC45LDE1MS4zIEwgMTg1LjEsMTUxLjUgTCAxODUuMiwxNTEuNiBMIDE4NS4zLDE1MS43IEwgMTg1LjUsMTUxLjggTCAxODUuNiwxNTEuOCBMIDE4NS44LDE1MS45IEwgMTg2LjAsMTUxLjkgTCAxODYuMSwxNTIuMCBMIDE4Ni4zLDE1Mi4wIEwgMTg2LjUsMTUyLjAgTCAxODYuNywxNTIuMCBMIDE4Ni44LDE1Mi4wIEwgMTg3LjAsMTUxLjkgTCAxODcuMiwxNTEuOSBMIDE4Ny4zLDE1MS44IEwgMTg3LjUsMTUxLjcgTCAxODcuNiwxNTEuNiBMIDE4Ny43LDE1MS41IEwgMTg3LjksMTUxLjQgTCAxODguMCwxNTEuMyBMIDE4OC4xLDE1MS4xIEwgMTg4LjIsMTUxLjAgTCAxODguMywxNTAuOCBMIDE4OC4zLDE1MC43IEwgMTg4LjQsMTUwLjUgTCAxODguNCwxNTAuMyBMIDE4OC40LDE1MC4yIEwgMTg4LjQsMTUwLjAgTCAxODYuNCwxNTAuMCBaJyBzdHlsZT0nZmlsbDojMDAwMDAwO2ZpbGwtcnVsZTpldmVub2RkO2ZpbGwtb3BhY2l0eToxO3N0cm9rZTojMDAwMDAwO3N0cm9rZS13aWR0aDowLjBweDtzdHJva2UtbGluZWNhcDpidXR0O3N0cm9rZS1saW5lam9pbjptaXRlcjtzdHJva2Utb3BhY2l0eToxOycgLz4KPC9zdmc+Cg== data:image/svg+xml;base64,PD94bWwgdmVyc2lvbj0nMS4wJyBlbmNvZGluZz0naXNvLTg4NTktMSc/Pgo8c3ZnIHZlcnNpb249JzEuMScgYmFzZVByb2ZpbGU9J2Z1bGwnCiAgICAgICAgICAgICAgeG1sbnM9J2h0dHA6Ly93d3cudzMub3JnLzIwMDAvc3ZnJwogICAgICAgICAgICAgICAgICAgICAgeG1sbnM6cmRraXQ9J2h0dHA6Ly93d3cucmRraXQub3JnL3htbCcKICAgICAgICAgICAgICAgICAgICAgIHhtbG5zOnhsaW5rPSdodHRwOi8vd3d3LnczLm9yZy8xOTk5L3hsaW5rJwogICAgICAgICAgICAgICAgICB4bWw6c3BhY2U9J3ByZXNlcnZlJwp3aWR0aD0nODVweCcgaGVpZ2h0PSc4NXB4JyB2aWV3Qm94PScwIDAgODUgODUnPgo8IS0tIEVORCBPRiBIRUFERVIgLS0+CjxyZWN0IHN0eWxlPSdvcGFjaXR5OjEuMDtmaWxsOiNGRkZGRkY7c3Ryb2tlOm5vbmUnIHdpZHRoPSc4NS4wJyBoZWlnaHQ9Jzg1LjAnIHg9JzAuMCcgeT0nMC4wJz4gPC9yZWN0Pgo8dGV4dCB4PSczNS4wJyB5PSc1My42JyBjbGFzcz0nYXRvbS0wJyBzdHlsZT0nZm9udC1zaXplOjIzcHg7Zm9udC1zdHlsZTpub3JtYWw7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZpbGwtb3BhY2l0eToxO3N0cm9rZTpub25lO2ZvbnQtZmFtaWx5OnNhbnMtc2VyaWY7dGV4dC1hbmNob3I6c3RhcnQ7ZmlsbDojM0I0MTQzJyA+QzwvdGV4dD4KPHRleHQgeD0nNTEuMCcgeT0nNTMuNicgY2xhc3M9J2F0b20tMCcgc3R5bGU9J2ZvbnQtc2l6ZToyM3B4O2ZvbnQtc3R5bGU6bm9ybWFsO2ZvbnQtd2VpZ2h0Om5vcm1hbDtmaWxsLW9wYWNpdHk6MTtzdHJva2U6bm9uZTtmb250LWZhbWlseTpzYW5zLXNlcmlmO3RleHQtYW5jaG9yOnN0YXJ0O2ZpbGw6IzNCNDE0MycgPnU8L3RleHQ+CjxwYXRoIGQ9J00gNjYuNCw0Mi4wIEwgNjYuNCw0MS45IEwgNjYuNCw0MS44IEwgNjYuNCw0MS43IEwgNjYuMyw0MS42IEwgNjYuMyw0MS41IEwgNjYuMiw0MS40IEwgNjYuMiw0MS4zIEwgNjYuMSw0MS4zIEwgNjYuMSw0MS4yIEwgNjYuMCw0MS4xIEwgNjUuOSw0MS4xIEwgNjUuOCw0MS4wIEwgNjUuNyw0MS4wIEwgNjUuNiw0MC45IEwgNjUuNSw0MC45IEwgNjUuNSw0MC45IEwgNjUuNCw0MC44IEwgNjUuMyw0MC44IEwgNjUuMiw0MC44IEwgNjUuMSw0MC45IEwgNjUuMCw0MC45IEwgNjQuOSw0MC45IEwgNjQuOCw0MC45IEwgNjQuNyw0MS4wIEwgNjQuNiw0MS4wIEwgNjQuNSw0MS4xIEwgNjQuNCw0MS4yIEwgNjQuNCw0MS4yIEwgNjQuMyw0MS4zIEwgNjQuMiw0MS40IEwgNjQuMiw0MS41IEwgNjQuMiw0MS42IEwgNjQuMSw0MS43IEwgNjQuMSw0MS44IEwgNjQuMSw0MS45IEwgNjQuMSw0Mi4wIEwgNjQuMSw0Mi4wIEwgNjQuMSw0Mi4xIEwgNjQuMSw0Mi4yIEwgNjQuMSw0Mi4zIEwgNjQuMiw0Mi40IEwgNjQuMiw0Mi41IEwgNjQuMiw0Mi42IEwgNjQuMyw0Mi43IEwgNjQuNCw0Mi44IEwgNjQuNCw0Mi44IEwgNjQuNSw0Mi45IEwgNjQuNiw0My4wIEwgNjQuNyw0My4wIEwgNjQuOCw0My4xIEwgNjQuOSw0My4xIEwgNjUuMCw0My4xIEwgNjUuMSw0My4xIEwgNjUuMiw0My4yIEwgNjUuMyw0My4yIEwgNjUuNCw0My4yIEwgNjUuNSw0My4xIEwgNjUuNSw0My4xIEwgNjUuNiw0My4xIEwgNjUuNyw0My4wIEwgNjUuOCw0My4wIEwgNjUuOSw0Mi45IEwgNjYuMCw0Mi45IEwgNjYuMSw0Mi44IEwgNjYuMSw0Mi43IEwgNjYuMiw0Mi43IEwgNjYuMiw0Mi42IEwgNjYuMyw0Mi41IEwgNjYuMyw0Mi40IEwgNjYuNCw0Mi4zIEwgNjYuNCw0Mi4yIEwgNjYuNCw0Mi4xIEwgNjYuNCw0Mi4wIEwgNjUuMiw0Mi4wIFonIHN0eWxlPSdmaWxsOiMwMDAwMDA7ZmlsbC1ydWxlOmV2ZW5vZGQ7ZmlsbC1vcGFjaXR5OjE7c3Ryb2tlOiMwMDAwMDA7c3Ryb2tlLXdpZHRoOjAuMHB4O3N0cm9rZS1saW5lY2FwOmJ1dHQ7c3Ryb2tlLWxpbmVqb2luOm1pdGVyO3N0cm9rZS1vcGFjaXR5OjE7JyAvPgo8L3N2Zz4K [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- 229910052802 copper Inorganic materials 0.000 description 1
- 239000010949 copper Substances 0.000 description 1
- 239000003365 glass fiber Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000003607 modifier Substances 0.000 description 1
- 230000036651 mood Effects 0.000 description 1
- 230000002093 peripheral Effects 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce, e.g. shopping or e-commerce
- G06Q30/02—Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
- G06Q30/0241—Advertisement
- G06Q30/0251—Targeted advertisement
- G06Q30/0267—Wireless devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/002—Specific input/output arrangements not covered by G06F3/01 - G06F3/16
- G06F3/005—Input arrangements through a video camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
- G06K7/1417—2D bar codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce, e.g. shopping or e-commerce
- G06Q30/02—Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
- G06Q30/0241—Advertisement
- G06Q30/0251—Targeted advertisement
- G06Q30/0252—Targeted advertisement based on events or environment, e.g. weather or festivals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce, e.g. shopping or e-commerce
- G06Q30/02—Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
- G06Q30/0241—Advertisement
- G06Q30/0251—Targeted advertisement
- G06Q30/0255—Targeted advertisement based on user history
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06Q—DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce, e.g. shopping or e-commerce
- G06Q30/02—Marketing, e.g. market research and analysis, surveying, promotions, advertising, buyer profiling, customer management or rewards; Price estimation or determination
- G06Q30/0241—Advertisement
- G06Q30/0251—Targeted advertisement
- G06Q30/0261—Targeted advertisement based on user location
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
Abstract
A computer-implemented method for providing advertisements in an augmented reality environment to a user includes receiving data related to a marker, the marker placed amongst one or more physical objects captured by the video camera. The computer-implemented method also includes retrieving dynamic digital content associated with the marker. Further, the computer-implemented method includes displaying the dynamic digital content amongst the one or more physical objects. Furthermore, the computer-implemented method includes receiving a user interaction with the dynamic digital content. Moreover, the computer-implemented method includes performing an action based on the user interaction.
Description
- This application is a continuation of U.S. patent application Ser. No. 13/296,236, filed Nov. 15, 2011, the entirety of which is incorporated by reference herein.
- Embodiments of the disclosure relate generally, to targeted advertising, and more specifically, advertisements in an augmented reality environment.
- Augmented Reality (AR) enhances a person's current perception of reality with computer generated output with, for example, sound, video and graphics. AR gives a live view of a physical, real-world environment where objects in the environment are augmented. Artificial information about environment and associated physical objects can be overlaid on the real world. With the help of AR, information around the real world becomes interactive. AR technologies have been enhancing interaction of users with the real world using computer generated virtual objects. Moreover, usage of AR to promote products with interactive AR applications is becoming common. Shopping environment using AR, however, poses more challenges.
- Various traditional methods of advertising exist, for example, light box advertising, posterior or exterior wall advertising, and out-of-home advertising. However, the traditional methods have only fixed content that are displayed to the user. Further, advertisements are not interactive with the user. Interactive advertisements stills remain a challenge.
- In light of the foregoing discussion, there is a need to dynamically provide advertisements in an augmented reality environment.
- The above-mentioned needs are met by a method, system, and computer program product for providing interactive advertisements in an augmented reality environment.
- An example of a computer-implemented method for providing advertisements in an augmented reality environment includes receiving data related to a marker, the marker placed amongst one or more physical objects captured by the video camera. The computer-implemented method also includes retrieving dynamic digital content associated with the marker. Further, the computer-implemented method includes displaying the dynamic digital content amongst the one or more physical objects. Furthermore, the computer-implemented method includes receiving a user interaction with the dynamic digital content. Moreover, the computer-implemented method includes performing an action based on the user interaction.
- An example of a computer program product stored on a non-transitory computer-readable medium that when executed by a processor, performs a method for providing advertisements in an augmented reality environment, includes data related to a marker, the marker placed amongst one or more physical objects captured by the video camera. The computer program product also includes retrieving dynamic digital content associated with the marker. Further, the computer program product includes displaying the dynamic digital content amongst the one or more physical objects. Furthermore, the computer program product includes receiving a user interaction with the dynamic digital content. Moreover, the computer program product includes performing an action based on the user interaction.
- An example of a system for providing advertisements in an augmented reality environment includes a video camera to receive data related to a marker, the marker placed amongst one or more physical objects captured by the video camera. The system also includes a network interface to retrieve dynamic digital content associated with the marker. Further, the system includes a display device to display the dynamic digital content amongst the one or more physical objects. Furthermore, the system includes a user interface to receive a user interaction with the dynamic digital content. Moreover, the system includes an interaction module to perform an action based on the user interaction
- Advantageously, a user can view and interact with advertisements in an augmented reality environment.
- The features and advantages described in this summary and in the following detailed description are not all-inclusive, and particularly, many additional features and advantages will be apparent to one of ordinary skill in the relevant art in view of the drawings, specification, and claims hereof. Moreover, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter, resort to the claims being necessary to determine such inventive subject matter.
- In the following drawings like reference numbers are used to refer to like elements. Although the following figures depict various examples of the invention, the invention is not limited to the examples depicted in the figures.
-
FIG. 1 is a flow diagram illustrating a method for providing advertisements in an augmented reality environment, in accordance with one embodiment; -
FIG. 2 is a schematic diagram illustrating interaction of an augmented reality model with physical world, in accordance with one embodiment; -
FIG. 3 is a schematic diagram illustrating markers and corresponding dynamic digital content, in accordance with one embodiment; -
FIG. 4 is a schematic diagram illustrating a method to retrieve augmented reality contents, in accordance with one embodiment; -
FIG. 5 is an exemplary representation of user interaction on dynamic digital content, in accordance with one embodiment; and -
FIG. 6 is a block diagram illustrating a mobile computing device, in accordance with one embodiment. - A method, system, and computer program product for providing advertisements in an augmented reality environment to a user is disclosed. The augmented reality environment refers, in one embodiment, to a live view of a physical, real-world environment which is modified by a device having a video camera and display.
- The following detailed description is intended to provide example implementations to one of ordinary skill in the art, and is not intended to limit the invention to the explicit disclosure, as one or ordinary skill in the art will understand that variations can be substituted that are within the scope of the invention as described.
-
FIG. 1 is a flow diagram illustrating a method for providing advertisements in an augmented reality environment, in accordance with one embodiment. - At step 110, data related to a marker is received. The marker is placed amongst one or more physical objects and then captured by a video camera, a photograph, a video stream, or just a still frame.
- A user of the device places the video camera over the one or more physical objects in real world. The physical objects are fitted with markers. The markers are specific patterns that are detected by augmented reality. The video camera captures the physical object and data related to the marker is received. The data includes, but is not limited to, position, rotation and scale of the marker.
- In one embodiment, the marker includes a Quick Response (QR) code marker. The QR code marker follows a specific pattern in the physical object and is represented as black and white squares. The black and white squares represent an encoded string of characters. The characters are first encoded as bits (zeros and ones) and later printed as the black and white squares.
- A marker can be recognized by, for example, a mobile application executing on a cell phone or PDA. In one embodiment, the application is always detecting markers, and in another embodiment, the application detects markers upon request by a user.
- At step 115, dynamic digital content associated with the marker, such as an interactive advertisement, is retrieved.
- The marker is converted to a network address. Using the network address the dynamic digital content is retrieved. In one embodiment, a Universal Resource Locator (URL) is retrieved which leads to a website. The URL can be accessed and downloaded over a data network, a cellular network, or the like. The dynamic digital content can be stored locally in RAM for immediate display, or stored in memory as a prefetch for a later display.
- The digital content is considered dynamic because, in one embodiment, the digital content is constantly updated. As a result, dynamic data retrieved for a first user can differ from dynamic data retrieved for a second user. Many factors can be used to determine which dynamic data to send responsive to a request. Exemplary factors include user profile, time, day, location (e.g., as determined by an integrated GPS), mood, preferences, and other context factors.
- At step 120, the dynamic digital content is displayed amongst the one or more physical objects. In one embodiment, a user can see real objects integrated in a video display with augmented reality objects. One example is discussed below with respect to
FIG. 2 . The video display can be at any resolution such as standard, high definition, or 3-dimensional, and of any format such as MP4. - A mobile application can include a video renderer. In operation, the video renderer combines, or overlays multiple video streams into a single stream. One stream is the real world video and another stream is the augmented reality video generated from the dynamic digital content. Based on the movements of the video camera, in relation to the markers, display of the dynamic digital content is adjusted. As the user moves the video camera across the physical objects, step 110, step 115 and step 120 are performed. For example, consider the video camera placed over an image of spacetti in a magazine. An advertisement related to different types of spaghetti is displayed. At this point, the video camera is moved to another image of sports shoes in the magazine. Consequently, an advertisement related to various brands of the sports shoes is displayed to the user.
- A variation of the dynamic digital content is selected in accordance with at least one of time, date, location, information about a user, a user preference, and display capability of a device.
- At step 125, a user interaction with the dynamic digital content is received.
- The dynamic digital content includes a mechanism to make a purchase. For example, the user can buy a product displayed in the advertisement using a BUY button.
- At step 130, an action is performed based on the user interaction.
- Examples of the action includes, but are not limited to, purchasing a product, posting a comment related to an advertisement and a commenting on Twitter.
-
FIG. 2 is a schematic diagram illustrating interaction of an augmented reality model with physical world, in accordance with one embodiment. - A mobile device 210 is placed in the augmented reality environment 220. A camera in the mobile device 210 captures markers from the augmented reality environment 220 and, in response, displays a girl 230 sitting on a physical box.
-
FIG. 3 is a schematic diagram illustrating markers and corresponding dynamic digital content, in accordance with one embodiment. - A plurality of markers 310 represents specific patterns of images that are detected by augmented reality. For each of the markers 310 corresponding augmented reality dynamic digital content is shown. The dynamic digital content includes advertisements 320. Further, each of the markers 310 is unique and corresponds to one of the advertisements 320.
- The advertisements 320 are dynamic. Content of the advertisements 320 can change based on a plurality of factors, for example, time and location of video camera.
-
FIG. 4 is a schematic diagram illustrating a method to retrieve augmented reality contents, in accordance with one embodiment. - A mobile device 410 captures a marker or a (Quick Response) QR code marker in an augmented environment. The QR code marker follows a specific pattern in the physical object and is represented as black and white squares. The black and white squares represent an encoded string of characters.
- In one embodiment, the mobile device 410 can also be a Personal Computer (PC), a laptop or notebook computer, a tablet computer, a smart phone or Personal Digital Assistant (PDA), a smart appliance, a video gaming console, an Internet television, a set-up box, or any other suitable processor-based device that can view advertisements.
- Based on the captured marker or QR code marker, a high reliability image feature is sent to a mass storage and augmented reality framework. At this point, the mobile device 410 retrieves augmented reality 3D model and dynamic digital content from the mass storage and augmented reality framework.
-
FIG. 5 is an exemplary representation of user interaction on dynamic digital content, in accordance with one embodiment. - The dynamic digital content is retrieved by the mobile device 410 as explained in
FIG. 4 . At this point, a user of the mobile device 410 performs an action. Examples of the action include, but are not limited to, movements of the video camera, change in location of the mobile device 410, and capturing of a new marker. - Data related to the action performed by the user is then sent to a mass storage and Augmented Reality framework. Based on the data, response content is sent to the mobile device 410. The response content refers to an interaction that the user performs. For example, the user can now buy product 510.
-
FIG. 6 is a block diagram illustrating a mobile computing device 610, in accordance with one embodiment. - The computing device 610 includes a processor 610, a hard drive 620, an I/O port 630, and a memory 640, coupled by a bus 699.
- The bus 699 can be soldered to one or more motherboards. Examples of the processor 610 includes, but is not limited to, a general purpose processor, an application-specific integrated circuit (ASIC), an FPGA (Field Programmable Gate Array), a RISC (Reduced Instruction Set Controller) processor, or an integrated circuit. There can be a single core or multiple cores processor. In one embodiment, the processor 610 is specially suited for processing demands of location-aware reminders (for example, custom micro-code, and instruction fetching, pipelining or cache sizes). The processor 610 can be disposed on silicon or any other suitable material. In operation, the processor 610 can receive and execute instructions and data stored in the memory 640 or the hard drive 620. The hard drive 620 can be a platter-based storage device, a flash drive, an external drive, a persistent memory device, or other types of memory.
- The hard drive 620 provides persistent (long term) storage for instructions and data. The I/O port 630 is an input/output panel including a network card 632 with an interface 633, along with a keyboard controller 634, a mouse controller 636, and a GPS card 638. The network card 632 can be, for example, a wired networking card (for example, a USB card, or an IEEE 802.3 card), a wireless networking card (for example, an IEEE 802.11 card, or a Bluetooth card), and a cellular networking card (for example, a 3G card). The interface 633 is configured according to networking compatibility. For example, a wired networking card includes a physical port to plug in a cord, and a wireless networking card includes an antennae. The network card 632 provides access to a communication channel on a network. The keyboard controller 634 can be coupled to a physical port 635 (for example, PS/2 or USB port) for connecting a keyboard. The keyboard can be a standard alphanumeric keyboard with 101 or 104 keys (including alphabetic, numerical and punctuation keys, a space bar, modifier keys, etc.), a laptop or notebook keyboard, a thumb-sized keyboard, a virtual keyboard, or the like. The mouse controller 636 can also be coupled to a physical port 637 (e.g., mouse or USB port). The GPS card 638 provides communication to GPS satellites operating in space to receive location data. An antenna 639 provides radio communications (or alternatively, a data port can receive location information from a peripheral device).
- The memory 640 can be a RAM (Random Access Memory), a flash memory, a non-persistent memory device, or other devices capable of storing program instructions being executed. The memory 640 comprises an Operating System (OS) module 642 along with a timer unit 610. In other embodiments, the memory 640 comprises a calendar application that manages a plurality of appointments. The OS module 642 can be one of Microsoft Windows® family of operating systems (for example, Windows 95, 98, Me, Windows NT, Windows 2000, Windows XP, Windows XP x64 Edition, Windows Vista, Windows CE, Windows Mobile), Linux, HP-UX, UNIX, Sun OS, Solaris, Mac OS X, Alpha OS, AIX, IRIX32, or IRIX64.
- As described herein, computer software products can be written in any of various suitable programming languages, such as C, C++, C#, Pascal, Fortran, Perl, Matlab (from MathWorks), SAS, SPSS, JavaScript, AJAX, and Java. The computer software product may be an independent application with data input and data display modules. Alternatively, the computer software products can be classes that can be instantiated as distributed objects. The computer software products can also be component software, for example Java Beans (from Sun Microsystems) or Enterprise Java Beans (EJB from Sun Microsystems). Many functionalities described herein can be implemented in computer software, computer hardware, or a combination.
- Furthermore, a computer that is running the previously mentioned computer software can be connected to a network and can interface to other computers using the network. The network can be an intranet, internet, or the Internet, among others. The network can be a wired network (for example, using copper), telephone network, packet network, an optical network (for example, using optical fiber), or a wireless network, or a combination of such networks. For example, data and other information can be passed between the computer and components (or steps) of a system using a wireless network based on a protocol, for example Wi-Fi (IEEE standards 802.11, 802.11a, 802.11b, 802.11e, 802.11g, 802.11i, and 802.11n). In one example, signals from the computer can be transferred, at least in part, wirelessly to components or other computers.
- As will be understood by those familiar with the art, the invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Likewise, the particular naming and division of the portions, modules, agents, managers, components, functions, procedures, actions, layers, features, attributes, methodologies and other aspects are not mandatory or significant, and the mechanisms that implement the invention or its features may have different names, divisions and/or formats.
- Furthermore, as will be apparent to one of ordinary skill in the relevant art, the portions, modules, agents, managers, components, functions, procedures, actions, layers, features, attributes, methodologies and other aspects of the invention can be implemented as software, hardware, firmware or any combination of the three. Of course, wherever a component of the present invention is implemented as software, the component can be implemented as a script, as a standalone program, as part of a larger program, as a plurality of separate scripts and/or programs, as a statically or dynamically linked library, as a kernel loadable module, as a device driver, and/or in every and any other way known now or in the future to those of skill in the art of computer programming. Additionally, the present invention is in no way limited to implementation in any specific programming language, or for any specific operating system or environment.
- Furthermore, it will be readily apparent to those of ordinary skill in the relevant art that where the present invention is implemented in whole or in part in software, the software components thereof can be stored on computer readable media as computer program products. Any form of computer readable medium can be used in this context, such as magnetic or optical storage media. Additionally, software portions of the present invention can be instantiated (for example as object code or executable images) within the memory of any programmable computing device.
- Accordingly, the disclosure of the present invention is intended to be illustrative, but not limiting, of the scope of the invention, which is set forth in the following claims.
Claims (21)
1-20. (canceled)
21. A computer-implemented method for providing dynamic digital content within an augmented reality environment, the method comprising:
receiving image data captured by an image capture device of a mobile device, the image depicting a marker formed in a pattern corresponding to a dynamic digital content;
receiving, from the mobile device, factor information corresponding to a user of an augmented reality framework;
communicating with a database included in the augmented reality framework;
retrieving the dynamic digital content from the database based on the pattern of the marker and the factor information;
transmitting the dynamic digital content to the mobile device for generating an augmented reality environment on the mobile device that combines a current video stream captured by the image capture device of the mobile device and the dynamic digital content;
receiving, from the mobile device, user interaction information describing an interaction with the dynamic digital content detected by the mobile device; and
performing an action based on the user interaction information.
22. The method of claim 21 , further comprising:
receiving, from the mobile device, second factor information corresponding to a second user;
retrieving a second dynamic digital content from the database based on the pattern of the marker and the second factor information;
transmitting the second dynamic digital content to the mobile device for generating a display of a second augmented reality environment on the mobile device that combines a second current video stream captured by the video camera device of the mobile device and the second dynamic digital content.
23. The method of claim 22 , wherein the second dynamic digital content is dynamically updated from the dynamic digital content based on the pattern of the marker and the second factor information, the second dynamic digital content having display attributes displayable in accordance with a display capability of the mobile device.
24. The method of claim 22 , further comprising:
adjusting the second dynamic digital content based on detected movements of the mobile device in relation to the marker.
25. The method of claim 21 , wherein the marker covers, at least in part, a physical product, and the dynamic digital content comprises information related to the physical product.
26. The method of claim 21 , further comprising:
converting the marker to a network address, wherein the dynamic digital content is retrieved using the network address.
27. The method of claim 21 , wherein the marker comprises a QR code marker.
28. The method of claim 21 , wherein a video renderer running on the mobile device is configured to combine the current video stream and the dynamic digital content into a single video stream displayed on a display screen of the mobile device.
29. A non-transitory computer-readable medium storing instructions that when executed by a processor, causes the processor to perform a method for providing dynamic digital content within an augmented reality environment, the method comprising:
receiving image data captured by an image capture device of a mobile device, the image depicting a marker formed in a pattern corresponding to a dynamic digital content;
receiving, from the mobile device, factor information corresponding to a user of an augmented reality framework;
communicating with a database included in the augmented reality framework;
retrieving the dynamic digital content from the database based on the pattern of the marker and the factor information;
transmitting the dynamic digital content to the mobile device for generating an augmented reality environment on the mobile device that combines a current video stream captured by the image capture device of the mobile device and the dynamic digital content;
receiving, from the mobile device, user interaction information describing an interaction with the dynamic digital content detected by the mobile device; and
performing an action based on the user interaction information.
30. The non-transitory computer-readable medium of claim 29 , the method further comprising:
receiving, from the mobile device, second factor information corresponding to a second user;
retrieving a second dynamic digital content from the database based on the pattern of the marker and the second factor information;
transmitting the second dynamic digital content to the mobile device for generating a display of a second augmented reality environment on the mobile device that combines a second current video stream captured by the video camera device of the mobile device and the second dynamic digital content.
31. The non-transitory computer-readable medium of claim 30 , wherein the second dynamic digital content is dynamically updated from the dynamic digital content based on the pattern of the marker and the second factor information, the second dynamic digital content having display attributes displayable in accordance with a display capability of the mobile device.
32. The non-transitory computer-readable medium of claim 30 , the method further comprising:
adjusting the second dynamic digital content based on detected movements of the mobile device in relation to the marker.
33. The non-transitory computer-readable medium of claim 29 , wherein the marker covers, at least in part, a physical product, and the dynamic digital content comprises information related to the physical product.
34. The non-transitory computer-readable medium of claim 29 , the method further comprising:
converting the marker to a network address, wherein the dynamic digital content is retrieved using the network address.
35. The non-transitory computer-readable medium of claim 29 , wherein the marker comprises a QR code marker.
36. The non-transitory computer-readable medium of claim 29 , wherein a video renderer running on the mobile device is configured to combine the current video stream and the dynamic digital content into a single video stream displayed on a display screen of the mobile device.
37. A computing device within an augmented reality framework for providing dynamic digital content within an augmented reality environment, the computing device comprising:
a network interface in communication with a mobile device through an augmented reality network, and configured to:
receive, from the mobile device, image data captured by an image capture device of a mobile device, the image depicting a marker formed in a pattern corresponding to a dynamic digital content;
receive, from the mobile device, factor information corresponding to a user of the augmented reality framework;
communicating with a database included in the augmented reality framework;
retrieving the dynamic digital content from the database based on the pattern of the marker and the factor information;
a dynamic digital content processor configured to:
transmit the dynamic digital content to the mobile device for generating an augmented reality environment on the mobile device that combines a current video stream captured by the image capture device of the mobile device and the dynamic digital content;
receive, from the mobile device, user interaction information describing an interaction with the dynamic digital content detected by the mobile device; and
perform an action based on the user interaction information.
38. The computing device of claim 37 , wherein the network interface is further configured to:
receive, from the mobile device, second factor information corresponding to a second user;
retrieve a second dynamic digital content from the database based on the pattern of the marker and the second factor information; and
wherein the dynamic digital content processor is further configured to:
transmit the second dynamic digital content to the mobile device for generating a display of a second augmented reality environment on the mobile device that combines a second current video stream captured by the video camera device of the mobile device and the second dynamic digital content.
39. The computing device of claim 38 , wherein the second dynamic digital content is dynamically updated from the dynamic digital content based on the pattern of the marker and the second factor information, the second dynamic digital content having display attributes displayable in accordance with a display capability of the mobile device.
40. The computing device of claim 38 , wherein the dynamic digital content processor is further configured to:
adjust the second dynamic digital content based on detected movements of the mobile device in relation to the marker.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/296,236 US9536251B2 (en) | 2011-11-15 | 2011-11-15 | Providing advertisements in an augmented reality environment |
US15/397,282 US20170116644A1 (en) | 2011-11-15 | 2017-01-03 | Providing advertisements in an augmented reality environment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/397,282 US20170116644A1 (en) | 2011-11-15 | 2017-01-03 | Providing advertisements in an augmented reality environment |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date | |
---|---|---|---|---|
US13/296,236 Continuation US9536251B2 (en) | 2011-11-15 | 2011-11-15 | Providing advertisements in an augmented reality environment |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170116644A1 true US20170116644A1 (en) | 2017-04-27 |
Family
ID=48281534
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/296,236 Active 2031-12-23 US9536251B2 (en) | 2011-11-15 | 2011-11-15 | Providing advertisements in an augmented reality environment |
US15/397,282 Abandoned US20170116644A1 (en) | 2011-11-15 | 2017-01-03 | Providing advertisements in an augmented reality environment |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/296,236 Active 2031-12-23 US9536251B2 (en) | 2011-11-15 | 2011-11-15 | Providing advertisements in an augmented reality environment |
Country Status (1)
Country | Link |
---|---|
US (2) | US9536251B2 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10691767B2 (en) | 2018-11-07 | 2020-06-23 | Samsung Electronics Co., Ltd. | System and method for coded pattern communication |
CN111683077A (en) * | 2020-06-02 | 2020-09-18 | 硅谷数模(苏州)半导体有限公司 | Virtual reality equipment and data processing method |
US11354815B2 (en) | 2018-05-23 | 2022-06-07 | Samsung Electronics Co., Ltd. | Marker-based augmented reality system and method |
Families Citing this family (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8810598B2 (en) | 2011-04-08 | 2014-08-19 | Nant Holdings Ip, Llc | Interference based augmented reality hosting platforms |
KR101874895B1 (en) * | 2012-01-12 | 2018-07-06 | 삼성전자 주식회사 | Method for providing augmented reality and terminal supporting the same |
US8803916B1 (en) * | 2012-05-03 | 2014-08-12 | Sprint Communications Company L.P. | Methods and systems for an augmented reality service delivery platform |
US8918087B1 (en) | 2012-06-08 | 2014-12-23 | Sprint Communications Company L.P. | Methods and systems for accessing crowd sourced landscape images |
US20140025481A1 (en) * | 2012-07-20 | 2014-01-23 | Lg Cns Co., Ltd. | Benefit promotion advertising in an augmented reality environment |
US10223755B2 (en) * | 2013-04-12 | 2019-03-05 | At&T Intellectual Property I, L.P. | Augmented reality retail system |
US20150009233A1 (en) * | 2013-07-03 | 2015-01-08 | Dylan Phillips | Asset-Linked Augmented Reality With User Generated Content and User Assigned Editable Links |
US9245192B2 (en) * | 2013-09-20 | 2016-01-26 | Here Global B.V. | Ad collateral detection |
US9582516B2 (en) | 2013-10-17 | 2017-02-28 | Nant Holdings Ip, Llc | Wide area augmented reality location-based services |
US9323323B2 (en) | 2014-01-06 | 2016-04-26 | Playground Energy Ltd | Augmented reality system for playground equipment incorporating transforming avatars |
US9451051B1 (en) * | 2014-02-13 | 2016-09-20 | Sprint Communications Company L.P. | Method and procedure to improve delivery and performance of interactive augmented reality applications over a wireless network |
WO2015159289A1 (en) * | 2014-04-15 | 2015-10-22 | Navigate Surgical Technologies, Inc. | Marker-based pixel replacement |
US20160050465A1 (en) * | 2014-08-18 | 2016-02-18 | Groopic, Inc. | Dynamically targeted ad augmentation in video |
US9734634B1 (en) * | 2014-09-26 | 2017-08-15 | A9.Com, Inc. | Augmented reality product preview |
US9697383B2 (en) * | 2015-04-14 | 2017-07-04 | International Business Machines Corporation | Numeric keypad encryption for augmented reality devices |
US10057220B2 (en) * | 2015-07-24 | 2018-08-21 | International Business Machines Corporation | Message encryption |
GB2551473A (en) * | 2016-04-29 | 2017-12-27 | String Labs Ltd | Augmented media |
US10748339B2 (en) | 2016-06-03 | 2020-08-18 | A Big Chunk Of Mud Llc | System and method for implementing computer-simulated reality interactions between users and publications |
US10262631B1 (en) | 2017-08-31 | 2019-04-16 | Bentley Systems, Incorporated | Large scale highly detailed model review using augmented reality |
US10509534B2 (en) | 2017-09-05 | 2019-12-17 | At&T Intellectual Property I, L.P. | System and method of providing automated customer service with augmented reality and social media integration |
US10922878B2 (en) * | 2017-10-04 | 2021-02-16 | Google Llc | Lighting for inserted content |
WO2019170835A1 (en) * | 2018-03-09 | 2019-09-12 | Adverty Ab | Advertising in augmented reality |
US10528998B2 (en) * | 2018-04-11 | 2020-01-07 | Trivver, Inc. | Systems and methods for presenting information related to products or services being shown on a second display device on a first display device using augmented reality technology |
US10922895B2 (en) | 2018-05-04 | 2021-02-16 | Microsoft Technology Licensing, Llc | Projection of content libraries in three-dimensional environment |
US11032607B2 (en) | 2018-12-07 | 2021-06-08 | At&T Intellectual Property I, L.P. | Methods, devices, and systems for embedding visual advertisements in video content |
US20210084233A1 (en) * | 2019-09-18 | 2021-03-18 | Google Llc | Generating and rendering motion graphics effects based on recognized content in camera view finder |
WO2021105751A1 (en) * | 2019-11-26 | 2021-06-03 | Telefonaktiebolaget Lm Ericsson (Publ) | Occlusion of virtual content in extended reality |
US20210304267A1 (en) * | 2020-03-27 | 2021-09-30 | Savor Brands Inc. | Systems and methods for consumer integration into a point-of-sale system |
Citations (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090165140A1 (en) * | 2000-10-10 | 2009-06-25 | Addnclick, Inc. | System for inserting/overlaying markers, data packets and objects relative to viewable content and enabling live social networking, n-dimensional virtual environments and/or other value derivable from the content |
US20100257252A1 (en) * | 2009-04-01 | 2010-10-07 | Microsoft Corporation | Augmented Reality Cloud Computing |
US20110134108A1 (en) * | 2009-12-07 | 2011-06-09 | International Business Machines Corporation | Interactive three-dimensional augmented realities from item markers for on-demand item visualization |
US20110145068A1 (en) * | 2007-09-17 | 2011-06-16 | King Martin T | Associating rendered advertisements with digital content |
US20120086727A1 (en) * | 2010-10-08 | 2012-04-12 | Nokia Corporation | Method and apparatus for generating augmented reality content |
US20120116559A1 (en) * | 2010-11-04 | 2012-05-10 | Davis Bruce L | Smartphone-Based Methods and Systems |
US20120201472A1 (en) * | 2011-02-08 | 2012-08-09 | Autonomy Corporation Ltd | System for the tagging and augmentation of geographically-specific locations using a visual data stream |
US20120200743A1 (en) * | 2011-02-08 | 2012-08-09 | Autonomy Corporation Ltd | System to augment a visual data stream based on a combination of geographical and visual information |
US20120203799A1 (en) * | 2011-02-08 | 2012-08-09 | Autonomy Corporation Ltd | System to augment a visual data stream with user-specific content |
US20120224743A1 (en) * | 2011-03-04 | 2012-09-06 | Rodriguez Tony F | Smartphone-based methods and systems |
US20120263154A1 (en) * | 2011-04-13 | 2012-10-18 | Autonomy Corporation Ltd | Methods and systems for generating and joining shared experience |
US20120299961A1 (en) * | 2011-05-27 | 2012-11-29 | A9.Com, Inc. | Augmenting a live view |
Family Cites Families (84)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3461980B2 (en) * | 1995-08-25 | 2003-10-27 | 株式会社東芝 | High-speed drawing method and apparatus |
US6330356B1 (en) * | 1999-09-29 | 2001-12-11 | Rockwell Science Center Llc | Dynamic visual registration of a 3-D object with a graphical model |
US20020094189A1 (en) * | 2000-07-26 | 2002-07-18 | Nassir Navab | Method and system for E-commerce video editing |
US20020016801A1 (en) * | 2000-08-01 | 2002-02-07 | Steven Reiley | Adaptive profile-based mobile document integration |
US8392552B2 (en) * | 2000-09-28 | 2013-03-05 | Vig Acquisitions Ltd., L.L.C. | System and method for providing configurable security monitoring utilizing an integrated information system |
US6891518B2 (en) * | 2000-10-05 | 2005-05-10 | Siemens Corporate Research, Inc. | Augmented reality visualization device |
US8234218B2 (en) * | 2000-10-10 | 2012-07-31 | AddnClick, Inc | Method of inserting/overlaying markers, data packets and objects relative to viewable content and enabling live social networking, N-dimensional virtual environments and/or other value derivable from the content |
US7034695B2 (en) * | 2000-12-26 | 2006-04-25 | Robert Ernest Troxler | Large area position/proximity correction device with alarms using (D)GPS technology |
DE10103922A1 (en) * | 2001-01-30 | 2002-08-01 | Physoptics Opto Electronic Gmb | Interactive data viewing and operating system |
US20020152117A1 (en) * | 2001-04-12 | 2002-10-17 | Mike Cristofalo | System and method for targeting object oriented audio and video content to users |
US7305691B2 (en) * | 2001-05-07 | 2007-12-04 | Actv, Inc. | System and method for providing targeted programming outside of the home |
US7064742B2 (en) * | 2001-05-31 | 2006-06-20 | Siemens Corporate Research Inc | Input devices using infrared trackers |
US8010702B2 (en) * | 2001-06-14 | 2011-08-30 | Nokia Corporation | Feature-based device description and content annotation |
US6795972B2 (en) * | 2001-06-29 | 2004-09-21 | Scientific-Atlanta, Inc. | Subscriber television system user interface with a virtual reality media space |
US20030078838A1 (en) * | 2001-10-18 | 2003-04-24 | Szmanda Jeffrey P. | Method of retrieving advertising information and use of the method |
US6879320B2 (en) * | 2002-09-12 | 2005-04-12 | Advanced Modern Technologies Corp. | Auto-control display device incorporated with lavatory system |
US20050010697A1 (en) * | 2002-12-30 | 2005-01-13 | Husam Kinawi | System for bandwidth detection and content switching |
US8072470B2 (en) * | 2003-05-29 | 2011-12-06 | Sony Computer Entertainment Inc. | System and method for providing a real-time three-dimensional interactive environment |
US7116342B2 (en) * | 2003-07-03 | 2006-10-03 | Sportsmedia Technology Corporation | System and method for inserting content into an image sequence |
US8599832B2 (en) * | 2005-09-28 | 2013-12-03 | Ingenio Llc | Methods and apparatuses to connect people for real time communications via voice over internet protocol (VOIP) |
US7707039B2 (en) * | 2004-02-15 | 2010-04-27 | Exbiblio B.V. | Automatic modification of web pages |
US7296747B2 (en) * | 2004-04-20 | 2007-11-20 | Michael Rohs | Visual code system for camera-equipped mobile devices and applications thereof |
US8435113B2 (en) * | 2004-12-15 | 2013-05-07 | Google Inc. | Method and system for displaying of transparent ads |
KR101350888B1 (en) * | 2005-07-14 | 2014-01-14 | 찰스 디. 휴스턴 | Gps based spectator and participant sport system and method |
US8914301B2 (en) * | 2005-10-28 | 2014-12-16 | Joyce A. Book | Method and apparatus for dynamic ad creation |
DE102005061952B4 (en) * | 2005-12-23 | 2008-09-11 | Metaio Gmbh | Method and system for determining inaccuracy information in an augmented reality system |
US20070205963A1 (en) * | 2006-03-03 | 2007-09-06 | Piccionelli Gregory A | Heads-up billboard |
US20070248283A1 (en) * | 2006-04-21 | 2007-10-25 | Mack Newton E | Method and apparatus for a wide area virtual scene preview system |
US10452756B2 (en) * | 2006-09-29 | 2019-10-22 | Oath Inc. | Platform for rendering content for a remote device |
US7886226B1 (en) * | 2006-10-03 | 2011-02-08 | Adobe Systems Incorporated | Content based Ad display control |
US8264544B1 (en) * | 2006-11-03 | 2012-09-11 | Keystream Corporation | Automated content insertion into video scene |
US20080186255A1 (en) * | 2006-12-07 | 2008-08-07 | Cohen Philip R | Systems and methods for data annotation, recordation, and communication |
KR101594190B1 (en) * | 2007-06-28 | 2016-02-15 | 톰슨 라이센싱 | Method apparatus and system for providing display device specific content over a network architecture |
CN101802860A (en) * | 2007-07-09 | 2010-08-11 | 维蒂公开股份有限公司 | Mobile device marketing and advertising platforms, methods, and systems |
US8644842B2 (en) * | 2007-09-04 | 2014-02-04 | Nokia Corporation | Personal augmented reality advertising |
US9058764B1 (en) * | 2007-11-30 | 2015-06-16 | Sprint Communications Company L.P. | Markers to implement augmented reality |
US8638908B2 (en) * | 2008-02-28 | 2014-01-28 | Computer Products Introductions, Corp | Contextual conversation processing in telecommunication applications |
US20090286570A1 (en) * | 2008-05-15 | 2009-11-19 | Sony Ericsson Mobile Communications Ab | Portable communication device and method of processing embedded visual cues |
US8542906B1 (en) * | 2008-05-21 | 2013-09-24 | Sprint Communications Company L.P. | Augmented reality image offset and overlay |
US20090300101A1 (en) * | 2008-05-30 | 2009-12-03 | Carl Johan Freer | Augmented reality platform and method using letters, numbers, and/or math symbols recognition |
EP2157545A1 (en) * | 2008-08-19 | 2010-02-24 | Sony Computer Entertainment Europe Limited | Entertainment device, system and method |
KR100974900B1 (en) * | 2008-11-04 | 2010-08-09 | 한국전자통신연구원 | Marker recognition apparatus using dynamic threshold and method thereof |
US20100156933A1 (en) * | 2008-12-19 | 2010-06-24 | Yahoo! Inc. | Virtualized real world advertising system |
US8819541B2 (en) * | 2009-02-13 | 2014-08-26 | Language Technologies, Inc. | System and method for converting the digital typesetting documents used in publishing to a device-specfic format for electronic publishing |
US8275590B2 (en) * | 2009-08-12 | 2012-09-25 | Zugara, Inc. | Providing a simulation of wearing items such as garments and/or accessories |
DE102009037835B4 (en) * | 2009-08-18 | 2012-12-06 | Metaio Gmbh | Method for displaying virtual information in a real environment |
US20120022924A1 (en) * | 2009-08-28 | 2012-01-26 | Nicole Runnels | Method and system for creating a personalized experience with video in connection with a stored value token |
DE102009049073A1 (en) * | 2009-10-12 | 2011-04-21 | Metaio Gmbh | Method for presenting virtual information in a view of a real environment |
DE102009049849B4 (en) * | 2009-10-19 | 2020-09-24 | Apple Inc. | Method for determining the pose of a camera, method for recognizing an object in a real environment and method for creating a data model |
US20120154633A1 (en) * | 2009-12-04 | 2012-06-21 | Rodriguez Tony F | Linked Data Methods and Systems |
US9008432B2 (en) * | 2009-12-23 | 2015-04-14 | Qyoo, Llc. | Coded visual information system |
US9373123B2 (en) * | 2009-12-30 | 2016-06-21 | Iheartmedia Management Services, Inc. | Wearable advertising ratings methods and systems |
US20110213664A1 (en) * | 2010-02-28 | 2011-09-01 | Osterhout Group, Inc. | Local advertising content on an interactive head-mounted eyepiece |
US8964298B2 (en) * | 2010-02-28 | 2015-02-24 | Microsoft Corporation | Video display modification based on sensor input for a see-through near-to-eye display |
WO2011112941A1 (en) * | 2010-03-12 | 2011-09-15 | Tagwhat, Inc. | Purchase and delivery of goods and services, and payment gateway in an augmented reality-enabled distribution network |
CA2696925A1 (en) * | 2010-03-19 | 2011-09-19 | Bertrand Nepveu | Integrated field-configurable headset and system |
US9767474B1 (en) * | 2010-03-23 | 2017-09-19 | Amazon Technologies, Inc. | Transaction tracking and incentives |
US20110246276A1 (en) * | 2010-04-02 | 2011-10-06 | Richard Ross Peters | Augmented- reality marketing with virtual coupon |
US20110279445A1 (en) * | 2010-05-16 | 2011-11-17 | Nokia Corporation | Method and apparatus for presenting location-based content |
US20110307917A1 (en) * | 2010-06-11 | 2011-12-15 | Brian Shuster | Method and apparatus for interactive mobile coupon/offer delivery, storage and redemption system |
US20130100139A1 (en) * | 2010-07-05 | 2013-04-25 | Cognitive Media Innovations (Israel) Ltd. | System and method of serial visual content presentation |
US20120067954A1 (en) * | 2010-09-16 | 2012-03-22 | Madhav Moganti | Sensors, scanners, and methods for automatically tagging content |
US8657809B2 (en) * | 2010-09-29 | 2014-02-25 | Stryker Leibinger Gmbh & Co., Kg | Surgical navigation system |
US20120110477A1 (en) * | 2010-11-02 | 2012-05-03 | Mimesis Republic | Systems and methods for enabling virtual social interactions |
US9275499B2 (en) * | 2010-11-08 | 2016-03-01 | Sony Corporation | Augmented reality interface for video |
US9721387B2 (en) * | 2010-12-21 | 2017-08-01 | Cyberlink Corp. | Systems and methods for implementing augmented reality |
KR101793738B1 (en) * | 2010-12-23 | 2017-11-07 | 한국전자통신연구원 | System and method of providing broadcast augmented reality advertisement service based on media ID junction |
US20120322041A1 (en) * | 2011-01-05 | 2012-12-20 | Weisman Jordan K | Method and apparatus for producing and delivering customized education and entertainment |
US8600892B2 (en) * | 2011-01-05 | 2013-12-03 | Ebay Inc. | Rapid online payment system |
US20110218854A1 (en) * | 2011-01-06 | 2011-09-08 | David Seth Shamlian | System, Apparatus and Method of Optimizing Facility Usage Capacity |
WO2012094605A1 (en) * | 2011-01-06 | 2012-07-12 | Cypher Entertainment | Augmented reality system |
US8584931B2 (en) * | 2011-01-14 | 2013-11-19 | John S.M. Chang | Systems and methods for an augmented experience of products and marketing materials using barcodes |
WO2012100082A2 (en) * | 2011-01-19 | 2012-07-26 | Panelvision, Llc | Interactive point of purchase system |
US8660951B2 (en) * | 2011-03-08 | 2014-02-25 | Bank Of America Corporation | Presenting offers on a mobile communication device |
US8340504B2 (en) * | 2011-04-26 | 2012-12-25 | Sony Computer Entertainment Europe Limited | Entertainment device and method |
US8638223B2 (en) * | 2011-05-18 | 2014-01-28 | Kodak Alaris Inc. | Mobile communicator with orientation detector |
WO2013006725A2 (en) * | 2011-07-05 | 2013-01-10 | Visa International Service Association | Electronic wallet checkout platform apparatuses, methods and systems |
US9886552B2 (en) * | 2011-08-12 | 2018-02-06 | Help Lighting, Inc. | System and method for image registration of multiple video streams |
US8749396B2 (en) * | 2011-08-25 | 2014-06-10 | Satorius Stedim Biotech Gmbh | Assembling method, monitoring method, communication method, augmented reality system and computer program product |
US20130232430A1 (en) * | 2011-08-26 | 2013-09-05 | Reincloud Corporation | Interactive user interface |
US20130222371A1 (en) * | 2011-08-26 | 2013-08-29 | Reincloud Corporation | Enhancing a sensory perception in a field of view of a real-time source within a display screen through augmented reality |
US20130072308A1 (en) * | 2011-09-15 | 2013-03-21 | Qonqr, Llc | Location-Based Multiplayer Game System and Method |
IN2014CN03530A (en) * | 2011-11-08 | 2015-07-03 | Vidinoti Sa | |
EP2624180A1 (en) * | 2012-02-06 | 2013-08-07 | Xabier Uribe-Etxebarria Jimenez | System of integrating remote third party services |
-
2011
- 2011-11-15 US US13/296,236 patent/US9536251B2/en active Active
-
2017
- 2017-01-03 US US15/397,282 patent/US20170116644A1/en not_active Abandoned
Patent Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20090165140A1 (en) * | 2000-10-10 | 2009-06-25 | Addnclick, Inc. | System for inserting/overlaying markers, data packets and objects relative to viewable content and enabling live social networking, n-dimensional virtual environments and/or other value derivable from the content |
US20110145068A1 (en) * | 2007-09-17 | 2011-06-16 | King Martin T | Associating rendered advertisements with digital content |
US20100257252A1 (en) * | 2009-04-01 | 2010-10-07 | Microsoft Corporation | Augmented Reality Cloud Computing |
US20110134108A1 (en) * | 2009-12-07 | 2011-06-09 | International Business Machines Corporation | Interactive three-dimensional augmented realities from item markers for on-demand item visualization |
US20120086727A1 (en) * | 2010-10-08 | 2012-04-12 | Nokia Corporation | Method and apparatus for generating augmented reality content |
US20120116559A1 (en) * | 2010-11-04 | 2012-05-10 | Davis Bruce L | Smartphone-Based Methods and Systems |
US20120201472A1 (en) * | 2011-02-08 | 2012-08-09 | Autonomy Corporation Ltd | System for the tagging and augmentation of geographically-specific locations using a visual data stream |
US20120200743A1 (en) * | 2011-02-08 | 2012-08-09 | Autonomy Corporation Ltd | System to augment a visual data stream based on a combination of geographical and visual information |
US20120203799A1 (en) * | 2011-02-08 | 2012-08-09 | Autonomy Corporation Ltd | System to augment a visual data stream with user-specific content |
US20130159545A1 (en) * | 2011-02-08 | 2013-06-20 | Longsand Limited | System to augment a visual data stream with user-specific content |
US20120224743A1 (en) * | 2011-03-04 | 2012-09-06 | Rodriguez Tony F | Smartphone-based methods and systems |
US20120263154A1 (en) * | 2011-04-13 | 2012-10-18 | Autonomy Corporation Ltd | Methods and systems for generating and joining shared experience |
US20120299961A1 (en) * | 2011-05-27 | 2012-11-29 | A9.Com, Inc. | Augmenting a live view |
Non-Patent Citations (2)
Title |
---|
Streaming Mobile Augmented Reality on Mobile Phones, Chen et al., IEEE International Symposium on Mixed and Augmented Reality 2009 Science and Technology Proceedings 19 -22 October, Orlando, Florida, USA * |
UMAR - Ubiquitous Mobile Augmented Reality, Henrysson et al., MUM 2004 October 27-29 2004 College Park, Maryland, USA * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11354815B2 (en) | 2018-05-23 | 2022-06-07 | Samsung Electronics Co., Ltd. | Marker-based augmented reality system and method |
US10691767B2 (en) | 2018-11-07 | 2020-06-23 | Samsung Electronics Co., Ltd. | System and method for coded pattern communication |
CN111683077A (en) * | 2020-06-02 | 2020-09-18 | 硅谷数模(苏州)半导体有限公司 | Virtual reality equipment and data processing method |
Also Published As
Publication number | Publication date |
---|---|
US9536251B2 (en) | 2017-01-03 |
US20130124326A1 (en) | 2013-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20170116644A1 (en) | Providing advertisements in an augmented reality environment | |
US11120485B2 (en) | Application purchasing | |
US10262356B2 (en) | Methods and arrangements including data migration among computing platforms, e.g. through use of steganographic screen encoding | |
US10026138B2 (en) | Screen watermarking methods and arrangements | |
TWI522814B (en) | Method,computer program product and computer system for consent-based sharing online photographs | |
US9535595B2 (en) | Accessed location of user interface | |
US9888280B2 (en) | Method and system for providing contextual information during video buffering | |
US20120254769A1 (en) | Caching multiple views corresponding to multiple aspect ratios | |
US20120158515A1 (en) | Dynamic advertisement serving based on an avatar | |
EP2423882B1 (en) | Methods and apparatuses for enhancing wallpaper display | |
US20140372229A1 (en) | Method and system for automatically pausing advertisements based on user attention | |
WO2015164463A1 (en) | Web user interface builder application | |
CN103400284A (en) | Advertisement presenting method and device | |
US20130132211A1 (en) | Providing seamless online video advertisements | |
CN104090706B (en) | Content acquisition method, content share method and its device | |
US20170364254A1 (en) | Method and system for visualizing patterns during internet browsing | |
JP2014171121A (en) | Projection system, projection apparatus, projection method, and projection program | |
US20150046809A1 (en) | Activity indicator | |
US20130110814A1 (en) | Contextual search on digital images | |
JP6794112B2 (en) | Terminal devices, information processing methods, and programs | |
US10733491B2 (en) | Fingerprint-based experience generation | |
JP2020042636A (en) | Information display program, information display device, information display method, and delivery device | |
JP6915028B2 (en) | Information processing equipment, information processing methods, and programs | |
JP6761839B2 (en) | Information display program, information display device, information display method and distribution device | |
JP6559196B2 (en) | Information processing apparatus, information processing method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |