US20180336734A1 - Augmented Reality System, Method, and Apparatus for Displaying an Item Image in a Contextual Environment - Google Patents

Augmented Reality System, Method, and Apparatus for Displaying an Item Image in a Contextual Environment Download PDF

Info

Publication number
US20180336734A1
US20180336734A1 US16/046,434 US201816046434A US2018336734A1 US 20180336734 A1 US20180336734 A1 US 20180336734A1 US 201816046434 A US201816046434 A US 201816046434A US 2018336734 A1 US2018336734 A1 US 2018336734A1
Authority
US
United States
Prior art keywords
placeholder
item
environment
image
portion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US16/046,434
Inventor
John Tapley
Eric J. Farraro
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
eBay Inc
Original Assignee
eBay Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US12/644,957 priority Critical patent/US9164577B2/en
Priority to US14/868,105 priority patent/US10210659B2/en
Application filed by eBay Inc filed Critical eBay Inc
Priority to US16/046,434 priority patent/US20180336734A1/en
Assigned to EBAY INC. reassignment EBAY INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: FARRARO, ERIC J., TAPLEY, JOHN
Publication of US20180336734A1 publication Critical patent/US20180336734A1/en
Application status is Pending legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/587Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
    • G06F17/30265
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • G06F3/0325Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K9/00Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
    • G06K9/62Methods or arrangements for recognition using electronic means
    • G06K9/6201Matching; Proximity measures
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/14Solving problems related to the presentation of information to be displayed
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00Aspects of interface with display user

Abstract

Method, apparatus, and system for providing an item image to a client for display in a contextual environment are described. In some embodiments, the user may select an item for display in the contextual environment, and the user may position a camera coupled to a processing system to capture the contextual environment. A placeholder may be generated and associated with an item selected by a user. In an embodiment, the generated placeholder may be placed in a location within the contextual environment, and the user's processing system may send a visual data stream of the camera-captured environment to a server. In an embodiment, the user's processing device may receive a modified data stream including an image of the item, and the user's processing device may display the item image in the same location as the placeholder.

Description

    RELATED APPLICATIONS
  • This application is a continuation of and claims the benefit of priority to U.S. patent application Ser. No. 14/868,105, filed Sep. 28, 2015, which claims priority under 35 U.S.C. § 120 to U.S. patent application Ser. No. 12/644,957, filed on Dec. 22, 2009, the benefit of priority of which is claimed hereby, and which is incorporated by reference herein in its entirety.
  • BACKGROUND
  • Item listings on online shopping and auction websites (e.g., e-commerce companies) may often provide images related to the item for sale to supplement a text description of the item. The images may be in the form of a digital photograph, a drawing, or in some cases, a video clip or any combination of these. For some items, there may be multiple images (e.g., digital photos) providing different angles and views of the item. In some examples, the images may be in a contextual environment, such as a sofa in a living room. In other examples, the item image may merely depict the item without a contextual environment.
  • BRIEF DESCRIPTION OF DRAWINGS
  • Embodiments of the present invention are illustrated by way of example and not limitation in the Figures of the accompanying drawings, in which like reference numbers indicate similar elements and in which:
  • FIG. 1 is a diagrammatic representation of a network within which an example augmented reality system for providing modified visual data to a processing system may be implemented;
  • FIG. 2 is a block diagram of an example augmented reality module, in accordance with one example embodiment;
  • FIG. 3 is a flow chart of a method for providing modified visual data, in accordance with an example embodiment;
  • FIG. 4 is an example of a placeholder for use with the augmented reality system, in accordance with an example embodiment;
  • FIGS. 5A-B are example user interfaces illustrating a placeholder in a camera-captured environment and the resulting augmented reality display in a contextual environment, in accordance with an example embodiment; and
  • FIG. 6 is a diagrammatic representation of an example machine in the form of a computer system within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed.
  • DETAILED DESCRIPTION
  • Systems and methods for displaying an item image on a screen as the item would appear positioned at a location in a camera-captured environment are discussed. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of an embodiment of the present invention. It will be evident, however, to one skilled in the art that the present invention may be practiced without these specific details. The following detailed description includes reference to the accompanying drawings, which form a part of the detailed description. The drawings show illustrations in accordance with example embodiments. These example embodiments, which are also referred to herein as “examples,” are described in enough detail to enable those skilled in the art to practice the present subject matter. The embodiments may be combined, other embodiments may be utilized, or structural, logical and electrical changes may be made without departing from the scope of what is claimed. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope is defined by the appending claims and their equivalents.
  • Augmented reality generally refers to creating a mixed virtual and real world environment though computer-generated imagery. Elements of the real world are mixed with virtual images in a real-time environment to provide a user with information and a visual effect that may not be entirely available otherwise.
  • In an online publication system such as an online trading platform, where a seller may post items for sale, it may be desirable to view how a particular item would appear in a location specified by a user to aid the user's purchase decision. For example, a user considering purchasing a sofa for a living room may need to determine where to position the sofa, and generally, how the sofa would appear in the living room. The user may wish to view the sofa as it would appear in the living room without actually possessing the sofa. Furthermore, the user may prefer to compare various sofas, view how the sofa would look from different angles in the room, or even surround the sofa with other items to create a furniture ensemble without physically moving the actual furniture. In an example embodiment, an augmented reality system may provide a user with the ability to arrange and rearrange a virtual sofa (and additional items, if desired) in an environment (e.g., a living room) captured by a camera instead of requiring physical movement of an actual sofa.
  • In an example embodiment, the method allows a user to place a marker (e.g., a placeholder such as a piece of paper with contrasting markings and unique objects) in a location where the actual item would be positioned. The method records an image of the market positioned in the location using, e.g., a video camera, sends the captured image to the augmented reality system, and receives an image of the actual item positioned at the chosen location. In various embodiments, the marker (e.g., placeholder) can be a sheet of paper (8.5″×11″) with unique markings and that a user can download, print and placed at the location. A server receives the video stream of the placeholder in the location from the user's system, detects the placeholder, and sends a modified video stream with an item in place of the marker back to the user's system for display.
  • In various example embodiments, an input including item selection is received from a client to generate a placeholder and information for generating the placeholder is provided to the input source (e.g., the client) or a processing system with output capabilities. Video data of a camera-captured environment is received, in which the placeholder may be located. The input is analyzed to detect the placeholder and an image is retrieved according to the analysis. The visual data is modified to include an image data associated with the image, which, in some embodiments, may be an overlay of the image, and the modified visual data may be provided to the input source (e.g., a user's processing system) or another processing system. In some example embodiment, the retrieved image may be modified in accordance with the analysis to scale and orient the item image overlay in accordance with the environment and placement information determined from the placeholder information. In one example embodiment, the placeholder may be a printed sheet of paper with unique markings (e.g., bar code, contrastable image, two-dimensional data code) printable by the user from a home computer system. In some example embodiments, the sheet of paper may also be recognizable by other processing systems. In some embodiments, a single placeholder may be generic to multiple items and used interchangeably to represent more than one item. For example, when a user wishes to compare a first item with a second item in the same location, the placeholder may interchangeably represent both the first and second item, with needing to generate two placeholders. In some embodiments, a single placeholder can be used without associating the placeholder with any particular item. An example augmented reality system is discussed with reference to FIG. 1.
  • FIG. 1 is a diagrammatic representation of a network within which an example augmented reality system 100 for providing modified visual data to a processing system 110 may be implemented. As shown, the augmented reality system 100 may include a processing system 110 and a server 120. The server 120, in one example embodiment, may host an on-line trading platform. The processing system 110 may run an application 116, such as a web browser application and may have access to the server 120 via a network 130. The network 130 may be a public network (e.g., the Internet, a wireless network, etc.) or a private network (e.g., a local area network (LAN), a wide area network (WAN), intranet, etc.).
  • In one embodiment, the network-based trading platform may provide one or more marketplace applications, payment applications, and other resources. The market place application may provide a number of marketplace functions and services to users that access the marketplace. The payment applications, likewise, may provide a number of payment services and functions to users. The network-based trading platform may display various items listed on the trading platform. The embodiments discussed in the specification are not limited to network-based trading platforms, however. In additional embodiments, other publishing platforms, such as social networking websites, news aggregating websites, web portals, network-based advertising platforms, or any other system that display items to users, may be used.
  • The processing system 110 may include a camera source 112 (e.g., a video camera or digital still camera) for capturing a contextual environment (e.g., a living room) and a visual output 114 (e.g., an LCD display or the like) to present the contextual environment and, in an example embodiment, to present an augmented environment. The server 120 includes an item image source 122 and an augmented reality application 124. In some embodiments, the server 120 may be communicatively coupled with one or more databases 140, which may store item images 142.
  • In an example embodiment, the processing system 110 may send a request to the server 120 to modify a contextual environment captured by a camera source 112. In some embodiments, the request from the processing system 110 may include a user-selected item. In an embodiment, an augmented reality application 124 at the server 120 may detect the request, and provide placeholder generation information to the processing system 110 to generate a placeholder associated with the user-selected item. Upon receiving the placeholder generation information, a user in control of the processing system 110 may produce the placeholder, e.g., by printing an image of the placeholder provided by the augmented reality application 124. In some example embodiments, the placeholder may be an ordinary letter-sized sheet of paper (e.g., 8.5″×11″) with unique markings, an example of which is illustrated in FIG. 4 and described below. The unique markings may be utilized by the augmented reality application 124 to identify the placeholder in the contextual environment and to determine a desired placement of the user-selected item within the contextual environment captured by the camera. In some embodiments, the placeholder may be generated using an auxiliary display device (e.g., mobile phone display) displaying the placeholder with unique markings. In other embodiments, the user may use the placeholder generation information to physically create the placeholder by drawing and/or coloring the unique markings onto an object, such as a piece of paper, or a three-dimensional object. In some embodiments, in addition to the user-selected item, the placeholder generation information and associated unique markings may be customized to accommodate elements of the environment based on received visual data collected by a camera. For example, the placeholder generation information may be produced by taking into considerations dimensions of the environment (e.g., room).
  • In another example embodiment, the augmented reality application 124 may receive and process visual data received from the processing system 110 and the camera source 112 communicatively coupled to the processing system 110, and provides modified visual data back to the processing system 110. For example, the camera source 112 may collect visual data of a contextual environment within which a placeholder is located. In some embodiments, one of the applications 116 may receive visual data. The application 116 may provide the visual data to the augmented reality application 124 of the server 120 via network 130. The augmented reality application 124 may analyze the visual data to detect placeholder information associated with a placeholder located within the captured contextual environment, and may also determine placement information from the placeholder information. The augmented reality application 124 may retrieve an image from an item image source 122 of the server 120 based on the placeholder information, placement information or any combination thereof. In some embodiments, the augmented reality application 124 may retrieve the image from the item images 142 stored in a database 140 that is communicatively coupled to the server 120. The augmented reality application 124 may then modify the visual data to include image data associated with the retrieved item image. In some embodiments, the augmented reality application 124 may modify the visual data with modified image data based on the determined placement information. In some embodiments, the augmented reality application 124 then provides modified visual data to the processing system 110 for visual display on a visual output 114.
  • In some embodiments, the processing system 110 may include an item image source, such as a library of item images stored on the processing system 110. In an example embodiment, a user may create a library of images of one or more items by way of the camera source 112 (e.g., digital camera). In one embodiment, an application hosted on the server 120 may be used to identify an item depicted in the image (see U.S. patent application Ser. No. 12/371,882) and the augmented reality application 124 may provide placeholder generation information from the server 120 to the processing system. In some example embodiments, the processing system 110 may host the augmented reality application 124 and may provide modified visual data, such as to the processing system 110 without use of the network 130 and the server 120.
  • FIG. 2 is a block diagram 200 of an example augmented reality module 210, in accordance with one example embodiment. As shown in FIG. 2, augmented reality module 210 comprises in input receiver module 220, an information provider module 222, a visual data receiver module 224, a detection module 226, a placement determination module 228, a retrieval module 230, and a modification module 232. These modules of the augmented reality system may be communicatively coupled to other modules via a bus 240.
  • An input receiver module 220 may be configured to receive a request to commence an augmented reality application (e.g., augmented reality application 124 of FIG. 1). The request may include item information associated with a selected item. In one embodiment, the input receiver module 220 may be configured to receive the request (e.g., an input) from a source, such as, for example, the processing system 110 of FIG. 1. The input receiver module 220 may be configured to receive additional information from the processor system, such as, e.g., camera specifications, lighting and dimensional information of a captured contextual environment, data transmission rates, frame refresh rate, among other specifications of the processing system 110, and environment parameters known to those of ordinary skill in the art.
  • An information provider module 222 may be configured to determine placeholder generation information based on the received request and item information from the input receiver module 220. Placeholder generation information may include instructions (e.g., machine readable instructions) to generate a placeholder. In some embodiments, the placeholder generation information may be machine-readable information, such as, for example, an electronic document. In an embodiment, the information provider module 222 may produce a file deliverable to the requesting source (e.g., processing system 110) or any other processing system. For example, the information provider module 222 may generate an electronic document or an image file in any one or combination of formats (e.g., Portable Document Format (PDF), Microsoft® Word document, Joint Photographic Experts Group (JPEG) or the like). In operation, a user may interface with a processing system to select an item listing. The user may send a request to generate a placeholder for placement within an environment. The input receiver module 220 may receive the request, which, in some embodiments, may include information identifying the item listing selected by the user, and the information provider module 222 may generate an electronic document and deliver the document to the requesting source (e.g., processing system 110). In some embodiments, the request to generate the placeholder may include the item listing selected. In some embodiment, a user may receive placeholder generation instruction without selecting or sending a request to generate a placeholder.
  • A visual data receiver module 224 receives visual data from a client, such as the processing system 110, communicatively coupled to a camera, such as a digital camera, video camera (e.g., web cam), or the like. In one example embodiment, a user may position the camera to capture and view a contextual environment in which the user may want to view an item as it would appear in that environment. In some embodiments, the visual data receiver module 224 may process, some or all of the camera-captured visual data to determine parameters of the visual environment. For example, the visual data receiver module 224 may determine parameters of the captured environment including lighting, angles, dimensions, gravitational orientation, and the like, and may determine specifics of the camera, such as frame refresh rate, zoom capabilities, camera model information, and the like.
  • A detection module 226 detects placeholder information that may be included with the received visual data. In an embodiment, the placeholder information (e.g., machine-readable instructions to generate a document) is associated with a placeholder placed within a viewable location of a camera (e.g., within the camera-captured contextual environment), the camera communicatively coupled with a processing system (e.g., client device), the processing system providing visual data received by the camera to the augmented reality module 210 at the visual data receiver module 224. In one example, unique markings of the placeholder may be captured by a camera coupled to the processing system, and these unique markings may be detected by the detection module 226 as representing a placeholder in the captured environment.
  • In one embodiment, the detection module 226 may be configured to parse visual data received from the visual data receiver module 224 to determine whether the received visual data includes placeholder information within the visual data. In some embodiments, the detection module 226 may verify the placeholder information, such as to determine whether the placeholder information matches with the selected item received at input receiver module 220. In some embodiments, the detection module 226 may be configured to notify the client (e.g. processing system 110) when the placeholder information does not match the selected item. In an example, the detection module 226 may provide suggestions to the client source, such as to recreate the placeholder, reposition the placeholder, or the like.
  • A placement determination module 228 may be configured to determine placement information of a placeholder using the placeholder information received with the visual data. In one embodiment, the placement determination module 228 may determine various characteristics associated with the placeholder based on the placeholder information. For example, the placement determination module 228 may determine characteristics including coordinates and general location of the placeholder in the contextual environment captured by the camera, and may determine an orientation, scale factor, lighting effects, and any obstructions obstructing the placeholder in the contextual environment, or the like. In one embodiment, the placement determination module 228 may be configured to provide the placement information including characteristics to a retrieval module 230. In one example embodiment, the placement determination module 228 may be configured to determine the placement information of a placeholder based on unique markings of the placeholder. These unique markings may be detected by the detection module 226 as described above.
  • A retrieval module 230 may be configured to retrieve an image of the item upon detection of the image of the placeholder captured by the camera. The retrieval module 230 may retrieve the image based on the unique markings of the placeholder. The retrieval module 230 may incorporate information received from the detection module 226 and the placement determination module 228 when retrieving an image of the selected item. In one example, the retrieval module 230 may select an image from a plurality of images of the item based on determined characteristics of the placeholder determined from the placeholder information and received from the placement determination module 228, as described above. In an example embodiment, the retrieval module 230 may use the determined characteristics to select a best fit image from a plurality of images. In some embodiments, the retrieval module 230 may retrieve or determine physical dimensions of the item, such as the height, the length, and the width, and may select a best fit image from the plurality of images according to the physical dimensions of the item and/or the characteristics of the placeholder. In one example, the retrieval module 230 may be configured to modify image data associated with the retrieved image according to the physical dimensions of the item and the characteristics of the placeholder, such as to represent a scaled and oriented image within the contextual environment.
  • A modification module 232 may be configured to modify the received visual data to include image data associated with the retrieved image into the visual data according to the placement information. In some embodiments, the modification module 232 may be configured to modify the received visual data to include the modified visual data generated by retrieval module 230. In one example embodiment, the modification module 232 may return the modified visual data to the client (e.g. processing system 110) providing the item selection and/or the selection to augment reality.
  • It will be noted, that while FIG. 2 shows particular modules independent of other modules, other embodiments may include one or more modules in a single component. Additionally, embodiments may be provided where a component that is shown in FIG. 2 as a single module maybe implemented as two or more components. Various operations performed by the augmented reality module 210 may be discussed with reference to FIGS. 3-6.
  • FIG. 3 is a flow chart of a method 300 for providing modified visual data, in accordance with an example embodiment. The method 300 may be performed by processing logic that may comprise hardware (e.g., dedicated logic, programmable logic, microcode, etc.) software (such as run on a general purpose computer system or a dedicated machine), or a combination of both. In one example embodiment, the processing logic may reside at a server 120 as shown in FIG. 1 in the form of an augmented reality application 124 of FIG. 1.
  • As shown in FIG. 3, the method 300 commences at operation 310 when the server 120 receives an input from a client (e.g., the processing system 110 of FIG. 1), the input including an item selection. At operation 320, the method 300 may provide generation information for generating a placeholder based on the received input. The generation information may be provided to the processing system 110 to permit a user to generate the placeholder using a printer, or view the placeholder using a visual display device (e.g., a mobile phone screen, a camera screen or the like). An example of a placeholder is depicted in FIG. 4 and described below.
  • At operation 330, the method 300 receives visual data from the client (e.g., processing system 110). In one embodiment, the visual data may be captured by a camera communicatively coupled with the client. At operation 340, the method 300 detects placeholder information included with the visual data; the placeholder information is associated with a placeholder placed in a contextual environment captured by the camera. At operation 350, the method 300 determines placement information using the placeholder information. At operation 360, the method 300 retrieves an image of an item associated with the placeholder based on the placeholder. At operation 370, the method 300 modifies the received visual data to include the image data associated with the retrieved image into the visual data with reference to the placement information. In an example, the retrieved image may be modified to reconcile the respective dimensions, orientation, etc. of the captured environment with the dimensions, orientation etc. of an item represented by the retrieve image. In some embodiments, the operation 370 of method 300 may provide the modified visual data to the client (e.g., processing system 110) providing the input at operation 310. Now the user may view the item as it would appear in the environment.
  • FIG. 4 is an example of a physical placeholder 400 for use with the augmented reality system 100 (e.g. processing system 110, server 120, and network 130 all of FIG. 1), in accordance with an example embodiment. In one example, upon receiving an input including an item selection, the augmented reality system 100 provides generation information to generate a placeholder 400 with unique markings 402-424 to a client source from which the input originated or, in some embodiment, any other processing system (e.g., a mobile phone). As previously described, the generation information may be a document, image, computer-readable instructions, or the like, for generating the placeholder 400 by use of rendering instrument such as, for example, a printer (e.g., in the case of a printable sheet) or a display screen (e.g., a display screen of a mobile phone, in the case of a non-printable digital file). In some embodiments, the placeholder 400 may be a standard sheet of paper (e.g., dimension of about 8.5″×11″) with the unique markings 402-424. In other embodiments, the placeholder 400 may be an electronically displayable set of instructions for display on a mobile phone or an auxiliary display screen. In other embodiments, the placeholder 400 may be a three dimensional object.
  • The placeholder 400 may include any one or more of arrows 402, 404, 406, and 408, which provide the augmented reality system 100 an upside and a downside orientation for the placeholder 400, such as to orient the placeholder 400 when captured by the camera. In one embodiment, the augmented reality system 100 may calibrate a camera source 112 of FIG. 1 of the processing system 110 with any combination of arrows 402, 404, 406, and 408. In an example embodiment, the arrows 402, 404, 406, and 408 may be formed in a clockwise direction such as to allow the augmented reality system 100 to first determine a top side and bottom side orientation. When the page is flipped, the orientation determined by the augmented reality system 100 may be flipped by 180°. In one example embodiment, any directionally distinguishable shape may be substituted for one or more of the arrows 402, 404, 406, and 408. In one embodiment, the augmented reality system 100 may differentiate between the four corners of the placeholder 400 with use of the arrows 402, 404, 406, and 408 when rotating the page across various axes from an original orientation. In an example, when a user rotates the placeholder 400 in the camera-captured environment, the augmented reality system 100 detects the rotation and rotates the corresponding retrieved item image when presenting the item in the contextual environment on a visual output 114 of FIG. 1.
  • In one example embodiment, the placeholder 400 includes a middle rectangle 410, which may provide for an initial detection of the placeholder 400. In some embodiments, the augmented reality system 100 may initially detect the middle rectangle 410 before other unique markings when the placeholder 400 is placed a great distance away from the camera in an open environment, such as for example, an auditorium or in an outdoor environment. In other example embodiments, the middle rectangle 410 may be substituted with any design relatively large in size with relation to the placeholder 400 and generally located near the middle of the placeholder 400.
  • As depicted in FIG. 4, the placeholder 400 includes shaded objects 412 and 414 shaded with dissimilar colors to provide distinct regions of the placeholder 400 for detecting an orientation, scale, and distance of the placeholder 400. The augmented reality system may employ the shaded objects 412 and 414 for determining a left-right and depth dimensional orientation.
  • The placeholder 400 may further include line markings 416, 418, 420 and 422 to assist with augmented reality system in refining a third dimension for the placeholder 400. In one embodiment, the lines within each of a first and second set of lines 416 and 418 are equidistant for each set. The first and second sets of lines 416 and 418 may provide a depth of the object and a scale factor. By known methods, the augmented reality system may orient and scale the image based on any or all of the arrows 402, 404, 406, and 408; middle rectangle 410; shaded objects 412 and 414 and line markings 416, 418, 420, and 422.
  • In one embodiment, the unique markings of placeholder 400 may include identification markings 424, which may be item identification information used when verifying whether the generated placeholder 400 matches with a selected item. In other embodiments, these additional identification markings 424 may include or may reference additional information related to the selected item, such as for example, price, inventory, and suggested items related to the selected item. In some example embodiments, the additional information may be presentable along with the image of the item in the contextual environment. In some embodiments, the additional identification markings 424 may aid in uniquely identifying more than one placeholder 400 in the environment, and thereby, allow simultaneously presentation of a plurality of items in the contextual environment. In some embodiments, the identification markings 424 may be a one-dimensional barcode, two dimensional barcode, or any other marking uniquely associable with a selected item. In some embodiments, a placeholder may be generated that may not be associable with one particular item and may be interchangeably used to represent more than one item.
  • FIGS. 5A-B are screen shots 500A and 500B of example user interfaces 502A and 502B illustrating a placeholder 550 in a camera-captured environment and the resulting augmented reality image 560 displayed in the contextual environment, in accordance with an example embodiment. In an example, a user may direct a camera toward a location such as the user's living room, which provides the contextual environment for the augmented reality. The user interface 502A illustrates a visual frame 504A of the camera-captured environment (e.g., a living room). In some embodiments, the user interface 502A and 502B may include selection buttons 506, 508, and 510. Selection button 506 may be selected to augment reality, selection button 508 may be selected to purchase an item, and selection button 510 may be selected to place a bid on an item.
  • For example, a user may select an item, such as a lamp, and orient a camera to view an environment in which the user may want to place the lamp (e.g., a bedroom). The user may select the augment reality selection button 506 at a client (e.g., the processing system 110 of FIG. 1) to provide an input along with the item selection information to a server (e.g., server 120 of FIG. 1). The server 120 may provide generation information to the client (e.g., processing system 110) to generate a placeholder, such as the placeholder 400 depicted in FIG. 4 and the user may place the placeholder in the camera-captured environment. Screen shot 500A illustrates a user interface 502A of FIG. 5A with a placeholder 550 viewable within a camera-captured environment in visual frame 504A.
  • The augmented reality application 124 of FIG. 1 at the server 120 receives the visual data of the camera-captured environment (shown in visual frame 504A including the placeholder 550) viewable from the client device (e.g., processing system 110). The augmented reality application 124 detects the placeholder information associated with the placeholder 550 included with the visual data and determines placement information from the placeholder information. The augmented reality application 124 then retrieves an image of the item associated with the placeholder 550. In some embodiments, the unique markings of the placeholder 550 may be used to determine which item is associated with the placeholder, or which image of the item may be selected from a plurality of images of an item. The augmented reality application 124 provides the client device (e.g., processing system 110) with modified visual data, which includes the image data associated with the retrieved image of the selected item. In some embodiments, the augmented reality application 124 replaces the placeholder information with the image data, such as to modify the received visual data and to display a replacement image of the item within the camera-captured viewable in visual frame 504B. In an example embodiment, as shown in FIG. 5B, the augmented reality application 124 may modify the received visual data by providing overlay image data in place of the placeholder information, such as to display an overlay of the item image (e.g., augmented reality image 560) within the camera-captured viewable in visual frame 504B.
  • FIG. 6 shows a diagrammatic representation of a machine in the example form of a computer system 600 within which a set of instructions, for causing the machine to perform any one or more of the methodologies discussed herein, may be executed. In alternative embodiments, the machine operates as a stand-alone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in a server-client network, or as a peer machine in a peer-to-peer (or distributed) network. The machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
  • The example computer system 600 includes a processor 602 (e.g., a central processing unit (CPU), a graphics processing unit (GPU) or both), a main memory 604 and a static memory 606, which communicate with each other via a bus 608. The computer system 600 may further include a video display unit 610 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)). The computer system 600 also includes an alpha-numeric input device 612 (e.g., a keyboard), a user interface (UI) navigation device 614 (e.g., a cursor control device), a disk drive unit 616, a signal generation device 618 (e.g., a speaker) and a network interface device 620.
  • The disk drive unit 616 includes a machine-readable medium 622 on which is stored one or more sets of instructions and data structures (e.g., software 624) embodying or utilized by any one or more of the methodologies or functions described herein. The software 624 may also reside, completely or at least partially, within the main memory 604 and/or within the processor 602 during execution thereof by the computer system 600, with the main memory 604 and the processor 602 also constituting machine-readable media.
  • The software 624 may further be transmitted or received over a network 626 via the network interface device 620 utilizing any one of a number of well-known transfer protocols (e.g., Hyper Text Transfer Protocol (HTTP)).
  • While the machine-readable medium 622 is shown in an example embodiment to be a single medium, the term “machine-readable medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “machine-readable medium” shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of embodiments of the present disclosure, or that is capable of storing, encoding or carrying data structures utilized by or associated with such a set of instructions. The term “machine-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical and magnetic media, and carrier wave signals. Such media may also include, without limitation, hard disks, floppy disks, flash memory cards, digital video disks, random access memory (RAMs), read only memory (ROMs), and the like.
  • The embodiments described herein may be implemented in an operating environment comprising software installed on a computer, in hardware, or in a combination of software and hardware.
  • Thus, an augmented reality system has been described. Although embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the inventive subject matter. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.

Claims (20)

What is claimed is:
1. A method comprising:
visually capturing, by a computing device, an environment including a placeholder, the placeholder including a first portion and a second portion, the first portion being visually distinct from the second portion;
determining, by the computing device, a placement of the placeholder in the environment, the placement describing an orientation of the placeholder and a distance of the placeholder relative to the computing device;
identifying, by the computing device, an item corresponding to the placeholder;
retrieving, by the computing device, an image of the item corresponding to the placeholder; and
generating, by the computing device, a visual display of the environment that includes the retrieved image of the item, the retrieved image of the item being positioned and oriented in the visual display based on the determined placement information of the placeholder in the environment.
2. The method of claim 1, further comprising receiving user input selecting the item corresponding to the placeholder and requesting the placeholder in response to receiving the user input.
3. The method of claim 1, wherein the visually capturing the environment including the placeholder is performed using a camera of the computing device.
4. The method of claim 1, wherein the first portion of the placeholder includes at least two shaded objects of dissimilar color.
5. The method of claim 1, wherein identifying the item corresponding to the placeholder is performed using visual information included in the second portion of the placeholder.
6. The method of claim 1, wherein the retrieved image of the item is scaled in the visual display of the environment based on the determined placement information of the placeholder in the environment.
7. The method of claim 1, further comprising determining one or more physical dimensions of the item, wherein retrieving the image of the item corresponding to the placeholder is performed in response to determining the one or more physical dimensions of the item.
8. A system comprising:
at least one processor; and
a computer-readable storage media having instructions stored thereon that are executable by the at least one processor to perform operations comprising:
visually capturing an environment including a placeholder, the placeholder including a first portion and a second portion, the first portion being visually distinct from the second portion;
determining a placement of the placeholder in the environment, the placement describing an orientation of the placeholder and a distance of the placeholder relative to the computing device;
identifying an item corresponding to the placeholder;
retrieving an image of the item corresponding to the placeholder; and
generating a visual display of the environment that includes the retrieved image of the item, the retrieved image of the item being positioned and oriented in the visual display based on the determined placement information of the placeholder in the environment.
9. The system of claim 8, the operations further comprising receiving user input selecting the item corresponding to the placeholder and requesting the placeholder in response to receiving the user input.
10. The system of claim 8, wherein the first portion of the placeholder includes at least two shaded objects of dissimilar color.
11. The system of claim 8, wherein identifying the item corresponding to the placeholder is performed using visual information included in the second portion of the placeholder.
12. The system of claim 8, wherein the retrieved image of the item is scaled in the visual display of the environment based on the determined placement information of the placeholder in the environment.
13. The system of claim 8, the operations further comprising determining one or more physical dimensions of the item, wherein retrieving the image of the item corresponding to the placeholder is performed in response to determining the one or more physical dimensions of the item.
14. A computer-readable storage medium having instructions stored thereon that are executable by a computing device to perform operations comprising:
visually capturing an environment including a placeholder, the placeholder including a first portion and a second portion, the first portion being visually distinct from the second portion;
determining a placement of the placeholder in the environment, the placement describing an orientation of the placeholder and a distance of the placeholder relative to the computing device;
identifying an item corresponding to the placeholder;
retrieving an image of the item corresponding to the placeholder; and
generating a visual display of the environment that includes the retrieved image of the item, the retrieved image of the item being positioned and oriented in the visual display based on the determined placement information of the placeholder in the environment.
15. The computer-readable storage medium of claim 14, the operations further comprising receiving user input selecting the item corresponding to the placeholder and requesting the placeholder in response to receiving the user input.
16. The computer-readable storage medium of claim 14, wherein the visually capturing the environment including the placeholder is performed using a camera of the computing device.
17. The computer-readable storage medium of claim 14, wherein the first portion of the placeholder includes at least two shaded objects of dissimilar color.
18. The computer-readable storage medium of claim 14, wherein identifying the item corresponding to the placeholder is performed using visual information included in the second portion of the placeholder.
19. The computer-readable storage medium of claim 14, wherein the retrieved image of the item is scaled in the visual display of the environment based on the determined placement information of the placeholder in the environment.
20. The computer-readable storage medium of claim 14, the operations further comprising determining one or more physical dimensions of the item, wherein retrieving the image of the item corresponding to the placeholder is performed in response to determining the one or more physical dimensions of the item.
US16/046,434 2009-12-22 2018-07-26 Augmented Reality System, Method, and Apparatus for Displaying an Item Image in a Contextual Environment Pending US20180336734A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US12/644,957 US9164577B2 (en) 2009-12-22 2009-12-22 Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
US14/868,105 US10210659B2 (en) 2009-12-22 2015-09-28 Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
US16/046,434 US20180336734A1 (en) 2009-12-22 2018-07-26 Augmented Reality System, Method, and Apparatus for Displaying an Item Image in a Contextual Environment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US16/046,434 US20180336734A1 (en) 2009-12-22 2018-07-26 Augmented Reality System, Method, and Apparatus for Displaying an Item Image in a Contextual Environment

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/868,105 Continuation US10210659B2 (en) 2009-12-22 2015-09-28 Augmented reality system, method, and apparatus for displaying an item image in a contextual environment

Publications (1)

Publication Number Publication Date
US20180336734A1 true US20180336734A1 (en) 2018-11-22

Family

ID=44150414

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/644,957 Active 2032-08-15 US9164577B2 (en) 2009-12-22 2009-12-22 Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
US14/868,105 Active US10210659B2 (en) 2009-12-22 2015-09-28 Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
US16/046,434 Pending US20180336734A1 (en) 2009-12-22 2018-07-26 Augmented Reality System, Method, and Apparatus for Displaying an Item Image in a Contextual Environment

Family Applications Before (2)

Application Number Title Priority Date Filing Date
US12/644,957 Active 2032-08-15 US9164577B2 (en) 2009-12-22 2009-12-22 Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
US14/868,105 Active US10210659B2 (en) 2009-12-22 2015-09-28 Augmented reality system, method, and apparatus for displaying an item image in a contextual environment

Country Status (5)

Country Link
US (3) US9164577B2 (en)
EP (1) EP2499635A4 (en)
KR (3) KR101659190B1 (en)
CN (2) CN102667913B (en)
WO (1) WO2011087797A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10210659B2 (en) 2009-12-22 2019-02-19 Ebay Inc. Augmented reality system, method, and apparatus for displaying an item image in a contextual environment

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9495386B2 (en) 2008-03-05 2016-11-15 Ebay Inc. Identification of items depicted in images
US8275375B2 (en) * 2010-03-25 2012-09-25 Jong Hyup Lee Data integration for wireless network systems
US10127606B2 (en) 2010-10-13 2018-11-13 Ebay Inc. Augmented reality system and method for visualizing an item
GB2489685B (en) * 2011-03-31 2017-01-25 Geovs Ltd A Display System
US8738754B2 (en) 2011-04-07 2014-05-27 International Business Machines Corporation Systems and methods for managing computing systems utilizing augmented reality
US20120259744A1 (en) * 2011-04-07 2012-10-11 Infosys Technologies, Ltd. System and method for augmented reality and social networking enhanced retail shopping
US20120299963A1 (en) * 2011-05-27 2012-11-29 Wegrzyn Kenneth M Method and system for selection of home fixtures
US10242456B2 (en) * 2011-06-23 2019-03-26 Limitless Computing, Inc. Digitally encoded marker-based augmented reality (AR)
US9449342B2 (en) 2011-10-27 2016-09-20 Ebay Inc. System and method for visualization of items in an environment using augmented reality
US9229231B2 (en) 2011-12-07 2016-01-05 Microsoft Technology Licensing, Llc Updating printed content with personalized virtual data
US9182815B2 (en) * 2011-12-07 2015-11-10 Microsoft Technology Licensing, Llc Making static printed content dynamic with virtual data
US9183807B2 (en) * 2011-12-07 2015-11-10 Microsoft Technology Licensing, Llc Displaying virtual data as printed content
US9240059B2 (en) * 2011-12-29 2016-01-19 Ebay Inc. Personal augmented reality
US8606645B1 (en) 2012-02-02 2013-12-10 SeeMore Interactive, Inc. Method, medium, and system for an augmented reality retail application
EP2624180A1 (en) * 2012-02-06 2013-08-07 Xabier Uribe-Etxebarria Jimenez System of integrating remote third party services
US9165381B2 (en) 2012-05-31 2015-10-20 Microsoft Technology Licensing, Llc Augmented books in a mixed reality environment
US20140015931A1 (en) * 2012-07-12 2014-01-16 Samsung Electronics Co., Ltd. Method and apparatus for processing virtual world
US9674419B2 (en) * 2012-07-31 2017-06-06 Hewlett-Packard Development Company, L.P. Web-linked camera device with unique association for augmented reality
US9336541B2 (en) 2012-09-21 2016-05-10 Paypal, Inc. Augmented reality product instructions, tutorials and visualizations
US20140270477A1 (en) * 2013-03-14 2014-09-18 Jonathan Coon Systems and methods for displaying a three-dimensional model from a photogrammetric scan
US20140340423A1 (en) * 2013-03-15 2014-11-20 Nexref Technologies, Llc Marker-based augmented reality (AR) display with inventory management
JP6255706B2 (en) 2013-04-22 2018-01-10 富士通株式会社 Display control apparatus, display control method, display control program, and information providing system
CA2852449A1 (en) * 2013-05-23 2014-11-23 Powerball Technologies Inc. Light fixture selection using augmented reality
US10137361B2 (en) * 2013-06-07 2018-11-27 Sony Interactive Entertainment America Llc Systems and methods for using reduced hops to generate an augmented virtual reality scene within a head mounted system
US9349139B1 (en) * 2013-12-10 2016-05-24 Amazon Technologies, Inc. Fine art samples
JP6244954B2 (en) 2014-02-06 2017-12-13 富士通株式会社 Terminal apparatus, information processing apparatus, display control method, and display control program
JP6217437B2 (en) * 2014-02-14 2017-10-25 富士通株式会社 Terminal apparatus, information processing apparatus, display control method, and display control program
WO2015126281A2 (en) * 2014-02-24 2015-08-27 Арташес Валерьевич ИКОНОМОВ Device and method for generating images
US10134082B2 (en) * 2014-10-13 2018-11-20 Paypal, Inc. Virtual display device for an interactive merchant sales environment
US9728010B2 (en) * 2014-12-30 2017-08-08 Microsoft Technology Licensing, Llc Virtual representations of real-world objects
US9791917B2 (en) * 2015-03-24 2017-10-17 Intel Corporation Augmentation modification based on user interaction with augmented reality scene
CN105653036A (en) * 2015-12-31 2016-06-08 深圳市路通网络技术有限公司 Scrawling augmented reality method and system
US10026229B1 (en) * 2016-02-09 2018-07-17 A9.Com, Inc. Auxiliary device as augmented reality platform
CN105825499A (en) 2016-03-09 2016-08-03 京东方科技集团股份有限公司 Reference plane determination method and determination system
US10237277B2 (en) * 2016-08-15 2019-03-19 Facebook, Inc. Generating and utilizing digital visual codes to grant privileges via a networking system
USD840413S1 (en) 2016-08-15 2019-02-12 Facebook, Inc. Display screen or portion thereof with digital visual codes graphical user interface
EP3306894A1 (en) * 2016-10-05 2018-04-11 Kone Corporation Generation of augmented reality
US10317990B2 (en) 2017-05-25 2019-06-11 International Business Machines Corporation Augmented reality to facilitate accessibility
US20180357833A1 (en) * 2017-06-07 2018-12-13 5th Planet, Inc. System and method for dynamically creating content in a three-dimensional virtual environment
CN108022301A (en) * 2017-11-23 2018-05-11 腾讯科技(上海)有限公司 Image processing method and device, and storage medium

Family Cites Families (333)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5068723A (en) 1989-05-19 1991-11-26 Gte Laboratories Incorporated Frame or sub-frame rate adaptive vector quantizer for moving images
FI92272C (en) 1992-05-20 1994-10-10 Valtion Teknillinen Image transmission compression coding system
US5408417A (en) 1992-05-28 1995-04-18 Wilder; Wilford B. Automated ticket sales and dispensing system
US5579471A (en) 1992-11-09 1996-11-26 International Business Machines Corporation Image query system and method
US5870149A (en) 1993-03-12 1999-02-09 Motorola, Inc. Video/integrated land mobile dispatch radio and video unit
US7859551B2 (en) 1993-10-15 2010-12-28 Bulman Richard L Object customization and presentation system
US5889896A (en) 1994-02-09 1999-03-30 Meshinsky; John System for performing multiple processes on images of scanned documents
US5546475A (en) 1994-04-29 1996-08-13 International Business Machines Corporation Produce recognition system
US5802361A (en) 1994-09-30 1998-09-01 Apple Computer, Inc. Method and system for searching graphic images and videos
JP2776295B2 (en) 1994-10-27 1998-07-16 日本電気株式会社 Image index generation method and image index generator
JPH08186714A (en) 1994-12-27 1996-07-16 Texas Instr Inc <Ti> Noise eliminating device for image data and its device
US6112226A (en) 1995-07-14 2000-08-29 Oracle Corporation Method and apparatus for concurrently encoding and tagging digital information for allowing non-sequential access during playback
US6947571B1 (en) 1999-05-19 2005-09-20 Digimarc Corporation Cell phones with optical capabilities, and related applications
US6714945B1 (en) 1995-11-17 2004-03-30 Sabre Inc. System, method, and article of manufacture for propagating transaction processing facility based data and for providing the propagated data to a variety of clients
US6434530B1 (en) 1996-05-30 2002-08-13 Retail Multimedia Corporation Interactive shopping system with mobile apparatus
JP3851384B2 (en) 1996-09-18 2006-11-29 シャープ株式会社 Image synthesizing apparatus and method
US5949429A (en) 1996-11-14 1999-09-07 Microsoft Corporation Method for performing pixel addressing operations for a tiled image
US6134674A (en) 1997-02-28 2000-10-17 Sony Corporation Computer based test operating system
US6151587A (en) * 1997-07-23 2000-11-21 Matthias; John T. Coupon dispenser and method for generating coupons
US20020116286A1 (en) 1997-10-09 2002-08-22 Walker Jay S. Method and apparatus for utilizing demand information at a vending machine
US6775417B2 (en) 1997-10-02 2004-08-10 S3 Graphics Co., Ltd. Fixed-rate block-based image compression with inferred pixel values
US6411744B1 (en) 1997-10-15 2002-06-25 Electric Planet, Inc. Method and apparatus for performing a clean background subtraction
AU1365699A (en) 1997-10-27 1999-05-17 Imagen Incorporated Image search and retrieval system
JP3500940B2 (en) 1997-12-25 2004-02-23 カシオ計算機株式会社 Product image data processing apparatus
KR100365664B1 (en) 1998-02-03 2003-01-24 츄요시 사이고 Eyeglasses try-on simulation system
US6278446B1 (en) 1998-02-23 2001-08-21 Siemens Corporate Research, Inc. System for interactive organization and browsing of video
JPH11250071A (en) 1998-02-26 1999-09-17 Minolta Co Ltd Image database constructing method, image database device and image information storage medium
WO1999044153A1 (en) 1998-02-27 1999-09-02 Mitsubishi Denki Kabushiki Kaisha Information retrieval system and information processing system
US20030112260A1 (en) 1998-02-27 2003-06-19 Tomonobu Gouzu Information retrieval system and information processing system
US6154738A (en) 1998-03-27 2000-11-28 Call; Charles Gainor Methods and apparatus for disseminating product information via the internet using universal product codes
US7495674B2 (en) 1998-05-27 2009-02-24 Advanced Testing Technologies, Inc. Video generation and capture techniques
US6157435A (en) 1998-05-29 2000-12-05 Eastman Kodak Company Image processing
FR2779848B1 (en) 1998-06-15 2001-09-14 Commissariat Energie Atomique Method invariant indexing an image using fractal characterizations and times
US6216134B1 (en) 1998-06-25 2001-04-10 Microsoft Corporation Method and system for visualization of clusters and classifications
US6216227B1 (en) 1998-06-29 2001-04-10 Sun Microsystems, Inc. Multi-venue ticketing using smart cards
US6134548A (en) 1998-11-19 2000-10-17 Ac Properties B.V. System, method and article of manufacture for advanced mobile bargain shopping
US6512919B2 (en) 1998-12-14 2003-01-28 Fujitsu Limited Electronic shopping system utilizing a program downloadable wireless videophone
US6567797B1 (en) 1999-01-26 2003-05-20 Xerox Corporation System and method for providing recommendations based on multi-modal user clusters
JP4794708B2 (en) * 1999-02-04 2011-10-19 オリンパス株式会社 3D position and orientation sensing device
US7027993B1 (en) 1999-03-12 2006-04-11 International Business Machines Corporation Computerized knowledge brokerage system
US6477269B1 (en) 1999-04-20 2002-11-05 Microsoft Corporation Method and system for searching for images based on color and shape of a selected image
AU6503800A (en) 1999-07-30 2001-02-19 Pixlogic Llc Perceptual similarity image retrieval
US6563959B1 (en) 1999-07-30 2003-05-13 Pixlogic Llc Perceptual similarity image retrieval method
US7478143B1 (en) 2003-08-25 2009-01-13 Arroweye Solutions, Inc. Method and apparatus for creation, personalization, and fulfillment of greeting cards with gift cards or integrated bookmarks
US6589290B1 (en) 1999-10-29 2003-07-08 America Online, Inc. Method and apparatus for populating a form with data
US6446045B1 (en) 2000-01-10 2002-09-03 Lucinda Stone Method for using computers to facilitate and control the creating of a plurality of functions
US20010034668A1 (en) * 2000-01-29 2001-10-25 Whitworth Brian L. Virtual picture hanging via the internet
US6587835B1 (en) 2000-02-09 2003-07-01 G. Victor Treyz Shopping assistance with handheld computing device
US7346543B1 (en) 2000-02-24 2008-03-18 Edmark Tomima L Virtual showroom method
US7428505B1 (en) 2000-02-29 2008-09-23 Ebay, Inc. Method and system for harvesting feedback and comments regarding multiple items from users of a network-based transaction facility
GB2360160B (en) 2000-03-07 2003-12-31 Ian Fletcher Improvements in or relating to image indexing systems
JP2001283079A (en) 2000-03-28 2001-10-12 Sony Corp Communication service method, its device, communication terminal unit, communication system and advertisement publicizing method
US7149665B2 (en) 2000-04-03 2006-12-12 Browzwear International Ltd System and method for simulation of virtual wear articles on virtual models
US7343293B1 (en) 2000-04-14 2008-03-11 Sony Corporation Responding to request for data
AU5163401A (en) 2000-04-17 2001-10-30 Emtera Corp System and method for wireless purchases of goods and services
JP4427697B2 (en) 2000-04-17 2010-03-10 ソニー株式会社 Information providing system, information transmitting apparatus and information receiving apparatus and method thereof
US20030208409A1 (en) 2001-04-30 2003-11-06 Mault James R. Method and apparatus for diet control
US8352331B2 (en) 2000-05-03 2013-01-08 Yahoo! Inc. Relationship discovery engine
US20020002504A1 (en) 2000-05-05 2002-01-03 Andrew Engel Mobile shopping assistant system and device
US6692127B2 (en) * 2000-05-18 2004-02-17 Visionix Ltd. Spectacles fitting system and fitting methods useful therein
JP2001344479A (en) 2000-05-31 2001-12-14 Sony Corp Sale system, server device, terminal device, and information processing method
US7526440B2 (en) 2000-06-12 2009-04-28 Walker Digital, Llc Method, computer product, and apparatus for facilitating the provision of opinions to a shopper from a panel of peers
US7487112B2 (en) 2000-06-29 2009-02-03 Barnes Jr Melvin L System, method, and computer program product for providing location based services and mobile e-commerce
US6901379B1 (en) 2000-07-07 2005-05-31 4-D Networks, Inc. Online shopping with virtual modeling and peer review
US6530521B1 (en) 2000-07-17 2003-03-11 Ncr Corporation Produce recognition apparatus and method of obtaining information about produce items
US20020094189A1 (en) 2000-07-26 2002-07-18 Nassir Navab Method and system for E-commerce video editing
AU7658301A (en) 2000-07-31 2002-02-13 Hypnotizer Method and system for receiving interactive dynamic overlays through a data stream and displaying it over a video content
US7062722B1 (en) 2000-08-22 2006-06-13 Bruce Carlin Network-linked interactive three-dimensional composition and display of saleable objects in situ in viewer-selected scenes for purposes of promotion and procurement
US7437312B2 (en) 2000-08-23 2008-10-14 Bizrate.Com Method for context personalized web browsing
KR100374034B1 (en) 2000-09-05 2003-02-26 삼성전자주식회사 Self-healing device of optical receiver and method thereof
US7254779B1 (en) * 2000-09-06 2007-08-07 Xanboo Inc. Customizable presentation environment
US6697761B2 (en) * 2000-09-19 2004-02-24 Olympus Optical Co., Ltd. Three-dimensional position/orientation sensing apparatus, information presenting system, and model error detecting system
JP2002099826A (en) 2000-09-21 2002-04-05 Matsushita Electric Ind Co Ltd Catalogue sales system
JP2002176671A (en) 2000-09-28 2002-06-21 Takashi Fujimoto Mobile phone
US8234218B2 (en) * 2000-10-10 2012-07-31 AddnClick, Inc Method of inserting/overlaying markers, data packets and objects relative to viewable content and enabling live social networking, N-dimensional virtual environments and/or other value derivable from the content
KR100413679B1 (en) 2000-10-21 2003-12-31 삼성전자주식회사 Shape descriptor extracting method
US6804662B1 (en) 2000-10-27 2004-10-12 Plumtree Software, Inc. Method and apparatus for query and analysis
US7890386B1 (en) 2000-10-27 2011-02-15 Palisades Technology, Llc Method for use with a wireless communication device for facilitating tasks using images and selections
WO2002039216A2 (en) 2000-11-03 2002-05-16 Outlet Group, Llc Method and system of an integrated business topography and virtual 3d network portal
US8130242B2 (en) 2000-11-06 2012-03-06 Nant Holdings Ip, Llc Interactivity via mobile image recognition
US6763148B1 (en) 2000-11-13 2004-07-13 Visual Key, Inc. Image recognition methods
US7827488B2 (en) * 2000-11-27 2010-11-02 Sitrick David H Image tracking and substitution system and methodology for audio-visual presentations
US6484130B2 (en) 2000-11-29 2002-11-19 International Business Machines Corporation Office accessibility information provider
US6993553B2 (en) 2000-12-19 2006-01-31 Sony Corporation Data providing system, data providing apparatus and method, data acquisition system and method, and program storage medium
US7130466B2 (en) 2000-12-21 2006-10-31 Cobion Ag System and method for compiling images from a database and comparing the compiled images with known images
US6690828B2 (en) 2001-04-09 2004-02-10 Gary Elliott Meyers Method for representing and comparing digital images
US6742003B2 (en) 2001-04-30 2004-05-25 Microsoft Corporation Apparatus and accompanying methods for visualizing clusters of data and hierarchical cluster classifications
US20020196333A1 (en) 2001-06-21 2002-12-26 Gorischek Ignaz M. Mirror and image display system
JP2003022395A (en) 2001-07-05 2003-01-24 Matsushita Electric Ind Co Ltd Merchandise related information providing system and merchandise sales system
EP1423825B1 (en) 2001-08-02 2011-01-26 Intellocity USA, Inc. Post production visual alterations
US7082365B2 (en) 2001-08-16 2006-07-25 Networks In Motion, Inc. Point of interest spatial rating search method and system
US7274380B2 (en) * 2001-10-04 2007-09-25 Siemens Corporate Research, Inc. Augmented reality system
JP3997749B2 (en) 2001-10-22 2007-10-24 ソニー株式会社 Signal processing method and apparatus, a signal processing program, and a recording medium,
JP3964646B2 (en) * 2001-10-25 2007-08-22 富士フイルム株式会社 Image processing method, image processing apparatus, and an image signal generation method
US7636874B2 (en) 2001-11-16 2009-12-22 Sap Ag Method and apparatus for computer-implemented processing of payment entries
US7953648B2 (en) 2001-11-26 2011-05-31 Vock Curtis A System and methods for generating virtual clothing experiences
US7022281B1 (en) 2001-11-26 2006-04-04 Senff Anthony N Systems and methods for removing contaminate material from a flowable material
US20030130910A1 (en) 2002-01-07 2003-07-10 Pickover Clifford A. Shopping cart presentation
US6783148B2 (en) 2002-01-14 2004-08-31 Autoliv Asp, Inc. Inflatable curtain positioning system and method
EP1495447A1 (en) 2002-03-26 2005-01-12 KIM, So-Woon System and method for 3-dimension simulation of glasses
JP2004048674A (en) * 2002-05-24 2004-02-12 Olympus Corp Information presentation system of visual field agreement type, portable information terminal, and server
JP2006351024A (en) 2002-05-24 2006-12-28 Olympus Corp Information presentation system of visual field agreement type, and portable information terminal for use in the same
US7568004B2 (en) 2002-06-20 2009-07-28 Linda Gottfried Method and system for sharing brand information
US7127491B2 (en) 2002-07-23 2006-10-24 Canon Kabushiki Kaisha Remote command server
US7231087B2 (en) * 2002-10-30 2007-06-12 Metrica, Inc. Matching binary templates against range map derived silhouettes for object pose estimation
WO2004040912A1 (en) 2002-10-31 2004-05-13 Electronics And Telecommunications Research Institute Non-linear quantization and similarity matching methods for retrieving video sequence having a set of image frames
GB0229625D0 (en) 2002-12-19 2003-01-22 British Telecomm Searching images
US7257268B2 (en) 2003-02-28 2007-08-14 Aperio Technologies, Inc. Systems and methods for image pattern recognition
US20040205286A1 (en) 2003-04-11 2004-10-14 Bryant Steven M. Grouping digital images using a digital camera
JP2004326229A (en) 2003-04-22 2004-11-18 Matsushita Electric Ind Co Ltd Information processor, server device and its program
JP4346950B2 (en) * 2003-05-02 2009-10-21 キヤノン株式会社 Information processing method and apparatus
CN100416336C (en) 2003-06-12 2008-09-03 美国西门子医疗解决公司 Calibrating real and virtual views
US7116342B2 (en) 2003-07-03 2006-10-03 Sportsmedia Technology Corporation System and method for inserting content into an image sequence
US7363214B2 (en) 2003-08-08 2008-04-22 Cnet Networks, Inc. System and method for determining quality of written product reviews in an automated manner
KR100552691B1 (en) * 2003-09-16 2006-02-20 삼성전자주식회사 Method and apparatus for localization in mobile robot
KR100969966B1 (en) 2003-10-06 2010-07-15 디즈니엔터프라이지즈,인크. System and method of playback and feature control for video players
US7277572B2 (en) * 2003-10-10 2007-10-02 Macpearl Design Llc Three-dimensional interior design system
US7379627B2 (en) 2003-10-20 2008-05-27 Microsoft Corporation Integrated solution to digital image similarity searching
WO2005055138A2 (en) 2003-11-26 2005-06-16 Yesvideo, Inc. Statical modeling of a visual image for use in determining similarity between visual images
WO2005063685A1 (en) 2003-12-25 2005-07-14 Asahi Denka Co., Ltd. Metal compound, material for forming thin film and method for preparing thin film
US7693325B2 (en) * 2004-01-14 2010-04-06 Hexagon Metrology, Inc. Transprojection of geometry data
WO2005072157A2 (en) 2004-01-16 2005-08-11 Hillcrest Laboratories, Inc. Metadata brokering server and methods
US7872669B2 (en) 2004-01-22 2011-01-18 Massachusetts Institute Of Technology Photo-based mobile deixis system and related techniques
JP4413633B2 (en) 2004-01-29 2010-02-10 株式会社ゼータ・ブリッジ Information retrieval systems, information retrieval method, the information retrieval apparatus, information retrieval program, the image recognition device, an image recognition method and an image recognition program, and, sales system
JP2007528240A (en) 2004-02-12 2007-10-11 アリヴァンディ,ベスジョン A system and method for creating a commodity from a virtual environment
US20070159522A1 (en) * 2004-02-20 2007-07-12 Harmut Neven Image-based contextual advertisement method and branded barcodes
US7751805B2 (en) 2004-02-20 2010-07-06 Google Inc. Mobile image-based information retrieval system
US7565139B2 (en) * 2004-02-20 2009-07-21 Google Inc. Image-based search engine for mobile phones with camera
US7624123B2 (en) 2004-02-26 2009-11-24 Ati Technologies, Inc. Image processing system and method
US20050222987A1 (en) 2004-04-02 2005-10-06 Vadon Eric R Automated detection of associations between search criteria and item categories based on collective analysis of user activity data
EP1741059B1 (en) * 2004-04-26 2013-10-02 Siemens Aktiengesellschaft Method for determining the position of a marker in an augmented reality system
JP4298577B2 (en) 2004-05-06 2009-07-22 三菱電機株式会社 Vehicle alarm system
US7281018B1 (en) 2004-05-26 2007-10-09 Microsoft Corporation Form template data source change
JP4114637B2 (en) 2004-05-28 2008-07-09 富士ゼロックス株式会社 Position measurement system
US7562069B1 (en) 2004-07-01 2009-07-14 Aol Llc Query disambiguation
US20070198505A1 (en) 2004-07-26 2007-08-23 Panthaen Informatics, Inc. Context-based search engine residing on a network
US20060058948A1 (en) 2004-07-28 2006-03-16 Ms. Melanie Blass Recordable location-based reminder system organizer
US7683858B2 (en) 2004-08-02 2010-03-23 Searete Llc Cosmetic enhancement mirror
US7370803B2 (en) * 2004-08-13 2008-05-13 Dofasco Inc. Remote crane bar code system
US8547401B2 (en) * 2004-08-19 2013-10-01 Sony Computer Entertainment Inc. Portable augmented reality device and method
US7853564B2 (en) 2004-09-17 2010-12-14 Adobe Systems Incorporated Adding metadata to a stock content item
JP4708752B2 (en) 2004-09-28 2011-06-22 キヤノン株式会社 Information processing method and apparatus
JP4689380B2 (en) 2004-09-28 2011-05-25 キヤノン株式会社 Information processing method and apparatus
US7460735B1 (en) 2004-09-28 2008-12-02 Google Inc. Systems and methods for using image duplicates to assign labels to images
US20060116935A1 (en) 2004-11-24 2006-06-01 Evans Charles E Cell phone based product research
US20060120686A1 (en) 2004-12-03 2006-06-08 Frank Liebenow Method, apparatus and system for storage and retrieval of images
EP1828862A2 (en) * 2004-12-14 2007-09-05 Sky-Trax Incorporated Method and apparatus for determining position and rotational orientation of an object
US7409362B2 (en) 2004-12-23 2008-08-05 Diamond Review, Inc. Vendor-driven, social-network enabled review system and method with flexible syndication
US20060149625A1 (en) 2004-12-30 2006-07-06 Ross Koningstein Suggesting and/or providing targeting information for advertisements
US20060149638A1 (en) 2005-01-06 2006-07-06 Allen Anita L Electronic personalized clothing makeover assistant
US9436945B2 (en) 2005-02-01 2016-09-06 Redfin Corporation Interactive map-based search and advertising
JP4599184B2 (en) * 2005-02-02 2010-12-15 キヤノン株式会社 Marker arrangement measuring method, marker arrangement measuring device
US7948481B2 (en) 2005-03-01 2011-05-24 Nissi Vilcovsky Devices, systems and methods of capturing and displaying appearances
US20060218153A1 (en) 2005-03-28 2006-09-28 Voon George H H Building social networks using shared content data relating to a common interest
US7519562B1 (en) 2005-03-31 2009-04-14 Amazon Technologies, Inc. Automatic identification of unreliable user ratings
CN101189049B (en) 2005-04-06 2012-02-29 苏黎士高等院校非金属材料联盟 Method of executing an application in a mobile device
US20080177640A1 (en) 2005-05-09 2008-07-24 Salih Burak Gokturk System and method for using image analysis and search in e-commerce
US8732025B2 (en) 2005-05-09 2014-05-20 Google Inc. System and method for enabling image recognition and searching of remote content on display
US7848765B2 (en) 2005-05-27 2010-12-07 Where, Inc. Location-based services
US7703040B2 (en) 2005-06-29 2010-04-20 Microsoft Corporation Local search engine user interface
KR101350888B1 (en) 2005-07-14 2014-01-14 찰스 디. 휴스턴 Gps based spectator and participant sport system and method
US7761400B2 (en) 2005-07-22 2010-07-20 John Reimer Identifying events
KR20070014532A (en) 2005-07-29 2007-02-01 주식회사 팬택 System and method for ordering goods using short message service during watching digital multimedia broadcasting service
US20110153614A1 (en) 2005-08-01 2011-06-23 Worthwhile Products Inventory control system process
US20110143731A1 (en) 2005-09-14 2011-06-16 Jorey Ramer Mobile Communication Facility Usage Pattern Geographic Based Advertising
US7801893B2 (en) 2005-09-30 2010-09-21 Iac Search & Media, Inc. Similarity detection and clustering of images
US20070133947A1 (en) 2005-10-28 2007-06-14 William Armitage Systems and methods for image search
US7769236B2 (en) * 2005-10-31 2010-08-03 National Research Council Of Canada Marker and method for detecting said marker
GB2431793B (en) 2005-10-31 2011-04-27 Sony Uk Ltd Image processing
US20090281909A1 (en) 2006-12-06 2009-11-12 Pumpone, Llc System and method for management and distribution of multimedia presentations
US7606581B2 (en) 2005-12-13 2009-10-20 Yahoo! Inc. System and method for providing geo-relevant information based on a location
US7457730B2 (en) * 2005-12-15 2008-11-25 Degnan Donald A Method and system for virtual decoration
US7931194B2 (en) 2005-12-21 2011-04-26 Ncr Corporation Methods and apparatus for automated document examination for age verification
US20070150403A1 (en) 2005-12-28 2007-06-28 Motorola, Inc. Method and system for a mobile auction concierge
US8208764B2 (en) 2006-01-21 2012-06-26 Elizabeth Guckenberger Photo automatic linking system and method for accessing, linking, and visualizing “key-face” and/or multiple similar facial images along with associated electronic data via a facial image recognition search engine
JP2007274478A (en) 2006-03-31 2007-10-18 Toshiba Corp Image processor, image processing method, and image processing program
US8121610B2 (en) 2006-03-31 2012-02-21 Research In Motion Limited Methods and apparatus for associating mapping functionality and information in contact lists of mobile communication devices
US8117246B2 (en) 2006-04-17 2012-02-14 Microsoft Corporation Registering, transfering, and acting on event metadata
US7783272B2 (en) 2006-06-29 2010-08-24 Microtune (Texas), L.P. Dynamic performance control of broadband tuner
WO2008003966A1 (en) 2006-07-05 2008-01-10 Carbon Digital Media Limited Method and apparatus for controlling configuration of an online auction facility
US7711609B1 (en) 2006-07-13 2010-05-04 Gofigure Media, Llc System and method for placing products or services and facilitating purchase
US10003781B2 (en) 2006-08-04 2018-06-19 Gula Consulting Limited Liability Company Displaying tags associated with items in a video playback
US20080046738A1 (en) 2006-08-04 2008-02-21 Yahoo! Inc. Anti-phishing agent
EP1887526A1 (en) * 2006-08-11 2008-02-13 Seac02 S.r.l. A digitally-augmented reality video system
US7813561B2 (en) 2006-08-14 2010-10-12 Microsoft Corporation Automatic classification of objects within images
GB2440958A (en) 2006-08-15 2008-02-20 Tomtom Bv Method of correcting map data for use in navigation systems
US7916129B2 (en) 2006-08-29 2011-03-29 Industrial Technology Research Institute Interactive display system
US20080071559A1 (en) * 2006-09-19 2008-03-20 Juha Arrasvuori Augmented reality assisted shopping
US20080084429A1 (en) 2006-10-04 2008-04-10 Sherman Locke Wissinger High performance image rendering for internet browser
FR2907239B1 (en) 2006-10-11 2009-01-09 Spikenet Technology Rapid Method for research and recognition of a digital image representative of at least one graphic pattern in a digital image bank
US20080109841A1 (en) 2006-10-23 2008-05-08 Ashley Heather Product information display and product linking
US7512605B2 (en) 2006-11-01 2009-03-31 International Business Machines Corporation Document clustering based on cohesive terms
US20080126193A1 (en) * 2006-11-27 2008-05-29 Grocery Shopping Network Ad delivery and implementation system
US20080147325A1 (en) 2006-12-18 2008-06-19 Maassel Paul W Method and system for providing augmented reality
WO2008076138A2 (en) 2006-12-18 2008-06-26 The Nielsen Company Methods and systems to meter point-of-purchase conduct with a wireless communication device equipped with a camera
US20080154710A1 (en) 2006-12-21 2008-06-26 Pradeep Varma Minimal Effort Prediction and Minimal Tooling Benefit Assessment for Semi-Automatic Code Porting
WO2008082891A2 (en) 2006-12-29 2008-07-10 Echostar Technologies Corporation Incremental transmission of data
KR101329289B1 (en) 2007-01-05 2013-11-14 삼성전자주식회사 Apparatus and method for providing schedule and path
CN101226596B (en) 2007-01-15 2012-02-01 夏普株式会社 Document image processing apparatus and a document image processing method
US7957510B2 (en) 2007-01-23 2011-06-07 Microsoft Corporation Notifying network contacts of inquiries
US20080201241A1 (en) 2007-02-02 2008-08-21 Daniel Ben Pecoraro Automated coffee system
US20080207357A1 (en) 2007-02-09 2008-08-28 Chris Savarese Combined range and tag finder
US20080205755A1 (en) 2007-02-23 2008-08-28 Banner Engineering Corporation Method and apparatus for color matching
US8103115B2 (en) 2007-02-26 2012-01-24 Sony Corporation Information processing apparatus, method, and program
US7978246B2 (en) 2007-03-13 2011-07-12 Osann Jr Robert Electronic mirror
JP5043133B2 (en) * 2007-03-13 2012-10-10 リサーチ インスティチュート オブ インダストリアル サイエンス アンド テクノロジー Land recognition landmark for mobile robot, and position recognition apparatus and method using the same
US7881984B2 (en) 2007-03-30 2011-02-01 Amazon Technologies, Inc. Service for providing item recommendations
US8958661B2 (en) 2007-03-30 2015-02-17 Intel Corporation Learning concept templates from web images to query personal image databases
KR100856585B1 (en) 2007-04-04 2008-09-03 주식회사 엘지데이콤 Interactive television system
GB0707216D0 (en) 2007-04-14 2007-05-23 Livesey Carl Interactive shopping platform
US20080268876A1 (en) 2007-04-24 2008-10-30 Natasha Gelfand Method, Device, Mobile Terminal, and Computer Program Product for a Point of Interest Based Scheme for Improving Mobile Visual Searching Functionalities
US8386923B2 (en) 2007-05-08 2013-02-26 Canon Kabushiki Kaisha Document generation apparatus, method, and storage medium
KR100805607B1 (en) 2007-05-09 2008-02-20 정두호 Method for online marketplace for interior design materials
US8694379B2 (en) 2007-05-14 2014-04-08 Microsoft Corporation One-click posting
CA2687484A1 (en) 2007-05-17 2008-11-27 Fat Free Mobile Inc. Web page transcoding method and system applying queries to plain text
US8412021B2 (en) 2007-05-18 2013-04-02 Fall Front Wireless Ny, Llc Video player user interface
US20090006208A1 (en) 2007-06-26 2009-01-01 Ranjit Singh Grewal Display of Video with Tagged Advertising
US7725362B2 (en) 2007-07-12 2010-05-25 Qualcomm Incorporated Virtual group shopping mall
US9609260B2 (en) 2007-07-13 2017-03-28 Gula Consulting Limited Liability Company Video tag layout
CN101354746B (en) 2007-07-23 2011-08-31 夏普株式会社 Device and method for extracting character image
CN101354703B (en) 2007-07-23 2010-11-17 夏普株式会社 Apparatus and method for processing document image
EP2020746A1 (en) 2007-08-02 2009-02-04 Grundfos Management A/S Method for actuating an asynchronous motor
US9569806B2 (en) 2007-09-04 2017-02-14 Apple Inc. Dynamic presentation of location-specific information
US20090083096A1 (en) 2007-09-20 2009-03-26 Microsoft Corporation Handling product reviews
DE102007045835B4 (en) * 2007-09-25 2012-12-20 Metaio Gmbh Method and apparatus for displaying a virtual object in a real environment,
DE102007045834B4 (en) * 2007-09-25 2012-01-26 Metaio Gmbh Method and apparatus for displaying a virtual object in a real environment,
US7627502B2 (en) 2007-10-08 2009-12-01 Microsoft Corporation System, method, and medium for determining items to insert into a wishlist by analyzing images provided by a user
US20090106127A1 (en) 2007-10-19 2009-04-23 Zuujit, Llc System and method for automated entry into on-line auction or sale services employing a wireless device
US20090109240A1 (en) * 2007-10-24 2009-04-30 Roman Englert Method and System for Providing and Reconstructing a Photorealistic Three-Dimensional Environment
US9147213B2 (en) * 2007-10-26 2015-09-29 Zazzle Inc. Visualizing a custom product in situ
KR101146091B1 (en) 2007-11-30 2012-05-16 광주과학기술원 Input Interface Device for Augmented Reality, and Augmented Reality System Therewith
US9058764B1 (en) * 2007-11-30 2015-06-16 Sprint Communications Company L.P. Markers to implement augmented reality
KR100932634B1 (en) * 2007-12-27 2009-12-21 팅크웨어(주) 3D web map service method and system using augmented reality
US20090262137A1 (en) 2008-01-10 2009-10-22 Walker Jay S Systems and methods for presenting prediction in a broadcast
WO2009094724A1 (en) * 2008-02-01 2009-08-06 Innovation Studios Pty Ltd Method for online selection of items and an online shopping system using the same
US20110001758A1 (en) * 2008-02-13 2011-01-06 Tal Chalozin Apparatus and method for manipulating an object inserted to video content
US9495386B2 (en) 2008-03-05 2016-11-15 Ebay Inc. Identification of items depicted in images
EP2250623A4 (en) 2008-03-05 2011-03-23 Ebay Inc Method and apparatus for image recognition services
US7756757B1 (en) 2008-03-05 2010-07-13 United Services Automobile Association (Usaa) Systems and methods for price searching and intelligent shopping lists on a mobile device
US8098881B2 (en) 2008-03-11 2012-01-17 Sony Ericsson Mobile Communications Ab Advertisement insertion systems and methods for digital cameras based on object recognition
US10122845B2 (en) 2008-03-11 2018-11-06 Nitesh Ratnakar Location based personal organizer
US20100211900A1 (en) 2009-02-17 2010-08-19 Robb Fujioka Virtual Marketplace Accessible To Widgetized Avatars
US9436927B2 (en) 2008-03-14 2016-09-06 Microsoft Technology Licensing, Llc Web-based multiuser collaboration
CN101541012A (en) 2008-03-21 2009-09-23 夏普株式会社 Interference overload indication generating method, interference overload indication triggering method, interference overload indication method and base station
US8180154B2 (en) 2008-03-25 2012-05-15 Techfinity, Inc. Method and apparatus for region-based segmentation image processing using region mapping
JP2009237878A (en) * 2008-03-27 2009-10-15 Dainippon Printing Co Ltd Composite image generating system, overlaying condition determining method, image processing apparatus, and image processing program
US20090271293A1 (en) 2008-04-28 2009-10-29 Interactive Luxury Solutions Llc Methods and systems for dynamically generating personalized shopping suggestions
US7707073B2 (en) 2008-05-15 2010-04-27 Sony Ericsson Mobile Communications, Ab Systems methods and computer program products for providing augmented shopping information
US8447643B2 (en) 2008-06-02 2013-05-21 Melvin L. Barnes, Jr. System and method for collecting and distributing reviews and ratings
US20090319388A1 (en) 2008-06-20 2009-12-24 Jian Yuan Image Capture for Purchases
US8161379B2 (en) * 2008-06-20 2012-04-17 Microsoft Corporation Fit and fill techniques for pictures
US20090319373A1 (en) 2008-06-23 2009-12-24 Microsoft Corporation National advertisement linking
US8233722B2 (en) 2008-06-27 2012-07-31 Palo Alto Research Center Incorporated Method and system for finding a document image in a document collection using localized two-dimensional visual fingerprints
US8788493B2 (en) 2008-06-30 2014-07-22 Verizon Patent And Licensing Inc. Digital image tagging apparatuses, systems, and methods
JP5111268B2 (en) 2008-07-09 2013-01-09 キヤノン株式会社 Image processing apparatus, image processing method, program thereof, and storage medium
US8260846B2 (en) 2008-07-25 2012-09-04 Liveperson, Inc. Method and system for providing targeted content to a surfer
JP2010039908A (en) 2008-08-07 2010-02-18 Sugisaki Fusako Curtain hanging simulation system, curtain hanging simulation method and program
US20100037177A1 (en) 2008-08-08 2010-02-11 Golsorkhi Andre O Tool for capturing data across web domains
US8520979B2 (en) 2008-08-19 2013-08-27 Digimarc Corporation Methods and systems for content processing
US20100048290A1 (en) * 2008-08-19 2010-02-25 Sony Computer Entertainment Europe Ltd. Image combining method, system and apparatus
US20100045701A1 (en) * 2008-08-22 2010-02-25 Cybernet Systems Corporation Automatic mapping of augmented reality fiducials
TWI375177B (en) 2008-09-10 2012-10-21 Univ Nat Taiwan System and method for inserting advertising content
KR101537018B1 (en) 2008-10-01 2015-07-17 삼성전자주식회사 Secure Memory Interface, System and Smart Card Including the same
JP2010141371A (en) 2008-10-08 2010-06-24 Avanty:Kk System for assisting creation/playback of animation content
US8217952B2 (en) 2008-11-26 2012-07-10 Novell, Inc. Techniques for caching images
KR20100067921A (en) 2008-12-12 2010-06-22 강동우 The area infomercial service method which applies a ip home server
US20100153378A1 (en) 2008-12-12 2010-06-17 Sardesai Prashant Online Pair Wise Comparison and Recommendation System
KR20100071559A (en) 2008-12-19 2010-06-29 에스케이텔레콤 주식회사 Electronic commerce linkage system using interactive advertisement contents and method thereof
US8886636B2 (en) 2008-12-23 2014-11-11 Yahoo! Inc. Context transfer in search advertising
WO2010084585A1 (en) 2009-01-21 2010-07-29 Fukuda Tatsuya Information guidance system
US8606657B2 (en) * 2009-01-21 2013-12-10 Edgenet, Inc. Augmented reality method and system for designing environments and buying/selling goods
US8411086B2 (en) * 2009-02-24 2013-04-02 Fuji Xerox Co., Ltd. Model creation using visual markup languages
CN101515198A (en) * 2009-03-11 2009-08-26 上海大学 Human-computer interaction method for grapping and throwing dummy object and system thereof
US10417675B2 (en) 2009-03-11 2019-09-17 Ebay Inc. System and method for providing user interfaces for fashion selection
US8825660B2 (en) 2009-03-17 2014-09-02 Ebay Inc. Image-based indexing in a network-based marketplace
CN101520904B (en) 2009-03-24 2011-12-28 上海水晶石信息技术有限公司 Methods of estimating with reality and augmented reality systems
US8527658B2 (en) 2009-04-07 2013-09-03 Verisign, Inc Domain traffic ranking
US8411986B2 (en) 2009-04-13 2013-04-02 Flashfoto, Inc. Systems and methods for segmenation by removal of monochromatic background with limitied intensity variations
US9195898B2 (en) 2009-04-14 2015-11-24 Qualcomm Incorporated Systems and methods for image recognition using mobile devices
US8862574B2 (en) 2009-04-30 2014-10-14 Microsoft Corporation Providing a search-result filters toolbar
WO2010141939A1 (en) 2009-06-05 2010-12-09 Mozaik Multimedia, Inc. Ecosystem for smart content tagging and interaction
US20110004517A1 (en) 2009-06-26 2011-01-06 The Jungle U LLC Dialogue advertising
US20100332304A1 (en) 2009-06-29 2010-12-30 Higgins Chris W Targeting in Cost-Per-Action Advertising
US20100332283A1 (en) 2009-06-29 2010-12-30 Apple Inc. Social networking in shopping environments
US8275590B2 (en) 2009-08-12 2012-09-25 Zugara, Inc. Providing a simulation of wearing items such as garments and/or accessories
US8682391B2 (en) 2009-08-27 2014-03-25 Lg Electronics Inc. Mobile terminal and controlling method thereof
US20110061011A1 (en) 2009-09-04 2011-03-10 Ramsay Hoguet Three-Dimensional Shopping Lists
US20110065496A1 (en) * 2009-09-11 2011-03-17 Wms Gaming, Inc. Augmented reality mechanism for wagering game systems
WO2011038275A1 (en) 2009-09-25 2011-03-31 Avazap Inc. Frameless video system
US20110084983A1 (en) 2009-09-29 2011-04-14 Wavelength & Resonance LLC Systems and Methods for Interaction With a Virtual Environment
RU2012113782A (en) 2009-10-13 2013-11-20 Эзсав Инк. Devices, methods and computer software products, ensuring the possibility of association of data of related products with execution of transactions
US8121618B2 (en) 2009-10-28 2012-02-21 Digimarc Corporation Intuitive computing methods and systems
US8239130B1 (en) 2009-11-12 2012-08-07 Google Inc. Enhanced identification of interesting points-of-interest
US8817078B2 (en) 2009-11-30 2014-08-26 Disney Enterprises, Inc. Augmented reality videogame broadcast programming
JP2011118834A (en) 2009-12-07 2011-06-16 Sony Corp Apparatus and method for processing information, and program
US9164577B2 (en) 2009-12-22 2015-10-20 Ebay Inc. Augmented reality system, method, and apparatus for displaying an item image in a contextual environment
KR101055985B1 (en) 2010-01-12 2011-08-11 인크로스 주식회사 Information provision method and information service method using a terminal equipped with a camera
US8990124B2 (en) 2010-01-14 2015-03-24 Microsoft Technology Licensing, Llc Assessing quality of user reviews
US20110184780A1 (en) 2010-01-21 2011-07-28 Ebay Inc. INTEGRATION OF eCOMMERCE FEATURES INTO SOCIAL NETWORKING PLATFORM
JP2013519162A (en) 2010-02-01 2013-05-23 ジャンプタップ,インコーポレイテッド Integrated advertising system
US8370062B1 (en) 2010-02-09 2013-02-05 Google Inc. Switching between location contexts
JP5452313B2 (en) 2010-03-29 2014-03-26 ニフティ株式会社 Electronic commerce server and electronic commerce method
US8639440B2 (en) 2010-03-31 2014-01-28 International Business Machines Corporation Augmented reality shopper routing
WO2011158336A1 (en) 2010-06-15 2011-12-22 株式会社ナビタイムジャパン Navigation system, terminal apparatus, navigation server, navigation apparatus, navigation method, and program
CN101893935B (en) 2010-07-14 2012-01-11 北京航空航天大学 Cooperative construction method for enhancing realistic table-tennis system based on real rackets
US20120072233A1 (en) 2010-09-20 2012-03-22 Hanlon Alaina B Medical health information system for health assessment, weight management and meal planning
US20120084812A1 (en) 2010-10-04 2012-04-05 Mark Thompson System and Method for Integrating Interactive Advertising and Metadata Into Real Time Video Content
US10127606B2 (en) 2010-10-13 2018-11-13 Ebay Inc. Augmented reality system and method for visualizing an item
US8660369B2 (en) 2010-10-25 2014-02-25 Disney Enterprises, Inc. Systems and methods using mobile devices for augmented reality
US8698843B2 (en) 2010-11-02 2014-04-15 Google Inc. Range of focus in an augmented reality application
US20120113141A1 (en) 2010-11-09 2012-05-10 Cbs Interactive Inc. Techniques to visualize products using augmented reality
US20120120113A1 (en) 2010-11-15 2012-05-17 Eduardo Hueso Method and apparatus for visualizing 2D product images integrated in a real-world environment
KR101292463B1 (en) 2011-01-27 2013-07-31 주식회사 팬택 Augmented reality system and method that share augmented reality service to remote
US20120197764A1 (en) 2011-02-02 2012-08-02 Ebay Inc. Method and process of using metadata associated with a digital media to search for local inventory
US20120215584A1 (en) 2011-02-18 2012-08-23 Leapset, Inc. Tracking off-line commerce and online activity
CN102156810A (en) 2011-03-30 2011-08-17 北京触角科技有限公司 Augmented reality real-time virtual fitting system and method thereof
US8336774B2 (en) 2011-04-04 2012-12-25 Shopper's Club, Llc Shopping apparatus and methods
CN102194007B (en) 2011-05-31 2014-12-10 中国电信股份有限公司 System and method for acquiring mobile augmented reality information
US8891832B2 (en) 2011-06-03 2014-11-18 Facebook, Inc. Computer-vision-assisted location check-in
US9973848B2 (en) 2011-06-21 2018-05-15 Amazon Technologies, Inc. Signal-enhancing beamforming in an augmented reality environment
US9043237B2 (en) 2011-09-21 2015-05-26 Fexco Merchant Services Systems and methods for making a payment using a wireless device
US9292603B2 (en) 2011-09-30 2016-03-22 Nuance Communications, Inc. Receipt and processing of user-specified queries
US8230016B1 (en) 2011-10-11 2012-07-24 Google Inc. Determining intent of a recommendation on a mobile application
US9449342B2 (en) 2011-10-27 2016-09-20 Ebay Inc. System and method for visualization of items in an environment using augmented reality
AU2015264850B2 (en) 2011-10-27 2017-04-27 Ebay Inc. Visualization of items using augmented reality
US20130116922A1 (en) 2011-11-08 2013-05-09 Hon Hai Precision Industry Co., Ltd. Emergency guiding system, server and portable device using augmented reality
US9240059B2 (en) 2011-12-29 2016-01-19 Ebay Inc. Personal augmented reality
US20130198002A1 (en) 2012-01-27 2013-08-01 Ebay Inc. Method and process of using meta-data associated with a digital media to advertise local inventory based upon view gps location
US20130325839A1 (en) 2012-03-05 2013-12-05 TeleCommunication Communication Systems, Inc. Single Search Box Global
US20140007012A1 (en) 2012-06-29 2014-01-02 Ebay Inc. Contextual menus based on image recognition
US9336541B2 (en) 2012-09-21 2016-05-10 Paypal, Inc. Augmented reality product instructions, tutorials and visualizations
US9773018B2 (en) 2013-08-13 2017-09-26 Ebay Inc. Mapping item categories to ambiguous queries by geo-location
US20160034944A1 (en) 2014-08-04 2016-02-04 Oren Raab Integrated mobile listing service

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10210659B2 (en) 2009-12-22 2019-02-19 Ebay Inc. Augmented reality system, method, and apparatus for displaying an item image in a contextual environment

Also Published As

Publication number Publication date
US9164577B2 (en) 2015-10-20
WO2011087797A3 (en) 2011-10-06
KR20120106988A (en) 2012-09-27
CN104656901A (en) 2015-05-27
CN104656901B (en) 2017-12-22
EP2499635A2 (en) 2012-09-19
US10210659B2 (en) 2019-02-19
WO2011087797A2 (en) 2011-07-21
CN102667913B (en) 2015-03-25
KR101659190B1 (en) 2016-09-22
KR101859856B1 (en) 2018-06-28
KR101657336B1 (en) 2016-09-19
US20160019723A1 (en) 2016-01-21
KR20140024483A (en) 2014-02-28
CN102667913A (en) 2012-09-12
KR20160111541A (en) 2016-09-26
EP2499635A4 (en) 2015-07-15
US20110148924A1 (en) 2011-06-23

Similar Documents

Publication Publication Date Title
US8205172B2 (en) Graphical web browser history toolbar
KR20090056506A (en) Rich content creation system and method thereof, and media that can record computer program for method thereof
EP1278161A2 (en) Image composition system and method thereof, image generation apparatus and method thereof, storage medium and computer program for image composition
US20080033641A1 (en) Method of generating a three-dimensional interactive tour of a geographic location
CN102027504B (en) Lightweight three-dimensional display
US8745502B2 (en) System and method for interfacing interactive systems with social networks and media playback devices
JP4401728B2 (en) Mixed reality space image generating method and a mixed reality system
US9595059B2 (en) Image-related methods and arrangements
US9087413B2 (en) System for delivering and enabling interactivity with images
KR101108743B1 (en) Method and apparatus for holographic user interface communication
CN103503013B (en) Video associated with the stored-value tokens to create a personalized experience of the methods and systems
US7502036B2 (en) System for delivering and enabling interactivity with images
EP1014257A1 (en) Window display
US8497883B2 (en) Information display device
US7616834B2 (en) System for delivering and enabling interactivity with images
CN103733177B (en) Enhanced real-time view
US7120593B1 (en) Method and system for ordering image related goods and services
US8451266B2 (en) Interactive three-dimensional augmented realities from item markers for on-demand item visualization
RU2509341C2 (en) Image processing device and image processing method
JP2010530998A (en) Image-based information retrieval method and system
US20130311329A1 (en) Image-related methods and arrangements
JP2004157968A (en) Three-dimensional computer modeling
KR20080031456A (en) System and methods for creation and use of a mixed media environment
KR20020014673A (en) Researching Method and Researching System For Interests in Commercial Goods By Using Electronic Catalog Including Interactive 3D Image data
JP2006507609A (en) Image capture and display system and method for generating a composite image

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

AS Assignment

Owner name: EBAY INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAPLEY, JOHN;FARRARO, ERIC J.;REEL/FRAME:047097/0233

Effective date: 20091218