VIRTUAL SHOPPING ENVIRONMENT
BACKGROUND OF THE INVENTION
The present invention relates generally to the field of electronic commerce and in particular to the use of multimedia computing and communications networks to provide a system and method for interactively shopping for and purchasing goods and services from a remote location.
Various methods and electronic devices have been used to allow consumers to purchase goods and services from their homes. One method uses a live host communicating with a television audience to present a variety of merchandise on display in a television studio. This method involves broadcast of the host's performance via a cable television channel in the same manner as a typical television show. Consumers contact a purchase center via telephone to order a product. One problem with this method is that the consumer does not control the products offered, or the sequence and timing of the offering. Because the product offerings and presentation schedule are predetermined, consumers must be watching the television show at the time when the products they want to purchase are being presented. Such television-based interactive home shopping systems are well known. Other systems allow consumers to shop "on-line" by accessing a proprietary computer service using a personal computer and communication device. The use of personal computer systems rather than televisions and telephones allows these systems to be more customer-driven. Most such systems provide the consumer with a textual description of product offerings in a menu-driven format. For example, textually-based home shopping services for books, computers, travel services and groceries are well known. However, these systems typically require the consumer to sort through a large number of products in a cumbersome textual format in order to select and purchase a single product.
With the increased use of the publicly available World Wide Web and the enhanced processing power of personal computers, merchants have begun to provide via the World Wide Web multimedia interactive systems for consumer shopping. For example, many large retailers now provide sites on the World Wide Web ("web sites") where consumers can purchase their goods and services. Some retail web sites
provide both textual descriptions and photographic images of the products. Also, certain retailers sell via their web sites merchandise the photographs of which are also available in printed catalogs.
Even though prior art systems have offered some flexibility in the selection and presentation of the offered products, none have provided interfaces that allow the consumer to interact with the products offered in a manner that simulates a realistic shopping experience. Where the products offered are of the type which consumers typically buy in person, such as clothing, the limitations of the prior art technology, such as non-user friendly interfaces, tend to outweigh the perceived benefits of shopping from a remote location. Virtual reality systems that allow users to simulate various types of real world experiences have been known for some time in the art. These systems provide maximally interactive user interfaces but have traditionally been too expensive to be put in thousands of homes. Moreover, none of these prior art virtual reality systems have sought to simulate the unique experience that consumers enjoy while shopping at large retail establishments. Accordingly, a need remains in the art for a system providing a virtual shopping environment that integrates personal computers or communications devices with retail management and information systems in a manner that simulates real world shopping.
SUMMARY OF THE INVENTION
The present invention solves the aforementioned problems by providing a system and method for enabling a consumer using a computer connected to an electronic network to view and purchase retail merchandise displayed in a multi- dimensional virtual environment that realistically simulates retail shopping.
In an aspect of the invention, an image representative of a retail store layout plan is generated and displayed to a consumer on the consumer's display device. The store layout image may include images representative of the shopping areas within the store as well as images representative of the product groupings associated with the shopping areas and of the individual products comprising the groupings. The consumer may simulate movement through the retail store by manipulating the store image - such as by zooming in or out and panning vertically and horizontally.
In one embodiment, an image representative of a retail shopping mall is generated and displayed to a consumer on the consumer's display device. The virtual shopping mall image is comprised of images representative of a plurality of retail merchants. According to the invention, a retail space management system generates information that describes a retail environment and includes descriptions of retail store layouts, shopping areas within each layout, product display areas within each shopping area, product groups associated with each product display area, and, preferably, products comprising each product group. The retail environment information is stored in a first, or environment, database accessible to the consumer's computer in any of several ways to be discussed below. In this database, each retail environment, if more than one, and each product has a unique identifier.
A product library generates information describing for each product, its appearance in at least two dimensions and its unique product code in the retail environment database. The information about each product, including in a preferred embodiment, at least its current price and availability, is stored in a second, or product, database accessible over the network via the consumer's computer. At least a portion of the information in the environment and product databases are separately delivered to the consumer's computer using any of a variety of data storage and communications means.
Also, in accordance with the invention, the system of the present invention retrieves over the network information that is subject to frequent change. In one aspect of the invention, the system in response to user input indicative of simulated manipulation of a product retrieves from a merchant information system the up-to- date pricing, availability, and other information for the product. In another aspect of the invention, the system retrieves from a merchant information system an indicator of which of the plurality of store layouts in the retail space management database a merchant intends to display as its current store layout where more than one layout is available for the merchant. The invention generates the retail store layout image after retrieving the merchant's current layout indicator and selecting from the available store layouts, the layout associated with the current layout indicator.
According to the invention, after the system generates the retail store layout image, a user may enter inputs indicative of simulated movement through the virtual
retail environment. In response to input from the consumer indicative of a simulated approach to a shopping area in the layout, the invention generates an image of the virtual shopping area and displays it on the consumer's display device. The virtual shopping area may include images of product display areas as well as images of the products as they would appear upon approach to the display area.
In a further aspect of the invention, the system generates a multi -dimensional model of objects representative of the product display area and the products therein. It accesses the retail environment database to obtain a description of the dimensions and appearance of the product display areas and the unique product codes of the products displayed therein. It then accesses the product database using the unique product codes to obtain descriptions of the dimensions and appearance of each product.
In still another aspect of the invention, the consumer may simulate manipulation of individual products by inputting commands indicative of viewing the product image at close range, removing the product from the display area, or handling the product in multi- dimensional space. In response to such user input, the system may display the product's current price, availability, and other non-static product- related information retrieved from the merchant information system. In addition, the user of the present invention may indicate the intent to purchase the displayed product. The invention records information about consumer purchases and forwards this information over a network to the merchant information system.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a simplified block diagram of a system for providing a virtual shopping environment illustrative of a preferred embodiment of the present invention.
FIG. 2 is a flowchart describing in a simplified manner the operation of the system of FIG. 1.
FIG. 3 is a flowchart describing in a simplified manner how the system of FIG. 1 generates a retail store layout image.
FIG. 4 is a flowchart describing in a simplified manner how the system of FIG. 1 processes user actions operating on a store layout.
FIG. 5 is a flowchart describing in a simplified manner how the system of FIG. 1 processes user actions operating on a shopping area.
FIG. 6 is a flowchart describing in a simplified manner how the system of FIG. 1 processes user actions simulating the viewing, manipulation and purchase of an individual product.
DETAILED DESCRIPTION
FIG. 1 is a block diagram of a system for providing a virtual shopping environment in accordance with a preferred embodiment of the present invention. In a preferred embodiment, the inventive system includes personal computer 10 connected via a communications means to computer network 15, retail environment database 20, product database 40, retail data manager 60, purchase order database 65, research database 67 and graphical image generator 80. In accordance with the invention, the contents of both retail environment database 20 and product database 40 are separately delivered to and accessible via personal computer 10. Also, at least some information for product database 40 is delivered to personal computer 10 over computer network 15 during the time that the consumer is viewing the virtual environment. Computer network 15 may be implemented using the Internet, cable television (CATV), telephony systems or any other electronic network.
Retail environment database 20 is populated with retail space management data 30 generated by retail space management system 35. Retail space management data 30 is delivered to retail environment database 20 using any of a number of well- known data storage and communications means. In one embodiment, retail space management data 30 is stored in a compressed file format and forwarded over computer network 15 for storage in the permanent memory of personal computer 10. In another embodiment, retail space management data 30 is stored on an optical data storage product, such as a compact disc, and is delivered by any appropriate means to the consumer for access via personal computer 10.
Retail space management data 30 describes the virtual environment in which the products are to be displayed. Retail space management data 30 includes descriptions preferably in three-dimensions of multiple retail store layouts, shopping areas within each layout, product display areas within each shopping area, product groups associated with each product display area, and the products comprising each product group. Typically, the description of a retail store layout will include a floor plan that indicates the sizes and locations of shopping areas, such as aisles, as well as the dimensions and appearance of product display areas, such as shelves. In the
preferred embodiment, the store layout description will identify for each product display area the groups of products that may be displayed therein, and the dimensions and appearance of the product groups in the display areas. In retail environment database 20, a unique identifier exists for each retail environment, where more than one environment is available, and preferably for each product. Retail space management data 30 in retail environment database 20 is accessible by an indication of the merchant whose retail space it describes.
Product database 40 stores information describing for each product, its price, current availability, dimensions and appearance in three dimensions and unique product code in retail environment database 20. Product database 40 can be populated with product description data 50 typically maintained in a product library 55. Product description data 50 may be delivered to product database 40 via a number of data storage and communication devices. In one embodiment, product description data 50 resides on a proprietary database and is forwarded for storage on personal computer 10 via a proprietary network accessed remotely using a dial-up facility. In another embodiment, product description data 50 is stored on an optical data storage product and delivered directly to the consumer for access via personal computer 10.
Product library 55 may contain the proprietary product descriptions of a single merchant or the shared descriptions of products sold by multiple retail merchants. A retail merchant who wishes to sell products using the system of the present invention may send samples of all new products to a third party for imaging and storage in product library 55. Alternatively, a merchant can send previously captured product images, prices, and other product information directly to the third party managing product library 55. Retail data manager 60 reads, updates and maintains information stored in retail environment database 20 and product database 40. In response to user input 70 retail data manager 60 accesses retail environment database 20 and product database 20 to create three-dimensional descriptions of retail store layouts, the shopping and display areas, and the products displayed therein. A consumer operates an input device 75 to generate user input 70. The consumer's input device 75 may be any of a mouse, trackball, keyboard, light pen or other input device for a computer.
Graphical image generator 80 includes a three-dimensional modeling system that allows a user to create, display and manipulate three-dimensional representations
of objects. Suitable three-dimensional modeling systems are believed to include real time virtual environment editors currently on the market, such as Sense8 WorldToolKit and Autodesk Cyberspace Developer's Kit. These devices allow a user to create and store a virtual environment and to move around within the environment. The three-dimensional modeling system of the present invention uses the three-dimensional descriptions generated by retail data manager 60 to construct a three-dimensional model of the virtual retail environment and the products displayed therein. Graphical image generator 80 outputs the three-dimensional model as a graphical image 85 for display on a user display device 90 attached to personal computer 10. In the graphical image 85, the three-dimensional model consists of replicas of objects that would appear in an actual store, as will be described in more detail below. User display device 90 may be a monitor or other type of display device for personal computer 10.
User input 70 can be indicative of the simulated movement of the consumer through the virtual shopping environment and the simulated manipulation of the three-dimensional objects therein. In the preferred embodiment, consumers use input device 75 to create inputs 70 indicative of movement up and down shopping aisles, manipulation of products on a shelf, and examination of products at close range and from different perspectives. In response to consumer inputs 70 indicative of simulated movement, the system will update the three-dimensional description of the retail environment and graphical image generator 80 generates a new image 85. Also, in response to an input 70 indicative of simulated movement past certain predetermined locations, retail data manager 60 accesses computer network 15 and retrieves for storage in product database 40 current pricing and availability information with respect to the products located near the predetermined location. User inputs 70 may also be indicative of other user commands such as the selection of a product for purchase. When the consumer selects a product for purchase, retail data manager 60 stores some portion of consumer inputs 70 in a purchase order database 65. Retail data manager 60 then forwards at least a portion of purchase order database 65 to a merchant information system 95. Merchant information system 95 is an information processing system that supports the operations of a retail merchant, such as by tracking billing and delivery of consumers' product orders.
Retail data manager 60 also stores some portion of consumer inputs 70 in a research database 67 and later forwards at least a portion of research database 67 to merchant information system 95 for analysis and tracking of consumer purchasing behavior. Retail data manager 60 tracks consumer inputs 70 in a manner that is transparent to the consumer.
One skilled in the art will readily understand that copies of retail environment database 20, product database 40, retail data manager 60 and graphical image generator 80 may reside on multiple personal computers 10 such that multiple consumers may simultaneously generate three-dimensional images of the same virtual shopping environment. These consumers all having an image of the same virtual shopping environment may nonetheless move through different areas of the environment and view or purchase different products.
FIG. 2 shows in simplified form steps that may be performed to carry out operation of the system of FIG. 1. At step 100, the system generates a graphical image 85 of a virtual shopping mall. The virtual shopping mall is comprised of the multiplicity of retail environments the descriptions of which are stored in retail environment database 20. In the preferred embodiment, the system constructs the virtual shopping mall image from graphical images of storefronts or other symbols representing the various retail environments. Also, in step 100, the system displays on display device 90 a graphical image 85 of the virtual shopping mall.
At step 120, the consumer using input device 75 creates an input 70 indicative of selection of a first retail environment from among the plurality of retail environments within the virtual shopping mall. For example, the consumer may use a mouse to point and click on the storefront image that represents the place where the consumer wants to pursue his virtual shopping experience. Upon selection of the storefront by the consumer, retail data manager 60 receives and processes the consumer's store selection input 70.
At step 140, retail data manager 60 accesses computer network 15 and remotely retrieves from merchant information system 95 a current store layout indicator for the selected environment where more than one store layout is available. The current store layout indicator is a unique code identifying the store layout that the first merchant intends to display as its current store layout. In the preferred embodiment, a retail environment may be associated with a multiplicity of store
layouts. The store layouts may be changed in accordance with the seasonal or marketing and promotional needs of the retail merchant.
After retrieving the current store layout indicator, the system at step 160 generates and displays on device 90 a graphical image of the store layout identified by the current store layout indicator. The consumer uses the store layout image as the starting point for accessing and moving through the virtual shopping mall. The consumer experiences the virtual shopping mall by executing actions on the store layout image and other subsequently generated graphical images of shopping areas, product display areas, or products in the store. For example, the consumer may create inputs 70 indicative of selection of a shopping area, or aisle, appearing in the store layout image. Similarly, the consumer may create inputs 70 indicative of viewing of a product appearing in a product display area image.
Turning now to the flowchart of FIG. 3, the steps that may be performed by the system to generate the store layout image are described in simplified form. At step 165, retail data manager 60 uses the current layout indicator, if any, to retrieve from retail environment database 20 the store layout description associated with the store layout that the retail merchant desires to display as its current store layout. Retail data manager 60 then forwards to graphical image generator 80 the store layout description details needed to create a graphical image of the store layout. At step 170, graphical image generator 80 uses the three-dimensional modeling system described above in connection with FIG. 1 to construct the store layout graphical image. For example, graphical image generator 80 may use the modeling system to construct a three-dimensional image of a floor plan that resembles the appearance of an actual retail store from the perspective of a consumer first entering the store. The floor plan image preferably includes three-dimensional images of shelving and racks separated by spatial areas denoting aisles. In step 175, graphical image generator 80 displays the store layout image thus constructed on display device 90.
After generating and displaying the current store layout image, the system at step 180 of FIG. 2 processes the consumer's actions simulating shopping in the virtual retail environment. Retail data manager 60 receives inputs 70 operating on the store layout image and the other subsequently displayed graphical images of the retail environment and products and executes commands accordingly. For example, retail data manager 60 may retrieve from retail environment database 20 descriptions of
store layouts and other elements of the virtual environment or retrieve from product database 40 the product descriptions. Retail data manager 60 would then forward the descriptions of the retail environment and products to graphical image generator 80 for generating graphical images in accordance with the consumer's inputs 70. In response to user input 70 indicative of exiting the virtual retail environment, the system at step 190 exports to merchant information system 95 certain purchase- related information recorded during the consumer's simulated shopping experience.
One skilled in the art will readily understand that steps 120, 140, 160, 180 and 190 of FIG. 2 may be performed repeatedly. For example, at step 120, the consumer may select a second storefront from among a plurality of merchant storefronts in the virtual shopping mall. At step 140, the system will remotely retrieve from merchant information system 95 the current store layout indicator associated with the second retail environment. The system at step 160 will generate a graphical image of the current store layout for the second retail environment. At step 180, the system will process the consumer's actions simulating shopping in the second environment.
Finally, when the consumer indicates that no further action will be taken in the second environment, the system at step 190 exports to merchant information system 95 purchase-related information recorded based on the consumer's actions in the second store. FIG. 4 is a flowchart describing in a simplified manner how the system of step
180 might process consumer actions operating on the current store layout image. At step 400, the consumer creates inputs 70 indicative of simulated approach to one of the shopping areas appearing in the current store layout image. For example, the consumer may select one of the aisles in the floor plan image described above in connection with FIG. 3.
At step 420, the system generates a graphical image of the shopping area. After receiving the consumer's input 70 indicating approach to a shopping area, retail data manager 60 retrieves, from retail environment database 20, the description of the selected shopping area. In the preferred embodiment, the retail environment database comprises a description in three dimensions of the shopping area. Retail data manager 60 then instructs graphical image generator 80 to construct and display to the consumer an image, preferably three-dimensional, of the selected shopping area.
After generating and displaying the shopping area image, the system at step 440 processes the consumer's actions simulating shopping within the selected shopping area. Retail data manager 60 receives the inputs 70 related to the graphical image of the shopping area, retrieves information from retail environment database 20, and instructs graphical image generator 80 to reconstruct the display image 85 in accordance with the consumer's intended actions in the shopping area. More specifically, retail data manager 60 will retrieve from retail environment database 20 the product display area descriptions associated with the selected shopping area and preferably information about the products displayed in the shopping area. For example, retail data manager 60 may retrieve from retail environment database 20 a three-dimensional description of the shelves in a selected aisle as well as the identification and location of the products designated to appear on those shelves. Retail data manager 60 would then forward the descriptions of the shelves and products to graphical image generator 80 for generating graphical image 85 representative of a group of shelves in an aisle, those shelves having products arranged on them.
One skilled in the art will readily understand that steps 400, 420 and 440 may be performed repeatedly. For example, at step 400, the consumer may select a second shopping area from among the plurality of shopping areas within the current store layout. The system at step 420 will generate a graphical image of the second selected shopping area. At step 440, the system will process the consumer's actions simulating shopping in the second selected shopping area.
FIG. 5 is a flowchart describing in a simplified manner how the system of step 440 might process consumer actions operating on a selected shopping area. A shopping area, such as an aisle, may be associated with multiple product display areas. At step 500, the consumer creates inputs 70 indicative of simulated approach to one of the product display areas appearing in the selected shopping area. For example, the consumer may indicate an approach to a shelf or rack adjacent to the currently selected aisle. In step 520, retail data manager 60 accesses computer network 15, remotely retrieves from merchant information system 95 and stores in product database 40 current pricing, availability and other information for all of the products that can appear in the selected shopping area. In response to inputs 70 indicative of an
approach to a product display area, retail data manager 60 at step 520 also generates descriptions of all product display areas within the selected shopping area as well as indications of the categories of products that may appear therein.
At step 540, the system generates a graphical image of the product display area to which the consumer indicates an approach. In the preferred embodiment, the retail environment database comprises a description in three dimensions of the dimensions and appearance of the product display area. Retail data manager 60 forwards to graphical image generator 80 the three-dimensional description of the display area and the current price and information. Retail data manager 60 then instructs graphical image generator 80 to construct a three-dimensional image of the product display area preferably including a representation of the current pricing and other information for the products appearing in the display area. Graphical image generator 80 outputs the display area model so constructed on the consumer's display device 90. After generating and displaying the display area image, the system at step 560 processes the consumer's actions indicating selection of a product appearing in the display area. Retail data manager 60 receives inputs 70 acting on the graphical image of the display area, retrieves information from product database 40 and instructs graphical image generator 80 to reconstruct display image 85 in accordance with the consumer's selection of a product. Retail data manager 60 preferably retrieves from product database 40 a description of the dimensions and appearance in three dimensions and the current pricing for the selected product. Retail data manager 60 then forwards the product description to graphical image generator 80 for generating a three-dimensional representation of the selected product that includes a representation of the current price of product.
One skilled in the art will readily understand that steps 500, 540 and 560 may be performed repeatedly. For example, at step 500, the consumer may select a second display area from among the plurality of display areas within the currently selected shopping area. The system at step 540 will generate a three-dimensional image of the second selected display area. At step 560, the system will process the consumer's actions indicating selection of a product from the second display area.
FIG. 6 is a flowchart describing in a simplified manner how the system of step 560 might process consumer actions indicative of viewing, manipulation or purchase
of a product. At step 600, the consumer creates inputs 70 indicative of simulated viewing or manipulation of a product. For example, the consumer by manipulating input device 70 may zoom in or out to view different parts of the product image. In one embodiment, a trackball motion forward and backward may simulate viewing the front and back portions of the product. In another embodiment, selection of an icon button with the placement of a cursor on the button and the suppression of a mouse button may simulate zooming in and out on the view of the product.
At step 620, the system regenerates the three-dimensional product model in response to the consumer's inputs indicating viewing or manipulation of the product. In the preferred embodiment, retail data manager 60 instructs graphical image generator 80 to rebuild a three-dimensional image of the product display area using the three-dimensional modeling system described above in connection with FIG.l . Preferably, reconfiguration of the product model in response to user inputs 70 is achieved using the library of commands in the three-dimensional modeling system, such as those accompanying the Senseδ WorldToolKit mentioned above. The graphical image generator 80 then outputs the regenerated product model on consumer display device 90.
One skilled in the art will readily understand that steps 600 and 620 may be performed repeatedly. For example, at step 600, the consumer may create a second input indicative of a simulated viewing or manipulation of the currently selected product. The system at step 620 will regenerate the three-dimensional product model accordingly.
At step 640, the consumer creates inputs 70 indicative of the purchase of a product. In one embodiment, the consumer by manipulating the input device 70 may suppress a button to indicate an intention to buy a product. The button representative of a purchase request may be a shopping cart icon and suppression of the button would initiate the simulated movement of the product into the shopping cart. Retail data manager 60 would receive the button suppression and instruct graphical image generator 80 to regenerate the three-dimensional representation of the virtual shopping environment to simulate purchase of the product. Regeneration of the virtual environment model might involve animating a three-dimensional image of the product to move adjacent to the three-dimensional representation of the shopping cart and then disappear from the virtual environment.
Upon the consumer's indication of the intent to purchase a product, retail data manager 60 at step 660 stores information necessary to create a purchase order for the product in purchase order database 65. For example, the unique product code and an indication of quantity and price may be stored in purchase order database 65. Retail data manager 60 subsequently forwards at least a portion of purchase order database 65 to merchant information system 95.
Simultaneously, at step 680, retail data manager 60 stores the consumer inputs 70 in a research database 67. In one embodiment, for each action taken by the consumer, a date and time stamp, an indication of the action taken, and an indication of the product affected may be stored. Retail data manager 60 subsequently forwards at least a portion of research database 67 to merchant information system 95 for analysis and tracking of consumer purchasing behavior. Retail data manager 60 tracks consumer inputs 70 in a manner that is transparent to the consumer.
While the present invention is described herein with reference to illustrative embodiments for particular applications, it should be understood that the invention is not limited thereto. Those having ordinary skill in the art and access to the teachings provided herein will recognize additional modifications, applications, and embodiments within the scope thereof and additional fields in which the present invention would be of significant utility.