WO2008106088A2

WO2008106088A2 - Method and system for facilitating commercial transactions using a telepresence robot

Info

Publication number: WO2008106088A2
Application number: PCT/US2008/002465
Authority: WO
Inventors: Roy Sandberg; Dan Sandberg
Original assignee: Roy Sandberg; Dan Sandberg
Priority date: 2007-02-27
Filing date: 2008-02-26
Publication date: 2008-09-04
Also published as: WO2008106088A3

Abstract

A method for using a telepresence robot for commercial transactions.

Description

Method and System for Facilitating Commercial Transactions Using a Telepresence Robot

BACKGROUND OF THE INVENTION

(1) Field of Invention

The present invention is related to the field of telepresence robotics, more specifically, the invention is a method for using a telepresence robot for commercial transactions.

(2) Related Art

Many commercial transactions require parties to the transaction to coexist in the same physical space. For example, the purchase of goods at a brick-and-mortar store requires that the shopper and sales clerk both be present at the same physical location. While commercial transactions using the World Wide Web are known in the art as a means to avoid the collocation of parties to the commercial transaction, use of the World Wide Web is limited to transactions that can be implemented with a web browser and web server. For example, a web site with a "shopping cart" must be designed and implemented, and the items for sale must be pictured or otherwise described. This represents a burden on the owner of a conventional store, who must implement a website with these features. Additionally, the store owner typically has a trained sales force, and their persuasive skills will not play a role in convincing customers to purchase when those customers purchase via the web site.

SUMMARY OF THE INVENTION

This patent application incorporates by reference copending application 11/223675 (Sandberg). Matter essential to the understanding of the present application is contained therein.

This application claims the benefit of U.S. Provisional Application No. 60/904152 ("Method for facilitating commercial transactions using a telepresence robot", Sandberg), filed 02/27/07, and included herein by reference.

This application also claims the benefit of U.S. Provisional Application No. 60/919117 ("Mobile Videoconferencing Bridge Between Real and Virtual Worlds", Sandberg), filed 03/20/07, and included herein by reference.

The present invention provides a method for enabling non-collocated parties to undertake a commercial transaction without significant modification to the underlying process of the transaction itself. No special website is needed, and existing salespersons can be used in a traditional manner.

In all the methods discussed below, a telepresence robot, as discussed in copending application 11/223675 (Sandberg) is used to enable an individual to maintain a presence at distant location. The telepresence robot allows the individual to see, hear, be seen, and speak at a remote location. An individual uses the telepresence robot by connecting to it using a standard personal computer or hand-held computer (equipped with a microphone, speakers, and a video camera) running a client application. Using the client application, the individual is able to move the telepresence robot about the remote location.

In the preferred method, a remote shopper logs into a telepresence robot, the telepresence robot being located in a location where a purchase may take place, such as a store, art gallery, flea market, bank, accounting firm, law office, or other locations where commercial transactions are known to occur. The remote shopper then navigates the telepresence robot to peruse the merchandise and/or speak with a salesperson or other individual in a position to offer a product or service. Interacting in a manner typical of the commercial transaction when it occurs without a telepresence robot (i.e., in person), the remote shopper may then finalize the commercial transaction using a credit card number or other purchasing technique that does require an exchange of cash such as the PayPal™ service or a checking account number. Alternatively, the customer may, after speaking with the salesperson or other individual in a position to offer a product or service, elect to finalize the purchase using techniques known in the art of commercial website design. For example, after verifying that the product meets his expectations, the customer might log into an existing website and purchase the product from the store in question. In the event that merchandise is being purchased, the remote shopper and/or individual collocated with the telepresence robot may arrange for the merchandise to be shipped to a location specified by the remote shopper or held for later pickup by the remote shopper.

Alternatively, items that the customer is interested in purchasing could be manually or automatically added to the customer's shopping cart using techniques known in the art. In one embodiment of this, a user would type in a product ID number to add the product of interest to their shopping cart. In another embodiment, the robot would have a barcode scanner or other product id reading technology and could automatically add the product to their shopping cart. In another embodiment, the salesperson could scan the product using a scanner built into the robot, or a scanner belonging to the store, thereby adding the product to the user's shopping list.

Using this method, an individual located far from the service or product being offered may purchase the service or product without any change in the process underlying the commercial transaction, except that shipping may need to be arranged, as the shopper would not be present to carry the goods purchased home.

In an alternative method, a commercial transaction is facilitated through the use of a telepresence robot used by the provider of commercial goods or services. Using this method, a provider of a commercial good or service contracts with or hires a remote worker to remotely control a telepresence robot. Using the telepresence robot, the remote worker may then perform functions that facilitate a commercial transaction, such as greet shoppers, assist with sales questions, help shoppers find particular goods, or advise a client on the specifics of a particular service. By using a remote worker to perform these tasks, the merchant or service provider that has hired the remote worker is able to hire the worker at lower cost, thus saving money and lowering the cost of the commercial transaction.

In yet another alternative embodiment, a commercial transaction is facilitated by enabling a remote customer to hear and view subject matter of interest to them for a fee. Specifically, a customer may log into a telepresence robot located at a museum, tourist site, or other location where a fee is charged to observe and listen to matters of interest. Using a credit card or other cashless purchasing technique, or using techniques known in the art of commercial website design, a remote customer may pay for the right to hear and observe the subject matter. In the preferred embodiment, the payment is arranged using the client application running on the customer's computer. Specifically, upon connecting to a telepresence robot located in a facility that charges for the use of the telepresence robot, the client application displays billing information to the customer, who may then elect to pay for the service, or to hangup. Once payment is made (using cashless purchasing techniques known in the art of website design), the customer then has control over the telepresence robot, and may move the telepresence robot about the remote location. Prior to payment, the customer has access to a subset of normal telepresence robot capabilities. The customer may only see a request for payment on the client application screen, or he may be able to see the view at the remote location but not control the telepresence robot, or he may be able to control the pan and tilt angle of the telepresence robot but not move the telepresence robot, or he may be able to hear sounds from the remote location, but not see the remote location or move the telepresence robot. Other permutations are also possible, but the common idea is that the telepresence robot is not fully functional until after payment has been made. Via this method, a museum, tourist site, or other location where a fee is charged to observe and listen to matters of interest may facilitate commercial transactions with remotely located individuals who might not otherwise visit the location in question.

In another alternative embodiment a commercial transaction is facilitated by enabling a remote customer to tour a company's premises remotely using a telepresence robot prior to making a financial commitment. Via this method, a remotely located customer may tour a factory, laboratory, or other workspace to establish trust and report prior to making a purchase. A specific example would be use by a foreign factory to assure customers that their facilities are consistent with industry standards. By catering to the needs of potential customers, the factory, laboratory, or other workspace facilitates the closure of a commercial transaction.

In another alternative embodiment, a commercial transaction is facilitated by enabling a remote customer to see and speak with people of interest using a telepresence robot. For example, a customer may pay a fee (using a credit card or other cashless purchasing technique, or using techniques known in the art of commercial website design) to view and speak with their child at a daycare facility or school. Alternatively, the school or daycare facility may enable the remote customer to see and speak with their child at no cost as an enticement to enroll their child in the school or daycare facility. This technique may also be used in other places where people congregate such as religious establishments (for example churches, synagogues, temples, and mosques), hospitals, nursing homes, prisons, and psychiatric wards.

In another alternative embodiment, a commercial transaction is facilitated by enabling team members to collaborate at a distance using a telepresence robot. In one specific embodiment, a worker utilizes the telepresence robot to build rapport with team members who work at a different location than the worker. In another specific embodiment, a manager utilizes the telepresence robot to oversee workers who work at a different location than the manager. By enabling closer collaboration of employees and contractors who operate at a distance from each other, an organization operates at greater efficiency and commercial transactions are thus facilitated. In another alternative embodiment, a commercial sale of a telepresence robot is facilitated through the use of a telepresence robot. A prospective customer downloads a client application to a personal computer with a web-cam, using the Internet. By running the client application, which may be pre-configured to automatically connect to a specific telepresence robot or group of telepresence robots, the prospective customer is able to control a telepresence robot from his location. The telepresence robot is located in a sales office affiliated with the seller of the telepresence robot. A salesperson is colocated in the same room as the telepresence robot, and he/she guides the prospective customer in the use of the telepresence robot using the audio and video communication channels established by the client-to-robot connection. The salesperson may also demonstrate the usability of the telepresence robot by writing on a whiteboard, or by directing the prospective client to look at the telepresence robot in a mirror. A eye chart may also be used to demonstrate the acuity of the telepresence robot camera. The salesperson also informs the prospective customer how the telepresence robot may be purchased, and assist with the purchase if necessary.

In another alternative embodiment of the invention, the telepresence robot user is embodied on the telepresence robot as an avatar. In the preferred embodiment of this invention, the user controls the robot from within a virtual world, and the avatar displayed on the telepresence robot screen takes the same visual appearance as an avatar used by the user within the virtual world.

Therefore, this embodiment of the invention discloses a method and apparatus for entering the real world from within a virtual world. Entering the real world from a virtual world would be useful both for entertainment purposes, and for business purposes. For example, a company might have a location in the virtual world that is used for advertising. Interested visitors to the company's virtual world location could, from within the virtual world, "inhabit" a remote presence at the actual real company location. This would allow an interested customer, while logged in to a virtual world, to speak directly with a real salesperson about that company's products, and receive a tour of the company's facilities. In another example, a room in a virtual world could be used to monitor the performance of real-life factories spread around the world. "Portals" accessible from this control-room could be used to "jump" directly to the physical locations of the real-life factories. In this way, it would be easy to monitor the performance of a factory, fab, store, construction site, or office. The ability to be physically present . when required or necessary makes business collaboration in a virtual world more useful and effective, thereby facilitating commercial transactions.

In the preferred embodiment, controls necessary to operate a mobile video conferencing device are made available through the user interface for a virtual world simulator client application. By using these controls, a user of a virtual world can drive a mobile video conferencing device through a real world location, and may interact with persons that are present there. In the preferred embodiment, the controls to operate the video conferencing device in the real world are the same as are used to move avatars within the virtual world. This enables a easy transition from virtual to real environments by a user of the virtual world simulator.

In an alternative embodiment, a "virtual" mobile video conferencing device is created within the virtual world and used as an avatar. This device includes a live streaming video of a first user, captured using a video camera, and streaming to a computer hosting the virtual world. A live audio stream from the first user, captured using a microphone, is also streamed to a computer hosting the virtual world. The streaming video is displayed within an avatar representing the user. In the preferred embodiment, the avatar looks like a mobile video conferencing device. In an alternative version, a streaming video is placed within any object in the virtual world, where the object acts as an avatar. The live audio is played such that a second user of the virtual world perceives the audio to be emanating from the avatar. The avatar could also look like a conventional human-form avatar, with the avatar's face replaced by the user's real face captured by their webcam. Via this technique, a second user cohabiting the virtual world with the first user, perceives the first user to be driving a mobile video conferencing device through the virtual world.

Techniques known in the art to stream audio and video for multi-user video conferences are used to implement this embodiment of the invention. The video data, prior to being output to the screen, is manipulated to fit on the virtual screen of the avatar. This manipulation may consist of a number of operations such as zooming, translation, and affine transformation known in the art of computer graphics for creating a proper 3D perspective on a 2D display surface.

In summary, this invention describes a method for facilitating a commercial transaction, comprising: establishing a digital communication channel between a computer terminal and a telepresence robot, remotely controlling the location of the telepresence robot; and transacting for the sale of a good or service using communication channels present on the telepresence robot.

This invention may also include the case wherein a shopper controls the telepresence robot. Also, an employee or contractor of a provider of goods or services may control the telepresence robot. Alternatively, a potential telepresence robot customer may use the telepresence robot to trial the features offered by the telepresence robot. In another variation of the invention, a customer pays for the right to use the telepresence robot to see and hear subject matter present at the location of the telepresence robot.

Another aspect of the invention consists of a method for facilitating a commercial transaction, comprising: establishing a digital communication channel between a computer terminal and a robotic telepresence device, remotely controlling the location of the robotic telepresence device, transacting for a sale of a good or a service using communication channels present on the telepresence robot, and purchasing the good or service by selecting a choice from a user interface present on the computer terminal.

The invention may also be described as a system for facilitating a commercial transaction, comprising: a computer terminal connected to a digital communications channel, a robotic, audio- visual, remotely-controllable, mobile telepresence device connected to the digital communications channel and tranceiving audio- visual and control data through the digital communications channel to the computer terminal, and a purchasing module located on the computer terminal, whereby a good or service located at the location of the telepresence device can be purchased by selecting a choice from a user interface.

In another embodiment of the invention, a system for facilitating a purchase of a telepresence robot is disclosed, comprising: a computational device connected to a digital communications channel, a telepresence robot control system, downloadable via an Internet connection and executing on the computational device an audio- visual, remotely-controllable, mobile telepresence robot connected to the digital communications channel and tranceiving audio- visual and control data through the digital communications channel to the telepresence robot control system, a telepresence robot prospective customer, controlling the telepresence robot using the telepresence robot control system, and a telepresence robot salesperson colocated with the telepresence robot, selling the telepresence robot to the telepresence robot prospective customer.

The invention also describes a method for conveying facial expressions within a virtual world, comprising the steps of: accepting a live video stream from a live video stream source, displaying the live video stream within an avatar in the virtual world, and enabling members of the virtual world to see the avatar and the live video stream within the avatar.

Also described is a method for entering a real world from within a virtual world, comprising the steps of: displaying a representation of a user on a mobile video conferencing device, and controlling the mobile video conferencing device using a user interface.

This method may also be used when the representation of the user is a video stream from the user's camera. Also, the method may be used where the user interface is part of a virtual world client program. DETAILED DESCRIPTION OF THE DRAWINGS

FIG. 1 is a exemplary embodiment of the invention, shown facilitating a purchase in an art gallery.

FIG.2 is an alternative embodiment of the invention, shown assisting a customer with a merchandise selection.

FIG. 3 is an alternative embodiment of the invention, shown as a means to promote the sale of telepresence robots.

FIG. 4 is a exemplary embodiment of the invention, shown as viewed within a virtual world.

DETAILED DESCRIPTION OF THE INVENTION

The present invention is related to the field of remote presence, more specifically, the invention is a method for using a telepresence robot for commercial transactions.

An alternative embodiment discloses a method and apparatus for entering the real world from within a virtual world.

An alternative embodiment of the invention is a method and apparatus for conveying a user's true facial expressions within a virtual world.

FIG. 1 is a exemplary embodiment of the invention, shown facilitating a purchase in an art gallery. A first 101 and second telepresence robot 102 are shown in an art gallery 103. Two docking stations 104 for the telepresence robots are also present in the gallery. The first telepresence robot is controlled by a user who can be seen on the screen 105. The second telepresence robot is controlled by user from within a virtual world, and the user is shown on the screen as his virtual world avatar 106. An avatar representing the controlling user 106 is shown on the LCD screen 107. The controlling user may drive the device though the real environment using the same controls that are present to move an avatar in the virtual environment. A man 108 and a woman 109 are shown in the environment. They may interact with both telepresence robots.

FIG.2 is an alternative embodiment of the invention, shown assisting a customer with a merchandise selection. A telepresence robot 201 is shown in a computer store 202. A salesperson 203 is present in the store. The remote user 204 is shown perusing the merchandise 205. The salesperson 203 is assisting the remote user. Via this means the remote user can shop in a brick-and-mortar store and be assisted by traditional sales staff.

FIG. 3 is an alternative embodiment of the invention, shown as a means to promote the sale of telepresence robots. In the figure a telepresence robot 301 is shown in a demonstration room 302. The robot is being remotely piloted, and the remote user is interacting with a salesperson 303. In the preferred embodiment of the invention, mirrors 304 are placed in the room so that the remote user may look at the robot he/she is piloting. In the preferred embodiment, a whiteboard 305 is used so that the salesperson may demonstrate the visual acuity of the robot camera. An eye chart 306 may also be used for this purpose. Multiple remote users may be present in the demonstration room using multiple telepresence robots 307. More than one salesperson 308 may also be present to interact with these users. The room may be closed off, or low barriers may be placed at the room exits so that the telepresence robots are prevented from entering areas other than the demonstration room.

FIG. 4 is a exemplary embodiment of the invention, shown as viewed within a virtual world. A view within a virtual world 401 is shown on a computer screen 402. A virtual mobile video conferencing device 403 is shown as viewed within the virtual world educational setting. Live streaming video 404 is displayed on the device's virtual screen 405. The virtual mobile video conferencing device may move through the virtual environment. The virtual mobile video conferencing device is visible by the viewer of the computer screen, as well as other members of the virtual world 406. The user represented by a virtual mobile video conferencing device avatar views and moves through the virtual world in the same manner as they would with any other avatar. In this example, the virtual mobile video device shows the face of an instructor, who can then convey information more accurately to the students, represented as avatars, because they can read his facial expressions more accurately than if he was represented without streaming real-time video of his facial expressions.

Advantages

What has been described is method for using a telepresence robot for commercial transactions.

The method and apparatus allows a user to facilitate a commercial transaction. Specifically, an individual located far from the service or product being offered may purchase the service or product without any significant change in the process underlying the commercial transaction. Alternatively, a merchant or service provider may utilize a remote worker operating a telepresence robot to facilitate a commercial transaction, thus saving money and lowering the cost of the commercial transaction. Alternatively, a museum, tourist site, or other location where a fee is charged to observe and listen to matters of interest may facilitate commercial transactions with remotely located individuals that operate a telepresence robot at the location. The remotely located user may optionally have connected to the museum, tourist site, or other location from within a virtual world.

Alternatively, a remotely located customer may tour a factory, laboratory, or other workspace to establish trust and report prior to making a purchase. Alternatively, the telepresence robot may be used to facilitate closer collaboration of employees and contractors who operate at a distance from each other, thereby enabling greater organizational efficiencies.

While certain exemplary embodiments have been described in detail and shown in the accompanying drawings, it is to be understood that such embodiments are merely illustrative of and not restrictive on the broad invention, and that this invention is not to be limited to the specific arrangements and constructions shown and described, since various other modifications may occur to those with ordinary skill in the art.

Claims

What is claimed:

1. An method for facilitating a commercial transaction, comprising:

(a) Establishing a digital communication channel between a computer terminal and a telepresence robot;

(b) remotely controlling the location of the telepresence robot; and

(c) transacting for the sale of a good or service using communication channels present on the telepresence robot.

2. The method of claim 1, wherein: a shopper controls the telepresence robot.

3. The method of claim 1, wherein:

An employee or contractor of a provider of goods or services controls the telepresence robot.

4. The method of claim 1, wherein: a potential telepresence robot customer uses the telepresence robot to trial the features offered by the telepresence robot.

5. The method of claim 1, wherein:

A customer pays for the right to use the telepresence robot to see and hear subject matter present at the location of the telepresence robot.

6. A method for facilitating a commercial transaction, comprising:

(a) Establishing a digital communication channel between a computer terminal and a robotic telepresence device;

(b) remotely controlling the location of the robotic telepresence device;

(c) transacting for a sale of a good or a service using communication channels present on the telepresence robot; and

(d) purchasing the good or service by selecting a choice from a user interface present on the computer terminal.

7. A system for facilitating a commercial transaction, comprising:

(a) a computer terminal connected to a digital communications channel;

(b) a robotic, audio- visual, remotely-controllable, mobile telepresence device connected to the digital communications channel and tranceiving audio-visual and control data through the digital communications channel to the computer terminal; and

(c) a purchasing module located on the computer terminal, whereby a good or service located at the location of the telepresence device can be purchased by selecting a choice from a user interface.

8. A system for facilitating a purchase of a telepresence robot, comprising:

(a) a computational device connected to a digital communications channel;

(b) a telepresence robot control system, downloadable via an Internet connection and executing on the computational device;

(b) an audio- visual, remotely-controllable, mobile telepresence robot connected to the digital communications channel and tranceiving audio-visual and control data through the digital communications channel to the telepresence robot control system;

(c) a telepresence robot prospective customer, controlling the telepresence robot using the telepresence robot control system; and

(d) a telepresence robot salesperson colocated with the telepresence robot, selling the telepresence robot to the telepresence robot prospective customer.

9. A method for conveying facial expressions within a virtual world, comprising the steps of:

(a) accepting a live video stream from a live video stream source;

(b) displaying the live video stream within an avatar in the virtual world; and

(c) enabling members of the virtual world to see the avatar and the live video stream within the avatar.

10. A method for entering a real world from within a virtual world, comprising the steps of:

(a) displaying a representation of a user on a mobile video conferencing device; and

(b) controlling the mobile video conferencing device using a user interface.

11. The method of claim 10, wherein:

(a) the representation of the user is a video stream from the user's camera;

12. The method of claim 10, wherein:

(a) the user interface is part of a virtual world client program.