WO1996037068A1

WO1996037068A1 - Data conferencing between remotely located participants

Info

Publication number: WO1996037068A1
Application number: PCT/US1996/005632
Authority: WO
Inventors: Timothy L. Mccullough; Louis J. Skarda, Jr.
Original assignee: Minnesota Mining And Manufacturing Company
Priority date: 1995-05-16
Filing date: 1996-04-22
Publication date: 1996-11-21
Also published as: EP0827663A1; AU5567896A; TW428395B; JPH11505391A; CA2219130A1; CN1184577A; KR19990014756A

Abstract

A method for facilitating data communications between remotely located conference participants. Data from documents to be shared with the conference participants is converted into a database of images, which is then transferred to the remote locations. The conference leader (14) then holds a teleconference with the participants (34), during which the standard telephone line (18) being used by the participants (16, 36) is also used to transmit data commands (22, 42) which select various images (44) in the database for display on the participants' computer monitors (32).

Description

DATA CONFERENCING BETWEEN REMOTELY LOCATED PARTICIPANTS

Field of the Invention

The present invention relates generally to communications among remotely located persons, and more specifically to communications involving the transfer of visual aids among such persons engaged in a teleconference.

Background of the Invention

For many years, business people have communicated by mail, telephone, and, when required, in person. The high cost of travel (both time and money), coupled with the expanding number of suppliers, customers, and co-workers, have lead business people to look for more efficient ways of communicating. Facsimile, voice teleconferencing, and video teleconferencing are among the more popular solutions employed today.

Video teleconferencing, in theory, holds the richest form of remote electronic communications but comes with several drawbacks: the equipment is very expensive, the communication costs are very high (due to the wide bandwidth required), the interactivity is far from "the same as being there," and no clear standards exist (so company-to-company video teleconferencing is not very common). Still, the need to improve the "business conferencing" process is very real, and several products have recently become available to address the need to improve personal communications over a network. One category of such products is called "shared screen" or shared "white board." This refers to the ability to have one image area, called a white board (see FIGURE 1), shared in common on several networked computers. When using such a product, any conference participant may place an image "onto" the white board for all to see. Furthermore, any participant can draw on the white board and this drawing will show up on the other white boards. This functionality is especially useful during "brainstorming" by, for example, engineers on a design team. In this technology, the documents are usually images, not application-specific data, such as actual word processing or spreadsheet data. As such, the output of a white board conference results in a consensus among the group and a shared understanding, but not a set of data in its final form. Another category of products is called "shared application." Users jointly view and manipulate the same application data simultaneously across several computers on a network (see FIGURE 2). In this mode, any participant may make a change (for example, change the data in a spreadsheet) and everyone's data changes. The outcome of this conference is a new set of data. This is helpful in collaborative text writing or collaborative design.

Both shared screen and shared application systems can incorporate compressed video. This is often far less sophisticated than full video conferencing, but it does allow the option of viewing a speaker. This is sometimes referred to as a "talking head." Shared white boards and shared applications require a two-way data channel and a two-way voice channel. One network configuration commonly used by these systems incorporates a local area network (LAN) for the data channel and the public switched telephone network (PSTN) for voice channel (see FIGURE 3). A second configuration is to use specially equipped integrated services digital network (ISDN) for both voice and data (see FIGURE 4). A third approach is to use the PSTN exclusively. If the PSTN is used for both data and voice communication for these systems, then either two separate phone lines are utilized (FIGURE 5A) or a special voice/data modem be incorporated (FIGURE 5B).

All of these systems strive to include the following hierarchical elements of communication:

1. Image/data assisted discussions/decision making.

2. Interactivity through both voice and image/data manipulation.

3. Visual contact with the participants to allow "body language" to be included. However, in striving for "full and rich" communications, many of these solutions have several major drawbacks, such as: 1. They require specialized communication hardware, thereby impairing widespread use.

2. The solutions are essentially immobile, thereby making it difficult for a mobile worker to use the capability while traveling. 3. The solutions consume substantial communication bandwidth, thereby making routine use expensive.

4. Most solutions require the same operating system, the same application software, and the same brand of communication hardware at each computer location, thereby impairing casual use. 5. No clear standards exist, further impairing widespread use.

6. Solutions which require simultaneous data and oral communications on a single telephone line result in voice degradation and/or expensive communications hardware.

There is currently a wide gap between the current widespread use of facsimile and teleconferencing and the limited use of the above-mentioned systems. It would be desirable to have an inexpensive, easy-to-use, widely-available, system- independent, image/data assisted teleconferencing system.

Summary of the Invention The present invention includes a method for facilitating data communications between remotely located conference participants. The method begins by converting data from documents to be shared with the other participant(s) into data representing viewable images, thereby creating a database of images. This conversion process preferably includes converting the data into a platform- independent database of images. Preferably, a unique address is assigned to each of the images.

Next, a copy of the image database is transferred to each remotely located computer. This may be accomplished either by storing the database on transportable storage media and physically transporting the media to the remote location, or by transferring the database via a data modem over a communication channel to each remotely located computer. If data transmission is used, it may be desirable to scramble the transmission to ensure that the secrecy of the data is not compromised.

During the teleconference, various images from the database copies are displayed on each remotely located computer monitor. The selection of which image from the database to be displayed is controlled by issuing data commands over the same telephone line that is being used to transmit the oral discussion between the conference participants. These data commands can also be used to highlight a portion of the image displayed on each monitor.

The present invention offers a low-cost, simple system for conducting a teleconference accompanied by graphic displays on the computer monitors of the conference participants. Because the images to be displayed have been previously sent to each of the participants, either via physical transfer of storage media or via data transmission, the conference leader (or presenter) can control which image is displayed on the participants' monitors by using a data command over the same telephone line being used to transmit the oral discussion among the participants. Since the images are already stored at each remote location, the transmission of the data command which controls the remote visual aids need be no longer than 2 seconds, and is more preferably less than 1 second. In one preferred embodiment, a data command lasts between 0.03 and 0.6 seconds. Although the transmission of the data commands interrupts the oral discussion among the participants with an audible signal, the brief duration of the interruption results in minimal interference with the discussion.

In one embodiment, the 300 bit/sec low-speed channel available in most standard modems is used to transmit data commands from the presenter to select a specific visual aid in the database to be displayed on each monitor. Oral discussions between the presenter and one, two, or more participants may be conducted via standard telephone lines.

The system of the present invention is convenient in that it uses pre-existing telephone lines and industry standard facsimile modems. By using a platform- independent database of images, a conference call may be conducted regardless of what type of computer system each participant has. Thus, compatibility of computer systems among the participants is not required.

Brief Description of the Drawing FIGURE 1 shows a prior art shared screen approach to teleconferencing.

FIGURE 2 shows a prior art shared application approach to teleconferencing.

FIGURE 3 shows a prior art approach to teleconferencing using a local area network and a public switched telephone network. FIGURE 4 shows a prior art approach to teleconferencing using a specially equipped ISDN network for both voice and data.

FIGURE 5A shows a prior art approach to teleconferencing using a public switched telephone network having separate phone lines for voice and data communication. FIGURE 5B shows a prior art approach to teleconferencing using a public switched telephone network having a special voice/data modem.

FIGURE 6 shows how source data is converted to an image database according to the present invention.

FIGURE 7 shows how copies of the image database are transmitted to remotely located computers according to the present invention.

FIGURE 8 shows how the presenter sends a data command to bring up the various stored visual aids onto a participant's computer monitor according to the present invention.

FIGURE 9 shows how two systems could be used to share visual aids during a voice teleconference according to the present invention.

FIGURE 10 shows how a single channel of a public switched telephone network can be used to transmit both voice and data according to the present invention. Detailed Description

The present invention is directed to a system which allows remotely located conference participants to present pertinent visual aids at each other's location while conducting a conversation via telephone. The system can operate over a single public switched telephone network (PSTN) line and is compatible with the vast, currently-existing base of computers, irrespective of operating system. The system is also far less expensive than conventional video conferencing.

The system operates as follows. A database representing viewable images to be used as computer-based visual aids is created. In one embodiment of the present invention, the database is converted into a platform-independent database of images. This conversion process may be accomplished by any of a variety of software programs, such as "Adobe's Acrobat" available from Adobe Systems, Inc., in Mountain View, California, U.S.A.

Each of the images is then assigned a unique address comprising, for example, the sender's user identification code and the numerical code in which the images were converted (see FIGURE 6). This allows the images to be uniquely referenced in both point-to-point and broadcast operation.

Next, a copy of the database is transferred to each of the remote locations with which the sender wishes to communicate (see FIGURE 7). This may be accomplished by either storing the images on media and physically transporting the media to the remote locations, or by transferring the copy of the database over a communication channel between the remote locations with the aid of a high speed modem. An example of such a modem is a standard 14,400 data/fax modem available from 3M in St. Paul, Minnesota. Because the data can be highly compressed, the information transfer can be faster than facsimile transfer. The transferred image is also of greater quality than if transferred via facsimile, and may also be in full color. If the image data being transferred via modem is of a confidential nature, it may be desirable to scramble the image database. After the database has been transferred to the remote locations, copies of all the stored images reside in the remote computers) and each image is uniquely addressable with a short code. A normal voice teleconference can now be held among the participants and when the conference leader or speaker wishes to refer to a document to make a point, the speaker, using his/her computer, broadcasts a short data command to the remote location(s) which brings up the image on each participant's computer monitor (see FIGURE 8). Since only a brief data command is required, the command can be effectively communicated by a modem operating in a low speed asynchronous character transfer mode, e.g., 300 bits/second. The data command will be very brief in duration and can be sent within the voice band. The participant will hear a brief audible signal similar to a "beep" immediately preceding each new image. Since the data command is short, voice conversation will have use of the full bandwidth, thereby providing the best voice fidelity that the channel can support, except during the short interval when the data command is being transmitted. (Simultaneous voice/data modems share the bandwidth between voice and data and thus degrade the quality of the voice.) The data commands may be communicated by public switch telephone network using 300 bits/second as defined by International Telecommunications Union (ITU) V.21 standard modulation in standard facsimile modems, such as one available from 3M Company, St. Paul, Minnesota.

To simplify this task, the software at the speaker's computer would provide a user interface which would show him/her, as shown in FIGURE 8: 1) a list of

"thumbnail size" images 2 that had been previously sent (to aid in selecting an image to refer to), 2) a "speaker panel" 8 to manage the flow of images, and 3) a blow-up

4 of the image currently being referred to. This application software would be resident in each computer. The operational steps would be as follows. Referring to FIGURE 9, one of the telephone participants, speaker or caller 14, on first computer system 12 would initiate a conference by dialing a telephone number either manually by handset or speaker phone 16, or automatically by modem 22. At the receiving end, participant

34 on second computer system 32 would be notified that an image assisted teleconference, i.e., a data conference, is desired. Participant 34 would activate appropriate software in second computer system 32, and from that point onward all operations at participant's end would be automatically controlled by caller 14.

First computer system 12 would send the database to system 32 over PSTN 18 using modem 22. Caller 14 and participant 34 would then hold a normal conversation using handset or speaker phones 16 and 36.

During the conversation, caller 14, referring to a thumbnail sized array of images 24, would use caller controls 28 to select a pertinent image 26 to be pulled up and displayed by the software on computer system 32. This would be accomplished as follows. Software in computer system 12 would identify the address of selected image 26 from displayed image array 24 on the monitor of computer system 12 and send a coded command from modem 22 to modem 42 at system 32. The software in system 32 would locate the selected image in the database and would display it as image 44 on the monitor of system 32.

Connector 20 is a common, widely-used device for tying handset 16 and modem 22 into PSTN 18. Similarly, connector 40 is a common, widely-used device for tying speaker phone 36 and modem 42 into PSTN 18.

Caller 14 may also elect to use caller controls 28 to highlight a portion of image 44 on the monitor of system 32. This might be done by caller 14 to emphasize to participant 34 the importance of a specific portion of image 44. In this case, the software in computer system 12 would transmit the command to the software in computer system 32, which would highlight the appropriate part of image 44 on the monitor of computer system 32.

If participant 34 desired to print image 44 on a printer attached to computer system 32, the participant would communicate this desire orally via PSTN 18. Caller 14 would then have the capability to either deny the request or release image 44 for printing. In the absence of such a request, image 44 will be automatically erased by the software in computer system 32 when the telephonic connection is terminated at the end of the teleconference. Caller 14 could also transfer control of the presentation to one of the participants if the caller so desires, so long as the participants have the appropriate software. Since image data is sent prior to using the phone line for voice, one PSTN connection can be used for both voice and data (see FIGURE 10).

The system of the present invention has the following unique features:

1. It provides interactive, image-assisted teleconferencing with multiple locations over one voice circuit on the public switched telephone network (this includes cellular telephones operating on the public network).

2. It provides image-assisted teleconferencing between dissimilar computers and dissimilar operating systems.

3. It encourages widespread use since it is backward compatible with most existing systems.

4. It is completely upwardly compatible with LAN and simultaneous voice/data modems.

5. It is likely to be compatible with future computer hardware and software since it can work in conjunction with, and not in competition with, white board shared application and full video technologies.

Those skilled in the art will appreciate that the present invention is not limited to the embodiments described above. For example, although FIGURE 9 shows a single caller 14 and a single participant 34, two or more such participants may also be included. Similarly, although FIGURE 9 shows only one caller 14 and one participant 34, participant 34 might also be a "presenter" or "caller" to caller 14. Thus, while caller 14 may have sent a copy of one image database to participant 34, participant 34 may have also sent a copy of another image database to caller 14. Thus, while caller 14 controls which images in the first database are being shown on the monitor of participant 34, "participant" 34 controls which images in the other database may be shown to "caller" 14.

Claims

What is claimed is:

1. A method for facilitating interpersonal communications between remotely located conference participants (14, 34), each participant having access to a computer (12, 32) and a monitor associated therewith, including the steps of:

(a) creating a database representing viewable images to be used as computer-based visual aids to be shared with at least one remotely located conference participant (34);

(b) transferring a copy of the database to each remotely located computer (32);

(c) displaying the visual aids (44) from the database copy on monitors associated with each remotely located computer; and

(d) using a single standard telephone line (18) to both (i) transmit oral comments (16, 36) from one participant to another, and (ii) transmit audible signals representing data commands to select a specific visual aid within each remotely located database copy to be displayed on each monitor, wherein the transmission of oral comments is temporarily overridden by the audible signals, wherein each audible signal lasts less than 2 seconds.

2. The method of claim 1, wherein step (d) includes issuing data commands that highlight a portion of the image displayed on each monitor.

3. The method of claim 1, wherein the database is a platform- independent database.

4. The method of claim 1, further including the step, after step (b), of retrieving the visual aids based on their unique address.

5. The method of claim 1, wherein each audible signal has a duration between 0.03 and 0.6 seconds.

6. The method of claim 1, wherein step (b) is accomplished by storing the copy of the database of images on transportable storage media and physically transporting the media to each remotely located computer.

7. The method of claim 1, wherein step (b) is accomplished by transferring the database of images over communication channels connecting the remotely located computers via a standard modem (22, 42).

8. The method of claim 1, wherein the data commands issued in step (d) include controlling which of the images being displayed on each monitor can be released for printing at the location of each monitor.

9. A method for facilitating interpersonal communications between a presenter (14) and at least one remotely located conference participant (34), the presenter and each participant having access to a computer (12, 32) and monitor associated therewith, including the steps of:

(a) creating a database representing viewable images to be used as computer-based visual aids to be shared with at least one remotely located conference participant;

(b) transferring a copy of the database from the presenter to each remotely located computer via modem;

(c) displaying the visual aids (44) from the database on monitors associated with each remotely located computer; and (d) operating a modem (22, 42) in a standard 300 bit/sec low-speed mode to transmit data commands from the presenter to select a specific visual aid in the database copy to be displayed on each monitor; and (e) transmitting oral comments (16, 36) between the presenter and each participant via standard telephone lines (18).

10. A method for facilitating interpersonal communications between a presenter (14) and at least one remotely located conference participant (34), the presenter and each conference participant having a computer (12, 32) and monitor associated therewith, including the steps of: (a) creating a database representing viewable images to be used as computer-based visual aids to be shared with at least one remotely located conference participant; (b) transferring a copy of the database from the presenter to each remotely located computer; (c) displaying the visual aids (24) from the database on the presenter's monitor and from the database copy (44) on monitors associated with each remotely located computer; and

(d) using a single standard telephone line (18) to both (i) transmit oral comments (16, 36) between the presenter and each participant, and (ii) transmit data commands from the presenter to select a specific visual aid in the database to be displayed on each monitor, wherein only the presenter can issue the data commands unless the presenter transfers such control to another conference participant.

11. The method of claim 10, wherein there are at least two conference participants.