WO1996041476A1 - Videoconferencing and multimedia system - Google Patents

Videoconferencing and multimedia system Download PDF

Info

Publication number
WO1996041476A1
WO1996041476A1 PCT/US1996/010017 US9610017W WO9641476A1 WO 1996041476 A1 WO1996041476 A1 WO 1996041476A1 US 9610017 W US9610017 W US 9610017W WO 9641476 A1 WO9641476 A1 WO 9641476A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
node
video
processor
control
Prior art date
Application number
PCT/US1996/010017
Other languages
French (fr)
Other versions
WO1996041476A9 (en
Inventor
Earl A. Gregory, Iii
R. Dean Heibert
Mark Fauth
Aleksandr Shkiler
Original Assignee
Imagetel International, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Imagetel International, Inc. filed Critical Imagetel International, Inc.
Priority to AU61704/96A priority Critical patent/AU6170496A/en
Publication of WO1996041476A1 publication Critical patent/WO1996041476A1/en
Publication of WO1996041476A9 publication Critical patent/WO1996041476A9/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/15Conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/56Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H04M3/567Multimedia conference systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals

Definitions

  • the invention relates to a videoconferencing and multimedia system for bi-directional transmission of voice, image data and other data among geographically distributed users.
  • ISDN integrated services digital network
  • the increased bandwidth associated with digital access systems has allowed for nearly full motion videoconferencing on larger display devices; however, many of these digital videoconferencing systems continue to transmit video information as "jerky motion" and not smooth video.
  • the audio system associated with many of these devices is not a two-way system, that is, a conferee is interrupted and his or her voice is no longer audible if another conferee speaks simultaneously.
  • a need remains for improvement of a videoconferencing system to allow for smooth video and bi ⁇ directional audio. Further, a need exists for improved integration of the videoconferencing system with multimedia devices for sending, for example, graphic information, as well as audio and video data over a digital network. In particular, a need exists for a videoconferencing system wherein documents and other data can be shared during a videoconference without using bandwidth that is necessary for the transmission of audio and video data.
  • a videoconferencing system which comprises a processor; at least one device connected to the processor selected from a group consisting of an audio device and a video device, the device being controlled in accordance with at least one signal type selected from a group consisting of logic-level signals, serial infrared signals and analog control signals; a control circuit connected to the processor, the processor being programmable to generate a command signal and provide the command signal to the control circuit, the control circuit being configured to process the command signal and to generate an output control signal in accordance with the command signal for transmission to the device and being at least one of the plurality of signal types that is compatible with the device.
  • a videoconferencing system which comprises first and second nodes each having at least one audio input device, at least one video input device, at least one audio output device, at least one video output device and a processor, the second node being operable to receive audio and video data generated by the audio input device and the video input device of the first node and to transmit to the first node audio and video data generated by the audio input device and the video input device of the second node; an audio and video data communication link connected to the first node and to the second node; and a control data communication link connected to the first node and to the second node and operable in parallel with the audio and video data communication link.
  • the processor of the first node is programmable to transmit audio and video data generated by its corresponding audio input device and video input device to the second node on the audio and video data communication link, and to generate and transmit control data to the second node on the control data communication link.
  • the processor of the second node is programmable to transmit audio and video data generated by its corresponding audio input device and video input device to the first node on the audio and video data communication link, and to generate and transmit control data to the first node on the control data communication link.
  • a videoconferencing system which also comprises at least one data input device connected to the first node for generating data to be transmitted to the second node during a videoconference; and an information transfer communication link connected to the first node and to the second node and operable in parallel with respect to the control data communication link.
  • the processor in the first node is programmable to transmit the data generated by the data input device to the second mode outside the bandwidth of the audio and video data during a videoconference via the information transfer communication link.
  • Fig. 1 depicts two videoconferencing systems constructed in accordance with an embodiment of the present invention and located at local and remote videoconference sites, respectively;
  • Fig. 2 is a schematic block diagram of the videoconferencing system depicted in Fig. 1;
  • Fig. 3 is a schematic block diagram of a videoconferencing system constructed in accordance with another embodiment of the present invention.
  • Fig. 4 is an illustration of an infrared and logic- level control device for a videoconferencing system in accordance with an embodiment of the present invention
  • Fig. 5 is a schematic diagram of the infrared and logic-level control board depicted in Fig. 4 and constructed in accordance with an embodiment of the present invention
  • Fig. 6 is a block diagram of network for supporting a videoconferencing system in accordance with an embodiment of the present invention.
  • Fig. 7 is a schematic block diagram of two nodes in the network depicted in Fig. 6 and constructed in accordance with an embodiment of the present invention.
  • FIG. 1 depicts a videoconferencing system 10 located at local videoconference site 12 and constructed in accordance with the present invention, which is in communication with at least one other videoconferencing system 10 located at a remote videoconference site 14.
  • the videoconferencing system 10 comprises a camera 16, a projector 18 and screen 20, at least one microphone 22, at least one speaker 24, a user interface 26 such as a touch screen and a control unit 28.
  • the control unit controls these devices, as well as processes audio, video and other data that is received from the remote videoconference site 14 or is about to be transmitted thereto.
  • the system 10 can also comprise a network interface 30 to, for example, a local area network (LAN), at least one auxiliary audio source 32, at least one auxiliary video source 34, a facsimile modem 38, and other multimedia devices such as a graphic image display 40 or video tape recorder (VCR) 42.
  • LAN local area network
  • auxiliary audio source 32 at least one auxiliary audio source 32
  • auxiliary video source 34 at least one auxiliary video source 34
  • facsimile modem 38 a facsimile modem 38
  • other multimedia devices such as a graphic image display 40 or video tape recorder (VCR) 42.
  • VCR video tape recorder
  • Fig. 2 depicts a first embodiment of the videoconferencing system 10 of the present invention which employs a large screen 20, e.g., a seven foot by four foot screen, and is built to be a stationary system in a room designated for multiple person videoconferences.
  • a large screen 20 e.g., a seven foot by four foot screen
  • Fig. 3 depicts a second embodiment of the videoconferencing system 10' of the present invention which employs a portable, roll-around cabinet having a wide- screen 36 inch monitor 44.
  • This embodiment of the present invention is useful for conferees desiring the flexibility of using different rooms for videoconferencing, or who do not wish to dedicate an entire room for videoconferencing.
  • the system 10 is connected to a telecommunications network such as a TI network or an ISDN by a Channel Service Unit (CSU) 50 or an Inverse Multiplexer (IMUX) 52, respectively.
  • the CSU 50 is preferably a model number MB+1CSU-2P Tl/PRI unit manufactured by Ascend Communications, Alameda, California for interfacing with a PRI or TI network.
  • a model number MB+8PRI IMUX 52 manufactured by Ascend Communications is preferably used to interface with an ISDN.
  • Data received from the CSU 50 or IMUX 52 is provided to a coder/decoder (CODEC) 54.
  • the CODEC decodes data received from a remote videoconference site 14 via the Tl or ISDN network.
  • a model number BT VC2300 CODEC manufactured by British Telecom, Reston, Virginia, is preferably used.
  • the CODEC 54 also encodes audio and video data generated by the system 10 for transmission across a network to the remote videoconference site.
  • Video data from the remote videoconference site 14 is provided to the projector 18 via a video transcoder (VID I/O) unit 56 and a scan doubler or enhanced definition encoder (EDC) 58.
  • VID I/O video transcoder
  • EDC enhanced definition encoder
  • the EDC is preferably a model number EDC2000 manufactured by Yamashita Engineering Manufacture, Inc., Kanagawa, Japan.
  • the transcoder 56 is preferably a model number VID I/O manufactured by Truevision, Indianapolis, Indiana.
  • the VID I/O unit 56 transcodes video to a composite format (Y/C) from a component format (RGB) in order to be supplied to the EDC 58.
  • the EDC scan doubler enhances the video prior to projection.
  • the EDC 58 also provides a full-screen preview of what is being transmitted to the remote videoconference site.
  • the projector is preferably a model number ECP3101 ACON projector available from Electrohome, Columbus, Ohio. This type of projector 18 is advantageous because it has advanced functionality such as ACON (automatic convergence) , as well as computer control capability.
  • the scan doubler 58 receives composite video from the camera 16 (e.g., a model number GP-US502 3CCD camera from Panasonic Broadcast and Television, Elgin, Illinois) via a digital video effects (DVE) module 60.
  • the screen 20 used with projector 18 is preferably a single-layer, high gain, Fresnel-lenticular-type screen. For example, a 45 inch by eight inch Diamond Screen, available from Draper Screen Company, Spiceland, Indiana can be used.
  • the projector is connected to a projector communications processor module (CPM) 84, which provides remote projection control via the personal computer 70.
  • the projector 18 can provide high- resolution graphic data from an external computer. Switching between projector sources is provided via the CPM 84.
  • Audio signals received from the remote videoconference site 14 are processed by the CODEC 54 and output to an audio mixer/amplifier unit 62.
  • the audio mixer/amplifier unit 62 preferably comprises a model number 4800-series mixer 64 manufactured by Alternative Electronic Design (IED), Louisville, Kentucky, which mixes inputs from as many as 8 microphones into one signal.
  • the audio mixer/amplifier unit 62 also comprises an IED model number 5000-Series Amplifier chassis 66 which holds cards for performing amplification and mixing, as well as echo cancellation.
  • the audio mixer/amplifier unit 62 receives audio signals from the camera 16 and provides them to the CODEC 54 for transmission to the remote videoconference site 14.
  • the audio system of the present invention preferably uses JBL Control 1 speakers 24 and model numbers PCC-160 and PCC-160W Phase Coherent Cardioid, Crown microphones 22, both of which are available from Communications System Group, Covington, Kentucky.
  • the audio system is provided with between one and four microphones, although more can be used.
  • the system 10 comprises a PLC chassis 68 (e.g, model number LittlePLC manufactured by Zworld Engineering, Davis, California) which encloses cards for controlling audio system volume and black and white balance functions of the camera, as well as other voltage controlled devices via a management system described below. These functions are performed by a personal computer (PC) 70 via the PLC 68.
  • the PC 70 is connected to a touch screen or other user interface 26 and to the projector 18.
  • the system 10 is configured to have a 16 x 9 aspect ratio and to provide full motion video at approximately 30 frames per second at all times.
  • a management software control system is provided in the PC to control devices to perform such functions as providing via a picture-in-picture (PIP) display a preview of the local conference room scene that is be transmitted, master input and output audio control, control of at least one external video source, simplified dialing for commencing communication with the remote videoconference site, automatic convergence, and switching between 16 X 9 and 4 X 3 video aspect ratios.
  • PIP picture-in-picture
  • the flat touch screen interfaces with the management system to receive user input.
  • the system 10 can control extemal audio sources and video sources and perform switching among them.
  • the alternative embodiment of the invention that is, system 10* depicted in Fig. 3, has a number of identical components such as the CSU 50, the IMUX 52, the CODEC 54, the audio mixer/amplifier unit 62, the touch screen 26, the PC 70, the PLC 68, and camera 16 interfaced with the CODEC 54 via a DVE 60.
  • the roll-around model of system 10* comprises a monitor such as a PROSCAN 36 inch HDTV- formatted monitor 44 available from Thompson Consumer Electronics, Indianapolis, Indiana.
  • the monitor 44 provides the projection and speaker systems for the roll- around embodiment of the system 10' .
  • the system 10' has 16 X 9 aspect ratio, full motion video, attempting 30 frames per second at all times.
  • the management software control system for the videoconferencing system 10' also allows for control of at least one external video source and for simplified dialing to commence telecommunication with the remote conference site.
  • the system 10' allows for master input audio control.
  • the system 10' provides for remote control of a number of functions such as PIP preview, television volume control, full screen preview, and aspect ratio switching.
  • the software control or management system for both the videoconferencing system 10 and system 10' is a software application which provides a user-friendly interface to conferees and other users so that they can control and manage the videoconferencing system 10 or 10'.
  • the management system is preferably used in connection with a Windows NT platform. UNIX and OS/2 operating systems can also be used.
  • the management system is modeled as several separate layers, with each layer being responsible for its particular level of functionality within the management system.
  • the management system is designed using an object oriented- type approach wherein each layer in the model has several different objects.
  • An object can represent a collection of methods used to control and manage a particular device such as the CODEC, a collection of devices such as the video components of the system 10, or a conceptual management model.
  • the management system is designed to be quickly adapted to accommodate new devices added to the system 10 or 10', to comply with new international standards regarding, for example, telecommunications and high definition television, as well as to provide a software system that is relatively easily maintained.
  • an infrared (IR) and logic-level control device is provided to allow bidirectional serial control of devices in a videoconferencing system which have, for example, a transistor-transistor logic level or TTL level, variable voltage-level or unidirectional, serial infrared control system.
  • an infrared (IR) and logic-level control device can be provided in the system 10', for example, to allow for software control of IR-controllable components such as the monitor 44.
  • the IR and logic-level control device can also be used, for example, in systems 10 and 10' to control peripheral devices such as a VCR 42 or a compact disc interactive player (CDI).
  • the IR board can be substituted for the PLC 68 and perform the functions of the above-described PLC.
  • the IR and logic-level control device is preferably implemented as a board and mounted into a rack-mountable cage, and shall hereinafter be referred to as the IR board.
  • Figs. 5A and 5B are a schematic diagram of the IR board 86 constructed in accordance an embodiment of the present invention.
  • the IR board 86 preferably comprises a microcontroller 90 and an RS-232 serial port 88 for communicating with the main control processor (not shown) of the PC 70.
  • the microcontroller is connected to an erasable programmable read only memory (EPROM) circuit 94 via a latch 93 and to a random access memory (RAM) circuit 92.
  • EPROM erasable programmable read only memory
  • RAM random access memory
  • the microcontroller receives commands from the main control processor of the PC via its 9 pin D-type connector 88 and RS-232 interface 96.
  • the commands are in accordance with an ASCII protocol.
  • the microcontroller transmits an acknowledgement signal (ACK) to the main control processor of the PC 70 and performs one or more functions in accordance with programmed code including, but not limited to: (1) transmitting IR control signals to a device in a videoconferencing system; (2) reading transistor-transistor logic-level or TTL level inputs from digital input ports; (3) setting TTL states (e.g., high or low) for digital output ports; (4) transmitting variable voltage-level signals (e.g., from 0 to +5 volts DC) to analog output ports; and (5) performing on-board self-diagnostic functions.
  • ACK acknowledgement signal
  • the IR board 86 provides for remote control of a number of video and audio components in a videoconferencing system such as VCRs and televisions.
  • a selected device e.g., a VCR
  • the microcontroller 90 For generating and transmitting serial IR control commands to a selected device (e.g., a VCR), the microcontroller 90 generates a control command.
  • the microcontroller can generate control commands for as many as eight serial IR outputs. It is to be understood that different numbers of serial IR outputs can be provided on the IR board to control a larger or fewer number of devices in accordance with the invention.
  • the microcontroller In accordance with the command inputs, the microcontroller generates output signals that are transmitted to the integrated circuits that need to be activated (e.g., a demultiplexer 100, a latch 102 for TTL outputs, and digital-to-analog converters (DACs) 104 and 106).
  • Each transmitted IR control command comprises two components supplied by the microcontroller: (1) a carrier frequency signal; and (2) a series of TTL pulses which represent the actual command information. These two components are logically summed together via a an open-collector NAND gate for each output.
  • the NAND gates are located on integrated circuits 108 and 110.
  • the NAND gates in turn drive eight respective IR emitters indicated collectively at 112 and remotely located near a desired receiver's window (e.g., the window of an IR-controllable VCR) .
  • the pulse width modulated IR signals are then received and decoded by the desired device, which translates the command information into its corresponding action(s) (e.g., rewind, pause, record).
  • the PC 70 via the IR board 86 can perform switching and otherwise remotely control a number of video and audio devices which can be controlled using TTL logic-level control signals or relay outputs.
  • Such devices can include, for example, voltage-controlled audio systems, pan-tilt-zoom devices for video cameras and LED indicators.
  • An octal latch 102 is connected to buffers 114 and 116, as well as to the decoder 98.
  • the main processor of the PC 70 provides the microcontroller 90 with commands.
  • the microcontroller 90 processes the commands and sets the logic-level of the appropriate output ports in response thereto.
  • the TTL logic-level inputs are provided to the latch 102 when activated by the decoder 98.
  • the inputs are then provided to the buffer 114 or 116, and then to respective ones of the output ports.
  • the output ports are indicated generally at 118. At least two of them are relays.
  • variable voltage-level analog signals are required to, for example, control the volume level of an audio system or to regulate the speed of miniature electric motors, as opposed to TTL logic-level signals.
  • at least two DAC integrated circuits 104 and 106 and their associated hardware are connected to the microcontroller 90.
  • the microcontroller In response to command signals from the main processor of the PC 70, the microcontroller sends input signals to a DAC, which performs conversion functions.
  • the resulting voltage-level analog signals are sent to respective ones of the output ports, which are indicated collectively at 120 and are connected to voltage- level controlled devices.
  • the IR board is configured with a feedback function for IR board diagnostics, and for devices which use TTL logic-level outputs for feedback purposes.
  • the output signals from the DACs (e.g., output ports 120), the IR emitters 112, and the TTL logic-level output ports 118 are provided to multiplexers 122, 124 and 126, respectively.
  • the multiplexer output signals are provided to the microcontroller 90, which runs a diagnostic program stored in the EPROM 94. The program evaluates the status of the IR board functions via the feedback signals of the circuits on the IR board and transmits status signals to the main processor of the PC 70.
  • some devices in a videoconferencing system can provide feedback to the main processor of the PC 70 via the IR board 86, in accordance with the present invention.
  • TTL logic-level signals from external devices are provided to input ports, which are indicated generally at 128, and then to a multiplexer (e.g., an 8x1 multiplexer) 130.
  • the multiplexers 122, 124, 126 and 130 are connected to the microcontroller 90 via a unidirectional buffer 132. After selecting one of the multiplexers, one port on the microcontroller can service a plurality of input signals therefrom. For example, one port on the microcontroller 96 can service TTL logic-level inputs from as many as five external devices.
  • the IR board 86 in Fig. 5 is depicted as comprising integrated circuits, the IR board of the present invention can be implemented other ways such as by using a programmable logic device (PLD) or an application-specific integrated circuit (ASIC) .
  • PLD programmable logic device
  • ASIC application-specific integrated circuit
  • a port on the IR board can be configured to receive IR commands from a hand ⁇ held remote control which are then relayed to the main processor of the PC 70. Certain functions of the PC can therefore be controlled by the hand-held remote control.
  • the program code for the IR board can allow the microcontroller to learn new IR command signals and therefore to control equipment from almost any manufacturer, regardless of IR command structure.
  • the IR board is useful as a system-level controller for desktop video editing systems or essentially any multimedia system comprising a number of devices that need to be controlled simultaneously.
  • a network 140 is provided to support point-to- point or multi-point videoconferencing, and is particularly useful in conjunction with extensive use of multimedia applications.
  • the network 140 comprises a number of nodes 142 (n j> 2).
  • Each node 142 preferably comprises two logically separate components: (1) a control and information transfer (CIT) terminal 144 which is responsible for overall control of the node itself and for managing information transferred to and from the node 142; and (2) an audio and video (AV) terminal 146 for processing audio and video data transferred to and from the node 142.
  • CIT control and information transfer
  • AV audio and video
  • the network 140 can be divided into a local-area network component indicated generally at 148 and a wide-area network component indicated generally at 150.
  • the local area network component 148 comprises a number of nodes 142 in a common geographical area which are each connected to a common server via digital, analog or hybrid digital and analog communication links.
  • a gateway node 152 is provided at the common point to operate as a gateway from the local area network component 148 to the wide area network component 150.
  • the gateway node 152 comprises a CODEC (not shown) and other communication facilities to operate in conjunction with a control server 154 and an AV server 156 translate signals between the local area network and wide area network components 148 and 150, respectively.
  • the gateway is collocated with the AV server and the control server to seize analog lines and to perform routing between and among local nodes, as well as provide access to the wide area network component via the CODEC.
  • the wide area network component 150 provides a communication link between stand-alone nodes and campus-wide networks containing multiple nodes or links multiple networks.
  • the communications link can be implemented using a number of different types of network media, as described below.
  • the network 140 is advantageous because it can support group videoconferencing, and provide, in effect, a parallel networking structure for servicing both the AV terminal and CIT terminal located within each node.
  • a CIT terminal controls preferably all local functions pertaining to the node such as audio and video functions, as well as network control functions (e.g., AV terminal call set-up and tear-down and CIT terminal session connect and disconnect) .
  • network control functions e.g., AV terminal call set-up and tear-down and CIT terminal session connect and disconnect
  • the CIT terminal can be used for any transfer of information for use during a videoconference, that is, non-real-time traffic such as compressed multimedia clips, application documents (e.g., spreadsheets) or graphics files.
  • non-real-time traffic such as compressed multimedia clips, application documents (e.g., spreadsheets) or graphics files.
  • the CIT terminal can also be used for sharing files between or among nodal applications in near-real-time.
  • the AV terminal 144 is preferably used as a stand ⁇ alone processor for transmitting and receiving audio and video data, e.g., a digital AV data stream formatted in accordance with the ITU/T H.320 suite of videoconferencing standards.
  • a AV terminal 144 decodes received audio and video data and presents it to the user, while encoding local audio and video data for transmission to one or more remote nodes.
  • the CIT terminal controls preferably all of the functions of the AV terminal.
  • each of the nodes 142 is similar, regardless of whether the node is part of a local area network (e.g., nodes 142a, 142b and 142c) or a stand- alone node in a wide area network (e.g., 142d) .
  • Options for connecting nodes differ between the local area network component 148 and the wide area network component 150 of the network 140.
  • CIT connectivity is preferably provided by a conventional LAN connection (e.g., Ethernet, token ring or the like).
  • This LAN connection can be either to an existing LAN, or to a separate LAN established for controlling a campus- type videoconferencing system comprising a number of nodes.
  • the LAN for controlling a campus-type videoconferencing system can be connected via a bridge to an existing LAN to maintain centralized network management and resource availability.
  • AV connectivity is preferably accomplished using high-speed digital communication lines (i.e., for compressed audio and video data) or full-bandwidth analog connections.
  • the CIT terminal controls local area rating via the server hub (e.g., the control server and the AV server) in the gateway.
  • CIT connectivity is preferably provided by two types of communications media: (1) a packet-switched network connection 158 for the control portion of the CIT terminal 144 to maintain essentially constant communication with other nodes (e.g,, using the D channel of an ISDN line); and (2) a switched digital connection (e.g., ISDN, FT1) 160 for bandwidth-on-demand.
  • the information transfer portion of a CIT terminal 144 is therefore allowed to accomplish out-of-band file transfers, file sharing and other data-related applications.
  • an in-band information transfer (IT) communications path is provided via optional H.320 time slot usage.
  • AV connectivity which is indicated generally at 162 can be provided by one of a number of high-speed digital communications methods such as ISDN, Tl/El or satellite-based communications.
  • the communication paths 158, 160 and 162 are preferably through public networks.
  • the packet network therefore provides a single network connection that allows for dynamic bandwidth scalability for achieving higher quality of service.
  • the control packet network 158 connected to a CIT terminal provides a future upgrade path to higher- bandwidth, packet-based network services such as asynchronous transfer mode (e.g., ATM, FDDI and such) as upgraded paths become available or are implemented for widespread public use.
  • asynchronous transfer mode e.g., ATM, FDDI and such
  • Fig. 7 provides an expanded view of two exemplary stand-alone nodes 142a and 142d.
  • the node 142a comprises an AV terminal 146a which receives audio and video data from a number of microphones 170 and video devices (e.g.. cameras) 172 via an audio switch 174 and a video switch 176.
  • the audio and video data is provided to a CODEC 178 and an IMUX 180 for transmission to the other node 142d.
  • the AV terminal 146d is also connected to output devices " 5 such as a projector 182 and a screen 184 via a video transceiver (e.g., a VID I/O unit) 186 and at least one speaker 188 via an amplifier 190.
  • output devices " 5 such as a projector 182 and a screen 184 via a video transceiver (e.g., a VID I/O unit) 186 and at least one speaker 188 via an amplifier 190.
  • the AV terminal 142d is also connected to audio and video sources 170 and 172 for generating an AV data stream for transmission to the 0 node 142a, as well as output devices (e.g., a projector 182, a screen 184 and a speaker 188) for the AV data stream received from the node 142a.
  • audio and video sources 170 and 172 for generating an AV data stream for transmission to the 0 node 142a
  • output devices e.g., a projector 182, a screen 184 and a speaker 18
  • a control data communication link 158 is provided in parallel with the 5 audio/video communication link 162.
  • the nodes 142a and 142d each preferably comprise a PC 196 connected to a monitor 198, one or more input devices such as a keyboard 200 and a mouse 202, and an optional printer 204 with scanning and facsimile functions.
  • the CIT terminals 144a 0 and 144d, respectively, are connected to the AV terminals 146a and 146d, respectively, for controlling local audio and video functions, as well as performing other nodal functions such as network control functions.
  • the CIT terminal of each node is connected to the control data 5 communications link 158 via a communications interface 206.
  • the CIT terminals can optionally be connected by another parallel communication link, that is, the information transfer communication link 160 indicated by 0 the phantom communication line in Fig. 7, as needed if out-of-bandwidth file sharing, file transfer or another data-related application involving the nodes 142a and 142d is desired.
  • another parallel communication link that is, the information transfer communication link 160 indicated by 0 the phantom communication line in Fig. 7, as needed if out-of-bandwidth file sharing, file transfer or another data-related application involving the nodes 142a and 142d is desired.
  • an H.320 bit stuffing operation on the AV communication link 162 can be used as an in-band IT communications path.
  • the packet-switched control data communications link 158 is advantageous because it provides common-channel control and signaling, among other reasons.
  • the common-channel connection permits the establishment of dual-mode data communications, that is, in-band and optional out-pf-band communications.
  • the common-channel connection therefore can be used to establish additional bandwidth on a temporary basis for graphics and file transfer, among other data-related applications.
  • the common-channel connection also assists two nodes in establishing a conference through CIT terminal communication.
  • the packet-switched control data communications link 158 is also advantageous because one node can identify the capabilities (e.g., whether or not additional bandwidth is available on demand) of another node via node identification.
  • videoconferencing systems can maintain their own schedules of availability, which can by accessed by nodes to ascertain when a videoconference can be established with that node.
  • the packet network increases ease of access, as an ISDN D channel can provide a 9600 baud, ongoing connection to the packet network for connecting a number of videoconferencing systems to the same network.
  • security is improved since each node is validated by a central server; otherwise, the node does not function in the packet network.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A videoconferencing and multimedia system is provided which comprises a personal computer (70) having an infrared and logic-level control board (86) in a peripheral slot thereof for controlling devices (16, 22, 24, 42, 44) therein via transistor-transistor logic-level signals, serial infrared signals and/or analog control signals such as variable-voltage level signals. The infrared and logic-level control board (86) processes feedback signals for board and external device diagnostics. The multiple nodes (142a-142d) in the videoconferencing system are networked using an audio and video communication link (162) and a parallel control data communication link (158). Another information transfer communication link (160) can be used on demand for file sharing and data transfer operations outside the bandwidth of the videoconference. Nodes (142a-142d) can be in a local area network (148) which is connected to a wide area network (150) via a gateway (152).

Description

VIDEOCONFERENCING AND MULTIMEDIA SYSTEM
This application is a continuation-in-part of U.S. patent application Serial No. 08/440,966, filed May 15, 1995, the entirety of which is hereby incorporated herein by reference for all purposes.
Field of the Invention
The invention relates to a videoconferencing and multimedia system for bi-directional transmission of voice, image data and other data among geographically distributed users. Background of the Invention
The development of two-way videoconferencing systems has provided individuals, who are geographically distributed, with the ability to communicate with each other from their respective locations. Thus, the time and expense of several individuals traveling to a single location in order to meet in person is eliminated. The ability to communicate graphic information, as well as see the facial expressions and gestures of conferees, presents significant improvements over audio telecommunication. A number of video telephones have been developed which interface with analog telephone lines. Due to the limited bandwidth of conventional analog telephone lines, however, the amount of information that can be exchanged is limited to less than full motion video and is typically presented on a relatively small display.
To overcome bandwidth limitations associated with video telephony transmitted over analog telephone lines, a number of videoconferencing systems have been developed to interface with digital telephone access lines such as an integrated services digital network (ISDN). The increased bandwidth associated with digital access systems has allowed for nearly full motion videoconferencing on larger display devices; however, many of these digital videoconferencing systems continue to transmit video information as "jerky motion" and not smooth video. Further, the audio system associated with many of these devices is not a two-way system, that is, a conferee is interrupted and his or her voice is no longer audible if another conferee speaks simultaneously.
Thus, a need remains for improvement of a videoconferencing system to allow for smooth video and bi¬ directional audio. Further, a need exists for improved integration of the videoconferencing system with multimedia devices for sending, for example, graphic information, as well as audio and video data over a digital network. In particular, a need exists for a videoconferencing system wherein documents and other data can be shared during a videoconference without using bandwidth that is necessary for the transmission of audio and video data.
Summary of the Invention
In accordance with an aspect of the present invention, a videoconferencing system is provided which comprises a processor; at least one device connected to the processor selected from a group consisting of an audio device and a video device, the device being controlled in accordance with at least one signal type selected from a group consisting of logic-level signals, serial infrared signals and analog control signals; a control circuit connected to the processor, the processor being programmable to generate a command signal and provide the command signal to the control circuit, the control circuit being configured to process the command signal and to generate an output control signal in accordance with the command signal for transmission to the device and being at least one of the plurality of signal types that is compatible with the device. In accordance with another aspect of the invention, a videoconferencing system is provided which comprises first and second nodes each having at least one audio input device, at least one video input device, at least one audio output device, at least one video output device and a processor, the second node being operable to receive audio and video data generated by the audio input device and the video input device of the first node and to transmit to the first node audio and video data generated by the audio input device and the video input device of the second node; an audio and video data communication link connected to the first node and to the second node; and a control data communication link connected to the first node and to the second node and operable in parallel with the audio and video data communication link. The processor of the first node is programmable to transmit audio and video data generated by its corresponding audio input device and video input device to the second node on the audio and video data communication link, and to generate and transmit control data to the second node on the control data communication link. The processor of the second node is programmable to transmit audio and video data generated by its corresponding audio input device and video input device to the first node on the audio and video data communication link, and to generate and transmit control data to the first node on the control data communication link.
In accordance with yet another aspect of the present invention, a videoconferencing system is provided which also comprises at least one data input device connected to the first node for generating data to be transmitted to the second node during a videoconference; and an information transfer communication link connected to the first node and to the second node and operable in parallel with respect to the control data communication link. The processor in the first node is programmable to transmit the data generated by the data input device to the second mode outside the bandwidth of the audio and video data during a videoconference via the information transfer communication link.
Brief Description of the Drawings
These and other features and advantages of the present invention will be more readily apprehended from the following detailed description when read in connection with the appended drawings, which form a part of this original disclosure, and wherein:
Fig. 1 depicts two videoconferencing systems constructed in accordance with an embodiment of the present invention and located at local and remote videoconference sites, respectively;
Fig. 2 is a schematic block diagram of the videoconferencing system depicted in Fig. 1;
Fig. 3 is a schematic block diagram of a videoconferencing system constructed in accordance with another embodiment of the present invention;
Fig. 4 is an illustration of an infrared and logic- level control device for a videoconferencing system in accordance with an embodiment of the present invention; Fig. 5 is a schematic diagram of the infrared and logic-level control board depicted in Fig. 4 and constructed in accordance with an embodiment of the present invention;
Fig. 6 is a block diagram of network for supporting a videoconferencing system in accordance with an embodiment of the present invention; and
Fig. 7 is a schematic block diagram of two nodes in the network depicted in Fig. 6 and constructed in accordance with an embodiment of the present invention.
Detailed Description of the Preferred Embodiments
Overview Fig. 1 depicts a videoconferencing system 10 located at local videoconference site 12 and constructed in accordance with the present invention, which is in communication with at least one other videoconferencing system 10 located at a remote videoconference site 14. As will be described in further detail below, the videoconferencing system 10 comprises a camera 16, a projector 18 and screen 20, at least one microphone 22, at least one speaker 24, a user interface 26 such as a touch screen and a control unit 28. The control unit controls these devices, as well as processes audio, video and other data that is received from the remote videoconference site 14 or is about to be transmitted thereto. The system 10 can also comprise a network interface 30 to, for example, a local area network (LAN), at least one auxiliary audio source 32, at least one auxiliary video source 34, a facsimile modem 38, and other multimedia devices such as a graphic image display 40 or video tape recorder (VCR) 42.
Fig. 2 depicts a first embodiment of the videoconferencing system 10 of the present invention which employs a large screen 20, e.g., a seven foot by four foot screen, and is built to be a stationary system in a room designated for multiple person videoconferences.
Fig. 3 depicts a second embodiment of the videoconferencing system 10' of the present invention which employs a portable, roll-around cabinet having a wide- screen 36 inch monitor 44. This embodiment of the present invention is useful for conferees desiring the flexibility of using different rooms for videoconferencing, or who do not wish to dedicate an entire room for videoconferencing.
With reference to Fig. 2, the system 10 is connected to a telecommunications network such as a TI network or an ISDN by a Channel Service Unit (CSU) 50 or an Inverse Multiplexer (IMUX) 52, respectively. The CSU 50 is preferably a model number MB+1CSU-2P Tl/PRI unit manufactured by Ascend Communications, Alameda, California for interfacing with a PRI or TI network. A model number MB+8PRI IMUX 52 manufactured by Ascend Communications is preferably used to interface with an ISDN.
Data received from the CSU 50 or IMUX 52 is provided to a coder/decoder (CODEC) 54. The CODEC decodes data received from a remote videoconference site 14 via the Tl or ISDN network. A model number BT VC2300 CODEC manufactured by British Telecom, Reston, Virginia, is preferably used. The CODEC 54 also encodes audio and video data generated by the system 10 for transmission across a network to the remote videoconference site. Video data from the remote videoconference site 14 is provided to the projector 18 via a video transcoder (VID I/O) unit 56 and a scan doubler or enhanced definition encoder (EDC) 58. The EDC is preferably a model number EDC2000 manufactured by Yamashita Engineering Manufacture, Inc., Kanagawa, Japan. The transcoder 56 is preferably a model number VID I/O manufactured by Truevision, Indianapolis, Indiana. The VID I/O unit 56 transcodes video to a composite format (Y/C) from a component format (RGB) in order to be supplied to the EDC 58. The EDC scan doubler enhances the video prior to projection. As will be discussed in further detail below, the EDC 58 also provides a full-screen preview of what is being transmitted to the remote videoconference site.
The projector is preferably a model number ECP3101 ACON projector available from Electrohome, Columbus, Ohio. This type of projector 18 is advantageous because it has advanced functionality such as ACON (automatic convergence) , as well as computer control capability.
The scan doubler 58 receives composite video from the camera 16 (e.g., a model number GP-US502 3CCD camera from Panasonic Broadcast and Television, Elgin, Illinois) via a digital video effects (DVE) module 60. The screen 20 used with projector 18 is preferably a single-layer, high gain, Fresnel-lenticular-type screen. For example, a 45 inch by eight inch Diamond Screen, available from Draper Screen Company, Spiceland, Indiana can be used. The projector is connected to a projector communications processor module (CPM) 84, which provides remote projection control via the personal computer 70. The projector 18 can provide high- resolution graphic data from an external computer. Switching between projector sources is provided via the CPM 84.
Audio signals received from the remote videoconference site 14 are processed by the CODEC 54 and output to an audio mixer/amplifier unit 62. The audio mixer/amplifier unit 62 preferably comprises a model number 4800-series mixer 64 manufactured by Innovative Electronic Design (IED), Louisville, Kentucky, which mixes inputs from as many as 8 microphones into one signal. The audio mixer/amplifier unit 62 also comprises an IED model number 5000-Series Amplifier chassis 66 which holds cards for performing amplification and mixing, as well as echo cancellation. The audio mixer/amplifier unit 62 receives audio signals from the camera 16 and provides them to the CODEC 54 for transmission to the remote videoconference site 14. The audio system of the present invention preferably uses JBL Control 1 speakers 24 and model numbers PCC-160 and PCC-160W Phase Coherent Cardioid, Crown microphones 22, both of which are available from Communications System Group, Covington, Kentucky. The audio system is provided with between one and four microphones, although more can be used.
With continued reference to Fig. 2 , the system 10 comprises a PLC chassis 68 (e.g, model number LittlePLC manufactured by Zworld Engineering, Davis, California) which encloses cards for controlling audio system volume and black and white balance functions of the camera, as well as other voltage controlled devices via a management system described below. These functions are performed by a personal computer (PC) 70 via the PLC 68. The PC 70 is connected to a touch screen or other user interface 26 and to the projector 18. The system 10 is configured to have a 16 x 9 aspect ratio and to provide full motion video at approximately 30 frames per second at all times. A management software control system is provided in the PC to control devices to perform such functions as providing via a picture-in-picture (PIP) display a preview of the local conference room scene that is be transmitted, master input and output audio control, control of at least one external video source, simplified dialing for commencing communication with the remote videoconference site, automatic convergence, and switching between 16 X 9 and 4 X 3 video aspect ratios. The flat touch screen interfaces with the management system to receive user input. The system 10 can control extemal audio sources and video sources and perform switching among them.
The alternative embodiment of the invention, that is, system 10* depicted in Fig. 3, has a number of identical components such as the CSU 50, the IMUX 52, the CODEC 54, the audio mixer/amplifier unit 62, the touch screen 26, the PC 70, the PLC 68, and camera 16 interfaced with the CODEC 54 via a DVE 60. The roll-around model of system 10* comprises a monitor such as a PROSCAN 36 inch HDTV- formatted monitor 44 available from Thompson Consumer Electronics, Indianapolis, Indiana. The monitor 44 provides the projection and speaker systems for the roll- around embodiment of the system 10' .
As with the first embodiment of the system 10, the system 10' has 16 X 9 aspect ratio, full motion video, attempting 30 frames per second at all times. The management software control system for the videoconferencing system 10' also allows for control of at least one external video source and for simplified dialing to commence telecommunication with the remote conference site. The system 10' allows for master input audio control. The system 10' provides for remote control of a number of functions such as PIP preview, television volume control, full screen preview, and aspect ratio switching. The software control or management system for both the videoconferencing system 10 and system 10' is a software application which provides a user-friendly interface to conferees and other users so that they can control and manage the videoconferencing system 10 or 10'. Although the system is independent of whatever operating system it is run on, the management system is preferably used in connection with a Windows NT platform. UNIX and OS/2 operating systems can also be used. For program coding purposes, the management system is modeled as several separate layers, with each layer being responsible for its particular level of functionality within the management system. In addition to being modelled in a layered manner, the management system is designed using an object oriented- type approach wherein each layer in the model has several different objects. An object can represent a collection of methods used to control and manage a particular device such as the CODEC, a collection of devices such as the video components of the system 10, or a conceptual management model. The management system is designed to be quickly adapted to accommodate new devices added to the system 10 or 10', to comply with new international standards regarding, for example, telecommunications and high definition television, as well as to provide a software system that is relatively easily maintained.
Infrared and Logic-Level Control Device
In accordance with a preferred embodiment of the present invention, an infrared (IR) and logic-level control device is provided to allow bidirectional serial control of devices in a videoconferencing system which have, for example, a transistor-transistor logic level or TTL level, variable voltage-level or unidirectional, serial infrared control system. Thus, an infrared (IR) and logic-level control device can be provided in the system 10', for example, to allow for software control of IR-controllable components such as the monitor 44. The IR and logic-level control device can also be used, for example, in systems 10 and 10' to control peripheral devices such as a VCR 42 or a compact disc interactive player (CDI). The IR board can be substituted for the PLC 68 and perform the functions of the above-described PLC.
With reference to Fig. 4, the IR and logic-level control device is preferably implemented as a board and mounted into a rack-mountable cage, and shall hereinafter be referred to as the IR board. Figs. 5A and 5B are a schematic diagram of the IR board 86 constructed in accordance an embodiment of the present invention. With reference to Figs. 4 and 5A and 5B, the IR board 86 preferably comprises a microcontroller 90 and an RS-232 serial port 88 for communicating with the main control processor (not shown) of the PC 70. The microcontroller is connected to an erasable programmable read only memory (EPROM) circuit 94 via a latch 93 and to a random access memory (RAM) circuit 92. The microcontroller receives commands from the main control processor of the PC via its 9 pin D-type connector 88 and RS-232 interface 96. The commands are in accordance with an ASCII protocol. The microcontroller, in turn, transmits an acknowledgement signal (ACK) to the main control processor of the PC 70 and performs one or more functions in accordance with programmed code including, but not limited to: (1) transmitting IR control signals to a device in a videoconferencing system; (2) reading transistor-transistor logic-level or TTL level inputs from digital input ports; (3) setting TTL states (e.g., high or low) for digital output ports; (4) transmitting variable voltage-level signals (e.g., from 0 to +5 volts DC) to analog output ports; and (5) performing on-board self-diagnostic functions.
In accordance with the present invention, the IR board 86 provides for remote control of a number of video and audio components in a videoconferencing system such as VCRs and televisions. For generating and transmitting serial IR control commands to a selected device (e.g., a VCR), the microcontroller 90 generates a control command. The microcontroller can generate control commands for as many as eight serial IR outputs. It is to be understood that different numbers of serial IR outputs can be provided on the IR board to control a larger or fewer number of devices in accordance with the invention. In accordance with the command inputs, the microcontroller generates output signals that are transmitted to the integrated circuits that need to be activated (e.g., a demultiplexer 100, a latch 102 for TTL outputs, and digital-to-analog converters (DACs) 104 and 106). Each transmitted IR control command comprises two components supplied by the microcontroller: (1) a carrier frequency signal; and (2) a series of TTL pulses which represent the actual command information. These two components are logically summed together via a an open-collector NAND gate for each output. The NAND gates are located on integrated circuits 108 and 110. The NAND gates in turn drive eight respective IR emitters indicated collectively at 112 and remotely located near a desired receiver's window (e.g., the window of an IR-controllable VCR) . The pulse width modulated IR signals are then received and decoded by the desired device, which translates the command information into its corresponding action(s) (e.g., rewind, pause, record). The PC 70 via the IR board 86 can perform switching and otherwise remotely control a number of video and audio devices which can be controlled using TTL logic-level control signals or relay outputs. Such devices can include, for example, voltage-controlled audio systems, pan-tilt-zoom devices for video cameras and LED indicators. An octal latch 102 is connected to buffers 114 and 116, as well as to the decoder 98. The main processor of the PC 70 provides the microcontroller 90 with commands. The microcontroller 90 processes the commands and sets the logic-level of the appropriate output ports in response thereto. The TTL logic-level inputs are provided to the latch 102 when activated by the decoder 98. The inputs are then provided to the buffer 114 or 116, and then to respective ones of the output ports. The output ports are indicated generally at 118. At least two of them are relays.
Sometimes variable voltage-level analog signals are required to, for example, control the volume level of an audio system or to regulate the speed of miniature electric motors, as opposed to TTL logic-level signals. To provide variable analog control signals in accordance with the present invention, at least two DAC integrated circuits 104 and 106 and their associated hardware are connected to the microcontroller 90. In response to command signals from the main processor of the PC 70, the microcontroller sends input signals to a DAC, which performs conversion functions. The resulting voltage-level analog signals are sent to respective ones of the output ports, which are indicated collectively at 120 and are connected to voltage- level controlled devices.
In addition to providing different types of output signals with which to control devices in a videoconferencing system, the IR board is configured with a feedback function for IR board diagnostics, and for devices which use TTL logic-level outputs for feedback purposes. The output signals from the DACs (e.g., output ports 120), the IR emitters 112, and the TTL logic-level output ports 118 are provided to multiplexers 122, 124 and 126, respectively. The multiplexer output signals are provided to the microcontroller 90, which runs a diagnostic program stored in the EPROM 94. The program evaluates the status of the IR board functions via the feedback signals of the circuits on the IR board and transmits status signals to the main processor of the PC 70.
As with IR board circuits, some devices in a videoconferencing system can provide feedback to the main processor of the PC 70 via the IR board 86, in accordance with the present invention. For example, TTL logic-level signals from external devices are provided to input ports, which are indicated generally at 128, and then to a multiplexer (e.g., an 8x1 multiplexer) 130.
The multiplexers 122, 124, 126 and 130 are connected to the microcontroller 90 via a unidirectional buffer 132. After selecting one of the multiplexers, one port on the microcontroller can service a plurality of input signals therefrom. For example, one port on the microcontroller 96 can service TTL logic-level inputs from as many as five external devices.
While the IR board 86 in Fig. 5 is depicted as comprising integrated circuits, the IR board of the present invention can be implemented other ways such as by using a programmable logic device (PLD) or an application-specific integrated circuit (ASIC) . In addition, a port on the IR board can be configured to receive IR commands from a hand¬ held remote control which are then relayed to the main processor of the PC 70. Certain functions of the PC can therefore be controlled by the hand-held remote control. Further, the program code for the IR board can allow the microcontroller to learn new IR command signals and therefore to control equipment from almost any manufacturer, regardless of IR command structure. Also, the IR board is useful as a system-level controller for desktop video editing systems or essentially any multimedia system comprising a number of devices that need to be controlled simultaneously.
Videoconferencing Network
In accordance with another embodiment of the present invention, a network 140 is provided to support point-to- point or multi-point videoconferencing, and is particularly useful in conjunction with extensive use of multimedia applications. With reference to Fig. 6, the network 140 comprises a number of nodes 142 (n j> 2). Each node 142 preferably comprises two logically separate components: (1) a control and information transfer (CIT) terminal 144 which is responsible for overall control of the node itself and for managing information transferred to and from the node 142; and (2) an audio and video (AV) terminal 146 for processing audio and video data transferred to and from the node 142.
With continued reference to Fig. 6, the network 140 can be divided into a local-area network component indicated generally at 148 and a wide-area network component indicated generally at 150. The local area network component 148 comprises a number of nodes 142 in a common geographical area which are each connected to a common server via digital, analog or hybrid digital and analog communication links. A gateway node 152 is provided at the common point to operate as a gateway from the local area network component 148 to the wide area network component 150. The gateway node 152 comprises a CODEC (not shown) and other communication facilities to operate in conjunction with a control server 154 and an AV server 156 translate signals between the local area network and wide area network components 148 and 150, respectively. The gateway is collocated with the AV server and the control server to seize analog lines and to perform routing between and among local nodes, as well as provide access to the wide area network component via the CODEC. The wide area network component 150 provides a communication link between stand-alone nodes and campus-wide networks containing multiple nodes or links multiple networks. The communications link can be implemented using a number of different types of network media, as described below. The network 140 is advantageous because it can support group videoconferencing, and provide, in effect, a parallel networking structure for servicing both the AV terminal and CIT terminal located within each node. With regard to the control functions of a CIT terminal 142, a CIT terminal controls preferably all local functions pertaining to the node such as audio and video functions, as well as network control functions (e.g., AV terminal call set-up and tear-down and CIT terminal session connect and disconnect) . Regarding the information transfer functions of a
CIT terminal 142, the CIT terminal can be used for any transfer of information for use during a videoconference, that is, non-real-time traffic such as compressed multimedia clips, application documents (e.g., spreadsheets) or graphics files. The CIT terminal can also be used for sharing files between or among nodal applications in near-real-time.
The AV terminal 144 is preferably used as a stand¬ alone processor for transmitting and receiving audio and video data, e.g., a digital AV data stream formatted in accordance with the ITU/T H.320 suite of videoconferencing standards. In addition to interfacing with other AV terminals across the network, a AV terminal 144 decodes received audio and video data and presents it to the user, while encoding local audio and video data for transmission to one or more remote nodes. The CIT terminal controls preferably all of the functions of the AV terminal. The use of parallel CIT and AV paths, an important principle of the network of the present invention, and the structure for each of the nodes 142 is similar, regardless of whether the node is part of a local area network (e.g., nodes 142a, 142b and 142c) or a stand- alone node in a wide area network (e.g., 142d) . Options for connecting nodes, however, differ between the local area network component 148 and the wide area network component 150 of the network 140.
With regard to local-area connectivity, CIT connectivity is preferably provided by a conventional LAN connection (e.g., Ethernet, token ring or the like). This LAN connection can be either to an existing LAN, or to a separate LAN established for controlling a campus- type videoconferencing system comprising a number of nodes. The LAN for controlling a campus-type videoconferencing system can be connected via a bridge to an existing LAN to maintain centralized network management and resource availability. AV connectivity is preferably accomplished using high-speed digital communication lines (i.e., for compressed audio and video data) or full-bandwidth analog connections. The CIT terminal controls local area rating via the server hub (e.g., the control server and the AV server) in the gateway. With regard to wide-area connectivity, CIT connectivity is preferably provided by two types of communications media: (1) a packet-switched network connection 158 for the control portion of the CIT terminal 144 to maintain essentially constant communication with other nodes (e.g,, using the D channel of an ISDN line); and (2) a switched digital connection (e.g., ISDN, FT1) 160 for bandwidth-on-demand. The information transfer portion of a CIT terminal 144 is therefore allowed to accomplish out-of-band file transfers, file sharing and other data-related applications. For nodes operating on a fixed-bandwidth transmission platform such that no additional bandwidth is available upon demand, an in-band information transfer (IT) communications path is provided via optional H.320 time slot usage. AV connectivity, which is indicated generally at 162, can be provided by one of a number of high-speed digital communications methods such as ISDN, Tl/El or satellite-based communications. The communication paths 158, 160 and 162 are preferably through public networks. The packet network therefore provides a single network connection that allows for dynamic bandwidth scalability for achieving higher quality of service. The control packet network 158 connected to a CIT terminal provides a future upgrade path to higher- bandwidth, packet-based network services such as asynchronous transfer mode (e.g., ATM, FDDI and such) as upgraded paths become available or are implemented for widespread public use.
Fig. 7 provides an expanded view of two exemplary stand-alone nodes 142a and 142d. The node 142a comprises an AV terminal 146a which receives audio and video data from a number of microphones 170 and video devices (e.g.. cameras) 172 via an audio switch 174 and a video switch 176. The audio and video data is provided to a CODEC 178 and an IMUX 180 for transmission to the other node 142d. The AV terminal 146d is also connected to output devices "5 such as a projector 182 and a screen 184 via a video transceiver (e.g., a VID I/O unit) 186 and at least one speaker 188 via an amplifier 190. The AV terminal 142d is also connected to audio and video sources 170 and 172 for generating an AV data stream for transmission to the 0 node 142a, as well as output devices (e.g., a projector 182, a screen 184 and a speaker 188) for the AV data stream received from the node 142a.
With continued reference to Fig. 6, a control data communication link 158 is provided in parallel with the 5 audio/video communication link 162. The nodes 142a and 142d each preferably comprise a PC 196 connected to a monitor 198, one or more input devices such as a keyboard 200 and a mouse 202, and an optional printer 204 with scanning and facsimile functions. The CIT terminals 144a 0 and 144d, respectively, are connected to the AV terminals 146a and 146d, respectively, for controlling local audio and video functions, as well as performing other nodal functions such as network control functions. The CIT terminal of each node is connected to the control data 5 communications link 158 via a communications interface 206.
The CIT terminals can optionally be connected by another parallel communication link, that is, the information transfer communication link 160 indicated by 0 the phantom communication line in Fig. 7, as needed if out-of-bandwidth file sharing, file transfer or another data-related application involving the nodes 142a and 142d is desired. Alternatively, if one of the nodes has a fixed-bandwidth transmission platform, and no additional bandwidth is available on demand, an H.320 bit stuffing operation on the AV communication link 162 can be used as an in-band IT communications path.
The packet-switched control data communications link 158 is advantageous because it provides common-channel control and signaling, among other reasons. As stated previously, the common-channel connection permits the establishment of dual-mode data communications, that is, in-band and optional out-pf-band communications. The common-channel connection therefore can be used to establish additional bandwidth on a temporary basis for graphics and file transfer, among other data-related applications. The common-channel connection also assists two nodes in establishing a conference through CIT terminal communication.
The packet-switched control data communications link 158 is also advantageous because one node can identify the capabilities (e.g., whether or not additional bandwidth is available on demand) of another node via node identification. In addition, videoconferencing systems can maintain their own schedules of availability, which can by accessed by nodes to ascertain when a videoconference can be established with that node. The packet network increases ease of access, as an ISDN D channel can provide a 9600 baud, ongoing connection to the packet network for connecting a number of videoconferencing systems to the same network. Finally, security is improved since each node is validated by a central server; otherwise, the node does not function in the packet network.
While certain advantageous embodiments have been chosen to illustrate the invention, it will be understood by those skilled in the art that various changes and modifications can be made herein without departing from the scope of the invention as defined in the appended claims.

Claims

What Is Claimed Is
1. A videoconferencing system, comprising: a processor; at least one of a plurality of devices connected to said processor comprising an audio device and a video device, said device being controlled in accordance with at least one of a plurality of signal types comprising transistor-transistor logic-level signals, serial infrared signals and analog control signals; a control circuit connected to said processor, said processor being programmable to generate a command signal and provide said command signal to said control circuit, said control circuit being configured to process said command signal and to generate an output control signal in accordance with said command signal for transmission to said device and being at least one of said plurality of signal types that is compatible with said device.
2. A videoconferencing system as claimed in claim 1, wherein said control circuit comprises a second processor configured to communicate with said processor via a serial communication link.
3. A videoconferencing system as claimed in claim 1, wherein said control circuit comprises an input port connected to said device, said device being operable to provide said processor with a status signal indicating operating conditions of said device.
4. A videoconferencing system, comprising: a processor; at least one of a plurality of devices connected to said processor comprising an audio device and a video device; a control circuit connected to said processor, said processor being programmable to generate a command signal and provide said command signal to said control circuit; wherein said device comprises an infrared receiver, said control circuit comprises at least one infrared emitter optically coupled to said infrared receiver and a second processor configured to process said command signal and generate an output signal comprising pulses corresponding to said command signal, said control circuit being operable to generate a carrier frequency signal, to logically combine said output signal with said carrier frequency signal and to transmit said combined signal to said infrared emitter.
5. A videoconferencing system as claimed in claim 4, wherein said control circuit is configured to provide said output signal to said second processor for feedback.
6. A videoconferencing system, comprising: a processor; at least one of a plurality of devices connected to said processor comprising an audio device and a video device; a control circuit connected to said processor, said processor being programmable to generate a command signal and provide said command signal to said control circuit; wherein said device comprises an input port, said control circuit comprises a second processor configured to process said command signal and generate an output signal comprising a transistor-transistor logic-level signal corresponding to said command signal, said control circuit being operable to transmit said output signal to said input port.
7. A videoconferencing system as claimed in claim 6, wherein said control circuit is configured to provide said output signal to said second processor for feedback.
8. A videoconferencing system, comprising: a processor; at least one of a plurality of devices connected to said processor comprising an audio device and a video device; a control circuit connected to said processor, said processor being programmable to generate a command signal and provide said command signal to said control circuit; wherein said device comprises an input port, said control circuit comprises a second processor configured to process said command signal and generate an output signal comprising a variable-voltage level signal corresponding to said command signal, said control circuit being operable to transmit said output signal to said input port.
9. A videoconferencing system as claimed in claim 8, wherein said control circuit is configured to provide said output signal to said second processor for feedback.
10. A method of controlling audio and video devices in a videoconferencing system comprising the steps of: receiving a command signal for controlling a selected one of said audio and video devices; generating a control signal in accordance with said command signal, said control signal being selected from a group of signals consisting of logic-level signals, serial infrared signals and analog control signals so as to be compatible with said selected one of said audio and video devices; and transmitting said control signal to said selected one of said audio and video devices.
11. A method as claimed in claim 10, wherein said control signal is a serial infrared signal comprising a carrier frequency signal and a series of logic-level pulses representing command data in said command signal, and said transmitting step comprises the step of providing said control signal to an infrared emitter.
12. A method as claimed in claim 10, further comprising the steps of: receiving said control signal at said selected one of said audio and video devices; and decoding said control signal into an action to be performed by said selected one of said audio and video devices.
13. A videoconferencing system, comprising: first and second nodes each having at least one audio input device, at least one video input device, at least one audio output device, at least one video output device and a processor, said second node being operable to receive audio and video data generated by said audio input device and said video input device of said first node and to transmit to said first node audio and video data generated by said audio input device and said video input device of said second node; an audio and video data communication link connected to said first node and to said second node; and a control data communication link connected to said first node and to said second node and operable in parallel with said audio and video data communication link; said processor of said first node being programmable to transmit audio and video data generated by corresponding said audio input device and said video input device to said second node on said audio and video
5 data communication link, and to generate and transmit control data to said second node on said control data communication link; said processor of said second node being programmable to transmit audio and video data generated
LO by corresponding said audio input device and said video input device to said first node on said audio and video data communication link, and to generate and transmit control data to said first node on said control data communication link.
L5
14. A videoconferencing system as claimed in claim 13, wherein said control data communications link is a packet switched network.
>0 15. A videoconferencing system as claimed in claim 13, wherein said audio and video communications link is a high speed serial digital communications link.
16. A videoconferencing system as claimed in claim 13, !5 further comprising a third node, a local area network having an audio and video communication path and a separate and parallel control data communication path, a control server and an audio and video server, said audio and video server and said control server being JO operable to connect said third node to said first node via said audio and video communication path and said control data communication path, respectively.
17. A videoconferencing system as claimed in claim 16, further comprising a gateway node, said local area network being connected to said audio and video communication link and said control data communication
*
5 links via said gateway node.
18. A videoconferencing system as claimed in claim 13, further comprising: at least one data input device connected to said 0 first node for generating data to be transmitted to said second node during a videoconference; and an information transfer communication link connected to said first node and to said second node and operable in parallel with respect to said control data 5 communication link, said processor in said first node being programmable to transmit said data generated by said data input device to said second mode outside the bandwidth of said audio and video data during a videoconference via said information transfer 0 communication link.
19. A videoconferencing system as claimed in claim 18, wherein said audio and video communication link is configured to transmit control bits which can be used in 5 a bit stuffing operation to transfer said data along said audio and video communication link using at least a portion of the bandwidth of said audio and video data.
0 20. A method of networking a first node and a second node in a videoconferencing system, comprising the steps of: transmitting audio and video data for a videoconference between said first node and said second node along a first communication path in a network; and transmitting control data for establishing said videoconference and managing said network along a second communication path that is parallel to said first communication path.
21. A method as claimed in claim 20, further comprising the steps of: connecting said first node and said second node to a gateway node; and connecting said gateway node to a third node via first and second communication links, said third node being operable to transmit and receive audio and video data on said first communication link, and to transmit and receive control data along said second communication link.
22. A method as claimed in claim 21, wherein said first communication link is a high speed serial digital communications link.
23. A method as claimed in claim 21, wherein said second communication link is a packet switched network.
PCT/US1996/010017 1995-06-07 1996-06-07 Videoconferencing and multimedia system WO1996041476A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU61704/96A AU6170496A (en) 1995-06-07 1996-06-07 Videoconferencing and multimedia system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US48299195A 1995-06-07 1995-06-07
US08/482,991 1995-06-07

Publications (2)

Publication Number Publication Date
WO1996041476A1 true WO1996041476A1 (en) 1996-12-19
WO1996041476A9 WO1996041476A9 (en) 1997-01-30

Family

ID=23918200

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1996/010017 WO1996041476A1 (en) 1995-06-07 1996-06-07 Videoconferencing and multimedia system

Country Status (2)

Country Link
AU (1) AU6170496A (en)
WO (1) WO1996041476A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0847178A2 (en) * 1996-12-06 1998-06-10 International Business Machines Corporation Multimedia conferencing using parallel networks
EP0955776A1 (en) * 1998-05-07 1999-11-10 Emil Josef Biggel Virtual meeting point
EP1423776A1 (en) * 2001-08-17 2004-06-02 Webemage Corp. Interactive television devices and systems
AU2006202130B2 (en) * 2005-05-24 2008-08-21 Polycom, Inc. A conference unit controlling room functions
US8389224B2 (en) 2004-05-24 2013-03-05 Laboratory Corporation Of America Holdings Assay for analysis of free drug in samples

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4882747A (en) * 1988-05-12 1989-11-21 Jerry Williams Infrared communication apparatus for remote site applications
US5283638A (en) * 1991-04-25 1994-02-01 Compuadd Corporation Multimedia computing and telecommunications workstation
WO1994024804A1 (en) * 1993-04-22 1994-10-27 Stephen Corey Wren System and method for facilitating transactions between central and remote facilities
US5371534A (en) * 1992-07-23 1994-12-06 At&T Corp. ISDN-based system for making a video call

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4882747A (en) * 1988-05-12 1989-11-21 Jerry Williams Infrared communication apparatus for remote site applications
US5283638A (en) * 1991-04-25 1994-02-01 Compuadd Corporation Multimedia computing and telecommunications workstation
US5371534A (en) * 1992-07-23 1994-12-06 At&T Corp. ISDN-based system for making a video call
WO1994024804A1 (en) * 1993-04-22 1994-10-27 Stephen Corey Wren System and method for facilitating transactions between central and remote facilities

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0847178A2 (en) * 1996-12-06 1998-06-10 International Business Machines Corporation Multimedia conferencing using parallel networks
JPH10257190A (en) * 1996-12-06 1998-09-25 Internatl Business Mach Corp <Ibm> Conference server system
EP0847178A3 (en) * 1996-12-06 1999-12-15 International Business Machines Corporation Multimedia conferencing using parallel networks
EP0955776A1 (en) * 1998-05-07 1999-11-10 Emil Josef Biggel Virtual meeting point
EP1423776A1 (en) * 2001-08-17 2004-06-02 Webemage Corp. Interactive television devices and systems
EP1423776A4 (en) * 2001-08-17 2005-11-09 Cyberscan Tech Inc Interactive television devices and systems
US7636931B2 (en) 2001-08-17 2009-12-22 Igt Interactive television devices and systems
US8640153B2 (en) 2001-08-17 2014-01-28 Korishima Property Llc Methods and systems for interactive television
US8389224B2 (en) 2004-05-24 2013-03-05 Laboratory Corporation Of America Holdings Assay for analysis of free drug in samples
US8828671B2 (en) 2004-05-24 2014-09-09 Laboratory Corporation Of America Holdings Simultaneous assay of target and target-drug binding
US8767032B2 (en) 2004-07-21 2014-07-01 Polycom, Inc. Conference unit controlling room functions
AU2006202130B2 (en) * 2005-05-24 2008-08-21 Polycom, Inc. A conference unit controlling room functions

Also Published As

Publication number Publication date
AU6170496A (en) 1996-12-30

Similar Documents

Publication Publication Date Title
US5793415A (en) Videoconferencing and multimedia system
EP0619679B1 (en) Multi-location television conference system and control apparatus
US5509009A (en) Video and aural communications system
EP1491044B1 (en) Telecommunications system
EP0948864B1 (en) Interoffice broadband communication system using twisted pair telephone wires
US20120086769A1 (en) Conference layout control and control protocol
EP1868347A2 (en) Associating independent multimedia sources into a conference call
US6356294B1 (en) Multi-point communication arrangement and method
JP2003532347A (en) Media Role Management in Video Conferencing Networks
CA2256581C (en) Multi-user video switchable translator
CA2174214C (en) Multimedia enabled network
JPH08111858A (en) Video interactive monitor system
WO1996041476A1 (en) Videoconferencing and multimedia system
WO1996041476A9 (en) Videoconferencing and multimedia system
Watanabe et al. Audio and visually augmented teleconferencing
JP3819097B2 (en) Video conference control device
JPH01233869A (en) Picture communication system
JP2902220B2 (en) Teleconference system
WO1998033317A2 (en) System and method for video/audio conferencing
Noore et al. Computer-based multimedia video conferencing system
Joskowicz Video Conferencing Technologies: Past, Present and Future
JP2004282785A (en) Display controlling apparatus and display controlling method
JPH1013804A (en) Multi-location video conference system
WO1997018663A1 (en) Video conference system
GB2402014A (en) Multimedia conference terminal with source selection means

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AT AU AZ BB BG BR BY CA CH CN CZ CZ DE DE DK DK EE EE ES FI FI GB GE HU IL IS JP KE KG KP KR KZ LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SK TJ TM TR TT UA UG UZ VN AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): KE LS MW SD SZ UG AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF

COP Corrected version of pamphlet

Free format text: PAGES 1/8 AND 4/8-8/8,DRAWINGS,REPLACED BY NEW PAGES 1/12 AND 4/12-12/12;PAGES 2/8 AND 3/8 RENUMBERED AS PAGES 2/12 AND 3/12;DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)